2024-05-08T18:20:15.711 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T18:20:15.712 DEBUG:teuthology.run:Teuthology command: teuthology --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} --archive /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697913 --owner scheduled_ivancich@teuthology --name ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi --verbose -- /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697913/orig.config.yaml 2024-05-08T18:20:15.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T18:20:15.826 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697913 branch: wip-upgrade-arrow-15 description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} email: ivancich@redhat.com first_in_suite: false job_id: '7697913' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-upgrade-arrow-15 ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-upgrade-arrow-15 sha1: d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 owner: scheduled_ivancich@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 831 sha1: d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 sleep_before_teardown: 0 subset: 1/50 suite: rgw suite_branch: wip-upgrade-arrow-15 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 targets: smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO8RyI81u3q9M9VM2rWIaf705TfPNUCMdpGPRI1t7Q/fbaLmW5Me38ENLd700SgsfrqEw4/IXQ16VKY+Sv7kzpg= smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPQ246GKy46o1Y9h/xWKxCY9hQHJ+MsYsRAey1aV0eBPnhHpcGKctYDSya+1i+XJq9WhobiDVXxQL0SBysqeicY= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_17:44:56 tube: smithi user: ivancich verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T18:20:15.826 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/qa; will attempt to use it 2024-05-08T18:20:15.827 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/qa/tasks 2024-05-08T18:20:15.827 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T18:20:15.829 INFO:teuthology.task.internal:Checking packages... 2024-05-08T18:20:15.853 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0' 2024-05-08T18:20:15.853 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T18:20:15.853 INFO:teuthology.packaging:ref: None 2024-05-08T18:20:15.853 INFO:teuthology.packaging:tag: None 2024-05-08T18:20:15.853 INFO:teuthology.packaging:branch: wip-upgrade-arrow-15 2024-05-08T18:20:15.853 INFO:teuthology.packaging:sha1: d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 2024-05-08T18:20:15.853 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-upgrade-arrow-15 2024-05-08T18:20:16.076 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3463.gd8e5981c 2024-05-08T18:20:16.078 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T18:20:16.084 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T18:20:16.084 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T18:20:16.127 INFO:teuthology.task.internal:Saving configuration 2024-05-08T18:20:16.139 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T18:20:16.180 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T18:20:16.205 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697913', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 18:15:25.728592', 'locked_by': 'scheduled_ivancich@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO8RyI81u3q9M9VM2rWIaf705TfPNUCMdpGPRI1t7Q/fbaLmW5Me38ENLd700SgsfrqEw4/IXQ16VKY+Sv7kzpg='} 2024-05-08T18:20:16.222 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697913', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 18:15:25.730079', 'locked_by': 'scheduled_ivancich@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPQ246GKy46o1Y9h/xWKxCY9hQHJ+MsYsRAey1aV0eBPnhHpcGKctYDSya+1i+XJq9WhobiDVXxQL0SBysqeicY='} 2024-05-08T18:20:16.223 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T18:20:16.229 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-05-08T18:20:16.229 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-05-08T18:20:16.229 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T18:20:16.313 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe8cd1660d0>, signals=[15]) 2024-05-08T18:20:16.313 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T18:20:16.319 INFO:teuthology.task.internal:Opening connections... 2024-05-08T18:20:16.319 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2024-05-08T18:20:16.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:20:16.401 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-05-08T18:20:16.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:20:16.478 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T18:20:16.484 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2024-05-08T18:20:16.503 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2024-05-08T18:20:16.503 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-05-08T18:20:16.561 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2024-05-08T18:20:16.561 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2024-05-08T18:20:16.561 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2024-05-08T18:20:16.561 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2024-05-08T18:20:16.561 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2024-05-08T18:20:16.561 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2024-05-08T18:20:16.561 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T18:20:16.561 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2024-05-08T18:20:16.561 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2024-05-08T18:20:16.561 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T18:20:16.561 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2024-05-08T18:20:16.561 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T18:20:16.561 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T18:20:16.562 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T18:20:16.562 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-05-08T18:20:16.587 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-05-08T18:20:16.605 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-05-08T18:20:16.605 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-05-08T18:20:16.662 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2024-05-08T18:20:16.662 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2024-05-08T18:20:16.662 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2024-05-08T18:20:16.662 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2024-05-08T18:20:16.662 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2024-05-08T18:20:16.662 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2024-05-08T18:20:16.662 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T18:20:16.663 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2024-05-08T18:20:16.663 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2024-05-08T18:20:16.663 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T18:20:16.663 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2024-05-08T18:20:16.663 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T18:20:16.663 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T18:20:16.663 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T18:20:16.663 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-05-08T18:20:16.687 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T18:20:16.695 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T18:20:16.718 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T18:20:16.718 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2024-05-08T18:20:16.721 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-05-08T18:20:16.737 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T18:20:16.742 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T18:20:16.742 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2024-05-08T18:20:16.778 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-05-08T18:20:16.802 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T18:20:16.856 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T18:20:16.871 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-08T18:20:16.872 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-08T18:20:16.872 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T18:20:16.872 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T18:20:16.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:20:16.889 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-05-08T18:20:16.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:20:16.890 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-05-08T18:20:16.945 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-437.el9.x86_64 2024-05-08T18:20:16.945 INFO:teuthology.task.kernel:Running kernel on smithi087: 5.14.0-437.el9.x86_64 2024-05-08T18:20:16.946 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum install -y kernel 2024-05-08T18:20:16.948 INFO:teuthology.orchestra.run.smithi053.stdout:5.14.0-437.el9.x86_64 2024-05-08T18:20:16.948 INFO:teuthology.task.kernel:Running kernel on smithi053: 5.14.0-437.el9.x86_64 2024-05-08T18:20:16.948 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum install -y kernel 2024-05-08T18:20:19.042 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.1 MB 00:00 2024-05-08T18:20:20.670 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.1 MB 00:02 2024-05-08T18:20:22.627 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 7.8 MB/s | 19 MB 00:02 2024-05-08T18:20:24.755 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 19 MB 00:03 2024-05-08T18:20:27.036 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.2 MB 00:00 2024-05-08T18:20:28.850 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-05-08T18:20:29.778 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 16 kB 00:01 2024-05-08T18:20:30.698 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-05-08T18:20:31.799 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-05-08T18:20:31.879 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-08T18:20:36.991 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-05-08T18:20:37.154 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-08T18:20:38.930 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-08T18:20:38.930 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-08T18:20:39.026 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:20:39.035 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:20:39.035 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-05-08T18:20:39.036 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:20:39.036 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T18:20:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-08T18:20:39.036 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-05-08T18:20:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-08T18:20:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-08T18:20:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-08T18:20:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:20:39.036 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T18:20:39.036 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:20:39.036 INFO:teuthology.orchestra.run.smithi087.stdout:Install 4 Packages 2024-05-08T18:20:39.036 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:20:39.036 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 78 M 2024-05-08T18:20:39.036 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 123 M 2024-05-08T18:20:39.037 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T18:20:39.234 INFO:teuthology.orchestra.run.smithi087.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 4.6 MB/s | 484 kB 00:00 2024-05-08T18:20:39.235 INFO:teuthology.orchestra.run.smithi053.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-08T18:20:39.235 INFO:teuthology.orchestra.run.smithi053.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-08T18:20:39.334 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:20:39.339 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:20:39.339 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-05-08T18:20:39.340 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:20:39.340 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-08T18:20:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-08T18:20:39.340 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-05-08T18:20:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-08T18:20:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-08T18:20:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-08T18:20:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:20:39.340 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-08T18:20:39.340 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:20:39.340 INFO:teuthology.orchestra.run.smithi053.stdout:Install 4 Packages 2024-05-08T18:20:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:20:39.341 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 78 M 2024-05-08T18:20:39.341 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 123 M 2024-05-08T18:20:39.341 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-08T18:20:39.731 INFO:teuthology.orchestra.run.smithi053.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 2.1 MB/s | 484 kB 00:00 2024-05-08T18:20:39.818 INFO:teuthology.orchestra.run.smithi087.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 22 MB/s | 15 MB 00:00 2024-05-08T18:20:40.376 INFO:teuthology.orchestra.run.smithi087.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 27 MB/s | 34 MB 00:01 2024-05-08T18:20:40.935 INFO:teuthology.orchestra.run.smithi087.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 16 MB/s | 28 MB 00:01 2024-05-08T18:20:40.938 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:20:40.938 INFO:teuthology.orchestra.run.smithi087.stdout:Total 41 MB/s | 78 MB 00:01 2024-05-08T18:20:41.612 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T18:20:41.966 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T18:20:41.966 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T18:20:42.031 INFO:teuthology.orchestra.run.smithi053.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 6.1 MB/s | 15 MB 00:02 2024-05-08T18:20:42.879 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T18:20:42.880 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T18:20:43.539 INFO:teuthology.orchestra.run.smithi053.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 7.3 MB/s | 28 MB 00:03 2024-05-08T18:20:45.295 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T18:20:45.993 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-08T18:20:46.077 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T18:20:46.289 INFO:teuthology.orchestra.run.smithi053.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 5.0 MB/s | 34 MB 00:06 2024-05-08T18:20:46.289 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:20:46.289 INFO:teuthology.orchestra.run.smithi053.stdout:Total 11 MB/s | 78 MB 00:06 2024-05-08T18:20:46.997 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-08T18:20:47.404 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-08T18:20:47.405 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-08T18:20:48.357 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-08T18:20:48.358 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-08T18:20:48.740 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T18:20:48.871 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T18:20:50.916 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-08T18:20:51.572 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-08T18:20:51.731 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T18:20:53.615 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T18:20:53.658 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:20:54.528 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T18:20:54.651 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T18:20:58.344 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:20:59.733 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T18:20:59.787 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:21:04.886 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:21:28.123 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:21:28.168 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:21:28.496 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:21:28.496 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-08T18:21:28.496 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T18:21:28.496 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T18:21:29.307 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:21:29.308 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:21:29.308 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T18:21:29.308 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-08T18:21:29.308 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-08T18:21:29.308 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-08T18:21:29.308 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-08T18:21:29.308 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:21:29.308 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:21:29.646 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T18:21:29.758 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T18:21:29.758 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T18:21:29.758 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-08T18:21:29.758 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T18:21:29.758 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T18:21:29.759 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-05-08T18:21:29.759 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi087.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T18:21:29.759 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T18:21:29.808 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T18:21:29.809 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T18:21:29.809 DEBUG:teuthology.orchestra.run.smithi087:> sudo rpm -qi grub2-tools 2024-05-08T18:21:29.849 INFO:teuthology.orchestra.run.smithi087.stdout:Name : grub2-tools 2024-05-08T18:21:29.850 INFO:teuthology.orchestra.run.smithi087.stdout:Epoch : 1 2024-05-08T18:21:29.850 INFO:teuthology.orchestra.run.smithi087.stdout:Version : 2.06 2024-05-08T18:21:29.850 INFO:teuthology.orchestra.run.smithi087.stdout:Release : 68.el9 2024-05-08T18:21:29.850 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: x86_64 2024-05-08T18:21:29.850 INFO:teuthology.orchestra.run.smithi087.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T18:21:29.850 INFO:teuthology.orchestra.run.smithi087.stdout:Group : Unspecified 2024-05-08T18:21:29.850 INFO:teuthology.orchestra.run.smithi087.stdout:Size : 8264254 2024-05-08T18:21:29.850 INFO:teuthology.orchestra.run.smithi087.stdout:License : GPLv3+ 2024-05-08T18:21:29.850 INFO:teuthology.orchestra.run.smithi087.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T18:21:29.850 INFO:teuthology.orchestra.run.smithi087.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T18:21:29.851 INFO:teuthology.orchestra.run.smithi087.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T18:21:29.851 INFO:teuthology.orchestra.run.smithi087.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T18:21:29.851 INFO:teuthology.orchestra.run.smithi087.stdout:Packager : builder@centos.org 2024-05-08T18:21:29.851 INFO:teuthology.orchestra.run.smithi087.stdout:Vendor : CentOS 2024-05-08T18:21:29.851 INFO:teuthology.orchestra.run.smithi087.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T18:21:29.851 INFO:teuthology.orchestra.run.smithi087.stdout:Summary : Support tools for GRUB. 2024-05-08T18:21:29.851 INFO:teuthology.orchestra.run.smithi087.stdout:Description : 2024-05-08T18:21:29.851 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:21:29.851 INFO:teuthology.orchestra.run.smithi087.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T18:21:29.851 INFO:teuthology.orchestra.run.smithi087.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T18:21:29.851 INFO:teuthology.orchestra.run.smithi087.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T18:21:29.851 INFO:teuthology.orchestra.run.smithi087.stdout:hardware devices. 2024-05-08T18:21:29.852 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:21:29.852 INFO:teuthology.orchestra.run.smithi087.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T18:21:29.853 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T18:21:29.853 INFO:teuthology.task.kernel:Updating grub on smithi087 to boot 5.14.0-444.el9.x86_64 2024-05-08T18:21:29.853 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T18:21:30.423 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2024-05-08T18:21:31.754 INFO:teuthology.orchestra.run.smithi087.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T18:21:31.792 INFO:teuthology.orchestra.run.smithi087.stderr:done 2024-05-08T18:21:31.794 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-05-08T18:21:31.814 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.Q35blJcb0M 2024-05-08T18:21:31.814 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Q35blJcb0M 2024-05-08T18:21:31.881 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.Q35blJcb0M 2024-05-08T18:21:32.013 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.Q35blJcb0M is 6KB 2024-05-08T18:21:32.064 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.Q35blJcb0M 2024-05-08T18:21:32.078 DEBUG:teuthology.orchestra.run.smithi087:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T18:21:32.148 INFO:teuthology.orchestra.run.smithi087.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T18:21:32.148 INFO:teuthology.orchestra.run.smithi087.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T18:21:32.148 INFO:teuthology.orchestra.run.smithi087.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T18:21:32.148 INFO:teuthology.orchestra.run.smithi087.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-08T18:21:32.150 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-08T18:21:32.312 DEBUG:teuthology.orchestra.run.smithi087:> sudo shutdown -r now 2024-05-08T18:21:36.017 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:21:36.056 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:21:36.414 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:21:36.414 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-08T18:21:36.414 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T18:21:36.414 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T18:21:37.206 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:21:37.206 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:21:37.206 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-08T18:21:37.207 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-08T18:21:37.207 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-08T18:21:37.207 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-08T18:21:37.207 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-08T18:21:37.207 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:21:37.207 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:21:37.552 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T18:21:37.631 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T18:21:37.631 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T18:21:37.631 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-08T18:21:37.631 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T18:21:37.632 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T18:21:37.632 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-08T18:21:37.632 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi053.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T18:21:37.632 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T18:21:37.683 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T18:21:37.683 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T18:21:37.683 DEBUG:teuthology.orchestra.run.smithi053:> sudo rpm -qi grub2-tools 2024-05-08T18:21:37.718 INFO:teuthology.orchestra.run.smithi053.stdout:Name : grub2-tools 2024-05-08T18:21:37.718 INFO:teuthology.orchestra.run.smithi053.stdout:Epoch : 1 2024-05-08T18:21:37.718 INFO:teuthology.orchestra.run.smithi053.stdout:Version : 2.06 2024-05-08T18:21:37.718 INFO:teuthology.orchestra.run.smithi053.stdout:Release : 68.el9 2024-05-08T18:21:37.718 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: x86_64 2024-05-08T18:21:37.718 INFO:teuthology.orchestra.run.smithi053.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T18:21:37.718 INFO:teuthology.orchestra.run.smithi053.stdout:Group : Unspecified 2024-05-08T18:21:37.718 INFO:teuthology.orchestra.run.smithi053.stdout:Size : 8264254 2024-05-08T18:21:37.718 INFO:teuthology.orchestra.run.smithi053.stdout:License : GPLv3+ 2024-05-08T18:21:37.718 INFO:teuthology.orchestra.run.smithi053.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T18:21:37.718 INFO:teuthology.orchestra.run.smithi053.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T18:21:37.719 INFO:teuthology.orchestra.run.smithi053.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T18:21:37.719 INFO:teuthology.orchestra.run.smithi053.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T18:21:37.719 INFO:teuthology.orchestra.run.smithi053.stdout:Packager : builder@centos.org 2024-05-08T18:21:37.719 INFO:teuthology.orchestra.run.smithi053.stdout:Vendor : CentOS 2024-05-08T18:21:37.719 INFO:teuthology.orchestra.run.smithi053.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T18:21:37.719 INFO:teuthology.orchestra.run.smithi053.stdout:Summary : Support tools for GRUB. 2024-05-08T18:21:37.719 INFO:teuthology.orchestra.run.smithi053.stdout:Description : 2024-05-08T18:21:37.719 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:21:37.719 INFO:teuthology.orchestra.run.smithi053.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T18:21:37.719 INFO:teuthology.orchestra.run.smithi053.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T18:21:37.719 INFO:teuthology.orchestra.run.smithi053.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T18:21:37.719 INFO:teuthology.orchestra.run.smithi053.stdout:hardware devices. 2024-05-08T18:21:37.719 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:21:37.719 INFO:teuthology.orchestra.run.smithi053.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T18:21:37.720 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T18:21:37.720 INFO:teuthology.task.kernel:Updating grub on smithi053 to boot 5.14.0-444.el9.x86_64 2024-05-08T18:21:37.721 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T18:21:38.340 INFO:teuthology.orchestra.run.smithi053.stderr:Generating grub configuration file ... 2024-05-08T18:21:39.674 INFO:teuthology.orchestra.run.smithi053.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T18:21:39.711 INFO:teuthology.orchestra.run.smithi053.stderr:done 2024-05-08T18:21:39.713 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-05-08T18:21:39.728 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.UcWoNMkmm4 2024-05-08T18:21:39.728 DEBUG:teuthology.orchestra.run.smithi053:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.UcWoNMkmm4 2024-05-08T18:21:39.793 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.UcWoNMkmm4 2024-05-08T18:21:39.938 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.UcWoNMkmm4 is 6KB 2024-05-08T18:21:39.986 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.UcWoNMkmm4 2024-05-08T18:21:40.000 DEBUG:teuthology.orchestra.run.smithi053:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T18:21:40.071 INFO:teuthology.orchestra.run.smithi053.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T18:21:40.071 INFO:teuthology.orchestra.run.smithi053.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T18:21:40.071 INFO:teuthology.orchestra.run.smithi053.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T18:21:40.071 INFO:teuthology.orchestra.run.smithi053.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-08T18:21:40.073 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-08T18:21:40.242 DEBUG:teuthology.orchestra.run.smithi053:> sudo shutdown -r now 2024-05-08T18:22:02.334 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-05-08T18:22:02.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-08T18:22:02.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:22:10.250 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-08T18:22:10.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-08T18:22:10.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:22:20.707 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-05-08T18:22:28.638 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-05-08T18:22:29.709 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-08T18:22:29.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:22:37.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-08T18:22:37.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:22:56.031 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-05-08T18:23:08.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-08T18:23:08.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:23:08.379 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-05-08T18:23:08.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-08T18:23:08.784 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-444.el9.x86_64"... 2024-05-08T18:23:08.785 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-05-08T18:23:08.800 INFO:teuthology.orchestra.run.smithi053.stdout:5.14.0-444.el9.x86_64 2024-05-08T18:23:08.800 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-08T18:23:08.800 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T18:23:08.800 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T18:23:09.801 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-08T18:23:09.801 DEBUG:teuthology.orchestra.run.smithi053:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T18:23:09.864 INFO:teuthology.orchestra.run.smithi053.stdout:ttyS1 2024-05-08T18:23:09.904 DEBUG:teuthology.parallel:result is None 2024-05-08T18:23:29.713 DEBUG:teuthology.orchestra.remote:timed out 2024-05-08T18:23:41.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-08T18:23:41.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:23:42.000 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-05-08T18:23:42.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-08T18:23:42.340 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-444.el9.x86_64"... 2024-05-08T18:23:42.340 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-05-08T18:23:42.356 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-444.el9.x86_64 2024-05-08T18:23:42.356 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-08T18:23:42.357 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T18:23:42.357 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T18:23:43.357 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-05-08T18:23:43.357 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T18:23:43.438 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2024-05-08T18:23:43.474 DEBUG:teuthology.parallel:result is None 2024-05-08T18:23:43.474 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T18:23:43.481 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T18:23:43.482 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T18:23:43.485 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T18:23:43.505 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T18:23:43.527 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T18:23:43.569 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T18:23:43.570 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T18:23:43.573 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T18:23:43.611 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T18:23:43.618 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T18:23:43.619 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T18:23:43.645 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T18:23:43.681 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:23:43.687 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:23:43.693 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:23:43.698 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:23:43.700 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T18:23:43.707 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T18:23:43.708 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T18:23:43.738 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T18:23:43.770 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T18:23:43.779 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T18:23:43.779 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T18:23:43.809 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T18:23:43.827 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T18:23:43.912 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T18:23:43.959 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T18:23:44.045 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T18:23:44.089 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:23:44.089 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T18:23:44.158 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T18:23:44.204 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T18:23:44.275 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T18:23:44.366 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T18:23:44.411 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T18:23:44.411 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T18:23:44.481 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2024-05-08T18:23:44.486 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-05-08T18:23:44.536 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T18:23:44.574 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T18:23:44.987 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T18:23:44.996 INFO:teuthology.task.internal:Starting timer... 2024-05-08T18:23:44.996 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T18:23:45.040 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T18:23:45.072 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-08T18:23:45.073 DEBUG:teuthology.orchestra.run.smithi053:> sudo service auditd rotate 2024-05-08T18:23:45.148 INFO:teuthology.orchestra.run.smithi053.stdout:Rotating logs: 2024-05-08T18:23:45.151 DEBUG:teuthology.orchestra.run.smithi087:> sudo service auditd rotate 2024-05-08T18:23:45.194 INFO:teuthology.orchestra.run.smithi087.stdout:Rotating logs: 2024-05-08T18:23:45.195 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T18:23:45.196 DEBUG:teuthology.orchestra.run.smithi053:> /usr/sbin/getenforce 2024-05-08T18:23:45.244 INFO:teuthology.orchestra.run.smithi053.stdout:Permissive 2024-05-08T18:23:45.245 DEBUG:teuthology.orchestra.run.smithi087:> /usr/sbin/getenforce 2024-05-08T18:23:45.273 INFO:teuthology.orchestra.run.smithi087.stdout:Permissive 2024-05-08T18:23:45.273 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi053.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi087.front.sepia.ceph.com': 'permissive'} 2024-05-08T18:23:45.273 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T18:23:45.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:23:45.302 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T18:23:45.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:23:45.341 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T18:23:45.341 DEBUG:teuthology.orchestra.run.smithi053:> sudo /usr/sbin/setenforce permissive 2024-05-08T18:23:45.373 DEBUG:teuthology.orchestra.run.smithi087:> sudo /usr/sbin/setenforce permissive 2024-05-08T18:23:45.409 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T18:23:45.419 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T18:23:45.436 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T18:23:45.438 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi053.front.sepia.ceph.com,smithi087.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T18:27:49.396 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi053.front.sepia.ceph.com'), Remote(name='ubuntu@smithi087.front.sepia.ceph.com')] 2024-05-08T18:27:49.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-08T18:27:49.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:27:49.477 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-05-08T18:27:49.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-08T18:27:49.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-08T18:27:49.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:27:49.645 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-05-08T18:27:49.723 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-08T18:27:49.723 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T18:27:49.734 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T18:27:49.734 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T18:27:49.735 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:27:49.737 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T18:27:49.737 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:27:49.769 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T18:27:49.785 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T18:27:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T18:27:49.806 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T18:27:49.811 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: ntpd: command not found 2024-05-08T18:27:49.823 INFO:teuthology.orchestra.run.smithi053.stdout:506 Cannot talk to daemon 2024-05-08T18:27:49.829 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: ntpd: command not found 2024-05-08T18:27:49.838 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T18:27:49.840 INFO:teuthology.orchestra.run.smithi087.stdout:506 Cannot talk to daemon 2024-05-08T18:27:49.853 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T18:27:49.854 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T18:27:49.868 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T18:27:49.910 INFO:teuthology.orchestra.run.smithi053.stderr:bash: line 1: ntpq: command not found 2024-05-08T18:27:49.913 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T18:27:49.914 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2024-05-08T18:27:49.914 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:27:49.914 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:27:49.914 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:27:49.914 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:27:49.924 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-05-08T18:27:49.927 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T18:27:49.927 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-05-08T18:27:49.927 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:27:49.927 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:27:49.927 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:27:49.927 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:27:49.928 INFO:teuthology.run_tasks:Running task install... 2024-05-08T18:27:49.936 DEBUG:teuthology.task.install:project ceph 2024-05-08T18:27:49.937 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0'}} 2024-05-08T18:27:49.937 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0'} 2024-05-08T18:27:49.937 INFO:teuthology.task.install:Using flavor: default 2024-05-08T18:27:49.943 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T18:27:49.943 INFO:teuthology.task.install:extra packages: [] 2024-05-08T18:27:49.943 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0', 'tag': None, 'wait_for_package': False} 2024-05-08T18:27:49.944 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 2024-05-08T18:27:49.946 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0', 'tag': None, 'wait_for_package': False} 2024-05-08T18:27:49.946 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 2024-05-08T18:27:50.089 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-upgrade-arrow-15/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/centos/9/flavors/default/ 2024-05-08T18:27:50.089 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3463.gd8e5981c 2024-05-08T18:27:50.095 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-upgrade-arrow-15/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/centos/9/flavors/default/ 2024-05-08T18:27:50.095 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3463.gd8e5981c 2024-05-08T18:27:50.205 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-upgrade-arrow-15/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-upgrade-arrow-15/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-upgrade-arrow-15/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T18:27:50.206 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:27:50.206 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T18:27:50.232 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-08T18:27:50.232 DEBUG:teuthology.orchestra.run.smithi053:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T18:27:50.264 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-upgrade-arrow-15/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-upgrade-arrow-15/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-upgrade-arrow-15/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T18:27:50.264 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T18:27:50.264 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T18:27:50.290 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-08T18:27:50.291 DEBUG:teuthology.orchestra.run.smithi087:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T18:27:50.301 DEBUG:teuthology.orchestra.run.smithi053:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T18:27:50.356 DEBUG:teuthology.orchestra.run.smithi087:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T18:27:50.378 DEBUG:teuthology.orchestra.run.smithi053:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T18:27:50.431 DEBUG:teuthology.orchestra.run.smithi087:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T18:27:50.444 INFO:teuthology.orchestra.run.smithi053.stdout:check_obsoletes = 1 2024-05-08T18:27:50.445 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum clean all 2024-05-08T18:27:50.496 INFO:teuthology.orchestra.run.smithi087.stdout:check_obsoletes = 1 2024-05-08T18:27:50.497 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum clean all 2024-05-08T18:27:50.685 INFO:teuthology.orchestra.run.smithi053.stdout:54 files removed 2024-05-08T18:27:50.712 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-radosgw 2024-05-08T18:27:50.728 INFO:teuthology.orchestra.run.smithi087.stdout:54 files removed 2024-05-08T18:27:50.755 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-radosgw 2024-05-08T18:27:51.491 INFO:teuthology.orchestra.run.smithi053.stdout:ceph packages for x86_64 171 kB/s | 84 kB 00:00 2024-05-08T18:27:51.506 INFO:teuthology.orchestra.run.smithi087.stdout:ceph packages for x86_64 176 kB/s | 84 kB 00:00 2024-05-08T18:27:51.849 INFO:teuthology.orchestra.run.smithi087.stdout:ceph noarch packages 41 kB/s | 12 kB 00:00 2024-05-08T18:27:51.850 INFO:teuthology.orchestra.run.smithi053.stdout:ceph noarch packages 39 kB/s | 12 kB 00:00 2024-05-08T18:27:52.266 INFO:teuthology.orchestra.run.smithi087.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-05-08T18:27:52.275 INFO:teuthology.orchestra.run.smithi053.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-05-08T18:27:53.859 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.1 MB 00:01 2024-05-08T18:27:54.324 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.1 MB 00:02 2024-05-08T18:27:55.744 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-05-08T18:27:56.309 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-05-08T18:28:01.470 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.2 MB 00:02 2024-05-08T18:28:02.393 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.2 MB 00:02 2024-05-08T18:28:03.836 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 93 kB/s | 16 kB 00:00 2024-05-08T18:28:03.946 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-05-08T18:28:05.404 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-05-08T18:28:05.966 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-08T18:28:10.638 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-05-08T18:28:11.330 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-08T18:28:13.003 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:28:13.017 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:28:13.018 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-05-08T18:28:13.018 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:28:13.018 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T18:28:13.018 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 11 M 2024-05-08T18:28:13.018 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrading: 2024-05-08T18:28:13.018 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 3.4 M 2024-05-08T18:28:13.018 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 3.1 M 2024-05-08T18:28:13.019 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-05-08T18:28:13.019 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T18:28:13.019 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 5.4 M 2024-05-08T18:28:13.019 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 21 M 2024-05-08T18:28:13.019 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 25 k 2024-05-08T18:28:13.019 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T18:28:13.019 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T18:28:13.019 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T18:28:13.019 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 747 k 2024-05-08T18:28:13.020 INFO:teuthology.orchestra.run.smithi087.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T18:28:13.020 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T18:28:13.020 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T18:28:13.020 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 500 k 2024-05-08T18:28:13.020 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T18:28:13.020 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 5.4 M 2024-05-08T18:28:13.020 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T18:28:13.020 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T18:28:13.020 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T18:28:13.020 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 45 k 2024-05-08T18:28:13.020 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 135 k 2024-05-08T18:28:13.020 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 161 k 2024-05-08T18:28:13.020 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T18:28:13.021 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 321 k 2024-05-08T18:28:13.021 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 298 k 2024-05-08T18:28:13.021 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 99 k 2024-05-08T18:28:13.021 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T18:28:13.021 INFO:teuthology.orchestra.run.smithi087.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T18:28:13.021 INFO:teuthology.orchestra.run.smithi087.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T18:28:13.021 INFO:teuthology.orchestra.run.smithi087.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T18:28:13.021 INFO:teuthology.orchestra.run.smithi087.stdout:Installing weak dependencies: 2024-05-08T18:28:13.021 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T18:28:13.021 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:28:13.021 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T18:28:13.021 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:28:13.021 INFO:teuthology.orchestra.run.smithi087.stdout:Install 30 Packages 2024-05-08T18:28:13.021 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrade 2 Packages 2024-05-08T18:28:13.021 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:28:13.022 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 60 M 2024-05-08T18:28:13.022 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T18:28:13.783 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:28:13.797 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:28:13.797 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-05-08T18:28:13.797 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:28:13.797 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-08T18:28:13.797 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 11 M 2024-05-08T18:28:13.797 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrading: 2024-05-08T18:28:13.797 INFO:teuthology.orchestra.run.smithi053.stdout: librados2 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 3.4 M 2024-05-08T18:28:13.797 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 3.1 M 2024-05-08T18:28:13.797 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-05-08T18:28:13.797 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T18:28:13.797 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 5.4 M 2024-05-08T18:28:13.797 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 21 M 2024-05-08T18:28:13.797 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 25 k 2024-05-08T18:28:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T18:28:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T18:28:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T18:28:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 747 k 2024-05-08T18:28:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T18:28:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T18:28:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T18:28:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 500 k 2024-05-08T18:28:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T18:28:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 5.4 M 2024-05-08T18:28:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T18:28:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T18:28:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T18:28:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 45 k 2024-05-08T18:28:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 135 k 2024-05-08T18:28:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 161 k 2024-05-08T18:28:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T18:28:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 321 k 2024-05-08T18:28:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 298 k 2024-05-08T18:28:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 99 k 2024-05-08T18:28:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T18:28:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T18:28:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T18:28:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T18:28:13.799 INFO:teuthology.orchestra.run.smithi053.stdout:Installing weak dependencies: 2024-05-08T18:28:13.800 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T18:28:13.800 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:28:13.800 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-08T18:28:13.800 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:28:13.800 INFO:teuthology.orchestra.run.smithi053.stdout:Install 30 Packages 2024-05-08T18:28:13.800 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrade 2 Packages 2024-05-08T18:28:13.800 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:28:13.800 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 60 M 2024-05-08T18:28:13.801 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-08T18:28:14.997 INFO:teuthology.orchestra.run.smithi087.stdout:(1/32): ceph-radosgw-19.0.0-3463.gd8e5981c.el9. 6.8 MB/s | 11 MB 00:01 2024-05-08T18:28:15.231 INFO:teuthology.orchestra.run.smithi087.stdout:(2/32): ceph-common-19.0.0-3463.gd8e5981c.el9.x 12 MB/s | 21 MB 00:01 2024-05-08T18:28:15.256 INFO:teuthology.orchestra.run.smithi087.stdout:(3/32): ceph-selinux-19.0.0-3463.gd8e5981c.el9. 97 kB/s | 25 kB 00:00 2024-05-08T18:28:15.373 INFO:teuthology.orchestra.run.smithi087.stdout:(4/32): libcephfs2-19.0.0-3463.gd8e5981c.el9.x8 5.2 MB/s | 747 kB 00:00 2024-05-08T18:28:15.407 INFO:teuthology.orchestra.run.smithi087.stdout:(5/32): libradosstriper1-19.0.0-3463.gd8e5981c. 3.3 MB/s | 500 kB 00:00 2024-05-08T18:28:15.515 INFO:teuthology.orchestra.run.smithi087.stdout:(6/32): python3-ceph-argparse-19.0.0-3463.gd8e5 416 kB/s | 45 kB 00:00 2024-05-08T18:28:15.616 INFO:teuthology.orchestra.run.smithi087.stdout:(7/32): python3-ceph-common-19.0.0-3463.gd8e598 1.3 MB/s | 135 kB 00:00 2024-05-08T18:28:15.716 INFO:teuthology.orchestra.run.smithi087.stdout:(8/32): python3-cephfs-19.0.0-3463.gd8e5981c.el 1.6 MB/s | 161 kB 00:00 2024-05-08T18:28:15.808 INFO:teuthology.orchestra.run.smithi087.stdout:(9/32): python3-rados-19.0.0-3463.gd8e5981c.el9 3.4 MB/s | 321 kB 00:00 2024-05-08T18:28:15.925 INFO:teuthology.orchestra.run.smithi087.stdout:(10/32): librgw2-19.0.0-3463.gd8e5981c.el9.x86_ 9.7 MB/s | 5.4 MB 00:00 2024-05-08T18:28:15.950 INFO:teuthology.orchestra.run.smithi087.stdout:(11/32): python3-rbd-19.0.0-3463.gd8e5981c.el9. 2.1 MB/s | 298 kB 00:00 2024-05-08T18:28:15.993 INFO:teuthology.orchestra.run.smithi087.stdout:(12/32): python3-rgw-19.0.0-3463.gd8e5981c.el9. 1.5 MB/s | 99 kB 00:00 2024-05-08T18:28:16.132 INFO:teuthology.orchestra.run.smithi053.stdout:(1/32): ceph-radosgw-19.0.0-3463.gd8e5981c.el9. 5.0 MB/s | 11 MB 00:02 2024-05-08T18:28:16.134 INFO:teuthology.orchestra.run.smithi087.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 583 kB/s | 107 kB 00:00 2024-05-08T18:28:16.160 INFO:teuthology.orchestra.run.smithi087.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 960 kB/s | 160 kB 00:00 2024-05-08T18:28:16.173 INFO:teuthology.orchestra.run.smithi053.stdout:(2/32): ceph-selinux-19.0.0-3463.gd8e5981c.el9. 608 kB/s | 25 kB 00:00 2024-05-08T18:28:16.185 INFO:teuthology.orchestra.run.smithi087.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 900 kB/s | 45 kB 00:00 2024-05-08T18:28:16.266 INFO:teuthology.orchestra.run.smithi053.stdout:(3/32): libcephfs2-19.0.0-3463.gd8e5981c.el9.x8 7.9 MB/s | 747 kB 00:00 2024-05-08T18:28:16.302 INFO:teuthology.orchestra.run.smithi087.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.5 MB/s | 292 kB 00:00 2024-05-08T18:28:16.353 INFO:teuthology.orchestra.run.smithi087.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 845 kB/s | 42 kB 00:00 2024-05-08T18:28:16.358 INFO:teuthology.orchestra.run.smithi053.stdout:(4/32): libradosstriper1-19.0.0-3463.gd8e5981c. 5.3 MB/s | 500 kB 00:00 2024-05-08T18:28:16.419 INFO:teuthology.orchestra.run.smithi087.stdout:(18/32): ceph-base-19.0.0-3463.gd8e5981c.el9.x8 1.8 MB/s | 5.4 MB 00:02 2024-05-08T18:28:16.453 INFO:teuthology.orchestra.run.smithi087.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-05-08T18:28:16.479 INFO:teuthology.orchestra.run.smithi087.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-05-08T18:28:16.495 INFO:teuthology.orchestra.run.smithi087.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-05-08T18:28:16.529 INFO:teuthology.orchestra.run.smithi087.stdout:(22/32): qatlib-service-24.02.0-1.el9.x86_64.rp 329 kB/s | 36 kB 00:00 2024-05-08T18:28:16.775 INFO:teuthology.orchestra.run.smithi053.stdout:(5/32): ceph-base-19.0.0-3463.gd8e5981c.el9.x86 1.9 MB/s | 5.4 MB 00:02 2024-05-08T18:28:16.871 INFO:teuthology.orchestra.run.smithi087.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 90 kB/s | 26 kB 00:00 2024-05-08T18:28:16.892 INFO:teuthology.orchestra.run.smithi053.stdout:(6/32): librgw2-19.0.0-3463.gd8e5981c.el9.x86_6 10 MB/s | 5.4 MB 00:00 2024-05-08T18:28:16.917 INFO:teuthology.orchestra.run.smithi053.stdout:(7/32): python3-ceph-argparse-19.0.0-3463.gd8e5 318 kB/s | 45 kB 00:00 2024-05-08T18:28:16.942 INFO:teuthology.orchestra.run.smithi053.stdout:(8/32): python3-ceph-common-19.0.0-3463.gd8e598 2.6 MB/s | 135 kB 00:00 2024-05-08T18:28:17.013 INFO:teuthology.orchestra.run.smithi087.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 343 kB/s | 49 kB 00:00 2024-05-08T18:28:17.063 INFO:teuthology.orchestra.run.smithi087.stdout:(25/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 528 kB/s | 309 kB 00:00 2024-05-08T18:28:17.105 INFO:teuthology.orchestra.run.smithi087.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 735 kB/s | 67 kB 00:00 2024-05-08T18:28:17.167 INFO:teuthology.orchestra.run.smithi053.stdout:(9/32): ceph-common-19.0.0-3463.gd8e5981c.el9.x 6.7 MB/s | 21 MB 00:03 2024-05-08T18:28:17.193 INFO:teuthology.orchestra.run.smithi053.stdout:(10/32): python3-cephfs-19.0.0-3463.gd8e5981c.e 585 kB/s | 161 kB 00:00 2024-05-08T18:28:17.218 INFO:teuthology.orchestra.run.smithi053.stdout:(11/32): python3-rados-19.0.0-3463.gd8e5981c.el 1.1 MB/s | 321 kB 00:00 2024-05-08T18:28:17.244 INFO:teuthology.orchestra.run.smithi053.stdout:(12/32): python3-rbd-19.0.0-3463.gd8e5981c.el9. 3.9 MB/s | 298 kB 00:00 2024-05-08T18:28:17.285 INFO:teuthology.orchestra.run.smithi053.stdout:(13/32): python3-rgw-19.0.0-3463.gd8e5981c.el9. 1.1 MB/s | 99 kB 00:00 2024-05-08T18:28:17.361 INFO:teuthology.orchestra.run.smithi053.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 752 kB/s | 107 kB 00:00 2024-05-08T18:28:17.394 INFO:teuthology.orchestra.run.smithi053.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-05-08T18:28:17.428 INFO:teuthology.orchestra.run.smithi053.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 871 kB/s | 160 kB 00:00 2024-05-08T18:28:17.447 INFO:teuthology.orchestra.run.smithi087.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 561 kB/s | 192 kB 00:00 2024-05-08T18:28:17.478 INFO:teuthology.orchestra.run.smithi053.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 846 kB/s | 42 kB 00:00 2024-05-08T18:28:17.545 INFO:teuthology.orchestra.run.smithi053.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-05-08T18:28:17.571 INFO:teuthology.orchestra.run.smithi053.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-05-08T18:28:17.604 INFO:teuthology.orchestra.run.smithi053.stdout:(20/32): librdkafka-1.6.1-102.el9.x86_64.rpm 2.7 MB/s | 662 kB 00:00 2024-05-08T18:28:17.629 INFO:teuthology.orchestra.run.smithi053.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 429 kB/s | 36 kB 00:00 2024-05-08T18:28:17.655 INFO:teuthology.orchestra.run.smithi053.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-05-08T18:28:17.655 INFO:teuthology.orchestra.run.smithi087.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.4 MB/s | 839 kB 00:00 2024-05-08T18:28:17.805 INFO:teuthology.orchestra.run.smithi053.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 173 kB/s | 26 kB 00:00 2024-05-08T18:28:17.922 INFO:teuthology.orchestra.run.smithi053.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 417 kB/s | 49 kB 00:00 2024-05-08T18:28:17.955 INFO:teuthology.orchestra.run.smithi053.stdout:(25/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 881 kB/s | 309 kB 00:00 2024-05-08T18:28:17.980 INFO:teuthology.orchestra.run.smithi053.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-05-08T18:28:18.072 INFO:teuthology.orchestra.run.smithi053.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-05-08T18:28:18.206 INFO:teuthology.orchestra.run.smithi053.stdout:(28/32): libarrow-9.0.0-11.el9.x86_64.rpm 8.0 MB/s | 4.4 MB 00:00 2024-05-08T18:28:18.248 INFO:teuthology.orchestra.run.smithi053.stdout:(29/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.8 MB/s | 839 kB 00:00 2024-05-08T18:28:18.315 INFO:teuthology.orchestra.run.smithi053.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 6.5 MB/s | 1.6 MB 00:00 2024-05-08T18:28:18.331 INFO:teuthology.orchestra.run.smithi087.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 1.8 MB/s | 1.6 MB 00:00 2024-05-08T18:28:18.764 INFO:teuthology.orchestra.run.smithi087.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 1.9 MB/s | 4.4 MB 00:02 2024-05-08T18:28:18.999 INFO:teuthology.orchestra.run.smithi053.stdout:(31/32): librbd1-19.0.0-3463.gd8e5981c.el9.x86_ 4.2 MB/s | 3.1 MB 00:00 2024-05-08T18:28:19.056 INFO:teuthology.orchestra.run.smithi087.stdout:(31/32): librbd1-19.0.0-3463.gd8e5981c.el9.x86_ 4.3 MB/s | 3.1 MB 00:00 2024-05-08T18:28:19.114 INFO:teuthology.orchestra.run.smithi087.stdout:(32/32): librados2-19.0.0-3463.gd8e5981c.el9.x8 2.3 MB/s | 3.4 MB 00:01 2024-05-08T18:28:19.120 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:28:19.120 INFO:teuthology.orchestra.run.smithi087.stdout:Total 9.9 MB/s | 60 MB 00:06 2024-05-08T18:28:19.228 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T18:28:19.264 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T18:28:19.264 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T18:28:19.690 INFO:teuthology.orchestra.run.smithi053.stdout:(32/32): librados2-19.0.0-3463.gd8e5981c.el9.x8 2.3 MB/s | 3.4 MB 00:01 2024-05-08T18:28:19.692 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:28:19.693 INFO:teuthology.orchestra.run.smithi053.stdout:Total 10 MB/s | 60 MB 00:05 2024-05-08T18:28:19.801 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-08T18:28:19.842 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-08T18:28:19.842 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-08T18:28:19.905 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T18:28:19.906 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T18:28:20.493 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-08T18:28:20.493 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-08T18:28:21.324 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T18:28:21.428 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-05-08T18:28:21.462 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-05-08T18:28:21.487 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-05-08T18:28:21.509 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-08T18:28:21.531 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-08T18:28:21.695 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-08T18:28:21.749 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-08T18:28:21.941 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-08T18:28:22.034 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-05-08T18:28:22.063 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-05-08T18:28:22.077 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-05-08T18:28:22.088 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-05-08T18:28:22.110 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-08T18:28:22.141 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-08T18:28:22.196 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 7/34 2024-05-08T18:28:22.292 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 7/34 2024-05-08T18:28:22.297 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-08T18:28:22.357 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-08T18:28:22.384 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rados-2:19.0.0-3463.gd8e5981c.el9.x86_64 8/34 2024-05-08T18:28:22.423 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 9/34 2024-05-08T18:28:22.486 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 9/34 2024-05-08T18:28:22.514 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-05-08T18:28:22.558 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-argparse-2:19.0.0-3463.gd8e5981c.el9. 11/34 2024-05-08T18:28:22.626 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cephfs-2:19.0.0-3463.gd8e5981c.el9.x86_64 12/34 2024-05-08T18:28:22.651 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libradosstriper1-2:19.0.0-3463.gd8e5981c.el9.x86_6 13/34 2024-05-08T18:28:22.715 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3463.gd8e5981c.el9.x86_6 13/34 2024-05-08T18:28:22.740 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-05-08T18:28:22.765 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-05-08T18:28:22.814 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 7/34 2024-05-08T18:28:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-05-08T18:28:22.884 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-05-08T18:28:22.912 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 7/34 2024-05-08T18:28:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-05-08T18:28:22.957 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-05-08T18:28:22.986 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-05-08T18:28:23.006 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rados-2:19.0.0-3463.gd8e5981c.el9.x86_64 8/34 2024-05-08T18:28:23.018 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-05-08T18:28:23.032 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 9/34 2024-05-08T18:28:23.104 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 9/34 2024-05-08T18:28:23.141 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-05-08T18:28:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-argparse-2:19.0.0-3463.gd8e5981c.el9. 11/34 2024-05-08T18:28:23.272 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cephfs-2:19.0.0-3463.gd8e5981c.el9.x86_64 12/34 2024-05-08T18:28:23.301 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libradosstriper1-2:19.0.0-3463.gd8e5981c.el9.x86_6 13/34 2024-05-08T18:28:23.333 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-05-08T18:28:23.357 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3463.gd8e5981c.el9.x86_6 13/34 2024-05-08T18:28:23.381 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 22/34 2024-05-08T18:28:23.391 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-05-08T18:28:23.471 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 22/34 2024-05-08T18:28:23.503 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 23/34 2024-05-08T18:28:23.504 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-05-08T18:28:23.537 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-05-08T18:28:23.547 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-05-08T18:28:23.595 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-05-08T18:28:23.624 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-05-08T18:28:23.653 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-05-08T18:28:23.686 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-05-08T18:28:24.023 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-05-08T18:28:24.029 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-05-08T18:28:24.051 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librgw2-2:19.0.0-3463.gd8e5981c.el9.x86_64 26/34 2024-05-08T18:28:24.065 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 22/34 2024-05-08T18:28:24.105 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librgw2-2:19.0.0-3463.gd8e5981c.el9.x86_64 26/34 2024-05-08T18:28:24.158 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 22/34 2024-05-08T18:28:24.174 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 27/34 2024-05-08T18:28:24.187 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 23/34 2024-05-08T18:28:24.203 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-common-2:19.0.0-3463.gd8e5981c.el9.x8 28/34 2024-05-08T18:28:24.232 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-05-08T18:28:24.737 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-05-08T18:28:24.776 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librgw2-2:19.0.0-3463.gd8e5981c.el9.x86_64 26/34 2024-05-08T18:28:24.848 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librgw2-2:19.0.0-3463.gd8e5981c.el9.x86_64 26/34 2024-05-08T18:28:24.928 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 27/34 2024-05-08T18:28:24.962 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-common-2:19.0.0-3463.gd8e5981c.el9.x8 28/34 2024-05-08T18:28:26.555 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 29/34 2024-05-08T18:28:26.609 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 29/34 2024-05-08T18:28:27.180 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 29/34 2024-05-08T18:28:27.213 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 30/34 2024-05-08T18:28:27.322 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 30/34 2024-05-08T18:28:27.322 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T18:28:27.323 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T18:28:27.323 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:28:27.364 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-selinux-2:19.0.0-3463.gd8e5981c.el9.x86_64 31/34 2024-05-08T18:28:27.379 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 29/34 2024-05-08T18:28:27.509 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 29/34 2024-05-08T18:28:28.101 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 29/34 2024-05-08T18:28:28.138 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 30/34 2024-05-08T18:28:28.230 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 30/34 2024-05-08T18:28:28.230 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T18:28:28.230 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T18:28:28.230 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:28:28.264 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-selinux-2:19.0.0-3463.gd8e5981c.el9.x86_64 31/34 2024-05-08T18:28:36.849 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3463.gd8e5981c.el9.x86_64 31/34 2024-05-08T18:28:36.849 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /sys 2024-05-08T18:28:36.849 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /proc 2024-05-08T18:28:36.849 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /mnt 2024-05-08T18:28:36.849 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /var/tmp 2024-05-08T18:28:36.849 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /home 2024-05-08T18:28:36.849 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /root 2024-05-08T18:28:36.849 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /tmp 2024-05-08T18:28:36.850 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:28:37.815 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-radosgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 32/34 2024-05-08T18:28:37.841 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 32/34 2024-05-08T18:28:37.842 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:28:37.842 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T18:28:37.842 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:28:37.842 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:28:37.842 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:28:37.843 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-08T18:28:37.926 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-08T18:28:37.926 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T18:28:38.339 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3463.gd8e5981c.el9.x86_64 31/34 2024-05-08T18:28:38.339 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /sys 2024-05-08T18:28:38.339 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /proc 2024-05-08T18:28:38.339 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /mnt 2024-05-08T18:28:38.339 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /var/tmp 2024-05-08T18:28:38.339 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /home 2024-05-08T18:28:38.339 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /root 2024-05-08T18:28:38.339 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /tmp 2024-05-08T18:28:38.339 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:28:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T18:28:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/34 2024-05-08T18:28:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/34 2024-05-08T18:28:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-radosgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 3/34 2024-05-08T18:28:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-selinux-2:19.0.0-3463.gd8e5981c.el9.x86_64 4/34 2024-05-08T18:28:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 5/34 2024-05-08T18:28:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libradosstriper1-2:19.0.0-3463.gd8e5981c.el9.x86_6 6/34 2024-05-08T18:28:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librgw2-2:19.0.0-3463.gd8e5981c.el9.x86_64 7/34 2024-05-08T18:28:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3463.gd8e5981c.el9. 8/34 2024-05-08T18:28:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-common-2:19.0.0-3463.gd8e5981c.el9.x8 9/34 2024-05-08T18:28:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cephfs-2:19.0.0-3463.gd8e5981c.el9.x86_64 10/34 2024-05-08T18:28:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rados-2:19.0.0-3463.gd8e5981c.el9.x86_64 11/34 2024-05-08T18:28:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 12/34 2024-05-08T18:28:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 13/34 2024-05-08T18:28:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-05-08T18:28:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-05-08T18:28:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-05-08T18:28:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-05-08T18:28:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-05-08T18:28:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-05-08T18:28:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-05-08T18:28:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-05-08T18:28:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-05-08T18:28:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-05-08T18:28:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-05-08T18:28:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-05-08T18:28:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-05-08T18:28:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-05-08T18:28:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-05-08T18:28:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-05-08T18:28:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-05-08T18:28:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 31/34 2024-05-08T18:28:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-05-08T18:28:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 33/34 2024-05-08T18:28:39.359 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-radosgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 32/34 2024-05-08T18:28:39.385 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 32/34 2024-05-08T18:28:39.386 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:28:39.386 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T18:28:39.386 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:28:39.386 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:28:39.387 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:28:39.388 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-08T18:28:39.478 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-08T18:28:39.478 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T18:28:39.935 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T18:28:39.935 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:28:39.935 INFO:teuthology.orchestra.run.smithi087.stdout:Upgraded: 2024-05-08T18:28:39.935 INFO:teuthology.orchestra.run.smithi087.stdout: librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:39.935 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:39.936 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T18:28:39.936 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T18:28:39.936 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:39.936 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:39.936 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:39.936 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:39.936 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T18:28:39.936 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T18:28:39.936 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T18:28:39.936 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:39.936 INFO:teuthology.orchestra.run.smithi087.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T18:28:39.937 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T18:28:39.937 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T18:28:39.937 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:39.937 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T18:28:39.937 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:39.937 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T18:28:39.937 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T18:28:39.937 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T18:28:39.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:39.938 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:39.938 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:39.938 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T18:28:39.938 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:39.938 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:39.938 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:39.938 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T18:28:39.938 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T18:28:39.938 INFO:teuthology.orchestra.run.smithi087.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T18:28:39.938 INFO:teuthology.orchestra.run.smithi087.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T18:28:39.938 INFO:teuthology.orchestra.run.smithi087.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T18:28:39.938 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:28:39.938 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:28:40.281 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-test 2024-05-08T18:28:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T18:28:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/34 2024-05-08T18:28:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/34 2024-05-08T18:28:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-radosgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 3/34 2024-05-08T18:28:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-selinux-2:19.0.0-3463.gd8e5981c.el9.x86_64 4/34 2024-05-08T18:28:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 5/34 2024-05-08T18:28:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libradosstriper1-2:19.0.0-3463.gd8e5981c.el9.x86_6 6/34 2024-05-08T18:28:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librgw2-2:19.0.0-3463.gd8e5981c.el9.x86_64 7/34 2024-05-08T18:28:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3463.gd8e5981c.el9. 8/34 2024-05-08T18:28:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-common-2:19.0.0-3463.gd8e5981c.el9.x8 9/34 2024-05-08T18:28:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cephfs-2:19.0.0-3463.gd8e5981c.el9.x86_64 10/34 2024-05-08T18:28:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rados-2:19.0.0-3463.gd8e5981c.el9.x86_64 11/34 2024-05-08T18:28:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 12/34 2024-05-08T18:28:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 13/34 2024-05-08T18:28:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-05-08T18:28:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-05-08T18:28:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-05-08T18:28:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-05-08T18:28:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-05-08T18:28:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-05-08T18:28:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-05-08T18:28:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-05-08T18:28:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-05-08T18:28:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-05-08T18:28:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-05-08T18:28:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-05-08T18:28:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-05-08T18:28:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-05-08T18:28:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-05-08T18:28:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-05-08T18:28:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-05-08T18:28:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 31/34 2024-05-08T18:28:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-05-08T18:28:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 33/34 2024-05-08T18:28:40.853 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:30 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:28:40.974 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:28:40.975 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:28:40.975 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-05-08T18:28:40.975 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:28:40.975 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T18:28:40.975 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 49 M 2024-05-08T18:28:40.975 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-05-08T18:28:40.975 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 163 k 2024-05-08T18:28:40.975 INFO:teuthology.orchestra.run.smithi087.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T18:28:40.976 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T18:28:40.976 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:28:40.976 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T18:28:40.976 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:28:40.976 INFO:teuthology.orchestra.run.smithi087.stdout:Install 4 Packages 2024-05-08T18:28:40.976 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:28:40.976 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 50 M 2024-05-08T18:28:40.977 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 211 M 2024-05-08T18:28:40.977 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T18:28:41.341 INFO:teuthology.orchestra.run.smithi087.stdout:(1/4): libcephsqlite-19.0.0-3463.gd8e5981c.el9. 509 kB/s | 163 kB 00:00 2024-05-08T18:28:41.367 INFO:teuthology.orchestra.run.smithi087.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 881 kB/s | 305 kB 00:00 2024-05-08T18:28:41.508 INFO:teuthology.orchestra.run.smithi087.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 382 kB/s | 64 kB 00:00 2024-05-08T18:28:41.552 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T18:28:41.552 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:28:41.552 INFO:teuthology.orchestra.run.smithi053.stdout:Upgraded: 2024-05-08T18:28:41.552 INFO:teuthology.orchestra.run.smithi053.stdout: librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:41.552 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:41.553 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-08T18:28:41.553 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T18:28:41.553 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:41.553 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:41.553 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:41.553 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:41.553 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T18:28:41.553 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T18:28:41.553 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T18:28:41.553 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:41.553 INFO:teuthology.orchestra.run.smithi053.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T18:28:41.553 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T18:28:41.554 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T18:28:41.554 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:41.554 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T18:28:41.554 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:41.554 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T18:28:41.554 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T18:28:41.555 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T18:28:41.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:41.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:41.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:41.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T18:28:41.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:41.556 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:41.556 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:41.556 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T18:28:41.556 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T18:28:41.556 INFO:teuthology.orchestra.run.smithi053.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T18:28:41.556 INFO:teuthology.orchestra.run.smithi053.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T18:28:41.556 INFO:teuthology.orchestra.run.smithi053.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T18:28:41.556 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:28:41.556 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:28:41.904 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-test 2024-05-08T18:28:42.493 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:31 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:28:42.618 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:28:42.619 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:28:42.619 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-05-08T18:28:42.619 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:28:42.619 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-08T18:28:42.619 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 49 M 2024-05-08T18:28:42.619 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-05-08T18:28:42.619 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 163 k 2024-05-08T18:28:42.619 INFO:teuthology.orchestra.run.smithi053.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T18:28:42.619 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T18:28:42.619 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:28:42.620 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-08T18:28:42.620 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:28:42.620 INFO:teuthology.orchestra.run.smithi053.stdout:Install 4 Packages 2024-05-08T18:28:42.620 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:28:42.620 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 50 M 2024-05-08T18:28:42.620 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 211 M 2024-05-08T18:28:42.621 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-08T18:28:42.817 INFO:teuthology.orchestra.run.smithi053.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.9 MB/s | 305 kB 00:00 2024-05-08T18:28:42.867 INFO:teuthology.orchestra.run.smithi053.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-05-08T18:28:43.242 INFO:teuthology.orchestra.run.smithi053.stdout:(3/4): libcephsqlite-19.0.0-3463.gd8e5981c.el9. 280 kB/s | 163 kB 00:00 2024-05-08T18:28:43.717 INFO:teuthology.orchestra.run.smithi087.stdout:(4/4): ceph-test-19.0.0-3463.gd8e5981c.el9.x86_ 18 MB/s | 49 MB 00:02 2024-05-08T18:28:43.719 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:28:43.719 INFO:teuthology.orchestra.run.smithi087.stdout:Total 18 MB/s | 50 MB 00:02 2024-05-08T18:28:43.746 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T18:28:43.766 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T18:28:43.766 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T18:28:44.138 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T18:28:44.138 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T18:28:44.667 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T18:28:44.750 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-08T18:28:44.799 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-08T18:28:44.827 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephsqlite-2:19.0.0-3463.gd8e5981c.el9.x86_64 3/4 2024-05-08T18:28:49.503 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3463.gd8e5981c.el9.x86_64 3/4 2024-05-08T18:28:49.575 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-test-2:19.0.0-3463.gd8e5981c.el9.x86_64 4/4 2024-05-08T18:28:52.068 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-test-2:19.0.0-3463.gd8e5981c.el9.x86_64 4/4 2024-05-08T18:28:52.068 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-test-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/4 2024-05-08T18:28:52.069 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephsqlite-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/4 2024-05-08T18:28:52.069 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-08T18:28:52.332 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-08T18:28:52.332 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:28:52.332 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T18:28:52.332 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:52.332 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:28:52.332 INFO:teuthology.orchestra.run.smithi087.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T18:28:52.332 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T18:28:52.332 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:28:52.332 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:28:52.606 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph 2024-05-08T18:28:52.892 INFO:teuthology.orchestra.run.smithi053.stdout:(4/4): ceph-test-19.0.0-3463.gd8e5981c.el9.x86_ 4.8 MB/s | 49 MB 00:10 2024-05-08T18:28:52.894 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:28:52.894 INFO:teuthology.orchestra.run.smithi053.stdout:Total 4.8 MB/s | 50 MB 00:10 2024-05-08T18:28:52.922 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-08T18:28:52.944 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-08T18:28:52.944 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-08T18:28:53.173 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:43 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:28:53.298 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:28:53.301 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:28:53.301 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-05-08T18:28:53.301 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:28:53.301 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T18:28:53.301 INFO:teuthology.orchestra.run.smithi087.stdout: ceph x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 6.6 k 2024-05-08T18:28:53.301 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-05-08T18:28:53.301 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 2.4 M 2024-05-08T18:28:53.301 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 1.5 M 2024-05-08T18:28:53.301 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 274 k 2024-05-08T18:28:53.301 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 4.7 M 2024-05-08T18:28:53.301 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 17 M 2024-05-08T18:28:53.301 INFO:teuthology.orchestra.run.smithi087.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T18:28:53.301 INFO:teuthology.orchestra.run.smithi087.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T18:28:53.302 INFO:teuthology.orchestra.run.smithi087.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T18:28:53.302 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T18:28:53.302 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T18:28:53.302 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T18:28:53.302 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T18:28:53.302 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T18:28:53.302 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T18:28:53.302 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T18:28:53.302 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections 2024-05-08T18:28:53.302 INFO:teuthology.orchestra.run.smithi087.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-05-08T18:28:53.302 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T18:28:53.302 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T18:28:53.302 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T18:28:53.303 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T18:28:53.303 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T18:28:53.303 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T18:28:53.303 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T18:28:53.303 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T18:28:53.303 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T18:28:53.303 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T18:28:53.303 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T18:28:53.303 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T18:28:53.303 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T18:28:53.303 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T18:28:53.303 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T18:28:53.303 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T18:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T18:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T18:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T18:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T18:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout:Install 36 Packages 2024-05-08T18:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:28:53.305 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 30 M 2024-05-08T18:28:53.305 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 108 M 2024-05-08T18:28:53.305 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T18:28:53.337 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-08T18:28:53.337 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-08T18:28:53.889 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-08T18:28:53.984 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-08T18:28:54.033 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-08T18:28:54.060 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephsqlite-2:19.0.0-3463.gd8e5981c.el9.x86_64 3/4 2024-05-08T18:28:54.103 INFO:teuthology.orchestra.run.smithi087.stdout:(1/36): ceph-19.0.0-3463.gd8e5981c.el9.x86_64.r 34 kB/s | 6.6 kB 00:00 2024-05-08T18:28:54.320 INFO:teuthology.orchestra.run.smithi087.stdout:(2/36): ceph-mgr-19.0.0-3463.gd8e5981c.el9.x86_ 3.7 MB/s | 1.5 MB 00:00 2024-05-08T18:28:54.362 INFO:teuthology.orchestra.run.smithi087.stdout:(3/36): ceph-mds-19.0.0-3463.gd8e5981c.el9.x86_ 5.2 MB/s | 2.4 MB 00:00 2024-05-08T18:28:54.446 INFO:teuthology.orchestra.run.smithi087.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3463.gd8e5 3.2 MB/s | 274 kB 00:00 2024-05-08T18:28:54.587 INFO:teuthology.orchestra.run.smithi087.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-05-08T18:28:54.688 INFO:teuthology.orchestra.run.smithi087.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 12 MB/s | 1.2 MB 00:00 2024-05-08T18:28:54.738 INFO:teuthology.orchestra.run.smithi087.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-05-08T18:28:54.789 INFO:teuthology.orchestra.run.smithi087.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-05-08T18:28:54.830 INFO:teuthology.orchestra.run.smithi087.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-05-08T18:28:54.939 INFO:teuthology.orchestra.run.smithi087.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 1.9 MB/s | 215 kB 00:00 2024-05-08T18:28:55.223 INFO:teuthology.orchestra.run.smithi087.stdout:(11/36): ceph-osd-19.0.0-3463.gd8e5981c.el9.x86 19 MB/s | 17 MB 00:00 2024-05-08T18:28:55.289 INFO:teuthology.orchestra.run.smithi087.stdout:(12/36): ceph-mon-19.0.0-3463.gd8e5981c.el9.x86 4.0 MB/s | 4.7 MB 00:01 2024-05-08T18:28:55.932 INFO:teuthology.orchestra.run.smithi087.stdout:(13/36): lua-5.4.4-4.el9.x86_64.rpm 190 kB/s | 188 kB 00:00 2024-05-08T18:28:55.957 INFO:teuthology.orchestra.run.smithi087.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 52 kB/s | 35 kB 00:00 2024-05-08T18:28:56.065 INFO:teuthology.orchestra.run.smithi087.stdout:(15/36): python3-mako-1.1.4-6.el9.noarch.rpm 204 kB/s | 172 kB 00:00 2024-05-08T18:28:56.341 INFO:teuthology.orchestra.run.smithi087.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 81 kB/s | 22 kB 00:00 2024-05-08T18:28:56.658 INFO:teuthology.orchestra.run.smithi087.stdout:(17/36): python3-pytz-2021.1-5.el9.noarch.rpm 70 kB/s | 51 kB 00:00 2024-05-08T18:28:56.691 INFO:teuthology.orchestra.run.smithi087.stdout:(18/36): python3-toml-0.10.2-6.el9.noarch.rpm 57 kB/s | 42 kB 00:00 2024-05-08T18:28:56.875 INFO:teuthology.orchestra.run.smithi087.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 283 kB/s | 151 kB 00:00 2024-05-08T18:28:57.067 INFO:teuthology.orchestra.run.smithi087.stdout:(20/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 106 kB/s | 43 kB 00:00 2024-05-08T18:28:57.108 INFO:teuthology.orchestra.run.smithi087.stdout:(21/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-05-08T18:28:57.176 INFO:teuthology.orchestra.run.smithi087.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 98 kB/s | 11 kB 00:00 2024-05-08T18:28:57.209 INFO:teuthology.orchestra.run.smithi087.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 176 kB/s | 18 kB 00:00 2024-05-08T18:28:57.251 INFO:teuthology.orchestra.run.smithi087.stdout:(24/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 307 kB/s | 172 kB 00:00 2024-05-08T18:28:57.301 INFO:teuthology.orchestra.run.smithi087.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 184 kB/s | 23 kB 00:00 2024-05-08T18:28:57.326 INFO:teuthology.orchestra.run.smithi087.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 166 kB/s | 19 kB 00:00 2024-05-08T18:28:57.352 INFO:teuthology.orchestra.run.smithi087.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 196 kB/s | 20 kB 00:00 2024-05-08T18:28:57.435 INFO:teuthology.orchestra.run.smithi087.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 726 kB/s | 79 kB 00:00 2024-05-08T18:28:57.461 INFO:teuthology.orchestra.run.smithi087.stdout:(29/36): python3-logutils-0.3.5-21.el9.noarch.r 291 kB/s | 46 kB 00:00 2024-05-08T18:28:57.536 INFO:teuthology.orchestra.run.smithi087.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 164 kB/s | 16 kB 00:00 2024-05-08T18:28:57.561 INFO:teuthology.orchestra.run.smithi087.stdout:(31/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-05-08T18:28:57.637 INFO:teuthology.orchestra.run.smithi087.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 357 kB/s | 36 kB 00:00 2024-05-08T18:28:57.662 INFO:teuthology.orchestra.run.smithi087.stdout:(33/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 448 kB/s | 90 kB 00:00 2024-05-08T18:28:57.687 INFO:teuthology.orchestra.run.smithi087.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-05-08T18:28:57.771 INFO:teuthology.orchestra.run.smithi087.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 184 kB/s | 20 kB 00:00 2024-05-08T18:28:57.796 INFO:teuthology.orchestra.run.smithi087.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.6 MB/s | 427 kB 00:00 2024-05-08T18:28:57.802 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:28:57.802 INFO:teuthology.orchestra.run.smithi087.stdout:Total 6.7 MB/s | 30 MB 00:04 2024-05-08T18:28:57.947 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T18:28:57.987 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T18:28:57.987 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T18:28:58.420 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T18:28:58.420 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T18:28:59.041 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3463.gd8e5981c.el9.x86_64 3/4 2024-05-08T18:28:59.120 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-test-2:19.0.0-3463.gd8e5981c.el9.x86_64 4/4 2024-05-08T18:28:59.696 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T18:28:59.758 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-05-08T18:28:59.789 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-05-08T18:28:59.825 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-05-08T18:28:59.897 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-05-08T18:28:59.941 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-05-08T18:28:59.975 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-05-08T18:29:00.066 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-05-08T18:29:00.153 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-05-08T18:29:00.193 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-05-08T18:29:00.229 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-05-08T18:29:00.259 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-05-08T18:29:00.293 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-05-08T18:29:00.326 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-05-08T18:29:00.370 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-05-08T18:29:00.402 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-05-08T18:29:00.437 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-05-08T18:29:00.474 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-05-08T18:29:00.549 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-05-08T18:29:00.686 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-05-08T18:29:00.766 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-05-08T18:29:00.819 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-05-08T18:29:00.858 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-05-08T18:29:00.906 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-05-08T18:29:00.961 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-05-08T18:29:01.148 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-05-08T18:29:01.212 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-05-08T18:29:01.289 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-05-08T18:29:01.378 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-05-08T18:29:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-test-2:19.0.0-3463.gd8e5981c.el9.x86_64 4/4 2024-05-08T18:29:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-test-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/4 2024-05-08T18:29:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephsqlite-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/4 2024-05-08T18:29:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-08T18:29:01.419 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-05-08T18:29:01.545 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-05-08T18:29:01.688 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-08T18:29:01.689 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:01.689 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-08T18:29:01.689 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:29:01.689 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:29:01.689 INFO:teuthology.orchestra.run.smithi053.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T18:29:01.689 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T18:29:01.689 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:01.689 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:29:01.701 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3463.gd8e5981c.el9. 31/36 2024-05-08T18:29:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 32/36 2024-05-08T18:29:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 32/36 2024-05-08T18:29:01.756 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:29:01.756 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T18:29:01.756 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T18:29:01.756 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T18:29:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:02.000 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph 2024-05-08T18:29:02.591 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:51 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:29:02.720 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:29:02.722 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:02.723 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-05-08T18:29:02.723 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:02.723 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-08T18:29:02.723 INFO:teuthology.orchestra.run.smithi053.stdout: ceph x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 6.6 k 2024-05-08T18:29:02.723 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-05-08T18:29:02.723 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 2.4 M 2024-05-08T18:29:02.723 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 1.5 M 2024-05-08T18:29:02.723 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 274 k 2024-05-08T18:29:02.723 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 4.7 M 2024-05-08T18:29:02.723 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 17 M 2024-05-08T18:29:02.723 INFO:teuthology.orchestra.run.smithi053.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T18:29:02.723 INFO:teuthology.orchestra.run.smithi053.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T18:29:02.724 INFO:teuthology.orchestra.run.smithi053.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T18:29:02.724 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T18:29:02.724 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T18:29:02.724 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T18:29:02.724 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T18:29:02.724 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T18:29:02.724 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T18:29:02.724 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T18:29:02.724 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections 2024-05-08T18:29:02.724 INFO:teuthology.orchestra.run.smithi053.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-05-08T18:29:02.724 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T18:29:02.724 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T18:29:02.725 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T18:29:02.725 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T18:29:02.725 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T18:29:02.725 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T18:29:02.725 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T18:29:02.725 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T18:29:02.725 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T18:29:02.725 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T18:29:02.725 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T18:29:02.725 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T18:29:02.725 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T18:29:02.725 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T18:29:02.725 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T18:29:02.725 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T18:29:02.726 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T18:29:02.726 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T18:29:02.726 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T18:29:02.726 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:02.726 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-08T18:29:02.726 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:02.726 INFO:teuthology.orchestra.run.smithi053.stdout:Install 36 Packages 2024-05-08T18:29:02.726 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:02.727 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 30 M 2024-05-08T18:29:02.727 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 108 M 2024-05-08T18:29:02.727 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-08T18:29:03.256 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-osd-2:19.0.0-3463.gd8e5981c.el9.x86_64 33/36 2024-05-08T18:29:03.286 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-osd-2:19.0.0-3463.gd8e5981c.el9.x86_64 33/36 2024-05-08T18:29:03.286 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:29:03.286 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T18:29:03.286 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T18:29:03.286 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T18:29:03.286 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:03.428 INFO:teuthology.orchestra.run.smithi053.stdout:(1/36): ceph-19.0.0-3463.gd8e5981c.el9.x86_64.r 37 kB/s | 6.6 kB 00:00 2024-05-08T18:29:03.732 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mon-2:19.0.0-3463.gd8e5981c.el9.x86_64 34/36 2024-05-08T18:29:03.756 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mon-2:19.0.0-3463.gd8e5981c.el9.x86_64 34/36 2024-05-08T18:29:03.757 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:29:03.757 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T18:29:03.757 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T18:29:03.757 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T18:29:03.757 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:03.844 INFO:teuthology.orchestra.run.smithi053.stdout:(2/36): ceph-mon-19.0.0-3463.gd8e5981c.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-05-08T18:29:03.912 INFO:teuthology.orchestra.run.smithi053.stdout:(3/36): ceph-mgr-19.0.0-3463.gd8e5981c.el9.x86_ 2.3 MB/s | 1.5 MB 00:00 2024-05-08T18:29:03.978 INFO:teuthology.orchestra.run.smithi053.stdout:(4/36): ceph-mds-19.0.0-3463.gd8e5981c.el9.x86_ 3.2 MB/s | 2.4 MB 00:00 2024-05-08T18:29:03.982 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mds-2:19.0.0-3463.gd8e5981c.el9.x86_64 35/36 2024-05-08T18:29:04.006 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mds-2:19.0.0-3463.gd8e5981c.el9.x86_64 35/36 2024-05-08T18:29:04.006 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:29:04.006 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T18:29:04.006 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T18:29:04.006 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T18:29:04.007 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:04.012 INFO:teuthology.orchestra.run.smithi053.stdout:(5/36): ceph-mgr-modules-core-19.0.0-3463.gd8e5 2.7 MB/s | 274 kB 00:00 2024-05-08T18:29:04.071 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-2:19.0.0-3463.gd8e5981c.el9.x86_64 36/36 2024-05-08T18:29:04.254 INFO:teuthology.orchestra.run.smithi053.stdout:(6/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 920 kB/s | 253 kB 00:00 2024-05-08T18:29:04.312 INFO:teuthology.orchestra.run.smithi053.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-05-08T18:29:04.421 INFO:teuthology.orchestra.run.smithi053.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 1.2 MB/s | 135 kB 00:00 2024-05-08T18:29:04.630 INFO:teuthology.orchestra.run.smithi053.stdout:(9/36): ceph-osd-19.0.0-3463.gd8e5981c.el9.x86_ 21 MB/s | 17 MB 00:00 2024-05-08T18:29:04.655 INFO:teuthology.orchestra.run.smithi053.stdout:(10/36): python3-requests-2.25.1-8.el9.noarch.r 535 kB/s | 125 kB 00:00 2024-05-08T18:29:04.688 INFO:teuthology.orchestra.run.smithi053.stdout:(11/36): python3-cryptography-36.0.1-4.el9.x86_ 1.8 MB/s | 1.2 MB 00:00 2024-05-08T18:29:04.839 INFO:teuthology.orchestra.run.smithi053.stdout:(12/36): python3-urllib3-1.26.5-5.el9.noarch.rp 1.0 MB/s | 215 kB 00:00 2024-05-08T18:29:05.506 INFO:teuthology.orchestra.run.smithi053.stdout:(13/36): python3-markupsafe-1.1.1-12.el9.x86_64 52 kB/s | 35 kB 00:00 2024-05-08T18:29:05.531 INFO:teuthology.orchestra.run.smithi053.stdout:(14/36): lua-5.4.4-4.el9.x86_64.rpm 215 kB/s | 188 kB 00:00 2024-05-08T18:29:05.556 INFO:teuthology.orchestra.run.smithi053.stdout:(15/36): python3-mako-1.1.4-6.el9.noarch.rpm 198 kB/s | 172 kB 00:00 2024-05-08T18:29:05.823 INFO:teuthology.orchestra.run.smithi053.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 84 kB/s | 22 kB 00:00 2024-05-08T18:29:05.882 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-2:19.0.0-3463.gd8e5981c.el9.x86_64 36/36 2024-05-08T18:29:05.882 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/36 2024-05-08T18:29:05.882 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mds-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/36 2024-05-08T18:29:05.882 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 3/36 2024-05-08T18:29:05.882 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mon-2:19.0.0-3463.gd8e5981c.el9.x86_64 4/36 2024-05-08T18:29:05.882 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-osd-2:19.0.0-3463.gd8e5981c.el9.x86_64 5/36 2024-05-08T18:29:05.882 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3463.gd8e5981c.el9. 6/36 2024-05-08T18:29:05.883 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-05-08T18:29:05.883 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-05-08T18:29:05.883 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-05-08T18:29:05.883 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-05-08T18:29:05.883 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-05-08T18:29:05.883 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-05-08T18:29:05.883 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-05-08T18:29:05.883 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-05-08T18:29:05.883 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-05-08T18:29:05.883 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-05-08T18:29:05.883 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-05-08T18:29:05.883 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-05-08T18:29:05.883 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-05-08T18:29:05.883 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-05-08T18:29:05.884 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-05-08T18:29:05.884 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-05-08T18:29:05.884 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-05-08T18:29:05.884 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-05-08T18:29:05.884 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-05-08T18:29:05.884 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-05-08T18:29:05.884 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-05-08T18:29:05.884 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-05-08T18:29:05.884 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-05-08T18:29:05.884 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-05-08T18:29:05.884 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-05-08T18:29:05.884 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-05-08T18:29:05.884 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-05-08T18:29:05.884 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-05-08T18:29:05.885 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-05-08T18:29:06.232 INFO:teuthology.orchestra.run.smithi053.stdout:(17/36): python3-pytz-2021.1-5.el9.noarch.rpm 70 kB/s | 51 kB 00:00 2024-05-08T18:29:06.282 INFO:teuthology.orchestra.run.smithi053.stdout:(18/36): python3-toml-0.10.2-6.el9.noarch.rpm 55 kB/s | 42 kB 00:00 2024-05-08T18:29:06.407 INFO:teuthology.orchestra.run.smithi053.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 272 kB/s | 151 kB 00:00 2024-05-08T18:29:06.633 INFO:teuthology.orchestra.run.smithi053.stdout:(20/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 109 kB/s | 43 kB 00:00 2024-05-08T18:29:06.658 INFO:teuthology.orchestra.run.smithi053.stdout:(21/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-05-08T18:29:06.744 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-05-08T18:29:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:06.774 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T18:29:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:29:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:29:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:29:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:29:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:29:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:29:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T18:29:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T18:29:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T18:29:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T18:29:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T18:29:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T18:29:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T18:29:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T18:29:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T18:29:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T18:29:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T18:29:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T18:29:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T18:29:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T18:29:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T18:29:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T18:29:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T18:29:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T18:29:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T18:29:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T18:29:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T18:29:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T18:29:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T18:29:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T18:29:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T18:29:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T18:29:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T18:29:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T18:29:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T18:29:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T18:29:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:06.776 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:06.777 INFO:teuthology.orchestra.run.smithi053.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 91 kB/s | 11 kB 00:00 2024-05-08T18:29:06.777 INFO:teuthology.orchestra.run.smithi053.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 151 kB/s | 18 kB 00:00 2024-05-08T18:29:06.834 INFO:teuthology.orchestra.run.smithi053.stdout:(24/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 312 kB/s | 172 kB 00:00 2024-05-08T18:29:06.884 INFO:teuthology.orchestra.run.smithi053.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 173 kB/s | 23 kB 00:00 2024-05-08T18:29:06.901 INFO:teuthology.orchestra.run.smithi053.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 155 kB/s | 19 kB 00:00 2024-05-08T18:29:06.935 INFO:teuthology.orchestra.run.smithi053.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 196 kB/s | 20 kB 00:00 2024-05-08T18:29:06.985 INFO:teuthology.orchestra.run.smithi053.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 461 kB/s | 46 kB 00:00 2024-05-08T18:29:07.085 INFO:teuthology.orchestra.run.smithi053.stdout:(29/36): python3-portend-3.1.0-2.el9.noarch.rpm 164 kB/s | 16 kB 00:00 2024-05-08T18:29:07.110 INFO:teuthology.orchestra.run.smithi053.stdout:(30/36): python3-more-itertools-8.12.0-2.el9.no 377 kB/s | 79 kB 00:00 2024-05-08T18:29:07.130 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-base 2024-05-08T18:29:07.135 INFO:teuthology.orchestra.run.smithi053.stdout:(31/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-05-08T18:29:07.194 INFO:teuthology.orchestra.run.smithi053.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 826 kB/s | 90 kB 00:00 2024-05-08T18:29:07.211 INFO:teuthology.orchestra.run.smithi053.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 355 kB/s | 36 kB 00:00 2024-05-08T18:29:07.261 INFO:teuthology.orchestra.run.smithi053.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-05-08T18:29:07.320 INFO:teuthology.orchestra.run.smithi053.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 184 kB/s | 20 kB 00:00 2024-05-08T18:29:07.353 INFO:teuthology.orchestra.run.smithi053.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.6 MB/s | 427 kB 00:00 2024-05-08T18:29:07.358 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:07.358 INFO:teuthology.orchestra.run.smithi053.stdout:Total 6.5 MB/s | 30 MB 00:04 2024-05-08T18:29:07.505 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-08T18:29:07.549 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-08T18:29:07.549 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-08T18:29:07.707 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:57 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:07.787 INFO:teuthology.orchestra.run.smithi087.stdout:Package ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:29:07.830 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:07.830 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-05-08T18:29:07.831 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:07.896 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install cephadm 2024-05-08T18:29:08.007 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-08T18:29:08.007 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-08T18:29:08.458 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:58 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:08.582 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:08.583 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:08.583 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-05-08T18:29:08.583 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:08.583 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T18:29:08.583 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 763 k 2024-05-08T18:29:08.583 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:08.583 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T18:29:08.583 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:08.583 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-05-08T18:29:08.583 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:08.583 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 763 k 2024-05-08T18:29:08.583 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 770 k 2024-05-08T18:29:08.583 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T18:29:09.034 INFO:teuthology.orchestra.run.smithi087.stdout:cephadm-19.0.0-3463.gd8e5981c.el9.noarch.rpm 1.7 MB/s | 763 kB 00:00 2024-05-08T18:29:09.034 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:09.034 INFO:teuthology.orchestra.run.smithi087.stdout:Total 1.6 MB/s | 763 kB 00:00 2024-05-08T18:29:09.034 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T18:29:09.039 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T18:29:09.040 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T18:29:09.045 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T18:29:09.046 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T18:29:09.116 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T18:29:09.281 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-08T18:29:09.365 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-05-08T18:29:09.398 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-05-08T18:29:09.426 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-05-08T18:29:09.503 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-05-08T18:29:09.559 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-05-08T18:29:09.591 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-05-08T18:29:09.599 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/1 2024-05-08T18:29:09.679 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/1 2024-05-08T18:29:09.689 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-05-08T18:29:09.774 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-05-08T18:29:09.820 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-05-08T18:29:09.854 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-05-08T18:29:09.884 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-05-08T18:29:09.918 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-05-08T18:29:09.951 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-05-08T18:29:09.993 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-05-08T18:29:10.036 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-05-08T18:29:10.039 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/1 2024-05-08T18:29:10.070 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-05-08T18:29:10.108 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-05-08T18:29:10.185 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-05-08T18:29:10.287 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/1 2024-05-08T18:29:10.288 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:10.288 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T18:29:10.288 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:29:10.288 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:10.288 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:10.338 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-05-08T18:29:10.428 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-05-08T18:29:10.472 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-immutable-object-cache 2024-05-08T18:29:10.487 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-05-08T18:29:10.525 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-05-08T18:29:10.584 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-05-08T18:29:10.648 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-05-08T18:29:10.854 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-05-08T18:29:10.904 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-05-08T18:29:10.986 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-05-08T18:29:11.047 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:01 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:11.084 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-05-08T18:29:11.119 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-05-08T18:29:11.171 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:11.172 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:11.172 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repo Size 2024-05-08T18:29:11.172 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:11.172 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T18:29:11.172 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 145 k 2024-05-08T18:29:11.172 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:11.172 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T18:29:11.172 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:11.172 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-05-08T18:29:11.172 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:11.173 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 145 k 2024-05-08T18:29:11.173 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 435 k 2024-05-08T18:29:11.173 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T18:29:11.254 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-05-08T18:29:11.401 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-immutable-object-cache-19.0.0-3463.gd8e598 637 kB/s | 145 kB 00:00 2024-05-08T18:29:11.401 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:11.401 INFO:teuthology.orchestra.run.smithi087.stdout:Total 633 kB/s | 145 kB 00:00 2024-05-08T18:29:11.402 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T18:29:11.409 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T18:29:11.409 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T18:29:11.427 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3463.gd8e5981c.el9. 31/36 2024-05-08T18:29:11.454 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 32/36 2024-05-08T18:29:11.465 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T18:29:11.466 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T18:29:11.482 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 32/36 2024-05-08T18:29:11.482 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:29:11.482 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T18:29:11.482 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T18:29:11.482 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T18:29:11.482 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:11.610 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T18:29:11.702 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3463.gd8e5981c. 1/1 2024-05-08T18:29:11.727 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3463.gd8e5981c. 1/1 2024-05-08T18:29:11.728 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:29:11.728 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T18:29:11.728 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:12.658 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3463.gd8e5981c. 1/1 2024-05-08T18:29:12.658 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:12.658 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T18:29:12.658 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:29:12.658 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:12.658 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:12.891 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-mgr 2024-05-08T18:29:13.013 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-osd-2:19.0.0-3463.gd8e5981c.el9.x86_64 33/36 2024-05-08T18:29:13.042 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-osd-2:19.0.0-3463.gd8e5981c.el9.x86_64 33/36 2024-05-08T18:29:13.043 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:29:13.043 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T18:29:13.043 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T18:29:13.043 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T18:29:13.043 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:13.468 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:03 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:13.506 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mon-2:19.0.0-3463.gd8e5981c.el9.x86_64 34/36 2024-05-08T18:29:13.531 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mon-2:19.0.0-3463.gd8e5981c.el9.x86_64 34/36 2024-05-08T18:29:13.531 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:29:13.531 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T18:29:13.531 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T18:29:13.531 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T18:29:13.531 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:13.554 INFO:teuthology.orchestra.run.smithi087.stdout:Package ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:29:13.597 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:13.598 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-05-08T18:29:13.598 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:13.672 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-mgr-dashboard 2024-05-08T18:29:13.765 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mds-2:19.0.0-3463.gd8e5981c.el9.x86_64 35/36 2024-05-08T18:29:13.790 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mds-2:19.0.0-3463.gd8e5981c.el9.x86_64 35/36 2024-05-08T18:29:13.790 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:29:13.791 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T18:29:13.791 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T18:29:13.791 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T18:29:13.791 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:13.856 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-2:19.0.0-3463.gd8e5981c.el9.x86_64 36/36 2024-05-08T18:29:14.235 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:04 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:14.358 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:14.359 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-05-08T18:29:14.360 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:14.360 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T18:29:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 3.5 M 2024-05-08T18:29:14.360 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-05-08T18:29:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T18:29:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 34 k 2024-05-08T18:29:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 16 k 2024-05-08T18:29:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T18:29:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T18:29:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T18:29:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T18:29:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T18:29:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T18:29:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T18:29:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T18:29:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:14.361 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T18:29:14.361 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:14.361 INFO:teuthology.orchestra.run.smithi087.stdout:Install 12 Packages 2024-05-08T18:29:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:14.362 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 8.6 M 2024-05-08T18:29:14.362 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 104 M 2024-05-08T18:29:14.362 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T18:29:15.280 INFO:teuthology.orchestra.run.smithi087.stdout:(1/12): ceph-grafana-dashboards-19.0.0-3463.gd8 131 kB/s | 34 kB 00:00 2024-05-08T18:29:15.306 INFO:teuthology.orchestra.run.smithi087.stdout:(2/12): ceph-prometheus-alerts-19.0.0-3463.gd8e 58 kB/s | 16 kB 00:00 2024-05-08T18:29:15.429 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-2:19.0.0-3463.gd8e5981c.el9.x86_64 36/36 2024-05-08T18:29:15.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/36 2024-05-08T18:29:15.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mds-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/36 2024-05-08T18:29:15.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 3/36 2024-05-08T18:29:15.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mon-2:19.0.0-3463.gd8e5981c.el9.x86_64 4/36 2024-05-08T18:29:15.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-osd-2:19.0.0-3463.gd8e5981c.el9.x86_64 5/36 2024-05-08T18:29:15.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3463.gd8e5981c.el9. 6/36 2024-05-08T18:29:15.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-05-08T18:29:15.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-05-08T18:29:15.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-05-08T18:29:15.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-05-08T18:29:15.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-05-08T18:29:15.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-05-08T18:29:15.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-05-08T18:29:15.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-05-08T18:29:15.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-05-08T18:29:15.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-05-08T18:29:15.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-05-08T18:29:15.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-05-08T18:29:15.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-05-08T18:29:15.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-05-08T18:29:15.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-05-08T18:29:15.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-05-08T18:29:15.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-05-08T18:29:15.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-05-08T18:29:15.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-05-08T18:29:15.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-05-08T18:29:15.431 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-05-08T18:29:15.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-05-08T18:29:15.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-05-08T18:29:15.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-05-08T18:29:15.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-05-08T18:29:15.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-05-08T18:29:15.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-05-08T18:29:15.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-05-08T18:29:15.433 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-05-08T18:29:15.872 INFO:teuthology.orchestra.run.smithi087.stdout:(3/12): ceph-mgr-dashboard-19.0.0-3463.gd8e5981 4.2 MB/s | 3.5 MB 00:00 2024-05-08T18:29:16.248 INFO:teuthology.orchestra.run.smithi087.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 286 kB/s | 269 kB 00:00 2024-05-08T18:29:16.327 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-05-08T18:29:16.327 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:16.327 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-08T18:29:16.327 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:29:16.327 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:29:16.327 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:29:16.327 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:29:16.328 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:29:16.328 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:29:16.328 INFO:teuthology.orchestra.run.smithi053.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T18:29:16.328 INFO:teuthology.orchestra.run.smithi053.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T18:29:16.328 INFO:teuthology.orchestra.run.smithi053.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T18:29:16.328 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T18:29:16.328 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T18:29:16.328 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T18:29:16.328 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T18:29:16.328 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T18:29:16.328 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T18:29:16.328 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T18:29:16.328 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T18:29:16.329 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T18:29:16.329 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T18:29:16.329 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T18:29:16.329 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T18:29:16.329 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T18:29:16.329 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T18:29:16.329 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T18:29:16.329 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T18:29:16.329 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T18:29:16.329 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T18:29:16.329 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T18:29:16.329 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T18:29:16.329 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T18:29:16.329 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T18:29:16.330 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T18:29:16.330 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T18:29:16.330 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T18:29:16.330 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T18:29:16.330 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T18:29:16.330 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:16.330 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:29:16.431 INFO:teuthology.orchestra.run.smithi087.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 898 kB/s | 1.0 MB 00:01 2024-05-08T18:29:16.531 INFO:teuthology.orchestra.run.smithi087.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.9 MB/s | 548 kB 00:00 2024-05-08T18:29:16.549 INFO:teuthology.orchestra.run.smithi087.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 167 kB/s | 19 kB 00:00 2024-05-08T18:29:16.679 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-base 2024-05-08T18:29:16.732 INFO:teuthology.orchestra.run.smithi087.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 789 kB/s | 144 kB 00:00 2024-05-08T18:29:16.757 INFO:teuthology.orchestra.run.smithi087.stdout:(9/12): protobuf-compiler-3.14.0-13.el9.x86_64. 976 kB/s | 863 kB 00:00 2024-05-08T18:29:16.782 INFO:teuthology.orchestra.run.smithi087.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 613 kB/s | 31 kB 00:00 2024-05-08T18:29:16.833 INFO:teuthology.orchestra.run.smithi087.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 6.8 MB/s | 2.0 MB 00:00 2024-05-08T18:29:17.008 INFO:teuthology.orchestra.run.smithi087.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 753 kB/s | 188 kB 00:00 2024-05-08T18:29:17.010 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:17.011 INFO:teuthology.orchestra.run.smithi087.stdout:Total 3.3 MB/s | 8.6 MB 00:02 2024-05-08T18:29:17.063 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T18:29:17.080 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T18:29:17.080 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T18:29:17.264 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T18:29:17.264 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T18:29:17.275 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:06 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:29:17.359 INFO:teuthology.orchestra.run.smithi053.stdout:Package ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:29:17.404 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:29:17.405 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-05-08T18:29:17.405 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:29:17.473 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install cephadm 2024-05-08T18:29:17.880 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T18:29:17.959 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-05-08T18:29:17.994 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-05-08T18:29:18.040 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-05-08T18:29:18.067 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:07 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:29:18.080 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-05-08T18:29:18.194 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-05-08T18:29:18.196 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:29:18.196 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:18.197 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-05-08T18:29:18.197 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:18.197 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-08T18:29:18.197 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 763 k 2024-05-08T18:29:18.197 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:18.197 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-08T18:29:18.197 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:18.197 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-05-08T18:29:18.197 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:18.197 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 763 k 2024-05-08T18:29:18.197 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 770 k 2024-05-08T18:29:18.197 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-08T18:29:18.322 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-05-08T18:29:18.424 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-05-08T18:29:18.473 INFO:teuthology.orchestra.run.smithi053.stdout:cephadm-19.0.0-3463.gd8e5981c.el9.noarch.rpm 2.7 MB/s | 763 kB 00:00 2024-05-08T18:29:18.474 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:18.474 INFO:teuthology.orchestra.run.smithi053.stdout:Total 2.7 MB/s | 763 kB 00:00 2024-05-08T18:29:18.474 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-08T18:29:18.479 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-08T18:29:18.480 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-08T18:29:18.484 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-05-08T18:29:18.485 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-08T18:29:18.486 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-08T18:29:18.521 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-05-08T18:29:18.554 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3463.gd8e5981c.el9 10/12 2024-05-08T18:29:18.558 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-08T18:29:18.982 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/1 2024-05-08T18:29:19.079 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/1 2024-05-08T18:29:19.459 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/1 2024-05-08T18:29:19.598 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3463.gd8e5981c.el 11/12 2024-05-08T18:29:19.654 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3463.gd8e5981c.el9.noa 12/12 2024-05-08T18:29:19.696 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/1 2024-05-08T18:29:19.697 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:19.697 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-08T18:29:19.697 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:29:19.697 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:19.697 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:29:19.945 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-immutable-object-cache 2024-05-08T18:29:20.538 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:09 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:29:20.667 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:29:20.668 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:20.668 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repo Size 2024-05-08T18:29:20.668 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:20.668 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-08T18:29:20.668 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 145 k 2024-05-08T18:29:20.668 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:20.668 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-08T18:29:20.668 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:20.668 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-05-08T18:29:20.668 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:20.668 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 145 k 2024-05-08T18:29:20.669 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 435 k 2024-05-08T18:29:20.669 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-08T18:29:20.958 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3463.gd8e5981c.el9.noa 12/12 2024-05-08T18:29:20.958 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3463.gd8e5981c.el 1/12 2024-05-08T18:29:20.958 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3463.gd8e5981c.el9.noa 2/12 2024-05-08T18:29:20.958 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3463.gd8e5981c.el9 3/12 2024-05-08T18:29:20.958 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-05-08T18:29:20.958 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-05-08T18:29:20.958 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-05-08T18:29:20.958 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-05-08T18:29:20.958 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-05-08T18:29:20.958 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-05-08T18:29:20.959 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-05-08T18:29:20.959 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-05-08T18:29:21.021 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-immutable-object-cache-19.0.0-3463.gd8e598 411 kB/s | 145 kB 00:00 2024-05-08T18:29:21.022 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:21.022 INFO:teuthology.orchestra.run.smithi053.stdout:Total 409 kB/s | 145 kB 00:00 2024-05-08T18:29:21.022 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-08T18:29:21.030 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-08T18:29:21.030 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-08T18:29:21.090 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-08T18:29:21.090 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-08T18:29:21.238 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-08T18:29:21.262 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-05-08T18:29:21.262 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:21.262 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T18:29:21.263 INFO:teuthology.orchestra.run.smithi087.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T18:29:21.263 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:29:21.263 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:29:21.263 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:29:21.263 INFO:teuthology.orchestra.run.smithi087.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T18:29:21.263 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T18:29:21.263 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T18:29:21.263 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T18:29:21.263 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T18:29:21.263 INFO:teuthology.orchestra.run.smithi087.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T18:29:21.263 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T18:29:21.263 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T18:29:21.263 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:21.263 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:21.322 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3463.gd8e5981c. 1/1 2024-05-08T18:29:21.349 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3463.gd8e5981c. 1/1 2024-05-08T18:29:21.349 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:29:21.349 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T18:29:21.349 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:21.495 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-08T18:29:22.061 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:12 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:22.184 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:22.185 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-05-08T18:29:22.186 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-05-08T18:29:22.186 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-05-08T18:29:22.186 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T18:29:22.186 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 7.4 M 2024-05-08T18:29:22.186 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-05-08T18:29:22.186 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T18:29:22.186 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T18:29:22.186 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T18:29:22.186 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T18:29:22.186 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T18:29:22.186 INFO:teuthology.orchestra.run.smithi087.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T18:29:22.186 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T18:29:22.187 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T18:29:22.187 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T18:29:22.187 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T18:29:22.187 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T18:29:22.187 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:22.187 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T18:29:22.187 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-05-08T18:29:22.187 INFO:teuthology.orchestra.run.smithi087.stdout:Install 12 Packages 2024-05-08T18:29:22.187 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:22.188 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 38 M 2024-05-08T18:29:22.188 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 209 M 2024-05-08T18:29:22.188 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T18:29:22.329 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3463.gd8e5981c. 1/1 2024-05-08T18:29:22.330 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:22.330 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-08T18:29:22.330 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:29:22.330 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:22.330 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:29:22.550 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr 2024-05-08T18:29:22.583 INFO:teuthology.orchestra.run.smithi087.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-05-08T18:29:22.642 INFO:teuthology.orchestra.run.smithi087.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 4.1 MB/s | 803 kB 00:00 2024-05-08T18:29:22.725 INFO:teuthology.orchestra.run.smithi087.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 231 kB/s | 33 kB 00:00 2024-05-08T18:29:22.776 INFO:teuthology.orchestra.run.smithi087.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-05-08T18:29:22.859 INFO:teuthology.orchestra.run.smithi087.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 422 kB/s | 35 kB 00:00 2024-05-08T18:29:23.148 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:12 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:29:23.231 INFO:teuthology.orchestra.run.smithi053.stdout:Package ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:29:23.277 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:29:23.278 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-05-08T18:29:23.278 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:29:23.348 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-dashboard 2024-05-08T18:29:23.451 INFO:teuthology.orchestra.run.smithi087.stdout:(6/12): ceph-mgr-diskprediction-local-19.0.0-34 7.4 MB/s | 7.4 MB 00:01 2024-05-08T18:29:23.502 INFO:teuthology.orchestra.run.smithi087.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.5 MB/s | 3.0 MB 00:00 2024-05-08T18:29:23.668 INFO:teuthology.orchestra.run.smithi087.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.1 MB/s | 244 kB 00:00 2024-05-08T18:29:23.777 INFO:teuthology.orchestra.run.smithi087.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.3 MB/s | 250 kB 00:00 2024-05-08T18:29:23.934 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:12 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:29:24.044 INFO:teuthology.orchestra.run.smithi087.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 4.0 MB/s | 4.7 MB 00:01 2024-05-08T18:29:24.063 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:29:24.064 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:24.064 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-05-08T18:29:24.064 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:24.064 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-08T18:29:24.064 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 3.5 M 2024-05-08T18:29:24.064 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-05-08T18:29:24.064 INFO:teuthology.orchestra.run.smithi053.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T18:29:24.065 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 34 k 2024-05-08T18:29:24.065 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 16 k 2024-05-08T18:29:24.065 INFO:teuthology.orchestra.run.smithi053.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T18:29:24.065 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T18:29:24.065 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T18:29:24.065 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T18:29:24.065 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T18:29:24.065 INFO:teuthology.orchestra.run.smithi053.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T18:29:24.065 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T18:29:24.065 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T18:29:24.065 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:24.065 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-08T18:29:24.066 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:24.066 INFO:teuthology.orchestra.run.smithi053.stdout:Install 12 Packages 2024-05-08T18:29:24.066 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:24.066 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 8.6 M 2024-05-08T18:29:24.066 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 104 M 2024-05-08T18:29:24.066 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-08T18:29:24.569 INFO:teuthology.orchestra.run.smithi087.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.8 MB/s | 5.1 MB 00:01 2024-05-08T18:29:25.017 INFO:teuthology.orchestra.run.smithi053.stdout:(1/12): ceph-prometheus-alerts-19.0.0-3463.gd8e 62 kB/s | 16 kB 00:00 2024-05-08T18:29:25.175 INFO:teuthology.orchestra.run.smithi053.stdout:(2/12): ceph-grafana-dashboards-19.0.0-3463.gd8 81 kB/s | 34 kB 00:00 2024-05-08T18:29:25.392 INFO:teuthology.orchestra.run.smithi053.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.7 MB/s | 1.0 MB 00:00 2024-05-08T18:29:25.418 INFO:teuthology.orchestra.run.smithi053.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-05-08T18:29:25.535 INFO:teuthology.orchestra.run.smithi053.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 5.9 MB/s | 863 kB 00:00 2024-05-08T18:29:25.602 INFO:teuthology.orchestra.run.smithi053.stdout:(6/12): ceph-mgr-dashboard-19.0.0-3463.gd8e5981 4.2 MB/s | 3.5 MB 00:00 2024-05-08T18:29:25.743 INFO:teuthology.orchestra.run.smithi053.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 94 kB/s | 19 kB 00:00 2024-05-08T18:29:25.836 INFO:teuthology.orchestra.run.smithi053.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.3 MB/s | 548 kB 00:00 2024-05-08T18:29:25.861 INFO:teuthology.orchestra.run.smithi053.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.2 MB/s | 144 kB 00:00 2024-05-08T18:29:25.944 INFO:teuthology.orchestra.run.smithi053.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 284 kB/s | 31 kB 00:00 2024-05-08T18:29:26.020 INFO:teuthology.orchestra.run.smithi053.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 4.9 MB/s | 2.0 MB 00:00 2024-05-08T18:29:26.045 INFO:teuthology.orchestra.run.smithi053.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.0 MB/s | 188 kB 00:00 2024-05-08T18:29:26.048 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:26.049 INFO:teuthology.orchestra.run.smithi053.stdout:Total 4.4 MB/s | 8.6 MB 00:01 2024-05-08T18:29:26.105 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-08T18:29:26.122 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-08T18:29:26.122 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-08T18:29:26.310 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-08T18:29:26.310 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-08T18:29:26.511 INFO:teuthology.orchestra.run.smithi087.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.9 MB/s | 16 MB 00:02 2024-05-08T18:29:26.512 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:26.512 INFO:teuthology.orchestra.run.smithi087.stdout:Total 8.8 MB/s | 38 MB 00:04 2024-05-08T18:29:26.867 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T18:29:26.894 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T18:29:26.894 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T18:29:26.927 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-08T18:29:27.024 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-05-08T18:29:27.059 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-05-08T18:29:27.107 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-05-08T18:29:27.135 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-05-08T18:29:27.257 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-05-08T18:29:27.313 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T18:29:27.314 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T18:29:27.420 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-05-08T18:29:27.527 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-05-08T18:29:27.583 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-05-08T18:29:27.610 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-05-08T18:29:27.643 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3463.gd8e5981c.el9 10/12 2024-05-08T18:29:28.083 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T18:29:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-08T18:29:28.184 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-08T18:29:28.284 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-08T18:29:28.318 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-08T18:29:28.495 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-08T18:29:28.526 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-08T18:29:28.607 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-08T18:29:28.752 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3463.gd8e5981c.el 11/12 2024-05-08T18:29:28.801 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3463.gd8e5981c.el9.noa 12/12 2024-05-08T18:29:29.253 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-08T18:29:29.372 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-08T18:29:30.089 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3463.gd8e5981c.el9.noa 12/12 2024-05-08T18:29:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3463.gd8e5981c.el 1/12 2024-05-08T18:29:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3463.gd8e5981c.el9.noa 2/12 2024-05-08T18:29:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3463.gd8e5981c.el9 3/12 2024-05-08T18:29:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-05-08T18:29:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-05-08T18:29:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-05-08T18:29:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-05-08T18:29:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-05-08T18:29:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-05-08T18:29:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-05-08T18:29:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-05-08T18:29:30.397 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-05-08T18:29:30.397 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:30.397 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-08T18:29:30.397 INFO:teuthology.orchestra.run.smithi053.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T18:29:30.398 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:29:30.398 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:29:30.398 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:29:30.398 INFO:teuthology.orchestra.run.smithi053.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T18:29:30.398 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T18:29:30.398 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T18:29:30.398 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T18:29:30.398 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T18:29:30.398 INFO:teuthology.orchestra.run.smithi053.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T18:29:30.398 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T18:29:30.398 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T18:29:30.398 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:30.398 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:29:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-08T18:29:30.641 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-08T18:29:31.232 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:20 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:29:31.359 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:29:31.360 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-05-08T18:29:31.360 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-05-08T18:29:31.360 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-05-08T18:29:31.360 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-08T18:29:31.360 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 7.4 M 2024-05-08T18:29:31.360 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-05-08T18:29:31.361 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T18:29:31.361 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T18:29:31.361 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T18:29:31.361 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T18:29:31.361 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T18:29:31.361 INFO:teuthology.orchestra.run.smithi053.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T18:29:31.361 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T18:29:31.361 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T18:29:31.361 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T18:29:31.361 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T18:29:31.361 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T18:29:31.361 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:31.361 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-08T18:29:31.361 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-05-08T18:29:31.362 INFO:teuthology.orchestra.run.smithi053.stdout:Install 12 Packages 2024-05-08T18:29:31.362 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:31.362 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 38 M 2024-05-08T18:29:31.362 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 209 M 2024-05-08T18:29:31.362 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-08T18:29:31.634 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-08T18:29:31.667 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3463.gd8e59 12/12 2024-05-08T18:29:32.198 INFO:teuthology.orchestra.run.smithi053.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 373 kB/s | 195 kB 00:00 2024-05-08T18:29:32.290 INFO:teuthology.orchestra.run.smithi053.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 358 kB/s | 33 kB 00:00 2024-05-08T18:29:32.415 INFO:teuthology.orchestra.run.smithi053.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 803 kB 00:00 2024-05-08T18:29:32.507 INFO:teuthology.orchestra.run.smithi053.stdout:(4/12): ceph-mgr-diskprediction-local-19.0.0-34 8.9 MB/s | 7.4 MB 00:00 2024-05-08T18:29:32.582 INFO:teuthology.orchestra.run.smithi053.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 10 MB/s | 3.0 MB 00:00 2024-05-08T18:29:32.608 INFO:teuthology.orchestra.run.smithi053.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 95 kB/s | 18 kB 00:00 2024-05-08T18:29:32.633 INFO:teuthology.orchestra.run.smithi053.stdout:(7/12): openblas-0.3.21-2.el9.x86_64.rpm 281 kB/s | 35 kB 00:00 2024-05-08T18:29:32.725 INFO:teuthology.orchestra.run.smithi053.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 33 MB/s | 4.7 MB 00:00 2024-05-08T18:29:32.759 INFO:teuthology.orchestra.run.smithi053.stdout:(9/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.6 MB/s | 244 kB 00:00 2024-05-08T18:29:32.784 INFO:teuthology.orchestra.run.smithi053.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 4.2 MB/s | 250 kB 00:00 2024-05-08T18:29:33.167 INFO:teuthology.orchestra.run.smithi053.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-05-08T18:29:33.684 INFO:teuthology.orchestra.run.smithi053.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.8 MB/s | 5.1 MB 00:01 2024-05-08T18:29:33.685 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:33.686 INFO:teuthology.orchestra.run.smithi053.stdout:Total 16 MB/s | 38 MB 00:02 2024-05-08T18:29:34.056 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-08T18:29:34.084 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-08T18:29:34.084 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-08T18:29:34.116 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3463.gd8e59 12/12 2024-05-08T18:29:34.117 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3463.gd8e59 1/12 2024-05-08T18:29:34.117 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-08T18:29:34.117 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-08T18:29:34.117 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-08T18:29:34.117 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-08T18:29:34.117 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-08T18:29:34.117 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-08T18:29:34.117 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-08T18:29:34.117 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-08T18:29:34.117 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-08T18:29:34.117 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-08T18:29:34.497 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-08T18:29:34.497 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:34.497 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T18:29:34.497 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:29:34.497 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T18:29:34.497 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T18:29:34.497 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T18:29:34.497 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T18:29:34.497 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T18:29:34.498 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T18:29:34.498 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T18:29:34.498 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T18:29:34.498 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T18:29:34.498 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T18:29:34.498 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T18:29:34.498 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:34.498 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:34.540 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-08T18:29:34.541 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-08T18:29:34.845 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-mgr-rook 2024-05-08T18:29:35.317 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-08T18:29:35.384 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-08T18:29:35.425 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-08T18:29:35.425 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:25 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:35.530 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-08T18:29:35.548 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:35.549 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:35.549 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-05-08T18:29:35.549 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:35.549 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T18:29:35.549 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 49 k 2024-05-08T18:29:35.549 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-05-08T18:29:35.549 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T18:29:35.549 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T18:29:35.550 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T18:29:35.550 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T18:29:35.550 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T18:29:35.550 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T18:29:35.550 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T18:29:35.550 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T18:29:35.550 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T18:29:35.550 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T18:29:35.550 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T18:29:35.550 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T18:29:35.551 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:35.551 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T18:29:35.551 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:35.551 INFO:teuthology.orchestra.run.smithi087.stdout:Install 13 Packages 2024-05-08T18:29:35.551 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:35.551 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 2.2 M 2024-05-08T18:29:35.551 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 26 M 2024-05-08T18:29:35.552 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T18:29:35.567 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-08T18:29:35.752 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-08T18:29:35.791 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-08T18:29:35.876 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-08T18:29:35.893 INFO:teuthology.orchestra.run.smithi087.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 230 kB/s | 26 kB 00:00 2024-05-08T18:29:35.910 INFO:teuthology.orchestra.run.smithi087.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 149 kB/s | 19 kB 00:00 2024-05-08T18:29:36.127 INFO:teuthology.orchestra.run.smithi087.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 954 kB/s | 222 kB 00:00 2024-05-08T18:29:36.144 INFO:teuthology.orchestra.run.smithi087.stdout:(4/13): ceph-mgr-rook-19.0.0-3463.gd8e5981c.el9 136 kB/s | 49 kB 00:00 2024-05-08T18:29:36.169 INFO:teuthology.orchestra.run.smithi087.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 613 kB/s | 159 kB 00:00 2024-05-08T18:29:36.220 INFO:teuthology.orchestra.run.smithi087.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-05-08T18:29:36.245 INFO:teuthology.orchestra.run.smithi087.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.3 MB/s | 279 kB 00:00 2024-05-08T18:29:36.462 INFO:teuthology.orchestra.run.smithi087.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 110 kB/s | 32 kB 00:00 2024-05-08T18:29:36.479 INFO:teuthology.orchestra.run.smithi087.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 58 kB/s | 15 kB 00:00 2024-05-08T18:29:36.580 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-08T18:29:36.621 INFO:teuthology.orchestra.run.smithi087.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 418 kB/s | 59 kB 00:00 2024-05-08T18:29:36.688 INFO:teuthology.orchestra.run.smithi087.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 521 kB/s | 206 kB 00:00 2024-05-08T18:29:36.710 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-08T18:29:36.746 INFO:teuthology.orchestra.run.smithi087.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 716 kB/s | 90 kB 00:00 2024-05-08T18:29:36.796 INFO:teuthology.orchestra.run.smithi087.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.1 MB/s | 1.0 MB 00:00 2024-05-08T18:29:36.799 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:36.799 INFO:teuthology.orchestra.run.smithi087.stdout:Total 1.8 MB/s | 2.2 MB 00:01 2024-05-08T18:29:36.865 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T18:29:36.880 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T18:29:36.880 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T18:29:36.966 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T18:29:36.966 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T18:29:37.480 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T18:29:37.652 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-08T18:29:37.714 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-08T18:29:37.769 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-08T18:29:37.815 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-08T18:29:37.857 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-08T18:29:37.951 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-08T18:29:38.028 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-08T18:29:38.060 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-08T18:29:38.108 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-08T18:29:38.828 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-08T18:29:38.872 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-08T18:29:38.906 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-08T18:29:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-08T18:29:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-rook-2:19.0.0-3463.gd8e5981c.el9.noarch 13/13 2024-05-08T18:29:39.119 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-08T18:29:39.149 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3463.gd8e59 12/12 2024-05-08T18:29:39.707 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3463.gd8e5981c.el9.noarch 13/13 2024-05-08T18:29:39.707 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3463.gd8e5981c.el9.noarch 1/13 2024-05-08T18:29:39.707 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-08T18:29:39.708 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-08T18:29:39.708 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-08T18:29:39.708 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-08T18:29:39.708 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-08T18:29:39.708 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-08T18:29:39.708 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-08T18:29:39.708 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-08T18:29:39.708 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-08T18:29:39.708 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-08T18:29:39.708 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-08T18:29:40.043 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-08T18:29:40.043 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:40.043 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T18:29:40.043 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:29:40.043 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T18:29:40.044 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T18:29:40.044 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T18:29:40.044 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T18:29:40.044 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T18:29:40.044 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T18:29:40.044 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T18:29:40.044 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T18:29:40.044 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T18:29:40.044 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T18:29:40.044 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T18:29:40.044 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T18:29:40.044 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:40.044 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:40.286 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-mgr-cephadm 2024-05-08T18:29:40.849 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:30 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:40.969 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:40.970 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:40.970 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-05-08T18:29:40.970 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:40.970 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T18:29:40.971 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 142 k 2024-05-08T18:29:40.971 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-05-08T18:29:40.971 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T18:29:40.971 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T18:29:40.971 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T18:29:40.971 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T18:29:40.971 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T18:29:40.971 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:40.971 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T18:29:40.971 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:40.971 INFO:teuthology.orchestra.run.smithi087.stdout:Install 6 Packages 2024-05-08T18:29:40.971 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:40.972 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 7.0 M 2024-05-08T18:29:40.972 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 33 M 2024-05-08T18:29:40.972 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T18:29:41.390 INFO:teuthology.orchestra.run.smithi087.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 2.4 MB/s | 248 kB 00:00 2024-05-08T18:29:41.499 INFO:teuthology.orchestra.run.smithi087.stdout:(2/6): ceph-mgr-cephadm-19.0.0-3463.gd8e5981c.e 681 kB/s | 142 kB 00:00 2024-05-08T18:29:41.674 INFO:teuthology.orchestra.run.smithi087.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-05-08T18:29:41.803 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3463.gd8e59 12/12 2024-05-08T18:29:41.803 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3463.gd8e59 1/12 2024-05-08T18:29:41.803 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-08T18:29:41.803 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-08T18:29:41.803 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-08T18:29:41.803 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-08T18:29:41.803 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-08T18:29:41.803 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-08T18:29:41.804 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-08T18:29:41.804 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-08T18:29:41.804 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-08T18:29:41.804 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-08T18:29:41.958 INFO:teuthology.orchestra.run.smithi087.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 126 kB/s | 58 kB 00:00 2024-05-08T18:29:42.033 INFO:teuthology.orchestra.run.smithi087.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 142 kB/s | 51 kB 00:00 2024-05-08T18:29:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-08T18:29:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:42.216 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-08T18:29:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:29:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T18:29:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T18:29:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T18:29:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T18:29:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T18:29:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T18:29:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T18:29:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T18:29:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T18:29:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T18:29:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T18:29:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:42.217 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:29:42.292 INFO:teuthology.orchestra.run.smithi087.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 608 kB/s | 548 kB 00:00 2024-05-08T18:29:42.292 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:42.293 INFO:teuthology.orchestra.run.smithi087.stdout:Total 5.3 MB/s | 7.0 MB 00:01 2024-05-08T18:29:42.363 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T18:29:42.374 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T18:29:42.374 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T18:29:42.470 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T18:29:42.471 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T18:29:42.564 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-rook 2024-05-08T18:29:42.778 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T18:29:42.934 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-08T18:29:42.994 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-08T18:29:43.162 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:32 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:29:43.289 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:29:43.290 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:43.290 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-05-08T18:29:43.290 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:43.290 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-08T18:29:43.290 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 49 k 2024-05-08T18:29:43.290 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-05-08T18:29:43.290 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T18:29:43.291 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T18:29:43.291 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T18:29:43.291 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T18:29:43.291 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T18:29:43.291 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T18:29:43.291 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T18:29:43.291 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T18:29:43.291 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T18:29:43.291 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T18:29:43.291 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T18:29:43.291 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T18:29:43.291 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:43.291 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-08T18:29:43.291 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:43.291 INFO:teuthology.orchestra.run.smithi053.stdout:Install 13 Packages 2024-05-08T18:29:43.292 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:43.292 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 2.2 M 2024-05-08T18:29:43.292 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 26 M 2024-05-08T18:29:43.292 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-08T18:29:43.536 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-08T18:29:43.559 INFO:teuthology.orchestra.run.smithi053.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 429 kB/s | 26 kB 00:00 2024-05-08T18:29:43.584 INFO:teuthology.orchestra.run.smithi053.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 226 kB/s | 19 kB 00:00 2024-05-08T18:29:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-08T18:29:43.676 INFO:teuthology.orchestra.run.smithi053.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-05-08T18:29:43.693 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-08T18:29:43.701 INFO:teuthology.orchestra.run.smithi053.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.4 MB/s | 222 kB 00:00 2024-05-08T18:29:43.722 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 6/6 2024-05-08T18:29:43.751 INFO:teuthology.orchestra.run.smithi053.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-05-08T18:29:43.777 INFO:teuthology.orchestra.run.smithi053.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-05-08T18:29:43.869 INFO:teuthology.orchestra.run.smithi053.stdout:(7/13): ceph-mgr-rook-19.0.0-3463.gd8e5981c.el9 133 kB/s | 49 kB 00:00 2024-05-08T18:29:43.952 INFO:teuthology.orchestra.run.smithi053.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 160 kB/s | 32 kB 00:00 2024-05-08T18:29:43.969 INFO:teuthology.orchestra.run.smithi053.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 78 kB/s | 15 kB 00:00 2024-05-08T18:29:44.095 INFO:teuthology.orchestra.run.smithi053.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 476 kB/s | 59 kB 00:00 2024-05-08T18:29:44.237 INFO:teuthology.orchestra.run.smithi053.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 634 kB/s | 90 kB 00:00 2024-05-08T18:29:44.420 INFO:teuthology.orchestra.run.smithi053.stdout:(12/13): python3-google-auth-2.29.0-1.el9.noarc 374 kB/s | 206 kB 00:00 2024-05-08T18:29:44.494 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 6/6 2024-05-08T18:29:44.494 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/6 2024-05-08T18:29:44.494 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-08T18:29:44.494 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-08T18:29:44.494 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-08T18:29:44.494 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-08T18:29:44.775 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-08T18:29:44.775 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:44.776 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T18:29:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:29:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T18:29:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T18:29:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T18:29:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T18:29:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T18:29:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:44.776 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:44.929 INFO:teuthology.orchestra.run.smithi053.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.0 MB/s | 1.0 MB 00:00 2024-05-08T18:29:44.933 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:44.933 INFO:teuthology.orchestra.run.smithi053.stdout:Total 1.3 MB/s | 2.2 MB 00:01 2024-05-08T18:29:45.007 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-08T18:29:45.024 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-08T18:29:45.024 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-08T18:29:45.029 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-fuse 2024-05-08T18:29:45.121 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-08T18:29:45.121 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-08T18:29:45.608 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:35 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:45.731 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:45.731 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:45.731 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-05-08T18:29:45.731 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:45.731 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T18:29:45.732 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 891 k 2024-05-08T18:29:45.732 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-05-08T18:29:45.732 INFO:teuthology.orchestra.run.smithi087.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T18:29:45.732 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:45.732 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T18:29:45.732 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:45.732 INFO:teuthology.orchestra.run.smithi087.stdout:Install 2 Packages 2024-05-08T18:29:45.732 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:45.733 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 971 k 2024-05-08T18:29:45.733 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 2.8 M 2024-05-08T18:29:45.733 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T18:29:45.759 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-08T18:29:45.937 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-08T18:29:45.999 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-08T18:29:46.054 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-08T18:29:46.090 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-08T18:29:46.132 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-08T18:29:46.136 INFO:teuthology.orchestra.run.smithi087.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 224 kB/s | 80 kB 00:00 2024-05-08T18:29:46.230 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-08T18:29:46.342 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-08T18:29:46.401 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-08T18:29:46.478 INFO:teuthology.orchestra.run.smithi087.stdout:(2/2): ceph-fuse-19.0.0-3463.gd8e5981c.el9.x86_ 1.2 MB/s | 891 kB 00:00 2024-05-08T18:29:46.478 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:46.478 INFO:teuthology.orchestra.run.smithi087.stdout:Total 1.3 MB/s | 971 kB 00:00 2024-05-08T18:29:46.491 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T18:29:46.513 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T18:29:46.513 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T18:29:46.596 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T18:29:46.596 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T18:29:46.789 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T18:29:46.929 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-08T18:29:46.994 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/2 2024-05-08T18:29:47.172 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-08T18:29:47.230 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-08T18:29:47.264 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-08T18:29:47.313 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-08T18:29:47.342 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-rook-2:19.0.0-3463.gd8e5981c.el9.noarch 13/13 2024-05-08T18:29:47.658 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/2 2024-05-08T18:29:47.658 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/2 2024-05-08T18:29:47.952 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-08T18:29:47.952 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:47.952 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T18:29:47.952 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-08T18:29:47.952 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:47.952 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:48.127 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3463.gd8e5981c.el9.noarch 13/13 2024-05-08T18:29:48.128 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3463.gd8e5981c.el9.noarch 1/13 2024-05-08T18:29:48.128 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-08T18:29:48.128 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-08T18:29:48.128 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-08T18:29:48.128 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-08T18:29:48.128 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-08T18:29:48.128 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-08T18:29:48.128 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-08T18:29:48.128 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-08T18:29:48.128 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-08T18:29:48.128 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-08T18:29:48.128 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-08T18:29:48.241 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-volume 2024-05-08T18:29:48.478 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-08T18:29:48.478 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:48.478 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-08T18:29:48.478 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:29:48.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T18:29:48.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T18:29:48.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T18:29:48.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T18:29:48.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T18:29:48.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T18:29:48.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T18:29:48.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T18:29:48.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T18:29:48.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T18:29:48.479 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T18:29:48.480 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T18:29:48.480 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:48.480 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:29:48.733 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-cephadm 2024-05-08T18:29:48.814 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:38 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:48.939 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:48.940 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:48.940 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-05-08T18:29:48.940 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:48.940 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T18:29:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 273 k 2024-05-08T18:29:48.941 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-05-08T18:29:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T18:29:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:48.941 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T18:29:48.941 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:48.941 INFO:teuthology.orchestra.run.smithi087.stdout:Install 2 Packages 2024-05-08T18:29:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:48.941 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 350 k 2024-05-08T18:29:48.941 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 1.5 M 2024-05-08T18:29:48.941 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T18:29:49.325 INFO:teuthology.orchestra.run.smithi087.stdout:(1/2): ceph-volume-19.0.0-3463.gd8e5981c.el9.no 1.1 MB/s | 273 kB 00:00 2024-05-08T18:29:49.329 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:38 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:29:49.350 INFO:teuthology.orchestra.run.smithi087.stdout:(2/2): python3-packaging-20.9-5.el9.noarch.rpm 277 kB/s | 77 kB 00:00 2024-05-08T18:29:49.350 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:49.350 INFO:teuthology.orchestra.run.smithi087.stdout:Total 854 kB/s | 350 kB 00:00 2024-05-08T18:29:49.362 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T18:29:49.371 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T18:29:49.371 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T18:29:49.408 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T18:29:49.408 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T18:29:49.454 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:29:49.455 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:49.455 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-05-08T18:29:49.455 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:49.455 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-08T18:29:49.455 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 142 k 2024-05-08T18:29:49.455 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-05-08T18:29:49.455 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T18:29:49.455 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T18:29:49.455 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T18:29:49.455 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T18:29:49.455 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T18:29:49.456 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:49.456 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-08T18:29:49.456 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:49.456 INFO:teuthology.orchestra.run.smithi053.stdout:Install 6 Packages 2024-05-08T18:29:49.456 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:49.456 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 7.0 M 2024-05-08T18:29:49.456 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 33 M 2024-05-08T18:29:49.457 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-08T18:29:49.553 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T18:29:49.729 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-05-08T18:29:49.769 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-volume-2:19.0.0-3463.gd8e5981c.el9.noarch 2/2 2024-05-08T18:29:49.785 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-volume-2:19.0.0-3463.gd8e5981c.el9.noarch 2/2 2024-05-08T18:29:49.785 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:29:49.785 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T18:29:49.785 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:50.006 INFO:teuthology.orchestra.run.smithi053.stdout:(1/6): ceph-mgr-cephadm-19.0.0-3463.gd8e5981c.e 444 kB/s | 142 kB 00:00 2024-05-08T18:29:50.415 INFO:teuthology.orchestra.run.smithi053.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 340 kB/s | 248 kB 00:00 2024-05-08T18:29:50.555 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-volume-2:19.0.0-3463.gd8e5981c.el9.noarch 1/2 2024-05-08T18:29:50.740 INFO:teuthology.orchestra.run.smithi053.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 177 kB/s | 58 kB 00:00 2024-05-08T18:29:50.874 INFO:teuthology.orchestra.run.smithi053.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 382 kB/s | 51 kB 00:00 2024-05-08T18:29:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-05-08T18:29:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:50.884 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T18:29:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:29:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T18:29:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:50.884 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:51.141 INFO:teuthology.orchestra.run.smithi053.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 483 kB/s | 548 kB 00:01 2024-05-08T18:29:51.181 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install librados-devel 2024-05-08T18:29:51.762 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:41 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:51.886 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:51.886 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:51.886 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repo Size 2024-05-08T18:29:51.886 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:51.886 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T18:29:51.886 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 127 k 2024-05-08T18:29:51.887 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:51.887 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T18:29:51.887 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:51.887 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-05-08T18:29:51.887 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:51.887 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 127 k 2024-05-08T18:29:51.887 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 456 k 2024-05-08T18:29:51.888 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T18:29:52.386 INFO:teuthology.orchestra.run.smithi087.stdout:librados-devel-19.0.0-3463.gd8e5981c.el9.x86_64 254 kB/s | 127 kB 00:00 2024-05-08T18:29:52.387 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:52.387 INFO:teuthology.orchestra.run.smithi087.stdout:Total 253 kB/s | 127 kB 00:00 2024-05-08T18:29:52.387 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T18:29:52.391 INFO:teuthology.orchestra.run.smithi053.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.2 MB/s | 6.0 MB 00:02 2024-05-08T18:29:52.392 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T18:29:52.392 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T18:29:52.394 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:52.395 INFO:teuthology.orchestra.run.smithi053.stdout:Total 2.4 MB/s | 7.0 MB 00:02 2024-05-08T18:29:52.456 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T18:29:52.456 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T18:29:52.472 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-08T18:29:52.485 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-08T18:29:52.486 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-08T18:29:52.591 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-08T18:29:52.591 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-08T18:29:52.621 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T18:29:52.709 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librados-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:29:52.909 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-08T18:29:53.079 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-08T18:29:53.125 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:29:53.135 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-08T18:29:53.365 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:29:53.366 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:53.366 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T18:29:53.366 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:29:53.366 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:53.366 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:53.622 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install libcephfs2 2024-05-08T18:29:53.688 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-08T18:29:53.773 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-08T18:29:53.844 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-08T18:29:53.871 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 6/6 2024-05-08T18:29:54.198 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:44 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:54.281 INFO:teuthology.orchestra.run.smithi087.stdout:Package libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:29:54.326 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:54.327 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-05-08T18:29:54.327 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:54.388 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install libcephfs-devel 2024-05-08T18:29:54.601 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 6/6 2024-05-08T18:29:54.601 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/6 2024-05-08T18:29:54.601 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-08T18:29:54.601 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-08T18:29:54.601 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-08T18:29:54.602 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-08T18:29:54.860 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-08T18:29:54.860 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:54.860 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-08T18:29:54.860 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:29:54.860 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T18:29:54.860 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T18:29:54.860 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T18:29:54.860 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T18:29:54.860 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T18:29:54.860 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:54.861 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:29:54.954 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:44 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:55.076 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:55.077 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:55.077 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repo Size 2024-05-08T18:29:55.077 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:55.078 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T18:29:55.078 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 32 k 2024-05-08T18:29:55.078 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:55.078 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T18:29:55.078 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:29:55.078 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-05-08T18:29:55.078 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:55.078 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 32 k 2024-05-08T18:29:55.078 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 142 k 2024-05-08T18:29:55.078 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T18:29:55.119 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-fuse 2024-05-08T18:29:55.247 INFO:teuthology.orchestra.run.smithi087.stdout:libcephfs-devel-19.0.0-3463.gd8e5981c.el9.x86_6 187 kB/s | 32 kB 00:00 2024-05-08T18:29:55.248 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:55.249 INFO:teuthology.orchestra.run.smithi087.stdout:Total 186 kB/s | 32 kB 00:00 2024-05-08T18:29:55.249 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T18:29:55.252 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T18:29:55.252 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T18:29:55.270 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T18:29:55.271 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T18:29:55.351 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T18:29:55.453 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:29:55.718 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:44 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:29:55.814 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:29:55.844 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:29:55.844 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:55.844 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-05-08T18:29:55.845 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:55.845 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-08T18:29:55.845 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 891 k 2024-05-08T18:29:55.845 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-05-08T18:29:55.845 INFO:teuthology.orchestra.run.smithi053.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T18:29:55.845 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:55.845 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-08T18:29:55.845 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:55.845 INFO:teuthology.orchestra.run.smithi053.stdout:Install 2 Packages 2024-05-08T18:29:55.846 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:55.846 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 971 k 2024-05-08T18:29:55.846 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 2.8 M 2024-05-08T18:29:55.846 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-08T18:29:56.040 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:29:56.040 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:56.040 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T18:29:56.040 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:29:56.040 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:29:56.040 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:56.051 INFO:teuthology.orchestra.run.smithi053.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 583 kB/s | 80 kB 00:00 2024-05-08T18:29:56.228 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install librados2 2024-05-08T18:29:56.243 INFO:teuthology.orchestra.run.smithi053.stdout:(2/2): ceph-fuse-19.0.0-3463.gd8e5981c.el9.x86_ 2.6 MB/s | 891 kB 00:00 2024-05-08T18:29:56.244 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:56.244 INFO:teuthology.orchestra.run.smithi053.stdout:Total 2.4 MB/s | 971 kB 00:00 2024-05-08T18:29:56.257 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-08T18:29:56.280 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-08T18:29:56.280 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-08T18:29:56.368 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-08T18:29:56.368 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-08T18:29:56.687 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-08T18:29:56.802 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:46 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:56.825 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-08T18:29:56.883 INFO:teuthology.orchestra.run.smithi087.stdout:Package librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:29:56.896 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/2 2024-05-08T18:29:56.925 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:56.926 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-05-08T18:29:56.926 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:56.991 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install librbd1 2024-05-08T18:29:57.549 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/2 2024-05-08T18:29:57.549 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/2 2024-05-08T18:29:57.566 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:47 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:57.645 INFO:teuthology.orchestra.run.smithi087.stdout:Package librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:29:57.686 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:57.687 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-05-08T18:29:57.687 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:57.746 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install python3-rados 2024-05-08T18:29:57.801 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-08T18:29:57.801 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:57.801 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-08T18:29:57.801 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-08T18:29:57.802 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:57.802 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:29:58.068 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-volume 2024-05-08T18:29:58.312 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:48 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:58.392 INFO:teuthology.orchestra.run.smithi087.stdout:Package python3-rados-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:29:58.434 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:58.435 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-05-08T18:29:58.435 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:58.499 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install python3-rgw 2024-05-08T18:29:58.668 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:47 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:29:58.796 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:29:58.797 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:58.797 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-05-08T18:29:58.797 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:58.797 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-08T18:29:58.797 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 273 k 2024-05-08T18:29:58.797 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-05-08T18:29:58.797 INFO:teuthology.orchestra.run.smithi053.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T18:29:58.798 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:58.798 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-08T18:29:58.798 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:29:58.798 INFO:teuthology.orchestra.run.smithi053.stdout:Install 2 Packages 2024-05-08T18:29:58.798 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:29:58.799 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 350 k 2024-05-08T18:29:58.799 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 1.5 M 2024-05-08T18:29:58.799 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-08T18:29:59.064 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:49 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:59.145 INFO:teuthology.orchestra.run.smithi087.stdout:Package python3-rgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:29:59.186 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:59.187 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-05-08T18:29:59.187 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:29:59.243 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install python3-cephfs 2024-05-08T18:29:59.308 INFO:teuthology.orchestra.run.smithi053.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 336 kB/s | 77 kB 00:00 2024-05-08T18:29:59.625 INFO:teuthology.orchestra.run.smithi053.stdout:(2/2): ceph-volume-19.0.0-3463.gd8e5981c.el9.no 499 kB/s | 273 kB 00:00 2024-05-08T18:29:59.625 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:29:59.625 INFO:teuthology.orchestra.run.smithi053.stdout:Total 423 kB/s | 350 kB 00:00 2024-05-08T18:29:59.638 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-08T18:29:59.649 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-08T18:29:59.650 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-08T18:29:59.684 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-08T18:29:59.684 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-08T18:29:59.818 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:49 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:29:59.835 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-08T18:29:59.899 INFO:teuthology.orchestra.run.smithi087.stdout:Package python3-cephfs-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:29:59.941 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:29:59.942 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-05-08T18:29:59.942 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:30:00.007 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install python3-rbd 2024-05-08T18:30:00.041 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-05-08T18:30:00.069 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-volume-2:19.0.0-3463.gd8e5981c.el9.noarch 2/2 2024-05-08T18:30:00.109 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-volume-2:19.0.0-3463.gd8e5981c.el9.noarch 2/2 2024-05-08T18:30:00.109 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:30:00.109 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T18:30:00.109 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:00.575 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:50 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:30:00.656 INFO:teuthology.orchestra.run.smithi087.stdout:Package python3-rbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:30:00.697 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:30:00.698 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-05-08T18:30:00.698 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:30:00.765 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install rbd-fuse 2024-05-08T18:30:00.906 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-volume-2:19.0.0-3463.gd8e5981c.el9.noarch 1/2 2024-05-08T18:30:01.201 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-05-08T18:30:01.201 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:01.201 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-08T18:30:01.201 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:30:01.202 INFO:teuthology.orchestra.run.smithi053.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T18:30:01.202 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:01.202 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:30:01.332 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:51 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:30:01.455 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:30:01.456 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:30:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-05-08T18:30:01.456 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:30:01.456 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T18:30:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 85 k 2024-05-08T18:30:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:01.456 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T18:30:01.456 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:30:01.456 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-05-08T18:30:01.457 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:01.457 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 85 k 2024-05-08T18:30:01.457 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 231 k 2024-05-08T18:30:01.457 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T18:30:01.504 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install librados-devel 2024-05-08T18:30:01.676 INFO:teuthology.orchestra.run.smithi087.stdout:rbd-fuse-19.0.0-3463.gd8e5981c.el9.x86_64.rpm 389 kB/s | 85 kB 00:00 2024-05-08T18:30:01.676 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:30:01.676 INFO:teuthology.orchestra.run.smithi087.stdout:Total 387 kB/s | 85 kB 00:00 2024-05-08T18:30:01.677 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T18:30:01.683 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T18:30:01.683 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T18:30:01.748 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T18:30:01.748 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T18:30:01.898 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T18:30:01.989 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:02.106 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:51 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:30:02.235 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:30:02.235 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:30:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repo Size 2024-05-08T18:30:02.236 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:30:02.236 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-08T18:30:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 127 k 2024-05-08T18:30:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:02.236 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-08T18:30:02.236 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:30:02.236 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-05-08T18:30:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:02.237 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 127 k 2024-05-08T18:30:02.237 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 456 k 2024-05-08T18:30:02.237 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-08T18:30:02.378 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:02.593 INFO:teuthology.orchestra.run.smithi053.stdout:librados-devel-19.0.0-3463.gd8e5981c.el9.x86_64 356 kB/s | 127 kB 00:00 2024-05-08T18:30:02.594 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:30:02.594 INFO:teuthology.orchestra.run.smithi053.stdout:Total 354 kB/s | 127 kB 00:00 2024-05-08T18:30:02.594 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-08T18:30:02.600 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-08T18:30:02.600 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-08T18:30:02.633 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:02.633 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:02.634 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T18:30:02.634 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:30:02.634 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:02.634 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:30:02.667 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-08T18:30:02.668 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-08T18:30:02.837 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-08T18:30:02.878 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install rbd-mirror 2024-05-08T18:30:02.936 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librados-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:03.474 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:53 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:30:03.490 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:03.599 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:30:03.599 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:30:03.600 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repo Size 2024-05-08T18:30:03.600 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:30:03.600 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T18:30:03.600 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 3.1 M 2024-05-08T18:30:03.600 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:03.600 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T18:30:03.600 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:30:03.600 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-05-08T18:30:03.600 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:03.600 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 3.1 M 2024-05-08T18:30:03.600 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 13 M 2024-05-08T18:30:03.600 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T18:30:03.750 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:03.751 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:03.751 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-08T18:30:03.751 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:30:03.751 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:03.751 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:30:04.005 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install libcephfs2 2024-05-08T18:30:04.271 INFO:teuthology.orchestra.run.smithi087.stdout:rbd-mirror-19.0.0-3463.gd8e5981c.el9.x86_64.rpm 4.6 MB/s | 3.1 MB 00:00 2024-05-08T18:30:04.271 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:30:04.272 INFO:teuthology.orchestra.run.smithi087.stdout:Total 4.6 MB/s | 3.1 MB 00:00 2024-05-08T18:30:04.272 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T18:30:04.280 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T18:30:04.281 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T18:30:04.360 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T18:30:04.361 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T18:30:04.604 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:53 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:30:04.689 INFO:teuthology.orchestra.run.smithi053.stdout:Package libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:30:04.734 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:30:04.735 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-05-08T18:30:04.735 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:30:04.787 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T18:30:04.791 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install libcephfs-devel 2024-05-08T18:30:04.838 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-mirror-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:04.863 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:04.864 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:30:04.864 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T18:30:04.864 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T18:30:04.864 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T18:30:04.864 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:05.390 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:54 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:30:05.518 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:30:05.519 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:30:05.519 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repo Size 2024-05-08T18:30:05.519 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:30:05.519 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-08T18:30:05.519 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 32 k 2024-05-08T18:30:05.520 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:05.520 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-08T18:30:05.520 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:30:05.520 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-05-08T18:30:05.520 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:05.520 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 32 k 2024-05-08T18:30:05.520 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 142 k 2024-05-08T18:30:05.520 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-08T18:30:05.855 INFO:teuthology.orchestra.run.smithi053.stdout:libcephfs-devel-19.0.0-3463.gd8e5981c.el9.x86_6 95 kB/s | 32 kB 00:00 2024-05-08T18:30:05.856 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:30:05.856 INFO:teuthology.orchestra.run.smithi053.stdout:Total 94 kB/s | 32 kB 00:00 2024-05-08T18:30:05.856 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-08T18:30:05.860 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-08T18:30:05.860 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-08T18:30:05.876 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-08T18:30:05.876 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-08T18:30:05.899 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-mirror-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:05.899 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:05.900 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T18:30:05.900 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:30:05.900 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:05.900 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:30:05.959 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-08T18:30:06.064 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:06.148 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install rbd-nbd 2024-05-08T18:30:06.532 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:06.729 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:56 ago on Wed 08 May 2024 06:28:10 PM UTC. 2024-05-08T18:30:06.758 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:06.758 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:06.758 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-08T18:30:06.758 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:30:06.758 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:06.758 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:30:06.857 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-08T18:30:06.857 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:30:06.858 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-05-08T18:30:06.858 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:30:06.858 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-08T18:30:06.858 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 171 k 2024-05-08T18:30:06.858 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:06.858 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-08T18:30:06.858 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-08T18:30:06.858 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-05-08T18:30:06.858 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:06.858 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 171 k 2024-05-08T18:30:06.858 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 494 k 2024-05-08T18:30:06.858 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-08T18:30:06.931 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install librados2 2024-05-08T18:30:07.249 INFO:teuthology.orchestra.run.smithi087.stdout:rbd-nbd-19.0.0-3463.gd8e5981c.el9.x86_64.rpm 437 kB/s | 171 kB 00:00 2024-05-08T18:30:07.250 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:30:07.250 INFO:teuthology.orchestra.run.smithi087.stdout:Total 435 kB/s | 171 kB 00:00 2024-05-08T18:30:07.250 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-08T18:30:07.258 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-08T18:30:07.258 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-08T18:30:07.321 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-08T18:30:07.321 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-08T18:30:07.469 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-08T18:30:07.523 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:56 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:30:07.571 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-nbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:07.607 INFO:teuthology.orchestra.run.smithi053.stdout:Package librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:30:07.652 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:30:07.653 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-05-08T18:30:07.653 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:30:07.719 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install librbd1 2024-05-08T18:30:07.976 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:08.222 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-nbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:08.223 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:08.223 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-08T18:30:08.223 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:30:08.223 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:08.223 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-08T18:30:08.313 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:57 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:30:08.396 INFO:teuthology.orchestra.run.smithi053.stdout:Package librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:30:08.441 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:30:08.442 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-05-08T18:30:08.442 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:30:08.461 DEBUG:teuthology.parallel:result is None 2024-05-08T18:30:08.499 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-rados 2024-05-08T18:30:09.098 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:58 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:30:09.183 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-rados-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:30:09.227 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:30:09.228 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-05-08T18:30:09.228 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:30:09.292 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-rgw 2024-05-08T18:30:09.888 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:58 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:30:09.973 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-rgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:30:10.018 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:30:10.019 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-05-08T18:30:10.019 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:30:10.086 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-cephfs 2024-05-08T18:30:10.690 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:59 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:30:10.774 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-cephfs-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:30:10.818 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:30:10.819 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-05-08T18:30:10.819 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:30:10.884 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-rbd 2024-05-08T18:30:11.486 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:00 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:30:11.570 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-rbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:30:11.614 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:30:11.615 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-05-08T18:30:11.615 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:30:11.673 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install rbd-fuse 2024-05-08T18:30:12.267 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:01 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:30:12.394 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:30:12.395 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:30:12.395 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-05-08T18:30:12.395 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:30:12.396 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-08T18:30:12.396 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 85 k 2024-05-08T18:30:12.396 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:12.396 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-08T18:30:12.396 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:30:12.396 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-05-08T18:30:12.396 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:12.396 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 85 k 2024-05-08T18:30:12.396 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 231 k 2024-05-08T18:30:12.396 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-08T18:30:12.591 INFO:teuthology.orchestra.run.smithi053.stdout:rbd-fuse-19.0.0-3463.gd8e5981c.el9.x86_64.rpm 437 kB/s | 85 kB 00:00 2024-05-08T18:30:12.592 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:30:12.592 INFO:teuthology.orchestra.run.smithi053.stdout:Total 434 kB/s | 85 kB 00:00 2024-05-08T18:30:12.592 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-08T18:30:12.600 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-08T18:30:12.600 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-08T18:30:12.667 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-08T18:30:12.667 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-08T18:30:12.817 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-08T18:30:12.918 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:13.273 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:13.533 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:13.533 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:13.533 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-08T18:30:13.533 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:30:13.533 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:13.533 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:30:13.769 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install rbd-mirror 2024-05-08T18:30:14.368 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:03 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:30:14.497 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:30:14.498 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:30:14.498 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repo Size 2024-05-08T18:30:14.498 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:30:14.498 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-08T18:30:14.499 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 3.1 M 2024-05-08T18:30:14.499 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:14.499 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-08T18:30:14.499 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:30:14.499 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-05-08T18:30:14.499 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:14.499 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 3.1 M 2024-05-08T18:30:14.499 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 13 M 2024-05-08T18:30:14.499 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-08T18:30:15.386 INFO:teuthology.orchestra.run.smithi053.stdout:rbd-mirror-19.0.0-3463.gd8e5981c.el9.x86_64.rpm 3.5 MB/s | 3.1 MB 00:00 2024-05-08T18:30:15.386 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:30:15.387 INFO:teuthology.orchestra.run.smithi053.stdout:Total 3.5 MB/s | 3.1 MB 00:00 2024-05-08T18:30:15.387 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-08T18:30:15.397 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-08T18:30:15.398 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-08T18:30:15.483 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-08T18:30:15.483 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-08T18:30:15.934 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-08T18:30:15.986 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-mirror-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:16.013 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:16.013 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:30:16.013 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T18:30:16.013 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T18:30:16.013 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T18:30:16.013 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:17.191 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-mirror-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:17.191 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:17.191 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-08T18:30:17.191 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:30:17.191 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:17.191 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:30:17.454 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install rbd-nbd 2024-05-08T18:30:18.053 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:07 ago on Wed 08 May 2024 06:28:11 PM UTC. 2024-05-08T18:30:18.179 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-05-08T18:30:18.180 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:30:18.180 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-05-08T18:30:18.180 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:30:18.181 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-05-08T18:30:18.181 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 171 k 2024-05-08T18:30:18.181 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:18.181 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-05-08T18:30:18.181 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-05-08T18:30:18.181 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-05-08T18:30:18.181 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:18.181 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 171 k 2024-05-08T18:30:18.181 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 494 k 2024-05-08T18:30:18.181 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-05-08T18:30:18.531 INFO:teuthology.orchestra.run.smithi053.stdout:rbd-nbd-19.0.0-3463.gd8e5981c.el9.x86_64.rpm 489 kB/s | 171 kB 00:00 2024-05-08T18:30:18.531 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:30:18.531 INFO:teuthology.orchestra.run.smithi053.stdout:Total 487 kB/s | 171 kB 00:00 2024-05-08T18:30:18.532 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-05-08T18:30:18.540 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-05-08T18:30:18.540 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-05-08T18:30:18.607 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-05-08T18:30:18.608 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-05-08T18:30:18.767 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-05-08T18:30:18.873 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-nbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:19.371 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:19.616 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-nbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:30:19.616 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:19.616 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-05-08T18:30:19.616 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:30:19.616 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:19.616 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-05-08T18:30:19.864 DEBUG:teuthology.parallel:result is None 2024-05-08T18:30:19.864 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 2024-05-08T18:30:20.252 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T18:30:20.276 INFO:teuthology.orchestra.run.smithi053.stdout:19.0.0-3463.gd8e5981c.el9 2024-05-08T18:30:20.276 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3463.gd8e5981c.el9 2024-05-08T18:30:20.276 INFO:teuthology.task.install:The correct ceph version 19.0.0-3463.gd8e5981c is installed. 2024-05-08T18:30:20.278 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 2024-05-08T18:30:20.422 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T18:30:20.447 INFO:teuthology.orchestra.run.smithi087.stdout:19.0.0-3463.gd8e5981c.el9 2024-05-08T18:30:20.448 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3463.gd8e5981c.el9 2024-05-08T18:30:20.448 INFO:teuthology.task.install:The correct ceph version 19.0.0-3463.gd8e5981c is installed. 2024-05-08T18:30:20.450 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T18:30:20.450 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:30:20.450 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T18:30:20.481 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T18:30:20.481 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T18:30:20.518 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T18:30:20.518 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:30:20.519 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T18:30:20.551 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T18:30:20.635 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T18:30:20.635 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T18:30:20.664 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T18:30:20.733 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T18:30:20.733 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:30:20.733 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T18:30:20.761 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T18:30:20.829 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T18:30:20.829 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T18:30:20.859 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T18:30:20.927 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T18:30:20.927 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:30:20.927 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T18:30:20.956 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T18:30:21.024 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T18:30:21.024 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T18:30:21.051 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T18:30:21.117 INFO:teuthology.run_tasks:Running task ceph... 2024-05-08T18:30:21.218 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-08T18:30:21.218 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /var/log/ceph 2024-05-08T18:30:21.220 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2024-05-08T18:30:21.247 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-08T18:30:21.247 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T18:30:21.289 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T18:30:21.315 INFO:tasks.ceph:Creating extra log directories... 2024-05-08T18:30:21.316 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T18:30:21.357 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T18:30:21.392 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-08T18:30:21.393 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-08T18:30:21.393 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697913', 'branch': 'wip-upgrade-arrow-15', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}}', 'email': 'ivancich@redhat.com', 'first_in_suite': False, 'job_id': '7697913', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-upgrade-arrow-15'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-upgrade-arrow-15', 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0'}}, 'owner': 'scheduled_ivancich@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 831, 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0', 'sleep_before_teardown': 0, 'subset': '1/50', 'suite': 'rgw', 'suite_branch': 'wip-upgrade-arrow-15', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0', 'targets': {'smithi053.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO8RyI81u3q9M9VM2rWIaf705TfPNUCMdpGPRI1t7Q/fbaLmW5Me38ENLd700SgsfrqEw4/IXQ16VKY+Sv7kzpg=', 'smithi087.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPQ246GKy46o1Y9h/xWKxCY9hQHJ+MsYsRAey1aV0eBPnhHpcGKctYDSya+1i+XJq9WhobiDVXxQL0SBysqeicY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_17:44:56', 'tube': 'smithi', 'user': 'ivancich', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-08T18:30:21.393 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T18:30:21.426 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T18:30:21.442 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T18:30:21.483 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T18:30:21.508 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:30:21.509 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T18:30:21.564 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T18:30:21.565 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2024-05-08T18:30:21.621 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T18:30:21.621 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:30:21.621 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-08T18:30:21.621 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:30:21.621 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T18:30:21.621 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-05-08 18:30:16.277362256 +0000 2024-05-08T18:30:21.622 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-05-08 18:27:29.735509185 +0000 2024-05-08T18:30:21.622 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-05-08 18:27:29.735509185 +0000 2024-05-08T18:30:21.622 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-05-08 18:27:29.735509185 +0000 2024-05-08T18:30:21.622 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T18:30:21.686 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-05-08T18:30:21.687 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-05-08T18:30:21.687 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000115343 s, 4.4 MB/s 2024-05-08T18:30:21.688 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T18:30:21.746 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2024-05-08T18:30:21.803 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T18:30:21.803 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:30:21.803 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-08T18:30:21.803 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:30:21.803 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T18:30:21.803 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-05-08 18:30:16.277362256 +0000 2024-05-08T18:30:21.803 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-05-08 18:27:30.073502722 +0000 2024-05-08T18:30:21.803 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-05-08 18:27:30.073502722 +0000 2024-05-08T18:30:21.804 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-05-08 18:27:30.073502722 +0000 2024-05-08T18:30:21.804 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T18:30:21.867 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-05-08T18:30:21.867 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-05-08T18:30:21.867 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000111818 s, 4.6 MB/s 2024-05-08T18:30:21.869 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T18:30:21.926 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-05-08 18:30:16.278362237 +0000 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-05-08 18:27:30.419496105 +0000 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-05-08 18:27:30.419496105 +0000 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-05-08 18:27:30.419496105 +0000 2024-05-08T18:30:21.984 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T18:30:22.048 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-05-08T18:30:22.048 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-05-08T18:30:22.048 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000100255 s, 5.1 MB/s 2024-05-08T18:30:22.049 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T18:30:22.106 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2024-05-08T18:30:22.162 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T18:30:22.163 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:30:22.163 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-08T18:30:22.163 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:30:22.163 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T18:30:22.163 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-05-08 18:30:16.278362237 +0000 2024-05-08T18:30:22.163 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-05-08 18:27:30.747489833 +0000 2024-05-08T18:30:22.163 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-05-08 18:27:30.747489833 +0000 2024-05-08T18:30:22.163 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-05-08 18:27:30.747489833 +0000 2024-05-08T18:30:22.163 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T18:30:22.226 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-05-08T18:30:22.227 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-05-08T18:30:22.227 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 8.6196e-05 s, 5.9 MB/s 2024-05-08T18:30:22.228 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T18:30:22.286 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-05-08T18:30:22.286 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T18:30:22.286 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T18:30:22.305 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T18:30:22.305 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2024-05-08T18:30:22.364 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T18:30:22.364 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:30:22.364 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-05-08T18:30:22.365 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:30:22.365 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T18:30:22.365 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-05-08 18:30:05.115259499 +0000 2024-05-08T18:30:22.365 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-08 18:27:29.733203705 +0000 2024-05-08T18:30:22.365 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-08 18:27:29.733203705 +0000 2024-05-08T18:30:22.365 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-05-08 18:27:29.733203705 +0000 2024-05-08T18:30:22.365 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T18:30:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-05-08T18:30:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-05-08T18:30:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.00027489 s, 1.9 MB/s 2024-05-08T18:30:22.433 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T18:30:22.491 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2024-05-08T18:30:22.550 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T18:30:22.550 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:30:22.550 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-08T18:30:22.550 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:30:22.551 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T18:30:22.551 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-05-08 18:30:05.115259499 +0000 2024-05-08T18:30:22.551 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-08 18:27:30.083195750 +0000 2024-05-08T18:30:22.551 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-08 18:27:30.083195750 +0000 2024-05-08T18:30:22.551 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-05-08 18:27:30.083195750 +0000 2024-05-08T18:30:22.551 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T18:30:22.616 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-05-08T18:30:22.616 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-05-08T18:30:22.616 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000173419 s, 3.0 MB/s 2024-05-08T18:30:22.618 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T18:30:22.675 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2024-05-08T18:30:22.732 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T18:30:22.733 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:30:22.733 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-05-08T18:30:22.733 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:30:22.733 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T18:30:22.733 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-05-08 18:30:05.116259477 +0000 2024-05-08T18:30:22.734 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-08 18:27:30.436187728 +0000 2024-05-08T18:30:22.734 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-08 18:27:30.436187728 +0000 2024-05-08T18:30:22.734 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-05-08 18:27:30.436187728 +0000 2024-05-08T18:30:22.734 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T18:30:22.796 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-05-08T18:30:22.796 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-05-08T18:30:22.796 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000214195 s, 2.4 MB/s 2024-05-08T18:30:22.798 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T18:30:22.854 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2024-05-08T18:30:22.911 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T18:30:22.911 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:30:22.911 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-08T18:30:22.911 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:30:22.911 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T18:30:22.911 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-05-08 18:30:05.116259477 +0000 2024-05-08T18:30:22.911 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-08 18:27:30.768180183 +0000 2024-05-08T18:30:22.911 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-08 18:27:30.768180183 +0000 2024-05-08T18:30:22.912 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-05-08 18:27:30.768180183 +0000 2024-05-08T18:30:22.912 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T18:30:22.974 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-05-08T18:30:22.975 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-05-08T18:30:22.975 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000203147 s, 2.5 MB/s 2024-05-08T18:30:22.977 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T18:30:23.033 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-08T18:30:23.033 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-05-08T18:30:23.033 INFO:tasks.ceph:Generating config... 2024-05-08T18:30:23.034 INFO:tasks.ceph:[client] debug ms = 1 2024-05-08T18:30:23.035 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-05-08T18:30:23.035 INFO:tasks.ceph:[client] debug rgw = 20 2024-05-08T18:30:23.035 INFO:tasks.ceph:[client] setgroup = ceph 2024-05-08T18:30:23.035 INFO:tasks.ceph:[client] setuser = ceph 2024-05-08T18:30:23.035 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-08T18:30:23.035 INFO:tasks.ceph:[osd] debug objclass = 20 2024-05-08T18:30:23.035 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-08T18:30:23.035 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-08T18:30:23.035 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-08T18:30:23.035 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-08T18:30:23.035 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-08T18:30:23.035 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-08T18:30:23.035 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-08T18:30:23.036 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-08T18:30:23.036 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-08T18:30:23.036 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-08T18:30:23.036 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-08T18:30:23.036 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-08T18:30:23.036 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-08T18:30:23.036 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-08T18:30:23.036 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-08T18:30:23.036 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-08T18:30:23.036 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-08T18:30:23.036 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-08T18:30:23.036 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-08T18:30:23.037 INFO:tasks.ceph:Setting up mon.a... 2024-05-08T18:30:23.037 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-08T18:30:23.095 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.keyring 2024-05-08T18:30:23.099 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-08T18:30:23.146 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T18:30:23.173 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.53')] 2024-05-08T18:30:23.173 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.53'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-05-08T18:30:23.174 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:30:23.174 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T18:30:23.230 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.53 --print /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:30:23.312 INFO:teuthology.orchestra.run.smithi053.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:30:23.312 INFO:teuthology.orchestra.run.smithi053.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:30:23.312 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:30:23.313 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: generated fsid 24862ec0-9aa3-4837-9fb5-4efcd65f7b56 2024-05-08T18:30:23.313 INFO:teuthology.orchestra.run.smithi053.stdout:setting min_mon_release = quincy 2024-05-08T18:30:23.313 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 0 2024-05-08T18:30:23.313 INFO:teuthology.orchestra.run.smithi053.stdout:fsid 24862ec0-9aa3-4837-9fb5-4efcd65f7b56 2024-05-08T18:30:23.313 INFO:teuthology.orchestra.run.smithi053.stdout:last_changed 2024-05-08T18:30:23.315299+0000 2024-05-08T18:30:23.313 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-05-08T18:30:23.315299+0000 2024-05-08T18:30:23.313 INFO:teuthology.orchestra.run.smithi053.stdout:min_mon_release 17 (quincy) 2024-05-08T18:30:23.313 INFO:teuthology.orchestra.run.smithi053.stdout:election_strategy: 1 2024-05-08T18:30:23.313 INFO:teuthology.orchestra.run.smithi053.stdout:0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2024-05-08T18:30:23.313 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-05-08T18:30:23.314 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T18:30:23.371 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 24862ec0-9aa3-4837-9fb5-4efcd65f7b56... 2024-05-08T18:30:23.372 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T18:30:23.414 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T18:30:23.457 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2024-05-08T18:30:23.457 INFO:teuthology.orchestra.run.smithi053.stdout: chdir = "" 2024-05-08T18:30:23.457 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T18:30:23.457 INFO:teuthology.orchestra.run.smithi053.stdout: auth supported = cephx 2024-05-08T18:30:23.457 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.457 INFO:teuthology.orchestra.run.smithi053.stdout: filestore xattr use omap = true 2024-05-08T18:30:23.457 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.457 INFO:teuthology.orchestra.run.smithi053.stdout: mon clock drift allowed = 1.000 2024-05-08T18:30:23.457 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.457 INFO:teuthology.orchestra.run.smithi053.stdout: osd crush chooseleaf type = 0 2024-05-08T18:30:23.458 INFO:teuthology.orchestra.run.smithi053.stdout: auth debug = true 2024-05-08T18:30:23.458 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.458 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on old message = true 2024-05-08T18:30:23.458 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on bug = true 2024-05-08T18:30:23.458 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.458 INFO:teuthology.orchestra.run.smithi053.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T18:30:23.458 INFO:teuthology.orchestra.run.smithi053.stdout: mon pg warn max object skew = 0 2024-05-08T18:30:23.458 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.458 INFO:teuthology.orchestra.run.smithi053.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T18:30:23.458 INFO:teuthology.orchestra.run.smithi053.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T18:30:23.458 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.458 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default size = 2 2024-05-08T18:30:23.458 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.459 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow primary affinity = true 2024-05-08T18:30:23.459 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow pg remap = true 2024-05-08T18:30:23.459 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on legacy crush tunables = false 2024-05-08T18:30:23.459 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on crush straw calc version zero = false 2024-05-08T18:30:23.459 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on no sortbitwise = false 2024-05-08T18:30:23.459 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on osd down out interval zero = false 2024-05-08T18:30:23.459 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on too few osds = false 2024-05-08T18:30:23.459 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T18:30:23.459 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T18:30:23.459 INFO:teuthology.orchestra.run.smithi053.stdout: mon_allow_pool_size_one = true 2024-05-08T18:30:23.459 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.459 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T18:30:23.459 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.460 INFO:teuthology.orchestra.run.smithi053.stdout: osd default data pool replay window = 5 2024-05-08T18:30:23.460 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.460 INFO:teuthology.orchestra.run.smithi053.stdout: mon allow pool delete = true 2024-05-08T18:30:23.460 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.460 INFO:teuthology.orchestra.run.smithi053.stdout: mon cluster log file level = debug 2024-05-08T18:30:23.460 INFO:teuthology.orchestra.run.smithi053.stdout: debug asserts on shutdown = true 2024-05-08T18:30:23.460 INFO:teuthology.orchestra.run.smithi053.stdout: mon health detail to clog = false 2024-05-08T18:30:23.460 INFO:teuthology.orchestra.run.smithi053.stdout: mon host = 172.21.15.53 2024-05-08T18:30:23.460 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = 24862ec0-9aa3-4837-9fb5-4efcd65f7b56 2024-05-08T18:30:23.460 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.460 INFO:teuthology.orchestra.run.smithi053.stdout:[osd] 2024-05-08T18:30:23.460 INFO:teuthology.orchestra.run.smithi053.stdout: osd journal size = 100 2024-05-08T18:30:23.460 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.460 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub load threshold = 5.0 2024-05-08T18:30:23.460 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub max interval = 600 2024-05-08T18:30:23.461 INFO:teuthology.orchestra.run.smithi053.stdout: osd mclock profile = high_recovery_ops 2024-05-08T18:30:23.461 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.461 INFO:teuthology.orchestra.run.smithi053.stdout: osd recover clone overlap = true 2024-05-08T18:30:23.461 INFO:teuthology.orchestra.run.smithi053.stdout: osd recovery max chunk = 1048576 2024-05-08T18:30:23.461 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.461 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug shutdown = true 2024-05-08T18:30:23.461 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug op order = true 2024-05-08T18:30:23.461 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug verify stray on activate = true 2024-05-08T18:30:23.461 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug trim objects = true 2024-05-08T18:30:23.461 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.461 INFO:teuthology.orchestra.run.smithi053.stdout: osd open classes on start = true 2024-05-08T18:30:23.461 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug pg log writeout = true 2024-05-08T18:30:23.461 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.462 INFO:teuthology.orchestra.run.smithi053.stdout: osd deep scrub update digest min age = 30 2024-05-08T18:30:23.462 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.462 INFO:teuthology.orchestra.run.smithi053.stdout: osd map max advance = 10 2024-05-08T18:30:23.462 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.462 INFO:teuthology.orchestra.run.smithi053.stdout: journal zero on create = true 2024-05-08T18:30:23.462 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.462 INFO:teuthology.orchestra.run.smithi053.stdout: filestore ondisk finisher threads = 3 2024-05-08T18:30:23.462 INFO:teuthology.orchestra.run.smithi053.stdout: filestore apply finisher threads = 3 2024-05-08T18:30:23.462 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.462 INFO:teuthology.orchestra.run.smithi053.stdout: bdev debug aio = true 2024-05-08T18:30:23.462 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug misdirected ops = true 2024-05-08T18:30:23.462 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-05-08T18:30:23.462 INFO:teuthology.orchestra.run.smithi053.stdout: debug objclass = 20 2024-05-08T18:30:23.462 INFO:teuthology.orchestra.run.smithi053.stdout: bdev async discard = True 2024-05-08T18:30:23.462 INFO:teuthology.orchestra.run.smithi053.stdout: bdev enable discard = True 2024-05-08T18:30:23.463 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore allocator = bitmap 2024-05-08T18:30:23.463 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore block size = 96636764160 2024-05-08T18:30:23.463 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore fsck on mount = True 2024-05-08T18:30:23.463 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluefs = 1/20 2024-05-08T18:30:23.463 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluestore = 1/20 2024-05-08T18:30:23.463 INFO:teuthology.orchestra.run.smithi053.stdout: debug osd = 20 2024-05-08T18:30:23.463 INFO:teuthology.orchestra.run.smithi053.stdout: debug rocksdb = 4/10 2024-05-08T18:30:23.463 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T18:30:23.463 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd full ratio = 0.9 2024-05-08T18:30:23.463 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd nearfull ratio = 0.8 2024-05-08T18:30:23.463 INFO:teuthology.orchestra.run.smithi053.stdout: osd failsafe full ratio = 0.95 2024-05-08T18:30:23.463 INFO:teuthology.orchestra.run.smithi053.stdout: osd objectstore = bluestore 2024-05-08T18:30:23.463 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.463 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr] 2024-05-08T18:30:23.464 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-05-08T18:30:23.464 INFO:teuthology.orchestra.run.smithi053.stdout: debug mgr = 20 2024-05-08T18:30:23.464 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-05-08T18:30:23.464 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-05-08T18:30:23.464 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:30:23.464 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:30:23.464 INFO:teuthology.orchestra.run.smithi053.stdout: mgr/telemetry/nag = false 2024-05-08T18:30:23.464 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.464 INFO:teuthology.orchestra.run.smithi053.stdout:[mon] 2024-05-08T18:30:23.464 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-05-08T18:30:23.464 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-05-08T18:30:23.464 INFO:teuthology.orchestra.run.smithi053.stdout: debug paxos = 20 2024-05-08T18:30:23.464 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-05-08T18:30:23.464 INFO:teuthology.orchestra.run.smithi053.stdout: mon data avail warn = 5 2024-05-08T18:30:23.465 INFO:teuthology.orchestra.run.smithi053.stdout: mon mgr mkfs grace = 240 2024-05-08T18:30:23.465 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:30:23.465 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd reporter subtree level = osd 2024-05-08T18:30:23.465 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd prime pg temp = true 2024-05-08T18:30:23.465 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:30:23.465 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.465 INFO:teuthology.orchestra.run.smithi053.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T18:30:23.465 INFO:teuthology.orchestra.run.smithi053.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T18:30:23.465 INFO:teuthology.orchestra.run.smithi053.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T18:30:23.465 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.465 INFO:teuthology.orchestra.run.smithi053.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T18:30:23.465 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T18:30:23.465 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T18:30:23.465 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.466 INFO:teuthology.orchestra.run.smithi053.stdout: # 1m isn't quite enough 2024-05-08T18:30:23.466 INFO:teuthology.orchestra.run.smithi053.stdout: mon_down_mkfs_grace = 2m 2024-05-08T18:30:23.466 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.466 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_filestore_osds = false 2024-05-08T18:30:23.466 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:23.466 INFO:teuthology.orchestra.run.smithi053.stdout:[client] 2024-05-08T18:30:23.466 INFO:teuthology.orchestra.run.smithi053.stdout: rgw cache enabled = true 2024-05-08T18:30:23.466 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable ops log = true 2024-05-08T18:30:23.466 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable usage log = true 2024-05-08T18:30:23.466 INFO:teuthology.orchestra.run.smithi053.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T18:30:23.466 INFO:teuthology.orchestra.run.smithi053.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T18:30:23.466 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-05-08T18:30:23.466 INFO:teuthology.orchestra.run.smithi053.stdout: rgw gc obj min wait = 15 2024-05-08T18:30:23.466 INFO:teuthology.orchestra.run.smithi053.stdout: debug rgw = 20 2024-05-08T18:30:23.466 INFO:teuthology.orchestra.run.smithi053.stdout: setgroup = ceph 2024-05-08T18:30:23.467 INFO:teuthology.orchestra.run.smithi053.stdout: setuser = ceph 2024-05-08T18:30:23.467 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.a] 2024-05-08T18:30:23.467 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2024-05-08T18:30:23.467 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2024-05-08T18:30:23.467 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T18:30:23.467 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2024-05-08T18:30:23.467 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.467 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2024-05-08T18:30:23.467 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.468 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2024-05-08T18:30:23.468 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.468 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2024-05-08T18:30:23.468 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2024-05-08T18:30:23.468 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.468 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2024-05-08T18:30:23.468 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2024-05-08T18:30:23.468 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.468 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T18:30:23.468 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2024-05-08T18:30:23.468 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.468 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T18:30:23.468 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T18:30:23.468 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.468 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2024-05-08T18:30:23.469 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.469 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2024-05-08T18:30:23.469 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2024-05-08T18:30:23.469 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2024-05-08T18:30:23.469 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2024-05-08T18:30:23.469 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2024-05-08T18:30:23.469 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2024-05-08T18:30:23.469 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2024-05-08T18:30:23.469 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T18:30:23.469 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T18:30:23.469 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2024-05-08T18:30:23.469 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.469 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T18:30:23.469 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.469 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2024-05-08T18:30:23.470 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.470 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2024-05-08T18:30:23.470 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.470 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2024-05-08T18:30:23.470 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2024-05-08T18:30:23.470 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2024-05-08T18:30:23.470 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = 172.21.15.53 2024-05-08T18:30:23.470 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = 24862ec0-9aa3-4837-9fb5-4efcd65f7b56 2024-05-08T18:30:23.470 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.470 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2024-05-08T18:30:23.470 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2024-05-08T18:30:23.470 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.470 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2024-05-08T18:30:23.470 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2024-05-08T18:30:23.471 INFO:teuthology.orchestra.run.smithi087.stdout: osd mclock profile = high_recovery_ops 2024-05-08T18:30:23.471 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.471 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2024-05-08T18:30:23.471 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2024-05-08T18:30:23.471 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.471 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2024-05-08T18:30:23.471 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2024-05-08T18:30:23.471 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2024-05-08T18:30:23.471 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug trim objects = true 2024-05-08T18:30:23.471 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.471 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2024-05-08T18:30:23.471 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2024-05-08T18:30:23.471 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.471 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2024-05-08T18:30:23.471 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.472 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2024-05-08T18:30:23.472 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.472 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2024-05-08T18:30:23.472 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.472 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2024-05-08T18:30:23.472 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2024-05-08T18:30:23.472 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.472 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2024-05-08T18:30:23.472 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2024-05-08T18:30:23.472 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-05-08T18:30:23.472 INFO:teuthology.orchestra.run.smithi087.stdout: debug objclass = 20 2024-05-08T18:30:23.472 INFO:teuthology.orchestra.run.smithi087.stdout: bdev async discard = True 2024-05-08T18:30:23.472 INFO:teuthology.orchestra.run.smithi087.stdout: bdev enable discard = True 2024-05-08T18:30:23.472 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore allocator = bitmap 2024-05-08T18:30:23.473 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2024-05-08T18:30:23.473 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2024-05-08T18:30:23.473 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 1/20 2024-05-08T18:30:23.473 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 1/20 2024-05-08T18:30:23.473 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2024-05-08T18:30:23.473 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 4/10 2024-05-08T18:30:23.473 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T18:30:23.473 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2024-05-08T18:30:23.473 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2024-05-08T18:30:23.473 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2024-05-08T18:30:23.473 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2024-05-08T18:30:23.473 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.473 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2024-05-08T18:30:23.473 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-05-08T18:30:23.474 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2024-05-08T18:30:23.474 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-05-08T18:30:23.474 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-05-08T18:30:23.474 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:30:23.474 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:30:23.474 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2024-05-08T18:30:23.474 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.474 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2024-05-08T18:30:23.474 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-05-08T18:30:23.474 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-05-08T18:30:23.474 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2024-05-08T18:30:23.474 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-05-08T18:30:23.474 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2024-05-08T18:30:23.474 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2024-05-08T18:30:23.475 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:30:23.475 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2024-05-08T18:30:23.475 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2024-05-08T18:30:23.475 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:30:23.475 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.475 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T18:30:23.475 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T18:30:23.475 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T18:30:23.475 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.475 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T18:30:23.475 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T18:30:23.475 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T18:30:23.475 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.475 INFO:teuthology.orchestra.run.smithi087.stdout: # 1m isn't quite enough 2024-05-08T18:30:23.476 INFO:teuthology.orchestra.run.smithi087.stdout: mon_down_mkfs_grace = 2m 2024-05-08T18:30:23.476 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.476 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_filestore_osds = false 2024-05-08T18:30:23.476 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-08T18:30:23.476 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2024-05-08T18:30:23.476 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2024-05-08T18:30:23.476 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2024-05-08T18:30:23.476 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2024-05-08T18:30:23.476 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T18:30:23.476 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T18:30:23.476 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-05-08T18:30:23.476 INFO:teuthology.orchestra.run.smithi087.stdout: rgw gc obj min wait = 15 2024-05-08T18:30:23.476 INFO:teuthology.orchestra.run.smithi087.stdout: debug rgw = 20 2024-05-08T18:30:23.476 INFO:teuthology.orchestra.run.smithi087.stdout: setgroup = ceph 2024-05-08T18:30:23.476 INFO:teuthology.orchestra.run.smithi087.stdout: setuser = ceph 2024-05-08T18:30:23.477 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2024-05-08T18:30:23.478 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-08T18:30:23.478 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-08T18:30:23.574 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-08T18:30:23.575 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:30:23.575 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-08T18:30:23.591 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:30:23.591 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-08T18:30:23.647 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi053.front.sepia.ceph.com 2024-05-08T18:30:23.647 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:30:23.648 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T18:30:23.648 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T18:30:23.723 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:30:23.723 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:30:23.780 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2024-05-08T18:30:23.780 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T18:30:23.780 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T18:30:23.780 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T18:30:23.816 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T18:30:23.816 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:30:23.871 INFO:tasks.ceph:Setting up mon nodes... 2024-05-08T18:30:23.871 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-08T18:30:23.871 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T18:30:23.965 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T18:30:23.967 INFO:tasks.ceph:Setting up mds nodes... 2024-05-08T18:30:23.967 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-08T18:30:23.968 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T18:30:24.008 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-08T18:30:24.020 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-08T18:30:24.021 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-05-08T18:30:24.021 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-08T18:30:24.046 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-05-08T18:30:24.047 INFO:tasks.ceph:role: osd.0 2024-05-08T18:30:24.047 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com 2024-05-08T18:30:24.047 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T18:30:24.112 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:30:24.112 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:30:24.112 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:30:24.113 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T18:30:24.113 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:30:24.113 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:30:24.113 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:30:24.113 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T18:30:24.113 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:30:24.113 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:30:24.145 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-05-08T18:30:24.147 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-05-08T18:30:24.147 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-08T18:30:24.217 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-08T18:30:24.288 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:30:24.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:24.382+0000 7f637de0e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-08T18:30:24.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:24.382+0000 7f637de0e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-08T18:30:24.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:24.382+0000 7f637de0e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T18:30:24.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:24.382+0000 7f637de0e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T18:30:24.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:24.382+0000 7f637de0e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T18:30:24.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:24.382+0000 7f637de0e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-08T18:30:27.230 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-08T18:30:27.261 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-08T18:30:27.291 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-08T18:30:27.291 INFO:tasks.ceph:role: osd.1 2024-05-08T18:30:27.292 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-08T18:30:27.292 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T18:30:27.367 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:30:27.367 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:30:27.368 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:30:27.368 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T18:30:27.368 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:30:27.368 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:30:27.368 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:30:27.368 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T18:30:27.368 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:30:27.368 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:30:27.881 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-05-08T18:30:27.883 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-05-08T18:30:27.883 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-05-08T18:30:28.015 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-08T18:30:28.048 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-08T18:30:28.115 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-08T18:30:28.115 INFO:tasks.ceph:role: osd.2 2024-05-08T18:30:28.115 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-08T18:30:28.115 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T18:30:28.189 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:30:28.189 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:30:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:30:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T18:30:28.190 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:30:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:30:28.190 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:30:28.190 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T18:30:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:30:28.190 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:30:28.647 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-05-08T18:30:28.649 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-05-08T18:30:28.649 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-05-08T18:30:28.737 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-08T18:30:28.767 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-08T18:30:28.832 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-08T18:30:28.833 INFO:tasks.ceph:role: osd.3 2024-05-08T18:30:28.833 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-08T18:30:28.833 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T18:30:28.905 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:30:28.905 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:30:28.906 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:30:28.906 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T18:30:28.906 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:30:28.906 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:30:28.906 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:30:28.906 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T18:30:28.906 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:30:28.906 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:30:29.400 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-05-08T18:30:29.402 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-05-08T18:30:29.402 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-05-08T18:30:29.530 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-08T18:30:29.559 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:30:29.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:29.689+0000 7ff411d6a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-08T18:30:29.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:29.695+0000 7ff411d6a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-08T18:30:29.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:29.695+0000 7ff411d6a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T18:30:29.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:29.695+0000 7ff411d6a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T18:30:29.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:29.695+0000 7ff411d6a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T18:30:29.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:29.696+0000 7ff411d6a640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-08T18:30:32.545 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-08T18:30:32.574 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:30:32.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:32.665+0000 7fc49b619640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-08T18:30:32.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:32.666+0000 7fc49b619640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-08T18:30:32.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:32.666+0000 7fc49b619640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T18:30:32.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:32.666+0000 7fc49b619640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T18:30:32.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:32.666+0000 7fc49b619640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T18:30:32.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:32.666+0000 7fc49b619640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-08T18:30:35.522 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-08T18:30:35.552 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:35.643+0000 7fea16296640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:35.644+0000 7fea16296640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:35.644+0000 7fea16296640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:35.644+0000 7fea16296640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:35.644+0000 7fea16296640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T18:30:35.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:35.644+0000 7fea16296640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-08T18:30:38.503 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-08T18:30:38.532 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-08T18:30:38.533 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:30:38.533 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-08T18:30:38.565 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T18:30:38.565 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-08T18:30:38.601 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T18:30:38.601 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-08T18:30:38.669 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T18:30:38.669 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-08T18:30:38.737 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T18:30:38.737 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-08T18:30:38.804 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T18:30:38.804 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-08T18:30:38.861 INFO:tasks.ceph:Adding keys to all mons... 2024-05-08T18:30:38.861 DEBUG:teuthology.orchestra.run.smithi053:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T18:30:38.890 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.0] 2024-05-08T18:30:38.890 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQDAxDtm1BrSFhAArqsVBscIqVQHi2jJf84msg== 2024-05-08T18:30:38.890 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.x] 2024-05-08T18:30:38.890 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQC/xDtm3jOwORAArKYhntfH/sEGac2UHriDBA== 2024-05-08T18:30:38.891 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.1] 2024-05-08T18:30:38.891 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQDFxDtmKCYnKRAAo8rt8y6nkNHbjDLscg/dRA== 2024-05-08T18:30:38.891 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.2] 2024-05-08T18:30:38.891 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQDIxDtmPBy5JxAAsiSzuxiCHGb49LwFCZ8Z/A== 2024-05-08T18:30:38.891 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.3] 2024-05-08T18:30:38.891 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQDLxDtm6g5qJhAAzcNpblyudHuoVhSF7ovzUQ== 2024-05-08T18:30:38.891 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2024-05-08T18:30:38.891 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQDAxDtm7cOpABAABBMbQs8FstQ7qf8cX6RY/A== 2024-05-08T18:30:38.892 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:30:38.991 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T18:30:39.046 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:30:39.098 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:30:39.150 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:30:39.202 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T18:30:39.256 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-08T18:30:39.257 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-08T18:30:39.282 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T18:30:39.380 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-08T18:30:39.405 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:30:39.461 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-08T18:30:39.462 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T18:30:39.462 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T18:30:39.504 INFO:tasks.ceph.mon.a:Started 2024-05-08T18:30:39.504 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-08T18:30:39.504 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-08T18:30:39.505 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-08T18:30:39.507 INFO:tasks.ceph.mgr.x:Started 2024-05-08T18:30:39.507 INFO:tasks.ceph:Setting crush tunables to default 2024-05-08T18:30:39.507 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd crush tunables default 2024-05-08T18:30:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.609+0000 7f2f48901640 1 Processor -- start 2024-05-08T18:30:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.610+0000 7f2f48901640 1 -- start start 2024-05-08T18:30:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.610+0000 7f2f48901640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f44092c20 0x7f2f44093000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.610+0000 7f2f48901640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f44093bf0 con 0x7f2f44093540 2024-05-08T18:30:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.610+0000 7f2f48901640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f2f44093940 con 0x7f2f44092c20 2024-05-08T18:30:39.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.610+0000 7f2f4259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f44092c20 0x7f2f44093000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:39.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.610+0000 7f2f3bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2f44093540 0x7f2f4412f4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58782/0 (socket says 172.21.15.53:58782) 2024-05-08T18:30:39.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.610+0000 7f2f3bfff640 1 -- 172.21.15.53:0/1614430073 learned_addr learned my addr 172.21.15.53:0/1614430073 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:39.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.610+0000 7f2f4259c640 1 -- 172.21.15.53:0/1614430073 >> v1:172.21.15.53:6789/0 conn(0x7f2f44093540 legacy=0x7f2f4412f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:39.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.610+0000 7f2f4259c640 1 -- 172.21.15.53:0/1614430073 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f44094310 con 0x7f2f44092c20 2024-05-08T18:30:39.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.612+0000 7f2f4259c640 1 --2- 172.21.15.53:0/1614430073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f44092c20 0x7f2f44093000 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009720 tx=0x7f2f3402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9778232e42e560 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:39.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.612+0000 7f2f41d9b640 1 -- 172.21.15.53:0/1614430073 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f340316d0 con 0x7f2f44092c20 2024-05-08T18:30:39.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.612+0000 7f2f41d9b640 1 -- 172.21.15.53:0/1614430073 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f34037070 con 0x7f2f44092c20 2024-05-08T18:30:39.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.612+0000 7f2f41d9b640 1 -- 172.21.15.53:0/1614430073 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f340319c0 con 0x7f2f44092c20 2024-05-08T18:30:39.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.613+0000 7f2f48901640 1 -- 172.21.15.53:0/1614430073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f44092c20 msgr2=0x7f2f44093000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:39.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.613+0000 7f2f48901640 1 --2- 172.21.15.53:0/1614430073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f44092c20 0x7f2f44093000 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009720 tx=0x7f2f3402b840 comp rx=0 tx=0).stop 2024-05-08T18:30:39.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.613+0000 7f2f48901640 1 -- 172.21.15.53:0/1614430073 shutdown_connections 2024-05-08T18:30:39.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.613+0000 7f2f48901640 1 --2- 172.21.15.53:0/1614430073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f44092c20 0x7f2f44093000 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:39.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.613+0000 7f2f48901640 1 -- 172.21.15.53:0/1614430073 >> 172.21.15.53:0/1614430073 conn(0x7f2f440a0d80 msgr2=0x7f2f440a1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:39.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.613+0000 7f2f48901640 1 -- 172.21.15.53:0/1614430073 shutdown_connections 2024-05-08T18:30:39.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.613+0000 7f2f48901640 1 -- 172.21.15.53:0/1614430073 wait complete. 2024-05-08T18:30:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.614+0000 7f2f48901640 1 Processor -- start 2024-05-08T18:30:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.614+0000 7f2f48901640 1 -- start start 2024-05-08T18:30:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.614+0000 7f2f48901640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f44092c20 0x7f2f441c1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.614+0000 7f2f48901640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4406ee60 con 0x7f2f44092c20 2024-05-08T18:30:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.614+0000 7f2f4259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f44092c20 0x7f2f441c1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.614+0000 7f2f4259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f44092c20 0x7f2f441c1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46412/0 (socket says 172.21.15.53:46412) 2024-05-08T18:30:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.614+0000 7f2f4259c640 1 -- 172.21.15.53:0/437442521 learned_addr learned my addr 172.21.15.53:0/437442521 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.615+0000 7f2f4259c640 1 -- 172.21.15.53:0/437442521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f44095fe0 con 0x7f2f44092c20 2024-05-08T18:30:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.615+0000 7f2f4259c640 1 --2- 172.21.15.53:0/437442521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f44092c20 0x7f2f441c1030 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009720 tx=0x7f2f340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.615+0000 7f2f3affd640 1 -- 172.21.15.53:0/437442521 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f34032770 con 0x7f2f44092c20 2024-05-08T18:30:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.615+0000 7f2f3affd640 1 -- 172.21.15.53:0/437442521 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f34032910 con 0x7f2f44092c20 2024-05-08T18:30:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.615+0000 7f2f3affd640 1 -- 172.21.15.53:0/437442521 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f34032bf0 con 0x7f2f44092c20 2024-05-08T18:30:39.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.615+0000 7f2f48901640 1 -- 172.21.15.53:0/437442521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f44096470 con 0x7f2f44092c20 2024-05-08T18:30:39.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.615+0000 7f2f48901640 1 -- 172.21.15.53:0/437442521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f441c1750 con 0x7f2f44092c20 2024-05-08T18:30:39.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.615+0000 7f2f3affd640 1 -- 172.21.15.53:0/437442521 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2f34045780 con 0x7f2f44092c20 2024-05-08T18:30:39.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.615+0000 7f2f3affd640 1 -- 172.21.15.53:0/437442521 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2f3402f050 con 0x7f2f44092c20 2024-05-08T18:30:39.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.616+0000 7f2f48901640 1 -- 172.21.15.53:0/437442521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f44093330 con 0x7f2f44092c20 2024-05-08T18:30:39.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.618+0000 7f2f3affd640 1 -- 172.21.15.53:0/437442521 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2f44093330 con 0x7f2f44092c20 2024-05-08T18:30:39.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.684+0000 7f2f48901640 1 -- 172.21.15.53:0/437442521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f2f44064010 con 0x7f2f44092c20 2024-05-08T18:30:39.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.685+0000 7f2f3affd640 1 -- 172.21.15.53:0/437442521 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f2f34040070 con 0x7f2f44092c20 2024-05-08T18:30:39.684 INFO:teuthology.orchestra.run.smithi053.stderr:adjusted tunables profile to default 2024-05-08T18:30:39.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.686+0000 7f2f48901640 1 -- 172.21.15.53:0/437442521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f44092c20 msgr2=0x7f2f441c1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:39.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.686+0000 7f2f48901640 1 --2- 172.21.15.53:0/437442521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f44092c20 0x7f2f441c1030 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009720 tx=0x7f2f340046c0 comp rx=0 tx=0).stop 2024-05-08T18:30:39.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.686+0000 7f2f48901640 1 -- 172.21.15.53:0/437442521 shutdown_connections 2024-05-08T18:30:39.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.686+0000 7f2f48901640 1 --2- 172.21.15.53:0/437442521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f44092c20 0x7f2f441c1030 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:39.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.686+0000 7f2f48901640 1 -- 172.21.15.53:0/437442521 >> 172.21.15.53:0/437442521 conn(0x7f2f440a0d80 msgr2=0x7f2f44071440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:39.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.686+0000 7f2f48901640 1 -- 172.21.15.53:0/437442521 shutdown_connections 2024-05-08T18:30:39.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:39.686+0000 7f2f48901640 1 -- 172.21.15.53:0/437442521 wait complete. 2024-05-08T18:30:39.695 INFO:tasks.ceph:check_enable_crimson: False 2024-05-08T18:30:39.695 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-08T18:30:39.695 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:30:39.695 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-08T18:30:39.721 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T18:30:39.721 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-08T18:30:39.747 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T18:30:39.747 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-08T18:30:39.812 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-08T18:30:39.812 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-08T18:30:39.877 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 2bf91df5-317b-40b7-a1ef-93220b68d9eb 0 2024-05-08T18:30:39.904 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:39.906+0000 7f3fd5c11040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T18:30:40.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.006+0000 7f9b10ebc640 1 Processor -- start 2024-05-08T18:30:40.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.006+0000 7f9b10ebc640 1 -- start start 2024-05-08T18:30:40.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.007+0000 7f9b10ebc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9b0c110c60 0x7f9b0c111040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:40.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.007+0000 7f9b10ebc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b0c111670 con 0x7f9b0c115610 2024-05-08T18:30:40.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.007+0000 7f9b10ebc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f9b0c1161d0 con 0x7f9b0c110c60 2024-05-08T18:30:40.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.007+0000 7f9b0a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9b0c110c60 0x7f9b0c111040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:40.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.007+0000 7f9b0a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9b0c110c60 0x7f9b0c111040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58314/0 (socket says 172.21.15.87:58314) 2024-05-08T18:30:40.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.007+0000 7f9b0a59c640 1 -- 172.21.15.87:0/852140856 learned_addr learned my addr 172.21.15.87:0/852140856 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:30:40.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.007+0000 7f9b0a59c640 1 -- 172.21.15.87:0/852140856 >> v1:172.21.15.53:6789/0 conn(0x7f9b0c115610 legacy=0x7f9b0c115ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.007+0000 7f9b0a59c640 1 -- 172.21.15.87:0/852140856 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c116380 con 0x7f9b0c110c60 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.008+0000 7f9b0a59c640 1 --2- 172.21.15.87:0/852140856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b0c110c60 0x7f9b0c111040 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0097f0 tx=0x7f9afc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea577fbc83b6667 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.008+0000 7f9b0959a640 1 -- 172.21.15.87:0/852140856 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9afc035020 con 0x7f9b0c110c60 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.008+0000 7f9b0959a640 1 -- 172.21.15.87:0/852140856 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc0317a0 con 0x7f9b0c110c60 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.008+0000 7f9b0959a640 1 -- 172.21.15.87:0/852140856 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9afc031aa0 con 0x7f9b0c110c60 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.009+0000 7f9b10ebc640 1 -- 172.21.15.87:0/852140856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b0c110c60 msgr2=0x7f9b0c111040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.009+0000 7f9b10ebc640 1 --2- 172.21.15.87:0/852140856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b0c110c60 0x7f9b0c111040 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0097f0 tx=0x7f9afc02b910 comp rx=0 tx=0).stop 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.009+0000 7f9b10ebc640 1 -- 172.21.15.87:0/852140856 shutdown_connections 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.009+0000 7f9b10ebc640 1 --2- 172.21.15.87:0/852140856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b0c110c60 0x7f9b0c111040 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.009+0000 7f9b10ebc640 1 -- 172.21.15.87:0/852140856 >> 172.21.15.87:0/852140856 conn(0x7f9b0c072160 msgr2=0x7f9b0c10edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.009+0000 7f9b10ebc640 1 -- 172.21.15.87:0/852140856 shutdown_connections 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.009+0000 7f9b10ebc640 1 -- 172.21.15.87:0/852140856 wait complete. 2024-05-08T18:30:40.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.010+0000 7f9b10ebc640 1 Processor -- start 2024-05-08T18:30:40.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.010+0000 7f9b10ebc640 1 -- start start 2024-05-08T18:30:40.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.010+0000 7f9b10ebc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b0c110c60 0x7f9b0c1ab370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:40.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.010+0000 7f9b10ebc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c11cd20 con 0x7f9b0c110c60 2024-05-08T18:30:40.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.010+0000 7f9b0a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b0c110c60 0x7f9b0c1ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:40.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.010+0000 7f9b0a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b0c110c60 0x7f9b0c1ab370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58324/0 (socket says 172.21.15.87:58324) 2024-05-08T18:30:40.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.010+0000 7f9b0a59c640 1 -- 172.21.15.87:0/2690761612 learned_addr learned my addr 172.21.15.87:0/2690761612 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:30:40.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.011+0000 7f9b0a59c640 1 -- 172.21.15.87:0/2690761612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c1ab940 con 0x7f9b0c110c60 2024-05-08T18:30:40.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.011+0000 7f9b0a59c640 1 --2- 172.21.15.87:0/2690761612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b0c110c60 0x7f9b0c1ab370 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0097f0 tx=0x7f9afc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:40.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.011+0000 7f9afaffd640 1 -- 172.21.15.87:0/2690761612 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9afc03ad00 con 0x7f9b0c110c60 2024-05-08T18:30:40.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.011+0000 7f9afaffd640 1 -- 172.21.15.87:0/2690761612 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc0443f0 con 0x7f9b0c110c60 2024-05-08T18:30:40.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.011+0000 7f9b10ebc640 1 -- 172.21.15.87:0/2690761612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b0c1abb70 con 0x7f9b0c110c60 2024-05-08T18:30:40.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.011+0000 7f9afaffd640 1 -- 172.21.15.87:0/2690761612 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9afc0446d0 con 0x7f9b0c110c60 2024-05-08T18:30:40.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.011+0000 7f9b10ebc640 1 -- 172.21.15.87:0/2690761612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b0c1a5400 con 0x7f9b0c110c60 2024-05-08T18:30:40.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.011+0000 7f9afaffd640 1 -- 172.21.15.87:0/2690761612 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9afc04b060 con 0x7f9b0c110c60 2024-05-08T18:30:40.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.011+0000 7f9afaffd640 1 -- 172.21.15.87:0/2690761612 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f9afc04d9d0 con 0x7f9b0c110c60 2024-05-08T18:30:40.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.012+0000 7f9b10ebc640 1 -- 172.21.15.87:0/2690761612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b0c050f90 con 0x7f9b0c110c60 2024-05-08T18:30:40.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.014+0000 7f9afaffd640 1 -- 172.21.15.87:0/2690761612 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9afc052020 con 0x7f9b0c110c60 2024-05-08T18:30:40.061 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:40.063+0000 7f3fd5c11040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T18:30:40.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.087+0000 7f9b10ebc640 1 -- 172.21.15.87:0/2690761612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2bf91df5-317b-40b7-a1ef-93220b68d9eb", "id": 0} v 0) -- 0x7f9b0c115610 con 0x7f9b0c110c60 2024-05-08T18:30:40.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.088+0000 7f9afaffd640 1 -- 172.21.15.87:0/2690761612 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2bf91df5-317b-40b7-a1ef-93220b68d9eb", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f9afc03f070 con 0x7f9b0c110c60 2024-05-08T18:30:40.087 INFO:teuthology.orchestra.run.smithi087.stdout:0 2024-05-08T18:30:40.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.089+0000 7f9b10ebc640 1 -- 172.21.15.87:0/2690761612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b0c110c60 msgr2=0x7f9b0c1ab370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:40.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.089+0000 7f9b10ebc640 1 --2- 172.21.15.87:0/2690761612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b0c110c60 0x7f9b0c1ab370 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0097f0 tx=0x7f9afc0046c0 comp rx=0 tx=0).stop 2024-05-08T18:30:40.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.089+0000 7f9b10ebc640 1 -- 172.21.15.87:0/2690761612 shutdown_connections 2024-05-08T18:30:40.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.089+0000 7f9b10ebc640 1 --2- 172.21.15.87:0/2690761612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b0c110c60 0x7f9b0c1ab370 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:40.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.089+0000 7f9b10ebc640 1 -- 172.21.15.87:0/2690761612 >> 172.21.15.87:0/2690761612 conn(0x7f9b0c072160 msgr2=0x7f9b0c114660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:40.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.089+0000 7f9b10ebc640 1 -- 172.21.15.87:0/2690761612 shutdown_connections 2024-05-08T18:30:40.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.089+0000 7f9b10ebc640 1 -- 172.21.15.87:0/2690761612 wait complete. 2024-05-08T18:30:40.098 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 8f60b028-91b7-4350-8ebf-62eb3cf4d77a 1 2024-05-08T18:30:40.117 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:40.119+0000 7f3fd5c11040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T18:30:40.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.198+0000 7fd33c683640 1 Processor -- start 2024-05-08T18:30:40.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.198+0000 7fd33c683640 1 -- start start 2024-05-08T18:30:40.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.199+0000 7fd33c683640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3341198c0 0x7fd33411bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:40.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.199+0000 7fd33c683640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd33411c1f0 con 0x7fd334110c40 2024-05-08T18:30:40.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.199+0000 7fd33c683640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fd33411d3f0 con 0x7fd3341198c0 2024-05-08T18:30:40.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.199+0000 7fd339c1e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3341198c0 0x7fd33411bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:40.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.199+0000 7fd33a41f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd334110c40 0x7fd334111020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:45756/0 (socket says 172.21.15.87:45756) 2024-05-08T18:30:40.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.199+0000 7fd33a41f640 1 -- 172.21.15.87:0/111825076 learned_addr learned my addr 172.21.15.87:0/111825076 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:30:40.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.199+0000 7fd33941d640 1 -- 172.21.15.87:0/111825076 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3015916051 0 0) 0x7fd33411c1f0 con 0x7fd334110c40 2024-05-08T18:30:40.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.199+0000 7fd33941d640 1 -- 172.21.15.87:0/111825076 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd320003520 con 0x7fd334110c40 2024-05-08T18:30:40.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.199+0000 7fd339c1e640 1 -- 172.21.15.87:0/111825076 >> v1:172.21.15.53:6789/0 conn(0x7fd334110c40 legacy=0x7fd334111020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:40.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.199+0000 7fd339c1e640 1 -- 172.21.15.87:0/111825076 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33411d5a0 con 0x7fd3341198c0 2024-05-08T18:30:40.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.200+0000 7fd339c1e640 1 --2- 172.21.15.87:0/111825076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3341198c0 0x7fd33411bcb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd330009720 tx=0x7fd33002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9436d6f6e817223 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:40.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.201+0000 7fd33941d640 1 -- 172.21.15.87:0/111825076 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3300316d0 con 0x7fd3341198c0 2024-05-08T18:30:40.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.201+0000 7fd33941d640 1 -- 172.21.15.87:0/111825076 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd330037070 con 0x7fd3341198c0 2024-05-08T18:30:40.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.201+0000 7fd33941d640 1 -- 172.21.15.87:0/111825076 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3300319a0 con 0x7fd3341198c0 2024-05-08T18:30:40.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.201+0000 7fd33c683640 1 -- 172.21.15.87:0/111825076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3341198c0 msgr2=0x7fd33411bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:40.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.201+0000 7fd33c683640 1 --2- 172.21.15.87:0/111825076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3341198c0 0x7fd33411bcb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd330009720 tx=0x7fd33002b840 comp rx=0 tx=0).stop 2024-05-08T18:30:40.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.201+0000 7fd33c683640 1 -- 172.21.15.87:0/111825076 shutdown_connections 2024-05-08T18:30:40.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.201+0000 7fd33c683640 1 --2- 172.21.15.87:0/111825076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3341198c0 0x7fd33411bcb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:40.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.201+0000 7fd33c683640 1 -- 172.21.15.87:0/111825076 >> 172.21.15.87:0/111825076 conn(0x7fd334072160 msgr2=0x7fd33410edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:40.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.201+0000 7fd33c683640 1 -- 172.21.15.87:0/111825076 shutdown_connections 2024-05-08T18:30:40.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.201+0000 7fd33c683640 1 -- 172.21.15.87:0/111825076 wait complete. 2024-05-08T18:30:40.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.202+0000 7fd33c683640 1 Processor -- start 2024-05-08T18:30:40.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.202+0000 7fd33c683640 1 -- start start 2024-05-08T18:30:40.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.202+0000 7fd33c683640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd334110c40 0x7fd3341ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:40.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.202+0000 7fd33c683640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd33411c8a0 con 0x7fd334110c40 2024-05-08T18:30:40.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.202+0000 7fd33a41f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd334110c40 0x7fd3341ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:40.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.202+0000 7fd33a41f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd334110c40 0x7fd3341ab150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58340/0 (socket says 172.21.15.87:58340) 2024-05-08T18:30:40.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.202+0000 7fd33a41f640 1 -- 172.21.15.87:0/1771370694 learned_addr learned my addr 172.21.15.87:0/1771370694 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:30:40.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.203+0000 7fd33a41f640 1 -- 172.21.15.87:0/1771370694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3341ab720 con 0x7fd334110c40 2024-05-08T18:30:40.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.203+0000 7fd33a41f640 1 --2- 172.21.15.87:0/1771370694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd334110c40 0x7fd3341ab150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd32400c3b0 tx=0x7fd32400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:40.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.203+0000 7fd32affd640 1 -- 172.21.15.87:0/1771370694 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd324017070 con 0x7fd334110c40 2024-05-08T18:30:40.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.203+0000 7fd32affd640 1 -- 172.21.15.87:0/1771370694 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd324005c10 con 0x7fd334110c40 2024-05-08T18:30:40.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.203+0000 7fd32affd640 1 -- 172.21.15.87:0/1771370694 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3240070d0 con 0x7fd334110c40 2024-05-08T18:30:40.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.203+0000 7fd33c683640 1 -- 172.21.15.87:0/1771370694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3341ab9b0 con 0x7fd334110c40 2024-05-08T18:30:40.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.203+0000 7fd33c683640 1 -- 172.21.15.87:0/1771370694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3341a53c0 con 0x7fd334110c40 2024-05-08T18:30:40.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.203+0000 7fd32affd640 1 -- 172.21.15.87:0/1771370694 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd32401a070 con 0x7fd334110c40 2024-05-08T18:30:40.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.203+0000 7fd32affd640 1 -- 172.21.15.87:0/1771370694 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fd3240127b0 con 0x7fd334110c40 2024-05-08T18:30:40.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.204+0000 7fd33c683640 1 -- 172.21.15.87:0/1771370694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd334050f90 con 0x7fd334110c40 2024-05-08T18:30:40.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.206+0000 7fd32affd640 1 -- 172.21.15.87:0/1771370694 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd324021070 con 0x7fd334110c40 2024-05-08T18:30:40.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.278+0000 7fd33c683640 1 -- 172.21.15.87:0/1771370694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8f60b028-91b7-4350-8ebf-62eb3cf4d77a", "id": 1} v 0) -- 0x7fd3341abbe0 con 0x7fd334110c40 2024-05-08T18:30:40.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.280+0000 7fd32affd640 1 -- 172.21.15.87:0/1771370694 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8f60b028-91b7-4350-8ebf-62eb3cf4d77a", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fd3240074f0 con 0x7fd334110c40 2024-05-08T18:30:40.278 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-05-08T18:30:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.280+0000 7fd33c683640 1 -- 172.21.15.87:0/1771370694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd334110c40 msgr2=0x7fd3341ab150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.281+0000 7fd33c683640 1 --2- 172.21.15.87:0/1771370694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd334110c40 0x7fd3341ab150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd32400c3b0 tx=0x7fd32400c870 comp rx=0 tx=0).stop 2024-05-08T18:30:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.281+0000 7fd33c683640 1 -- 172.21.15.87:0/1771370694 shutdown_connections 2024-05-08T18:30:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.281+0000 7fd33c683640 1 --2- 172.21.15.87:0/1771370694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd334110c40 0x7fd3341ab150 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.281+0000 7fd33c683640 1 -- 172.21.15.87:0/1771370694 >> 172.21.15.87:0/1771370694 conn(0x7fd334072160 msgr2=0x7fd334072b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.281+0000 7fd33c683640 1 -- 172.21.15.87:0/1771370694 shutdown_connections 2024-05-08T18:30:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.281+0000 7fd33c683640 1 -- 172.21.15.87:0/1771370694 wait complete. 2024-05-08T18:30:40.289 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new bdb8b677-0dba-4bd1-871f-dcd34fbaf2a7 2 2024-05-08T18:30:40.383 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:40.385+0000 7f3fd5c11040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T18:30:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.429+0000 7ff344706640 1 Processor -- start 2024-05-08T18:30:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.429+0000 7ff344706640 1 -- start start 2024-05-08T18:30:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.430+0000 7ff344706640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff33c11ba70 0x7ff33c11de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.430+0000 7ff344706640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff33c11e430 con 0x7ff33c118d80 2024-05-08T18:30:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.430+0000 7ff344706640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ff33c11f610 con 0x7ff33c11ba70 2024-05-08T18:30:40.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.430+0000 7ff341ca1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff33c11ba70 0x7ff33c11de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:40.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.430+0000 7ff341ca1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff33c11ba70 0x7ff33c11de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58344/0 (socket says 172.21.15.87:58344) 2024-05-08T18:30:40.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.430+0000 7ff341ca1640 1 -- 172.21.15.87:0/2982048765 learned_addr learned my addr 172.21.15.87:0/2982048765 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:30:40.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.430+0000 7ff3424a2640 1 --1- 172.21.15.87:0/2982048765 >> v1:172.21.15.53:6789/0 conn(0x7ff33c118d80 0x7ff33c119160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:45770/0 (socket says 172.21.15.87:45770) 2024-05-08T18:30:40.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.430+0000 7ff341ca1640 1 -- 172.21.15.87:0/2982048765 >> v1:172.21.15.53:6789/0 conn(0x7ff33c118d80 legacy=0x7ff33c119160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:40.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.430+0000 7ff341ca1640 1 -- 172.21.15.87:0/2982048765 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c11f790 con 0x7ff33c11ba70 2024-05-08T18:30:40.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.431+0000 7ff341ca1640 1 --2- 172.21.15.87:0/2982048765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff33c11ba70 0x7ff33c11de60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0097f0 tx=0x7ff32c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6c2ab6dd2150d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:40.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.431+0000 7ff3414a0640 1 -- 172.21.15.87:0/2982048765 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff32c035020 con 0x7ff33c11ba70 2024-05-08T18:30:40.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.431+0000 7ff3414a0640 1 -- 172.21.15.87:0/2982048765 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32c0317a0 con 0x7ff33c11ba70 2024-05-08T18:30:40.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.431+0000 7ff3414a0640 1 -- 172.21.15.87:0/2982048765 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff32c031aa0 con 0x7ff33c11ba70 2024-05-08T18:30:40.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.432+0000 7ff344706640 1 -- 172.21.15.87:0/2982048765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff33c11ba70 msgr2=0x7ff33c11de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:40.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.432+0000 7ff344706640 1 --2- 172.21.15.87:0/2982048765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff33c11ba70 0x7ff33c11de60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0097f0 tx=0x7ff32c02b910 comp rx=0 tx=0).stop 2024-05-08T18:30:40.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.432+0000 7ff344706640 1 -- 172.21.15.87:0/2982048765 shutdown_connections 2024-05-08T18:30:40.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.432+0000 7ff344706640 1 --2- 172.21.15.87:0/2982048765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff33c11ba70 0x7ff33c11de60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:40.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.432+0000 7ff344706640 1 -- 172.21.15.87:0/2982048765 >> 172.21.15.87:0/2982048765 conn(0x7ff33c06fa10 msgr2=0x7ff33c110dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:40.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.432+0000 7ff344706640 1 -- 172.21.15.87:0/2982048765 shutdown_connections 2024-05-08T18:30:40.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.432+0000 7ff344706640 1 -- 172.21.15.87:0/2982048765 wait complete. 2024-05-08T18:30:40.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.433+0000 7ff344706640 1 Processor -- start 2024-05-08T18:30:40.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.433+0000 7ff344706640 1 -- start start 2024-05-08T18:30:40.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.433+0000 7ff344706640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff33c118d80 0x7ff33c1a7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:40.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.433+0000 7ff344706640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c11eaf0 con 0x7ff33c118d80 2024-05-08T18:30:40.432 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:40.433+0000 7f3fd5c11040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T18:30:40.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.433+0000 7ff3424a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff33c118d80 0x7ff33c1a7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:40.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.433+0000 7ff3424a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff33c118d80 0x7ff33c1a7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58354/0 (socket says 172.21.15.87:58354) 2024-05-08T18:30:40.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.433+0000 7ff3424a2640 1 -- 172.21.15.87:0/3366110569 learned_addr learned my addr 172.21.15.87:0/3366110569 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:30:40.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.433+0000 7ff3424a2640 1 -- 172.21.15.87:0/3366110569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c1a7f30 con 0x7ff33c118d80 2024-05-08T18:30:40.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.434+0000 7ff3424a2640 1 --2- 172.21.15.87:0/3366110569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff33c118d80 0x7ff33c1a7960 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff33400c710 tx=0x7ff33400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:40.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.434+0000 7ff332ffd640 1 -- 172.21.15.87:0/3366110569 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff334017070 con 0x7ff33c118d80 2024-05-08T18:30:40.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.434+0000 7ff332ffd640 1 -- 172.21.15.87:0/3366110569 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff334005da0 con 0x7ff33c118d80 2024-05-08T18:30:40.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.434+0000 7ff344706640 1 -- 172.21.15.87:0/3366110569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33c1a8220 con 0x7ff33c118d80 2024-05-08T18:30:40.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.434+0000 7ff332ffd640 1 -- 172.21.15.87:0/3366110569 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff33400a790 con 0x7ff33c118d80 2024-05-08T18:30:40.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.434+0000 7ff344706640 1 -- 172.21.15.87:0/3366110569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33c1ac1f0 con 0x7ff33c118d80 2024-05-08T18:30:40.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.434+0000 7ff332ffd640 1 -- 172.21.15.87:0/3366110569 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff33401a070 con 0x7ff33c118d80 2024-05-08T18:30:40.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.434+0000 7ff332ffd640 1 -- 172.21.15.87:0/3366110569 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7ff334007830 con 0x7ff33c118d80 2024-05-08T18:30:40.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.435+0000 7ff344706640 1 -- 172.21.15.87:0/3366110569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff33c050f90 con 0x7ff33c118d80 2024-05-08T18:30:40.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.437+0000 7ff332ffd640 1 -- 172.21.15.87:0/3366110569 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff334007070 con 0x7ff33c118d80 2024-05-08T18:30:40.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.510+0000 7ff344706640 1 -- 172.21.15.87:0/3366110569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bdb8b677-0dba-4bd1-871f-dcd34fbaf2a7", "id": 2} v 0) -- 0x7ff33c11ba70 con 0x7ff33c118d80 2024-05-08T18:30:40.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.511+0000 7ff332ffd640 1 -- 172.21.15.87:0/3366110569 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bdb8b677-0dba-4bd1-871f-dcd34fbaf2a7", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7ff334007330 con 0x7ff33c118d80 2024-05-08T18:30:40.509 INFO:teuthology.orchestra.run.smithi087.stdout:2 2024-05-08T18:30:40.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.512+0000 7ff344706640 1 -- 172.21.15.87:0/3366110569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff33c118d80 msgr2=0x7ff33c1a7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:40.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.512+0000 7ff344706640 1 --2- 172.21.15.87:0/3366110569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff33c118d80 0x7ff33c1a7960 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff33400c710 tx=0x7ff33400cbd0 comp rx=0 tx=0).stop 2024-05-08T18:30:40.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.512+0000 7ff344706640 1 -- 172.21.15.87:0/3366110569 shutdown_connections 2024-05-08T18:30:40.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.512+0000 7ff344706640 1 --2- 172.21.15.87:0/3366110569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff33c118d80 0x7ff33c1a7960 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:40.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.512+0000 7ff344706640 1 -- 172.21.15.87:0/3366110569 >> 172.21.15.87:0/3366110569 conn(0x7ff33c06fa10 msgr2=0x7ff33c11be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:40.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.512+0000 7ff344706640 1 -- 172.21.15.87:0/3366110569 shutdown_connections 2024-05-08T18:30:40.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.512+0000 7ff344706640 1 -- 172.21.15.87:0/3366110569 wait complete. 2024-05-08T18:30:40.520 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 461c3e80-69a6-46f2-a941-06ff79538fe4 3 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.620+0000 7f5ed8a91640 1 Processor -- start 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.620+0000 7f5ed8a91640 1 -- start start 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.620+0000 7f5ed8a91640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ed406d310 0x7f5ed411e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.620+0000 7f5ed8a91640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ed406d7c0 con 0x7f5ed4111a50 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.620+0000 7f5ed8a91640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5ed406d990 con 0x7f5ed406d310 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.621+0000 7f5ed1d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ed406d310 0x7f5ed411e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.621+0000 7f5ed1d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ed406d310 0x7f5ed411e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58362/0 (socket says 172.21.15.87:58362) 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.621+0000 7f5ed1d9b640 1 -- 172.21.15.87:0/1921835455 learned_addr learned my addr 172.21.15.87:0/1921835455 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.621+0000 7f5ed1d9b640 1 -- 172.21.15.87:0/1921835455 >> v1:172.21.15.53:6789/0 conn(0x7f5ed4111a50 legacy=0x7f5ed406cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.621+0000 7f5ed1d9b640 1 -- 172.21.15.87:0/1921835455 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed411f990 con 0x7f5ed406d310 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.622+0000 7f5ed1d9b640 1 --2- 172.21.15.87:0/1921835455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed406d310 0x7f5ed411e440 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0097f0 tx=0x7f5ebc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486a23e9bf102edf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.622+0000 7f5ed159a640 1 -- 172.21.15.87:0/1921835455 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ebc035020 con 0x7f5ed406d310 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.622+0000 7f5ed159a640 1 -- 172.21.15.87:0/1921835455 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ebc0317a0 con 0x7f5ed406d310 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.622+0000 7f5ed159a640 1 -- 172.21.15.87:0/1921835455 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ebc031aa0 con 0x7f5ed406d310 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.623+0000 7f5ed8a91640 1 -- 172.21.15.87:0/1921835455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed406d310 msgr2=0x7f5ed411e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.623+0000 7f5ed8a91640 1 --2- 172.21.15.87:0/1921835455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed406d310 0x7f5ed411e440 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0097f0 tx=0x7f5ebc02b910 comp rx=0 tx=0).stop 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.623+0000 7f5ed8a91640 1 -- 172.21.15.87:0/1921835455 shutdown_connections 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.623+0000 7f5ed8a91640 1 --2- 172.21.15.87:0/1921835455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed406d310 0x7f5ed411e440 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.623+0000 7f5ed8a91640 1 -- 172.21.15.87:0/1921835455 >> 172.21.15.87:0/1921835455 conn(0x7f5ed4071390 msgr2=0x7f5ed40737b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.623+0000 7f5ed8a91640 1 -- 172.21.15.87:0/1921835455 shutdown_connections 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.623+0000 7f5ed8a91640 1 -- 172.21.15.87:0/1921835455 wait complete. 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.624+0000 7f5ed8a91640 1 Processor -- start 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.624+0000 7f5ed8a91640 1 -- start start 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.624+0000 7f5ed8a91640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed406d310 0x7f5ed41a79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.624+0000 7f5ed8a91640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed411ee10 con 0x7f5ed406d310 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.624+0000 7f5ed259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed406d310 0x7f5ed41a79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.624+0000 7f5ed259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed406d310 0x7f5ed41a79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58372/0 (socket says 172.21.15.87:58372) 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.624+0000 7f5ed259c640 1 -- 172.21.15.87:0/4014623492 learned_addr learned my addr 172.21.15.87:0/4014623492 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.624+0000 7f5ed259c640 1 -- 172.21.15.87:0/4014623492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed41a7ee0 con 0x7f5ed406d310 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.625+0000 7f5ed259c640 1 --2- 172.21.15.87:0/4014623492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed406d310 0x7f5ed41a79a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400c380 tx=0x7f5ec400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.625+0000 7f5ecaffd640 1 -- 172.21.15.87:0/4014623492 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ec4005200 con 0x7f5ed406d310 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.625+0000 7f5ecaffd640 1 -- 172.21.15.87:0/4014623492 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec40053c0 con 0x7f5ed406d310 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.625+0000 7f5ed8a91640 1 -- 172.21.15.87:0/4014623492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed41a8170 con 0x7f5ed406d310 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.625+0000 7f5ecaffd640 1 -- 172.21.15.87:0/4014623492 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ec4007190 con 0x7f5ed406d310 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.625+0000 7f5ed8a91640 1 -- 172.21.15.87:0/4014623492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed41ac120 con 0x7f5ed406d310 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.625+0000 7f5ecaffd640 1 -- 172.21.15.87:0/4014623492 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5ec4007400 con 0x7f5ed406d310 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.625+0000 7f5ecaffd640 1 -- 172.21.15.87:0/4014623492 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f5ec4011590 con 0x7f5ed406d310 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.626+0000 7f5ed8a91640 1 -- 172.21.15.87:0/4014623492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed4050f90 con 0x7f5ed406d310 2024-05-08T18:30:40.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.628+0000 7f5ecaffd640 1 -- 172.21.15.87:0/4014623492 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5ec40035f0 con 0x7f5ed406d310 2024-05-08T18:30:40.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.700+0000 7f5ed8a91640 1 -- 172.21.15.87:0/4014623492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "461c3e80-69a6-46f2-a941-06ff79538fe4", "id": 3} v 0) -- 0x7f5ed4111a50 con 0x7f5ed406d310 2024-05-08T18:30:40.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.701+0000 7f5ecaffd640 1 -- 172.21.15.87:0/4014623492 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "461c3e80-69a6-46f2-a941-06ff79538fe4", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f5ec4003aa0 con 0x7f5ed406d310 2024-05-08T18:30:40.699 INFO:teuthology.orchestra.run.smithi087.stdout:3 2024-05-08T18:30:40.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.702+0000 7f5ed8a91640 1 -- 172.21.15.87:0/4014623492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed406d310 msgr2=0x7f5ed41a79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:40.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.702+0000 7f5ed8a91640 1 --2- 172.21.15.87:0/4014623492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed406d310 0x7f5ed41a79a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400c380 tx=0x7f5ec400c840 comp rx=0 tx=0).stop 2024-05-08T18:30:40.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.702+0000 7f5ed8a91640 1 -- 172.21.15.87:0/4014623492 shutdown_connections 2024-05-08T18:30:40.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.702+0000 7f5ed8a91640 1 --2- 172.21.15.87:0/4014623492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed406d310 0x7f5ed41a79a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:40.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.702+0000 7f5ed8a91640 1 -- 172.21.15.87:0/4014623492 >> 172.21.15.87:0/4014623492 conn(0x7f5ed4071390 msgr2=0x7f5ed41183f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:40.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.702+0000 7f5ed8a91640 1 -- 172.21.15.87:0/4014623492 shutdown_connections 2024-05-08T18:30:40.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:40.702+0000 7f5ed8a91640 1 -- 172.21.15.87:0/4014623492 wait complete. 2024-05-08T18:30:40.711 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-08T18:30:40.711 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-08T18:30:40.713 INFO:tasks.ceph.osd.0:Started 2024-05-08T18:30:40.713 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-08T18:30:40.714 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-08T18:30:40.715 INFO:tasks.ceph.osd.1:Started 2024-05-08T18:30:40.716 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-08T18:30:40.716 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-08T18:30:40.718 INFO:tasks.ceph.osd.2:Started 2024-05-08T18:30:40.718 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-08T18:30:40.718 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-08T18:30:40.720 INFO:tasks.ceph.osd.3:Started 2024-05-08T18:30:40.720 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:30:40.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.835+0000 7febd9579640 1 Processor -- start 2024-05-08T18:30:40.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.835+0000 7febd9579640 1 -- start start 2024-05-08T18:30:40.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.836+0000 7febd9579640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7febd40983f0 0x7febd40987d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:40.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.836+0000 7febd9579640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febd409c0d0 con 0x7febd4123820 2024-05-08T18:30:40.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.836+0000 7febd9579640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7febd409d550 con 0x7febd40983f0 2024-05-08T18:30:40.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.836+0000 7febd2ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7febd40983f0 0x7febd40987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:40.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.836+0000 7febd27fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7febd4123820 0x7febd4123c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49664/0 (socket says 172.21.15.53:49664) 2024-05-08T18:30:40.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.836+0000 7febd27fc640 1 -- 172.21.15.53:0/988576695 learned_addr learned my addr 172.21.15.53:0/988576695 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:40.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.836+0000 7febd1ffb640 1 -- 172.21.15.53:0/988576695 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1287776553 0 0) 0x7febd409c0d0 con 0x7febd4123820 2024-05-08T18:30:40.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.836+0000 7febd1ffb640 1 -- 172.21.15.53:0/988576695 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febc0003520 con 0x7febd4123820 2024-05-08T18:30:40.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.836+0000 7febd2ffd640 1 -- 172.21.15.53:0/988576695 >> v1:172.21.15.53:6789/0 conn(0x7febd4123820 legacy=0x7febd4123c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:40.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.836+0000 7febd2ffd640 1 -- 172.21.15.53:0/988576695 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd406e1d0 con 0x7febd40983f0 2024-05-08T18:30:40.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.837+0000 7febd2ffd640 1 --2- 172.21.15.53:0/988576695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febd40983f0 0x7febd40987d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7febc4009720 tx=0x7febc402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a164154d5dd741fe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:40.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.837+0000 7febd1ffb640 1 -- 172.21.15.53:0/988576695 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febc40316d0 con 0x7febd40983f0 2024-05-08T18:30:40.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.837+0000 7febd1ffb640 1 -- 172.21.15.53:0/988576695 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc4037070 con 0x7febd40983f0 2024-05-08T18:30:40.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.837+0000 7febd1ffb640 1 -- 172.21.15.53:0/988576695 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febc40319c0 con 0x7febd40983f0 2024-05-08T18:30:40.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.838+0000 7febd9579640 1 -- 172.21.15.53:0/988576695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febd40983f0 msgr2=0x7febd40987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:40.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.838+0000 7febd9579640 1 --2- 172.21.15.53:0/988576695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febd40983f0 0x7febd40987d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7febc4009720 tx=0x7febc402b840 comp rx=0 tx=0).stop 2024-05-08T18:30:40.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.838+0000 7febd9579640 1 -- 172.21.15.53:0/988576695 shutdown_connections 2024-05-08T18:30:40.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.838+0000 7febd9579640 1 --2- 172.21.15.53:0/988576695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febd40983f0 0x7febd40987d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:40.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.838+0000 7febd9579640 1 -- 172.21.15.53:0/988576695 >> 172.21.15.53:0/988576695 conn(0x7febd409ed90 msgr2=0x7febd409b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:40.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.838+0000 7febd9579640 1 -- 172.21.15.53:0/988576695 shutdown_connections 2024-05-08T18:30:40.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.838+0000 7febd9579640 1 -- 172.21.15.53:0/988576695 wait complete. 2024-05-08T18:30:40.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.839+0000 7febd9579640 1 Processor -- start 2024-05-08T18:30:40.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.839+0000 7febd9579640 1 -- start start 2024-05-08T18:30:40.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.839+0000 7febd9579640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febd40983f0 0x7febd408b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:40.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.839+0000 7febd9579640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7febd409bb50 con 0x7febd40983f0 2024-05-08T18:30:40.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.840+0000 7febd2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febd40983f0 0x7febd408b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:40.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.840+0000 7febd2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febd40983f0 0x7febd408b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38330/0 (socket says 172.21.15.53:38330) 2024-05-08T18:30:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.840+0000 7febd2ffd640 1 -- 172.21.15.53:0/1778798393 learned_addr learned my addr 172.21.15.53:0/1778798393 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.840+0000 7febd2ffd640 1 -- 172.21.15.53:0/1778798393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd408d5a0 con 0x7febd40983f0 2024-05-08T18:30:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.840+0000 7febd2ffd640 1 --2- 172.21.15.53:0/1778798393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febd40983f0 0x7febd408b990 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7febc4000c00 tx=0x7febc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.840+0000 7febcb7fe640 1 -- 172.21.15.53:0/1778798393 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febc4032560 con 0x7febd40983f0 2024-05-08T18:30:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.840+0000 7febcb7fe640 1 -- 172.21.15.53:0/1778798393 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc4032700 con 0x7febd40983f0 2024-05-08T18:30:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.840+0000 7febd9579640 1 -- 172.21.15.53:0/1778798393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd408ede0 con 0x7febd40983f0 2024-05-08T18:30:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.840+0000 7febcb7fe640 1 -- 172.21.15.53:0/1778798393 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febc4032a00 con 0x7febd40983f0 2024-05-08T18:30:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.840+0000 7febd9579640 1 -- 172.21.15.53:0/1778798393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd408bed0 con 0x7febd40983f0 2024-05-08T18:30:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.840+0000 7febcb7fe640 1 -- 172.21.15.53:0/1778798393 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7febc404c060 con 0x7febd40983f0 2024-05-08T18:30:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.841+0000 7febcb7fe640 1 -- 172.21.15.53:0/1778798393 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7febc402f050 con 0x7febd40983f0 2024-05-08T18:30:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.841+0000 7febd9579640 1 -- 172.21.15.53:0/1778798393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febd408d100 con 0x7febd40983f0 2024-05-08T18:30:40.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.843+0000 7febcb7fe640 1 -- 172.21.15.53:0/1778798393 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7febc4040070 con 0x7febd40983f0 2024-05-08T18:30:40.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.905+0000 7febd9579640 1 -- 172.21.15.53:0/1778798393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7febd4064010 con 0x7febd40983f0 2024-05-08T18:30:40.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.905+0000 7febcb7fe640 1 -- 172.21.15.53:0/1778798393 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7febc40060d0 con 0x7febd40983f0 2024-05-08T18:30:40.905 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:40.905 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":6,"fsid":"24862ec0-9aa3-4837-9fb5-4efcd65f7b56","created":"2024-05-08T18:30:39.594585+0000","modified":"2024-05-08T18:30:40.701334+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T18:30:40.701334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2bf91df5-317b-40b7-a1ef-93220b68d9eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8f60b028-91b7-4350-8ebf-62eb3cf4d77a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bdb8b677-0dba-4bd1-871f-dcd34fbaf2a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"461c3e80-69a6-46f2-a941-06ff79538fe4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:30:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.906+0000 7febd9579640 1 -- 172.21.15.53:0/1778798393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febd40983f0 msgr2=0x7febd408b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.906+0000 7febd9579640 1 --2- 172.21.15.53:0/1778798393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febd40983f0 0x7febd408b990 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7febc4000c00 tx=0x7febc40046c0 comp rx=0 tx=0).stop 2024-05-08T18:30:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.906+0000 7febd9579640 1 -- 172.21.15.53:0/1778798393 shutdown_connections 2024-05-08T18:30:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.906+0000 7febd9579640 1 --2- 172.21.15.53:0/1778798393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febd40983f0 0x7febd408b990 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.906+0000 7febd9579640 1 -- 172.21.15.53:0/1778798393 >> 172.21.15.53:0/1778798393 conn(0x7febd409ed90 msgr2=0x7febd412b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.906+0000 7febd9579640 1 -- 172.21.15.53:0/1778798393 shutdown_connections 2024-05-08T18:30:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:40.906+0000 7febd9579640 1 -- 172.21.15.53:0/1778798393 wait complete. 2024-05-08T18:30:40.915 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-08T18:30:40.916 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-08T18:30:41.202 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:41.204+0000 7f3fd5c11040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T18:30:41.288 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:41.290+0000 7f3fd5c11040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T18:30:41.309 INFO:tasks.ceph.osd.3.smithi087.stderr:2024-05-08T18:30:41.311+0000 7f17ed01e640 -1 Falling back to public interface 2024-05-08T18:30:41.310 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-05-08T18:30:41.312+0000 7f0921308640 -1 Falling back to public interface 2024-05-08T18:30:41.316 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-05-08T18:30:41.317+0000 7f7761814640 -1 Falling back to public interface 2024-05-08T18:30:41.317 INFO:tasks.ceph.osd.2.smithi087.stderr:2024-05-08T18:30:41.319+0000 7f7b5f58e640 -1 Falling back to public interface 2024-05-08T18:30:41.319 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T18:30:41.334 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:41.336+0000 7f3fd5c11040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T18:30:41.416 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.416+0000 7f0fc5adb640 1 Processor -- start 2024-05-08T18:30:41.416 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.416+0000 7f0fc5adb640 1 -- start start 2024-05-08T18:30:41.416 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.416+0000 7f0fc5adb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0fc0070310 0x7f0fc01292c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:41.416 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.416+0000 7f0fc5adb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc0123310 con 0x7f0fc0129800 2024-05-08T18:30:41.416 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.416+0000 7f0fc5adb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f0fc0073ed0 con 0x7f0fc0070310 2024-05-08T18:30:41.416 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.417+0000 7f0fbf7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0fc0070310 0x7f0fc01292c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:41.416 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.417+0000 7f0fbeffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0fc0129800 0x7f0fc012c170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49674/0 (socket says 172.21.15.53:49674) 2024-05-08T18:30:41.417 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.417+0000 7f0fbeffd640 1 -- 172.21.15.53:0/4150753482 learned_addr learned my addr 172.21.15.53:0/4150753482 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:41.417 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.417+0000 7f0fbf7fe640 1 -- 172.21.15.53:0/4150753482 >> v1:172.21.15.53:6789/0 conn(0x7f0fc0129800 legacy=0x7f0fc012c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:41.417 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.417+0000 7f0fbf7fe640 1 -- 172.21.15.53:0/4150753482 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc0073930 con 0x7f0fc0070310 2024-05-08T18:30:41.419 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.418+0000 7f0fbf7fe640 1 --2- 172.21.15.53:0/4150753482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc0070310 0x7f0fc01292c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009720 tx=0x7f0fb002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3047a4e79e18d63d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:41.419 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.418+0000 7f0fbe7fc640 1 -- 172.21.15.53:0/4150753482 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fb0035020 con 0x7f0fc0070310 2024-05-08T18:30:41.419 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.418+0000 7f0fbe7fc640 1 -- 172.21.15.53:0/4150753482 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb0031760 con 0x7f0fc0070310 2024-05-08T18:30:41.419 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.418+0000 7f0fbe7fc640 1 -- 172.21.15.53:0/4150753482 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fb0031a60 con 0x7f0fc0070310 2024-05-08T18:30:41.419 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.418+0000 7f0fc5adb640 1 -- 172.21.15.53:0/4150753482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc0070310 msgr2=0x7f0fc01292c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:41.419 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.418+0000 7f0fc5adb640 1 --2- 172.21.15.53:0/4150753482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc0070310 0x7f0fc01292c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009720 tx=0x7f0fb002b8d0 comp rx=0 tx=0).stop 2024-05-08T18:30:41.419 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.418+0000 7f0fc5adb640 1 -- 172.21.15.53:0/4150753482 shutdown_connections 2024-05-08T18:30:41.419 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.418+0000 7f0fc5adb640 1 --2- 172.21.15.53:0/4150753482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc0070310 0x7f0fc01292c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:41.419 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.418+0000 7f0fc5adb640 1 -- 172.21.15.53:0/4150753482 >> 172.21.15.53:0/4150753482 conn(0x7f0fc009d620 msgr2=0x7f0fc009da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:41.419 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.418+0000 7f0fc5adb640 1 -- 172.21.15.53:0/4150753482 shutdown_connections 2024-05-08T18:30:41.419 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.418+0000 7f0fc5adb640 1 -- 172.21.15.53:0/4150753482 wait complete. 2024-05-08T18:30:41.420 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.419+0000 7f0fc5adb640 1 Processor -- start 2024-05-08T18:30:41.420 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.419+0000 7f0fc5adb640 1 -- start start 2024-05-08T18:30:41.420 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.420+0000 7f0fc5adb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc0070310 0x7f0fc01167b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:41.420 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.420+0000 7f0fc5adb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc012c880 con 0x7f0fc0070310 2024-05-08T18:30:41.420 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.420+0000 7f0fbf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc0070310 0x7f0fc01167b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:41.420 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.420+0000 7f0fbf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc0070310 0x7f0fc01167b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38350/0 (socket says 172.21.15.53:38350) 2024-05-08T18:30:41.420 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.420+0000 7f0fbf7fe640 1 -- 172.21.15.53:0/1983507071 learned_addr learned my addr 172.21.15.53:0/1983507071 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:41.420 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.420+0000 7f0fbf7fe640 1 -- 172.21.15.53:0/1983507071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc0070e10 con 0x7f0fc0070310 2024-05-08T18:30:41.421 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.420+0000 7f0fbf7fe640 1 --2- 172.21.15.53:0/1983507071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc0070310 0x7f0fc01167b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009720 tx=0x7f0fb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:41.421 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.421+0000 7f0fa7fff640 1 -- 172.21.15.53:0/1983507071 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fb003b980 con 0x7f0fc0070310 2024-05-08T18:30:41.421 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.421+0000 7f0fa7fff640 1 -- 172.21.15.53:0/1983507071 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb003bb40 con 0x7f0fc0070310 2024-05-08T18:30:41.421 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.421+0000 7f0fc5adb640 1 -- 172.21.15.53:0/1983507071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc0071950 con 0x7f0fc0070310 2024-05-08T18:30:41.422 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.421+0000 7f0fa7fff640 1 -- 172.21.15.53:0/1983507071 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fb003be60 con 0x7f0fc0070310 2024-05-08T18:30:41.422 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.421+0000 7f0fc5adb640 1 -- 172.21.15.53:0/1983507071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc0118370 con 0x7f0fc0070310 2024-05-08T18:30:41.422 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.421+0000 7f0fa7fff640 1 -- 172.21.15.53:0/1983507071 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0fb004c060 con 0x7f0fc0070310 2024-05-08T18:30:41.422 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.421+0000 7f0fa7fff640 1 -- 172.21.15.53:0/1983507071 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f0fb0045ad0 con 0x7f0fc0070310 2024-05-08T18:30:41.422 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.422+0000 7f0fc5adb640 1 -- 172.21.15.53:0/1983507071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc0064010 con 0x7f0fc0070310 2024-05-08T18:30:41.422 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.424+0000 7f0fa7fff640 1 -- 172.21.15.53:0/1983507071 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0fc0118370 con 0x7f0fc0070310 2024-05-08T18:30:41.484 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.485+0000 7f0fc5adb640 1 -- 172.21.15.53:0/1983507071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0fc011d230 con 0x7f0fc0070310 2024-05-08T18:30:41.485 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.485+0000 7f0fa7fff640 1 -- 172.21.15.53:0/1983507071 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f0fb0040070 con 0x7f0fc0070310 2024-05-08T18:30:41.485 INFO:teuthology.misc.health.smithi053.stdout: 2024-05-08T18:30:41.485 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":6,"fsid":"24862ec0-9aa3-4837-9fb5-4efcd65f7b56","created":"2024-05-08T18:30:39.594585+0000","modified":"2024-05-08T18:30:40.701334+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T18:30:40.701334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2bf91df5-317b-40b7-a1ef-93220b68d9eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8f60b028-91b7-4350-8ebf-62eb3cf4d77a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bdb8b677-0dba-4bd1-871f-dcd34fbaf2a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"461c3e80-69a6-46f2-a941-06ff79538fe4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:30:41.486 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.486+0000 7f0fc5adb640 1 -- 172.21.15.53:0/1983507071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc0070310 msgr2=0x7f0fc01167b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:41.486 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.486+0000 7f0fc5adb640 1 --2- 172.21.15.53:0/1983507071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc0070310 0x7f0fc01167b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009720 tx=0x7f0fb00046c0 comp rx=0 tx=0).stop 2024-05-08T18:30:41.486 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.486+0000 7f0fc5adb640 1 -- 172.21.15.53:0/1983507071 shutdown_connections 2024-05-08T18:30:41.486 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.486+0000 7f0fc5adb640 1 --2- 172.21.15.53:0/1983507071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc0070310 0x7f0fc01167b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:41.486 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.486+0000 7f0fc5adb640 1 -- 172.21.15.53:0/1983507071 >> 172.21.15.53:0/1983507071 conn(0x7f0fc009d620 msgr2=0x7f0fc006f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:41.486 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.486+0000 7f0fc5adb640 1 -- 172.21.15.53:0/1983507071 shutdown_connections 2024-05-08T18:30:41.486 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:41.486+0000 7f0fc5adb640 1 -- 172.21.15.53:0/1983507071 wait complete. 2024-05-08T18:30:41.494 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-05-08T18:30:41.497 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:41.499+0000 7f3fd5c11040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T18:30:41.552 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:41.553+0000 7f3fd5c11040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T18:30:41.606 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:41.607+0000 7f3fd5c11040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T18:30:41.718 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:41.720+0000 7f3fd5c11040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T18:30:42.095 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:42.097+0000 7f3fd5c11040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T18:30:42.234 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:42.235+0000 7f3fd5c11040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T18:30:42.490 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:42.492+0000 7f3fd5c11040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T18:30:42.541 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:42.543+0000 7f3fd5c11040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T18:30:42.656 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:42.658+0000 7f3fd5c11040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T18:30:42.953 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:42.955+0000 7f3fd5c11040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T18:30:43.001 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:43.002+0000 7f3fd5c11040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T18:30:43.156 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:43.158+0000 7f3fd5c11040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T18:30:43.293 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:43.295+0000 7f3fd5c11040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T18:30:43.342 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:43.344+0000 7f3fd5c11040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T18:30:43.411 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:43.412+0000 7f3fd5c11040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T18:30:43.455 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:43.457+0000 7f3fd5c11040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T18:30:43.937 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:43.939+0000 7f3fd5c11040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T18:30:44.089 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:44.091+0000 7f3fd5c11040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T18:30:44.735 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-05-08T18:30:44.736+0000 7f7761814640 -1 osd.0 0 log_to_monitors true 2024-05-08T18:30:44.800 INFO:tasks.ceph.osd.3.smithi087.stderr:2024-05-08T18:30:44.802+0000 7f17ed01e640 -1 osd.3 0 log_to_monitors true 2024-05-08T18:30:44.831 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-05-08T18:30:44.833+0000 7f0921308640 -1 osd.1 0 log_to_monitors true 2024-05-08T18:30:44.838 INFO:tasks.ceph.osd.2.smithi087.stderr:2024-05-08T18:30:44.840+0000 7f7b5f58e640 -1 osd.2 0 log_to_monitors true 2024-05-08T18:30:45.099 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-05-08T18:30:45.101+0000 7f3f7551b640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-05-08T18:30:46.970 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-05-08T18:30:46.971+0000 7f775d15c640 -1 osd.0 0 waiting for initial osdmap 2024-05-08T18:30:46.987 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-05-08T18:30:46.988+0000 7f7754f7c640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:30:47.819 INFO:tasks.ceph.osd.2.smithi087.stderr:2024-05-08T18:30:47.821+0000 7f7b5b524640 -1 osd.2 0 waiting for initial osdmap 2024-05-08T18:30:47.832 INFO:tasks.ceph.osd.2.smithi087.stderr:2024-05-08T18:30:47.834+0000 7f7b53344640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:30:47.864 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-05-08T18:30:47.866+0000 7f091d29e640 -1 osd.1 0 waiting for initial osdmap 2024-05-08T18:30:47.868 INFO:tasks.ceph.osd.3.smithi087.stderr:2024-05-08T18:30:47.870+0000 7f17e88e8640 -1 osd.3 0 waiting for initial osdmap 2024-05-08T18:30:47.875 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-05-08T18:30:47.877+0000 7f09150be640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:30:47.879 INFO:tasks.ceph.osd.3.smithi087.stderr:2024-05-08T18:30:47.881+0000 7f17e0719640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:30:47.897 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T18:30:48.006 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.006+0000 7f0066850640 1 Processor -- start 2024-05-08T18:30:48.006 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.006+0000 7f0066850640 1 -- start start 2024-05-08T18:30:48.006 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.007+0000 7f0066850640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f00601288f0 0x7f0060128cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:48.006 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.007+0000 7f0066850640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0060073690 con 0x7f006012b8d0 2024-05-08T18:30:48.006 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.007+0000 7f0066850640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f0060072f20 con 0x7f00601288f0 2024-05-08T18:30:48.006 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.007+0000 7f005ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f00601288f0 0x7f0060128cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:48.007 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.007+0000 7f005ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f00601288f0 0x7f0060128cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38370/0 (socket says 172.21.15.53:38370) 2024-05-08T18:30:48.007 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.007+0000 7f005f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f006012b8d0 0x7f006012bd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49688/0 (socket says 172.21.15.53:49688) 2024-05-08T18:30:48.007 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.007+0000 7f005ffff640 1 -- 172.21.15.53:0/1679184468 learned_addr learned my addr 172.21.15.53:0/1679184468 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:48.007 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.007+0000 7f005ffff640 1 -- 172.21.15.53:0/1679184468 >> v1:172.21.15.53:6789/0 conn(0x7f006012b8d0 legacy=0x7f006012bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:48.007 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.007+0000 7f005ffff640 1 -- 172.21.15.53:0/1679184468 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0060073ad0 con 0x7f00601288f0 2024-05-08T18:30:48.009 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.008+0000 7f005ffff640 1 --2- 172.21.15.53:0/1679184468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00601288f0 0x7f0060128cd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f005000ba80 tx=0x7f005002df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffe01631a236844 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:48.009 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.008+0000 7f005effd640 1 -- 172.21.15.53:0/1679184468 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0050034070 con 0x7f00601288f0 2024-05-08T18:30:48.009 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.008+0000 7f005effd640 1 -- 172.21.15.53:0/1679184468 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f005002ec30 con 0x7f00601288f0 2024-05-08T18:30:48.009 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.008+0000 7f005effd640 1 -- 172.21.15.53:0/1679184468 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0050038400 con 0x7f00601288f0 2024-05-08T18:30:48.010 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.009+0000 7f0066850640 1 -- 172.21.15.53:0/1679184468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00601288f0 msgr2=0x7f0060128cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:48.010 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.009+0000 7f0066850640 1 --2- 172.21.15.53:0/1679184468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00601288f0 0x7f0060128cd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f005000ba80 tx=0x7f005002df50 comp rx=0 tx=0).stop 2024-05-08T18:30:48.010 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.009+0000 7f0066850640 1 -- 172.21.15.53:0/1679184468 shutdown_connections 2024-05-08T18:30:48.010 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.009+0000 7f0066850640 1 --2- 172.21.15.53:0/1679184468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00601288f0 0x7f0060128cd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:48.010 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.009+0000 7f0066850640 1 -- 172.21.15.53:0/1679184468 >> 172.21.15.53:0/1679184468 conn(0x7f006009d620 msgr2=0x7f006009da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:48.010 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.009+0000 7f0066850640 1 -- 172.21.15.53:0/1679184468 shutdown_connections 2024-05-08T18:30:48.010 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.009+0000 7f0066850640 1 -- 172.21.15.53:0/1679184468 wait complete. 2024-05-08T18:30:48.010 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.010+0000 7f0066850640 1 Processor -- start 2024-05-08T18:30:48.010 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.010+0000 7f0066850640 1 -- start start 2024-05-08T18:30:48.010 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.010+0000 7f0066850640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00601288f0 0x7f006011d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:48.010 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.010+0000 7f0066850640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0060128600 con 0x7f00601288f0 2024-05-08T18:30:48.010 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.010+0000 7f005ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00601288f0 0x7f006011d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:48.010 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.010+0000 7f005ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00601288f0 0x7f006011d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38374/0 (socket says 172.21.15.53:38374) 2024-05-08T18:30:48.011 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.010+0000 7f005ffff640 1 -- 172.21.15.53:0/3130917091 learned_addr learned my addr 172.21.15.53:0/3130917091 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:48.011 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.011+0000 7f005ffff640 1 -- 172.21.15.53:0/3130917091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006011ff70 con 0x7f00601288f0 2024-05-08T18:30:48.011 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.011+0000 7f005ffff640 1 --2- 172.21.15.53:0/3130917091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00601288f0 0x7f006011d5d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f005000ba80 tx=0x7f00500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:48.012 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.011+0000 7f005cff9640 1 -- 172.21.15.53:0/3130917091 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0050046020 con 0x7f00601288f0 2024-05-08T18:30:48.012 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.011+0000 7f005cff9640 1 -- 172.21.15.53:0/3130917091 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00500376f0 con 0x7f00601288f0 2024-05-08T18:30:48.012 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.011+0000 7f0066850640 1 -- 172.21.15.53:0/3130917091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006011db10 con 0x7f00601288f0 2024-05-08T18:30:48.012 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.011+0000 7f005cff9640 1 -- 172.21.15.53:0/3130917091 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00500379d0 con 0x7f00601288f0 2024-05-08T18:30:48.012 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.011+0000 7f0066850640 1 -- 172.21.15.53:0/3130917091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f006011dfe0 con 0x7f00601288f0 2024-05-08T18:30:48.012 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.012+0000 7f005cff9640 1 -- 172.21.15.53:0/3130917091 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) ==== 49355+0+0 (secure 0 0 0) 0x7f0050049070 con 0x7f00601288f0 2024-05-08T18:30:48.012 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.012+0000 7f0066850640 1 -- 172.21.15.53:0/3130917091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0060129f90 con 0x7f00601288f0 2024-05-08T18:30:48.013 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.012+0000 7f005cff9640 1 --2- 172.21.15.53:0/3130917091 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f004c03d220 0x7f004c03f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:48.013 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.012+0000 7f005cff9640 1 -- 172.21.15.53:0/3130917091 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 2743+0+0 (secure 0 0 0) 0x7f00500731e0 con 0x7f00601288f0 2024-05-08T18:30:48.013 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.013+0000 7f005f7fe640 1 --2- 172.21.15.53:0/3130917091 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f004c03d220 0x7f004c03f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:48.013 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.013+0000 7f005f7fe640 1 --2- 172.21.15.53:0/3130917091 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f004c03d220 0x7f004c03f6e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f00540015f0 tx=0x7f0054007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:48.016 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.017+0000 7f005cff9640 1 -- 172.21.15.53:0/3130917091 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0060129f90 con 0x7f00601288f0 2024-05-08T18:30:48.212 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.213+0000 7f0066850640 1 -- 172.21.15.53:0/3130917091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f006011ee40 con 0x7f00601288f0 2024-05-08T18:30:48.212 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.213+0000 7f005cff9640 1 -- 172.21.15.53:0/3130917091 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) ==== 74+0+6056 (secure 0 0 0) 0x7f00500517c0 con 0x7f00601288f0 2024-05-08T18:30:48.213 INFO:teuthology.misc.health.smithi053.stdout: 2024-05-08T18:30:48.213 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":9,"fsid":"24862ec0-9aa3-4837-9fb5-4efcd65f7b56","created":"2024-05-08T18:30:39.594585+0000","modified":"2024-05-08T18:30:47.973576+0000","last_up_change":"2024-05-08T18:30:47.973576+0000","last_in_change":"2024-05-08T18:30:40.701334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2bf91df5-317b-40b7-a1ef-93220b68d9eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":443747735},{"type":"v1","addr":"172.21.15.53:6801","nonce":443747735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":443747735},{"type":"v1","addr":"172.21.15.53:6803","nonce":443747735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":443747735},{"type":"v1","addr":"172.21.15.53:6807","nonce":443747735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":443747735},{"type":"v1","addr":"172.21.15.53:6805","nonce":443747735}]},"public_addr":"172.21.15.53:6801/443747735","cluster_addr":"172.21.15.53:6803/443747735","heartbeat_back_addr":"172.21.15.53:6807/443747735","heartbeat_front_addr":"172.21.15.53:6805/443747735","state":["exists","up"]},{"osd":1,"uuid":"8f60b028-91b7-4350-8ebf-62eb3cf4d77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2448644045},{"type":"v1","addr":"172.21.15.87:6809","nonce":2448644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2448644045},{"type":"v1","addr":"172.21.15.87:6811","nonce":2448644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2448644045},{"type":"v1","addr":"172.21.15.87:6815","nonce":2448644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2448644045},{"type":"v1","addr":"172.21.15.87:6813","nonce":2448644045}]},"public_addr":"172.21.15.87:6809/2448644045","cluster_addr":"172.21.15.87:6811/2448644045","heartbeat_back_addr":"172.21.15.87:6815/2448644045","heartbeat_front_addr":"172.21.15.87:6813/2448644045","state":["exists","up"]},{"osd":2,"uuid":"bdb8b677-0dba-4bd1-871f-dcd34fbaf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2108501615},{"type":"v1","addr":"172.21.15.87:6817","nonce":2108501615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2108501615},{"type":"v1","addr":"172.21.15.87:6819","nonce":2108501615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2108501615},{"type":"v1","addr":"172.21.15.87:6823","nonce":2108501615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2108501615},{"type":"v1","addr":"172.21.15.87:6821","nonce":2108501615}]},"public_addr":"172.21.15.87:6817/2108501615","cluster_addr":"172.21.15.87:6819/2108501615","heartbeat_back_addr":"172.21.15.87:6823/2108501615","heartbeat_front_addr":"172.21.15.87:6821/2108501615","state":["exists","up"]},{"osd":3,"uuid":"461c3e80-69a6-46f2-a941-06ff79538fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2929215285},{"type":"v1","addr":"172.21.15.87:6801","nonce":2929215285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2929215285},{"type":"v1","addr":"172.21.15.87:6803","nonce":2929215285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2929215285},{"type":"v1","addr":"172.21.15.87:6807","nonce":2929215285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2929215285},{"type":"v1","addr":"172.21.15.87:6805","nonce":2929215285}]},"public_addr":"172.21.15.87:6801/2929215285","cluster_addr":"172.21.15.87:6803/2929215285","heartbeat_back_addr":"172.21.15.87:6807/2929215285","heartbeat_front_addr":"172.21.15.87:6805/2929215285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:30:48.215 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.216+0000 7f0066850640 1 -- 172.21.15.53:0/3130917091 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f004c03d220 msgr2=0x7f004c03f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:48.215 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.216+0000 7f0066850640 1 --2- 172.21.15.53:0/3130917091 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f004c03d220 0x7f004c03f6e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f00540015f0 tx=0x7f0054007a40 comp rx=0 tx=0).stop 2024-05-08T18:30:48.215 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.216+0000 7f0066850640 1 -- 172.21.15.53:0/3130917091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00601288f0 msgr2=0x7f006011d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:48.215 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.216+0000 7f0066850640 1 --2- 172.21.15.53:0/3130917091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00601288f0 0x7f006011d5d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f005000ba80 tx=0x7f00500046c0 comp rx=0 tx=0).stop 2024-05-08T18:30:48.215 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.216+0000 7f0066850640 1 -- 172.21.15.53:0/3130917091 shutdown_connections 2024-05-08T18:30:48.215 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.216+0000 7f0066850640 1 --2- 172.21.15.53:0/3130917091 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f004c03d220 0x7f004c03f6e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:48.215 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.216+0000 7f0066850640 1 --2- 172.21.15.53:0/3130917091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00601288f0 0x7f006011d5d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:48.215 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.216+0000 7f0066850640 1 -- 172.21.15.53:0/3130917091 >> 172.21.15.53:0/3130917091 conn(0x7f006009d620 msgr2=0x7f0060070270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:48.215 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.216+0000 7f0066850640 1 -- 172.21.15.53:0/3130917091 shutdown_connections 2024-05-08T18:30:48.215 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:30:48.216+0000 7f0066850640 1 -- 172.21.15.53:0/3130917091 wait complete. 2024-05-08T18:30:48.225 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-05-08T18:30:48.225 INFO:tasks.ceph:Creating RBD pool 2024-05-08T18:30:48.225 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-08T18:30:48.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.328+0000 7f3ecc691640 1 Processor -- start 2024-05-08T18:30:48.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.328+0000 7f3ecc691640 1 -- start start 2024-05-08T18:30:48.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.329+0000 7f3ecc691640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3ec40a0290 0x7f3ec4134700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:48.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.329+0000 7f3ecc691640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec4099ed0 con 0x7f3ec409f7a0 2024-05-08T18:30:48.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.329+0000 7f3ecc691640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f3ec409b910 con 0x7f3ec40a0290 2024-05-08T18:30:48.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.329+0000 7f3ec9c2c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3ec40a0290 0x7f3ec4134700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:48.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.329+0000 7f3eca42d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3ec409f7a0 0x7f3ec409fb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49696/0 (socket says 172.21.15.53:49696) 2024-05-08T18:30:48.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.329+0000 7f3eca42d640 1 -- 172.21.15.53:0/163049062 learned_addr learned my addr 172.21.15.53:0/163049062 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:48.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.329+0000 7f3ec9c2c640 1 -- 172.21.15.53:0/163049062 >> v1:172.21.15.53:6789/0 conn(0x7f3ec409f7a0 legacy=0x7f3ec409fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:48.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.329+0000 7f3ec9c2c640 1 -- 172.21.15.53:0/163049062 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec409b3e0 con 0x7f3ec40a0290 2024-05-08T18:30:48.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.330+0000 7f3ec9c2c640 1 --2- 172.21.15.53:0/163049062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ec40a0290 0x7f3ec4134700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009720 tx=0x7f3eb402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81b19f0961f61a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:48.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.330+0000 7f3ec942b640 1 -- 172.21.15.53:0/163049062 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb40316d0 con 0x7f3ec40a0290 2024-05-08T18:30:48.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.330+0000 7f3ec942b640 1 -- 172.21.15.53:0/163049062 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb4037070 con 0x7f3ec40a0290 2024-05-08T18:30:48.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.330+0000 7f3ec942b640 1 -- 172.21.15.53:0/163049062 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb40319c0 con 0x7f3ec40a0290 2024-05-08T18:30:48.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.331+0000 7f3ecc691640 1 -- 172.21.15.53:0/163049062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ec40a0290 msgr2=0x7f3ec4134700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:48.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.331+0000 7f3ecc691640 1 --2- 172.21.15.53:0/163049062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ec40a0290 0x7f3ec4134700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009720 tx=0x7f3eb402b840 comp rx=0 tx=0).stop 2024-05-08T18:30:48.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.331+0000 7f3ecc691640 1 -- 172.21.15.53:0/163049062 shutdown_connections 2024-05-08T18:30:48.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.331+0000 7f3ecc691640 1 --2- 172.21.15.53:0/163049062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ec40a0290 0x7f3ec4134700 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:48.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.331+0000 7f3ecc691640 1 -- 172.21.15.53:0/163049062 >> 172.21.15.53:0/163049062 conn(0x7f3ec409e8c0 msgr2=0x7f3ec409ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:48.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.331+0000 7f3ecc691640 1 -- 172.21.15.53:0/163049062 shutdown_connections 2024-05-08T18:30:48.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.331+0000 7f3ecc691640 1 -- 172.21.15.53:0/163049062 wait complete. 2024-05-08T18:30:48.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.332+0000 7f3ecc691640 1 Processor -- start 2024-05-08T18:30:48.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.332+0000 7f3ecc691640 1 -- start start 2024-05-08T18:30:48.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.332+0000 7f3ecc691640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ec409f7a0 0x7f3ec411bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:48.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.332+0000 7f3ecc691640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec4134dc0 con 0x7f3ec409f7a0 2024-05-08T18:30:48.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.332+0000 7f3eca42d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ec409f7a0 0x7f3ec411bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:48.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.332+0000 7f3eca42d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ec409f7a0 0x7f3ec411bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38396/0 (socket says 172.21.15.53:38396) 2024-05-08T18:30:48.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.332+0000 7f3eca42d640 1 -- 172.21.15.53:0/532750623 learned_addr learned my addr 172.21.15.53:0/532750623 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:48.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.332+0000 7f3eca42d640 1 -- 172.21.15.53:0/532750623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec41344c0 con 0x7f3ec409f7a0 2024-05-08T18:30:48.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.333+0000 7f3eca42d640 1 --2- 172.21.15.53:0/532750623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ec409f7a0 0x7f3ec411bf20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000c480 tx=0x7f3ec000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:48.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.333+0000 7f3ebaffd640 1 -- 172.21.15.53:0/532750623 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec0017070 con 0x7f3ec409f7a0 2024-05-08T18:30:48.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.333+0000 7f3ebaffd640 1 -- 172.21.15.53:0/532750623 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ec0005c10 con 0x7f3ec409f7a0 2024-05-08T18:30:48.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.333+0000 7f3ecc691640 1 -- 172.21.15.53:0/532750623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec411efd0 con 0x7f3ec409f7a0 2024-05-08T18:30:48.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.333+0000 7f3ebaffd640 1 -- 172.21.15.53:0/532750623 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec00070d0 con 0x7f3ec409f7a0 2024-05-08T18:30:48.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.333+0000 7f3ecc691640 1 -- 172.21.15.53:0/532750623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec411eb20 con 0x7f3ec409f7a0 2024-05-08T18:30:48.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.334+0000 7f3ecc691640 1 -- 172.21.15.53:0/532750623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec4064010 con 0x7f3ec409f7a0 2024-05-08T18:30:48.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.334+0000 7f3ebaffd640 1 -- 172.21.15.53:0/532750623 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) ==== 49355+0+0 (secure 0 0 0) 0x7f3ec001a070 con 0x7f3ec409f7a0 2024-05-08T18:30:48.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.334+0000 7f3ebaffd640 1 --2- 172.21.15.53:0/532750623 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ea803d220 0x7f3ea803f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:48.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.334+0000 7f3ebaffd640 1 -- 172.21.15.53:0/532750623 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 2743+0+0 (secure 0 0 0) 0x7f3ec0050200 con 0x7f3ec409f7a0 2024-05-08T18:30:48.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.334+0000 7f3ec9c2c640 1 --2- 172.21.15.53:0/532750623 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ea803d220 0x7f3ea803f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:48.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.335+0000 7f3ec9c2c640 1 --2- 172.21.15.53:0/532750623 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ea803d220 0x7f3ea803f6e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4036000 tx=0x7f3eb4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:48.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.339+0000 7f3ebaffd640 1 -- 172.21.15.53:0/532750623 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3ec0010c90 con 0x7f3ec409f7a0 2024-05-08T18:30:48.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.534+0000 7f3ecc691640 1 -- 172.21.15.53:0/532750623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f3ec411d110 con 0x7f3ec409f7a0 2024-05-08T18:30:48.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.973+0000 7f3ebaffd640 1 -- 172.21.15.53:0/532750623 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) ==== 109+0+0 (secure 0 0 0) 0x7f3ec0011360 con 0x7f3ec409f7a0 2024-05-08T18:30:48.973 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'rbd' created 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.976+0000 7f3ecc691640 1 -- 172.21.15.53:0/532750623 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ea803d220 msgr2=0x7f3ea803f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.976+0000 7f3ecc691640 1 --2- 172.21.15.53:0/532750623 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ea803d220 0x7f3ea803f6e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4036000 tx=0x7f3eb4008030 comp rx=0 tx=0).stop 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.976+0000 7f3ecc691640 1 -- 172.21.15.53:0/532750623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ec409f7a0 msgr2=0x7f3ec411bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.976+0000 7f3ecc691640 1 --2- 172.21.15.53:0/532750623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ec409f7a0 0x7f3ec411bf20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000c480 tx=0x7f3ec000c940 comp rx=0 tx=0).stop 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.976+0000 7f3ecc691640 1 -- 172.21.15.53:0/532750623 shutdown_connections 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.976+0000 7f3ecc691640 1 --2- 172.21.15.53:0/532750623 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ea803d220 0x7f3ea803f6e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.976+0000 7f3ecc691640 1 --2- 172.21.15.53:0/532750623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ec409f7a0 0x7f3ec411bf20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.976+0000 7f3ecc691640 1 -- 172.21.15.53:0/532750623 >> 172.21.15.53:0/532750623 conn(0x7f3ec409e8c0 msgr2=0x7f3ec409c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.977+0000 7f3ecc691640 1 -- 172.21.15.53:0/532750623 shutdown_connections 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:48.977+0000 7f3ecc691640 1 -- 172.21.15.53:0/532750623 wait complete. 2024-05-08T18:30:48.989 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-08T18:30:49.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.100+0000 7f19552ee640 1 Processor -- start 2024-05-08T18:30:49.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.101+0000 7f19552ee640 1 -- start start 2024-05-08T18:30:49.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.101+0000 7f19552ee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f19501287a0 0x7f1950128b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:49.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.101+0000 7f19552ee640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1950128370 con 0x7f195012b770 2024-05-08T18:30:49.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.101+0000 7f19552ee640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f1950073890 con 0x7f19501287a0 2024-05-08T18:30:49.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.101+0000 7f194effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f19501287a0 0x7f1950128b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:49.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.101+0000 7f194e7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f195012b770 0x7f195012bb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49706/0 (socket says 172.21.15.53:49706) 2024-05-08T18:30:49.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.101+0000 7f194e7fc640 1 -- 172.21.15.53:0/1070061000 learned_addr learned my addr 172.21.15.53:0/1070061000 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:49.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.101+0000 7f194effd640 1 -- 172.21.15.53:0/1070061000 >> v1:172.21.15.53:6789/0 conn(0x7f195012b770 legacy=0x7f195012bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:49.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.101+0000 7f194effd640 1 -- 172.21.15.53:0/1070061000 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19501290c0 con 0x7f19501287a0 2024-05-08T18:30:49.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.102+0000 7f194effd640 1 --2- 172.21.15.53:0/1070061000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19501287a0 0x7f1950128b80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f194000b9c0 tx=0x7f194002ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf319f68c8ee345f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:49.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.102+0000 7f194dffb640 1 -- 172.21.15.53:0/1070061000 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1940034070 con 0x7f19501287a0 2024-05-08T18:30:49.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.102+0000 7f194dffb640 1 -- 172.21.15.53:0/1070061000 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f194002ead0 con 0x7f19501287a0 2024-05-08T18:30:49.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.102+0000 7f194dffb640 1 -- 172.21.15.53:0/1070061000 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f194002edd0 con 0x7f19501287a0 2024-05-08T18:30:49.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.103+0000 7f19552ee640 1 -- 172.21.15.53:0/1070061000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19501287a0 msgr2=0x7f1950128b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:49.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.103+0000 7f19552ee640 1 --2- 172.21.15.53:0/1070061000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19501287a0 0x7f1950128b80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f194000b9c0 tx=0x7f194002ddf0 comp rx=0 tx=0).stop 2024-05-08T18:30:49.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.103+0000 7f19552ee640 1 -- 172.21.15.53:0/1070061000 shutdown_connections 2024-05-08T18:30:49.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.103+0000 7f19552ee640 1 --2- 172.21.15.53:0/1070061000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19501287a0 0x7f1950128b80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:49.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.103+0000 7f19552ee640 1 -- 172.21.15.53:0/1070061000 >> 172.21.15.53:0/1070061000 conn(0x7f195009a330 msgr2=0x7f195009a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:49.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.103+0000 7f19552ee640 1 -- 172.21.15.53:0/1070061000 shutdown_connections 2024-05-08T18:30:49.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.103+0000 7f19552ee640 1 -- 172.21.15.53:0/1070061000 wait complete. 2024-05-08T18:30:49.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.104+0000 7f19552ee640 1 Processor -- start 2024-05-08T18:30:49.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.104+0000 7f19552ee640 1 -- start start 2024-05-08T18:30:49.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.104+0000 7f19552ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19501287a0 0x7f195011d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:49.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.104+0000 7f19552ee640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1950073050 con 0x7f19501287a0 2024-05-08T18:30:49.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.104+0000 7f194effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19501287a0 0x7f195011d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:49.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.104+0000 7f194effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19501287a0 0x7f195011d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38414/0 (socket says 172.21.15.53:38414) 2024-05-08T18:30:49.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.104+0000 7f194effd640 1 -- 172.21.15.53:0/2495652613 learned_addr learned my addr 172.21.15.53:0/2495652613 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:49.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.105+0000 7f194effd640 1 -- 172.21.15.53:0/2495652613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f195011f180 con 0x7f19501287a0 2024-05-08T18:30:49.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.105+0000 7f194effd640 1 --2- 172.21.15.53:0/2495652613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19501287a0 0x7f195011d520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f194000b9c0 tx=0x7f19400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:49.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.105+0000 7f19377fe640 1 -- 172.21.15.53:0/2495652613 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1940037770 con 0x7f19501287a0 2024-05-08T18:30:49.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.105+0000 7f19377fe640 1 -- 172.21.15.53:0/2495652613 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1940037910 con 0x7f19501287a0 2024-05-08T18:30:49.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.105+0000 7f19552ee640 1 -- 172.21.15.53:0/2495652613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19501209c0 con 0x7f19501287a0 2024-05-08T18:30:49.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.105+0000 7f19377fe640 1 -- 172.21.15.53:0/2495652613 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1940037bf0 con 0x7f19501287a0 2024-05-08T18:30:49.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.105+0000 7f19552ee640 1 -- 172.21.15.53:0/2495652613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f195011da60 con 0x7f19501287a0 2024-05-08T18:30:49.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.106+0000 7f19552ee640 1 -- 172.21.15.53:0/2495652613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f195009ce40 con 0x7f19501287a0 2024-05-08T18:30:49.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.106+0000 7f19377fe640 1 -- 172.21.15.53:0/2495652613 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) ==== 49355+0+0 (secure 0 0 0) 0x7f1940049020 con 0x7f19501287a0 2024-05-08T18:30:49.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.106+0000 7f19377fe640 1 --2- 172.21.15.53:0/2495652613 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f193c03d220 0x7f193c03f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.107+0000 7f19377fe640 1 -- 172.21.15.53:0/2495652613 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 3460+0+0 (secure 0 0 0) 0x7f1940047020 con 0x7f19501287a0 2024-05-08T18:30:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.107+0000 7f194e7fc640 1 --2- 172.21.15.53:0/2495652613 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f193c03d220 0x7f193c03f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.107+0000 7f194e7fc640 1 --2- 172.21.15.53:0/2495652613 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f193c03d220 0x7f193c03f6e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1944007fd0 tx=0x7f1944007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:49.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.111+0000 7f19377fe640 1 -- 172.21.15.53:0/2495652613 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1940042950 con 0x7f19501287a0 2024-05-08T18:30:49.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.301+0000 7f19552ee640 1 -- 172.21.15.53:0/2495652613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f1950064010 con 0x7f19501287a0 2024-05-08T18:30:49.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.974+0000 7f19377fe640 1 -- 172.21.15.53:0/2495652613 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) ==== 173+0+0 (secure 0 0 0) 0x7f194004be20 con 0x7f19501287a0 2024-05-08T18:30:49.974 INFO:teuthology.orchestra.run.smithi053.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-08T18:30:49.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.977+0000 7f19552ee640 1 -- 172.21.15.53:0/2495652613 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f193c03d220 msgr2=0x7f193c03f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:49.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.977+0000 7f19552ee640 1 --2- 172.21.15.53:0/2495652613 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f193c03d220 0x7f193c03f6e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1944007fd0 tx=0x7f1944007ac0 comp rx=0 tx=0).stop 2024-05-08T18:30:49.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.977+0000 7f19552ee640 1 -- 172.21.15.53:0/2495652613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19501287a0 msgr2=0x7f195011d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:49.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.977+0000 7f19552ee640 1 --2- 172.21.15.53:0/2495652613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19501287a0 0x7f195011d520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f194000b9c0 tx=0x7f19400046c0 comp rx=0 tx=0).stop 2024-05-08T18:30:49.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.977+0000 7f19552ee640 1 -- 172.21.15.53:0/2495652613 shutdown_connections 2024-05-08T18:30:49.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.977+0000 7f19552ee640 1 --2- 172.21.15.53:0/2495652613 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f193c03d220 0x7f193c03f6e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:49.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.977+0000 7f19552ee640 1 --2- 172.21.15.53:0/2495652613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19501287a0 0x7f195011d520 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:49.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.978+0000 7f19552ee640 1 -- 172.21.15.53:0/2495652613 >> 172.21.15.53:0/2495652613 conn(0x7f195009a330 msgr2=0x7f1950129550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:49.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.978+0000 7f19552ee640 1 -- 172.21.15.53:0/2495652613 shutdown_connections 2024-05-08T18:30:49.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:49.978+0000 7f19552ee640 1 -- 172.21.15.53:0/2495652613 wait complete. 2024-05-08T18:30:49.992 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-08T18:30:49.992 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T18:30:49.992 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-08T18:30:49.993 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-08T18:30:49.993 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-08T18:30:50.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.105+0000 7fbd2c2e6640 1 Processor -- start 2024-05-08T18:30:50.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.105+0000 7fbd2c2e6640 1 -- start start 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.105+0000 7fbd2c2e6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbd2406f8d0 0x7fbd241349f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.105+0000 7fbd2c2e6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd2409f550 con 0x7fbd2406ede0 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.105+0000 7fbd2c2e6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbd24073490 con 0x7fbd2406f8d0 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.105+0000 7fbd29881640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbd2406f8d0 0x7fbd241349f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.105+0000 7fbd2a082640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbd2406ede0 0x7fbd2406f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49702/0 (socket says 172.21.15.53:49702) 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.105+0000 7fbd2a082640 1 -- 172.21.15.53:0/1124587177 learned_addr learned my addr 172.21.15.53:0/1124587177 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.106+0000 7fbd29881640 1 -- 172.21.15.53:0/1124587177 >> v1:172.21.15.53:6789/0 conn(0x7fbd2406ede0 legacy=0x7fbd2406f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.106+0000 7fbd29080640 1 -- 172.21.15.53:0/1124587177 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857202285 0 0) 0x7fbd2409f550 con 0x7fbd2406ede0 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.106+0000 7fbd29881640 1 -- 172.21.15.53:0/1124587177 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd24070920 con 0x7fbd2406f8d0 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.107+0000 7fbd29881640 1 --2- 172.21.15.53:0/1124587177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd2406f8d0 0x7fbd241349f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009720 tx=0x7fbd1402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336080133b6fb823 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.107+0000 7fbd29080640 1 -- 172.21.15.53:0/1124587177 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd140316d0 con 0x7fbd2406f8d0 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.107+0000 7fbd29080640 1 -- 172.21.15.53:0/1124587177 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd14037070 con 0x7fbd2406f8d0 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.107+0000 7fbd29080640 1 -- 172.21.15.53:0/1124587177 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd140319c0 con 0x7fbd2406f8d0 2024-05-08T18:30:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.108+0000 7fbd2c2e6640 1 -- 172.21.15.53:0/1124587177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd2406f8d0 msgr2=0x7fbd241349f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.108+0000 7fbd2c2e6640 1 --2- 172.21.15.53:0/1124587177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd2406f8d0 0x7fbd241349f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009720 tx=0x7fbd1402b840 comp rx=0 tx=0).stop 2024-05-08T18:30:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.108+0000 7fbd2c2e6640 1 -- 172.21.15.53:0/1124587177 shutdown_connections 2024-05-08T18:30:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.108+0000 7fbd2c2e6640 1 --2- 172.21.15.53:0/1124587177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd2406f8d0 0x7fbd241349f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:50.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.108+0000 7fbd2c2e6640 1 -- 172.21.15.53:0/1124587177 >> 172.21.15.53:0/1124587177 conn(0x7fbd2409c8a0 msgr2=0x7fbd2409ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:50.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.108+0000 7fbd2c2e6640 1 -- 172.21.15.53:0/1124587177 shutdown_connections 2024-05-08T18:30:50.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.108+0000 7fbd2c2e6640 1 -- 172.21.15.53:0/1124587177 wait complete. 2024-05-08T18:30:50.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.109+0000 7fbd2c2e6640 1 Processor -- start 2024-05-08T18:30:50.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.109+0000 7fbd2c2e6640 1 -- start start 2024-05-08T18:30:50.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.110+0000 7fbd2c2e6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd2406ede0 0x7fbd24131c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.110+0000 7fbd2c2e6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbd24134f30 con 0x7fbd2406ede0 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.110+0000 7fbd2a082640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd2406ede0 0x7fbd24131c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.110+0000 7fbd2a082640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd2406ede0 0x7fbd24131c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36298/0 (socket says 172.21.15.53:36298) 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.110+0000 7fbd2a082640 1 -- 172.21.15.53:0/1984813061 learned_addr learned my addr 172.21.15.53:0/1984813061 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.110+0000 7fbd2a082640 1 -- 172.21.15.53:0/1984813061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd24123df0 con 0x7fbd2406ede0 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.110+0000 7fbd2a082640 1 --2- 172.21.15.53:0/1984813061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd2406ede0 0x7fbd24131c70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c370 tx=0x7fbd2000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.110+0000 7fbd1affd640 1 -- 172.21.15.53:0/1984813061 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd20007410 con 0x7fbd2406ede0 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.110+0000 7fbd1affd640 1 -- 172.21.15.53:0/1984813061 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd200075d0 con 0x7fbd2406ede0 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.110+0000 7fbd2c2e6640 1 -- 172.21.15.53:0/1984813061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd24123950 con 0x7fbd2406ede0 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.110+0000 7fbd1affd640 1 -- 172.21.15.53:0/1984813061 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd20004950 con 0x7fbd2406ede0 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.110+0000 7fbd2c2e6640 1 -- 172.21.15.53:0/1984813061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd24124c60 con 0x7fbd2406ede0 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.111+0000 7fbd1affd640 1 -- 172.21.15.53:0/1984813061 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) ==== 49355+0+0 (secure 0 0 0) 0x7fbd20011070 con 0x7fbd2406ede0 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.111+0000 7fbd2c2e6640 1 -- 172.21.15.53:0/1984813061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd2409c190 con 0x7fbd2406ede0 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.112+0000 7fbd1affd640 1 --2- 172.21.15.53:0/1984813061 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbd0803d200 0x7fbd0803f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.112+0000 7fbd1affd640 1 -- 172.21.15.53:0/1984813061 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 3482+0+0 (secure 0 0 0) 0x7fbd20050dd0 con 0x7fbd2406ede0 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.112+0000 7fbd29881640 1 --2- 172.21.15.53:0/1984813061 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbd0803d200 0x7fbd0803f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:50.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.113+0000 7fbd29881640 1 --2- 172.21.15.53:0/1984813061 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbd0803d200 0x7fbd0803f6c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbd14036000 tx=0x7fbd14008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:50.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.116+0000 7fbd1affd640 1 -- 172.21.15.53:0/1984813061 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fbd2409c190 con 0x7fbd2406ede0 2024-05-08T18:30:50.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.358+0000 7fbd2c2e6640 1 -- 172.21.15.53:0/1984813061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fbd24064010 con 0x7fbd2406ede0 2024-05-08T18:30:50.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.369+0000 7fbd1affd640 1 -- 172.21.15.53:0/1984813061 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) ==== 74+0+95395 (secure 0 0 0) 0x7fbd20052030 con 0x7fbd2406ede0 2024-05-08T18:30:50.369 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:50.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.371+0000 7fbd2c2e6640 1 -- 172.21.15.53:0/1984813061 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbd0803d200 msgr2=0x7fbd0803f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:50.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.371+0000 7fbd2c2e6640 1 --2- 172.21.15.53:0/1984813061 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbd0803d200 0x7fbd0803f6c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbd14036000 tx=0x7fbd14008030 comp rx=0 tx=0).stop 2024-05-08T18:30:50.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.371+0000 7fbd2c2e6640 1 -- 172.21.15.53:0/1984813061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd2406ede0 msgr2=0x7fbd24131c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:50.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.371+0000 7fbd2c2e6640 1 --2- 172.21.15.53:0/1984813061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd2406ede0 0x7fbd24131c70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c370 tx=0x7fbd2000c830 comp rx=0 tx=0).stop 2024-05-08T18:30:50.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.371+0000 7fbd2c2e6640 1 -- 172.21.15.53:0/1984813061 shutdown_connections 2024-05-08T18:30:50.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.371+0000 7fbd2c2e6640 1 --2- 172.21.15.53:0/1984813061 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbd0803d200 0x7fbd0803f6c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:50.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.371+0000 7fbd2c2e6640 1 --2- 172.21.15.53:0/1984813061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd2406ede0 0x7fbd24131c70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:50.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.371+0000 7fbd2c2e6640 1 -- 172.21.15.53:0/1984813061 >> 172.21.15.53:0/1984813061 conn(0x7fbd2409c8a0 msgr2=0x7fbd24133880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:50.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.372+0000 7fbd2c2e6640 1 -- 172.21.15.53:0/1984813061 shutdown_connections 2024-05-08T18:30:50.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.372+0000 7fbd2c2e6640 1 -- 172.21.15.53:0/1984813061 wait complete. 2024-05-08T18:30:50.382 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":4,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":211215191},{"type":"v1","addr":"172.21.15.87:6825","nonce":211215191}]},"active_addr":"172.21.15.87:6825/211215191","active_change":"2024-05-08T18:30:44.094485+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":3097056519}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":3769843829}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":3793777922}]}]} 2024-05-08T18:30:50.384 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-08T18:30:50.384 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T18:30:50.384 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:30:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.487+0000 7f435c6ff640 1 Processor -- start 2024-05-08T18:30:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.487+0000 7f435c6ff640 1 -- start start 2024-05-08T18:30:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.488+0000 7f435c6ff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f43540969c0 0x7f4354134ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.488+0000 7f435c6ff640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4354097810 con 0x7f4354094bb0 2024-05-08T18:30:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.488+0000 7f435c6ff640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f435406ecb0 con 0x7f43540969c0 2024-05-08T18:30:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.488+0000 7f4359c9a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f43540969c0 0x7f4354134ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.488+0000 7f435a49b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4354094bb0 0x7f43540962b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49712/0 (socket says 172.21.15.53:49712) 2024-05-08T18:30:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.488+0000 7f435a49b640 1 -- 172.21.15.53:0/2765380454 learned_addr learned my addr 172.21.15.53:0/2765380454 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.488+0000 7f4359c9a640 1 -- 172.21.15.53:0/2765380454 >> v1:172.21.15.53:6789/0 conn(0x7f4354094bb0 legacy=0x7f43540962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.488+0000 7f4359c9a640 1 -- 172.21.15.53:0/2765380454 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4354097a80 con 0x7f43540969c0 2024-05-08T18:30:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.488+0000 7f4359499640 1 -- 172.21.15.53:0/2765380454 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3164333448 0 0) 0x7f4354097810 con 0x7f4354094bb0 2024-05-08T18:30:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.489+0000 7f4359c9a640 1 --2- 172.21.15.53:0/2765380454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43540969c0 0x7f4354134ef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4344009720 tx=0x7f434402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b644e9f473a68654 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.489+0000 7f4359499640 1 -- 172.21.15.53:0/2765380454 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4344035020 con 0x7f43540969c0 2024-05-08T18:30:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.489+0000 7f4359499640 1 -- 172.21.15.53:0/2765380454 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4344031760 con 0x7f43540969c0 2024-05-08T18:30:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.489+0000 7f4359499640 1 -- 172.21.15.53:0/2765380454 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4344031a60 con 0x7f43540969c0 2024-05-08T18:30:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.490+0000 7f435c6ff640 1 -- 172.21.15.53:0/2765380454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43540969c0 msgr2=0x7f4354134ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.490+0000 7f435c6ff640 1 --2- 172.21.15.53:0/2765380454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43540969c0 0x7f4354134ef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4344009720 tx=0x7f434402b8d0 comp rx=0 tx=0).stop 2024-05-08T18:30:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.490+0000 7f435c6ff640 1 -- 172.21.15.53:0/2765380454 shutdown_connections 2024-05-08T18:30:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.490+0000 7f435c6ff640 1 --2- 172.21.15.53:0/2765380454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43540969c0 0x7f4354134ef0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.490+0000 7f435c6ff640 1 -- 172.21.15.53:0/2765380454 >> 172.21.15.53:0/2765380454 conn(0x7f435409e360 msgr2=0x7f435409a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.490+0000 7f435c6ff640 1 -- 172.21.15.53:0/2765380454 shutdown_connections 2024-05-08T18:30:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.490+0000 7f435c6ff640 1 -- 172.21.15.53:0/2765380454 wait complete. 2024-05-08T18:30:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.491+0000 7f435c6ff640 1 Processor -- start 2024-05-08T18:30:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.491+0000 7f435c6ff640 1 -- start start 2024-05-08T18:30:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.491+0000 7f435c6ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4354094bb0 0x7f43541c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.491+0000 7f435c6ff640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4354096e10 con 0x7f4354094bb0 2024-05-08T18:30:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.491+0000 7f435a49b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4354094bb0 0x7f43541c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.491+0000 7f435a49b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4354094bb0 0x7f43541c0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36302/0 (socket says 172.21.15.53:36302) 2024-05-08T18:30:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.491+0000 7f435a49b640 1 -- 172.21.15.53:0/3537506888 learned_addr learned my addr 172.21.15.53:0/3537506888 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.491+0000 7f435a49b640 1 -- 172.21.15.53:0/3537506888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43541abe70 con 0x7f4354094bb0 2024-05-08T18:30:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.491+0000 7f435a49b640 1 --2- 172.21.15.53:0/3537506888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4354094bb0 0x7f43541c0be0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f435000c6d0 tx=0x7f435000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.492+0000 7f434affd640 1 -- 172.21.15.53:0/3537506888 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4350001d20 con 0x7f4354094bb0 2024-05-08T18:30:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.492+0000 7f434affd640 1 -- 172.21.15.53:0/3537506888 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4350007070 con 0x7f4354094bb0 2024-05-08T18:30:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.492+0000 7f435c6ff640 1 -- 172.21.15.53:0/3537506888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43541aa430 con 0x7f4354094bb0 2024-05-08T18:30:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.492+0000 7f434affd640 1 -- 172.21.15.53:0/3537506888 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4350007370 con 0x7f4354094bb0 2024-05-08T18:30:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.492+0000 7f435c6ff640 1 -- 172.21.15.53:0/3537506888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43541ac110 con 0x7f4354094bb0 2024-05-08T18:30:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.493+0000 7f435c6ff640 1 -- 172.21.15.53:0/3537506888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4354064010 con 0x7f4354094bb0 2024-05-08T18:30:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.493+0000 7f434affd640 1 -- 172.21.15.53:0/3537506888 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) ==== 49355+0+0 (secure 0 0 0) 0x7f43500057a0 con 0x7f4354094bb0 2024-05-08T18:30:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.493+0000 7f434affd640 1 --2- 172.21.15.53:0/3537506888 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f433803d220 0x7f433803f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.493+0000 7f434affd640 1 -- 172.21.15.53:0/3537506888 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 3482+0+0 (secure 0 0 0) 0x7f4350050f30 con 0x7f4354094bb0 2024-05-08T18:30:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.493+0000 7f4359c9a640 1 --2- 172.21.15.53:0/3537506888 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f433803d220 0x7f433803f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:50.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.494+0000 7f4359c9a640 1 --2- 172.21.15.53:0/3537506888 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f433803d220 0x7f433803f6e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4344036000 tx=0x7f4344008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:50.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.498+0000 7f434affd640 1 -- 172.21.15.53:0/3537506888 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f43541abe70 con 0x7f4354094bb0 2024-05-08T18:30:50.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.689+0000 7f435c6ff640 1 -- 172.21.15.53:0/3537506888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43541a9c80 con 0x7f4354094bb0 2024-05-08T18:30:50.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.690+0000 7f434affd640 1 -- 172.21.15.53:0/3537506888 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+9733 (secure 0 0 0) 0x7f43500113a0 con 0x7f4354094bb0 2024-05-08T18:30:50.689 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:50.689 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":11,"fsid":"24862ec0-9aa3-4837-9fb5-4efcd65f7b56","created":"2024-05-08T18:30:39.594585+0000","modified":"2024-05-08T18:30:49.975305+0000","last_up_change":"2024-05-08T18:30:47.973576+0000","last_in_change":"2024-05-08T18:30:40.701334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:30:48.122011+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:30:48.538594+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bf91df5-317b-40b7-a1ef-93220b68d9eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":443747735},{"type":"v1","addr":"172.21.15.53:6801","nonce":443747735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":443747735},{"type":"v1","addr":"172.21.15.53:6803","nonce":443747735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":443747735},{"type":"v1","addr":"172.21.15.53:6807","nonce":443747735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":443747735},{"type":"v1","addr":"172.21.15.53:6805","nonce":443747735}]},"public_addr":"172.21.15.53:6801/443747735","cluster_addr":"172.21.15.53:6803/443747735","heartbeat_back_addr":"172.21.15.53:6807/443747735","heartbeat_front_addr":"172.21.15.53:6805/443747735","state":["exists","up"]},{"osd":1,"uuid":"8f60b028-91b7-4350-8ebf-62eb3cf4d77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2448644045},{"type":"v1","addr":"172.21.15.87:6809","nonce":2448644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2448644045},{"type":"v1","addr":"172.21.15.87:6811","nonce":2448644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2448644045},{"type":"v1","addr":"172.21.15.87:6815","nonce":2448644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2448644045},{"type":"v1","addr":"172.21.15.87:6813","nonce":2448644045}]},"public_addr":"172.21.15.87:6809/2448644045","cluster_addr":"172.21.15.87:6811/2448644045","heartbeat_back_addr":"172.21.15.87:6815/2448644045","heartbeat_front_addr":"172.21.15.87:6813/2448644045","state":["exists","up"]},{"osd":2,"uuid":"bdb8b677-0dba-4bd1-871f-dcd34fbaf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2108501615},{"type":"v1","addr":"172.21.15.87:6817","nonce":2108501615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2108501615},{"type":"v1","addr":"172.21.15.87:6819","nonce":2108501615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2108501615},{"type":"v1","addr":"172.21.15.87:6823","nonce":2108501615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2108501615},{"type":"v1","addr":"172.21.15.87:6821","nonce":2108501615}]},"public_addr":"172.21.15.87:6817/2108501615","cluster_addr":"172.21.15.87:6819/2108501615","heartbeat_back_addr":"172.21.15.87:6823/2108501615","heartbeat_front_addr":"172.21.15.87:6821/2108501615","state":["exists","up"]},{"osd":3,"uuid":"461c3e80-69a6-46f2-a941-06ff79538fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2929215285},{"type":"v1","addr":"172.21.15.87:6801","nonce":2929215285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2929215285},{"type":"v1","addr":"172.21.15.87:6803","nonce":2929215285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2929215285},{"type":"v1","addr":"172.21.15.87:6807","nonce":2929215285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2929215285},{"type":"v1","addr":"172.21.15.87:6805","nonce":2929215285}]},"public_addr":"172.21.15.87:6801/2929215285","cluster_addr":"172.21.15.87:6803/2929215285","heartbeat_back_addr":"172.21.15.87:6807/2929215285","heartbeat_front_addr":"172.21.15.87:6805/2929215285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:30:45.715976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:30:45.795465+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:30:45.865129+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:30:45.829998+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:30:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.692+0000 7f435c6ff640 1 -- 172.21.15.53:0/3537506888 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f433803d220 msgr2=0x7f433803f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.692+0000 7f435c6ff640 1 --2- 172.21.15.53:0/3537506888 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f433803d220 0x7f433803f6e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4344036000 tx=0x7f4344008030 comp rx=0 tx=0).stop 2024-05-08T18:30:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.692+0000 7f435c6ff640 1 -- 172.21.15.53:0/3537506888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4354094bb0 msgr2=0x7f43541c0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.692+0000 7f435c6ff640 1 --2- 172.21.15.53:0/3537506888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4354094bb0 0x7f43541c0be0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f435000c6d0 tx=0x7f435000cb90 comp rx=0 tx=0).stop 2024-05-08T18:30:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.692+0000 7f435c6ff640 1 -- 172.21.15.53:0/3537506888 shutdown_connections 2024-05-08T18:30:50.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.692+0000 7f435c6ff640 1 --2- 172.21.15.53:0/3537506888 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f433803d220 0x7f433803f6e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:50.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.692+0000 7f435c6ff640 1 --2- 172.21.15.53:0/3537506888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4354094bb0 0x7f43541c0be0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:50.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.692+0000 7f435c6ff640 1 -- 172.21.15.53:0/3537506888 >> 172.21.15.53:0/3537506888 conn(0x7f435409e360 msgr2=0x7f43540927b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:50.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.692+0000 7f435c6ff640 1 -- 172.21.15.53:0/3537506888 shutdown_connections 2024-05-08T18:30:50.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.692+0000 7f435c6ff640 1 -- 172.21.15.53:0/3537506888 wait complete. 2024-05-08T18:30:50.702 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T18:30:50.702 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:30:50.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.806+0000 7f9e96379640 1 Processor -- start 2024-05-08T18:30:50.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.806+0000 7f9e96379640 1 -- start start 2024-05-08T18:30:50.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.806+0000 7f9e96379640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9e9006fe20 0x7f9e90128e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:50.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.806+0000 7f9e96379640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e90072dc0 con 0x7f9e90129390 2024-05-08T18:30:50.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.806+0000 7f9e96379640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f9e90128ad0 con 0x7f9e9006fe20 2024-05-08T18:30:50.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.807+0000 7f9e8ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9e9006fe20 0x7f9e90128e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:50.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.807+0000 7f9e8f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9e90129390 0x7f9e9012c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49728/0 (socket says 172.21.15.53:49728) 2024-05-08T18:30:50.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.807+0000 7f9e8f7fe640 1 -- 172.21.15.53:0/3051069168 learned_addr learned my addr 172.21.15.53:0/3051069168 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:50.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.807+0000 7f9e8ffff640 1 -- 172.21.15.53:0/3051069168 >> v1:172.21.15.53:6789/0 conn(0x7f9e90129390 legacy=0x7f9e9012c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:50.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.807+0000 7f9e8ffff640 1 -- 172.21.15.53:0/3051069168 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e900739e0 con 0x7f9e9006fe20 2024-05-08T18:30:50.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.808+0000 7f9e8ffff640 1 --2- 172.21.15.53:0/3051069168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e9006fe20 0x7f9e90128e50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e80009720 tx=0x7f9e8002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fab681e7dd46883 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:50.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.808+0000 7f9e8effd640 1 -- 172.21.15.53:0/3051069168 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e800316d0 con 0x7f9e9006fe20 2024-05-08T18:30:50.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.808+0000 7f9e8effd640 1 -- 172.21.15.53:0/3051069168 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e80037070 con 0x7f9e9006fe20 2024-05-08T18:30:50.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.808+0000 7f9e8effd640 1 -- 172.21.15.53:0/3051069168 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e800319c0 con 0x7f9e9006fe20 2024-05-08T18:30:50.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.808+0000 7f9e96379640 1 -- 172.21.15.53:0/3051069168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e9006fe20 msgr2=0x7f9e90128e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:50.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.808+0000 7f9e96379640 1 --2- 172.21.15.53:0/3051069168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e9006fe20 0x7f9e90128e50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e80009720 tx=0x7f9e8002b840 comp rx=0 tx=0).stop 2024-05-08T18:30:50.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.808+0000 7f9e96379640 1 -- 172.21.15.53:0/3051069168 shutdown_connections 2024-05-08T18:30:50.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.808+0000 7f9e96379640 1 --2- 172.21.15.53:0/3051069168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e9006fe20 0x7f9e90128e50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:50.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.808+0000 7f9e96379640 1 -- 172.21.15.53:0/3051069168 >> 172.21.15.53:0/3051069168 conn(0x7f9e9009a910 msgr2=0x7f9e9006e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:50.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.808+0000 7f9e96379640 1 -- 172.21.15.53:0/3051069168 shutdown_connections 2024-05-08T18:30:50.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.808+0000 7f9e96379640 1 -- 172.21.15.53:0/3051069168 wait complete. 2024-05-08T18:30:50.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.809+0000 7f9e96379640 1 Processor -- start 2024-05-08T18:30:50.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.809+0000 7f9e96379640 1 -- start start 2024-05-08T18:30:50.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.810+0000 7f9e96379640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e9006fe20 0x7f9e901187a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:50.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.810+0000 7f9e96379640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9e901299a0 con 0x7f9e9006fe20 2024-05-08T18:30:50.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.810+0000 7f9e8ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e9006fe20 0x7f9e901187a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:50.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.810+0000 7f9e8ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e9006fe20 0x7f9e901187a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36312/0 (socket says 172.21.15.53:36312) 2024-05-08T18:30:50.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.810+0000 7f9e8ffff640 1 -- 172.21.15.53:0/3658347216 learned_addr learned my addr 172.21.15.53:0/3658347216 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:50.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.810+0000 7f9e8ffff640 1 -- 172.21.15.53:0/3658347216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e900709a0 con 0x7f9e9006fe20 2024-05-08T18:30:50.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.810+0000 7f9e8ffff640 1 --2- 172.21.15.53:0/3658347216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e9006fe20 0x7f9e901187a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9e80034040 tx=0x7f9e800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:50.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.811+0000 7f9e8cff9640 1 -- 172.21.15.53:0/3658347216 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e80032770 con 0x7f9e9006fe20 2024-05-08T18:30:50.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.811+0000 7f9e8cff9640 1 -- 172.21.15.53:0/3658347216 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e80032910 con 0x7f9e9006fe20 2024-05-08T18:30:50.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.811+0000 7f9e96379640 1 -- 172.21.15.53:0/3658347216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e901198d0 con 0x7f9e9006fe20 2024-05-08T18:30:50.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.811+0000 7f9e8cff9640 1 -- 172.21.15.53:0/3658347216 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e80032c30 con 0x7f9e9006fe20 2024-05-08T18:30:50.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.811+0000 7f9e96379640 1 -- 172.21.15.53:0/3658347216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e90118ec0 con 0x7f9e9006fe20 2024-05-08T18:30:50.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.812+0000 7f9e96379640 1 -- 172.21.15.53:0/3658347216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e90071200 con 0x7f9e9006fe20 2024-05-08T18:30:50.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.812+0000 7f9e8cff9640 1 -- 172.21.15.53:0/3658347216 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) ==== 49355+0+0 (secure 0 0 0) 0x7f9e8004c060 con 0x7f9e9006fe20 2024-05-08T18:30:50.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.812+0000 7f9e8cff9640 1 --2- 172.21.15.53:0/3658347216 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9e7c03d220 0x7f9e7c03f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:50.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.812+0000 7f9e8cff9640 1 -- 172.21.15.53:0/3658347216 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 3482+0+0 (secure 0 0 0) 0x7f9e8002f050 con 0x7f9e9006fe20 2024-05-08T18:30:50.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.812+0000 7f9e8f7fe640 1 --2- 172.21.15.53:0/3658347216 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9e7c03d220 0x7f9e7c03f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:50.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.813+0000 7f9e8f7fe640 1 --2- 172.21.15.53:0/3658347216 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9e7c03d220 0x7f9e7c03f6e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9e84007fd0 tx=0x7f9e84007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:50.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.817+0000 7f9e8cff9640 1 -- 172.21.15.53:0/3658347216 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9e80040070 con 0x7f9e9006fe20 2024-05-08T18:30:50.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:50.981+0000 7f9e8cff9640 1 -- 172.21.15.53:0/3658347216 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9e8004eca0 con 0x7f9e9006fe20 2024-05-08T18:30:51.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.013+0000 7f9e96379640 1 -- 172.21.15.53:0/3658347216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e90064010 con 0x7f9e9006fe20 2024-05-08T18:30:51.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.013+0000 7f9e8cff9640 1 -- 172.21.15.53:0/3658347216 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+9707 (secure 0 0 0) 0x7f9e8002dc20 con 0x7f9e9006fe20 2024-05-08T18:30:51.015 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:51.015 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":12,"fsid":"24862ec0-9aa3-4837-9fb5-4efcd65f7b56","created":"2024-05-08T18:30:39.594585+0000","modified":"2024-05-08T18:30:50.976434+0000","last_up_change":"2024-05-08T18:30:47.973576+0000","last_in_change":"2024-05-08T18:30:40.701334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:30:48.122011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:30:48.538594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bf91df5-317b-40b7-a1ef-93220b68d9eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":443747735},{"type":"v1","addr":"172.21.15.53:6801","nonce":443747735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":443747735},{"type":"v1","addr":"172.21.15.53:6803","nonce":443747735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":443747735},{"type":"v1","addr":"172.21.15.53:6807","nonce":443747735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":443747735},{"type":"v1","addr":"172.21.15.53:6805","nonce":443747735}]},"public_addr":"172.21.15.53:6801/443747735","cluster_addr":"172.21.15.53:6803/443747735","heartbeat_back_addr":"172.21.15.53:6807/443747735","heartbeat_front_addr":"172.21.15.53:6805/443747735","state":["exists","up"]},{"osd":1,"uuid":"8f60b028-91b7-4350-8ebf-62eb3cf4d77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2448644045},{"type":"v1","addr":"172.21.15.87:6809","nonce":2448644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2448644045},{"type":"v1","addr":"172.21.15.87:6811","nonce":2448644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2448644045},{"type":"v1","addr":"172.21.15.87:6815","nonce":2448644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2448644045},{"type":"v1","addr":"172.21.15.87:6813","nonce":2448644045}]},"public_addr":"172.21.15.87:6809/2448644045","cluster_addr":"172.21.15.87:6811/2448644045","heartbeat_back_addr":"172.21.15.87:6815/2448644045","heartbeat_front_addr":"172.21.15.87:6813/2448644045","state":["exists","up"]},{"osd":2,"uuid":"bdb8b677-0dba-4bd1-871f-dcd34fbaf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2108501615},{"type":"v1","addr":"172.21.15.87:6817","nonce":2108501615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2108501615},{"type":"v1","addr":"172.21.15.87:6819","nonce":2108501615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2108501615},{"type":"v1","addr":"172.21.15.87:6823","nonce":2108501615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2108501615},{"type":"v1","addr":"172.21.15.87:6821","nonce":2108501615}]},"public_addr":"172.21.15.87:6817/2108501615","cluster_addr":"172.21.15.87:6819/2108501615","heartbeat_back_addr":"172.21.15.87:6823/2108501615","heartbeat_front_addr":"172.21.15.87:6821/2108501615","state":["exists","up"]},{"osd":3,"uuid":"461c3e80-69a6-46f2-a941-06ff79538fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2929215285},{"type":"v1","addr":"172.21.15.87:6801","nonce":2929215285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2929215285},{"type":"v1","addr":"172.21.15.87:6803","nonce":2929215285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2929215285},{"type":"v1","addr":"172.21.15.87:6807","nonce":2929215285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2929215285},{"type":"v1","addr":"172.21.15.87:6805","nonce":2929215285}]},"public_addr":"172.21.15.87:6801/2929215285","cluster_addr":"172.21.15.87:6803/2929215285","heartbeat_back_addr":"172.21.15.87:6807/2929215285","heartbeat_front_addr":"172.21.15.87:6805/2929215285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:30:45.715976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:30:45.795465+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:30:45.865129+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:30:45.829998+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:30:51.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.016+0000 7f9e96379640 1 -- 172.21.15.53:0/3658347216 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9e7c03d220 msgr2=0x7f9e7c03f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.016+0000 7f9e96379640 1 --2- 172.21.15.53:0/3658347216 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9e7c03d220 0x7f9e7c03f6e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9e84007fd0 tx=0x7f9e84007ac0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.016+0000 7f9e96379640 1 -- 172.21.15.53:0/3658347216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e9006fe20 msgr2=0x7f9e901187a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.016+0000 7f9e96379640 1 --2- 172.21.15.53:0/3658347216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e9006fe20 0x7f9e901187a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9e80034040 tx=0x7f9e800046c0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.016+0000 7f9e96379640 1 -- 172.21.15.53:0/3658347216 shutdown_connections 2024-05-08T18:30:51.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.016+0000 7f9e96379640 1 --2- 172.21.15.53:0/3658347216 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9e7c03d220 0x7f9e7c03f6e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.016+0000 7f9e96379640 1 --2- 172.21.15.53:0/3658347216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e9006fe20 0x7f9e901187a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.016+0000 7f9e96379640 1 -- 172.21.15.53:0/3658347216 >> 172.21.15.53:0/3658347216 conn(0x7f9e9009a910 msgr2=0x7f9e90127460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:51.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.016+0000 7f9e96379640 1 -- 172.21.15.53:0/3658347216 shutdown_connections 2024-05-08T18:30:51.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.016+0000 7f9e96379640 1 -- 172.21.15.53:0/3658347216 wait complete. 2024-05-08T18:30:51.026 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T18:30:51.027 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T18:30:51.027 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T18:30:51.027 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T18:30:51.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.138+0000 7f5093f92640 1 Processor -- start 2024-05-08T18:30:51.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.138+0000 7f4274083640 1 Processor -- start 2024-05-08T18:30:51.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.138+0000 7f2f701c7640 1 Processor -- start 2024-05-08T18:30:51.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.138+0000 7f7f5193f640 1 Processor -- start 2024-05-08T18:30:51.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.138+0000 7f5093f92640 1 -- start start 2024-05-08T18:30:51.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.138+0000 7f7f5193f640 1 -- start start 2024-05-08T18:30:51.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.138+0000 7f4274083640 1 -- start start 2024-05-08T18:30:51.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.138+0000 7f2f701c7640 1 -- start start 2024-05-08T18:30:51.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f5093f92640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f508c06fe20 0x7f508c128e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f4274083640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f426c070850 0x7f426c070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f5093f92640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f508c072dc0 con 0x7f508c129390 2024-05-08T18:30:51.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f5093f92640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f508c128ad0 con 0x7f508c06fe20 2024-05-08T18:30:51.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f4274083640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f426c0a28f0 con 0x7f426c071170 2024-05-08T18:30:51.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f4274083640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f426c072970 con 0x7f426c070850 2024-05-08T18:30:51.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f7f5193f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7f4c12dde0 0x7f7f4c1328b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f7f5193f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f4c097810 con 0x7f7f4c12d2f0 2024-05-08T18:30:51.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f7f5193f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f7f4c097b50 con 0x7f7f4c12dde0 2024-05-08T18:30:51.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f2f701c7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f68132700 0x7f2f68134af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f2f701c7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f68072880 con 0x7f2f68070000 2024-05-08T18:30:51.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f2f701c7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f2f68072110 con 0x7f2f68132700 2024-05-08T18:30:51.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f5091d2e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f508c06fe20 0x7f508c128e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f4271e1f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f426c070850 0x7f426c070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f5091d2e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f508c06fe20 0x7f508c128e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36326/0 (socket says 172.21.15.53:36326) 2024-05-08T18:30:51.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f7f4affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7f4c12d2f0 0x7f7f4c12d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49750/0 (socket says 172.21.15.53:49750) 2024-05-08T18:30:51.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f7f4affd640 1 -- 172.21.15.53:0/4003318399 learned_addr learned my addr 172.21.15.53:0/4003318399 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:51.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f509152d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f508c129390 0x7f508c12c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49730/0 (socket says 172.21.15.53:49730) 2024-05-08T18:30:51.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f509152d640 1 -- 172.21.15.53:0/3211056415 learned_addr learned my addr 172.21.15.53:0/3211056415 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:51.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f2f6d762640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f68132700 0x7f2f68134af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f2f6d762640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f68132700 0x7f2f68134af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36342/0 (socket says 172.21.15.53:36342) 2024-05-08T18:30:51.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f2f6d762640 1 -- 172.21.15.53:0/1881160581 learned_addr learned my addr 172.21.15.53:0/1881160581 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:51.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f7f4a7fc640 1 --2- 172.21.15.53:0/4003318399 >> v2:172.21.15.53:3300/0 conn(0x7f7f4c12dde0 0x7f7f4c1328b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f4271e1f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f426c070850 0x7f426c070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36328/0 (socket says 172.21.15.53:36328) 2024-05-08T18:30:51.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f4271e1f640 1 -- 172.21.15.53:0/1435508000 learned_addr learned my addr 172.21.15.53:0/1435508000 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:51.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f2f6d762640 1 -- 172.21.15.53:0/1881160581 >> v1:172.21.15.53:6789/0 conn(0x7f2f68070000 legacy=0x7f2f680703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.139+0000 7f2f6d762640 1 -- 172.21.15.53:0/1881160581 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f68072fd0 con 0x7f2f68132700 2024-05-08T18:30:51.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.140+0000 7f5091d2e640 1 -- 172.21.15.53:0/3211056415 >> v1:172.21.15.53:6789/0 conn(0x7f508c129390 legacy=0x7f508c12c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.140+0000 7f5091d2e640 1 -- 172.21.15.53:0/3211056415 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508c0739e0 con 0x7f508c06fe20 2024-05-08T18:30:51.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.140+0000 7f7f49ffb640 1 -- 172.21.15.53:0/4003318399 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 95945099 0 0) 0x7f7f4c097810 con 0x7f7f4c12d2f0 2024-05-08T18:30:51.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.140+0000 7f7f49ffb640 1 -- 172.21.15.53:0/4003318399 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f34003520 con 0x7f7f4c12d2f0 2024-05-08T18:30:51.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.140+0000 7f4271e1f640 1 -- 172.21.15.53:0/1435508000 >> v1:172.21.15.53:6789/0 conn(0x7f426c071170 legacy=0x7f426c12c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.140+0000 7f4271e1f640 1 -- 172.21.15.53:0/1435508000 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426c072ba0 con 0x7f426c070850 2024-05-08T18:30:51.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.140+0000 7f2f6d762640 1 --2- 172.21.15.53:0/1881160581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f68132700 0x7f2f68134af0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2f580097f0 tx=0x7f2f5802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759e0651dced563 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.140+0000 7f7f49ffb640 1 -- 172.21.15.53:0/4003318399 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2915530232 0 0) 0x7f7f34003520 con 0x7f7f4c12d2f0 2024-05-08T18:30:51.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.140+0000 7f7f49ffb640 1 -- 172.21.15.53:0/4003318399 >> v2:172.21.15.53:3300/0 conn(0x7f7f4c12dde0 msgr2=0x7f7f4c1328b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T18:30:51.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.140+0000 7f7f49ffb640 1 --2- 172.21.15.53:0/4003318399 >> v2:172.21.15.53:3300/0 conn(0x7f7f4c12dde0 0x7f7f4c1328b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.140+0000 7f7f49ffb640 1 -- 172.21.15.53:0/4003318399 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4c096db0 con 0x7f7f4c12d2f0 2024-05-08T18:30:51.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.140+0000 7f7f49ffb640 1 -- 172.21.15.53:0/4003318399 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1682549187 0 0) 0x7f7f3c0015a0 con 0x7f7f4c12d2f0 2024-05-08T18:30:51.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.140+0000 7f7f49ffb640 1 -- 172.21.15.53:0/4003318399 >> v1:172.21.15.53:6789/0 conn(0x7f7f4c12d2f0 legacy=0x7f7f4c12d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.140+0000 7f7f49ffb640 1 --2- 172.21.15.53:0/4003318399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f34003a00 0x7f7f34003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.140+0000 7f7f49ffb640 1 -- 172.21.15.53:0/4003318399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c097b50 con 0x7f7f34003a00 2024-05-08T18:30:51.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.141+0000 7f5091d2e640 1 --2- 172.21.15.53:0/3211056415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f508c06fe20 0x7f508c128e50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5088009720 tx=0x7f508802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89b98407be6d54a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.141+0000 7f7f4affd640 1 --2- 172.21.15.53:0/4003318399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f34003a00 0x7f7f34003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.141+0000 7f2f6cf61640 1 -- 172.21.15.53:0/1881160581 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f58035020 con 0x7f2f68132700 2024-05-08T18:30:51.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.141+0000 7f2f6cf61640 1 -- 172.21.15.53:0/1881160581 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f580317a0 con 0x7f2f68132700 2024-05-08T18:30:51.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.141+0000 7f2f6cf61640 1 -- 172.21.15.53:0/1881160581 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f58031aa0 con 0x7f2f68132700 2024-05-08T18:30:51.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.141+0000 7f5090d2c640 1 -- 172.21.15.53:0/3211056415 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50880316d0 con 0x7f508c06fe20 2024-05-08T18:30:51.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.141+0000 7f5090d2c640 1 -- 172.21.15.53:0/3211056415 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5088037070 con 0x7f508c06fe20 2024-05-08T18:30:51.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.141+0000 7f5090d2c640 1 -- 172.21.15.53:0/3211056415 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50880319c0 con 0x7f508c06fe20 2024-05-08T18:30:51.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.141+0000 7f7f4affd640 1 -- 172.21.15.53:0/4003318399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f34003520 con 0x7f7f34003a00 2024-05-08T18:30:51.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.141+0000 7f4271e1f640 1 --2- 172.21.15.53:0/1435508000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c070850 0x7f426c070c30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42680097f0 tx=0x7f426802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c4a07330f3f592 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.141+0000 7f4270e1d640 1 -- 172.21.15.53:0/1435508000 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4268035020 con 0x7f426c070850 2024-05-08T18:30:51.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.141+0000 7f4270e1d640 1 -- 172.21.15.53:0/1435508000 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42680317a0 con 0x7f426c070850 2024-05-08T18:30:51.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.141+0000 7f4270e1d640 1 -- 172.21.15.53:0/1435508000 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4268031aa0 con 0x7f426c070850 2024-05-08T18:30:51.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.141+0000 7f2f701c7640 1 -- 172.21.15.53:0/1881160581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f68132700 msgr2=0x7f2f68134af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.141+0000 7f2f701c7640 1 --2- 172.21.15.53:0/1881160581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f68132700 0x7f2f68134af0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2f580097f0 tx=0x7f2f5802b910 comp rx=0 tx=0).stop 2024-05-08T18:30:51.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.142+0000 7f2f701c7640 1 -- 172.21.15.53:0/1881160581 shutdown_connections 2024-05-08T18:30:51.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.142+0000 7f2f701c7640 1 --2- 172.21.15.53:0/1881160581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f68132700 0x7f2f68134af0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.142+0000 7f2f701c7640 1 -- 172.21.15.53:0/1881160581 >> 172.21.15.53:0/1881160581 conn(0x7f2f6809a910 msgr2=0x7f2f6806e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:51.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.142+0000 7f2f701c7640 1 -- 172.21.15.53:0/1881160581 shutdown_connections 2024-05-08T18:30:51.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.142+0000 7f2f701c7640 1 -- 172.21.15.53:0/1881160581 wait complete. 2024-05-08T18:30:51.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.142+0000 7f5093f92640 1 -- 172.21.15.53:0/3211056415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f508c06fe20 msgr2=0x7f508c128e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.142+0000 7f5093f92640 1 --2- 172.21.15.53:0/3211056415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f508c06fe20 0x7f508c128e50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5088009720 tx=0x7f508802b840 comp rx=0 tx=0).stop 2024-05-08T18:30:51.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.142+0000 7f5093f92640 1 -- 172.21.15.53:0/3211056415 shutdown_connections 2024-05-08T18:30:51.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.142+0000 7f5093f92640 1 --2- 172.21.15.53:0/3211056415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f508c06fe20 0x7f508c128e50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.142+0000 7f5093f92640 1 -- 172.21.15.53:0/3211056415 >> 172.21.15.53:0/3211056415 conn(0x7f508c09a910 msgr2=0x7f508c06e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:51.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.142+0000 7f7f4affd640 1 --2- 172.21.15.53:0/4003318399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f34003a00 0x7f7f34003e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c007f10 tx=0x7f7f34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a4d6f507a5d79f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.142+0000 7f5093f92640 1 -- 172.21.15.53:0/3211056415 shutdown_connections 2024-05-08T18:30:51.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.142+0000 7f5093f92640 1 -- 172.21.15.53:0/3211056415 wait complete. 2024-05-08T18:30:51.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.142+0000 7f4274083640 1 -- 172.21.15.53:0/1435508000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c070850 msgr2=0x7f426c070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.142+0000 7f4274083640 1 --2- 172.21.15.53:0/1435508000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c070850 0x7f426c070c30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42680097f0 tx=0x7f426802b910 comp rx=0 tx=0).stop 2024-05-08T18:30:51.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.142+0000 7f7f49ffb640 1 -- 172.21.15.53:0/4003318399 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c007be0 con 0x7f7f34003a00 2024-05-08T18:30:51.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.142+0000 7f2f701c7640 1 Processor -- start 2024-05-08T18:30:51.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f4274083640 1 -- 172.21.15.53:0/1435508000 shutdown_connections 2024-05-08T18:30:51.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f4274083640 1 --2- 172.21.15.53:0/1435508000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c070850 0x7f426c070c30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f4274083640 1 -- 172.21.15.53:0/1435508000 >> 172.21.15.53:0/1435508000 conn(0x7f426c09ff90 msgr2=0x7f426c0a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:51.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f7f49ffb640 1 -- 172.21.15.53:0/4003318399 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3c030070 con 0x7f7f34003a00 2024-05-08T18:30:51.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f7f49ffb640 1 -- 172.21.15.53:0/4003318399 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c02cbd0 con 0x7f7f34003a00 2024-05-08T18:30:51.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f2f701c7640 1 -- start start 2024-05-08T18:30:51.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f2f701c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f68070000 0x7f2f68120150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f2f701c7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2f68070af0 con 0x7f2f68070000 2024-05-08T18:30:51.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f2f6df63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f68070000 0x7f2f68120150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f4274083640 1 -- 172.21.15.53:0/1435508000 shutdown_connections 2024-05-08T18:30:51.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f4274083640 1 -- 172.21.15.53:0/1435508000 wait complete. 2024-05-08T18:30:51.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f2f6df63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f68070000 0x7f2f68120150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36388/0 (socket says 172.21.15.53:36388) 2024-05-08T18:30:51.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f2f6df63640 1 -- 172.21.15.53:0/3426186382 learned_addr learned my addr 172.21.15.53:0/3426186382 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:51.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f5093f92640 1 Processor -- start 2024-05-08T18:30:51.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f5093f92640 1 -- start start 2024-05-08T18:30:51.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f2f6df63640 1 -- 172.21.15.53:0/3426186382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f681232b0 con 0x7f2f68070000 2024-05-08T18:30:51.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f7f5193f640 1 -- 172.21.15.53:0/4003318399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f34003a00 msgr2=0x7f7f34003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.143+0000 7f7f5193f640 1 --2- 172.21.15.53:0/4003318399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f34003a00 0x7f7f34003e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c007f10 tx=0x7f7f34005830 comp rx=0 tx=0).stop 2024-05-08T18:30:51.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f7f5193f640 1 -- 172.21.15.53:0/4003318399 shutdown_connections 2024-05-08T18:30:51.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f7f5193f640 1 --2- 172.21.15.53:0/4003318399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f34003a00 0x7f7f34003e00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f7f5193f640 1 --2- 172.21.15.53:0/4003318399 >> v2:172.21.15.53:3300/0 conn(0x7f7f4c12dde0 0x7f7f4c1328b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f7f5193f640 1 -- 172.21.15.53:0/4003318399 >> 172.21.15.53:0/4003318399 conn(0x7f7f4c09e150 msgr2=0x7f7f4c09e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:51.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f7f5193f640 1 -- 172.21.15.53:0/4003318399 shutdown_connections 2024-05-08T18:30:51.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f2f6df63640 1 --2- 172.21.15.53:0/3426186382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f68070000 0x7f2f68120150 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400c380 tx=0x7f2f6400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f7f5193f640 1 -- 172.21.15.53:0/4003318399 wait complete. 2024-05-08T18:30:51.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f2f5e7fc640 1 -- 172.21.15.53:0/3426186382 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f64005200 con 0x7f2f68070000 2024-05-08T18:30:51.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f2f701c7640 1 -- 172.21.15.53:0/3426186382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f68122680 con 0x7f2f68070000 2024-05-08T18:30:51.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f2f701c7640 1 -- 172.21.15.53:0/3426186382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f68122e00 con 0x7f2f68070000 2024-05-08T18:30:51.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f5093f92640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f508c06fe20 0x7f508c115770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f2f5e7fc640 1 -- 172.21.15.53:0/3426186382 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f640053a0 con 0x7f2f68070000 2024-05-08T18:30:51.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f4274083640 1 Processor -- start 2024-05-08T18:30:51.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f5093f92640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f508c1299a0 con 0x7f508c06fe20 2024-05-08T18:30:51.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f5091d2e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f508c06fe20 0x7f508c115770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f5091d2e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f508c06fe20 0x7f508c115770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36390/0 (socket says 172.21.15.53:36390) 2024-05-08T18:30:51.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f5091d2e640 1 -- 172.21.15.53:0/3813259567 learned_addr learned my addr 172.21.15.53:0/3813259567 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:51.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.145+0000 7f7f5193f640 1 Processor -- start 2024-05-08T18:30:51.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.144+0000 7f2f5e7fc640 1 -- 172.21.15.53:0/3426186382 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f64020060 con 0x7f2f68070000 2024-05-08T18:30:51.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.145+0000 7f4274083640 1 -- start start 2024-05-08T18:30:51.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.145+0000 7f7f5193f640 1 -- start start 2024-05-08T18:30:51.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.145+0000 7f2f701c7640 1 -- 172.21.15.53:0/3426186382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2f50000f80 con 0x7f2f68070000 2024-05-08T18:30:51.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.145+0000 7f5091d2e640 1 -- 172.21.15.53:0/3813259567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508c117520 con 0x7f508c06fe20 2024-05-08T18:30:51.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.145+0000 7f2f5e7fc640 1 -- 172.21.15.53:0/3426186382 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2f64006900 con 0x7f2f68070000 2024-05-08T18:30:51.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.145+0000 7f5091d2e640 1 --2- 172.21.15.53:0/3813259567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f508c06fe20 0x7f508c115770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5088034040 tx=0x7f50880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f4274083640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c070850 0x7f426c123720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f4274083640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f426c0715c0 con 0x7f426c070850 2024-05-08T18:30:51.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f2f5e7fc640 1 --2- 172.21.15.53:0/3426186382 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2f4c03d260 0x7f2f4c03f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f2f5e7fc640 1 -- 172.21.15.53:0/3426186382 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f2f64050820 con 0x7f2f68070000 2024-05-08T18:30:51.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f7f5193f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f34003a00 0x7f7f4c1bf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f7f5193f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c0974e0 con 0x7f7f34003a00 2024-05-08T18:30:51.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f2f5e7fc640 1 --2- 172.21.15.53:0/3426186382 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2f4c0429e0 0x7f2f4c044e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f50827fc640 1 -- 172.21.15.53:0/3813259567 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5088032770 con 0x7f508c06fe20 2024-05-08T18:30:51.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f4271e1f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c070850 0x7f426c123720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f4271e1f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c070850 0x7f426c123720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36396/0 (socket says 172.21.15.53:36396) 2024-05-08T18:30:51.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f4271e1f640 1 -- 172.21.15.53:0/3311181883 learned_addr learned my addr 172.21.15.53:0/3311181883 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:51.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f7f4affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f34003a00 0x7f7f4c1bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f7f4affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f34003a00 0x7f7f4c1bf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36404/0 (socket says 172.21.15.53:36404) 2024-05-08T18:30:51.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f7f4affd640 1 -- 172.21.15.53:0/4133969645 learned_addr learned my addr 172.21.15.53:0/4133969645 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:51.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f2f5e7fc640 1 -- 172.21.15.53:0/3426186382 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f64009e50 con 0x7f2f4c0429e0 2024-05-08T18:30:51.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f2f5e7fc640 1 -- 172.21.15.53:0/3426186382 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f2f640552a0 con 0x7f2f68070000 2024-05-08T18:30:51.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f2f6d762640 1 --2- 172.21.15.53:0/3426186382 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2f4c03d260 0x7f2f4c03f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f2f6e764640 1 --2- 172.21.15.53:0/3426186382 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2f4c0429e0 0x7f2f4c044e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f50827fc640 1 -- 172.21.15.53:0/3813259567 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5088032910 con 0x7f508c06fe20 2024-05-08T18:30:51.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f50827fc640 1 -- 172.21.15.53:0/3813259567 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5088032c30 con 0x7f508c06fe20 2024-05-08T18:30:51.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f5093f92640 1 -- 172.21.15.53:0/3813259567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508c122e40 con 0x7f508c06fe20 2024-05-08T18:30:51.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f5093f92640 1 -- 172.21.15.53:0/3813259567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f508c115cb0 con 0x7f508c06fe20 2024-05-08T18:30:51.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f7f4affd640 1 -- 172.21.15.53:0/4133969645 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4c127b10 con 0x7f7f34003a00 2024-05-08T18:30:51.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.146+0000 7f4271e1f640 1 -- 172.21.15.53:0/3311181883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426c12b8d0 con 0x7f426c070850 2024-05-08T18:30:51.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f2f6d762640 1 --2- 172.21.15.53:0/3426186382 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2f4c03d260 0x7f2f4c03f720 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2f58036000 tx=0x7f2f58008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f2f6e764640 1 --2- 172.21.15.53:0/3426186382 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2f4c0429e0 0x7f2f4c044e20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f7f4affd640 1 --2- 172.21.15.53:0/4133969645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f34003a00 0x7f7f4c1bf600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c007f10 tx=0x7f7f3c0018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f4271e1f640 1 --2- 172.21.15.53:0/3311181883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c070850 0x7f426c123720 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f42680097f0 tx=0x7f42680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f5093f92640 1 -- 172.21.15.53:0/3813259567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f508c064010 con 0x7f508c06fe20 2024-05-08T18:30:51.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f50827fc640 1 -- 172.21.15.53:0/3813259567 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f508804c060 con 0x7f508c06fe20 2024-05-08T18:30:51.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f7f33fff640 1 -- 172.21.15.53:0/4133969645 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c045070 con 0x7f7f34003a00 2024-05-08T18:30:51.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f7f33fff640 1 -- 172.21.15.53:0/4133969645 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3c007bc0 con 0x7f7f34003a00 2024-05-08T18:30:51.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f425e7fc640 1 -- 172.21.15.53:0/3311181883 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4268040070 con 0x7f426c070850 2024-05-08T18:30:51.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f425e7fc640 1 -- 172.21.15.53:0/3311181883 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4268030c50 con 0x7f426c070850 2024-05-08T18:30:51.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f4274083640 1 -- 172.21.15.53:0/3311181883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f426c126830 con 0x7f426c070850 2024-05-08T18:30:51.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f425e7fc640 1 -- 172.21.15.53:0/3311181883 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4268035040 con 0x7f426c070850 2024-05-08T18:30:51.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f7f33fff640 1 -- 172.21.15.53:0/4133969645 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c004ca0 con 0x7f7f34003a00 2024-05-08T18:30:51.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f7f5193f640 1 -- 172.21.15.53:0/4133969645 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4c1297f0 con 0x7f7f34003a00 2024-05-08T18:30:51.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f7f5193f640 1 -- 172.21.15.53:0/4133969645 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f4c1bfb40 con 0x7f7f34003a00 2024-05-08T18:30:51.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f50827fc640 1 --2- 172.21.15.53:0/3813259567 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f507003d300 0x7f507003f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f50827fc640 1 -- 172.21.15.53:0/3813259567 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f508802f050 con 0x7f508c06fe20 2024-05-08T18:30:51.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.148+0000 7f50827fc640 1 --2- 172.21.15.53:0/3813259567 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x7f5070042a80 0x7f5070044ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.148+0000 7f509152d640 1 --2- 172.21.15.53:0/3813259567 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f507003d300 0x7f507003f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.148+0000 7f50827fc640 1 -- 172.21.15.53:0/3813259567 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f508803de50 con 0x7f5070042a80 2024-05-08T18:30:51.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.148+0000 7f50827fc640 1 -- 172.21.15.53:0/3813259567 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f50880752f0 con 0x7f508c06fe20 2024-05-08T18:30:51.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.148+0000 7f2f5e7fc640 1 -- 172.21.15.53:0/3426186382 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f64009e50 con 0x7f2f4c0429e0 2024-05-08T18:30:51.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.148+0000 7f509252f640 1 --2- 172.21.15.53:0/3813259567 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x7f5070042a80 0x7f5070044ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.147+0000 7f4274083640 1 -- 172.21.15.53:0/3311181883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f426c123c60 con 0x7f426c070850 2024-05-08T18:30:51.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.148+0000 7f7f5193f640 1 -- 172.21.15.53:0/4133969645 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7f4c128ba0 con 0x7f7f34003a00 2024-05-08T18:30:51.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.148+0000 7f4274083640 1 -- 172.21.15.53:0/3311181883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f426c12c480 con 0x7f426c070850 2024-05-08T18:30:51.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.148+0000 7f509152d640 1 --2- 172.21.15.53:0/3813259567 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f507003d300 0x7f507003f7c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f507c007fd0 tx=0x7f507c007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.149+0000 7f509252f640 1 --2- 172.21.15.53:0/3813259567 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x7f5070042a80 0x7f5070044ec0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.149+0000 7f425e7fc640 1 -- 172.21.15.53:0/3311181883 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f426804b060 con 0x7f426c070850 2024-05-08T18:30:51.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.149+0000 7f7f33fff640 1 -- 172.21.15.53:0/4133969645 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7f3c048070 con 0x7f7f34003a00 2024-05-08T18:30:51.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.149+0000 7f425e7fc640 1 --2- 172.21.15.53:0/3311181883 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f425003d300 0x7f425003f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.149+0000 7f425e7fc640 1 -- 172.21.15.53:0/3311181883 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f4268073080 con 0x7f426c070850 2024-05-08T18:30:51.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.149+0000 7f7f33fff640 1 --2- 172.21.15.53:0/4133969645 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7f3803d300 0x7f7f3803f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.149+0000 7f7f33fff640 1 -- 172.21.15.53:0/4133969645 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f7f3c03d070 con 0x7f7f34003a00 2024-05-08T18:30:51.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.149+0000 7f425e7fc640 1 --2- 172.21.15.53:0/3311181883 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4250042a80 0x7f4250044ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.150+0000 7f7f33fff640 1 --2- 172.21.15.53:0/4133969645 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x7f7f38042a80 0x7f7f38044ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.150+0000 7f50827fc640 1 -- 172.21.15.53:0/3813259567 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f508803de50 con 0x7f5070042a80 2024-05-08T18:30:51.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.149+0000 7f427161e640 1 --2- 172.21.15.53:0/3311181883 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f425003d300 0x7f425003f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.149+0000 7f425e7fc640 1 -- 172.21.15.53:0/3311181883 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f426803de50 con 0x7f4250042a80 2024-05-08T18:30:51.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.149+0000 7f425e7fc640 1 -- 172.21.15.53:0/3311181883 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f426807a050 con 0x7f426c070850 2024-05-08T18:30:51.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.150+0000 7f7f33fff640 1 -- 172.21.15.53:0/4133969645 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f3c043e70 con 0x7f7f38042a80 2024-05-08T18:30:51.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.150+0000 7f7f33fff640 1 -- 172.21.15.53:0/4133969645 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f7f3c079050 con 0x7f7f34003a00 2024-05-08T18:30:51.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.150+0000 7f7f4a7fc640 1 --2- 172.21.15.53:0/4133969645 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7f3803d300 0x7f7f3803f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.150+0000 7f4272620640 1 --2- 172.21.15.53:0/3311181883 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4250042a80 0x7f4250044ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.150+0000 7f7f4b7fe640 1 --2- 172.21.15.53:0/4133969645 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x7f7f38042a80 0x7f7f38044ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.150+0000 7f7f4a7fc640 1 --2- 172.21.15.53:0/4133969645 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7f3803d300 0x7f7f3803f7c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009910 tx=0x7f7f40009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.150+0000 7f427161e640 1 --2- 172.21.15.53:0/3311181883 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f425003d300 0x7f425003f7c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4260000f60 tx=0x7f4260007a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.150+0000 7f4272620640 1 --2- 172.21.15.53:0/3311181883 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4250042a80 0x7f4250044ec0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.150+0000 7f7f4b7fe640 1 --2- 172.21.15.53:0/4133969645 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x7f7f38042a80 0x7f7f38044ec0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.151+0000 7f425e7fc640 1 -- 172.21.15.53:0/3311181883 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f426803de50 con 0x7f4250042a80 2024-05-08T18:30:51.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.152+0000 7f7f33fff640 1 -- 172.21.15.53:0/4133969645 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7f3c043e70 con 0x7f7f38042a80 2024-05-08T18:30:51.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.163+0000 7f2f701c7640 1 -- 172.21.15.53:0/3426186382 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2f50002c70 con 0x7f2f4c0429e0 2024-05-08T18:30:51.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.164+0000 7f2f5e7fc640 1 -- 172.21.15.53:0/3426186382 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2f50002c70 con 0x7f2f4c0429e0 2024-05-08T18:30:51.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.164+0000 7f2f701c7640 1 -- 172.21.15.53:0/3426186382 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2f4c0429e0 msgr2=0x7f2f4c044e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.164+0000 7f2f701c7640 1 --2- 172.21.15.53:0/3426186382 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2f4c0429e0 0x7f2f4c044e20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.164+0000 7f5093f92640 1 -- 172.21.15.53:0/3813259567 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f508c129390 con 0x7f5070042a80 2024-05-08T18:30:51.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.164+0000 7f2f701c7640 1 -- 172.21.15.53:0/3426186382 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2f4c03d260 msgr2=0x7f2f4c03f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.164+0000 7f2f701c7640 1 --2- 172.21.15.53:0/3426186382 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2f4c03d260 0x7f2f4c03f720 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2f58036000 tx=0x7f2f58008030 comp rx=0 tx=0).stop 2024-05-08T18:30:51.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.164+0000 7f2f701c7640 1 -- 172.21.15.53:0/3426186382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f68070000 msgr2=0x7f2f68120150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.164+0000 7f2f701c7640 1 --2- 172.21.15.53:0/3426186382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f68070000 0x7f2f68120150 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400c380 tx=0x7f2f6400c840 comp rx=0 tx=0).stop 2024-05-08T18:30:51.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f2f701c7640 1 -- 172.21.15.53:0/3426186382 shutdown_connections 2024-05-08T18:30:51.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f2f701c7640 1 --2- 172.21.15.53:0/3426186382 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2f4c0429e0 0x7f2f4c044e20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f2f701c7640 1 --2- 172.21.15.53:0/3426186382 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2f4c03d260 0x7f2f4c03f720 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f2f701c7640 1 --2- 172.21.15.53:0/3426186382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f68070000 0x7f2f68120150 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f2f701c7640 1 -- 172.21.15.53:0/3426186382 >> 172.21.15.53:0/3426186382 conn(0x7f2f6809a910 msgr2=0x7f2f681b77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:51.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f2f701c7640 1 -- 172.21.15.53:0/3426186382 shutdown_connections 2024-05-08T18:30:51.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f50827fc640 1 -- 172.21.15.53:0/3813259567 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f508c129390 con 0x7f5070042a80 2024-05-08T18:30:51.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f2f701c7640 1 -- 172.21.15.53:0/3426186382 wait complete. 2024-05-08T18:30:51.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f5093f92640 1 -- 172.21.15.53:0/3813259567 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x7f5070042a80 msgr2=0x7f5070044ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f5093f92640 1 --2- 172.21.15.53:0/3813259567 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x7f5070042a80 0x7f5070044ec0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f5093f92640 1 -- 172.21.15.53:0/3813259567 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f507003d300 msgr2=0x7f507003f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f5093f92640 1 --2- 172.21.15.53:0/3813259567 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f507003d300 0x7f507003f7c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f507c007fd0 tx=0x7f507c007ac0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f5093f92640 1 -- 172.21.15.53:0/3813259567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f508c06fe20 msgr2=0x7f508c115770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f5093f92640 1 --2- 172.21.15.53:0/3813259567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f508c06fe20 0x7f508c115770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5088034040 tx=0x7f50880046c0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f5093f92640 1 -- 172.21.15.53:0/3813259567 shutdown_connections 2024-05-08T18:30:51.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f5093f92640 1 --2- 172.21.15.53:0/3813259567 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x7f5070042a80 0x7f5070044ec0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f5093f92640 1 --2- 172.21.15.53:0/3813259567 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f507003d300 0x7f507003f7c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f5093f92640 1 --2- 172.21.15.53:0/3813259567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f508c06fe20 0x7f508c115770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f5093f92640 1 -- 172.21.15.53:0/3813259567 >> 172.21.15.53:0/3813259567 conn(0x7f508c09a910 msgr2=0x7f508c09c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:51.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f5093f92640 1 -- 172.21.15.53:0/3813259567 shutdown_connections 2024-05-08T18:30:51.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.165+0000 7f5093f92640 1 -- 172.21.15.53:0/3813259567 wait complete. 2024-05-08T18:30:51.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.166+0000 7f4274083640 1 -- 172.21.15.53:0/3311181883 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f426c064010 con 0x7f4250042a80 2024-05-08T18:30:51.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.167+0000 7f425e7fc640 1 -- 172.21.15.53:0/3311181883 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f426c064010 con 0x7f4250042a80 2024-05-08T18:30:51.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.167+0000 7f7f5193f640 1 -- 172.21.15.53:0/4133969645 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7f4c064010 con 0x7f7f38042a80 2024-05-08T18:30:51.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.167+0000 7f4274083640 1 -- 172.21.15.53:0/3311181883 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4250042a80 msgr2=0x7f4250044ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.167+0000 7f4274083640 1 --2- 172.21.15.53:0/3311181883 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4250042a80 0x7f4250044ec0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.167+0000 7f7f33fff640 1 -- 172.21.15.53:0/4133969645 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7f4c064010 con 0x7f7f38042a80 2024-05-08T18:30:51.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.167+0000 7f4274083640 1 -- 172.21.15.53:0/3311181883 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f425003d300 msgr2=0x7f425003f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.167+0000 7f4274083640 1 --2- 172.21.15.53:0/3311181883 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f425003d300 0x7f425003f7c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4260000f60 tx=0x7f4260007a30 comp rx=0 tx=0).stop 2024-05-08T18:30:51.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.167+0000 7f4274083640 1 -- 172.21.15.53:0/3311181883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c070850 msgr2=0x7f426c123720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.167+0000 7f4274083640 1 --2- 172.21.15.53:0/3311181883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c070850 0x7f426c123720 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f42680097f0 tx=0x7f42680046c0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.167+0000 7f4274083640 1 -- 172.21.15.53:0/3311181883 shutdown_connections 2024-05-08T18:30:51.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.167+0000 7f4274083640 1 --2- 172.21.15.53:0/3311181883 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4250042a80 0x7f4250044ec0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.167+0000 7f4274083640 1 --2- 172.21.15.53:0/3311181883 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f425003d300 0x7f425003f7c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.167+0000 7f4274083640 1 --2- 172.21.15.53:0/3311181883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c070850 0x7f426c123720 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.167+0000 7f4274083640 1 -- 172.21.15.53:0/3311181883 >> 172.21.15.53:0/3311181883 conn(0x7f426c09ff90 msgr2=0x7f426c06f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:51.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.168+0000 7f7f5193f640 1 -- 172.21.15.53:0/4133969645 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x7f7f38042a80 msgr2=0x7f7f38044ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.168+0000 7f7f5193f640 1 --2- 172.21.15.53:0/4133969645 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x7f7f38042a80 0x7f7f38044ec0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.168+0000 7f4274083640 1 -- 172.21.15.53:0/3311181883 shutdown_connections 2024-05-08T18:30:51.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.168+0000 7f4274083640 1 -- 172.21.15.53:0/3311181883 wait complete. 2024-05-08T18:30:51.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.168+0000 7f7f5193f640 1 -- 172.21.15.53:0/4133969645 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7f3803d300 msgr2=0x7f7f3803f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.168+0000 7f7f5193f640 1 --2- 172.21.15.53:0/4133969645 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7f3803d300 0x7f7f3803f7c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009910 tx=0x7f7f40009190 comp rx=0 tx=0).stop 2024-05-08T18:30:51.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.168+0000 7f7f5193f640 1 -- 172.21.15.53:0/4133969645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f34003a00 msgr2=0x7f7f4c1bf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.168+0000 7f7f5193f640 1 --2- 172.21.15.53:0/4133969645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f34003a00 0x7f7f4c1bf600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c007f10 tx=0x7f7f3c0018a0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.168+0000 7f7f5193f640 1 -- 172.21.15.53:0/4133969645 shutdown_connections 2024-05-08T18:30:51.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.168+0000 7f7f5193f640 1 --2- 172.21.15.53:0/4133969645 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x7f7f38042a80 0x7f7f38044ec0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.168+0000 7f7f5193f640 1 --2- 172.21.15.53:0/4133969645 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7f3803d300 0x7f7f3803f7c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.168+0000 7f7f5193f640 1 --2- 172.21.15.53:0/4133969645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f34003a00 0x7f7f4c1bf600 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.168+0000 7f7f5193f640 1 -- 172.21.15.53:0/4133969645 >> 172.21.15.53:0/4133969645 conn(0x7f7f4c09e150 msgr2=0x7f7f4c12b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:51.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.168+0000 7f7f5193f640 1 -- 172.21.15.53:0/4133969645 shutdown_connections 2024-05-08T18:30:51.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.168+0000 7f7f5193f640 1 -- 172.21.15.53:0/4133969645 wait complete. 2024-05-08T18:30:51.193 INFO:teuthology.orchestra.run.smithi053.stdout:38654705666 2024-05-08T18:30:51.194 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T18:30:51.194 INFO:teuthology.orchestra.run.smithi053.stdout:38654705667 2024-05-08T18:30:51.195 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T18:30:51.196 INFO:teuthology.orchestra.run.smithi053.stdout:38654705668 2024-05-08T18:30:51.196 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T18:30:51.197 INFO:teuthology.orchestra.run.smithi053.stdout:38654705667 2024-05-08T18:30:51.197 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T18:30:51.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.343+0000 7f257b8c3640 1 Processor -- start 2024-05-08T18:30:51.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.343+0000 7f5020975640 1 Processor -- start 2024-05-08T18:30:51.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.344+0000 7f9b9e1e8640 1 Processor -- start 2024-05-08T18:30:51.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.344+0000 7f5020975640 1 -- start start 2024-05-08T18:30:51.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.344+0000 7f257b8c3640 1 -- start start 2024-05-08T18:30:51.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.344+0000 7f9b9e1e8640 1 -- start start 2024-05-08T18:30:51.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.344+0000 7f53559c0640 1 Processor -- start 2024-05-08T18:30:51.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.344+0000 7f9b9e1e8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9b9812c7f0 0x7f9b9812cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.344+0000 7f53559c0640 1 -- start start 2024-05-08T18:30:51.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.344+0000 7f9b9e1e8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b980a23e0 con 0x7f9b98070850 2024-05-08T18:30:51.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.344+0000 7f9b9e1e8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f9b98072fc0 con 0x7f9b9812c7f0 2024-05-08T18:30:51.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.344+0000 7f257b8c3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f257412d1e0 0x7f257412d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.344+0000 7f257b8c3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25740712a0 con 0x7f257412dc40 2024-05-08T18:30:51.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.344+0000 7f9b977fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9b9812c7f0 0x7f9b9812cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.344+0000 7f257b8c3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f2574113ce0 con 0x7f257412d1e0 2024-05-08T18:30:51.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.344+0000 7f9b96ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9b98070850 0x7f9b98070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49766/0 (socket says 172.21.15.53:49766) 2024-05-08T18:30:51.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.344+0000 7f9b96ffd640 1 -- 172.21.15.53:0/2758266158 learned_addr learned my addr 172.21.15.53:0/2758266158 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:51.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.344+0000 7f5020975640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f501c12cd70 0x7f501c131480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.344+0000 7f257965f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f257412d1e0 0x7f257412d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f257965f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f257412d1e0 0x7f257412d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36428/0 (socket says 172.21.15.53:36428) 2024-05-08T18:30:51.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f257965f640 1 -- 172.21.15.53:0/1104755762 learned_addr learned my addr 172.21.15.53:0/1104755762 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:51.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f5020975640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f501c071720 con 0x7f501c12c140 2024-05-08T18:30:51.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f5020975640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f501c073b40 con 0x7f501c12cd70 2024-05-08T18:30:51.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f5019d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f501c12cd70 0x7f501c131480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f53559c0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f535012d330 0x7f535012d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f501a59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f501c12c140 0x7f501c12c660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49778/0 (socket says 172.21.15.53:49778) 2024-05-08T18:30:51.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f501a59c640 1 -- 172.21.15.53:0/3931580573 learned_addr learned my addr 172.21.15.53:0/3931580573 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:51.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f53559c0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5350072c90 con 0x7f535009b570 2024-05-08T18:30:51.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f53559c0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f53500739a0 con 0x7f535012d330 2024-05-08T18:30:51.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f9b967fc640 1 -- 172.21.15.53:0/2758266158 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1149036144 0 0) 0x7f9b980a23e0 con 0x7f9b98070850 2024-05-08T18:30:51.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f9b967fc640 1 -- 172.21.15.53:0/2758266158 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b80003520 con 0x7f9b98070850 2024-05-08T18:30:51.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f257965f640 1 -- 172.21.15.53:0/1104755762 >> v1:172.21.15.53:6789/0 conn(0x7f257412dc40 legacy=0x7f2574129c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T18:30:51.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f257965f640 1 -- 172.21.15.53:0/1104755762 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f257412e020 con 0x7f257412d1e0 2024-05-08T18:30:51.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f534e7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f535009b570 0x7f535012a080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49782/0 (socket says 172.21.15.53:49782) 2024-05-08T18:30:51.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f534e7fc640 1 -- 172.21.15.53:0/941385470 learned_addr learned my addr 172.21.15.53:0/941385470 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:51.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f9b967fc640 1 -- 172.21.15.53:0/2758266158 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2625487141 0 0) 0x7f9b80003520 con 0x7f9b98070850 2024-05-08T18:30:51.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f9b967fc640 1 -- 172.21.15.53:0/2758266158 >> v2:172.21.15.53:3300/0 conn(0x7f9b9812c7f0 msgr2=0x7f9b9812cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T18:30:51.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f5019d9b640 1 -- 172.21.15.53:0/3931580573 >> v1:172.21.15.53:6789/0 conn(0x7f501c12c140 legacy=0x7f501c12c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f5019d9b640 1 -- 172.21.15.53:0/3931580573 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501c071e90 con 0x7f501c12cd70 2024-05-08T18:30:51.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f9b967fc640 1 --2- 172.21.15.53:0/2758266158 >> v2:172.21.15.53:3300/0 conn(0x7f9b9812c7f0 0x7f9b9812cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f9b967fc640 1 -- 172.21.15.53:0/2758266158 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b98071f80 con 0x7f9b98070850 2024-05-08T18:30:51.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f9b967fc640 1 -- 172.21.15.53:0/2758266158 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1682549187 0 0) 0x7f9b8c0015a0 con 0x7f9b98070850 2024-05-08T18:30:51.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f9b967fc640 1 -- 172.21.15.53:0/2758266158 >> v1:172.21.15.53:6789/0 conn(0x7f9b98070850 legacy=0x7f9b98070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f9b967fc640 1 --2- 172.21.15.53:0/2758266158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b800039b0 0x7f9b80003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f9b967fc640 1 -- 172.21.15.53:0/2758266158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9b98072fc0 con 0x7f9b800039b0 2024-05-08T18:30:51.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f534effd640 1 --2- 172.21.15.53:0/941385470 >> v2:172.21.15.53:3300/0 conn(0x7f535012d330 0x7f535012d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f534dffb640 1 -- 172.21.15.53:0/941385470 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2929785992 0 0) 0x7f5344001110 con 0x7f535009b570 2024-05-08T18:30:51.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.345+0000 7f534dffb640 1 -- 172.21.15.53:0/941385470 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5338003520 con 0x7f535009b570 2024-05-08T18:30:51.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.346+0000 7f9b977fe640 1 --2- 172.21.15.53:0/2758266158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b800039b0 0x7f9b80003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.346+0000 7f534dffb640 1 -- 172.21.15.53:0/941385470 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3375364013 0 0) 0x7f5338003520 con 0x7f535009b570 2024-05-08T18:30:51.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.346+0000 7f534dffb640 1 -- 172.21.15.53:0/941385470 >> v2:172.21.15.53:3300/0 conn(0x7f535012d330 msgr2=0x7f535012d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T18:30:51.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.346+0000 7f534dffb640 1 --2- 172.21.15.53:0/941385470 >> v2:172.21.15.53:3300/0 conn(0x7f535012d330 0x7f535012d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.346+0000 7f534dffb640 1 -- 172.21.15.53:0/941385470 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5350072620 con 0x7f535009b570 2024-05-08T18:30:51.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.346+0000 7f534dffb640 1 -- 172.21.15.53:0/941385470 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1682549187 0 0) 0x7f5344001770 con 0x7f535009b570 2024-05-08T18:30:51.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.346+0000 7f534dffb640 1 -- 172.21.15.53:0/941385470 >> v1:172.21.15.53:6789/0 conn(0x7f535009b570 legacy=0x7f535012a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.346+0000 7f534dffb640 1 --2- 172.21.15.53:0/941385470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5338003a30 0x7f5338003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.346+0000 7f534dffb640 1 -- 172.21.15.53:0/941385470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f53380044f0 con 0x7f5338003a30 2024-05-08T18:30:51.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.346+0000 7f9b977fe640 1 -- 172.21.15.53:0/2758266158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b98071f80 con 0x7f9b800039b0 2024-05-08T18:30:51.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.346+0000 7f534effd640 1 --2- 172.21.15.53:0/941385470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5338003a30 0x7f5338003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.346+0000 7f257965f640 1 --2- 172.21.15.53:0/1104755762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f257412d1e0 0x7f257412d700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f25700097f0 tx=0x7f257002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47b632b2f6c6156 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.346+0000 7f534effd640 1 -- 172.21.15.53:0/941385470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5338003520 con 0x7f5338003a30 2024-05-08T18:30:51.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.346+0000 7f5019d9b640 1 --2- 172.21.15.53:0/3931580573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c12cd70 0x7f501c131480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5010009720 tx=0x7f501002dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5f5364d13c3eee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.347+0000 7f256bfff640 1 -- 172.21.15.53:0/1104755762 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2570035020 con 0x7f257412d1e0 2024-05-08T18:30:51.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.347+0000 7f256bfff640 1 -- 172.21.15.53:0/1104755762 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25700317a0 con 0x7f257412d1e0 2024-05-08T18:30:51.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.347+0000 7f256bfff640 1 -- 172.21.15.53:0/1104755762 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2570035020 con 0x7f257412d1e0 2024-05-08T18:30:51.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.347+0000 7f501959a640 1 -- 172.21.15.53:0/3931580573 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f501002f7d0 con 0x7f501c12cd70 2024-05-08T18:30:51.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.347+0000 7f501959a640 1 -- 172.21.15.53:0/3931580573 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f501002f970 con 0x7f501c12cd70 2024-05-08T18:30:51.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.347+0000 7f501959a640 1 -- 172.21.15.53:0/3931580573 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f501002fc70 con 0x7f501c12cd70 2024-05-08T18:30:51.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.347+0000 7f9b977fe640 1 --2- 172.21.15.53:0/2758266158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b800039b0 0x7f9b80003db0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b88009a20 tx=0x7f9b80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f39f056acc86d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.347+0000 7f257b8c3640 1 -- 172.21.15.53:0/1104755762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f257412d1e0 msgr2=0x7f257412d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.347+0000 7f257b8c3640 1 --2- 172.21.15.53:0/1104755762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f257412d1e0 0x7f257412d700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f25700097f0 tx=0x7f257002b910 comp rx=0 tx=0).stop 2024-05-08T18:30:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.347+0000 7f5020975640 1 -- 172.21.15.53:0/3931580573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c12cd70 msgr2=0x7f501c131480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.347+0000 7f5020975640 1 --2- 172.21.15.53:0/3931580573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c12cd70 0x7f501c131480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5010009720 tx=0x7f501002dae0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.347+0000 7f257b8c3640 1 -- 172.21.15.53:0/1104755762 shutdown_connections 2024-05-08T18:30:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.347+0000 7f257b8c3640 1 --2- 172.21.15.53:0/1104755762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f257412d1e0 0x7f257412d700 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.347+0000 7f257b8c3640 1 -- 172.21.15.53:0/1104755762 >> 172.21.15.53:0/1104755762 conn(0x7f257409a910 msgr2=0x7f257406e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:51.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.348+0000 7f5020975640 1 -- 172.21.15.53:0/3931580573 shutdown_connections 2024-05-08T18:30:51.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.348+0000 7f9b967fc640 1 -- 172.21.15.53:0/2758266158 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b88039070 con 0x7f9b800039b0 2024-05-08T18:30:51.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.348+0000 7f5020975640 1 --2- 172.21.15.53:0/3931580573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c12cd70 0x7f501c131480 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.348+0000 7f5020975640 1 -- 172.21.15.53:0/3931580573 >> 172.21.15.53:0/3931580573 conn(0x7f501c09e9b0 msgr2=0x7f501c09edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:51.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.348+0000 7f9b967fc640 1 -- 172.21.15.53:0/2758266158 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8802c9a0 con 0x7f9b800039b0 2024-05-08T18:30:51.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.348+0000 7f5020975640 1 -- 172.21.15.53:0/3931580573 shutdown_connections 2024-05-08T18:30:51.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.348+0000 7f534effd640 1 --2- 172.21.15.53:0/941385470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5338003a30 0x7f5338003e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5340009a40 tx=0x7f5338005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95db3e08825b251 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.348+0000 7f5020975640 1 -- 172.21.15.53:0/3931580573 wait complete. 2024-05-08T18:30:51.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.348+0000 7f257b8c3640 1 -- 172.21.15.53:0/1104755762 shutdown_connections 2024-05-08T18:30:51.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.348+0000 7f9b967fc640 1 -- 172.21.15.53:0/2758266158 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b88039070 con 0x7f9b800039b0 2024-05-08T18:30:51.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.348+0000 7f257b8c3640 1 -- 172.21.15.53:0/1104755762 wait complete. 2024-05-08T18:30:51.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.348+0000 7f534dffb640 1 -- 172.21.15.53:0/941385470 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5340039070 con 0x7f5338003a30 2024-05-08T18:30:51.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.348+0000 7f534dffb640 1 -- 172.21.15.53:0/941385470 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f534002c9a0 con 0x7f5338003a30 2024-05-08T18:30:51.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.348+0000 7f534dffb640 1 -- 172.21.15.53:0/941385470 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5340009690 con 0x7f5338003a30 2024-05-08T18:30:51.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.348+0000 7f9b9e1e8640 1 -- 172.21.15.53:0/2758266158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b800039b0 msgr2=0x7f9b80003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.348+0000 7f9b9e1e8640 1 --2- 172.21.15.53:0/2758266158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b800039b0 0x7f9b80003db0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b88009a20 tx=0x7f9b80005830 comp rx=0 tx=0).stop 2024-05-08T18:30:51.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f9b9e1e8640 1 -- 172.21.15.53:0/2758266158 shutdown_connections 2024-05-08T18:30:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f9b9e1e8640 1 --2- 172.21.15.53:0/2758266158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b800039b0 0x7f9b80003db0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f9b9e1e8640 1 --2- 172.21.15.53:0/2758266158 >> v2:172.21.15.53:3300/0 conn(0x7f9b9812c7f0 0x7f9b9812cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f9b9e1e8640 1 -- 172.21.15.53:0/2758266158 >> 172.21.15.53:0/2758266158 conn(0x7f9b9809ff90 msgr2=0x7f9b980a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f53559c0640 1 -- 172.21.15.53:0/941385470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5338003a30 msgr2=0x7f5338003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f53559c0640 1 --2- 172.21.15.53:0/941385470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5338003a30 0x7f5338003e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5340009a40 tx=0x7f5338005830 comp rx=0 tx=0).stop 2024-05-08T18:30:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f9b9e1e8640 1 -- 172.21.15.53:0/2758266158 shutdown_connections 2024-05-08T18:30:51.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f9b9e1e8640 1 -- 172.21.15.53:0/2758266158 wait complete. 2024-05-08T18:30:51.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f53559c0640 1 -- 172.21.15.53:0/941385470 shutdown_connections 2024-05-08T18:30:51.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f53559c0640 1 --2- 172.21.15.53:0/941385470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5338003a30 0x7f5338003e30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f53559c0640 1 --2- 172.21.15.53:0/941385470 >> v2:172.21.15.53:3300/0 conn(0x7f535012d330 0x7f535012d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f53559c0640 1 -- 172.21.15.53:0/941385470 >> 172.21.15.53:0/941385470 conn(0x7f535009c3f0 msgr2=0x7f535009c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:51.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f53559c0640 1 -- 172.21.15.53:0/941385470 shutdown_connections 2024-05-08T18:30:51.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f53559c0640 1 -- 172.21.15.53:0/941385470 wait complete. 2024-05-08T18:30:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f257b8c3640 1 Processor -- start 2024-05-08T18:30:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f5020975640 1 Processor -- start 2024-05-08T18:30:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f257b8c3640 1 -- start start 2024-05-08T18:30:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.349+0000 7f5020975640 1 -- start start 2024-05-08T18:30:51.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.350+0000 7f9b9e1e8640 1 Processor -- start 2024-05-08T18:30:51.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.350+0000 7f257b8c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f257412d1e0 0x7f25741bea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.350+0000 7f53559c0640 1 Processor -- start 2024-05-08T18:30:51.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.350+0000 7f257b8c3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2574114490 con 0x7f257412d1e0 2024-05-08T18:30:51.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.350+0000 7f9b9e1e8640 1 -- start start 2024-05-08T18:30:51.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.350+0000 7f257965f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f257412d1e0 0x7f25741bea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.350+0000 7f257965f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f257412d1e0 0x7f25741bea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36458/0 (socket says 172.21.15.53:36458) 2024-05-08T18:30:51.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.350+0000 7f257965f640 1 -- 172.21.15.53:0/3590763889 learned_addr learned my addr 172.21.15.53:0/3590763889 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:51.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.350+0000 7f5020975640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c12c140 0x7f501c127f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.350+0000 7f53559c0640 1 -- start start 2024-05-08T18:30:51.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.350+0000 7f5020975640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f501c06e0a0 con 0x7f501c12c140 2024-05-08T18:30:51.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.350+0000 7f9b9e1e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b800039b0 0x7f9b9808c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.350+0000 7f9b9e1e8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9b980713b0 con 0x7f9b800039b0 2024-05-08T18:30:51.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.350+0000 7f257965f640 1 -- 172.21.15.53:0/3590763889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2574116f20 con 0x7f257412d1e0 2024-05-08T18:30:51.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.350+0000 7f9b977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b800039b0 0x7f9b9808c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.350+0000 7f501a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c12c140 0x7f501c127f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.350+0000 7f9b977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b800039b0 0x7f9b9808c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36478/0 (socket says 172.21.15.53:36478) 2024-05-08T18:30:51.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f9b977fe640 1 -- 172.21.15.53:0/986109906 learned_addr learned my addr 172.21.15.53:0/986109906 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:51.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f501a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c12c140 0x7f501c127f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36474/0 (socket says 172.21.15.53:36474) 2024-05-08T18:30:51.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f501a59c640 1 -- 172.21.15.53:0/2712955874 learned_addr learned my addr 172.21.15.53:0/2712955874 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:51.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f53559c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5338003a30 0x7f535011b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f53559c0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f535012e020 con 0x7f5338003a30 2024-05-08T18:30:51.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f534effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5338003a30 0x7f535011b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f534effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5338003a30 0x7f535011b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36490/0 (socket says 172.21.15.53:36490) 2024-05-08T18:30:51.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f534effd640 1 -- 172.21.15.53:0/1842244936 learned_addr learned my addr 172.21.15.53:0/1842244936 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:51.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f257965f640 1 --2- 172.21.15.53:0/3590763889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f257412d1e0 0x7f25741bea40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f25700090b0 tx=0x7f25700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f9b977fe640 1 -- 172.21.15.53:0/986109906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b9808dfe0 con 0x7f9b800039b0 2024-05-08T18:30:51.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f501a59c640 1 -- 172.21.15.53:0/2712955874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501c129780 con 0x7f501c12c140 2024-05-08T18:30:51.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f9b977fe640 1 --2- 172.21.15.53:0/986109906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b800039b0 0x7f9b9808c550 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9b88037040 tx=0x7f9b88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f534effd640 1 -- 172.21.15.53:0/1842244936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535012adb0 con 0x7f5338003a30 2024-05-08T18:30:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f501a59c640 1 --2- 172.21.15.53:0/2712955874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c12c140 0x7f501c127f30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f500c00c4a0 tx=0x7f500c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f534effd640 1 --2- 172.21.15.53:0/1842244936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5338003a30 0x7f535011b140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5340037040 tx=0x7f5340004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f9b7ffff640 1 -- 172.21.15.53:0/986109906 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b88044020 con 0x7f9b800039b0 2024-05-08T18:30:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f2569ffb640 1 -- 172.21.15.53:0/3590763889 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2570003a10 con 0x7f257412d1e0 2024-05-08T18:30:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f2569ffb640 1 -- 172.21.15.53:0/3590763889 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2570003bb0 con 0x7f257412d1e0 2024-05-08T18:30:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f257b8c3640 1 -- 172.21.15.53:0/3590763889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2574126b70 con 0x7f257412d1e0 2024-05-08T18:30:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f2569ffb640 1 -- 172.21.15.53:0/3590763889 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2570046480 con 0x7f257412d1e0 2024-05-08T18:30:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.352+0000 7f9b7ffff640 1 -- 172.21.15.53:0/986109906 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b88034c70 con 0x7f9b800039b0 2024-05-08T18:30:51.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.351+0000 7f500affd640 1 -- 172.21.15.53:0/2712955874 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f500c017070 con 0x7f501c12c140 2024-05-08T18:30:51.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.352+0000 7f9b9e1e8640 1 -- 172.21.15.53:0/986109906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b9808e6d0 con 0x7f9b800039b0 2024-05-08T18:30:51.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.352+0000 7f500affd640 1 -- 172.21.15.53:0/2712955874 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f500c005c10 con 0x7f501c12c140 2024-05-08T18:30:51.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.352+0000 7f500affd640 1 -- 172.21.15.53:0/2712955874 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f500c007070 con 0x7f501c12c140 2024-05-08T18:30:51.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.352+0000 7f5020975640 1 -- 172.21.15.53:0/2712955874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f501c1b2f50 con 0x7f501c12c140 2024-05-08T18:30:51.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.352+0000 7f5337fff640 1 -- 172.21.15.53:0/1842244936 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5340042020 con 0x7f5338003a30 2024-05-08T18:30:51.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.352+0000 7f9b9e1e8640 1 -- 172.21.15.53:0/986109906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b98125d30 con 0x7f9b800039b0 2024-05-08T18:30:51.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.352+0000 7f5020975640 1 -- 172.21.15.53:0/2712955874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f501c08c870 con 0x7f501c12c140 2024-05-08T18:30:51.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.352+0000 7f53559c0640 1 -- 172.21.15.53:0/1842244936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f535011dc60 con 0x7f5338003a30 2024-05-08T18:30:51.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.352+0000 7f53559c0640 1 -- 172.21.15.53:0/1842244936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f535011b680 con 0x7f5338003a30 2024-05-08T18:30:51.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.352+0000 7f9b7ffff640 1 -- 172.21.15.53:0/986109906 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b88039040 con 0x7f9b800039b0 2024-05-08T18:30:51.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.352+0000 7f5337fff640 1 -- 172.21.15.53:0/1842244936 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f534003a040 con 0x7f5338003a30 2024-05-08T18:30:51.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.352+0000 7f5337fff640 1 -- 172.21.15.53:0/1842244936 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5340039070 con 0x7f5338003a30 2024-05-08T18:30:51.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.352+0000 7f257b8c3640 1 -- 172.21.15.53:0/3590763889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2574117ad0 con 0x7f257412d1e0 2024-05-08T18:30:51.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.353+0000 7f9b7ffff640 1 -- 172.21.15.53:0/986109906 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9b88047020 con 0x7f9b800039b0 2024-05-08T18:30:51.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.353+0000 7f257b8c3640 1 -- 172.21.15.53:0/3590763889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2574064010 con 0x7f257412d1e0 2024-05-08T18:30:51.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.353+0000 7f53559c0640 1 -- 172.21.15.53:0/1842244936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5330005080 con 0x7f5338003a30 2024-05-08T18:30:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.354+0000 7f9b9e1e8640 1 -- 172.21.15.53:0/986109906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b78005080 con 0x7f9b800039b0 2024-05-08T18:30:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.354+0000 7f5337fff640 1 -- 172.21.15.53:0/1842244936 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5340045020 con 0x7f5338003a30 2024-05-08T18:30:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.354+0000 7f2569ffb640 1 -- 172.21.15.53:0/3590763889 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2570038020 con 0x7f257412d1e0 2024-05-08T18:30:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.354+0000 7f9b7ffff640 1 --2- 172.21.15.53:0/986109906 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b8403d350 0x7f9b8403f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.354+0000 7f5337fff640 1 --2- 172.21.15.53:0/1842244936 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f533c03d300 0x7f533c03f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.354+0000 7f2569ffb640 1 --2- 172.21.15.53:0/3590763889 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f255803d2b0 0x7f255803f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.354+0000 7f9b7ffff640 1 -- 172.21.15.53:0/986109906 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f9b8800f040 con 0x7f9b800039b0 2024-05-08T18:30:51.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.354+0000 7f5337fff640 1 -- 172.21.15.53:0/1842244936 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f534000f040 con 0x7f5338003a30 2024-05-08T18:30:51.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.354+0000 7f2569ffb640 1 -- 172.21.15.53:0/3590763889 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f2570073c70 con 0x7f257412d1e0 2024-05-08T18:30:51.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.354+0000 7f2578e5e640 1 --2- 172.21.15.53:0/3590763889 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f255803d2b0 0x7f255803f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.354+0000 7f534e7fc640 1 --2- 172.21.15.53:0/1842244936 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f533c03d300 0x7f533c03f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.354+0000 7f9b96ffd640 1 --2- 172.21.15.53:0/986109906 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b8403d350 0x7f9b8403f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.354+0000 7f5020975640 1 -- 172.21.15.53:0/2712955874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f501c064010 con 0x7f501c12c140 2024-05-08T18:30:51.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.355+0000 7f500affd640 1 -- 172.21.15.53:0/2712955874 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f500c01a070 con 0x7f501c12c140 2024-05-08T18:30:51.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.355+0000 7f534e7fc640 1 --2- 172.21.15.53:0/1842244936 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f533c03d300 0x7f533c03f7c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5344000fd0 tx=0x7f53440011b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.355+0000 7f2578e5e640 1 --2- 172.21.15.53:0/3590763889 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f255803d2b0 0x7f255803f770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2564003cf0 tx=0x7f2564007a50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.355+0000 7f9b96ffd640 1 --2- 172.21.15.53:0/986109906 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b8403d350 0x7f9b8403f810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c007920 tx=0x7f9b8c000ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.355+0000 7f500affd640 1 --2- 172.21.15.53:0/2712955874 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4ffc03d300 0x7f4ffc03f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:51.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.355+0000 7f500affd640 1 -- 172.21.15.53:0/2712955874 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f500c050610 con 0x7f501c12c140 2024-05-08T18:30:51.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.355+0000 7f5019d9b640 1 --2- 172.21.15.53:0/2712955874 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4ffc03d300 0x7f4ffc03f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:51.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.356+0000 7f5019d9b640 1 --2- 172.21.15.53:0/2712955874 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4ffc03d300 0x7f4ffc03f7c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5010038000 tx=0x7f5010008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:51.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.359+0000 7f2569ffb640 1 -- 172.21.15.53:0/3590763889 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2570046e20 con 0x7f257412d1e0 2024-05-08T18:30:51.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.363+0000 7f5337fff640 1 -- 172.21.15.53:0/1842244936 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f534004c070 con 0x7f5338003a30 2024-05-08T18:30:51.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.368+0000 7f500affd640 1 -- 172.21.15.53:0/2712955874 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f501c1b2f50 con 0x7f501c12c140 2024-05-08T18:30:51.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.376+0000 7f9b7ffff640 1 -- 172.21.15.53:0/986109906 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9b8804e070 con 0x7f9b800039b0 2024-05-08T18:30:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.555+0000 7f53559c0640 1 -- 172.21.15.53:0/1842244936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5330005370 con 0x7f5338003a30 2024-05-08T18:30:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.555+0000 7f5337fff640 1 -- 172.21.15.53:0/1842244936 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5340032e00 con 0x7f5338003a30 2024-05-08T18:30:51.555 INFO:teuthology.orchestra.run.smithi053.stdout:38654705666 2024-05-08T18:30:51.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.558+0000 7f53559c0640 1 -- 172.21.15.53:0/1842244936 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f533c03d300 msgr2=0x7f533c03f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.558+0000 7f53559c0640 1 --2- 172.21.15.53:0/1842244936 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f533c03d300 0x7f533c03f7c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5344000fd0 tx=0x7f53440011b0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.558+0000 7f53559c0640 1 -- 172.21.15.53:0/1842244936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5338003a30 msgr2=0x7f535011b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.558+0000 7f53559c0640 1 --2- 172.21.15.53:0/1842244936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5338003a30 0x7f535011b140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5340037040 tx=0x7f5340004730 comp rx=0 tx=0).stop 2024-05-08T18:30:51.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.558+0000 7f53559c0640 1 -- 172.21.15.53:0/1842244936 shutdown_connections 2024-05-08T18:30:51.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.558+0000 7f53559c0640 1 --2- 172.21.15.53:0/1842244936 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f533c03d300 0x7f533c03f7c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.558+0000 7f53559c0640 1 --2- 172.21.15.53:0/1842244936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5338003a30 0x7f535011b140 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.558+0000 7f53559c0640 1 -- 172.21.15.53:0/1842244936 >> 172.21.15.53:0/1842244936 conn(0x7f535009c3f0 msgr2=0x7f53501b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:51.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.559+0000 7f53559c0640 1 -- 172.21.15.53:0/1842244936 shutdown_connections 2024-05-08T18:30:51.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.559+0000 7f53559c0640 1 -- 172.21.15.53:0/1842244936 wait complete. 2024-05-08T18:30:51.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.564+0000 7f5020975640 1 -- 172.21.15.53:0/2712955874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f501c0757f0 con 0x7f501c12c140 2024-05-08T18:30:51.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.565+0000 7f500affd640 1 -- 172.21.15.53:0/2712955874 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f500c019cd0 con 0x7f501c12c140 2024-05-08T18:30:51.564 INFO:teuthology.orchestra.run.smithi053.stdout:38654705667 2024-05-08T18:30:51.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.567+0000 7f5020975640 1 -- 172.21.15.53:0/2712955874 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4ffc03d300 msgr2=0x7f4ffc03f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.567+0000 7f5020975640 1 --2- 172.21.15.53:0/2712955874 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4ffc03d300 0x7f4ffc03f7c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5010038000 tx=0x7f5010008030 comp rx=0 tx=0).stop 2024-05-08T18:30:51.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.567+0000 7f5020975640 1 -- 172.21.15.53:0/2712955874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c12c140 msgr2=0x7f501c127f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.567+0000 7f5020975640 1 --2- 172.21.15.53:0/2712955874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c12c140 0x7f501c127f30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f500c00c4a0 tx=0x7f500c00c960 comp rx=0 tx=0).stop 2024-05-08T18:30:51.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.567+0000 7f5020975640 1 -- 172.21.15.53:0/2712955874 shutdown_connections 2024-05-08T18:30:51.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.567+0000 7f5020975640 1 --2- 172.21.15.53:0/2712955874 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4ffc03d300 0x7f4ffc03f7c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.567+0000 7f5020975640 1 --2- 172.21.15.53:0/2712955874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c12c140 0x7f501c127f30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.567+0000 7f5020975640 1 -- 172.21.15.53:0/2712955874 >> 172.21.15.53:0/2712955874 conn(0x7f501c09e9b0 msgr2=0x7f501c1b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:51.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.567+0000 7f5020975640 1 -- 172.21.15.53:0/2712955874 shutdown_connections 2024-05-08T18:30:51.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.567+0000 7f5020975640 1 -- 172.21.15.53:0/2712955874 wait complete. 2024-05-08T18:30:51.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.3 2024-05-08T18:30:51.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.2 2024-05-08T18:30:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.603+0000 7f257b8c3640 1 -- 172.21.15.53:0/3590763889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2574075170 con 0x7f257412d1e0 2024-05-08T18:30:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.603+0000 7f2569ffb640 1 -- 172.21.15.53:0/3590763889 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2570039dc0 con 0x7f257412d1e0 2024-05-08T18:30:51.602 INFO:teuthology.orchestra.run.smithi053.stdout:38654705665 2024-05-08T18:30:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.606+0000 7f257b8c3640 1 -- 172.21.15.53:0/3590763889 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f255803d2b0 msgr2=0x7f255803f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.606+0000 7f257b8c3640 1 --2- 172.21.15.53:0/3590763889 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f255803d2b0 0x7f255803f770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2564003cf0 tx=0x7f2564007a50 comp rx=0 tx=0).stop 2024-05-08T18:30:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.606+0000 7f257b8c3640 1 -- 172.21.15.53:0/3590763889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f257412d1e0 msgr2=0x7f25741bea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.606+0000 7f257b8c3640 1 --2- 172.21.15.53:0/3590763889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f257412d1e0 0x7f25741bea40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f25700090b0 tx=0x7f25700046c0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.606+0000 7f257b8c3640 1 -- 172.21.15.53:0/3590763889 shutdown_connections 2024-05-08T18:30:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.606+0000 7f257b8c3640 1 --2- 172.21.15.53:0/3590763889 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f255803d2b0 0x7f255803f770 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.606+0000 7f257b8c3640 1 --2- 172.21.15.53:0/3590763889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f257412d1e0 0x7f25741bea40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.606+0000 7f257b8c3640 1 -- 172.21.15.53:0/3590763889 >> 172.21.15.53:0/3590763889 conn(0x7f257409a910 msgr2=0x7f257412afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.606+0000 7f257b8c3640 1 -- 172.21.15.53:0/3590763889 shutdown_connections 2024-05-08T18:30:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.606+0000 7f257b8c3640 1 -- 172.21.15.53:0/3590763889 wait complete. 2024-05-08T18:30:51.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705665 for osd.0 2024-05-08T18:30:51.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.629+0000 7f9b9e1e8640 1 -- 172.21.15.53:0/986109906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9b78005370 con 0x7f9b800039b0 2024-05-08T18:30:51.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.629+0000 7f9b7ffff640 1 -- 172.21.15.53:0/986109906 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9b8803dda0 con 0x7f9b800039b0 2024-05-08T18:30:51.631 INFO:teuthology.orchestra.run.smithi053.stdout:38654705666 2024-05-08T18:30:51.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.631+0000 7f9b9e1e8640 1 -- 172.21.15.53:0/986109906 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b8403d350 msgr2=0x7f9b8403f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.631+0000 7f9b9e1e8640 1 --2- 172.21.15.53:0/986109906 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b8403d350 0x7f9b8403f810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c007920 tx=0x7f9b8c000ed0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.631+0000 7f9b9e1e8640 1 -- 172.21.15.53:0/986109906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b800039b0 msgr2=0x7f9b9808c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:51.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.631+0000 7f9b9e1e8640 1 --2- 172.21.15.53:0/986109906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b800039b0 0x7f9b9808c550 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9b88037040 tx=0x7f9b88004730 comp rx=0 tx=0).stop 2024-05-08T18:30:51.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.631+0000 7f9b9e1e8640 1 -- 172.21.15.53:0/986109906 shutdown_connections 2024-05-08T18:30:51.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.631+0000 7f9b9e1e8640 1 --2- 172.21.15.53:0/986109906 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b8403d350 0x7f9b8403f810 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.631+0000 7f9b9e1e8640 1 --2- 172.21.15.53:0/986109906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b800039b0 0x7f9b9808c550 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:51.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.632+0000 7f9b9e1e8640 1 -- 172.21.15.53:0/986109906 >> 172.21.15.53:0/986109906 conn(0x7f9b9809ff90 msgr2=0x7f9b98129680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:51.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.632+0000 7f9b9e1e8640 1 -- 172.21.15.53:0/986109906 shutdown_connections 2024-05-08T18:30:51.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:51.632+0000 7f9b9e1e8640 1 -- 172.21.15.53:0/986109906 wait complete. 2024-05-08T18:30:51.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.1 2024-05-08T18:30:52.571 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T18:30:52.578 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T18:30:52.621 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T18:30:52.642 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T18:30:52.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.691+0000 7efc1b48a640 1 Processor -- start 2024-05-08T18:30:52.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.692+0000 7efc1b48a640 1 -- start start 2024-05-08T18:30:52.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.692+0000 7efc1b48a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efc1412c7f0 0x7efc1412cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:52.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.692+0000 7efc1b48a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc140a23e0 con 0x7efc14070850 2024-05-08T18:30:52.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.692+0000 7efc1b48a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7efc14072fc0 con 0x7efc1412c7f0 2024-05-08T18:30:52.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.692+0000 7efc19226640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efc1412c7f0 0x7efc1412cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:52.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.692+0000 7efc18a25640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efc14070850 0x7efc14070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49786/0 (socket says 172.21.15.53:49786) 2024-05-08T18:30:52.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.692+0000 7efc18a25640 1 -- 172.21.15.53:0/1211255117 learned_addr learned my addr 172.21.15.53:0/1211255117 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:52.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.693+0000 7efc19226640 1 -- 172.21.15.53:0/1211255117 >> v1:172.21.15.53:6789/0 conn(0x7efc14070850 legacy=0x7efc14070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:52.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.693+0000 7efc19226640 1 -- 172.21.15.53:0/1211255117 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc14071f80 con 0x7efc1412c7f0 2024-05-08T18:30:52.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.693+0000 7efc0bfff640 1 -- 172.21.15.53:0/1211255117 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242517800 0 0) 0x7efc140a23e0 con 0x7efc14070850 2024-05-08T18:30:52.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.694+0000 7efc19226640 1 --2- 172.21.15.53:0/1211255117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc1412c7f0 0x7efc1412cbd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efc10009720 tx=0x7efc1002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf338632a2bb32f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:52.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.694+0000 7efc0bfff640 1 -- 172.21.15.53:0/1211255117 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc100316d0 con 0x7efc1412c7f0 2024-05-08T18:30:52.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.694+0000 7efc0bfff640 1 -- 172.21.15.53:0/1211255117 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc10037070 con 0x7efc1412c7f0 2024-05-08T18:30:52.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.694+0000 7efc0bfff640 1 -- 172.21.15.53:0/1211255117 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc100319c0 con 0x7efc1412c7f0 2024-05-08T18:30:52.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.695+0000 7efc1b48a640 1 -- 172.21.15.53:0/1211255117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc1412c7f0 msgr2=0x7efc1412cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:52.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.695+0000 7efc1b48a640 1 --2- 172.21.15.53:0/1211255117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc1412c7f0 0x7efc1412cbd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efc10009720 tx=0x7efc1002b840 comp rx=0 tx=0).stop 2024-05-08T18:30:52.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.695+0000 7efc1b48a640 1 -- 172.21.15.53:0/1211255117 shutdown_connections 2024-05-08T18:30:52.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.695+0000 7efc1b48a640 1 --2- 172.21.15.53:0/1211255117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc1412c7f0 0x7efc1412cbd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:52.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.695+0000 7efc1b48a640 1 -- 172.21.15.53:0/1211255117 >> 172.21.15.53:0/1211255117 conn(0x7efc1409ff90 msgr2=0x7efc140a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:52.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.695+0000 7efc1b48a640 1 -- 172.21.15.53:0/1211255117 shutdown_connections 2024-05-08T18:30:52.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.695+0000 7efc1b48a640 1 -- 172.21.15.53:0/1211255117 wait complete. 2024-05-08T18:30:52.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.696+0000 7efc1b48a640 1 Processor -- start 2024-05-08T18:30:52.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.696+0000 7efc1b48a640 1 -- start start 2024-05-08T18:30:52.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.697+0000 7efc1b48a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc14070850 0x7efc1411a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:52.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.697+0000 7efc1b48a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efc14071530 con 0x7efc14070850 2024-05-08T18:30:52.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.697+0000 7efc19226640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc14070850 0x7efc1411a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:52.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.697+0000 7efc19226640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc14070850 0x7efc1411a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36522/0 (socket says 172.21.15.53:36522) 2024-05-08T18:30:52.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.697+0000 7efc19226640 1 -- 172.21.15.53:0/1351860557 learned_addr learned my addr 172.21.15.53:0/1351860557 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:52.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.698+0000 7efc19226640 1 -- 172.21.15.53:0/1351860557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1411d550 con 0x7efc14070850 2024-05-08T18:30:52.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.698+0000 7efc19226640 1 --2- 172.21.15.53:0/1351860557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc14070850 0x7efc1411a440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efc10034040 tx=0x7efc100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:52.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.698+0000 7efc09ffb640 1 -- 172.21.15.53:0/1351860557 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc10032770 con 0x7efc14070850 2024-05-08T18:30:52.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.698+0000 7efc09ffb640 1 -- 172.21.15.53:0/1351860557 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc10032910 con 0x7efc14070850 2024-05-08T18:30:52.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.698+0000 7efc09ffb640 1 -- 172.21.15.53:0/1351860557 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc10032c30 con 0x7efc14070850 2024-05-08T18:30:52.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.699+0000 7efc1b48a640 1 -- 172.21.15.53:0/1351860557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc1411d990 con 0x7efc14070850 2024-05-08T18:30:52.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.699+0000 7efc1b48a640 1 -- 172.21.15.53:0/1351860557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc1411ab60 con 0x7efc14070850 2024-05-08T18:30:52.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.701+0000 7efc09ffb640 1 -- 172.21.15.53:0/1351860557 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7efc1004c060 con 0x7efc14070850 2024-05-08T18:30:52.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.701+0000 7efc1b48a640 1 -- 172.21.15.53:0/1351860557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc14064010 con 0x7efc14070850 2024-05-08T18:30:52.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.701+0000 7efc09ffb640 1 --2- 172.21.15.53:0/1351860557 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efbf803d2b0 0x7efbf803f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:52.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.701+0000 7efc09ffb640 1 -- 172.21.15.53:0/1351860557 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7efc1002f050 con 0x7efc14070850 2024-05-08T18:30:52.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.702+0000 7efc18a25640 1 --2- 172.21.15.53:0/1351860557 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efbf803d2b0 0x7efbf803f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:52.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.702+0000 7efc18a25640 1 --2- 172.21.15.53:0/1351860557 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efbf803d2b0 0x7efbf803f770 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efc04000c00 tx=0x7efc04007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:52.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.710+0000 7efc09ffb640 1 -- 172.21.15.53:0/1351860557 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7efc10077070 con 0x7efc14070850 2024-05-08T18:30:52.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.731+0000 7f58752ae640 1 Processor -- start 2024-05-08T18:30:52.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.731+0000 7f58752ae640 1 -- start start 2024-05-08T18:30:52.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.732+0000 7f58752ae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f587012c7f0 0x7f587012cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:52.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.732+0000 7f58752ae640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58700a23e0 con 0x7f5870070850 2024-05-08T18:30:52.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.732+0000 7f58752ae640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5870072fc0 con 0x7f587012c7f0 2024-05-08T18:30:52.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.732+0000 7f586effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f587012c7f0 0x7f587012cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:52.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.732+0000 7f586e7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5870070850 0x7f5870070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49802/0 (socket says 172.21.15.53:49802) 2024-05-08T18:30:52.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.732+0000 7f586effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f587012c7f0 0x7f587012cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36534/0 (socket says 172.21.15.53:36534) 2024-05-08T18:30:52.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.732+0000 7f586e7fc640 1 -- 172.21.15.53:0/1593403123 learned_addr learned my addr 172.21.15.53:0/1593403123 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:52.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.733+0000 7f586effd640 1 -- 172.21.15.53:0/1593403123 >> v1:172.21.15.53:6789/0 conn(0x7f5870070850 legacy=0x7f5870070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:52.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.733+0000 7f586effd640 1 -- 172.21.15.53:0/1593403123 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5870071f80 con 0x7f587012c7f0 2024-05-08T18:30:52.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.734+0000 7f586effd640 1 --2- 172.21.15.53:0/1593403123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f587012c7f0 0x7f587012cbd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5860009720 tx=0x7f586002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb7f306ac89ebbf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:52.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.734+0000 7f586dffb640 1 -- 172.21.15.53:0/1593403123 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58600316d0 con 0x7f587012c7f0 2024-05-08T18:30:52.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.734+0000 7f586dffb640 1 -- 172.21.15.53:0/1593403123 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5860037070 con 0x7f587012c7f0 2024-05-08T18:30:52.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.734+0000 7f586dffb640 1 -- 172.21.15.53:0/1593403123 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58600319c0 con 0x7f587012c7f0 2024-05-08T18:30:52.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.735+0000 7f58752ae640 1 -- 172.21.15.53:0/1593403123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f587012c7f0 msgr2=0x7f587012cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:52.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.735+0000 7f58752ae640 1 --2- 172.21.15.53:0/1593403123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f587012c7f0 0x7f587012cbd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5860009720 tx=0x7f586002b840 comp rx=0 tx=0).stop 2024-05-08T18:30:52.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.735+0000 7f58752ae640 1 -- 172.21.15.53:0/1593403123 shutdown_connections 2024-05-08T18:30:52.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.735+0000 7f58752ae640 1 --2- 172.21.15.53:0/1593403123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f587012c7f0 0x7f587012cbd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:52.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.735+0000 7f58752ae640 1 -- 172.21.15.53:0/1593403123 >> 172.21.15.53:0/1593403123 conn(0x7f587009ff90 msgr2=0x7f58700a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:52.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.735+0000 7f58752ae640 1 -- 172.21.15.53:0/1593403123 shutdown_connections 2024-05-08T18:30:52.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.735+0000 7f58752ae640 1 -- 172.21.15.53:0/1593403123 wait complete. 2024-05-08T18:30:52.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.736+0000 7f58752ae640 1 Processor -- start 2024-05-08T18:30:52.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.736+0000 7f58752ae640 1 -- start start 2024-05-08T18:30:52.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.737+0000 7f58752ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5870070850 0x7f587011a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:52.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.737+0000 7f58752ae640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5870071530 con 0x7f5870070850 2024-05-08T18:30:52.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.737+0000 7f586effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5870070850 0x7f587011a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:52.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.737+0000 7f586effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5870070850 0x7f587011a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36536/0 (socket says 172.21.15.53:36536) 2024-05-08T18:30:52.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.737+0000 7f586effd640 1 -- 172.21.15.53:0/1844899777 learned_addr learned my addr 172.21.15.53:0/1844899777 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:52.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.737+0000 7f586effd640 1 -- 172.21.15.53:0/1844899777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587011d550 con 0x7f5870070850 2024-05-08T18:30:52.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.737+0000 7f586effd640 1 --2- 172.21.15.53:0/1844899777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5870070850 0x7f587011a440 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5860034040 tx=0x7f58600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:52.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.738+0000 7f58577fe640 1 -- 172.21.15.53:0/1844899777 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5860032770 con 0x7f5870070850 2024-05-08T18:30:52.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.738+0000 7f58577fe640 1 -- 172.21.15.53:0/1844899777 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5860032910 con 0x7f5870070850 2024-05-08T18:30:52.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.738+0000 7f58577fe640 1 -- 172.21.15.53:0/1844899777 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5860032c30 con 0x7f5870070850 2024-05-08T18:30:52.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.738+0000 7f58752ae640 1 -- 172.21.15.53:0/1844899777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f587011d990 con 0x7f5870070850 2024-05-08T18:30:52.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.738+0000 7f58752ae640 1 -- 172.21.15.53:0/1844899777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f587011ab60 con 0x7f5870070850 2024-05-08T18:30:52.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.739+0000 7f58577fe640 1 -- 172.21.15.53:0/1844899777 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f586004c060 con 0x7f5870070850 2024-05-08T18:30:52.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.739+0000 7f58752ae640 1 -- 172.21.15.53:0/1844899777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f587012a010 con 0x7f5870070850 2024-05-08T18:30:52.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.739+0000 7f58577fe640 1 --2- 172.21.15.53:0/1844899777 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f585c03d2b0 0x7f585c03f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:52.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.740+0000 7f58577fe640 1 -- 172.21.15.53:0/1844899777 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f586002f050 con 0x7f5870070850 2024-05-08T18:30:52.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.740+0000 7f586e7fc640 1 --2- 172.21.15.53:0/1844899777 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f585c03d2b0 0x7f585c03f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:52.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.740+0000 7f586e7fc640 1 --2- 172.21.15.53:0/1844899777 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f585c03d2b0 0x7f585c03f770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5864007fd0 tx=0x7f5864007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:52.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.745+0000 7f58577fe640 1 -- 172.21.15.53:0/1844899777 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5860040070 con 0x7f5870070850 2024-05-08T18:30:52.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.774+0000 7fbffd85e640 1 Processor -- start 2024-05-08T18:30:52.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.774+0000 7f2f01d52640 1 Processor -- start 2024-05-08T18:30:52.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.774+0000 7f2f01d52640 1 -- start start 2024-05-08T18:30:52.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.774+0000 7fbffd85e640 1 -- start start 2024-05-08T18:30:52.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.775+0000 7f2f01d52640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2efc071340 0x7f2efc1349d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:52.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.775+0000 7fbffd85e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbff80701c0 0x7fbff80705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:52.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.775+0000 7f2f01d52640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2efc0a28f0 con 0x7f2efc070850 2024-05-08T18:30:52.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.775+0000 7f2f01d52640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f2efc072970 con 0x7f2efc071340 2024-05-08T18:30:52.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.775+0000 7fbffd85e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbff8072e10 con 0x7fbff8070ae0 2024-05-08T18:30:52.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.775+0000 7f2efaffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2efc071340 0x7f2efc1349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:52.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.775+0000 7fbffd85e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbff80715e0 con 0x7fbff80701c0 2024-05-08T18:30:52.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.775+0000 7f2efaffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2efc071340 0x7f2efc1349d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36552/0 (socket says 172.21.15.53:36552) 2024-05-08T18:30:52.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.775+0000 7f2efaffd640 1 -- 172.21.15.53:0/355053893 learned_addr learned my addr 172.21.15.53:0/355053893 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:52.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.775+0000 7fbff67fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbff8070ae0 0x7fbff812f470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49826/0 (socket says 172.21.15.53:49826) 2024-05-08T18:30:52.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.775+0000 7fbff67fc640 1 -- 172.21.15.53:0/1055086850 learned_addr learned my addr 172.21.15.53:0/1055086850 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:52.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.775+0000 7f2efaffd640 1 -- 172.21.15.53:0/355053893 >> v1:172.21.15.53:6789/0 conn(0x7f2efc070850 legacy=0x7f2efc070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T18:30:52.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.775+0000 7f2efaffd640 1 -- 172.21.15.53:0/355053893 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc072ba0 con 0x7f2efc071340 2024-05-08T18:30:52.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.775+0000 7fbff6ffd640 1 --2- 172.21.15.53:0/1055086850 >> v2:172.21.15.53:3300/0 conn(0x7fbff80701c0 0x7fbff80705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:52.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.776+0000 7fbff5ffb640 1 -- 172.21.15.53:0/1055086850 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2458678669 0 0) 0x7fbff8072e10 con 0x7fbff8070ae0 2024-05-08T18:30:52.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.776+0000 7fbff5ffb640 1 -- 172.21.15.53:0/1055086850 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfe0003520 con 0x7fbff8070ae0 2024-05-08T18:30:52.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.776+0000 7fbff5ffb640 1 -- 172.21.15.53:0/1055086850 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4180120877 0 0) 0x7fbfe0003520 con 0x7fbff8070ae0 2024-05-08T18:30:52.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.776+0000 7fbff6ffd640 1 -- 172.21.15.53:0/1055086850 >> v1:172.21.15.53:6789/0 conn(0x7fbff8070ae0 legacy=0x7fbff812f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:52.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.776+0000 7fbff6ffd640 1 -- 172.21.15.53:0/1055086850 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff80726c0 con 0x7fbff80701c0 2024-05-08T18:30:52.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.776+0000 7f2efaffd640 1 --2- 172.21.15.53:0/355053893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2efc071340 0x7f2efc1349d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00097f0 tx=0x7f2ef002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3aeca94e2349a2a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:52.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.777+0000 7f2efa7fc640 1 -- 172.21.15.53:0/355053893 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ef002e070 con 0x7f2efc071340 2024-05-08T18:30:52.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.777+0000 7f2efa7fc640 1 -- 172.21.15.53:0/355053893 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef0037070 con 0x7f2efc071340 2024-05-08T18:30:52.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.777+0000 7f2efa7fc640 1 -- 172.21.15.53:0/355053893 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ef0031730 con 0x7f2efc071340 2024-05-08T18:30:52.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.777+0000 7fbff6ffd640 1 --2- 172.21.15.53:0/1055086850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbff80701c0 0x7fbff80705a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009720 tx=0x7fbfe802b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a380860a07c091cb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:52.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.777+0000 7f2f01d52640 1 -- 172.21.15.53:0/355053893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2efc071340 msgr2=0x7f2efc1349d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:52.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.777+0000 7f2f01d52640 1 --2- 172.21.15.53:0/355053893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2efc071340 0x7f2efc1349d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00097f0 tx=0x7f2ef002b880 comp rx=0 tx=0).stop 2024-05-08T18:30:52.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.777+0000 7fbff5ffb640 1 -- 172.21.15.53:0/1055086850 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfe8037070 con 0x7fbff80701c0 2024-05-08T18:30:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.777+0000 7f2f01d52640 1 -- 172.21.15.53:0/355053893 shutdown_connections 2024-05-08T18:30:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.777+0000 7f2f01d52640 1 --2- 172.21.15.53:0/355053893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2efc071340 0x7f2efc1349d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.777+0000 7f2f01d52640 1 -- 172.21.15.53:0/355053893 >> 172.21.15.53:0/355053893 conn(0x7f2efc09ff90 msgr2=0x7f2efc0a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.777+0000 7fbff5ffb640 1 -- 172.21.15.53:0/1055086850 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe8030510 con 0x7fbff80701c0 2024-05-08T18:30:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.778+0000 7f2f01d52640 1 -- 172.21.15.53:0/355053893 shutdown_connections 2024-05-08T18:30:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.778+0000 7fbff5ffb640 1 -- 172.21.15.53:0/1055086850 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfe8037070 con 0x7fbff80701c0 2024-05-08T18:30:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.778+0000 7fbffd85e640 1 -- 172.21.15.53:0/1055086850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbff80701c0 msgr2=0x7fbff80705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.778+0000 7fbffd85e640 1 --2- 172.21.15.53:0/1055086850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbff80701c0 0x7fbff80705a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009720 tx=0x7fbfe802b710 comp rx=0 tx=0).stop 2024-05-08T18:30:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.778+0000 7f2f01d52640 1 -- 172.21.15.53:0/355053893 wait complete. 2024-05-08T18:30:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.779+0000 7fbffd85e640 1 -- 172.21.15.53:0/1055086850 shutdown_connections 2024-05-08T18:30:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.779+0000 7fbffd85e640 1 --2- 172.21.15.53:0/1055086850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbff80701c0 0x7fbff80705a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.779+0000 7fbffd85e640 1 -- 172.21.15.53:0/1055086850 >> 172.21.15.53:0/1055086850 conn(0x7fbff809e9f0 msgr2=0x7fbff809ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.779+0000 7fbffd85e640 1 -- 172.21.15.53:0/1055086850 shutdown_connections 2024-05-08T18:30:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.779+0000 7fbffd85e640 1 -- 172.21.15.53:0/1055086850 wait complete. 2024-05-08T18:30:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.779+0000 7f2f01d52640 1 Processor -- start 2024-05-08T18:30:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.779+0000 7fbffd85e640 1 Processor -- start 2024-05-08T18:30:52.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.780+0000 7f2f01d52640 1 -- start start 2024-05-08T18:30:52.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.780+0000 7fbffd85e640 1 -- start start 2024-05-08T18:30:52.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.780+0000 7f2f01d52640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2efc070850 0x7f2efc130590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:52.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.780+0000 7f2f01d52640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc134f10 con 0x7f2efc070850 2024-05-08T18:30:52.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.780+0000 7fbffd85e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbff80701c0 0x7fbff811c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:52.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.780+0000 7fbffd85e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbff812fb80 con 0x7fbff80701c0 2024-05-08T18:30:52.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.780+0000 7f2efb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2efc070850 0x7f2efc130590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:52.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.780+0000 7f2efb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2efc070850 0x7f2efc130590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36576/0 (socket says 172.21.15.53:36576) 2024-05-08T18:30:52.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.780+0000 7f2efb7fe640 1 -- 172.21.15.53:0/2910501471 learned_addr learned my addr 172.21.15.53:0/2910501471 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:52.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.780+0000 7fbff6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbff80701c0 0x7fbff811c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:52.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.780+0000 7fbff6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbff80701c0 0x7fbff811c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36592/0 (socket says 172.21.15.53:36592) 2024-05-08T18:30:52.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.780+0000 7fbff6ffd640 1 -- 172.21.15.53:0/3038954587 learned_addr learned my addr 172.21.15.53:0/3038954587 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:52.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.781+0000 7f2efb7fe640 1 -- 172.21.15.53:0/2910501471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc131c10 con 0x7f2efc070850 2024-05-08T18:30:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.781+0000 7fbff6ffd640 1 -- 172.21.15.53:0/3038954587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff811fa80 con 0x7fbff80701c0 2024-05-08T18:30:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.781+0000 7f2efb7fe640 1 --2- 172.21.15.53:0/2910501471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2efc070850 0x7f2efc130590 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00c3b0 tx=0x7f2eec00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.781+0000 7fbff6ffd640 1 --2- 172.21.15.53:0/3038954587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbff80701c0 0x7fbff811c6b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbfe802b750 tx=0x7fbfe80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:52.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.781+0000 7f2ee3fff640 1 -- 172.21.15.53:0/2910501471 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eec0116c0 con 0x7f2efc070850 2024-05-08T18:30:52.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.781+0000 7f2f01d52640 1 -- 172.21.15.53:0/2910501471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2efc132880 con 0x7f2efc070850 2024-05-08T18:30:52.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.781+0000 7f2ee3fff640 1 -- 172.21.15.53:0/2910501471 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eec017070 con 0x7f2efc070850 2024-05-08T18:30:52.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.781+0000 7fbfdffff640 1 -- 172.21.15.53:0/3038954587 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfe8043070 con 0x7fbff80701c0 2024-05-08T18:30:52.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.781+0000 7fbfdffff640 1 -- 172.21.15.53:0/3038954587 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe80327d0 con 0x7fbff80701c0 2024-05-08T18:30:52.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.781+0000 7fbfdffff640 1 -- 172.21.15.53:0/3038954587 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfe8037070 con 0x7fbff80701c0 2024-05-08T18:30:52.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.781+0000 7fbffd85e640 1 -- 172.21.15.53:0/3038954587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff811e1e0 con 0x7fbff80701c0 2024-05-08T18:30:52.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.781+0000 7fbffd85e640 1 -- 172.21.15.53:0/3038954587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff811cbf0 con 0x7fbff80701c0 2024-05-08T18:30:52.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.782+0000 7f2ee3fff640 1 -- 172.21.15.53:0/2910501471 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eec0119d0 con 0x7f2efc070850 2024-05-08T18:30:52.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.782+0000 7f2f01d52640 1 -- 172.21.15.53:0/2910501471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2efc132f90 con 0x7f2efc070850 2024-05-08T18:30:52.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.782+0000 7f2ee3fff640 1 -- 172.21.15.53:0/2910501471 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2eec011c30 con 0x7f2efc070850 2024-05-08T18:30:52.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.782+0000 7fbffd85e640 1 -- 172.21.15.53:0/3038954587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff8064010 con 0x7fbff80701c0 2024-05-08T18:30:52.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.783+0000 7f2ee3fff640 1 --2- 172.21.15.53:0/2910501471 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2ee803d2b0 0x7f2ee803f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:52.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.783+0000 7fbfdffff640 1 -- 172.21.15.53:0/3038954587 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbfe8046070 con 0x7fbff80701c0 2024-05-08T18:30:52.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.783+0000 7f2ee3fff640 1 -- 172.21.15.53:0/2910501471 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f2eec055170 con 0x7f2efc070850 2024-05-08T18:30:52.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.783+0000 7fbfdffff640 1 --2- 172.21.15.53:0/3038954587 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbfe403d2b0 0x7fbfe403f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:52.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.783+0000 7f2efaffd640 1 --2- 172.21.15.53:0/2910501471 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2ee803d2b0 0x7f2ee803f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:52.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.783+0000 7f2f01d52640 1 -- 172.21.15.53:0/2910501471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2efc064010 con 0x7f2efc070850 2024-05-08T18:30:52.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.783+0000 7fbfdffff640 1 -- 172.21.15.53:0/3038954587 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fbfe8072d10 con 0x7fbff80701c0 2024-05-08T18:30:52.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.783+0000 7fbff67fc640 1 --2- 172.21.15.53:0/3038954587 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbfe403d2b0 0x7fbfe403f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:52.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.784+0000 7f2efaffd640 1 --2- 172.21.15.53:0/2910501471 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2ee803d2b0 0x7f2ee803f770 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0036000 tx=0x7f2ef0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:52.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.784+0000 7fbff67fc640 1 --2- 172.21.15.53:0/3038954587 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbfe403d2b0 0x7fbfe403f770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbfec001710 tx=0x7fbfec001080 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:52.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.788+0000 7fbfdffff640 1 -- 172.21.15.53:0/3038954587 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fbfe8050d60 con 0x7fbff80701c0 2024-05-08T18:30:52.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.793+0000 7f2ee3fff640 1 -- 172.21.15.53:0/2910501471 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2eec04f910 con 0x7f2efc070850 2024-05-08T18:30:52.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.907+0000 7efc1b48a640 1 -- 172.21.15.53:0/1351860557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7efc140a2930 con 0x7efc14070850 2024-05-08T18:30:52.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.908+0000 7efc09ffb640 1 -- 172.21.15.53:0/1351860557 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efc10040070 con 0x7efc14070850 2024-05-08T18:30:52.907 INFO:teuthology.orchestra.run.smithi053.stdout:38654705667 2024-05-08T18:30:52.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.911+0000 7efc1b48a640 1 -- 172.21.15.53:0/1351860557 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efbf803d2b0 msgr2=0x7efbf803f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:52.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.911+0000 7efc1b48a640 1 --2- 172.21.15.53:0/1351860557 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efbf803d2b0 0x7efbf803f770 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efc04000c00 tx=0x7efc04007910 comp rx=0 tx=0).stop 2024-05-08T18:30:52.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.911+0000 7efc1b48a640 1 -- 172.21.15.53:0/1351860557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc14070850 msgr2=0x7efc1411a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:52.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.911+0000 7efc1b48a640 1 --2- 172.21.15.53:0/1351860557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc14070850 0x7efc1411a440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efc10034040 tx=0x7efc100046c0 comp rx=0 tx=0).stop 2024-05-08T18:30:52.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.911+0000 7efc1b48a640 1 -- 172.21.15.53:0/1351860557 shutdown_connections 2024-05-08T18:30:52.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.911+0000 7efc1b48a640 1 --2- 172.21.15.53:0/1351860557 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efbf803d2b0 0x7efbf803f770 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:52.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.911+0000 7efc1b48a640 1 --2- 172.21.15.53:0/1351860557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc14070850 0x7efc1411a440 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:52.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.911+0000 7efc1b48a640 1 -- 172.21.15.53:0/1351860557 >> 172.21.15.53:0/1351860557 conn(0x7efc1409ff90 msgr2=0x7efc141b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:52.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.911+0000 7efc1b48a640 1 -- 172.21.15.53:0/1351860557 shutdown_connections 2024-05-08T18:30:52.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.911+0000 7efc1b48a640 1 -- 172.21.15.53:0/1351860557 wait complete. 2024-05-08T18:30:52.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.3 2024-05-08T18:30:52.926 DEBUG:teuthology.parallel:result is None 2024-05-08T18:30:52.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.942+0000 7f58752ae640 1 -- 172.21.15.53:0/1844899777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5870064010 con 0x7f5870070850 2024-05-08T18:30:52.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.943+0000 7f58577fe640 1 -- 172.21.15.53:0/1844899777 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5860032dd0 con 0x7f5870070850 2024-05-08T18:30:52.942 INFO:teuthology.orchestra.run.smithi053.stdout:38654705668 2024-05-08T18:30:52.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.946+0000 7f58752ae640 1 -- 172.21.15.53:0/1844899777 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f585c03d2b0 msgr2=0x7f585c03f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:52.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.946+0000 7f58752ae640 1 --2- 172.21.15.53:0/1844899777 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f585c03d2b0 0x7f585c03f770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5864007fd0 tx=0x7f5864007ac0 comp rx=0 tx=0).stop 2024-05-08T18:30:52.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.946+0000 7f58752ae640 1 -- 172.21.15.53:0/1844899777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5870070850 msgr2=0x7f587011a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:52.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.946+0000 7f58752ae640 1 --2- 172.21.15.53:0/1844899777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5870070850 0x7f587011a440 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5860034040 tx=0x7f58600046c0 comp rx=0 tx=0).stop 2024-05-08T18:30:52.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.946+0000 7f58752ae640 1 -- 172.21.15.53:0/1844899777 shutdown_connections 2024-05-08T18:30:52.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.946+0000 7f58752ae640 1 --2- 172.21.15.53:0/1844899777 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f585c03d2b0 0x7f585c03f770 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:52.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.946+0000 7f58752ae640 1 --2- 172.21.15.53:0/1844899777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5870070850 0x7f587011a440 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:52.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.946+0000 7f58752ae640 1 -- 172.21.15.53:0/1844899777 >> 172.21.15.53:0/1844899777 conn(0x7f587009ff90 msgr2=0x7f58701b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:52.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.946+0000 7f58752ae640 1 -- 172.21.15.53:0/1844899777 shutdown_connections 2024-05-08T18:30:52.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.946+0000 7f58752ae640 1 -- 172.21.15.53:0/1844899777 wait complete. 2024-05-08T18:30:52.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.2 2024-05-08T18:30:52.957 DEBUG:teuthology.parallel:result is None 2024-05-08T18:30:52.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.985+0000 7f2f01d52640 1 -- 172.21.15.53:0/2910501471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2efc075170 con 0x7f2efc070850 2024-05-08T18:30:52.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.986+0000 7f2ee3fff640 1 -- 172.21.15.53:0/2910501471 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2eec012420 con 0x7f2efc070850 2024-05-08T18:30:52.985 INFO:teuthology.orchestra.run.smithi053.stdout:38654705667 2024-05-08T18:30:52.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.988+0000 7f2f01d52640 1 -- 172.21.15.53:0/2910501471 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2ee803d2b0 msgr2=0x7f2ee803f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:52.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.988+0000 7f2f01d52640 1 --2- 172.21.15.53:0/2910501471 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2ee803d2b0 0x7f2ee803f770 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0036000 tx=0x7f2ef0008030 comp rx=0 tx=0).stop 2024-05-08T18:30:52.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.988+0000 7f2f01d52640 1 -- 172.21.15.53:0/2910501471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2efc070850 msgr2=0x7f2efc130590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:52.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.988+0000 7f2f01d52640 1 --2- 172.21.15.53:0/2910501471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2efc070850 0x7f2efc130590 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00c3b0 tx=0x7f2eec00c870 comp rx=0 tx=0).stop 2024-05-08T18:30:52.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.988+0000 7f2f01d52640 1 -- 172.21.15.53:0/2910501471 shutdown_connections 2024-05-08T18:30:52.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.988+0000 7f2f01d52640 1 --2- 172.21.15.53:0/2910501471 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2ee803d2b0 0x7f2ee803f770 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:52.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.988+0000 7f2f01d52640 1 --2- 172.21.15.53:0/2910501471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2efc070850 0x7f2efc130590 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:52.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.988+0000 7f2f01d52640 1 -- 172.21.15.53:0/2910501471 >> 172.21.15.53:0/2910501471 conn(0x7f2efc09ff90 msgr2=0x7f2efc06f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:52.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.988+0000 7f2f01d52640 1 -- 172.21.15.53:0/2910501471 shutdown_connections 2024-05-08T18:30:52.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.988+0000 7f2f01d52640 1 -- 172.21.15.53:0/2910501471 wait complete. 2024-05-08T18:30:52.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.991+0000 7fbffd85e640 1 -- 172.21.15.53:0/3038954587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fbff811f270 con 0x7fbff80701c0 2024-05-08T18:30:52.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.991+0000 7fbfdffff640 1 -- 172.21.15.53:0/3038954587 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbfe803c470 con 0x7fbff80701c0 2024-05-08T18:30:52.990 INFO:teuthology.orchestra.run.smithi053.stdout:38654705666 2024-05-08T18:30:52.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.993+0000 7fbffd85e640 1 -- 172.21.15.53:0/3038954587 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbfe403d2b0 msgr2=0x7fbfe403f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:52.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.993+0000 7fbffd85e640 1 --2- 172.21.15.53:0/3038954587 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbfe403d2b0 0x7fbfe403f770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbfec001710 tx=0x7fbfec001080 comp rx=0 tx=0).stop 2024-05-08T18:30:52.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.993+0000 7fbffd85e640 1 -- 172.21.15.53:0/3038954587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbff80701c0 msgr2=0x7fbff811c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:52.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.993+0000 7fbffd85e640 1 --2- 172.21.15.53:0/3038954587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbff80701c0 0x7fbff811c6b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbfe802b750 tx=0x7fbfe80046c0 comp rx=0 tx=0).stop 2024-05-08T18:30:52.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.993+0000 7fbffd85e640 1 -- 172.21.15.53:0/3038954587 shutdown_connections 2024-05-08T18:30:52.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.993+0000 7fbffd85e640 1 --2- 172.21.15.53:0/3038954587 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbfe403d2b0 0x7fbfe403f770 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:52.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.993+0000 7fbffd85e640 1 --2- 172.21.15.53:0/3038954587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbff80701c0 0x7fbff811c6b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:52.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.993+0000 7fbffd85e640 1 -- 172.21.15.53:0/3038954587 >> 172.21.15.53:0/3038954587 conn(0x7fbff809e9f0 msgr2=0x7fbff812d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:52.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.993+0000 7fbffd85e640 1 -- 172.21.15.53:0/3038954587 shutdown_connections 2024-05-08T18:30:52.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:52.993+0000 7fbffd85e640 1 -- 172.21.15.53:0/3038954587 wait complete. 2024-05-08T18:30:52.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.1 2024-05-08T18:30:52.999 DEBUG:teuthology.parallel:result is None 2024-05-08T18:30:53.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705666 for osd.0 2024-05-08T18:30:53.003 DEBUG:teuthology.parallel:result is None 2024-05-08T18:30:53.004 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T18:30:53.004 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:30:53.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.148+0000 7fdb4b1f2640 1 Processor -- start 2024-05-08T18:30:53.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.148+0000 7fdb4b1f2640 1 -- start start 2024-05-08T18:30:53.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.148+0000 7fdb4b1f2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdb44130520 0x7fdb44132910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:53.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.148+0000 7fdb4b1f2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb4412d590 con 0x7fdb4412d1b0 2024-05-08T18:30:53.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.148+0000 7fdb4b1f2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fdb44114de0 con 0x7fdb44130520 2024-05-08T18:30:53.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.148+0000 7fdb43fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdb44130520 0x7fdb44132910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:53.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.148+0000 7fdb48f8e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdb4412d1b0 0x7fdb4412d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49828/0 (socket says 172.21.15.53:49828) 2024-05-08T18:30:53.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.148+0000 7fdb48f8e640 1 -- 172.21.15.53:0/1366301130 learned_addr learned my addr 172.21.15.53:0/1366301130 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:53.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.149+0000 7fdb43fff640 1 -- 172.21.15.53:0/1366301130 >> v1:172.21.15.53:6789/0 conn(0x7fdb4412d1b0 legacy=0x7fdb4412d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:53.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.149+0000 7fdb43fff640 1 -- 172.21.15.53:0/1366301130 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb44113c30 con 0x7fdb44130520 2024-05-08T18:30:53.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.149+0000 7fdb437fe640 1 -- 172.21.15.53:0/1366301130 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183395159 0 0) 0x7fdb4412d590 con 0x7fdb4412d1b0 2024-05-08T18:30:53.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.149+0000 7fdb43fff640 1 --2- 172.21.15.53:0/1366301130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb44130520 0x7fdb44132910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdb30009720 tx=0x7fdb3002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91449dec1acf070 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:53.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.150+0000 7fdb437fe640 1 -- 172.21.15.53:0/1366301130 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb300316d0 con 0x7fdb44130520 2024-05-08T18:30:53.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.150+0000 7fdb437fe640 1 -- 172.21.15.53:0/1366301130 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb30037070 con 0x7fdb44130520 2024-05-08T18:30:53.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.150+0000 7fdb437fe640 1 -- 172.21.15.53:0/1366301130 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb300319c0 con 0x7fdb44130520 2024-05-08T18:30:53.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.150+0000 7fdb4b1f2640 1 -- 172.21.15.53:0/1366301130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb44130520 msgr2=0x7fdb44132910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:53.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.150+0000 7fdb4b1f2640 1 --2- 172.21.15.53:0/1366301130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb44130520 0x7fdb44132910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdb30009720 tx=0x7fdb3002b840 comp rx=0 tx=0).stop 2024-05-08T18:30:53.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.150+0000 7fdb4b1f2640 1 -- 172.21.15.53:0/1366301130 shutdown_connections 2024-05-08T18:30:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.150+0000 7fdb4b1f2640 1 --2- 172.21.15.53:0/1366301130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb44130520 0x7fdb44132910 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.150+0000 7fdb4b1f2640 1 -- 172.21.15.53:0/1366301130 >> 172.21.15.53:0/1366301130 conn(0x7fdb4409a910 msgr2=0x7fdb4406e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.150+0000 7fdb4b1f2640 1 -- 172.21.15.53:0/1366301130 shutdown_connections 2024-05-08T18:30:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.150+0000 7fdb4b1f2640 1 -- 172.21.15.53:0/1366301130 wait complete. 2024-05-08T18:30:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.151+0000 7fdb4b1f2640 1 Processor -- start 2024-05-08T18:30:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.151+0000 7fdb4b1f2640 1 -- start start 2024-05-08T18:30:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.151+0000 7fdb4b1f2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb4412d1b0 0x7fdb441287e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.151+0000 7fdb4b1f2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdb44132fd0 con 0x7fdb4412d1b0 2024-05-08T18:30:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.152+0000 7fdb48f8e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb4412d1b0 0x7fdb441287e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.152+0000 7fdb48f8e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb4412d1b0 0x7fdb441287e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36616/0 (socket says 172.21.15.53:36616) 2024-05-08T18:30:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.152+0000 7fdb48f8e640 1 -- 172.21.15.53:0/429882175 learned_addr learned my addr 172.21.15.53:0/429882175 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.152+0000 7fdb48f8e640 1 -- 172.21.15.53:0/429882175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb441150f0 con 0x7fdb4412d1b0 2024-05-08T18:30:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.152+0000 7fdb48f8e640 1 --2- 172.21.15.53:0/429882175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb4412d1b0 0x7fdb441287e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800c420 tx=0x7fdb3800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.152+0000 7fdb417fa640 1 -- 172.21.15.53:0/429882175 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb38018070 con 0x7fdb4412d1b0 2024-05-08T18:30:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.152+0000 7fdb417fa640 1 -- 172.21.15.53:0/429882175 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb380074d0 con 0x7fdb4412d1b0 2024-05-08T18:30:53.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.152+0000 7fdb417fa640 1 -- 172.21.15.53:0/429882175 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb38004950 con 0x7fdb4412d1b0 2024-05-08T18:30:53.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.152+0000 7fdb4b1f2640 1 -- 172.21.15.53:0/429882175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb44115cc0 con 0x7fdb4412d1b0 2024-05-08T18:30:53.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.152+0000 7fdb4b1f2640 1 -- 172.21.15.53:0/429882175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb44128d20 con 0x7fdb4412d1b0 2024-05-08T18:30:53.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.153+0000 7fdb417fa640 1 -- 172.21.15.53:0/429882175 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fdb3801b070 con 0x7fdb4412d1b0 2024-05-08T18:30:53.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.153+0000 7fdb417fa640 1 --2- 172.21.15.53:0/429882175 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fdb2803d260 0x7fdb2803f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:53.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.153+0000 7fdb4b1f2640 1 -- 172.21.15.53:0/429882175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb44064010 con 0x7fdb4412d1b0 2024-05-08T18:30:53.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.153+0000 7fdb417fa640 1 -- 172.21.15.53:0/429882175 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fdb380506d0 con 0x7fdb4412d1b0 2024-05-08T18:30:53.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.154+0000 7fdb43fff640 1 --2- 172.21.15.53:0/429882175 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fdb2803d260 0x7fdb2803f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:53.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.154+0000 7fdb43fff640 1 --2- 172.21.15.53:0/429882175 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fdb2803d260 0x7fdb2803f720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdb30036000 tx=0x7fdb30008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:53.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.158+0000 7fdb417fa640 1 -- 172.21.15.53:0/429882175 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fdb38010300 con 0x7fdb4412d1b0 2024-05-08T18:30:53.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.344+0000 7fdb4b1f2640 1 -- 172.21.15.53:0/429882175 --> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb44132920 con 0x7fdb2803d260 2024-05-08T18:30:53.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.346+0000 7fdb417fa640 1 -- 172.21.15.53:0/429882175 <== mgr.4102 v2:172.21.15.87:6824/211215191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31856 (secure 0 0 0) 0x7fdb30037040 con 0x7fdb2803d260 2024-05-08T18:30:53.345 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:53.346 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:30:53.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.348+0000 7fdb4b1f2640 1 -- 172.21.15.53:0/429882175 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fdb2803d260 msgr2=0x7fdb2803f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:53.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.348+0000 7fdb4b1f2640 1 --2- 172.21.15.53:0/429882175 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fdb2803d260 0x7fdb2803f720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdb30036000 tx=0x7fdb30008030 comp rx=0 tx=0).stop 2024-05-08T18:30:53.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.348+0000 7fdb4b1f2640 1 -- 172.21.15.53:0/429882175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb4412d1b0 msgr2=0x7fdb441287e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:53.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.348+0000 7fdb4b1f2640 1 --2- 172.21.15.53:0/429882175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb4412d1b0 0x7fdb441287e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800c420 tx=0x7fdb3800c8e0 comp rx=0 tx=0).stop 2024-05-08T18:30:53.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.348+0000 7fdb4b1f2640 1 -- 172.21.15.53:0/429882175 shutdown_connections 2024-05-08T18:30:53.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.348+0000 7fdb4b1f2640 1 --2- 172.21.15.53:0/429882175 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fdb2803d260 0x7fdb2803f720 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:53.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.348+0000 7fdb4b1f2640 1 --2- 172.21.15.53:0/429882175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb4412d1b0 0x7fdb441287e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:53.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.348+0000 7fdb4b1f2640 1 -- 172.21.15.53:0/429882175 >> 172.21.15.53:0/429882175 conn(0x7fdb4409a910 msgr2=0x7fdb4412ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:53.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.348+0000 7fdb4b1f2640 1 -- 172.21.15.53:0/429882175 shutdown_connections 2024-05-08T18:30:53.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.348+0000 7fdb4b1f2640 1 -- 172.21.15.53:0/429882175 wait complete. 2024-05-08T18:30:53.359 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-05-08T18:30:52.101202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118432,"kb_used_data":1544,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377368928,"statfs":{"total":386547056640,"available":386425782272,"internally_reserved":0,"allocated":1581056,"data_stored":1287380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:30:50.981614+0000","last_change":"2024-05-08T18:30:49.984897+0000","last_active":"2024-05-08T18:30:50.981614+0000","last_peered":"2024-05-08T18:30:50.981614+0000","last_clean":"2024-05-08T18:30:50.981614+0000","last_became_active":"2024-05-08T18:30:49.984280+0000","last_became_peered":"2024-05-08T18:30:49.984280+0000","last_unstale":"2024-05-08T18:30:50.981614+0000","last_undegraded":"2024-05-08T18:30:50.981614+0000","last_fullsized":"2024-05-08T18:30:50.981614+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:26.601806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T18:30:49.983667+0000","last_change":"2024-05-08T18:30:49.982641+0000","last_active":"2024-05-08T18:30:49.983667+0000","last_peered":"2024-05-08T18:30:49.983667+0000","last_clean":"2024-05-08T18:30:49.983667+0000","last_became_active":"2024-05-08T18:30:49.982330+0000","last_became_peered":"2024-05-08T18:30:49.982330+0000","last_unstale":"2024-05-08T18:30:49.983667+0000","last_undegraded":"2024-05-08T18:30:49.983667+0000","last_fullsized":"2024-05-08T18:30:49.983667+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:54:57.041299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:30:50.981903+0000","last_change":"2024-05-08T18:30:49.982777+0000","last_active":"2024-05-08T18:30:50.981903+0000","last_peered":"2024-05-08T18:30:50.981903+0000","last_clean":"2024-05-08T18:30:50.981903+0000","last_became_active":"2024-05-08T18:30:49.982471+0000","last_became_peered":"2024-05-08T18:30:49.982471+0000","last_unstale":"2024-05-08T18:30:50.981903+0000","last_undegraded":"2024-05-08T18:30:50.981903+0000","last_fullsized":"2024-05-08T18:30:50.981903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:54.349839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T18:30:49.984562+0000","last_change":"2024-05-08T18:30:49.983824+0000","last_active":"2024-05-08T18:30:49.984562+0000","last_peered":"2024-05-08T18:30:49.984562+0000","last_clean":"2024-05-08T18:30:49.984562+0000","last_became_active":"2024-05-08T18:30:49.983522+0000","last_became_peered":"2024-05-08T18:30:49.983522+0000","last_unstale":"2024-05-08T18:30:49.984562+0000","last_undegraded":"2024-05-08T18:30:49.984562+0000","last_fullsized":"2024-05-08T18:30:49.984562+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:54.158426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:30:50.981473+0000","last_change":"2024-05-08T18:30:49.983911+0000","last_active":"2024-05-08T18:30:50.981473+0000","last_peered":"2024-05-08T18:30:50.981473+0000","last_clean":"2024-05-08T18:30:50.981473+0000","last_became_active":"2024-05-08T18:30:49.983515+0000","last_became_peered":"2024-05-08T18:30:49.983515+0000","last_unstale":"2024-05-08T18:30:50.981473+0000","last_undegraded":"2024-05-08T18:30:50.981473+0000","last_fullsized":"2024-05-08T18:30:50.981473+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:40.629929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T18:30:49.984155+0000","last_change":"2024-05-08T18:30:49.982800+0000","last_active":"2024-05-08T18:30:49.984155+0000","last_peered":"2024-05-08T18:30:49.984155+0000","last_clean":"2024-05-08T18:30:49.984155+0000","last_became_active":"2024-05-08T18:30:49.982438+0000","last_became_peered":"2024-05-08T18:30:49.982438+0000","last_unstale":"2024-05-08T18:30:49.984155+0000","last_undegraded":"2024-05-08T18:30:49.984155+0000","last_fullsized":"2024-05-08T18:30:49.984155+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:18.812194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:30:50.981473+0000","last_change":"2024-05-08T18:30:49.983190+0000","last_active":"2024-05-08T18:30:50.981473+0000","last_peered":"2024-05-08T18:30:50.981473+0000","last_clean":"2024-05-08T18:30:50.981473+0000","last_became_active":"2024-05-08T18:30:49.982854+0000","last_became_peered":"2024-05-08T18:30:49.982854+0000","last_unstale":"2024-05-08T18:30:50.981473+0000","last_undegraded":"2024-05-08T18:30:50.981473+0000","last_fullsized":"2024-05-08T18:30:50.981473+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:33.902157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:30:50.981904+0000","last_change":"2024-05-08T18:30:49.983387+0000","last_active":"2024-05-08T18:30:50.981904+0000","last_peered":"2024-05-08T18:30:50.981904+0000","last_clean":"2024-05-08T18:30:50.981904+0000","last_became_active":"2024-05-08T18:30:49.983023+0000","last_became_peered":"2024-05-08T18:30:49.983023+0000","last_unstale":"2024-05-08T18:30:50.981904+0000","last_undegraded":"2024-05-08T18:30:50.981904+0000","last_fullsized":"2024-05-08T18:30:50.981904+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:49.558123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":99,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T18:30:50.382635+0000","last_change":"2024-05-08T18:30:49.982170+0000","last_active":"2024-05-08T18:30:50.382635+0000","last_peered":"2024-05-08T18:30:50.382635+0000","last_clean":"2024-05-08T18:30:50.382635+0000","last_became_active":"2024-05-08T18:30:49.981852+0000","last_became_peered":"2024-05-08T18:30:49.981852+0000","last_unstale":"2024-05-08T18:30:50.382635+0000","last_undegraded":"2024-05-08T18:30:50.382635+0000","last_fullsized":"2024-05-08T18:30:50.382635+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:23:21.435751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:30:53.359 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:30:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.463+0000 7f39a16ca640 1 Processor -- start 2024-05-08T18:30:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.463+0000 7f39a16ca640 1 -- start start 2024-05-08T18:30:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.463+0000 7f39a16ca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f399c132700 0x7f399c134af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.463+0000 7f39a16ca640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f399c072880 con 0x7f399c070000 2024-05-08T18:30:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.463+0000 7f39a16ca640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f399c072110 con 0x7f399c132700 2024-05-08T18:30:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.464+0000 7f3993fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f399c132700 0x7f399c134af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.464+0000 7f399affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f399c070000 0x7f399c0703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49834/0 (socket says 172.21.15.53:49834) 2024-05-08T18:30:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.464+0000 7f399affd640 1 -- 172.21.15.53:0/2186185047 learned_addr learned my addr 172.21.15.53:0/2186185047 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.464+0000 7f3993fff640 1 -- 172.21.15.53:0/2186185047 >> v1:172.21.15.53:6789/0 conn(0x7f399c070000 legacy=0x7f399c0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.464+0000 7f3993fff640 1 -- 172.21.15.53:0/2186185047 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399c072fd0 con 0x7f399c132700 2024-05-08T18:30:53.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.465+0000 7f3993fff640 1 --2- 172.21.15.53:0/2186185047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f399c132700 0x7f399c134af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3984009720 tx=0x7f398402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a77642e1ed7fa3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:53.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.465+0000 7f399a7fc640 1 -- 172.21.15.53:0/2186185047 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39840316d0 con 0x7f399c132700 2024-05-08T18:30:53.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.465+0000 7f399a7fc640 1 -- 172.21.15.53:0/2186185047 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3984037070 con 0x7f399c132700 2024-05-08T18:30:53.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.465+0000 7f399a7fc640 1 -- 172.21.15.53:0/2186185047 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39840319c0 con 0x7f399c132700 2024-05-08T18:30:53.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.465+0000 7f39a16ca640 1 -- 172.21.15.53:0/2186185047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f399c132700 msgr2=0x7f399c134af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:53.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.465+0000 7f39a16ca640 1 --2- 172.21.15.53:0/2186185047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f399c132700 0x7f399c134af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3984009720 tx=0x7f398402b840 comp rx=0 tx=0).stop 2024-05-08T18:30:53.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.465+0000 7f39a16ca640 1 -- 172.21.15.53:0/2186185047 shutdown_connections 2024-05-08T18:30:53.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.465+0000 7f39a16ca640 1 --2- 172.21.15.53:0/2186185047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f399c132700 0x7f399c134af0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:53.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.465+0000 7f39a16ca640 1 -- 172.21.15.53:0/2186185047 >> 172.21.15.53:0/2186185047 conn(0x7f399c09a910 msgr2=0x7f399c06e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:53.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.465+0000 7f39a16ca640 1 -- 172.21.15.53:0/2186185047 shutdown_connections 2024-05-08T18:30:53.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.465+0000 7f39a16ca640 1 -- 172.21.15.53:0/2186185047 wait complete. 2024-05-08T18:30:53.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.466+0000 7f39a16ca640 1 Processor -- start 2024-05-08T18:30:53.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.466+0000 7f39a16ca640 1 -- start start 2024-05-08T18:30:53.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.467+0000 7f39a16ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f399c070000 0x7f399c121260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:53.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.467+0000 7f39a16ca640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f399c070af0 con 0x7f399c070000 2024-05-08T18:30:53.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.467+0000 7f399affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f399c070000 0x7f399c121260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:53.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.467+0000 7f399affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f399c070000 0x7f399c121260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36636/0 (socket says 172.21.15.53:36636) 2024-05-08T18:30:53.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.467+0000 7f399affd640 1 -- 172.21.15.53:0/3231405234 learned_addr learned my addr 172.21.15.53:0/3231405234 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:53.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.467+0000 7f399affd640 1 -- 172.21.15.53:0/3231405234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399c12ff50 con 0x7f399c070000 2024-05-08T18:30:53.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.467+0000 7f399affd640 1 --2- 172.21.15.53:0/3231405234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f399c070000 0x7f399c121260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f398c00c4a0 tx=0x7f398c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:53.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.467+0000 7f39937fe640 1 -- 172.21.15.53:0/3231405234 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f398c017070 con 0x7f399c070000 2024-05-08T18:30:53.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.467+0000 7f39937fe640 1 -- 172.21.15.53:0/3231405234 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398c005c10 con 0x7f399c070000 2024-05-08T18:30:53.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.467+0000 7f39a16ca640 1 -- 172.21.15.53:0/3231405234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f399c1248e0 con 0x7f399c070000 2024-05-08T18:30:53.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.467+0000 7f39937fe640 1 -- 172.21.15.53:0/3231405234 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f398c007070 con 0x7f399c070000 2024-05-08T18:30:53.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.467+0000 7f39a16ca640 1 -- 172.21.15.53:0/3231405234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f399c121980 con 0x7f399c070000 2024-05-08T18:30:53.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.468+0000 7f39937fe640 1 -- 172.21.15.53:0/3231405234 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f398c01a070 con 0x7f399c070000 2024-05-08T18:30:53.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.468+0000 7f39937fe640 1 --2- 172.21.15.53:0/3231405234 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f397c03d2b0 0x7f397c03f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:53.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.468+0000 7f39a16ca640 1 -- 172.21.15.53:0/3231405234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f399c122c00 con 0x7f399c070000 2024-05-08T18:30:53.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.468+0000 7f39937fe640 1 -- 172.21.15.53:0/3231405234 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f398c0505d0 con 0x7f399c070000 2024-05-08T18:30:53.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.469+0000 7f3993fff640 1 --2- 172.21.15.53:0/3231405234 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f397c03d2b0 0x7f397c03f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:53.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.469+0000 7f3993fff640 1 --2- 172.21.15.53:0/3231405234 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f397c03d2b0 0x7f397c03f770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3984036000 tx=0x7f3984008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:53.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.473+0000 7f39937fe640 1 -- 172.21.15.53:0/3231405234 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f398c04c770 con 0x7f399c070000 2024-05-08T18:30:53.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.664+0000 7f39a16ca640 1 -- 172.21.15.53:0/3231405234 --> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f399c1323c0 con 0x7f397c03d2b0 2024-05-08T18:30:53.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.666+0000 7f39937fe640 1 -- 172.21.15.53:0/3231405234 <== mgr.4102 v2:172.21.15.87:6824/211215191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31856 (secure 0 0 0) 0x7f399c1323c0 con 0x7f397c03d2b0 2024-05-08T18:30:53.665 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:53.665 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:30:53.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.668+0000 7f39a16ca640 1 -- 172.21.15.53:0/3231405234 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f397c03d2b0 msgr2=0x7f397c03f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:53.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.668+0000 7f39a16ca640 1 --2- 172.21.15.53:0/3231405234 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f397c03d2b0 0x7f397c03f770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3984036000 tx=0x7f3984008030 comp rx=0 tx=0).stop 2024-05-08T18:30:53.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.668+0000 7f39a16ca640 1 -- 172.21.15.53:0/3231405234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f399c070000 msgr2=0x7f399c121260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:53.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.668+0000 7f39a16ca640 1 --2- 172.21.15.53:0/3231405234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f399c070000 0x7f399c121260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f398c00c4a0 tx=0x7f398c00c960 comp rx=0 tx=0).stop 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.668+0000 7f39a16ca640 1 -- 172.21.15.53:0/3231405234 shutdown_connections 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.668+0000 7f39a16ca640 1 --2- 172.21.15.53:0/3231405234 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f397c03d2b0 0x7f397c03f770 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.668+0000 7f39a16ca640 1 --2- 172.21.15.53:0/3231405234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f399c070000 0x7f399c121260 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.668+0000 7f39a16ca640 1 -- 172.21.15.53:0/3231405234 >> 172.21.15.53:0/3231405234 conn(0x7f399c09a910 msgr2=0x7f399c11a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.668+0000 7f39a16ca640 1 -- 172.21.15.53:0/3231405234 shutdown_connections 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.668+0000 7f39a16ca640 1 -- 172.21.15.53:0/3231405234 wait complete. 2024-05-08T18:30:53.679 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-05-08T18:30:52.101202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118432,"kb_used_data":1544,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377368928,"statfs":{"total":386547056640,"available":386425782272,"internally_reserved":0,"allocated":1581056,"data_stored":1287380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:30:50.981614+0000","last_change":"2024-05-08T18:30:49.984897+0000","last_active":"2024-05-08T18:30:50.981614+0000","last_peered":"2024-05-08T18:30:50.981614+0000","last_clean":"2024-05-08T18:30:50.981614+0000","last_became_active":"2024-05-08T18:30:49.984280+0000","last_became_peered":"2024-05-08T18:30:49.984280+0000","last_unstale":"2024-05-08T18:30:50.981614+0000","last_undegraded":"2024-05-08T18:30:50.981614+0000","last_fullsized":"2024-05-08T18:30:50.981614+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:26.601806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T18:30:49.983667+0000","last_change":"2024-05-08T18:30:49.982641+0000","last_active":"2024-05-08T18:30:49.983667+0000","last_peered":"2024-05-08T18:30:49.983667+0000","last_clean":"2024-05-08T18:30:49.983667+0000","last_became_active":"2024-05-08T18:30:49.982330+0000","last_became_peered":"2024-05-08T18:30:49.982330+0000","last_unstale":"2024-05-08T18:30:49.983667+0000","last_undegraded":"2024-05-08T18:30:49.983667+0000","last_fullsized":"2024-05-08T18:30:49.983667+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:54:57.041299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:30:50.981903+0000","last_change":"2024-05-08T18:30:49.982777+0000","last_active":"2024-05-08T18:30:50.981903+0000","last_peered":"2024-05-08T18:30:50.981903+0000","last_clean":"2024-05-08T18:30:50.981903+0000","last_became_active":"2024-05-08T18:30:49.982471+0000","last_became_peered":"2024-05-08T18:30:49.982471+0000","last_unstale":"2024-05-08T18:30:50.981903+0000","last_undegraded":"2024-05-08T18:30:50.981903+0000","last_fullsized":"2024-05-08T18:30:50.981903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:54.349839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T18:30:49.984562+0000","last_change":"2024-05-08T18:30:49.983824+0000","last_active":"2024-05-08T18:30:49.984562+0000","last_peered":"2024-05-08T18:30:49.984562+0000","last_clean":"2024-05-08T18:30:49.984562+0000","last_became_active":"2024-05-08T18:30:49.983522+0000","last_became_peered":"2024-05-08T18:30:49.983522+0000","last_unstale":"2024-05-08T18:30:49.984562+0000","last_undegraded":"2024-05-08T18:30:49.984562+0000","last_fullsized":"2024-05-08T18:30:49.984562+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:54.158426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:30:50.981473+0000","last_change":"2024-05-08T18:30:49.983911+0000","last_active":"2024-05-08T18:30:50.981473+0000","last_peered":"2024-05-08T18:30:50.981473+0000","last_clean":"2024-05-08T18:30:50.981473+0000","last_became_active":"2024-05-08T18:30:49.983515+0000","last_became_peered":"2024-05-08T18:30:49.983515+0000","last_unstale":"2024-05-08T18:30:50.981473+0000","last_undegraded":"2024-05-08T18:30:50.981473+0000","last_fullsized":"2024-05-08T18:30:50.981473+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:40.629929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T18:30:49.984155+0000","last_change":"2024-05-08T18:30:49.982800+0000","last_active":"2024-05-08T18:30:49.984155+0000","last_peered":"2024-05-08T18:30:49.984155+0000","last_clean":"2024-05-08T18:30:49.984155+0000","last_became_active":"2024-05-08T18:30:49.982438+0000","last_became_peered":"2024-05-08T18:30:49.982438+0000","last_unstale":"2024-05-08T18:30:49.984155+0000","last_undegraded":"2024-05-08T18:30:49.984155+0000","last_fullsized":"2024-05-08T18:30:49.984155+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:18.812194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:30:50.981473+0000","last_change":"2024-05-08T18:30:49.983190+0000","last_active":"2024-05-08T18:30:50.981473+0000","last_peered":"2024-05-08T18:30:50.981473+0000","last_clean":"2024-05-08T18:30:50.981473+0000","last_became_active":"2024-05-08T18:30:49.982854+0000","last_became_peered":"2024-05-08T18:30:49.982854+0000","last_unstale":"2024-05-08T18:30:50.981473+0000","last_undegraded":"2024-05-08T18:30:50.981473+0000","last_fullsized":"2024-05-08T18:30:50.981473+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:33.902157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:30:50.981904+0000","last_change":"2024-05-08T18:30:49.983387+0000","last_active":"2024-05-08T18:30:50.981904+0000","last_peered":"2024-05-08T18:30:50.981904+0000","last_clean":"2024-05-08T18:30:50.981904+0000","last_became_active":"2024-05-08T18:30:49.983023+0000","last_became_peered":"2024-05-08T18:30:49.983023+0000","last_unstale":"2024-05-08T18:30:50.981904+0000","last_undegraded":"2024-05-08T18:30:50.981904+0000","last_fullsized":"2024-05-08T18:30:50.981904+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:49.558123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":99,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T18:30:50.382635+0000","last_change":"2024-05-08T18:30:49.982170+0000","last_active":"2024-05-08T18:30:50.382635+0000","last_peered":"2024-05-08T18:30:50.382635+0000","last_clean":"2024-05-08T18:30:50.382635+0000","last_became_active":"2024-05-08T18:30:49.981852+0000","last_became_peered":"2024-05-08T18:30:49.981852+0000","last_unstale":"2024-05-08T18:30:50.382635+0000","last_undegraded":"2024-05-08T18:30:50.382635+0000","last_fullsized":"2024-05-08T18:30:50.382635+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:23:21.435751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:30:53.679 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T18:30:53.680 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T18:30:53.680 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-08T18:30:53.680 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-08T18:30:53.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.782+0000 7fd4c2f17640 1 Processor -- start 2024-05-08T18:30:53.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.782+0000 7fd4c2f17640 1 -- start start 2024-05-08T18:30:53.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.783+0000 7fd4c2f17640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd4bc12c7f0 0x7fd4bc12cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:53.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.783+0000 7fd4c2f17640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4bc0a23e0 con 0x7fd4bc070850 2024-05-08T18:30:53.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.783+0000 7fd4c2f17640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fd4bc072fc0 con 0x7fd4bc12c7f0 2024-05-08T18:30:53.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.783+0000 7fd4c0cb3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd4bc12c7f0 0x7fd4bc12cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:53.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.783+0000 7fd4bbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd4bc070850 0x7fd4bc070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49842/0 (socket says 172.21.15.53:49842) 2024-05-08T18:30:53.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.783+0000 7fd4c0cb3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd4bc12c7f0 0x7fd4bc12cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36646/0 (socket says 172.21.15.53:36646) 2024-05-08T18:30:53.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.783+0000 7fd4bbfff640 1 -- 172.21.15.53:0/3544349737 learned_addr learned my addr 172.21.15.53:0/3544349737 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:30:53.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.783+0000 7fd4c0cb3640 1 -- 172.21.15.53:0/3544349737 >> v1:172.21.15.53:6789/0 conn(0x7fd4bc070850 legacy=0x7fd4bc070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:53.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.783+0000 7fd4c0cb3640 1 -- 172.21.15.53:0/3544349737 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4bc071f80 con 0x7fd4bc12c7f0 2024-05-08T18:30:53.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.784+0000 7fd4c0cb3640 1 --2- 172.21.15.53:0/3544349737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4bc12c7f0 0x7fd4bc12cbd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009720 tx=0x7fd4ac02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284dc230f0d9e1ce server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:53.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.784+0000 7fd4bb7fe640 1 -- 172.21.15.53:0/3544349737 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ac0316d0 con 0x7fd4bc12c7f0 2024-05-08T18:30:53.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.784+0000 7fd4bb7fe640 1 -- 172.21.15.53:0/3544349737 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ac037070 con 0x7fd4bc12c7f0 2024-05-08T18:30:53.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.784+0000 7fd4bb7fe640 1 -- 172.21.15.53:0/3544349737 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ac0319c0 con 0x7fd4bc12c7f0 2024-05-08T18:30:53.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.785+0000 7fd4c2f17640 1 -- 172.21.15.53:0/3544349737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4bc12c7f0 msgr2=0x7fd4bc12cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:53.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.785+0000 7fd4c2f17640 1 --2- 172.21.15.53:0/3544349737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4bc12c7f0 0x7fd4bc12cbd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009720 tx=0x7fd4ac02b840 comp rx=0 tx=0).stop 2024-05-08T18:30:53.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.785+0000 7fd4c2f17640 1 -- 172.21.15.53:0/3544349737 shutdown_connections 2024-05-08T18:30:53.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.785+0000 7fd4c2f17640 1 --2- 172.21.15.53:0/3544349737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4bc12c7f0 0x7fd4bc12cbd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:53.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.785+0000 7fd4c2f17640 1 -- 172.21.15.53:0/3544349737 >> 172.21.15.53:0/3544349737 conn(0x7fd4bc09ff90 msgr2=0x7fd4bc0a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:53.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.785+0000 7fd4c2f17640 1 -- 172.21.15.53:0/3544349737 shutdown_connections 2024-05-08T18:30:53.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.785+0000 7fd4c2f17640 1 -- 172.21.15.53:0/3544349737 wait complete. 2024-05-08T18:30:53.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.786+0000 7fd4c2f17640 1 Processor -- start 2024-05-08T18:30:53.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.786+0000 7fd4c2f17640 1 -- start start 2024-05-08T18:30:53.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.786+0000 7fd4c2f17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4bc070850 0x7fd4bc11a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:53.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.786+0000 7fd4c2f17640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd4bc071530 con 0x7fd4bc070850 2024-05-08T18:30:53.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.786+0000 7fd4c0cb3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4bc070850 0x7fd4bc11a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:53.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.786+0000 7fd4c0cb3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4bc070850 0x7fd4bc11a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36658/0 (socket says 172.21.15.53:36658) 2024-05-08T18:30:53.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.786+0000 7fd4c0cb3640 1 -- 172.21.15.53:0/3572739456 learned_addr learned my addr 172.21.15.53:0/3572739456 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:30:53.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.786+0000 7fd4c0cb3640 1 -- 172.21.15.53:0/3572739456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4bc11bbf0 con 0x7fd4bc070850 2024-05-08T18:30:53.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.787+0000 7fd4c0cb3640 1 --2- 172.21.15.53:0/3572739456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4bc070850 0x7fd4bc11a330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac034040 tx=0x7fd4ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:53.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.787+0000 7fd4b97fa640 1 -- 172.21.15.53:0/3572739456 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ac032770 con 0x7fd4bc070850 2024-05-08T18:30:53.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.787+0000 7fd4b97fa640 1 -- 172.21.15.53:0/3572739456 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ac032910 con 0x7fd4bc070850 2024-05-08T18:30:53.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.787+0000 7fd4b97fa640 1 -- 172.21.15.53:0/3572739456 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ac032c10 con 0x7fd4bc070850 2024-05-08T18:30:53.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.787+0000 7fd4c2f17640 1 -- 172.21.15.53:0/3572739456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4bc11d8d0 con 0x7fd4bc070850 2024-05-08T18:30:53.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.787+0000 7fd4c2f17640 1 -- 172.21.15.53:0/3572739456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4bc129e30 con 0x7fd4bc070850 2024-05-08T18:30:53.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.788+0000 7fd4b97fa640 1 -- 172.21.15.53:0/3572739456 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd4ac04c060 con 0x7fd4bc070850 2024-05-08T18:30:53.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.788+0000 7fd4c2f17640 1 -- 172.21.15.53:0/3572739456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4bc064010 con 0x7fd4bc070850 2024-05-08T18:30:53.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.788+0000 7fd4b97fa640 1 --2- 172.21.15.53:0/3572739456 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4a803d2b0 0x7fd4a803f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:53.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.788+0000 7fd4b97fa640 1 -- 172.21.15.53:0/3572739456 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fd4ac02f050 con 0x7fd4bc070850 2024-05-08T18:30:53.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.788+0000 7fd4bbfff640 1 --2- 172.21.15.53:0/3572739456 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4a803d2b0 0x7fd4a803f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:53.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.789+0000 7fd4bbfff640 1 --2- 172.21.15.53:0/3572739456 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4a803d2b0 0x7fd4a803f770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0007fd0 tx=0x7fd4b0007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:53.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:53.793+0000 7fd4b97fa640 1 -- 172.21.15.53:0/3572739456 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd4ac040070 con 0x7fd4bc070850 2024-05-08T18:30:54.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:54.020+0000 7fd4c2f17640 1 -- 172.21.15.53:0/3572739456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd4bc0a2930 con 0x7fd4bc070850 2024-05-08T18:30:54.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:54.020+0000 7fd4b97fa640 1 -- 172.21.15.53:0/3572739456 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd4ac04dc40 con 0x7fd4bc070850 2024-05-08T18:30:54.019 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:30:54.020 INFO:teuthology.orchestra.run.smithi053.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T18:30:54.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:54.022+0000 7fd4c2f17640 1 -- 172.21.15.53:0/3572739456 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4a803d2b0 msgr2=0x7fd4a803f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:54.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:54.022+0000 7fd4c2f17640 1 --2- 172.21.15.53:0/3572739456 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4a803d2b0 0x7fd4a803f770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0007fd0 tx=0x7fd4b0007ac0 comp rx=0 tx=0).stop 2024-05-08T18:30:54.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:54.022+0000 7fd4c2f17640 1 -- 172.21.15.53:0/3572739456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4bc070850 msgr2=0x7fd4bc11a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:54.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:54.022+0000 7fd4c2f17640 1 --2- 172.21.15.53:0/3572739456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4bc070850 0x7fd4bc11a330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac034040 tx=0x7fd4ac0046c0 comp rx=0 tx=0).stop 2024-05-08T18:30:54.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:54.022+0000 7fd4c2f17640 1 -- 172.21.15.53:0/3572739456 shutdown_connections 2024-05-08T18:30:54.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:54.022+0000 7fd4c2f17640 1 --2- 172.21.15.53:0/3572739456 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4a803d2b0 0x7fd4a803f770 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:54.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:54.022+0000 7fd4c2f17640 1 --2- 172.21.15.53:0/3572739456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4bc070850 0x7fd4bc11a330 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:54.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:54.022+0000 7fd4c2f17640 1 -- 172.21.15.53:0/3572739456 >> 172.21.15.53:0/3572739456 conn(0x7fd4bc09ff90 msgr2=0x7fd4bc1b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:54.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:54.022+0000 7fd4c2f17640 1 -- 172.21.15.53:0/3572739456 shutdown_connections 2024-05-08T18:30:54.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:30:54.022+0000 7fd4c2f17640 1 -- 172.21.15.53:0/3572739456 wait complete. 2024-05-08T18:30:54.032 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-08T18:30:54.033 INFO:teuthology.run_tasks:Running task rgw... 2024-05-08T18:30:54.049 DEBUG:tasks.rgw:config is {'client.0': None} 2024-05-08T18:30:54.049 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-05-08T18:30:54.050 INFO:tasks.rgw:Creating data pools 2024-05-08T18:30:54.050 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-05-08T18:30:54.050 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-05-08T18:30:54.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.165+0000 7f554919d640 1 Processor -- start 2024-05-08T18:30:54.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.165+0000 7f554919d640 1 -- start start 2024-05-08T18:30:54.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.165+0000 7f554919d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5544118d80 0x7f5544119160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:54.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.165+0000 7f554919d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5544119820 con 0x7f5544112ab0 2024-05-08T18:30:54.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.165+0000 7f554919d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5544113670 con 0x7f5544118d80 2024-05-08T18:30:54.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.166+0000 7f5542d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5544118d80 0x7f5544119160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:54.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.166+0000 7f5542d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5544118d80 0x7f5544119160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:41170/0 (socket says 172.21.15.87:41170) 2024-05-08T18:30:54.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.166+0000 7f5542d9d640 1 -- 172.21.15.87:0/1821827361 learned_addr learned my addr 172.21.15.87:0/1821827361 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:30:54.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.166+0000 7f554259c640 1 --1- 172.21.15.87:0/1821827361 >> v1:172.21.15.53:6789/0 conn(0x7f5544112ab0 0x7f5544112f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:36894/0 (socket says 172.21.15.87:36894) 2024-05-08T18:30:54.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.166+0000 7f5542d9d640 1 -- 172.21.15.87:0/1821827361 >> v1:172.21.15.53:6789/0 conn(0x7f5544112ab0 legacy=0x7f5544112f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:54.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.166+0000 7f5542d9d640 1 -- 172.21.15.87:0/1821827361 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5544113820 con 0x7f5544118d80 2024-05-08T18:30:54.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.167+0000 7f5542d9d640 1 --2- 172.21.15.87:0/1821827361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5544118d80 0x7f5544119160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5534009e50 tx=0x7f553402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5d545e0b28d7ab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:54.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.167+0000 7f5541d9b640 1 -- 172.21.15.87:0/1821827361 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f553402c8a0 con 0x7f5544118d80 2024-05-08T18:30:54.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.167+0000 7f5541d9b640 1 -- 172.21.15.87:0/1821827361 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f553402ca40 con 0x7f5544118d80 2024-05-08T18:30:54.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.167+0000 7f5541d9b640 1 -- 172.21.15.87:0/1821827361 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f553402cd40 con 0x7f5544118d80 2024-05-08T18:30:54.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.167+0000 7f554919d640 1 -- 172.21.15.87:0/1821827361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5544118d80 msgr2=0x7f5544119160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:54.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.167+0000 7f554919d640 1 --2- 172.21.15.87:0/1821827361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5544118d80 0x7f5544119160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5534009e50 tx=0x7f553402bf80 comp rx=0 tx=0).stop 2024-05-08T18:30:54.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.167+0000 7f554919d640 1 -- 172.21.15.87:0/1821827361 shutdown_connections 2024-05-08T18:30:54.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.167+0000 7f554919d640 1 --2- 172.21.15.87:0/1821827361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5544118d80 0x7f5544119160 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:54.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.167+0000 7f554919d640 1 -- 172.21.15.87:0/1821827361 >> 172.21.15.87:0/1821827361 conn(0x7f554406fa10 msgr2=0x7f5544110dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:54.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.168+0000 7f554919d640 1 -- 172.21.15.87:0/1821827361 shutdown_connections 2024-05-08T18:30:54.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.168+0000 7f554919d640 1 -- 172.21.15.87:0/1821827361 wait complete. 2024-05-08T18:30:54.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.169+0000 7f554919d640 1 Processor -- start 2024-05-08T18:30:54.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.169+0000 7f554919d640 1 -- start start 2024-05-08T18:30:54.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.169+0000 7f554919d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5544112ab0 0x7f55441ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:54.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.169+0000 7f554919d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f554411eee0 con 0x7f5544112ab0 2024-05-08T18:30:54.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.169+0000 7f5542d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5544112ab0 0x7f55441ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:54.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.169+0000 7f5542d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5544112ab0 0x7f55441ad450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:41180/0 (socket says 172.21.15.87:41180) 2024-05-08T18:30:54.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.169+0000 7f5542d9d640 1 -- 172.21.15.87:0/3346853662 learned_addr learned my addr 172.21.15.87:0/3346853662 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:30:54.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.169+0000 7f5542d9d640 1 -- 172.21.15.87:0/3346853662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55441ada20 con 0x7f5544112ab0 2024-05-08T18:30:54.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.170+0000 7f5542d9d640 1 --2- 172.21.15.87:0/3346853662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5544112ab0 0x7f55441ad450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5534000f80 tx=0x7f5534004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.170+0000 7f552b7fe640 1 -- 172.21.15.87:0/3346853662 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5534043020 con 0x7f5544112ab0 2024-05-08T18:30:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.170+0000 7f552b7fe640 1 -- 172.21.15.87:0/3346853662 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f553403e660 con 0x7f5544112ab0 2024-05-08T18:30:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.170+0000 7f554919d640 1 -- 172.21.15.87:0/3346853662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55441adc50 con 0x7f5544112ab0 2024-05-08T18:30:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.170+0000 7f552b7fe640 1 -- 172.21.15.87:0/3346853662 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f553403e960 con 0x7f5544112ab0 2024-05-08T18:30:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.170+0000 7f554919d640 1 -- 172.21.15.87:0/3346853662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55441a7560 con 0x7f5544112ab0 2024-05-08T18:30:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.171+0000 7f552b7fe640 1 -- 172.21.15.87:0/3346853662 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5534046020 con 0x7f5544112ab0 2024-05-08T18:30:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.171+0000 7f554919d640 1 -- 172.21.15.87:0/3346853662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5544050f90 con 0x7f5544112ab0 2024-05-08T18:30:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.171+0000 7f552b7fe640 1 --2- 172.21.15.87:0/3346853662 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f553003d2b0 0x7f553003f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.171+0000 7f552b7fe640 1 -- 172.21.15.87:0/3346853662 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f553403a040 con 0x7f5544112ab0 2024-05-08T18:30:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.171+0000 7f554259c640 1 --2- 172.21.15.87:0/3346853662 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f553003d2b0 0x7f553003f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:54.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.171+0000 7f554259c640 1 --2- 172.21.15.87:0/3346853662 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f553003d2b0 0x7f553003f770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f55380015f0 tx=0x7f5538007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:54.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.176+0000 7f552b7fe640 1 -- 172.21.15.87:0/3346853662 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f553404d030 con 0x7f5544112ab0 2024-05-08T18:30:54.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:54.364+0000 7f554919d640 1 -- 172.21.15.87:0/3346853662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) -- 0x7f5544118d80 con 0x7f5544112ab0 2024-05-08T18:30:55.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.252+0000 7f552b7fe640 1 -- 172.21.15.87:0/3346853662 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v13) ==== 171+0+0 (secure 0 0 0) 0x7f55340333a0 con 0x7f5544112ab0 2024-05-08T18:30:55.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.254+0000 7f554919d640 1 -- 172.21.15.87:0/3346853662 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f553003d2b0 msgr2=0x7f553003f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:55.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.254+0000 7f554919d640 1 --2- 172.21.15.87:0/3346853662 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f553003d2b0 0x7f553003f770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f55380015f0 tx=0x7f5538007a40 comp rx=0 tx=0).stop 2024-05-08T18:30:55.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.254+0000 7f554919d640 1 -- 172.21.15.87:0/3346853662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5544112ab0 msgr2=0x7f55441ad450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:55.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.254+0000 7f554919d640 1 --2- 172.21.15.87:0/3346853662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5544112ab0 0x7f55441ad450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5534000f80 tx=0x7f5534004a40 comp rx=0 tx=0).stop 2024-05-08T18:30:55.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.254+0000 7f554919d640 1 -- 172.21.15.87:0/3346853662 shutdown_connections 2024-05-08T18:30:55.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.254+0000 7f554919d640 1 --2- 172.21.15.87:0/3346853662 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f553003d2b0 0x7f553003f770 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:55.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.254+0000 7f554919d640 1 --2- 172.21.15.87:0/3346853662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5544112ab0 0x7f55441ad450 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:55.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.254+0000 7f554919d640 1 -- 172.21.15.87:0/3346853662 >> 172.21.15.87:0/3346853662 conn(0x7f554406fa10 msgr2=0x7f5544114db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:55.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.254+0000 7f554919d640 1 -- 172.21.15.87:0/3346853662 shutdown_connections 2024-05-08T18:30:55.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.254+0000 7f554919d640 1 -- 172.21.15.87:0/3346853662 wait complete. 2024-05-08T18:30:55.264 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-05-08T18:30:55.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.368+0000 7feff240a640 1 Processor -- start 2024-05-08T18:30:55.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.368+0000 7feff240a640 1 -- start start 2024-05-08T18:30:55.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.368+0000 7feff240a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fefec10f020 0x7fefec10f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:55.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.368+0000 7feff240a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefec10fb90 con 0x7fefec1189b0 2024-05-08T18:30:55.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.368+0000 7feff240a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fefec11d4d0 con 0x7fefec10f020 2024-05-08T18:30:55.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.369+0000 7fefebfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fefec10f020 0x7fefec10f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:55.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.369+0000 7fefeb7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fefec1189b0 0x7fefec11ada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:36910/0 (socket says 172.21.15.87:36910) 2024-05-08T18:30:55.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.369+0000 7fefeb7fe640 1 -- 172.21.15.87:0/108299543 learned_addr learned my addr 172.21.15.87:0/108299543 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:30:55.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.369+0000 7fefeaffd640 1 -- 172.21.15.87:0/108299543 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4263798263 0 0) 0x7fefec10fb90 con 0x7fefec1189b0 2024-05-08T18:30:55.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.369+0000 7fefeaffd640 1 -- 172.21.15.87:0/108299543 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefd4003520 con 0x7fefec1189b0 2024-05-08T18:30:55.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.369+0000 7fefebfff640 1 -- 172.21.15.87:0/108299543 >> v1:172.21.15.53:6789/0 conn(0x7fefec1189b0 legacy=0x7fefec11ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:55.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.369+0000 7fefebfff640 1 -- 172.21.15.87:0/108299543 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefec11d650 con 0x7fefec10f020 2024-05-08T18:30:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.370+0000 7fefebfff640 1 --2- 172.21.15.87:0/108299543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefec10f020 0x7fefec10f400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009720 tx=0x7fefdc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516853376abecea5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.370+0000 7fefeaffd640 1 -- 172.21.15.87:0/108299543 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefdc0316d0 con 0x7fefec10f020 2024-05-08T18:30:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.370+0000 7fefeaffd640 1 -- 172.21.15.87:0/108299543 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefdc037070 con 0x7fefec10f020 2024-05-08T18:30:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.370+0000 7fefeaffd640 1 -- 172.21.15.87:0/108299543 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefdc0319c0 con 0x7fefec10f020 2024-05-08T18:30:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.371+0000 7feff240a640 1 -- 172.21.15.87:0/108299543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefec10f020 msgr2=0x7fefec10f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.371+0000 7feff240a640 1 --2- 172.21.15.87:0/108299543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefec10f020 0x7fefec10f400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009720 tx=0x7fefdc02b840 comp rx=0 tx=0).stop 2024-05-08T18:30:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.371+0000 7feff240a640 1 -- 172.21.15.87:0/108299543 shutdown_connections 2024-05-08T18:30:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.371+0000 7feff240a640 1 --2- 172.21.15.87:0/108299543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefec10f020 0x7fefec10f400 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.371+0000 7feff240a640 1 -- 172.21.15.87:0/108299543 >> 172.21.15.87:0/108299543 conn(0x7fefec0706c0 msgr2=0x7fefec072ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.371+0000 7feff240a640 1 -- 172.21.15.87:0/108299543 shutdown_connections 2024-05-08T18:30:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.371+0000 7feff240a640 1 -- 172.21.15.87:0/108299543 wait complete. 2024-05-08T18:30:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.371+0000 7feff240a640 1 Processor -- start 2024-05-08T18:30:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.372+0000 7feff240a640 1 -- start start 2024-05-08T18:30:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.372+0000 7feff240a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefec10f020 0x7fefec110820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.372+0000 7feff240a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fefec11c9e0 con 0x7fefec10f020 2024-05-08T18:30:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.372+0000 7fefebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefec10f020 0x7fefec110820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.372+0000 7fefebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefec10f020 0x7fefec110820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:41208/0 (socket says 172.21.15.87:41208) 2024-05-08T18:30:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.372+0000 7fefebfff640 1 -- 172.21.15.87:0/556672148 learned_addr learned my addr 172.21.15.87:0/556672148 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:30:55.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.372+0000 7fefebfff640 1 -- 172.21.15.87:0/556672148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefec110d60 con 0x7fefec10f020 2024-05-08T18:30:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.373+0000 7fefebfff640 1 --2- 172.21.15.87:0/556672148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefec10f020 0x7fefec110820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fefdc034040 tx=0x7fefdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.373+0000 7fefe8ff9640 1 -- 172.21.15.87:0/556672148 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefdc032560 con 0x7fefec10f020 2024-05-08T18:30:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.373+0000 7fefe8ff9640 1 -- 172.21.15.87:0/556672148 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefdc032700 con 0x7fefec10f020 2024-05-08T18:30:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.373+0000 7fefe8ff9640 1 -- 172.21.15.87:0/556672148 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefdc032a20 con 0x7fefec10f020 2024-05-08T18:30:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.373+0000 7feff240a640 1 -- 172.21.15.87:0/556672148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefec110f90 con 0x7fefec10f020 2024-05-08T18:30:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.373+0000 7feff240a640 1 -- 172.21.15.87:0/556672148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefec111480 con 0x7fefec10f020 2024-05-08T18:30:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.374+0000 7feff240a640 1 -- 172.21.15.87:0/556672148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefec050f90 con 0x7fefec10f020 2024-05-08T18:30:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.374+0000 7fefe8ff9640 1 -- 172.21.15.87:0/556672148 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fefdc04c060 con 0x7fefec10f020 2024-05-08T18:30:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.374+0000 7fefe8ff9640 1 --2- 172.21.15.87:0/556672148 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fefd803d2b0 0x7fefd803f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:55.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.374+0000 7fefe8ff9640 1 -- 172.21.15.87:0/556672148 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3797+0+0 (secure 0 0 0) 0x7fefdc02f050 con 0x7fefec10f020 2024-05-08T18:30:55.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.374+0000 7fefeb7fe640 1 --2- 172.21.15.87:0/556672148 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fefd803d2b0 0x7fefd803f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:55.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.375+0000 7fefeb7fe640 1 --2- 172.21.15.87:0/556672148 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fefd803d2b0 0x7fefd803f770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fefe00011e0 tx=0x7fefe0007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:55.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.379+0000 7fefe8ff9640 1 -- 172.21.15.87:0/556672148 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fefdc040070 con 0x7fefec10f020 2024-05-08T18:30:55.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:55.556+0000 7feff240a640 1 -- 172.21.15.87:0/556672148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7fefec1189b0 con 0x7fefec10f020 2024-05-08T18:30:57.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.256+0000 7fefe8ff9640 1 -- 172.21.15.87:0/556672148 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v15) ==== 227+0+0 (secure 0 0 0) 0x7fefdc03bde0 con 0x7fefec10f020 2024-05-08T18:30:57.254 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'default.rgw.buckets.data' created 2024-05-08T18:30:57.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.259+0000 7feff240a640 1 -- 172.21.15.87:0/556672148 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fefd803d2b0 msgr2=0x7fefd803f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:57.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.259+0000 7feff240a640 1 --2- 172.21.15.87:0/556672148 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fefd803d2b0 0x7fefd803f770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fefe00011e0 tx=0x7fefe0007970 comp rx=0 tx=0).stop 2024-05-08T18:30:57.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.259+0000 7feff240a640 1 -- 172.21.15.87:0/556672148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefec10f020 msgr2=0x7fefec110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:57.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.259+0000 7feff240a640 1 --2- 172.21.15.87:0/556672148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefec10f020 0x7fefec110820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fefdc034040 tx=0x7fefdc0046c0 comp rx=0 tx=0).stop 2024-05-08T18:30:57.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.259+0000 7feff240a640 1 -- 172.21.15.87:0/556672148 shutdown_connections 2024-05-08T18:30:57.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.259+0000 7feff240a640 1 --2- 172.21.15.87:0/556672148 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fefd803d2b0 0x7fefd803f770 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:57.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.259+0000 7feff240a640 1 --2- 172.21.15.87:0/556672148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefec10f020 0x7fefec110820 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:57.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.259+0000 7feff240a640 1 -- 172.21.15.87:0/556672148 >> 172.21.15.87:0/556672148 conn(0x7fefec0706c0 msgr2=0x7fefec070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:57.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.259+0000 7feff240a640 1 -- 172.21.15.87:0/556672148 shutdown_connections 2024-05-08T18:30:57.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.259+0000 7feff240a640 1 -- 172.21.15.87:0/556672148 wait complete. 2024-05-08T18:30:57.279 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-05-08T18:30:57.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.385+0000 7f6ad9b42640 1 Processor -- start 2024-05-08T18:30:57.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.385+0000 7f6ad9b42640 1 -- start start 2024-05-08T18:30:57.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.385+0000 7f6ad9b42640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6ad410f020 0x7f6ad410f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:57.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.385+0000 7f6ad9b42640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad410fbd0 con 0x7f6ad41189b0 2024-05-08T18:30:57.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.385+0000 7f6ad9b42640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f6ad411d4d0 con 0x7f6ad410f020 2024-05-08T18:30:57.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.385+0000 7f6ad37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6ad410f020 0x7f6ad410f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:57.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.385+0000 7f6ad2ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6ad41189b0 0x7f6ad411ada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:36916/0 (socket says 172.21.15.87:36916) 2024-05-08T18:30:57.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.385+0000 7f6ad2ffd640 1 -- 172.21.15.87:0/2180166026 learned_addr learned my addr 172.21.15.87:0/2180166026 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:30:57.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.385+0000 7f6ad37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6ad410f020 0x7f6ad410f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:41224/0 (socket says 172.21.15.87:41224) 2024-05-08T18:30:57.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.386+0000 7f6ad37fe640 1 -- 172.21.15.87:0/2180166026 >> v1:172.21.15.53:6789/0 conn(0x7f6ad41189b0 legacy=0x7f6ad411ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:57.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.386+0000 7f6ad37fe640 1 -- 172.21.15.87:0/2180166026 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad411d680 con 0x7f6ad410f020 2024-05-08T18:30:57.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.386+0000 7f6ad37fe640 1 --2- 172.21.15.87:0/2180166026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ad410f020 0x7f6ad410f400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009720 tx=0x7f6ac402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51158ffaf8ea6953 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:57.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.387+0000 7f6ad27fc640 1 -- 172.21.15.87:0/2180166026 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac40316d0 con 0x7f6ad410f020 2024-05-08T18:30:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.387+0000 7f6ad27fc640 1 -- 172.21.15.87:0/2180166026 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac4037070 con 0x7f6ad410f020 2024-05-08T18:30:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.387+0000 7f6ad27fc640 1 -- 172.21.15.87:0/2180166026 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac40319c0 con 0x7f6ad410f020 2024-05-08T18:30:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.387+0000 7f6ad9b42640 1 -- 172.21.15.87:0/2180166026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ad410f020 msgr2=0x7f6ad410f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.387+0000 7f6ad9b42640 1 --2- 172.21.15.87:0/2180166026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ad410f020 0x7f6ad410f400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009720 tx=0x7f6ac402b840 comp rx=0 tx=0).stop 2024-05-08T18:30:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.387+0000 7f6ad9b42640 1 -- 172.21.15.87:0/2180166026 shutdown_connections 2024-05-08T18:30:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.387+0000 7f6ad9b42640 1 --2- 172.21.15.87:0/2180166026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ad410f020 0x7f6ad410f400 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.387+0000 7f6ad9b42640 1 -- 172.21.15.87:0/2180166026 >> 172.21.15.87:0/2180166026 conn(0x7f6ad40705a0 msgr2=0x7f6ad40729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.387+0000 7f6ad9b42640 1 -- 172.21.15.87:0/2180166026 shutdown_connections 2024-05-08T18:30:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.387+0000 7f6ad9b42640 1 -- 172.21.15.87:0/2180166026 wait complete. 2024-05-08T18:30:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.388+0000 7f6ad9b42640 1 Processor -- start 2024-05-08T18:30:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.388+0000 7f6ad9b42640 1 -- start start 2024-05-08T18:30:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.388+0000 7f6ad9b42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ad410f020 0x7f6ad41a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.388+0000 7f6ad9b42640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad411c9e0 con 0x7f6ad410f020 2024-05-08T18:30:57.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.388+0000 7f6ad37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ad410f020 0x7f6ad41a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:57.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.388+0000 7f6ad37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ad410f020 0x7f6ad41a5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:41238/0 (socket says 172.21.15.87:41238) 2024-05-08T18:30:57.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.389+0000 7f6ad37fe640 1 -- 172.21.15.87:0/2009874360 learned_addr learned my addr 172.21.15.87:0/2009874360 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:30:57.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.389+0000 7f6ad37fe640 1 -- 172.21.15.87:0/2009874360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad41a5f20 con 0x7f6ad410f020 2024-05-08T18:30:57.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.389+0000 7f6ad37fe640 1 --2- 172.21.15.87:0/2009874360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ad410f020 0x7f6ad41a5950 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4034040 tx=0x7f6ac40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:57.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.389+0000 7f6abbfff640 1 -- 172.21.15.87:0/2009874360 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac4032770 con 0x7f6ad410f020 2024-05-08T18:30:57.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.389+0000 7f6abbfff640 1 -- 172.21.15.87:0/2009874360 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac4032910 con 0x7f6ad410f020 2024-05-08T18:30:57.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.389+0000 7f6abbfff640 1 -- 172.21.15.87:0/2009874360 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac4032c10 con 0x7f6ad410f020 2024-05-08T18:30:57.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.389+0000 7f6ad9b42640 1 -- 172.21.15.87:0/2009874360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad41a61b0 con 0x7f6ad410f020 2024-05-08T18:30:57.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.389+0000 7f6ad9b42640 1 -- 172.21.15.87:0/2009874360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad41aa1e0 con 0x7f6ad410f020 2024-05-08T18:30:57.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.390+0000 7f6ad9b42640 1 -- 172.21.15.87:0/2009874360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad4050f90 con 0x7f6ad410f020 2024-05-08T18:30:57.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.390+0000 7f6abbfff640 1 -- 172.21.15.87:0/2009874360 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6ac404c060 con 0x7f6ad410f020 2024-05-08T18:30:57.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.391+0000 7f6abbfff640 1 --2- 172.21.15.87:0/2009874360 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6ac003d260 0x7f6ac003f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:57.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.391+0000 7f6abbfff640 1 -- 172.21.15.87:0/2009874360 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4272+0+0 (secure 0 0 0) 0x7f6ac402f050 con 0x7f6ad410f020 2024-05-08T18:30:57.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.391+0000 7f6ad2ffd640 1 --2- 172.21.15.87:0/2009874360 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6ac003d260 0x7f6ac003f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:57.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.391+0000 7f6ad2ffd640 1 --2- 172.21.15.87:0/2009874360 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6ac003d260 0x7f6ac003f720 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8000f60 tx=0x7f6ac8007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:57.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.396+0000 7f6abbfff640 1 -- 172.21.15.87:0/2009874360 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6ac4040070 con 0x7f6ad410f020 2024-05-08T18:30:57.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:57.575+0000 7f6ad9b42640 1 -- 172.21.15.87:0/2009874360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f6ad41a6380 con 0x7f6ad410f020 2024-05-08T18:30:58.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.261+0000 7f6abbfff640 1 -- 172.21.15.87:0/2009874360 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v16) ==== 185+0+0 (secure 0 0 0) 0x7f6ac404de20 con 0x7f6ad410f020 2024-05-08T18:30:58.260 INFO:teuthology.orchestra.run.smithi087.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-05-08T18:30:58.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.264+0000 7f6ad9b42640 1 -- 172.21.15.87:0/2009874360 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6ac003d260 msgr2=0x7f6ac003f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:58.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.264+0000 7f6ad9b42640 1 --2- 172.21.15.87:0/2009874360 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6ac003d260 0x7f6ac003f720 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8000f60 tx=0x7f6ac8007a80 comp rx=0 tx=0).stop 2024-05-08T18:30:58.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.264+0000 7f6ad9b42640 1 -- 172.21.15.87:0/2009874360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ad410f020 msgr2=0x7f6ad41a5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:58.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.264+0000 7f6ad9b42640 1 --2- 172.21.15.87:0/2009874360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ad410f020 0x7f6ad41a5950 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4034040 tx=0x7f6ac40046c0 comp rx=0 tx=0).stop 2024-05-08T18:30:58.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.264+0000 7f6ad9b42640 1 -- 172.21.15.87:0/2009874360 shutdown_connections 2024-05-08T18:30:58.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.264+0000 7f6ad9b42640 1 --2- 172.21.15.87:0/2009874360 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6ac003d260 0x7f6ac003f720 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:58.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.264+0000 7f6ad9b42640 1 --2- 172.21.15.87:0/2009874360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ad410f020 0x7f6ad41a5950 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:58.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.264+0000 7f6ad9b42640 1 -- 172.21.15.87:0/2009874360 >> 172.21.15.87:0/2009874360 conn(0x7f6ad40705a0 msgr2=0x7f6ad4070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:58.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.264+0000 7f6ad9b42640 1 -- 172.21.15.87:0/2009874360 shutdown_connections 2024-05-08T18:30:58.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.264+0000 7f6ad9b42640 1 -- 172.21.15.87:0/2009874360 wait complete. 2024-05-08T18:30:58.284 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-05-08T18:30:58.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.398+0000 7f24ec91c640 1 Processor -- start 2024-05-08T18:30:58.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.398+0000 7f24ec91c640 1 -- start start 2024-05-08T18:30:58.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.398+0000 7f24ec91c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f24e81109c0 0x7f24e8110dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:58.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.398+0000 7f24ec91c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24e811b0d0 con 0x7f24e81113c0 2024-05-08T18:30:58.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.398+0000 7f24ec91c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f24e811c2d0 con 0x7f24e81109c0 2024-05-08T18:30:58.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.398+0000 7f24e659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f24e81109c0 0x7f24e8110dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:58.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.398+0000 7f24e659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f24e81109c0 0x7f24e8110dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:41248/0 (socket says 172.21.15.87:41248) 2024-05-08T18:30:58.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.398+0000 7f24ddd9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f24e81113c0 0x7f24e8119870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:36922/0 (socket says 172.21.15.87:36922) 2024-05-08T18:30:58.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.398+0000 7f24e659c640 1 -- 172.21.15.87:0/3831918144 learned_addr learned my addr 172.21.15.87:0/3831918144 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:30:58.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.399+0000 7f24e659c640 1 -- 172.21.15.87:0/3831918144 >> v1:172.21.15.53:6789/0 conn(0x7f24e81113c0 legacy=0x7f24e8119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:58.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.399+0000 7f24e659c640 1 -- 172.21.15.87:0/3831918144 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e811c480 con 0x7f24e81109c0 2024-05-08T18:30:58.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.399+0000 7f24e659c640 1 --2- 172.21.15.87:0/3831918144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e81109c0 0x7f24e8110dc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f24d800ba90 tx=0x7f24d802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960e3e7eaa1b732d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:58.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.400+0000 7f24e5d9b640 1 -- 172.21.15.87:0/3831918144 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d803b070 con 0x7f24e81109c0 2024-05-08T18:30:58.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.400+0000 7f24e5d9b640 1 -- 172.21.15.87:0/3831918144 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d802edc0 con 0x7f24e81109c0 2024-05-08T18:30:58.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.400+0000 7f24e5d9b640 1 -- 172.21.15.87:0/3831918144 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d8036590 con 0x7f24e81109c0 2024-05-08T18:30:58.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.400+0000 7f24ec91c640 1 -- 172.21.15.87:0/3831918144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e81109c0 msgr2=0x7f24e8110dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:58.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.400+0000 7f24ec91c640 1 --2- 172.21.15.87:0/3831918144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e81109c0 0x7f24e8110dc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f24d800ba90 tx=0x7f24d802e0e0 comp rx=0 tx=0).stop 2024-05-08T18:30:58.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.400+0000 7f24ec91c640 1 -- 172.21.15.87:0/3831918144 shutdown_connections 2024-05-08T18:30:58.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.400+0000 7f24ec91c640 1 --2- 172.21.15.87:0/3831918144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e81109c0 0x7f24e8110dc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:58.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.400+0000 7f24ec91c640 1 -- 172.21.15.87:0/3831918144 >> 172.21.15.87:0/3831918144 conn(0x7f24e80705a0 msgr2=0x7f24e80729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:58.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.400+0000 7f24ec91c640 1 -- 172.21.15.87:0/3831918144 shutdown_connections 2024-05-08T18:30:58.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.400+0000 7f24ec91c640 1 -- 172.21.15.87:0/3831918144 wait complete. 2024-05-08T18:30:58.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.401+0000 7f24ec91c640 1 Processor -- start 2024-05-08T18:30:58.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.401+0000 7f24ec91c640 1 -- start start 2024-05-08T18:30:58.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.401+0000 7f24ec91c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e81109c0 0x7f24e81ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:58.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.401+0000 7f24ec91c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f24e811b7c0 con 0x7f24e81109c0 2024-05-08T18:30:58.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.401+0000 7f24e659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e81109c0 0x7f24e81ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:58.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.402+0000 7f24e659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e81109c0 0x7f24e81ad4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:41252/0 (socket says 172.21.15.87:41252) 2024-05-08T18:30:58.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.402+0000 7f24e659c640 1 -- 172.21.15.87:0/3291827172 learned_addr learned my addr 172.21.15.87:0/3291827172 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:30:58.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.402+0000 7f24e659c640 1 -- 172.21.15.87:0/3291827172 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e81ada70 con 0x7f24e81109c0 2024-05-08T18:30:58.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.402+0000 7f24e659c640 1 --2- 172.21.15.87:0/3291827172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e81109c0 0x7f24e81ad4a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f24d800b2c0 tx=0x7f24d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:58.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.402+0000 7f24df7fe640 1 -- 172.21.15.87:0/3291827172 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d8046070 con 0x7f24e81109c0 2024-05-08T18:30:58.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.402+0000 7f24df7fe640 1 -- 172.21.15.87:0/3291827172 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d803f680 con 0x7f24e81109c0 2024-05-08T18:30:58.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.402+0000 7f24ec91c640 1 -- 172.21.15.87:0/3291827172 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e81add00 con 0x7f24e81109c0 2024-05-08T18:30:58.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.402+0000 7f24df7fe640 1 -- 172.21.15.87:0/3291827172 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d803b070 con 0x7f24e81109c0 2024-05-08T18:30:58.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.402+0000 7f24ec91c640 1 -- 172.21.15.87:0/3291827172 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e81a7610 con 0x7f24e81109c0 2024-05-08T18:30:58.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.403+0000 7f24ec91c640 1 -- 172.21.15.87:0/3291827172 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e8050f90 con 0x7f24e81109c0 2024-05-08T18:30:58.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.403+0000 7f24df7fe640 1 -- 172.21.15.87:0/3291827172 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f24d8049070 con 0x7f24e81109c0 2024-05-08T18:30:58.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.403+0000 7f24df7fe640 1 --2- 172.21.15.87:0/3291827172 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f24c803d260 0x7f24c803f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:58.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.403+0000 7f24df7fe640 1 -- 172.21.15.87:0/3291827172 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4283+0+0 (secure 0 0 0) 0x7f24d8073730 con 0x7f24e81109c0 2024-05-08T18:30:58.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.403+0000 7f24ddd9b640 1 --2- 172.21.15.87:0/3291827172 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f24c803d260 0x7f24c803f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:58.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.404+0000 7f24ddd9b640 1 --2- 172.21.15.87:0/3291827172 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f24c803d260 0x7f24c803f720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f24e8076010 tx=0x7f24d0007a20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:58.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.408+0000 7f24df7fe640 1 -- 172.21.15.87:0/3291827172 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f24d8035a90 con 0x7f24e81109c0 2024-05-08T18:30:58.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:58.586+0000 7f24ec91c640 1 -- 172.21.15.87:0/3291827172 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f24e81a8bf0 con 0x7f24e81109c0 2024-05-08T18:30:59.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.265+0000 7f24df7fe640 1 -- 172.21.15.87:0/3291827172 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v17) ==== 169+0+0 (secure 0 0 0) 0x7f24d8073340 con 0x7f24e81109c0 2024-05-08T18:30:59.265 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'default.rgw.buckets.index' created 2024-05-08T18:30:59.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.269+0000 7f24ec91c640 1 -- 172.21.15.87:0/3291827172 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f24c803d260 msgr2=0x7f24c803f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:59.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.269+0000 7f24ec91c640 1 --2- 172.21.15.87:0/3291827172 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f24c803d260 0x7f24c803f720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f24e8076010 tx=0x7f24d0007a20 comp rx=0 tx=0).stop 2024-05-08T18:30:59.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.269+0000 7f24ec91c640 1 -- 172.21.15.87:0/3291827172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e81109c0 msgr2=0x7f24e81ad4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.269+0000 7f24ec91c640 1 --2- 172.21.15.87:0/3291827172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e81109c0 0x7f24e81ad4a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f24d800b2c0 tx=0x7f24d8004730 comp rx=0 tx=0).stop 2024-05-08T18:30:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.269+0000 7f24ec91c640 1 -- 172.21.15.87:0/3291827172 shutdown_connections 2024-05-08T18:30:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.269+0000 7f24ec91c640 1 --2- 172.21.15.87:0/3291827172 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f24c803d260 0x7f24c803f720 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.269+0000 7f24ec91c640 1 --2- 172.21.15.87:0/3291827172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e81109c0 0x7f24e81ad4a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.269+0000 7f24ec91c640 1 -- 172.21.15.87:0/3291827172 >> 172.21.15.87:0/3291827172 conn(0x7f24e80705a0 msgr2=0x7f24e8118440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.269+0000 7f24ec91c640 1 -- 172.21.15.87:0/3291827172 shutdown_connections 2024-05-08T18:30:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.269+0000 7f24ec91c640 1 -- 172.21.15.87:0/3291827172 wait complete. 2024-05-08T18:30:59.287 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-05-08T18:30:59.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.393+0000 7fcf0a92b640 1 Processor -- start 2024-05-08T18:30:59.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.393+0000 7fcf0a92b640 1 -- start start 2024-05-08T18:30:59.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.393+0000 7fcf0a92b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcf041199c0 0x7fcf0411bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:59.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.393+0000 7fcf0a92b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf0411c2f0 con 0x7fcf0410f020 2024-05-08T18:30:59.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.393+0000 7fcf0a92b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fcf0411d4d0 con 0x7fcf041199c0 2024-05-08T18:30:59.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.393+0000 7fcf037fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcf041199c0 0x7fcf0411bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:59.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.393+0000 7fcf037fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcf041199c0 0x7fcf0411bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:41264/0 (socket says 172.21.15.87:41264) 2024-05-08T18:30:59.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.393+0000 7fcf037fe640 1 -- 172.21.15.87:0/3066974781 learned_addr learned my addr 172.21.15.87:0/3066974781 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:30:59.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.394+0000 7fcf037fe640 1 -- 172.21.15.87:0/3066974781 >> v1:172.21.15.53:6789/0 conn(0x7fcf0410f020 legacy=0x7fcf0410f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:59.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.394+0000 7fcf037fe640 1 -- 172.21.15.87:0/3066974781 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf0411d680 con 0x7fcf041199c0 2024-05-08T18:30:59.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.395+0000 7fcf037fe640 1 --2- 172.21.15.87:0/3066974781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf041199c0 0x7fcf0411bdb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcef80097f0 tx=0x7fcef802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebcc0c841366ee29 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:59.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.395+0000 7fcf02ffd640 1 -- 172.21.15.87:0/3066974781 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef8035020 con 0x7fcf041199c0 2024-05-08T18:30:59.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.395+0000 7fcf02ffd640 1 -- 172.21.15.87:0/3066974781 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef80317a0 con 0x7fcf041199c0 2024-05-08T18:30:59.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.395+0000 7fcf02ffd640 1 -- 172.21.15.87:0/3066974781 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef8031aa0 con 0x7fcf041199c0 2024-05-08T18:30:59.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.395+0000 7fcf0a92b640 1 -- 172.21.15.87:0/3066974781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf041199c0 msgr2=0x7fcf0411bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:30:59.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.395+0000 7fcf0a92b640 1 --2- 172.21.15.87:0/3066974781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf041199c0 0x7fcf0411bdb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcef80097f0 tx=0x7fcef802b910 comp rx=0 tx=0).stop 2024-05-08T18:30:59.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.395+0000 7fcf0a92b640 1 -- 172.21.15.87:0/3066974781 shutdown_connections 2024-05-08T18:30:59.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.395+0000 7fcf0a92b640 1 --2- 172.21.15.87:0/3066974781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf041199c0 0x7fcf0411bdb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:30:59.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.395+0000 7fcf0a92b640 1 -- 172.21.15.87:0/3066974781 >> 172.21.15.87:0/3066974781 conn(0x7fcf040705a0 msgr2=0x7fcf040729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:30:59.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.395+0000 7fcf0a92b640 1 -- 172.21.15.87:0/3066974781 shutdown_connections 2024-05-08T18:30:59.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.395+0000 7fcf0a92b640 1 -- 172.21.15.87:0/3066974781 wait complete. 2024-05-08T18:30:59.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.396+0000 7fcf0a92b640 1 Processor -- start 2024-05-08T18:30:59.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.396+0000 7fcf0a92b640 1 -- start start 2024-05-08T18:30:59.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.396+0000 7fcf0a92b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf0410f020 0x7fcf04110820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:59.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.396+0000 7fcf0a92b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0411c9e0 con 0x7fcf0410f020 2024-05-08T18:30:59.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.397+0000 7fcf03fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf0410f020 0x7fcf04110820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:59.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.397+0000 7fcf03fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf0410f020 0x7fcf04110820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:41266/0 (socket says 172.21.15.87:41266) 2024-05-08T18:30:59.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.397+0000 7fcf03fff640 1 -- 172.21.15.87:0/2255579018 learned_addr learned my addr 172.21.15.87:0/2255579018 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:30:59.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.397+0000 7fcf03fff640 1 -- 172.21.15.87:0/2255579018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf04110d60 con 0x7fcf0410f020 2024-05-08T18:30:59.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.397+0000 7fcf03fff640 1 --2- 172.21.15.87:0/2255579018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf0410f020 0x7fcf04110820 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcef400c340 tx=0x7fcef4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:59.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.397+0000 7fcf00ff9640 1 -- 172.21.15.87:0/2255579018 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef4005200 con 0x7fcf0410f020 2024-05-08T18:30:59.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.397+0000 7fcf00ff9640 1 -- 172.21.15.87:0/2255579018 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef40053c0 con 0x7fcf0410f020 2024-05-08T18:30:59.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.397+0000 7fcf0a92b640 1 -- 172.21.15.87:0/2255579018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf04110f90 con 0x7fcf0410f020 2024-05-08T18:30:59.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.397+0000 7fcf00ff9640 1 -- 172.21.15.87:0/2255579018 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef4007190 con 0x7fcf0410f020 2024-05-08T18:30:59.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.397+0000 7fcf0a92b640 1 -- 172.21.15.87:0/2255579018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf04111460 con 0x7fcf0410f020 2024-05-08T18:30:59.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.398+0000 7fcf0a92b640 1 -- 172.21.15.87:0/2255579018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf04050f90 con 0x7fcf0410f020 2024-05-08T18:30:59.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.398+0000 7fcf00ff9640 1 -- 172.21.15.87:0/2255579018 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fcef4007400 con 0x7fcf0410f020 2024-05-08T18:30:59.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.399+0000 7fcf00ff9640 1 --2- 172.21.15.87:0/2255579018 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcef003d260 0x7fcef003f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:30:59.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.399+0000 7fcf00ff9640 1 -- 172.21.15.87:0/2255579018 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4647+0+0 (secure 0 0 0) 0x7fcef4050c40 con 0x7fcf0410f020 2024-05-08T18:30:59.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.399+0000 7fcf037fe640 1 --2- 172.21.15.87:0/2255579018 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcef003d260 0x7fcef003f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:30:59.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.399+0000 7fcf037fe640 1 --2- 172.21.15.87:0/2255579018 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcef003d260 0x7fcef003f720 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcef8036000 tx=0x7fcef8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:30:59.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.404+0000 7fcf00ff9640 1 -- 172.21.15.87:0/2255579018 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fcef401a360 con 0x7fcf0410f020 2024-05-08T18:30:59.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:30:59.583+0000 7fcf0a92b640 1 -- 172.21.15.87:0/2255579018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7fcf041199c0 con 0x7fcf0410f020 2024-05-08T18:31:00.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:00.268+0000 7fcf00ff9640 1 -- 172.21.15.87:0/2255579018 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v18) ==== 187+0+0 (secure 0 0 0) 0x7fcef40067d0 con 0x7fcf0410f020 2024-05-08T18:31:00.267 INFO:teuthology.orchestra.run.smithi087.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-05-08T18:31:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:00.272+0000 7fcf0a92b640 1 -- 172.21.15.87:0/2255579018 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcef003d260 msgr2=0x7fcef003f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:00.272+0000 7fcf0a92b640 1 --2- 172.21.15.87:0/2255579018 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcef003d260 0x7fcef003f720 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcef8036000 tx=0x7fcef8008030 comp rx=0 tx=0).stop 2024-05-08T18:31:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:00.272+0000 7fcf0a92b640 1 -- 172.21.15.87:0/2255579018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf0410f020 msgr2=0x7fcf04110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:00.272+0000 7fcf0a92b640 1 --2- 172.21.15.87:0/2255579018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf0410f020 0x7fcf04110820 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcef400c340 tx=0x7fcef4001e70 comp rx=0 tx=0).stop 2024-05-08T18:31:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:00.273+0000 7fcf0a92b640 1 -- 172.21.15.87:0/2255579018 shutdown_connections 2024-05-08T18:31:00.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:00.273+0000 7fcf0a92b640 1 --2- 172.21.15.87:0/2255579018 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcef003d260 0x7fcef003f720 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:00.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:00.273+0000 7fcf0a92b640 1 --2- 172.21.15.87:0/2255579018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf0410f020 0x7fcf04110820 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:00.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:00.273+0000 7fcf0a92b640 1 -- 172.21.15.87:0/2255579018 >> 172.21.15.87:0/2255579018 conn(0x7fcf040705a0 msgr2=0x7fcf040728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:00.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:00.274+0000 7fcf0a92b640 1 -- 172.21.15.87:0/2255579018 shutdown_connections 2024-05-08T18:31:00.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:00.275+0000 7fcf0a92b640 1 -- 172.21.15.87:0/2255579018 wait complete. 2024-05-08T18:31:00.300 DEBUG:tasks.rgw:Pools created 2024-05-08T18:31:00.300 INFO:tasks.rgw:Starting rgw... 2024-05-08T18:31:00.300 INFO:tasks.rgw:rgw client.0 config is {} 2024-05-08T18:31:00.300 INFO:tasks.rgw:Using beast as radosgw frontend 2024-05-08T18:31:00.301 DEBUG:teuthology.orchestra.run.smithi087:> sudo echo -n http://smithi087.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-05-08T18:31:00.329 INFO:teuthology.orchestra.run.smithi087.stdout:http://smithi087.front.sepia.ceph.com:80 2024-05-08T18:31:00.329 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-05-08T18:31:00.395 INFO:tasks.rgw.client.0:Restarting daemon 2024-05-08T18:31:00.395 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-05-08T18:31:00.437 INFO:tasks.rgw.client.0:Started 2024-05-08T18:31:00.438 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi087.front.sepia.ceph.com:80/ 2024-05-08T18:31:00.438 DEBUG:teuthology.orchestra.run.smithi087:> curl http://smithi087.front.sepia.ceph.com:80/ 2024-05-08T18:31:00.467 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:31:00.468 INFO:teuthology.orchestra.run.smithi087.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:31:00.468 INFO:teuthology.orchestra.run.smithi087.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:31:00.468 INFO:teuthology.orchestra.run.smithi087.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:31:00.468 INFO:teuthology.orchestra.run.smithi087.stderr:curl: (7) Failed to connect to smithi087.front.sepia.ceph.com port 80: Connection refused 2024-05-08T18:31:01.470 DEBUG:teuthology.orchestra.run.smithi087:> curl http://smithi087.front.sepia.ceph.com:80/ 2024-05-08T18:31:01.491 INFO:teuthology.orchestra.run.smithi087.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:31:01.491 INFO:teuthology.orchestra.run.smithi087.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:31:01.492 INFO:teuthology.orchestra.run.smithi087.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:31:01.493 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:31:01.493 INFO:teuthology.orchestra.run.smithi087.stderr:curl: (7) Failed to connect to smithi087.front.sepia.ceph.com port 80: Connection refused 2024-05-08T18:31:03.495 DEBUG:teuthology.orchestra.run.smithi087:> curl http://smithi087.front.sepia.ceph.com:80/ 2024-05-08T18:31:03.520 INFO:teuthology.orchestra.run.smithi087.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:31:03.520 INFO:teuthology.orchestra.run.smithi087.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:31:03.521 INFO:teuthology.orchestra.run.smithi087.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:31:03.521 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:31:03.522 INFO:teuthology.orchestra.run.smithi087.stderr:curl: (7) Failed to connect to smithi087.front.sepia.ceph.com port 80: Connection refused 2024-05-08T18:31:07.523 DEBUG:teuthology.orchestra.run.smithi087:> curl http://smithi087.front.sepia.ceph.com:80/ 2024-05-08T18:31:07.548 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:31:07.548 INFO:teuthology.orchestra.run.smithi087.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:31:07.548 INFO:teuthology.orchestra.run.smithi087.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:31:07.548 INFO:teuthology.orchestra.run.smithi087.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:31:07.549 INFO:teuthology.orchestra.run.smithi087.stderr:curl: (7) Failed to connect to smithi087.front.sepia.ceph.com port 80: Connection refused 2024-05-08T18:31:09.446 INFO:tasks.rgw.client.0.smithi087.stdout:2024-05-08T18:31:09.446+0000 7f8ccc20f880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-05-08T18:31:15.549 DEBUG:teuthology.orchestra.run.smithi087:> curl http://smithi087.front.sepia.ceph.com:80/ 2024-05-08T18:31:15.574 INFO:teuthology.orchestra.run.smithi087.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:31:15.574 INFO:teuthology.orchestra.run.smithi087.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:31:15.575 INFO:teuthology.orchestra.run.smithi087.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-05-08T18:31:15.576 INFO:teuthology.orchestra.run.smithi087.stdout:anonymous 2024-05-08T18:31:15.577 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-05-08T18:31:15.669 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-05-08T18:31:15.669 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-05-08T18:31:15.669 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-05-08T18:31:15.669 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-05-08T18:31:15.719 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:15.719 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:15.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.722+0000 7fe69b52d800 1 Processor -- start 2024-05-08T18:31:15.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.722+0000 7fe69b52d800 1 -- start start 2024-05-08T18:31:15.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.722+0000 7fe69b52d800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5632971a7df0 0x5632971a6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.722+0000 7fe69b52d800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5632971a6dd0 con 0x5632971a6890 2024-05-08T18:31:15.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.722+0000 7fe69b52d800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5632970d2e20 con 0x5632971a7df0 2024-05-08T18:31:15.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.723+0000 7fe697178640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5632971a7df0 0x5632971a6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.723+0000 7fe697178640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5632971a7df0 0x5632971a6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60296/0 (socket says 172.21.15.87:60296) 2024-05-08T18:31:15.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.723+0000 7fe697178640 1 -- 172.21.15.87:0/486896950 learned_addr learned my addr 172.21.15.87:0/486896950 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:15.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.723+0000 7fe696977640 1 --1- 172.21.15.87:0/486896950 >> v1:172.21.15.53:6789/0 conn(0x5632971a6890 0x56329723a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41810/0 (socket says 172.21.15.87:41810) 2024-05-08T18:31:15.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.723+0000 7fe697178640 1 -- 172.21.15.87:0/486896950 >> v1:172.21.15.53:6789/0 conn(0x5632971a6890 legacy=0x56329723a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.723+0000 7fe697178640 1 -- 172.21.15.87:0/486896950 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632971a6fa0 con 0x5632971a7df0 2024-05-08T18:31:15.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.725+0000 7fe697178640 1 --2- 172.21.15.87:0/486896950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a7df0 0x5632971a6350 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe68800a520 tx=0x7fe68801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8300787b1bcc1679 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.725+0000 7fe696176640 1 -- 172.21.15.87:0/486896950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe688057070 con 0x5632971a7df0 2024-05-08T18:31:15.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.725+0000 7fe696176640 1 -- 172.21.15.87:0/486896950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe688052570 con 0x5632971a7df0 2024-05-08T18:31:15.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.725+0000 7fe696176640 1 -- 172.21.15.87:0/486896950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe688052870 con 0x5632971a7df0 2024-05-08T18:31:15.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.726+0000 7fe69b52d800 1 -- 172.21.15.87:0/486896950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a7df0 msgr2=0x5632971a6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.726+0000 7fe69b52d800 1 --2- 172.21.15.87:0/486896950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a7df0 0x5632971a6350 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe68800a520 tx=0x7fe68801d010 comp rx=0 tx=0).stop 2024-05-08T18:31:15.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.726+0000 7fe69b52d800 1 -- 172.21.15.87:0/486896950 shutdown_connections 2024-05-08T18:31:15.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.726+0000 7fe69b52d800 1 --2- 172.21.15.87:0/486896950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a7df0 0x5632971a6350 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.726+0000 7fe69b52d800 1 -- 172.21.15.87:0/486896950 >> 172.21.15.87:0/486896950 conn(0x56329722d820 msgr2=0x56329722fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:15.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.726+0000 7fe69b52d800 1 -- 172.21.15.87:0/486896950 shutdown_connections 2024-05-08T18:31:15.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.726+0000 7fe69b52d800 1 -- 172.21.15.87:0/486896950 wait complete. 2024-05-08T18:31:15.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.742+0000 7fe69b52d800 1 Processor -- start 2024-05-08T18:31:15.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.742+0000 7fe69b52d800 1 -- start start 2024-05-08T18:31:15.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.742+0000 7fe69b52d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a6890 0x563297325a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.742+0000 7fe69b52d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56329717d5a0 con 0x5632971a6890 2024-05-08T18:31:15.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.742+0000 7fe697178640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a6890 0x563297325a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.742+0000 7fe697178640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a6890 0x563297325a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60298/0 (socket says 172.21.15.87:60298) 2024-05-08T18:31:15.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.742+0000 7fe697178640 1 -- 172.21.15.87:0/2104708106 learned_addr learned my addr 172.21.15.87:0/2104708106 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:15.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.742+0000 7fe697178640 1 -- 172.21.15.87:0/2104708106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563297325ff0 con 0x5632971a6890 2024-05-08T18:31:15.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.743+0000 7fe697178640 1 --2- 172.21.15.87:0/2104708106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a6890 0x563297325a20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe68801d050 tx=0x7fe68804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ffa1eb33c2eb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.743+0000 7fe58560a640 1 -- 172.21.15.87:0/2104708106 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe688057040 con 0x5632971a6890 2024-05-08T18:31:15.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.743+0000 7fe58560a640 1 -- 172.21.15.87:0/2104708106 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe688052850 con 0x5632971a6890 2024-05-08T18:31:15.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.743+0000 7fe58560a640 1 -- 172.21.15.87:0/2104708106 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe688052b30 con 0x5632971a6890 2024-05-08T18:31:15.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.744+0000 7fe69b52d800 1 -- 172.21.15.87:0/2104708106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a6890 msgr2=0x563297325a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.744+0000 7fe69b52d800 1 --2- 172.21.15.87:0/2104708106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a6890 0x563297325a20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe68801d050 tx=0x7fe68804c000 comp rx=0 tx=0).stop 2024-05-08T18:31:15.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.744+0000 7fe69b52d800 1 -- 172.21.15.87:0/2104708106 shutdown_connections 2024-05-08T18:31:15.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.744+0000 7fe69b52d800 1 --2- 172.21.15.87:0/2104708106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a6890 0x563297325a20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.744+0000 7fe69b52d800 1 -- 172.21.15.87:0/2104708106 >> 172.21.15.87:0/2104708106 conn(0x56329722d820 msgr2=0x5632973212a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:15.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.744+0000 7fe69b52d800 1 -- 172.21.15.87:0/2104708106 shutdown_connections 2024-05-08T18:31:15.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.744+0000 7fe69b52d800 1 -- 172.21.15.87:0/2104708106 wait complete. 2024-05-08T18:31:15.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.744+0000 7fe69b52d800 1 Processor -- start 2024-05-08T18:31:15.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.744+0000 7fe69b52d800 1 -- start start 2024-05-08T18:31:15.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.744+0000 7fe69b52d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a6890 0x56329732d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.744+0000 7fe69b52d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56329723db40 con 0x5632971a6890 2024-05-08T18:31:15.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.745+0000 7fe697178640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a6890 0x56329732d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.745+0000 7fe697178640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a6890 0x56329732d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60308/0 (socket says 172.21.15.87:60308) 2024-05-08T18:31:15.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.745+0000 7fe697178640 1 -- 172.21.15.87:0/57973935 learned_addr learned my addr 172.21.15.87:0/57973935 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:15.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.745+0000 7fe697178640 1 -- 172.21.15.87:0/57973935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56329732d980 con 0x5632971a6890 2024-05-08T18:31:15.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.745+0000 7fe697178640 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a6890 0x56329732d440 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe688000c00 tx=0x7fe688003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.745+0000 7fe583e07640 1 -- 172.21.15.87:0/57973935 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe688073070 con 0x5632971a6890 2024-05-08T18:31:15.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.745+0000 7fe69b52d800 1 -- 172.21.15.87:0/57973935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56329732dc10 con 0x5632971a6890 2024-05-08T18:31:15.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.745+0000 7fe583e07640 1 -- 172.21.15.87:0/57973935 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe68805d570 con 0x5632971a6890 2024-05-08T18:31:15.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.745+0000 7fe583e07640 1 -- 172.21.15.87:0/57973935 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe688057070 con 0x5632971a6890 2024-05-08T18:31:15.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.745+0000 7fe69b52d800 1 -- 172.21.15.87:0/57973935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563297330870 con 0x5632971a6890 2024-05-08T18:31:15.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.746+0000 7fe583e07640 1 -- 172.21.15.87:0/57973935 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fe688076070 con 0x5632971a6890 2024-05-08T18:31:15.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.746+0000 7fe583e07640 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe57c03bb50 0x7fe57c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.747+0000 7fe583e07640 1 -- 172.21.15.87:0/57973935 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fe688094180 con 0x5632971a6890 2024-05-08T18:31:15.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.747+0000 7fe696977640 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe57c03bb50 0x7fe57c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.747+0000 7fe69b52d800 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563297332620 0x563297334a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.747+0000 7fe69b52d800 1 -- 172.21.15.87:0/57973935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563297334f50 con 0x563297332620 2024-05-08T18:31:15.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.747+0000 7fe697979640 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563297332620 0x563297334a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.747+0000 7fe696977640 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe57c03bb50 0x7fe57c03e010 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe68c000f60 tx=0x7fe68c001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.747+0000 7fe697979640 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563297332620 0x563297334a10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.747+0000 7fe697979640 1 -- 172.21.15.87:0/57973935 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe69000a4a0 con 0x563297332620 2024-05-08T18:31:15.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.747+0000 7fe69b52d800 1 -- 172.21.15.87:0/57973935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563297331c00 con 0x563297332620 2024-05-08T18:31:15.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.748+0000 7fe697979640 1 -- 172.21.15.87:0/57973935 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe69000a4a0 con 0x563297332620 2024-05-08T18:31:15.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.748+0000 7fe69b52d800 1 -- 172.21.15.87:0/57973935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563297336d70 con 0x563297332620 2024-05-08T18:31:15.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.748+0000 7fe697979640 1 -- 172.21.15.87:0/57973935 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe69000a4a0 con 0x563297332620 2024-05-08T18:31:15.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.748+0000 7fe69b52d800 1 -- 172.21.15.87:0/57973935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563297335fa0 con 0x563297332620 2024-05-08T18:31:15.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.748+0000 7fe697979640 1 -- 172.21.15.87:0/57973935 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe69000a4a0 con 0x563297332620 2024-05-08T18:31:15.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.748+0000 7fe69b52d800 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563297338120 0x56329733a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.748+0000 7fe69b52d800 1 -- 172.21.15.87:0/57973935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56329733aa50 con 0x563297338120 2024-05-08T18:31:15.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.749+0000 7fe697178640 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563297338120 0x56329733a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.749+0000 7fe697178640 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563297338120 0x56329733a510 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.750+0000 7fe697178640 1 -- 172.21.15.87:0/57973935 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe688075030 con 0x563297338120 2024-05-08T18:31:15.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.750+0000 7fe69b52d800 1 Processor -- start 2024-05-08T18:31:15.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.750+0000 7fe69b52d800 1 -- start start 2024-05-08T18:31:15.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.750+0000 7fe69b52d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297348c90 0x5632973490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.750+0000 7fe69b52d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563297123fc0 con 0x563297348c90 2024-05-08T18:31:15.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.750+0000 7fe697979640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297348c90 0x5632973490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.750+0000 7fe697979640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297348c90 0x5632973490b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60320/0 (socket says 172.21.15.87:60320) 2024-05-08T18:31:15.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.750+0000 7fe697979640 1 -- 172.21.15.87:0/2220800922 learned_addr learned my addr 172.21.15.87:0/2220800922 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:15.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.751+0000 7fe697979640 1 -- 172.21.15.87:0/2220800922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632973495f0 con 0x563297348c90 2024-05-08T18:31:15.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.751+0000 7fe697979640 1 --2- 172.21.15.87:0/2220800922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297348c90 0x5632973490b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x56329732e7f0 tx=0x7fe6900178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.751+0000 7fe581602640 1 -- 172.21.15.87:0/2220800922 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe690013440 con 0x563297348c90 2024-05-08T18:31:15.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.751+0000 7fe69b52d800 1 -- 172.21.15.87:0/2220800922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56329734a060 con 0x563297348c90 2024-05-08T18:31:15.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.751+0000 7fe581602640 1 -- 172.21.15.87:0/2220800922 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6900135e0 con 0x563297348c90 2024-05-08T18:31:15.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.751+0000 7fe69b52d800 1 -- 172.21.15.87:0/2220800922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56329734a560 con 0x563297348c90 2024-05-08T18:31:15.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.751+0000 7fe581602640 1 -- 172.21.15.87:0/2220800922 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe690027060 con 0x563297348c90 2024-05-08T18:31:15.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.752+0000 7fe581602640 1 -- 172.21.15.87:0/2220800922 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fe690011040 con 0x563297348c90 2024-05-08T18:31:15.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.752+0000 7fe581602640 1 --2- 172.21.15.87:0/2220800922 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe57003bb50 0x7fe57003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.752+0000 7fe581602640 1 -- 172.21.15.87:0/2220800922 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fe69001d070 con 0x563297348c90 2024-05-08T18:31:15.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.752+0000 7fe697178640 1 --2- 172.21.15.87:0/2220800922 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe57003bb50 0x7fe57003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.753+0000 7fe69b52d800 1 Processor -- start 2024-05-08T18:31:15.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.753+0000 7fe697178640 1 --2- 172.21.15.87:0/2220800922 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe57003bb50 0x7fe57003e010 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe68805c750 tx=0x7fe688052440 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.753+0000 7fe69b52d800 1 -- start start 2024-05-08T18:31:15.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.753+0000 7fe69b52d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297355f70 0x563297356390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.753+0000 7fe69b52d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5632973262b0 con 0x563297355f70 2024-05-08T18:31:15.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.753+0000 7fe697979640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297355f70 0x563297356390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.753+0000 7fe697979640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297355f70 0x563297356390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60336/0 (socket says 172.21.15.87:60336) 2024-05-08T18:31:15.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.753+0000 7fe697979640 1 -- 172.21.15.87:0/3576000349 learned_addr learned my addr 172.21.15.87:0/3576000349 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:15.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.754+0000 7fe697979640 1 -- 172.21.15.87:0/3576000349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563297356960 con 0x563297355f70 2024-05-08T18:31:15.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.754+0000 7fe697979640 1 --2- 172.21.15.87:0/3576000349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297355f70 0x563297356390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe6900529e0 tx=0x7fe690052c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb79e03f2efe706a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.754+0000 7fe57affd640 1 -- 172.21.15.87:0/3576000349 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe69002a480 con 0x563297355f70 2024-05-08T18:31:15.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.754+0000 7fe57affd640 1 -- 172.21.15.87:0/3576000349 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe690054110 con 0x563297355f70 2024-05-08T18:31:15.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.754+0000 7fe57affd640 1 -- 172.21.15.87:0/3576000349 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6900543f0 con 0x563297355f70 2024-05-08T18:31:15.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.754+0000 7fe69b52d800 1 -- 172.21.15.87:0/3576000349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297355f70 msgr2=0x563297356390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.754+0000 7fe69b52d800 1 --2- 172.21.15.87:0/3576000349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297355f70 0x563297356390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe6900529e0 tx=0x7fe690052c60 comp rx=0 tx=0).stop 2024-05-08T18:31:15.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.754+0000 7fe69b52d800 1 -- 172.21.15.87:0/3576000349 shutdown_connections 2024-05-08T18:31:15.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.754+0000 7fe69b52d800 1 --2- 172.21.15.87:0/3576000349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297355f70 0x563297356390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.754+0000 7fe69b52d800 1 -- 172.21.15.87:0/3576000349 >> 172.21.15.87:0/3576000349 conn(0x563297352280 msgr2=0x563297350330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:15.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.754+0000 7fe69b52d800 1 -- 172.21.15.87:0/3576000349 shutdown_connections 2024-05-08T18:31:15.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.755+0000 7fe69b52d800 1 -- 172.21.15.87:0/3576000349 wait complete. 2024-05-08T18:31:15.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.755+0000 7fe69b52d800 1 Processor -- start 2024-05-08T18:31:15.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.755+0000 7fe69b52d800 1 -- start start 2024-05-08T18:31:15.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.755+0000 7fe69b52d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297355f70 0x56329735d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.755+0000 7fe69b52d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563297357130 con 0x563297355f70 2024-05-08T18:31:15.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.755+0000 7fe697979640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297355f70 0x56329735d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.755+0000 7fe697979640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297355f70 0x56329735d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60352/0 (socket says 172.21.15.87:60352) 2024-05-08T18:31:15.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.755+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 learned_addr learned my addr 172.21.15.87:0/131519168 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:15.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.756+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56329735d9c0 con 0x563297355f70 2024-05-08T18:31:15.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.756+0000 7fe697979640 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297355f70 0x56329735d480 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe69002ad50 tx=0x7fe690052940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.756+0000 7fe5797fa640 1 -- 172.21.15.87:0/131519168 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe690030020 con 0x563297355f70 2024-05-08T18:31:15.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.756+0000 7fe5797fa640 1 -- 172.21.15.87:0/131519168 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe690051540 con 0x563297355f70 2024-05-08T18:31:15.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.756+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56329735dc50 con 0x563297355f70 2024-05-08T18:31:15.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.756+0000 7fe5797fa640 1 -- 172.21.15.87:0/131519168 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6900139f0 con 0x563297355f70 2024-05-08T18:31:15.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.756+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563297360900 con 0x563297355f70 2024-05-08T18:31:15.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.757+0000 7fe5797fa640 1 -- 172.21.15.87:0/131519168 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fe690033020 con 0x563297355f70 2024-05-08T18:31:15.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.757+0000 7fe5797fa640 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe56003bba0 0x7fe56003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.757+0000 7fe5797fa640 1 -- 172.21.15.87:0/131519168 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fe69000e040 con 0x563297355f70 2024-05-08T18:31:15.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.757+0000 7fe697178640 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe56003bba0 0x7fe56003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.758+0000 7fe69b52d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.758+0000 7fe69b52d800 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563297369120 0x56329736b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.758+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56329736bd30 con 0x563297369120 2024-05-08T18:31:15.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.758+0000 7fe697178640 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe56003bba0 0x7fe56003e060 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x563297336cd0 tx=0x7fe688091310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.758+0000 7fe696977640 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563297369120 0x56329736b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.758+0000 7fe696977640 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563297369120 0x56329736b5e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.758+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.758+0000 7fe69b52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:15.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.758+0000 7fe69b52d800 20 realm 2024-05-08T18:31:15.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.758+0000 7fe69b52d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.758+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563297368570 con 0x563297369120 2024-05-08T18:31:15.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe69b52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:15.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe69b52d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:15.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe69b52d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56329736c810 con 0x563297369120 2024-05-08T18:31:15.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe69b52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:15.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe69b52d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56329736d0e0 con 0x563297369120 2024-05-08T18:31:15.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe69b52d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:15.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe69b52d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56329736d480 con 0x563297369120 2024-05-08T18:31:15.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe69b52d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:15.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe69b52d800 20 searching for the correct realm 2024-05-08T18:31:15.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe69b52d800 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56329736f3b0 0x5632973717a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.759+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x56329736f3b0 2024-05-08T18:31:15.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.760+0000 7fe697979640 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56329736f3b0 0x5632973717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.760+0000 7fe697979640 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56329736f3b0 0x5632973717a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.760+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.760+0000 7fe697979640 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fe690035020 0x7fe6900249d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.760+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x7fe690035020 2024-05-08T18:31:15.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.761+0000 7fe697178640 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fe690035020 0x7fe6900249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.761+0000 7fe697178640 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fe690035020 0x7fe6900249d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.761+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.761+0000 7fe697178640 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fe688087050 0x7fe688076360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.761+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x7fe688087050 2024-05-08T18:31:15.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.761+0000 7fe696977640 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fe688087050 0x7fe688076360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.762+0000 7fe696977640 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fe688087050 0x7fe688076360 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.762+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.762+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x563297369120 2024-05-08T18:31:15.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.762+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.762+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x563297369120 2024-05-08T18:31:15.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.763+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.763+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x7fe688087050 2024-05-08T18:31:15.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.763+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.763+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x7fe688087050 2024-05-08T18:31:15.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.763+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.763+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x7fe690035020 2024-05-08T18:31:15.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.764+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.764+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x56329736f3b0 2024-05-08T18:31:15.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.764+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.764+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x563297369120 2024-05-08T18:31:15.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.764+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.764+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x7fe688087050 2024-05-08T18:31:15.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.765+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.765+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x563297369120 2024-05-08T18:31:15.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.765+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.765+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x7fe690035020 2024-05-08T18:31:15.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.765+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.765+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x56329736f3b0 2024-05-08T18:31:15.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.765+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.765+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x56329736f3b0 2024-05-08T18:31:15.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.766+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.766+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x7fe688087050 2024-05-08T18:31:15.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.766+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.766+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x56329736f3b0 2024-05-08T18:31:15.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.766+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.766+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x56329736f3b0 2024-05-08T18:31:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.766+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.766+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x563297369120 2024-05-08T18:31:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.767+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.767+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x563297369120 2024-05-08T18:31:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.767+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v20'2 uv2 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.767+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x7fe688087050 2024-05-08T18:31:15.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.767+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.767+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x56329736f3b0 2024-05-08T18:31:15.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.768+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.768+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x7fe690035020 2024-05-08T18:31:15.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.768+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.768+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x563297369120 2024-05-08T18:31:15.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.768+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.768+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x7fe688087050 2024-05-08T18:31:15.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.768+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.768+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x56329736f3b0 2024-05-08T18:31:15.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.769+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.769+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x7fe688087050 2024-05-08T18:31:15.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.769+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.769+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x7fe690035020 2024-05-08T18:31:15.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.769+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.769+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x56329736f3b0 2024-05-08T18:31:15.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.770+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.770+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x7fe688087050 2024-05-08T18:31:15.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.770+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.770+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x563297369120 2024-05-08T18:31:15.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.770+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.770+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563297371e70 con 0x7fe690035020 2024-05-08T18:31:15.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.770+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.770+0000 7fe69b52d800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:15.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.770+0000 7fe69b52d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:15.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.770+0000 7fe69b52d800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:15.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.770+0000 7fe69b52d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:15.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.770+0000 7fe69b52d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:15.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.770+0000 7fe69b52d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.770+0000 7fe69b52d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56329736de30 con 0x563297369120 2024-05-08T18:31:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe69b52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe69b52d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56329736e6d0 con 0x563297369120 2024-05-08T18:31:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe69b52d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe69b52d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56329736da70 con 0x7fe688087050 2024-05-08T18:31:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe69b52d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:15.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe69b52d800 20 zone default found 2024-05-08T18:31:15.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe69b52d800 4 Realm: () 2024-05-08T18:31:15.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe69b52d800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:15.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe69b52d800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:15.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe69b52d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:15.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe69b52d800 20 zonegroup default 2024-05-08T18:31:15.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe69b52d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.771+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5632973722f0 con 0x7fe688087050 2024-05-08T18:31:15.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.772+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.772+0000 7fe69b52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:15.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.772+0000 7fe69b52d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.772+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563297374180 con 0x56329736f3b0 2024-05-08T18:31:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.772+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.772+0000 7fe69b52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.772+0000 7fe69b52d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.772+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563297374520 con 0x56329736f3b0 2024-05-08T18:31:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.772+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.772+0000 7fe69b52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.772+0000 7fe69b52d800 20 started sync module instance, tier type = 2024-05-08T18:31:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.772+0000 7fe69b52d800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.772+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632973735c0 con 0x7fe690035020 2024-05-08T18:31:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.773+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.773+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94775285332448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563297374d70 con 0x7fe690035020 2024-05-08T18:31:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.773+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632973755c0 con 0x563297369120 2024-05-08T18:31:15.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.775+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94775285332448] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.775+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.775+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94775285336256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563297375600 con 0x563297369120 2024-05-08T18:31:15.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.775+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632973760f0 con 0x56329736f3b0 2024-05-08T18:31:15.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.777+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94775285336256] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.777+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.777+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94775285341120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632973764e0 con 0x56329736f3b0 2024-05-08T18:31:15.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.777+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563297376f20 con 0x7fe690035020 2024-05-08T18:31:15.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.778+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.778+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94775285344752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632973777c0 con 0x7fe690035020 2024-05-08T18:31:15.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.778+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632973782c0 con 0x563297369120 2024-05-08T18:31:15.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.778+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94775285341120] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.780+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.780+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94775285349808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632973786b0 con 0x563297369120 2024-05-08T18:31:15.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.780+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632973790b0 con 0x7fe688087050 2024-05-08T18:31:15.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.781+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94775285344752] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.781+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94775285349808] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.783+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.783+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94775285338384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563297378bc0 con 0x7fe688087050 2024-05-08T18:31:15.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.783+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563297379950 con 0x7fe688087050 2024-05-08T18:31:15.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.784+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94775285338384] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.785+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.785+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94775285347088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563297378bc0 con 0x7fe688087050 2024-05-08T18:31:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.785+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563297379f70 con 0x7fe688087050 2024-05-08T18:31:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.786+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94775285347088] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.786+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.786+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94775285355440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563297379f70 con 0x7fe688087050 2024-05-08T18:31:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.786+0000 7fe69b52d800 20 add_watcher() i=0 2024-05-08T18:31:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.786+0000 7fe69b52d800 20 add_watcher() i=1 2024-05-08T18:31:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.786+0000 7fe69b52d800 20 add_watcher() i=2 2024-05-08T18:31:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.786+0000 7fe69b52d800 20 add_watcher() i=3 2024-05-08T18:31:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.786+0000 7fe69b52d800 20 add_watcher() i=4 2024-05-08T18:31:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.786+0000 7fe69b52d800 20 add_watcher() i=5 2024-05-08T18:31:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.786+0000 7fe69b52d800 20 add_watcher() i=6 2024-05-08T18:31:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.787+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94775285355440] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.787+0000 7fe69b52d800 20 add_watcher() i=7 2024-05-08T18:31:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.787+0000 7fe69b52d800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.787+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56329737d390 con 0x563297369120 2024-05-08T18:31:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.787+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.787+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94775285357712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56329737a860 con 0x563297369120 2024-05-08T18:31:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.788+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94775285357712] v27'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.789+0000 7fe54dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.789+0000 7fe69b52d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.789+0000 7fe69b52d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:15.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.789+0000 7fe69b52d800 5 note: GC not initialized 2024-05-08T18:31:15.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.789+0000 7fe54cfe1640 20 reqs_thread_entry: start 2024-05-08T18:31:15.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.789+0000 7fe69b52d800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:15.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.789+0000 7fe69b52d800 20 Filter name: none 2024-05-08T18:31:15.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.789+0000 7fe4c67fc640 20 reqs_thread_entry: start 2024-05-08T18:31:15.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.789+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5632973b0030 con 0x56329736f3b0 2024-05-08T18:31:15.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.790+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(62 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.790+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5632973760f0 con 0x56329736f3b0 2024-05-08T18:31:15.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.790+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(63 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.790+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5632973760f0 con 0x563297369120 2024-05-08T18:31:15.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.790+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(64 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.790+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56329736e6d0 con 0x563297369120 2024-05-08T18:31:15.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.791+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.791+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56329736e6d0 con 0x7fe690035020 2024-05-08T18:31:15.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.791+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.791+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x56329736f3b0 2024-05-08T18:31:15.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.791+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(67 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.791+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x563297369120 2024-05-08T18:31:15.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.791+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.791+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x56329736f3b0 2024-05-08T18:31:15.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.792+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(69 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.792+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x7fe690035020 2024-05-08T18:31:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.792+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.792+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x56329736f3b0 2024-05-08T18:31:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.792+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(71 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.792+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x563297369120 2024-05-08T18:31:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.792+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(72 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.792+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x7fe688087050 2024-05-08T18:31:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.793+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(73 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.793+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x7fe688087050 2024-05-08T18:31:15.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.793+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(74 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.793+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x56329736f3b0 2024-05-08T18:31:15.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.794+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(75 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.794+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x7fe688087050 2024-05-08T18:31:15.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.794+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(76 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.794+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x7fe688087050 2024-05-08T18:31:15.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.794+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(77 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.794+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x7fe688087050 2024-05-08T18:31:15.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.794+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(78 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.794+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x56329736f3b0 2024-05-08T18:31:15.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.795+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(79 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.795+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x7fe690035020 2024-05-08T18:31:15.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.795+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(80 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.795+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x563297369120 2024-05-08T18:31:15.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.795+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(81 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.795+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x563297369120 2024-05-08T18:31:15.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.795+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(82 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.795+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x56329736f3b0 2024-05-08T18:31:15.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.796+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(83 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.796+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x7fe690035020 2024-05-08T18:31:15.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.796+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(84 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.796+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x7fe688087050 2024-05-08T18:31:15.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.796+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(85 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.796+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x563297369120 2024-05-08T18:31:15.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.796+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(86 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.796+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x7fe688087050 2024-05-08T18:31:15.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.797+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(87 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.797+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x56329736f3b0 2024-05-08T18:31:15.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.797+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(88 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.797+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x7fe690035020 2024-05-08T18:31:15.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.797+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(89 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.797+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x7fe688087050 2024-05-08T18:31:15.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.798+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(90 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.798+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x563297369120 2024-05-08T18:31:15.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.798+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(91 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.798+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x56329736f3b0 2024-05-08T18:31:15.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.798+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(92 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.798+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fe6880ab040 con 0x7fe690035020 2024-05-08T18:31:15.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.798+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(93 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.799+0000 7fe54dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:15.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.799+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94775285357712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632973760f0 con 0x563297369120 2024-05-08T18:31:15.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.800+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94775285357712] v27'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.800+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94775285332448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56329736e6d0 con 0x7fe690035020 2024-05-08T18:31:15.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.801+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94775285332448] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.801+0000 7fe69b52d800 20 remove_watcher() i=0 2024-05-08T18:31:15.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.801+0000 7fe69b52d800 2 removed watcher, disabling cache 2024-05-08T18:31:15.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.801+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94775285336256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56329736e6d0 con 0x563297369120 2024-05-08T18:31:15.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.803+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94775285336256] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.803+0000 7fe69b52d800 20 remove_watcher() i=1 2024-05-08T18:31:15.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.803+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94775285341120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56329736e6d0 con 0x56329736f3b0 2024-05-08T18:31:15.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.804+0000 7fe697979640 1 -- 172.21.15.87:0/131519168 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94775285341120] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe690029070 con 0x56329736f3b0 2024-05-08T18:31:15.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.804+0000 7fe69b52d800 20 remove_watcher() i=2 2024-05-08T18:31:15.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.804+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94775285344752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563297375bc0 con 0x7fe690035020 2024-05-08T18:31:15.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.805+0000 7fe697178640 1 -- 172.21.15.87:0/131519168 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94775285344752] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe688083030 con 0x7fe690035020 2024-05-08T18:31:15.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.805+0000 7fe69b52d800 20 remove_watcher() i=3 2024-05-08T18:31:15.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.805+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94775285349808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563297375bc0 con 0x563297369120 2024-05-08T18:31:15.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.806+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94775285349808] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x563297369120 2024-05-08T18:31:15.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.806+0000 7fe69b52d800 20 remove_watcher() i=4 2024-05-08T18:31:15.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.806+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94775285338384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563297377db0 con 0x7fe688087050 2024-05-08T18:31:15.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.807+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94775285338384] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.807+0000 7fe69b52d800 20 remove_watcher() i=5 2024-05-08T18:31:15.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.807+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94775285347088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563297375bc0 con 0x7fe688087050 2024-05-08T18:31:15.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.808+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94775285347088] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.808+0000 7fe69b52d800 20 remove_watcher() i=6 2024-05-08T18:31:15.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.808+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94775285355440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563297375110 con 0x7fe688087050 2024-05-08T18:31:15.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.809+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94775285355440] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68c00f610 con 0x7fe688087050 2024-05-08T18:31:15.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.809+0000 7fe69b52d800 20 remove_watcher() i=7 2024-05-08T18:31:15.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.809+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fe688087050 msgr2=0x7fe688076360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.809+0000 7fe69b52d800 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fe688087050 0x7fe688076360 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.809+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563297369120 msgr2=0x56329736b5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.809+0000 7fe69b52d800 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563297369120 0x56329736b5e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fe690035020 msgr2=0x7fe6900249d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fe690035020 0x7fe6900249d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56329736f3b0 msgr2=0x5632973717a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56329736f3b0 0x5632973717a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe56003bba0 msgr2=0x7fe56003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe56003bba0 0x7fe56003e060 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x563297336cd0 tx=0x7fe688091310 comp rx=0 tx=0).stop 2024-05-08T18:31:15.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297355f70 msgr2=0x56329735d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297355f70 0x56329735d480 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe69002ad50 tx=0x7fe690052940 comp rx=0 tx=0).stop 2024-05-08T18:31:15.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe696977640 1 -- 172.21.15.87:0/131519168 reap_dead start 2024-05-08T18:31:15.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 shutdown_connections 2024-05-08T18:31:15.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 --2- 172.21.15.87:0/131519168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297355f70 0x56329735d480 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 >> 172.21.15.87:0/131519168 conn(0x563297352280 msgr2=0x56329734f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:15.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 shutdown_connections 2024-05-08T18:31:15.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 -- 172.21.15.87:0/131519168 wait complete. 2024-05-08T18:31:15.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 -- 172.21.15.87:0/2220800922 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe57003bb50 msgr2=0x7fe57003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 --2- 172.21.15.87:0/2220800922 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe57003bb50 0x7fe57003e010 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe68805c750 tx=0x7fe688052440 comp rx=0 tx=0).stop 2024-05-08T18:31:15.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 -- 172.21.15.87:0/2220800922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297348c90 msgr2=0x5632973490b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 --2- 172.21.15.87:0/2220800922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297348c90 0x5632973490b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x56329732e7f0 tx=0x7fe6900178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 -- 172.21.15.87:0/2220800922 shutdown_connections 2024-05-08T18:31:15.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 --2- 172.21.15.87:0/2220800922 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe57003bb50 0x7fe57003e010 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 --2- 172.21.15.87:0/2220800922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563297348c90 0x5632973490b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 -- 172.21.15.87:0/2220800922 >> 172.21.15.87:0/2220800922 conn(0x56329733cd30 msgr2=0x56329733d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:15.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 -- 172.21.15.87:0/2220800922 shutdown_connections 2024-05-08T18:31:15.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.810+0000 7fe69b52d800 1 -- 172.21.15.87:0/2220800922 wait complete. 2024-05-08T18:31:15.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.811+0000 7fe69b52d800 1 -- 172.21.15.87:0/57973935 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563297338120 msgr2=0x56329733a510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.811+0000 7fe69b52d800 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563297338120 0x56329733a510 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.811+0000 7fe69b52d800 1 -- 172.21.15.87:0/57973935 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563297332620 msgr2=0x563297334a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.811+0000 7fe69b52d800 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563297332620 0x563297334a10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.811+0000 7fe69b52d800 1 -- 172.21.15.87:0/57973935 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe57c03bb50 msgr2=0x7fe57c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.811+0000 7fe69b52d800 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe57c03bb50 0x7fe57c03e010 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe68c000f60 tx=0x7fe68c001370 comp rx=0 tx=0).stop 2024-05-08T18:31:15.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.811+0000 7fe69b52d800 1 -- 172.21.15.87:0/57973935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a6890 msgr2=0x56329732d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.811+0000 7fe69b52d800 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a6890 0x56329732d440 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe688000c00 tx=0x7fe688003020 comp rx=0 tx=0).stop 2024-05-08T18:31:15.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.811+0000 7fe69b52d800 1 -- 172.21.15.87:0/57973935 shutdown_connections 2024-05-08T18:31:15.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.811+0000 7fe69b52d800 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563297332620 0x563297334a10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.811+0000 7fe69b52d800 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563297338120 0x56329733a510 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.811+0000 7fe69b52d800 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe57c03bb50 0x7fe57c03e010 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.811+0000 7fe69b52d800 1 --2- 172.21.15.87:0/57973935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632971a6890 0x56329732d440 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.811+0000 7fe69b52d800 1 -- 172.21.15.87:0/57973935 >> 172.21.15.87:0/57973935 conn(0x56329722d820 msgr2=0x56329731faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:15.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.811+0000 7fe69b52d800 1 -- 172.21.15.87:0/57973935 shutdown_connections 2024-05-08T18:31:15.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.811+0000 7fe69b52d800 1 -- 172.21.15.87:0/57973935 wait complete. 2024-05-08T18:31:15.824 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T18:31:15.825 DEBUG:tasks.util.rgw: json result: [] 2024-05-08T18:31:15.825 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-05-08T18:31:15.825 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-05-08T18:31:15.825 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-05-08T18:31:15.869 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:15.869 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:15.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.872+0000 7fc54fa0f800 1 Processor -- start 2024-05-08T18:31:15.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.872+0000 7fc54fa0f800 1 -- start start 2024-05-08T18:31:15.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.872+0000 7fc54fa0f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a4f267f2b0 0x55a4f267f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.872+0000 7fc54fa0f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a4f267fd50 con 0x55a4f2680470 2024-05-08T18:31:15.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.872+0000 7fc54fa0f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55a4f251fe20 con 0x55a4f267f2b0 2024-05-08T18:31:15.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.872+0000 7fc54b140640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a4f267f2b0 0x55a4f267f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.872+0000 7fc54b140640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a4f267f2b0 0x55a4f267f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60356/0 (socket says 172.21.15.87:60356) 2024-05-08T18:31:15.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.872+0000 7fc54b140640 1 -- 172.21.15.87:0/1127094690 learned_addr learned my addr 172.21.15.87:0/1127094690 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:15.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.872+0000 7fc54a93f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55a4f2680470 0x55a4f26808f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41816/0 (socket says 172.21.15.87:41816) 2024-05-08T18:31:15.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.872+0000 7fc54b140640 1 -- 172.21.15.87:0/1127094690 >> v1:172.21.15.53:6789/0 conn(0x55a4f2680470 legacy=0x55a4f26808f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.872+0000 7fc54b140640 1 -- 172.21.15.87:0/1127094690 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4f2681030 con 0x55a4f267f2b0 2024-05-08T18:31:15.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.874+0000 7fc54b140640 1 --2- 172.21.15.87:0/1127094690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 0x55a4f267f6d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00a520 tx=0x7fc53c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90ae6d6f14979bc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.874+0000 7fc54a13e640 1 -- 172.21.15.87:0/1127094690 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc53c057070 con 0x55a4f267f2b0 2024-05-08T18:31:15.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.875+0000 7fc54a13e640 1 -- 172.21.15.87:0/1127094690 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53c052570 con 0x55a4f267f2b0 2024-05-08T18:31:15.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.875+0000 7fc54a13e640 1 -- 172.21.15.87:0/1127094690 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc53c052870 con 0x55a4f267f2b0 2024-05-08T18:31:15.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.875+0000 7fc54fa0f800 1 -- 172.21.15.87:0/1127094690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 msgr2=0x55a4f267f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.875+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/1127094690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 0x55a4f267f6d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00a520 tx=0x7fc53c01d010 comp rx=0 tx=0).stop 2024-05-08T18:31:15.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.875+0000 7fc54fa0f800 1 -- 172.21.15.87:0/1127094690 shutdown_connections 2024-05-08T18:31:15.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.875+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/1127094690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 0x55a4f267f6d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.875+0000 7fc54fa0f800 1 -- 172.21.15.87:0/1127094690 >> 172.21.15.87:0/1127094690 conn(0x55a4f267a830 msgr2=0x55a4f267cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:15.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.875+0000 7fc54fa0f800 1 -- 172.21.15.87:0/1127094690 shutdown_connections 2024-05-08T18:31:15.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.875+0000 7fc54fa0f800 1 -- 172.21.15.87:0/1127094690 wait complete. 2024-05-08T18:31:15.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.888+0000 7fc54fa0f800 1 Processor -- start 2024-05-08T18:31:15.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.888+0000 7fc54fa0f800 1 -- start start 2024-05-08T18:31:15.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.888+0000 7fc54fa0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 0x55a4f25f4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.888+0000 7fc54fa0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a4f25ca5b0 con 0x55a4f267f2b0 2024-05-08T18:31:15.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.889+0000 7fc54b140640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 0x55a4f25f4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.889+0000 7fc54b140640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 0x55a4f25f4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60372/0 (socket says 172.21.15.87:60372) 2024-05-08T18:31:15.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.889+0000 7fc54b140640 1 -- 172.21.15.87:0/2795415355 learned_addr learned my addr 172.21.15.87:0/2795415355 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:15.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.889+0000 7fc54b140640 1 -- 172.21.15.87:0/2795415355 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4f25f3230 con 0x55a4f267f2b0 2024-05-08T18:31:15.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.889+0000 7fc54b140640 1 --2- 172.21.15.87:0/2795415355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 0x55a4f25f4c70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc53c01d050 tx=0x7fc53c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b404906c5f51539 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.889+0000 7fc43960a640 1 -- 172.21.15.87:0/2795415355 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc53c057040 con 0x55a4f267f2b0 2024-05-08T18:31:15.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.889+0000 7fc43960a640 1 -- 172.21.15.87:0/2795415355 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53c052850 con 0x55a4f267f2b0 2024-05-08T18:31:15.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.889+0000 7fc43960a640 1 -- 172.21.15.87:0/2795415355 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc53c052b70 con 0x55a4f267f2b0 2024-05-08T18:31:15.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.890+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2795415355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 msgr2=0x55a4f25f4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.890+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/2795415355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 0x55a4f25f4c70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc53c01d050 tx=0x7fc53c04c000 comp rx=0 tx=0).stop 2024-05-08T18:31:15.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.890+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2795415355 shutdown_connections 2024-05-08T18:31:15.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.890+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/2795415355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 0x55a4f25f4c70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.890+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2795415355 >> 172.21.15.87:0/2795415355 conn(0x55a4f267a830 msgr2=0x55a4f276c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:15.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.890+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2795415355 shutdown_connections 2024-05-08T18:31:15.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.890+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2795415355 wait complete. 2024-05-08T18:31:15.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.891+0000 7fc54fa0f800 1 Processor -- start 2024-05-08T18:31:15.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.891+0000 7fc54fa0f800 1 -- start start 2024-05-08T18:31:15.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.891+0000 7fc54fa0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 0x55a4f277a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.891+0000 7fc54fa0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a4f2688940 con 0x55a4f267f2b0 2024-05-08T18:31:15.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.891+0000 7fc54b140640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 0x55a4f277a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.891+0000 7fc54b140640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 0x55a4f277a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60386/0 (socket says 172.21.15.87:60386) 2024-05-08T18:31:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.891+0000 7fc54b140640 1 -- 172.21.15.87:0/3065887183 learned_addr learned my addr 172.21.15.87:0/3065887183 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.891+0000 7fc54b140640 1 -- 172.21.15.87:0/3065887183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4f277a820 con 0x55a4f267f2b0 2024-05-08T18:31:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.891+0000 7fc54b140640 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 0x55a4f277a2e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc53c01d050 tx=0x7fc53c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.892+0000 7fc437e07640 1 -- 172.21.15.87:0/3065887183 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc53c073070 con 0x55a4f267f2b0 2024-05-08T18:31:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.892+0000 7fc437e07640 1 -- 172.21.15.87:0/3065887183 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53c05d650 con 0x55a4f267f2b0 2024-05-08T18:31:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.892+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3065887183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4f277aab0 con 0x55a4f267f2b0 2024-05-08T18:31:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.892+0000 7fc437e07640 1 -- 172.21.15.87:0/3065887183 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc53c057070 con 0x55a4f267f2b0 2024-05-08T18:31:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.892+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3065887183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4f277d710 con 0x55a4f267f2b0 2024-05-08T18:31:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.893+0000 7fc437e07640 1 -- 172.21.15.87:0/3065887183 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc53c076070 con 0x55a4f267f2b0 2024-05-08T18:31:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.893+0000 7fc437e07640 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc43003bb50 0x7fc43003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.893+0000 7fc437e07640 1 -- 172.21.15.87:0/3065887183 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc53c094260 con 0x55a4f267f2b0 2024-05-08T18:31:15.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.893+0000 7fc54a93f640 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc43003bb50 0x7fc43003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.893+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a4f2680470 0x55a4f27814d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.893+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3065887183 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f2781af0 con 0x55a4f2680470 2024-05-08T18:31:15.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.893+0000 7fc54b941640 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a4f2680470 0x55a4f27814d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.893+0000 7fc54a93f640 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc43003bb50 0x7fc43003e010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc540000f60 tx=0x7fc540001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.893+0000 7fc54b941640 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a4f2680470 0x55a4f27814d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.894+0000 7fc54b941640 1 -- 172.21.15.87:0/3065887183 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc54400a4a0 con 0x55a4f2680470 2024-05-08T18:31:15.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.894+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3065887183 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f277eaa0 con 0x55a4f2680470 2024-05-08T18:31:15.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.894+0000 7fc54b941640 1 -- 172.21.15.87:0/3065887183 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc54400a4a0 con 0x55a4f2680470 2024-05-08T18:31:15.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.894+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3065887183 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27838f0 con 0x55a4f2680470 2024-05-08T18:31:15.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.894+0000 7fc54b941640 1 -- 172.21.15.87:0/3065887183 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc54400a4a0 con 0x55a4f2680470 2024-05-08T18:31:15.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.894+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3065887183 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f2782a30 con 0x55a4f2680470 2024-05-08T18:31:15.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.895+0000 7fc54b941640 1 -- 172.21.15.87:0/3065887183 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc54400a4a0 con 0x55a4f2680470 2024-05-08T18:31:15.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.895+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a4f2783500 0x55a4f2786d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.895+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3065887183 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27874d0 con 0x55a4f2783500 2024-05-08T18:31:15.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.895+0000 7fc54b140640 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a4f2783500 0x55a4f2786d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.895+0000 7fc54b140640 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a4f2783500 0x55a4f2786d40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.895+0000 7fc54b140640 1 -- 172.21.15.87:0/3065887183 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc53c075030 con 0x55a4f2783500 2024-05-08T18:31:15.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.896+0000 7fc54fa0f800 1 Processor -- start 2024-05-08T18:31:15.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.896+0000 7fc54fa0f800 1 -- start start 2024-05-08T18:31:15.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.896+0000 7fc54fa0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f2795820 0x55a4f2795c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.896+0000 7fc54fa0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a4f2570fc0 con 0x55a4f2795820 2024-05-08T18:31:15.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.896+0000 7fc54b941640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f2795820 0x55a4f2795c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.896+0000 7fc54b941640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f2795820 0x55a4f2795c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60400/0 (socket says 172.21.15.87:60400) 2024-05-08T18:31:15.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.896+0000 7fc54b941640 1 -- 172.21.15.87:0/2985556251 learned_addr learned my addr 172.21.15.87:0/2985556251 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:15.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.896+0000 7fc54b941640 1 -- 172.21.15.87:0/2985556251 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4f2796180 con 0x55a4f2795820 2024-05-08T18:31:15.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.897+0000 7fc54b941640 1 --2- 172.21.15.87:0/2985556251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f2795820 0x55a4f2795c40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55a4f2781eb0 tx=0x7fc5440178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.897+0000 7fc435602640 1 -- 172.21.15.87:0/2985556251 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc544013440 con 0x55a4f2795820 2024-05-08T18:31:15.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.897+0000 7fc435602640 1 -- 172.21.15.87:0/2985556251 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5440135e0 con 0x55a4f2795820 2024-05-08T18:31:15.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.897+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2985556251 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4f2796bf0 con 0x55a4f2795820 2024-05-08T18:31:15.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.897+0000 7fc435602640 1 -- 172.21.15.87:0/2985556251 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5440138c0 con 0x55a4f2795820 2024-05-08T18:31:15.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.897+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2985556251 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4f27970f0 con 0x55a4f2795820 2024-05-08T18:31:15.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.898+0000 7fc435602640 1 -- 172.21.15.87:0/2985556251 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc544011040 con 0x55a4f2795820 2024-05-08T18:31:15.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.898+0000 7fc435602640 1 --2- 172.21.15.87:0/2985556251 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc42403bba0 0x7fc42403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.898+0000 7fc435602640 1 -- 172.21.15.87:0/2985556251 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc54401d070 con 0x55a4f2795820 2024-05-08T18:31:15.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.898+0000 7fc54b140640 1 --2- 172.21.15.87:0/2985556251 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc42403bba0 0x7fc42403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.898+0000 7fc54fa0f800 1 Processor -- start 2024-05-08T18:31:15.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.898+0000 7fc54fa0f800 1 -- start start 2024-05-08T18:31:15.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.898+0000 7fc54b140640 1 --2- 172.21.15.87:0/2985556251 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc42403bba0 0x7fc42403e060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc53c05b4e0 tx=0x7fc53c006a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.898+0000 7fc54fa0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f27a2ac0 0x55a4f27a2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.898+0000 7fc54fa0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a4f25f34f0 con 0x55a4f27a2ac0 2024-05-08T18:31:15.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.899+0000 7fc54b941640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f27a2ac0 0x55a4f27a2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.899+0000 7fc54b941640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f27a2ac0 0x55a4f27a2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60404/0 (socket says 172.21.15.87:60404) 2024-05-08T18:31:15.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.899+0000 7fc54b941640 1 -- 172.21.15.87:0/3605653474 learned_addr learned my addr 172.21.15.87:0/3605653474 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:15.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.899+0000 7fc54b941640 1 -- 172.21.15.87:0/3605653474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4f27a34b0 con 0x55a4f27a2ac0 2024-05-08T18:31:15.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.899+0000 7fc54b941640 1 --2- 172.21.15.87:0/3605653474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f27a2ac0 0x55a4f27a2ee0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc544052970 tx=0x7fc544001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db33189c8285d32 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.899+0000 7fc42effd640 1 -- 172.21.15.87:0/3605653474 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc54404f020 con 0x55a4f27a2ac0 2024-05-08T18:31:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.899+0000 7fc42effd640 1 -- 172.21.15.87:0/3605653474 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5440158e0 con 0x55a4f27a2ac0 2024-05-08T18:31:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.899+0000 7fc42effd640 1 -- 172.21.15.87:0/3605653474 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc54402ad80 con 0x55a4f27a2ac0 2024-05-08T18:31:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.900+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3605653474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f27a2ac0 msgr2=0x55a4f27a2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.900+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/3605653474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f27a2ac0 0x55a4f27a2ee0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc544052970 tx=0x7fc544001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.900+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3605653474 shutdown_connections 2024-05-08T18:31:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.900+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/3605653474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f27a2ac0 0x55a4f27a2ee0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.900+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3605653474 >> 172.21.15.87:0/3605653474 conn(0x55a4f279ee20 msgr2=0x55a4f279ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.900+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3605653474 shutdown_connections 2024-05-08T18:31:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.900+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3605653474 wait complete. 2024-05-08T18:31:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.900+0000 7fc54fa0f800 1 Processor -- start 2024-05-08T18:31:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.900+0000 7fc54fa0f800 1 -- start start 2024-05-08T18:31:15.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.900+0000 7fc54fa0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f27a2ac0 0x55a4f27aa080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.900+0000 7fc54fa0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a4f27a3c20 con 0x55a4f27a2ac0 2024-05-08T18:31:15.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.901+0000 7fc54b941640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f27a2ac0 0x55a4f27aa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.901+0000 7fc54b941640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f27a2ac0 0x55a4f27aa080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60408/0 (socket says 172.21.15.87:60408) 2024-05-08T18:31:15.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.901+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 learned_addr learned my addr 172.21.15.87:0/2743414167 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:15.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.901+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4f27aa5c0 con 0x55a4f27a2ac0 2024-05-08T18:31:15.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.901+0000 7fc54b941640 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f27a2ac0 0x55a4f27aa080 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc544052970 tx=0x7fc544052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.901+0000 7fc42d7fa640 1 -- 172.21.15.87:0/2743414167 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc544030030 con 0x55a4f27a2ac0 2024-05-08T18:31:15.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.901+0000 7fc42d7fa640 1 -- 172.21.15.87:0/2743414167 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc544052be0 con 0x55a4f27a2ac0 2024-05-08T18:31:15.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.901+0000 7fc42d7fa640 1 -- 172.21.15.87:0/2743414167 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc544013a60 con 0x55a4f27a2ac0 2024-05-08T18:31:15.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.901+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4f27aa850 con 0x55a4f27a2ac0 2024-05-08T18:31:15.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.901+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4f27ad500 con 0x55a4f27a2ac0 2024-05-08T18:31:15.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.902+0000 7fc42d7fa640 1 -- 172.21.15.87:0/2743414167 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc544033070 con 0x55a4f27a2ac0 2024-05-08T18:31:15.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.902+0000 7fc42d7fa640 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc41403bb50 0x7fc41403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.902+0000 7fc42d7fa640 1 -- 172.21.15.87:0/2743414167 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc544031070 con 0x55a4f27a2ac0 2024-05-08T18:31:15.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.902+0000 7fc54b140640 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc41403bb50 0x7fc41403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.903+0000 7fc54b140640 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc41403bb50 0x7fc41403e010 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc53c005930 tx=0x7fc53c086000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.903+0000 7fc54fa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.903+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a4f27b5b60 0x55a4f27b8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.903+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27b8770 con 0x55a4f27b5b60 2024-05-08T18:31:15.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.903+0000 7fc54a93f640 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a4f27b5b60 0x55a4f27b8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.903+0000 7fc54a93f640 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a4f27b5b60 0x55a4f27b8020 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:15.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54fa0f800 20 realm 2024-05-08T18:31:15.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54fa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27b4fb0 con 0x55a4f27b5b60 2024-05-08T18:31:15.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:15.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54fa0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:15.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54fa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27b9260 con 0x55a4f27b5b60 2024-05-08T18:31:15.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:15.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54fa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27b9b30 con 0x55a4f27b5b60 2024-05-08T18:31:15.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54fa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:15.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54fa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.904+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27b9ed0 con 0x55a4f27b5b60 2024-05-08T18:31:15.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.905+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.905+0000 7fc54fa0f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:15.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.905+0000 7fc54fa0f800 20 searching for the correct realm 2024-05-08T18:31:15.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.905+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a4f27bbdb0 0x55a4f27be1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.905+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x55a4f27bbdb0 2024-05-08T18:31:15.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.905+0000 7fc54b941640 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a4f27bbdb0 0x55a4f27be1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.905+0000 7fc54b941640 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a4f27bbdb0 0x55a4f27be1e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.905+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.905+0000 7fc54b941640 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc544035030 0x7fc54402a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.905+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x7fc544035030 2024-05-08T18:31:15.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.906+0000 7fc54b140640 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc544035030 0x7fc54402a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.906+0000 7fc54b140640 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc544035030 0x7fc54402a350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.906+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.906+0000 7fc54b140640 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc53c0a1040 0x7fc53c094640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:15.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.906+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x7fc53c0a1040 2024-05-08T18:31:15.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.906+0000 7fc54a93f640 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc53c0a1040 0x7fc53c094640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:15.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.907+0000 7fc54a93f640 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc53c0a1040 0x7fc53c094640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:15.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.907+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.907+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x55a4f27b5b60 2024-05-08T18:31:15.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.907+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.907+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x55a4f27b5b60 2024-05-08T18:31:15.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.907+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.907+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x7fc53c0a1040 2024-05-08T18:31:15.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.908+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.908+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x7fc53c0a1040 2024-05-08T18:31:15.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.908+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.908+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x7fc544035030 2024-05-08T18:31:15.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.908+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.908+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x55a4f27bbdb0 2024-05-08T18:31:15.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.908+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.908+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x55a4f27b5b60 2024-05-08T18:31:15.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.909+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.909+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x7fc53c0a1040 2024-05-08T18:31:15.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.909+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.909+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x55a4f27b5b60 2024-05-08T18:31:15.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.909+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.909+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x7fc544035030 2024-05-08T18:31:15.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.910+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.910+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x55a4f27bbdb0 2024-05-08T18:31:15.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.910+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.910+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x55a4f27bbdb0 2024-05-08T18:31:15.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.910+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.910+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x7fc53c0a1040 2024-05-08T18:31:15.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.910+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.910+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x55a4f27bbdb0 2024-05-08T18:31:15.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.911+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.911+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x55a4f27bbdb0 2024-05-08T18:31:15.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.911+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.911+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x55a4f27b5b60 2024-05-08T18:31:15.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.911+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.911+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x55a4f27b5b60 2024-05-08T18:31:15.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.911+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v20'2 uv2 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.911+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x7fc53c0a1040 2024-05-08T18:31:15.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.912+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.912+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x55a4f27bbdb0 2024-05-08T18:31:15.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.912+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.912+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x7fc544035030 2024-05-08T18:31:15.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.912+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.912+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x55a4f27b5b60 2024-05-08T18:31:15.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.912+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.912+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x7fc53c0a1040 2024-05-08T18:31:15.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.913+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.913+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x55a4f27bbdb0 2024-05-08T18:31:15.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.913+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.913+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x7fc53c0a1040 2024-05-08T18:31:15.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.913+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.913+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x7fc544035030 2024-05-08T18:31:15.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.913+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.913+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x55a4f27bbdb0 2024-05-08T18:31:15.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.914+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.914+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x7fc53c0a1040 2024-05-08T18:31:15.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.914+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.914+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x55a4f27b5b60 2024-05-08T18:31:15.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.914+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.914+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27be8b0 con 0x7fc544035030 2024-05-08T18:31:15.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.914+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.914+0000 7fc54fa0f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:15.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.914+0000 7fc54fa0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:15.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.914+0000 7fc54fa0f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:15.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.914+0000 7fc54fa0f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:15.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.914+0000 7fc54fa0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:15.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.914+0000 7fc54fa0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:15.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54fa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27ba820 con 0x55a4f27b5b60 2024-05-08T18:31:15.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:15.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54fa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27bb0c0 con 0x55a4f27b5b60 2024-05-08T18:31:15.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54fa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:15.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54fa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27bed30 con 0x7fc53c0a1040 2024-05-08T18:31:15.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54fa0f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:15.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54fa0f800 20 zone default found 2024-05-08T18:31:15.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54fa0f800 4 Realm: () 2024-05-08T18:31:15.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54fa0f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:15.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54fa0f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:15.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54fa0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:15.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54fa0f800 20 zonegroup default 2024-05-08T18:31:15.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54fa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.915+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27bad00 con 0x7fc53c0a1040 2024-05-08T18:31:15.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.916+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.916+0000 7fc54fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:15.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.916+0000 7fc54fa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.916+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c0c40 con 0x55a4f27bbdb0 2024-05-08T18:31:15.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.916+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.916+0000 7fc54fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:15.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.916+0000 7fc54fa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.916+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c1010 con 0x55a4f27bbdb0 2024-05-08T18:31:15.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.916+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.916+0000 7fc54fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:15.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.916+0000 7fc54fa0f800 20 started sync module instance, tier type = 2024-05-08T18:31:15.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.916+0000 7fc54fa0f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:15.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.916+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c00e0 con 0x7fc544035030 2024-05-08T18:31:15.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.917+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.917+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94166931211472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27bfd40 con 0x7fc544035030 2024-05-08T18:31:15.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.917+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c1f40 con 0x55a4f27b5b60 2024-05-08T18:31:15.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.918+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94166931211472] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.919+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.919+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94166931217040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c2360 con 0x55a4f27b5b60 2024-05-08T18:31:15.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.919+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c2d20 con 0x55a4f27bbdb0 2024-05-08T18:31:15.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.920+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.920+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94166931220592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c35c0 con 0x55a4f27bbdb0 2024-05-08T18:31:15.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.920+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c40e0 con 0x7fc544035030 2024-05-08T18:31:15.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.920+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94166931217040] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.921+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.921+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94166931225520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c44d0 con 0x7fc544035030 2024-05-08T18:31:15.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.921+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94166931220592] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.921+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c4ee0 con 0x55a4f27b5b60 2024-05-08T18:31:15.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.922+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.922+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94166931229200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c5390 con 0x55a4f27b5b60 2024-05-08T18:31:15.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.922+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c5d50 con 0x7fc53c0a1040 2024-05-08T18:31:15.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.922+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94166931225520] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.923+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94166931229200] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.923+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.923+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94166931232928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c5390 con 0x7fc53c0a1040 2024-05-08T18:31:15.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.923+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c5cc0 con 0x7fc53c0a1040 2024-05-08T18:31:15.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.924+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94166931232928] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.924+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.924+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94166931230432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c5300 con 0x7fc53c0a1040 2024-05-08T18:31:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.924+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c6c10 con 0x7fc53c0a1040 2024-05-08T18:31:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.925+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.925+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94166931230432] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.925+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94166931236704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c6180 con 0x7fc53c0a1040 2024-05-08T18:31:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.925+0000 7fc54fa0f800 20 add_watcher() i=0 2024-05-08T18:31:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.925+0000 7fc54fa0f800 20 add_watcher() i=1 2024-05-08T18:31:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.925+0000 7fc54fa0f800 20 add_watcher() i=2 2024-05-08T18:31:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.925+0000 7fc54fa0f800 20 add_watcher() i=3 2024-05-08T18:31:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.925+0000 7fc54fa0f800 20 add_watcher() i=4 2024-05-08T18:31:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.925+0000 7fc54fa0f800 20 add_watcher() i=5 2024-05-08T18:31:15.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.925+0000 7fc54fa0f800 20 add_watcher() i=6 2024-05-08T18:31:15.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.926+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94166931236704] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.926+0000 7fc54fa0f800 20 add_watcher() i=7 2024-05-08T18:31:15.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.926+0000 7fc54fa0f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:15.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.926+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27ca060 con 0x55a4f27b5b60 2024-05-08T18:31:15.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.927+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.927+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94166931237760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c7490 con 0x55a4f27b5b60 2024-05-08T18:31:15.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.928+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94166931237760] v27'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.928+0000 7fc401fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:15.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.928+0000 7fc54fa0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:15.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.928+0000 7fc54fa0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:15.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.928+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d2910 con 0x55a4f27b5b60 2024-05-08T18:31:15.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.929+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.929+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d2f60 con 0x7fc53c0a1040 2024-05-08T18:31:15.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.931+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.931+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d33c0 con 0x55a4f27bbdb0 2024-05-08T18:31:15.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.932+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.932+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d3750 con 0x55a4f27b5b60 2024-05-08T18:31:15.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.933+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.933+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d3730 con 0x7fc544035030 2024-05-08T18:31:15.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.934+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.934+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4020 con 0x55a4f27bbdb0 2024-05-08T18:31:15.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.935+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.935+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4020 con 0x55a4f27b5b60 2024-05-08T18:31:15.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.936+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.936+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4020 con 0x7fc53c0a1040 2024-05-08T18:31:15.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.937+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.937+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4020 con 0x7fc544035030 2024-05-08T18:31:15.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.939+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.939+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4020 con 0x55a4f27bbdb0 2024-05-08T18:31:15.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.940+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.940+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d43e0 con 0x7fc544035030 2024-05-08T18:31:15.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.941+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.941+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d43e0 con 0x7fc53c0a1040 2024-05-08T18:31:15.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.942+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.942+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d43e0 con 0x7fc544035030 2024-05-08T18:31:15.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.943+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.943+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d43e0 con 0x7fc53c0a1040 2024-05-08T18:31:15.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.944+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'19 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.944+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d45b0 con 0x55a4f27b5b60 2024-05-08T18:31:15.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.945+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'28 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.945+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4020 con 0x55a4f27bbdb0 2024-05-08T18:31:15.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.946+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'14 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.946+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4990 con 0x7fc544035030 2024-05-08T18:31:15.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.947+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.947+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4970 con 0x55a4f27bbdb0 2024-05-08T18:31:15.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.951+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.951+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4970 con 0x55a4f27b5b60 2024-05-08T18:31:15.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.953+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.953+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4970 con 0x55a4f27b5b60 2024-05-08T18:31:15.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.956+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.956+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4970 con 0x55a4f27bbdb0 2024-05-08T18:31:15.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.959+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.959+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4970 con 0x7fc544035030 2024-05-08T18:31:15.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.960+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.960+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4970 con 0x55a4f27bbdb0 2024-05-08T18:31:15.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.962+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.962+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4970 con 0x55a4f27bbdb0 2024-05-08T18:31:15.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.965+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.965+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4970 con 0x55a4f27bbdb0 2024-05-08T18:31:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.967+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.968+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4970 con 0x55a4f27bbdb0 2024-05-08T18:31:15.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.971+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.971+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4970 con 0x7fc53c0a1040 2024-05-08T18:31:15.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.973+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.973+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4970 con 0x55a4f27bbdb0 2024-05-08T18:31:15.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.976+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.976+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d4970 con 0x7fc53c0a1040 2024-05-08T18:31:15.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.979+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.979+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d45b0 con 0x55a4f27bbdb0 2024-05-08T18:31:15.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.980+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.980+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d45b0 con 0x7fc53c0a1040 2024-05-08T18:31:15.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.982+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.982+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d43e0 con 0x7fc544035030 2024-05-08T18:31:15.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.983+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.983+0000 7fc400fe1640 20 reqs_thread_entry: start 2024-05-08T18:31:15.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.983+0000 7fc54fa0f800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:15.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.983+0000 7fc54fa0f800 20 Filter name: none 2024-05-08T18:31:15.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.983+0000 7fc37a7fc640 20 reqs_thread_entry: start 2024-05-08T18:31:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.983+0000 7fc54fa0f800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-08T18:31:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.983+0000 7fc54fa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.983+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27ff620 con 0x7fc544035030 2024-05-08T18:31:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.984+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.984+0000 7fc54fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.984+0000 7fc54fa0f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-05-08T18:31:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.984+0000 7fc54fa0f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:31:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:could not remove user: unable to remove user, user does not exist 2024-05-08T18:31:15.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.984+0000 7fc401fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:15.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.984+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94166931237760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27d0430 con 0x55a4f27b5b60 2024-05-08T18:31:15.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.985+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94166931237760] v27'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.985+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94166931211472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c6b80 con 0x7fc544035030 2024-05-08T18:31:15.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.988+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94166931211472] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.988+0000 7fc54fa0f800 20 remove_watcher() i=0 2024-05-08T18:31:15.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.988+0000 7fc54fa0f800 2 removed watcher, disabling cache 2024-05-08T18:31:15.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.988+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94166931217040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c6b80 con 0x55a4f27b5b60 2024-05-08T18:31:15.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.990+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94166931217040] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.990+0000 7fc54fa0f800 20 remove_watcher() i=1 2024-05-08T18:31:15.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.990+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94166931220592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c1a90 con 0x55a4f27bbdb0 2024-05-08T18:31:15.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.991+0000 7fc54b941640 1 -- 172.21.15.87:0/2743414167 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94166931220592] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc544029070 con 0x55a4f27bbdb0 2024-05-08T18:31:15.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.991+0000 7fc54fa0f800 20 remove_watcher() i=2 2024-05-08T18:31:15.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.991+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94166931225520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c6b80 con 0x7fc544035030 2024-05-08T18:31:15.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.992+0000 7fc54b140640 1 -- 172.21.15.87:0/2743414167 <== osd.2 v2:172.21.15.87:6816/2108501615 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94166931225520] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc53c075030 con 0x7fc544035030 2024-05-08T18:31:15.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.992+0000 7fc54fa0f800 20 remove_watcher() i=3 2024-05-08T18:31:15.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.992+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94166931229200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c1a90 con 0x55a4f27b5b60 2024-05-08T18:31:15.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.993+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94166931229200] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x55a4f27b5b60 2024-05-08T18:31:15.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.993+0000 7fc54fa0f800 20 remove_watcher() i=4 2024-05-08T18:31:15.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.993+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94166931232928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c1a90 con 0x7fc53c0a1040 2024-05-08T18:31:15.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.994+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94166931232928] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.994+0000 7fc54fa0f800 20 remove_watcher() i=5 2024-05-08T18:31:15.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.994+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94166931230432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c1a90 con 0x7fc53c0a1040 2024-05-08T18:31:15.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.995+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94166931230432] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.996+0000 7fc54fa0f800 20 remove_watcher() i=6 2024-05-08T18:31:15.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.996+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94166931236704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4f27c1a90 con 0x7fc53c0a1040 2024-05-08T18:31:15.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94166931236704] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54000f610 con 0x7fc53c0a1040 2024-05-08T18:31:15.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 20 remove_watcher() i=7 2024-05-08T18:31:15.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc53c0a1040 msgr2=0x7fc53c094640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc53c0a1040 0x7fc53c094640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a4f27b5b60 msgr2=0x55a4f27b8020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a4f27b5b60 0x55a4f27b8020 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc544035030 msgr2=0x7fc54402a350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc544035030 0x7fc54402a350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a4f27bbdb0 msgr2=0x55a4f27be1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a4f27bbdb0 0x55a4f27be1e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc41403bb50 msgr2=0x7fc41403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc41403bb50 0x7fc41403e010 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc53c005930 tx=0x7fc53c086000 comp rx=0 tx=0).stop 2024-05-08T18:31:15.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f27a2ac0 msgr2=0x55a4f27aa080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f27a2ac0 0x55a4f27aa080 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc544052970 tx=0x7fc544052900 comp rx=0 tx=0).stop 2024-05-08T18:31:15.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54a93f640 1 -- 172.21.15.87:0/2743414167 reap_dead start 2024-05-08T18:31:15.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 shutdown_connections 2024-05-08T18:31:15.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/2743414167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f27a2ac0 0x55a4f27aa080 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:15.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 >> 172.21.15.87:0/2743414167 conn(0x55a4f279ee20 msgr2=0x55a4f279c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:15.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 shutdown_connections 2024-05-08T18:31:15.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2743414167 wait complete. 2024-05-08T18:31:15.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2985556251 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc42403bba0 msgr2=0x7fc42403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/2985556251 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc42403bba0 0x7fc42403e060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc53c05b4e0 tx=0x7fc53c006a30 comp rx=0 tx=0).stop 2024-05-08T18:31:15.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2985556251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f2795820 msgr2=0x55a4f2795c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:15.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/2985556251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f2795820 0x55a4f2795c40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55a4f2781eb0 tx=0x7fc5440178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2985556251 shutdown_connections 2024-05-08T18:31:16.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/2985556251 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc42403bba0 0x7fc42403e060 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/2985556251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f2795820 0x55a4f2795c40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2985556251 >> 172.21.15.87:0/2985556251 conn(0x55a4f27898c0 msgr2=0x55a4f2789cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2985556251 shutdown_connections 2024-05-08T18:31:16.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.997+0000 7fc54fa0f800 1 -- 172.21.15.87:0/2985556251 wait complete. 2024-05-08T18:31:16.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.998+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3065887183 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a4f2783500 msgr2=0x55a4f2786d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.998+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a4f2783500 0x55a4f2786d40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.998+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3065887183 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a4f2680470 msgr2=0x55a4f27814d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.998+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a4f2680470 0x55a4f27814d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.998+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3065887183 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc43003bb50 msgr2=0x7fc43003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.998+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc43003bb50 0x7fc43003e010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc540000f60 tx=0x7fc540001370 comp rx=0 tx=0).stop 2024-05-08T18:31:16.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.998+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3065887183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 msgr2=0x55a4f277a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.998+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 0x55a4f277a2e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc53c01d050 tx=0x7fc53c003020 comp rx=0 tx=0).stop 2024-05-08T18:31:16.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.998+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3065887183 shutdown_connections 2024-05-08T18:31:16.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.998+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a4f2680470 0x55a4f27814d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.998+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a4f2783500 0x55a4f2786d40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.998+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc43003bb50 0x7fc43003e010 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.998+0000 7fc54fa0f800 1 --2- 172.21.15.87:0/3065887183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4f267f2b0 0x55a4f277a2e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.998+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3065887183 >> 172.21.15.87:0/3065887183 conn(0x55a4f267a830 msgr2=0x55a4f276bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.998+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3065887183 shutdown_connections 2024-05-08T18:31:16.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:15.998+0000 7fc54fa0f800 1 -- 172.21.15.87:0/3065887183 wait complete. 2024-05-08T18:31:16.004 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-08T18:31:16.005 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-05-08T18:31:16.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-05-08T18:31:16.005 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-05-08T18:31:16.049 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:16.049 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:16.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.051+0000 7fb518887800 1 Processor -- start 2024-05-08T18:31:16.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.052+0000 7fb518887800 1 -- start start 2024-05-08T18:31:16.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.052+0000 7fb518887800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5628fe11f5d0 0x5628fe1219c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.052+0000 7fb518887800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5628fe121f90 con 0x5628fe11b140 2024-05-08T18:31:16.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.052+0000 7fb518887800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5628fdfbce20 con 0x5628fe11f5d0 2024-05-08T18:31:16.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.052+0000 7fb50ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5628fe11f5d0 0x5628fe1219c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.052+0000 7fb51637f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5628fe11b140 0x5628fe11b560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41828/0 (socket says 172.21.15.87:41828) 2024-05-08T18:31:16.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.052+0000 7fb51637f640 1 -- 172.21.15.87:0/4108713059 learned_addr learned my addr 172.21.15.87:0/4108713059 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:16.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.052+0000 7fb50ffff640 1 -- 172.21.15.87:0/4108713059 >> v1:172.21.15.53:6789/0 conn(0x5628fe11b140 legacy=0x5628fe11b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.052+0000 7fb50ffff640 1 -- 172.21.15.87:0/4108713059 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628fe1231c0 con 0x5628fe11f5d0 2024-05-08T18:31:16.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.054+0000 7fb50ffff640 1 --2- 172.21.15.87:0/4108713059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11f5d0 0x5628fe1219c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb50000a470 tx=0x7fb50001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350c91ccc43fcca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.054+0000 7fb515b7e640 1 -- 172.21.15.87:0/4108713059 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb500057070 con 0x5628fe11f5d0 2024-05-08T18:31:16.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.054+0000 7fb515b7e640 1 -- 172.21.15.87:0/4108713059 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb500052570 con 0x5628fe11f5d0 2024-05-08T18:31:16.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.055+0000 7fb515b7e640 1 -- 172.21.15.87:0/4108713059 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb500052870 con 0x5628fe11f5d0 2024-05-08T18:31:16.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.055+0000 7fb518887800 1 -- 172.21.15.87:0/4108713059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11f5d0 msgr2=0x5628fe1219c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.055+0000 7fb518887800 1 --2- 172.21.15.87:0/4108713059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11f5d0 0x5628fe1219c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb50000a470 tx=0x7fb50001ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:16.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.055+0000 7fb518887800 1 -- 172.21.15.87:0/4108713059 shutdown_connections 2024-05-08T18:31:16.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.055+0000 7fb518887800 1 --2- 172.21.15.87:0/4108713059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11f5d0 0x5628fe1219c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.055+0000 7fb518887800 1 -- 172.21.15.87:0/4108713059 >> 172.21.15.87:0/4108713059 conn(0x5628fe116720 msgr2=0x5628fe118b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.055+0000 7fb518887800 1 -- 172.21.15.87:0/4108713059 shutdown_connections 2024-05-08T18:31:16.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.055+0000 7fb518887800 1 -- 172.21.15.87:0/4108713059 wait complete. 2024-05-08T18:31:16.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.069+0000 7fb518887800 1 Processor -- start 2024-05-08T18:31:16.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.069+0000 7fb518887800 1 -- start start 2024-05-08T18:31:16.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.069+0000 7fb518887800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11b140 0x5628fe20c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.069+0000 7fb518887800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5628fe0675b0 con 0x5628fe11b140 2024-05-08T18:31:16.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.069+0000 7fb51637f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11b140 0x5628fe20c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.069+0000 7fb51637f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11b140 0x5628fe20c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60430/0 (socket says 172.21.15.87:60430) 2024-05-08T18:31:16.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.069+0000 7fb51637f640 1 -- 172.21.15.87:0/3619308169 learned_addr learned my addr 172.21.15.87:0/3619308169 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.069+0000 7fb51637f640 1 -- 172.21.15.87:0/3619308169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628fe20ca80 con 0x5628fe11b140 2024-05-08T18:31:16.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.070+0000 7fb51637f640 1 --2- 172.21.15.87:0/3619308169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11b140 0x5628fe20c4b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb508001d80 tx=0x7fb508001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd55cbf4e2434b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.070+0000 7fb404608640 1 -- 172.21.15.87:0/3619308169 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb508013030 con 0x5628fe11b140 2024-05-08T18:31:16.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.070+0000 7fb404608640 1 -- 172.21.15.87:0/3619308169 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb50800e470 con 0x5628fe11b140 2024-05-08T18:31:16.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.070+0000 7fb404608640 1 -- 172.21.15.87:0/3619308169 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb50800e810 con 0x5628fe11b140 2024-05-08T18:31:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.070+0000 7fb518887800 1 -- 172.21.15.87:0/3619308169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11b140 msgr2=0x5628fe20c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.070+0000 7fb518887800 1 --2- 172.21.15.87:0/3619308169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11b140 0x5628fe20c4b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb508001d80 tx=0x7fb508001e70 comp rx=0 tx=0).stop 2024-05-08T18:31:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.071+0000 7fb518887800 1 -- 172.21.15.87:0/3619308169 shutdown_connections 2024-05-08T18:31:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.071+0000 7fb518887800 1 --2- 172.21.15.87:0/3619308169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11b140 0x5628fe20c4b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.071+0000 7fb518887800 1 -- 172.21.15.87:0/3619308169 >> 172.21.15.87:0/3619308169 conn(0x5628fe116720 msgr2=0x5628fe207dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.071+0000 7fb518887800 1 -- 172.21.15.87:0/3619308169 shutdown_connections 2024-05-08T18:31:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.071+0000 7fb518887800 1 -- 172.21.15.87:0/3619308169 wait complete. 2024-05-08T18:31:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.071+0000 7fb518887800 1 Processor -- start 2024-05-08T18:31:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.071+0000 7fb518887800 1 -- start start 2024-05-08T18:31:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.071+0000 7fb518887800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11b140 0x5628fe08f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.071+0000 7fb518887800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5628fe122460 con 0x5628fe11b140 2024-05-08T18:31:16.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.071+0000 7fb51637f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11b140 0x5628fe08f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.071+0000 7fb51637f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11b140 0x5628fe08f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60446/0 (socket says 172.21.15.87:60446) 2024-05-08T18:31:16.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.071+0000 7fb51637f640 1 -- 172.21.15.87:0/1345889939 learned_addr learned my addr 172.21.15.87:0/1345889939 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.072+0000 7fb51637f640 1 -- 172.21.15.87:0/1345889939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628fe217d70 con 0x5628fe11b140 2024-05-08T18:31:16.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.072+0000 7fb51637f640 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11b140 0x5628fe08f300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb508004000 tx=0x7fb508000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.072+0000 7fb402e05640 1 -- 172.21.15.87:0/1345889939 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb508027070 con 0x5628fe11b140 2024-05-08T18:31:16.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.072+0000 7fb402e05640 1 -- 172.21.15.87:0/1345889939 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb508019900 con 0x5628fe11b140 2024-05-08T18:31:16.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.072+0000 7fb518887800 1 -- 172.21.15.87:0/1345889939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628fe217f40 con 0x5628fe11b140 2024-05-08T18:31:16.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.072+0000 7fb402e05640 1 -- 172.21.15.87:0/1345889939 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb508019c60 con 0x5628fe11b140 2024-05-08T18:31:16.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.072+0000 7fb518887800 1 -- 172.21.15.87:0/1345889939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628fe218460 con 0x5628fe11b140 2024-05-08T18:31:16.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.073+0000 7fb402e05640 1 -- 172.21.15.87:0/1345889939 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb50802a070 con 0x5628fe11b140 2024-05-08T18:31:16.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.073+0000 7fb402e05640 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb3fc03bb50 0x7fb3fc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.073+0000 7fb402e05640 1 -- 172.21.15.87:0/1345889939 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb50801f070 con 0x5628fe11b140 2024-05-08T18:31:16.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.073+0000 7fb50ffff640 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb3fc03bb50 0x7fb3fc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.073+0000 7fb518887800 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5628fe11f5d0 0x5628fe21c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.073+0000 7fb518887800 1 -- 172.21.15.87:0/1345889939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe21c8c0 con 0x5628fe11f5d0 2024-05-08T18:31:16.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.073+0000 7fb516b80640 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5628fe11f5d0 0x5628fe21c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.074+0000 7fb50ffff640 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb3fc03bb50 0x7fb3fc03e010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb500054000 tx=0x7fb50004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.074+0000 7fb516b80640 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5628fe11f5d0 0x5628fe21c340 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.074+0000 7fb516b80640 1 -- 172.21.15.87:0/1345889939 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb51000a4a0 con 0x5628fe11f5d0 2024-05-08T18:31:16.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.074+0000 7fb518887800 1 -- 172.21.15.87:0/1345889939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe219910 con 0x5628fe11f5d0 2024-05-08T18:31:16.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.074+0000 7fb516b80640 1 -- 172.21.15.87:0/1345889939 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb51000a4a0 con 0x5628fe11f5d0 2024-05-08T18:31:16.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.074+0000 7fb518887800 1 -- 172.21.15.87:0/1345889939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe21e700 con 0x5628fe11f5d0 2024-05-08T18:31:16.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.075+0000 7fb516b80640 1 -- 172.21.15.87:0/1345889939 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb51000a4a0 con 0x5628fe11f5d0 2024-05-08T18:31:16.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.075+0000 7fb518887800 1 -- 172.21.15.87:0/1345889939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe21d930 con 0x5628fe11f5d0 2024-05-08T18:31:16.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.075+0000 7fb516b80640 1 -- 172.21.15.87:0/1345889939 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb51000a4a0 con 0x5628fe11f5d0 2024-05-08T18:31:16.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.075+0000 7fb518887800 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5628fe21fab0 0x5628fe221ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.075+0000 7fb518887800 1 -- 172.21.15.87:0/1345889939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe2223e0 con 0x5628fe21fab0 2024-05-08T18:31:16.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.075+0000 7fb51637f640 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5628fe21fab0 0x5628fe221ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.075+0000 7fb51637f640 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5628fe21fab0 0x5628fe221ea0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.076+0000 7fb51637f640 1 -- 172.21.15.87:0/1345889939 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb508029030 con 0x5628fe21fab0 2024-05-08T18:31:16.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.076+0000 7fb518887800 1 Processor -- start 2024-05-08T18:31:16.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.076+0000 7fb518887800 1 -- start start 2024-05-08T18:31:16.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.076+0000 7fb518887800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe230620 0x5628fe230a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.076+0000 7fb518887800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5628fe00dfc0 con 0x5628fe230620 2024-05-08T18:31:16.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.076+0000 7fb516b80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe230620 0x5628fe230a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.076+0000 7fb516b80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe230620 0x5628fe230a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60460/0 (socket says 172.21.15.87:60460) 2024-05-08T18:31:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.076+0000 7fb516b80640 1 -- 172.21.15.87:0/2865152450 learned_addr learned my addr 172.21.15.87:0/2865152450 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.077+0000 7fb516b80640 1 -- 172.21.15.87:0/2865152450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628fe230f80 con 0x5628fe230620 2024-05-08T18:31:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.077+0000 7fb516b80640 1 --2- 172.21.15.87:0/2865152450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe230620 0x5628fe230a40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x5628fe08f040 tx=0x7fb5100178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.077+0000 7fb3fbfff640 1 -- 172.21.15.87:0/2865152450 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb510013440 con 0x5628fe230620 2024-05-08T18:31:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.077+0000 7fb3fbfff640 1 -- 172.21.15.87:0/2865152450 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5100135e0 con 0x5628fe230620 2024-05-08T18:31:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.077+0000 7fb518887800 1 -- 172.21.15.87:0/2865152450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628fe2319f0 con 0x5628fe230620 2024-05-08T18:31:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.077+0000 7fb3fbfff640 1 -- 172.21.15.87:0/2865152450 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5100138c0 con 0x5628fe230620 2024-05-08T18:31:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.077+0000 7fb518887800 1 -- 172.21.15.87:0/2865152450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628fe231ef0 con 0x5628fe230620 2024-05-08T18:31:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.078+0000 7fb3fbfff640 1 -- 172.21.15.87:0/2865152450 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb510011040 con 0x5628fe230620 2024-05-08T18:31:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.078+0000 7fb3fbfff640 1 --2- 172.21.15.87:0/2865152450 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb3f003bb50 0x7fb3f003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.078+0000 7fb3fbfff640 1 -- 172.21.15.87:0/2865152450 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb51001d070 con 0x5628fe230620 2024-05-08T18:31:16.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.078+0000 7fb51637f640 1 --2- 172.21.15.87:0/2865152450 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb3f003bb50 0x7fb3f003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.078+0000 7fb518887800 1 Processor -- start 2024-05-08T18:31:16.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.079+0000 7fb518887800 1 -- start start 2024-05-08T18:31:16.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.079+0000 7fb51637f640 1 --2- 172.21.15.87:0/2865152450 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb3f003bb50 0x7fb3f003e010 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb50800cae0 tx=0x7fb50800ef30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.079+0000 7fb518887800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe23d940 0x5628fe23dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.079+0000 7fb518887800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5628fe20ce00 con 0x5628fe23d940 2024-05-08T18:31:16.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.079+0000 7fb516b80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe23d940 0x5628fe23dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.079+0000 7fb516b80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe23d940 0x5628fe23dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60470/0 (socket says 172.21.15.87:60470) 2024-05-08T18:31:16.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.079+0000 7fb516b80640 1 -- 172.21.15.87:0/3406997617 learned_addr learned my addr 172.21.15.87:0/3406997617 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.079+0000 7fb516b80640 1 -- 172.21.15.87:0/3406997617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628fe23e330 con 0x5628fe23d940 2024-05-08T18:31:16.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.079+0000 7fb516b80640 1 --2- 172.21.15.87:0/3406997617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe23d940 0x5628fe23dd60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb5100529a0 tx=0x7fb510001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72171f464fb1db27 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.079+0000 7fb3f9ffb640 1 -- 172.21.15.87:0/3406997617 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5100540d0 con 0x5628fe23d940 2024-05-08T18:31:16.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.079+0000 7fb3f9ffb640 1 -- 172.21.15.87:0/3406997617 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb510054270 con 0x5628fe23d940 2024-05-08T18:31:16.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.079+0000 7fb3f9ffb640 1 -- 172.21.15.87:0/3406997617 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb510001660 con 0x5628fe23d940 2024-05-08T18:31:16.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.080+0000 7fb518887800 1 -- 172.21.15.87:0/3406997617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe23d940 msgr2=0x5628fe23dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.080+0000 7fb518887800 1 --2- 172.21.15.87:0/3406997617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe23d940 0x5628fe23dd60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb5100529a0 tx=0x7fb510001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:16.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.080+0000 7fb518887800 1 -- 172.21.15.87:0/3406997617 shutdown_connections 2024-05-08T18:31:16.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.080+0000 7fb518887800 1 --2- 172.21.15.87:0/3406997617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe23d940 0x5628fe23dd60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.080+0000 7fb518887800 1 -- 172.21.15.87:0/3406997617 >> 172.21.15.87:0/3406997617 conn(0x5628fe239ca0 msgr2=0x5628fe237d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.080+0000 7fb518887800 1 -- 172.21.15.87:0/3406997617 shutdown_connections 2024-05-08T18:31:16.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.080+0000 7fb518887800 1 -- 172.21.15.87:0/3406997617 wait complete. 2024-05-08T18:31:16.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.080+0000 7fb518887800 1 Processor -- start 2024-05-08T18:31:16.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.080+0000 7fb518887800 1 -- start start 2024-05-08T18:31:16.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.080+0000 7fb518887800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe23d940 0x5628fe244f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.080+0000 7fb518887800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5628fe23eaa0 con 0x5628fe23d940 2024-05-08T18:31:16.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.081+0000 7fb516b80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe23d940 0x5628fe244f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.081+0000 7fb516b80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe23d940 0x5628fe244f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60484/0 (socket says 172.21.15.87:60484) 2024-05-08T18:31:16.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.081+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 learned_addr learned my addr 172.21.15.87:0/3960345217 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.081+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628fe245470 con 0x5628fe23d940 2024-05-08T18:31:16.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.081+0000 7fb516b80640 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe23d940 0x5628fe244f30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb510001ea0 tx=0x7fb510052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.081+0000 7fb3e7fff640 1 -- 172.21.15.87:0/3960345217 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb510030020 con 0x5628fe23d940 2024-05-08T18:31:16.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.081+0000 7fb3e7fff640 1 -- 172.21.15.87:0/3960345217 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb510015ab0 con 0x5628fe23d940 2024-05-08T18:31:16.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.081+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628fe245700 con 0x5628fe23d940 2024-05-08T18:31:16.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.081+0000 7fb3e7fff640 1 -- 172.21.15.87:0/3960345217 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb510015430 con 0x5628fe23d940 2024-05-08T18:31:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.081+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628fe2483b0 con 0x5628fe23d940 2024-05-08T18:31:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.082+0000 7fb3e7fff640 1 -- 172.21.15.87:0/3960345217 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb510033020 con 0x5628fe23d940 2024-05-08T18:31:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.082+0000 7fb3e7fff640 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb3e003bb50 0x7fb3e003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.082+0000 7fb3e7fff640 1 -- 172.21.15.87:0/3960345217 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb51000e040 con 0x5628fe23d940 2024-05-08T18:31:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.082+0000 7fb51637f640 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb3e003bb50 0x7fb3e003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.083+0000 7fb51637f640 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb3e003bb50 0x7fb3e003e010 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb508051210 tx=0x7fb508044000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.083+0000 7fb518887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.083+0000 7fb518887800 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5628fe250bb0 0x5628fe253070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.083+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe2537c0 con 0x5628fe250bb0 2024-05-08T18:31:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.083+0000 7fb50ffff640 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5628fe250bb0 0x5628fe253070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.083+0000 7fb50ffff640 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5628fe250bb0 0x5628fe253070 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.083+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.083+0000 7fb518887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.083+0000 7fb518887800 20 realm 2024-05-08T18:31:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.083+0000 7fb518887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.083+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe253b90 con 0x5628fe250bb0 2024-05-08T18:31:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb518887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb518887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb518887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe254460 con 0x5628fe250bb0 2024-05-08T18:31:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb518887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb518887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe254800 con 0x5628fe250bb0 2024-05-08T18:31:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb518887800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb518887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe255050 con 0x5628fe250bb0 2024-05-08T18:31:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb518887800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb518887800 20 searching for the correct realm 2024-05-08T18:31:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb518887800 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5628fe256dc0 0x5628fe2591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.084+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x5628fe256dc0 2024-05-08T18:31:16.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.085+0000 7fb516b80640 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5628fe256dc0 0x5628fe2591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.085+0000 7fb516b80640 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5628fe256dc0 0x5628fe2591b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.085+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510029070 con 0x5628fe256dc0 2024-05-08T18:31:16.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.085+0000 7fb516b80640 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fb510035020 0x7fb510004600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.085+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x7fb510035020 2024-05-08T18:31:16.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.085+0000 7fb51637f640 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fb510035020 0x7fb510004600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.086+0000 7fb51637f640 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fb510035020 0x7fb510004600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.086+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.086+0000 7fb51637f640 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fb50802c060 0x7fb50802a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.086+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x7fb50802c060 2024-05-08T18:31:16.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.086+0000 7fb50ffff640 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fb50802c060 0x7fb50802a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.087+0000 7fb50ffff640 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fb50802c060 0x7fb50802a7e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.087+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.087+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x5628fe250bb0 2024-05-08T18:31:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.087+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.087+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x5628fe250bb0 2024-05-08T18:31:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.087+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.087+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x7fb50802c060 2024-05-08T18:31:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.088+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.088+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x7fb50802c060 2024-05-08T18:31:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.088+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.088+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x7fb510035020 2024-05-08T18:31:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.088+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.088+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x5628fe256dc0 2024-05-08T18:31:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.088+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510029070 con 0x5628fe256dc0 2024-05-08T18:31:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.088+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x5628fe250bb0 2024-05-08T18:31:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.089+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.089+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x7fb50802c060 2024-05-08T18:31:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.089+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.089+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x5628fe250bb0 2024-05-08T18:31:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.089+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.089+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x7fb510035020 2024-05-08T18:31:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.089+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.090+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x5628fe256dc0 2024-05-08T18:31:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.090+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.090+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x5628fe256dc0 2024-05-08T18:31:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.090+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.090+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x7fb50802c060 2024-05-08T18:31:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.090+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.090+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x5628fe256dc0 2024-05-08T18:31:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.091+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.091+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x5628fe256dc0 2024-05-08T18:31:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.091+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.091+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x5628fe250bb0 2024-05-08T18:31:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.091+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.091+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x5628fe250bb0 2024-05-08T18:31:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.091+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v20'2 uv2 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.091+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x7fb50802c060 2024-05-08T18:31:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.091+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.091+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x5628fe256dc0 2024-05-08T18:31:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.092+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.092+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x7fb510035020 2024-05-08T18:31:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.092+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.092+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x5628fe250bb0 2024-05-08T18:31:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.092+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.092+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x7fb50802c060 2024-05-08T18:31:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.092+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.092+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x5628fe256dc0 2024-05-08T18:31:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.093+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.093+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x7fb50802c060 2024-05-08T18:31:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.093+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.093+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x7fb510035020 2024-05-08T18:31:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.093+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.093+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x5628fe256dc0 2024-05-08T18:31:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.093+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.093+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x7fb50802c060 2024-05-08T18:31:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.094+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.094+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x5628fe250bb0 2024-05-08T18:31:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.094+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.094+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259740 con 0x7fb510035020 2024-05-08T18:31:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.094+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.094+0000 7fb518887800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.094+0000 7fb518887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.094+0000 7fb518887800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.094+0000 7fb518887800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.094+0000 7fb518887800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.094+0000 7fb518887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.094+0000 7fb518887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.094+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe255a00 con 0x5628fe250bb0 2024-05-08T18:31:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.094+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.094+0000 7fb518887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.094+0000 7fb518887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.094+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe2562a0 con 0x5628fe250bb0 2024-05-08T18:31:16.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb518887800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:16.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb518887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe259bc0 con 0x7fb50802c060 2024-05-08T18:31:16.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb518887800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:16.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb518887800 20 zone default found 2024-05-08T18:31:16.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb518887800 4 Realm: () 2024-05-08T18:31:16.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb518887800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:16.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb518887800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:16.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb518887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:16.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb518887800 20 zonegroup default 2024-05-08T18:31:16.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb518887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25a070 con 0x7fb50802c060 2024-05-08T18:31:16.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb518887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb518887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.095+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25ba50 con 0x5628fe256dc0 2024-05-08T18:31:16.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.096+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.096+0000 7fb518887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.096+0000 7fb518887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.096+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25bef0 con 0x5628fe256dc0 2024-05-08T18:31:16.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.096+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.096+0000 7fb518887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.096+0000 7fb518887800 20 started sync module instance, tier type = 2024-05-08T18:31:16.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.096+0000 7fb518887800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:16.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.096+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25aee0 con 0x7fb510035020 2024-05-08T18:31:16.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.097+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.097+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94734062564048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25c800 con 0x7fb510035020 2024-05-08T18:31:16.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.097+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25d050 con 0x5628fe250bb0 2024-05-08T18:31:16.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.098+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94734062564048] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.098+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.098+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94734062568272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25d0b0 con 0x5628fe250bb0 2024-05-08T18:31:16.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.098+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25dbc0 con 0x5628fe256dc0 2024-05-08T18:31:16.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.099+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94734062568272] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.100+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.100+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94734062573168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25dfb0 con 0x5628fe256dc0 2024-05-08T18:31:16.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.100+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25e9e0 con 0x7fb510035020 2024-05-08T18:31:16.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.101+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.101+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94734062576880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25f2b0 con 0x7fb510035020 2024-05-08T18:31:16.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.101+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25fdb0 con 0x5628fe250bb0 2024-05-08T18:31:16.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.101+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94734062573168] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.102+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94734062576880] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.103+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.103+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94734062581920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25ee00 con 0x5628fe250bb0 2024-05-08T18:31:16.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.103+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe260650 con 0x7fb50802c060 2024-05-08T18:31:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.104+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94734062581920] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.104+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.104+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94734062570400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25ee00 con 0x7fb50802c060 2024-05-08T18:31:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.104+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe260c50 con 0x7fb50802c060 2024-05-08T18:31:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.105+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94734062570400] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.105+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.105+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94734062585664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe260c10 con 0x7fb50802c060 2024-05-08T18:31:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.105+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe261650 con 0x7fb50802c060 2024-05-08T18:31:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.106+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.106+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94734062588192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe261ac0 con 0x7fb50802c060 2024-05-08T18:31:16.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.106+0000 7fb518887800 20 add_watcher() i=0 2024-05-08T18:31:16.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.106+0000 7fb518887800 20 add_watcher() i=1 2024-05-08T18:31:16.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.106+0000 7fb518887800 20 add_watcher() i=2 2024-05-08T18:31:16.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.106+0000 7fb518887800 20 add_watcher() i=3 2024-05-08T18:31:16.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.106+0000 7fb518887800 20 add_watcher() i=4 2024-05-08T18:31:16.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.106+0000 7fb518887800 20 add_watcher() i=5 2024-05-08T18:31:16.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.106+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94734062585664] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.106+0000 7fb518887800 20 add_watcher() i=6 2024-05-08T18:31:16.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.107+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94734062588192] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.107+0000 7fb518887800 20 add_watcher() i=7 2024-05-08T18:31:16.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.107+0000 7fb518887800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:16.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.107+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe261ac0 con 0x5628fe250bb0 2024-05-08T18:31:16.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.108+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.108+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94734062589456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe261a30 con 0x5628fe250bb0 2024-05-08T18:31:16.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.109+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94734062589456] v27'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.109+0000 7fb3ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:16.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.109+0000 7fb518887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:16.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.109+0000 7fb518887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:16.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.109+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26d350 con 0x5628fe250bb0 2024-05-08T18:31:16.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.110+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.110+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26da20 con 0x7fb50802c060 2024-05-08T18:31:16.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.111+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.111+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26df90 con 0x5628fe256dc0 2024-05-08T18:31:16.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.112+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.112+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26df90 con 0x5628fe250bb0 2024-05-08T18:31:16.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.113+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.113+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26e520 con 0x7fb510035020 2024-05-08T18:31:16.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.114+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.114+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26e920 con 0x5628fe256dc0 2024-05-08T18:31:16.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.115+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.115+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26e920 con 0x5628fe250bb0 2024-05-08T18:31:16.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.116+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.116+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26e920 con 0x7fb50802c060 2024-05-08T18:31:16.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.117+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.117+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26e920 con 0x7fb510035020 2024-05-08T18:31:16.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.118+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.119+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26e9b0 con 0x5628fe256dc0 2024-05-08T18:31:16.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.119+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.119+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26ea40 con 0x7fb510035020 2024-05-08T18:31:16.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.120+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.121+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x7fb50802c060 2024-05-08T18:31:16.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.122+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.122+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x7fb510035020 2024-05-08T18:31:16.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.123+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.123+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x7fb50802c060 2024-05-08T18:31:16.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.124+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'21 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.124+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x5628fe250bb0 2024-05-08T18:31:16.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.125+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'33 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.125+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x5628fe256dc0 2024-05-08T18:31:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.126+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'17 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.126+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x7fb510035020 2024-05-08T18:31:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.127+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.127+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x5628fe256dc0 2024-05-08T18:31:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.128+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.128+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x5628fe250bb0 2024-05-08T18:31:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.129+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.129+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x5628fe250bb0 2024-05-08T18:31:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.130+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'34 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.130+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x5628fe256dc0 2024-05-08T18:31:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.131+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.131+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x7fb510035020 2024-05-08T18:31:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.132+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.132+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x5628fe256dc0 2024-05-08T18:31:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.133+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.133+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x5628fe256dc0 2024-05-08T18:31:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.134+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.134+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x5628fe256dc0 2024-05-08T18:31:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.135+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.135+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x5628fe256dc0 2024-05-08T18:31:16.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.136+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.136+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x7fb50802c060 2024-05-08T18:31:16.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.137+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.137+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x5628fe256dc0 2024-05-08T18:31:16.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.138+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.138+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x7fb50802c060 2024-05-08T18:31:16.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.139+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.139+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x5628fe256dc0 2024-05-08T18:31:16.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.140+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.140+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x7fb50802c060 2024-05-08T18:31:16.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.142+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.142+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26efc0 con 0x7fb510035020 2024-05-08T18:31:16.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.143+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.143+0000 7fb3477fe640 20 reqs_thread_entry: start 2024-05-08T18:31:16.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.143+0000 7fb518887800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:16.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.143+0000 7fb518887800 20 Filter name: none 2024-05-08T18:31:16.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.143+0000 7fb3457fa640 20 reqs_thread_entry: start 2024-05-08T18:31:16.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.143+0000 7fb518887800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-08T18:31:16.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.144+0000 7fb518887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.144+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5628fe299e90 con 0x7fb50802c060 2024-05-08T18:31:16.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.144+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.144+0000 7fb518887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.144+0000 7fb518887800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-05-08T18:31:16.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.144+0000 7fb518887800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T18:31:16.144 INFO:teuthology.orchestra.run.smithi087.stderr:could not remove user: unable to remove user, user does not exist 2024-05-08T18:31:16.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.145+0000 7fb3ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:16.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.145+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94734062589456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe26b640 con 0x5628fe250bb0 2024-05-08T18:31:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.146+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94734062589456] v27'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.146+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94734062564048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe261610 con 0x7fb510035020 2024-05-08T18:31:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.147+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94734062564048] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.147+0000 7fb518887800 20 remove_watcher() i=0 2024-05-08T18:31:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.147+0000 7fb518887800 2 removed watcher, disabling cache 2024-05-08T18:31:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.147+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94734062568272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe261610 con 0x5628fe250bb0 2024-05-08T18:31:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.148+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94734062568272] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.148+0000 7fb518887800 20 remove_watcher() i=1 2024-05-08T18:31:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.148+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94734062573168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25c350 con 0x5628fe256dc0 2024-05-08T18:31:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.149+0000 7fb516b80640 1 -- 172.21.15.87:0/3960345217 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94734062573168] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510061040 con 0x5628fe256dc0 2024-05-08T18:31:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.149+0000 7fb518887800 20 remove_watcher() i=2 2024-05-08T18:31:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.149+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94734062576880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe261610 con 0x7fb510035020 2024-05-08T18:31:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.150+0000 7fb51637f640 1 -- 172.21.15.87:0/3960345217 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94734062576880] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50803e070 con 0x7fb510035020 2024-05-08T18:31:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.150+0000 7fb518887800 20 remove_watcher() i=3 2024-05-08T18:31:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.150+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94734062581920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25d670 con 0x5628fe250bb0 2024-05-08T18:31:16.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.152+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94734062581920] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x5628fe250bb0 2024-05-08T18:31:16.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.152+0000 7fb518887800 20 remove_watcher() i=4 2024-05-08T18:31:16.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.152+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94734062570400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25c350 con 0x7fb50802c060 2024-05-08T18:31:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.153+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94734062570400] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.153+0000 7fb518887800 20 remove_watcher() i=5 2024-05-08T18:31:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.153+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94734062585664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe261610 con 0x7fb50802c060 2024-05-08T18:31:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.155+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94734062585664] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.155+0000 7fb518887800 20 remove_watcher() i=6 2024-05-08T18:31:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.155+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94734062588192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5628fe25d670 con 0x7fb50802c060 2024-05-08T18:31:16.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94734062588192] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50005a040 con 0x7fb50802c060 2024-05-08T18:31:16.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 20 remove_watcher() i=7 2024-05-08T18:31:16.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fb50802c060 msgr2=0x7fb50802a7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fb50802c060 0x7fb50802a7e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5628fe250bb0 msgr2=0x5628fe253070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5628fe250bb0 0x5628fe253070 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fb510035020 msgr2=0x7fb510004600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fb510035020 0x7fb510004600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5628fe256dc0 msgr2=0x5628fe2591b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5628fe256dc0 0x5628fe2591b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb3e003bb50 msgr2=0x7fb3e003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb3e003bb50 0x7fb3e003e010 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb508051210 tx=0x7fb508044000 comp rx=0 tx=0).stop 2024-05-08T18:31:16.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe23d940 msgr2=0x5628fe244f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb50ffff640 1 -- 172.21.15.87:0/3960345217 reap_dead start 2024-05-08T18:31:16.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe23d940 0x5628fe244f30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb510001ea0 tx=0x7fb510052900 comp rx=0 tx=0).stop 2024-05-08T18:31:16.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 shutdown_connections 2024-05-08T18:31:16.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 --2- 172.21.15.87:0/3960345217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe23d940 0x5628fe244f30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 >> 172.21.15.87:0/3960345217 conn(0x5628fe239ca0 msgr2=0x5628fe237300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 shutdown_connections 2024-05-08T18:31:16.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 -- 172.21.15.87:0/3960345217 wait complete. 2024-05-08T18:31:16.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 -- 172.21.15.87:0/2865152450 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb3f003bb50 msgr2=0x7fb3f003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 --2- 172.21.15.87:0/2865152450 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb3f003bb50 0x7fb3f003e010 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb50800cae0 tx=0x7fb50800ef30 comp rx=0 tx=0).stop 2024-05-08T18:31:16.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 -- 172.21.15.87:0/2865152450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe230620 msgr2=0x5628fe230a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.156+0000 7fb518887800 1 --2- 172.21.15.87:0/2865152450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe230620 0x5628fe230a40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x5628fe08f040 tx=0x7fb5100178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 -- 172.21.15.87:0/2865152450 shutdown_connections 2024-05-08T18:31:16.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 --2- 172.21.15.87:0/2865152450 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb3f003bb50 0x7fb3f003e010 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 --2- 172.21.15.87:0/2865152450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe230620 0x5628fe230a40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 -- 172.21.15.87:0/2865152450 >> 172.21.15.87:0/2865152450 conn(0x5628fe2246c0 msgr2=0x5628fe224ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 -- 172.21.15.87:0/2865152450 shutdown_connections 2024-05-08T18:31:16.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 -- 172.21.15.87:0/2865152450 wait complete. 2024-05-08T18:31:16.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 -- 172.21.15.87:0/1345889939 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5628fe21fab0 msgr2=0x5628fe221ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5628fe21fab0 0x5628fe221ea0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 -- 172.21.15.87:0/1345889939 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5628fe11f5d0 msgr2=0x5628fe21c340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5628fe11f5d0 0x5628fe21c340 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 -- 172.21.15.87:0/1345889939 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb3fc03bb50 msgr2=0x7fb3fc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb3fc03bb50 0x7fb3fc03e010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb500054000 tx=0x7fb50004e000 comp rx=0 tx=0).stop 2024-05-08T18:31:16.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 -- 172.21.15.87:0/1345889939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11b140 msgr2=0x5628fe08f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11b140 0x5628fe08f300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb508004000 tx=0x7fb508000bc0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 -- 172.21.15.87:0/1345889939 shutdown_connections 2024-05-08T18:31:16.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5628fe11f5d0 0x5628fe21c340 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5628fe21fab0 0x5628fe221ea0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb3fc03bb50 0x7fb3fc03e010 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 --2- 172.21.15.87:0/1345889939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628fe11b140 0x5628fe08f300 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 -- 172.21.15.87:0/1345889939 >> 172.21.15.87:0/1345889939 conn(0x5628fe116720 msgr2=0x5628fe2065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 -- 172.21.15.87:0/1345889939 shutdown_connections 2024-05-08T18:31:16.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.157+0000 7fb518887800 1 -- 172.21.15.87:0/1345889939 wait complete. 2024-05-08T18:31:16.163 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-08T18:31:16.164 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-08T18:31:16.164 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-08T18:31:16.164 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-08T18:31:16.208 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:16.208 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:16.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.211+0000 7fd4af03f800 1 Processor -- start 2024-05-08T18:31:16.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.211+0000 7fd4af03f800 1 -- start start 2024-05-08T18:31:16.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.211+0000 7fd4af03f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fdc75cbd50 0x55fdc75ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.211+0000 7fd4af03f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fdc75d2190 con 0x55fdc75ce680 2024-05-08T18:31:16.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.211+0000 7fd4af03f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55fdc746be20 con 0x55fdc75cbd50 2024-05-08T18:31:16.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.211+0000 7fd4acb37640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fdc75cbd50 0x55fdc75ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.211+0000 7fd4acb37640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fdc75cbd50 0x55fdc75ce140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60494/0 (socket says 172.21.15.87:60494) 2024-05-08T18:31:16.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.211+0000 7fd4acb37640 1 -- 172.21.15.87:0/2672661487 learned_addr learned my addr 172.21.15.87:0/2672661487 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.211+0000 7fd4a7fff640 1 --1- 172.21.15.87:0/2672661487 >> v1:172.21.15.53:6789/0 conn(0x55fdc75ce680 0x55fdc75d0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41830/0 (socket says 172.21.15.87:41830) 2024-05-08T18:31:16.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.212+0000 7fd4acb37640 1 -- 172.21.15.87:0/2672661487 >> v1:172.21.15.53:6789/0 conn(0x55fdc75ce680 legacy=0x55fdc75d0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.212+0000 7fd4acb37640 1 -- 172.21.15.87:0/2672661487 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdc75d3370 con 0x55fdc75cbd50 2024-05-08T18:31:16.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.213+0000 7fd4acb37640 1 --2- 172.21.15.87:0/2672661487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 0x55fdc75ce140 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000a520 tx=0x7fd4a001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c73ccca1b454149 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.214+0000 7fd4a77fe640 1 -- 172.21.15.87:0/2672661487 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a0057070 con 0x55fdc75cbd50 2024-05-08T18:31:16.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.214+0000 7fd4a77fe640 1 -- 172.21.15.87:0/2672661487 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a0052570 con 0x55fdc75cbd50 2024-05-08T18:31:16.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.214+0000 7fd4a77fe640 1 -- 172.21.15.87:0/2672661487 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a004ae60 con 0x55fdc75cbd50 2024-05-08T18:31:16.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.214+0000 7fd4af03f800 1 -- 172.21.15.87:0/2672661487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 msgr2=0x55fdc75ce140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.214+0000 7fd4af03f800 1 --2- 172.21.15.87:0/2672661487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 0x55fdc75ce140 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000a520 tx=0x7fd4a001d010 comp rx=0 tx=0).stop 2024-05-08T18:31:16.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.214+0000 7fd4af03f800 1 -- 172.21.15.87:0/2672661487 shutdown_connections 2024-05-08T18:31:16.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.214+0000 7fd4af03f800 1 --2- 172.21.15.87:0/2672661487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 0x55fdc75ce140 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.214+0000 7fd4af03f800 1 -- 172.21.15.87:0/2672661487 >> 172.21.15.87:0/2672661487 conn(0x55fdc75c56a0 msgr2=0x55fdc75c7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.214+0000 7fd4af03f800 1 -- 172.21.15.87:0/2672661487 shutdown_connections 2024-05-08T18:31:16.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.214+0000 7fd4af03f800 1 -- 172.21.15.87:0/2672661487 wait complete. 2024-05-08T18:31:16.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.228+0000 7fd4af03f800 1 Processor -- start 2024-05-08T18:31:16.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.228+0000 7fd4af03f800 1 -- start start 2024-05-08T18:31:16.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.228+0000 7fd4af03f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 0x55fdc76bc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.228+0000 7fd4af03f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fdc75165b0 con 0x55fdc75cbd50 2024-05-08T18:31:16.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.228+0000 7fd4acb37640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 0x55fdc76bc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.228+0000 7fd4acb37640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 0x55fdc76bc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60500/0 (socket says 172.21.15.87:60500) 2024-05-08T18:31:16.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.228+0000 7fd4acb37640 1 -- 172.21.15.87:0/791537801 learned_addr learned my addr 172.21.15.87:0/791537801 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.228+0000 7fd4acb37640 1 -- 172.21.15.87:0/791537801 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdc76bcc00 con 0x55fdc75cbd50 2024-05-08T18:31:16.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.229+0000 7fd4acb37640 1 --2- 172.21.15.87:0/791537801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 0x55fdc76bc630 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0055040 tx=0x7fd4a004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2edcaca5f8238d5a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.229+0000 7fd39ae05640 1 -- 172.21.15.87:0/791537801 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a0057040 con 0x55fdc75cbd50 2024-05-08T18:31:16.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.229+0000 7fd39ae05640 1 -- 172.21.15.87:0/791537801 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a0052720 con 0x55fdc75cbd50 2024-05-08T18:31:16.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.229+0000 7fd39ae05640 1 -- 172.21.15.87:0/791537801 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a0052a20 con 0x55fdc75cbd50 2024-05-08T18:31:16.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.229+0000 7fd4af03f800 1 -- 172.21.15.87:0/791537801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 msgr2=0x55fdc76bc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.229+0000 7fd4af03f800 1 --2- 172.21.15.87:0/791537801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 0x55fdc76bc630 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0055040 tx=0x7fd4a004c000 comp rx=0 tx=0).stop 2024-05-08T18:31:16.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.230+0000 7fd4af03f800 1 -- 172.21.15.87:0/791537801 shutdown_connections 2024-05-08T18:31:16.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.230+0000 7fd4af03f800 1 --2- 172.21.15.87:0/791537801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 0x55fdc76bc630 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.230+0000 7fd4af03f800 1 -- 172.21.15.87:0/791537801 >> 172.21.15.87:0/791537801 conn(0x55fdc75c56a0 msgr2=0x55fdc76b7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.230+0000 7fd4af03f800 1 -- 172.21.15.87:0/791537801 shutdown_connections 2024-05-08T18:31:16.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.230+0000 7fd4af03f800 1 -- 172.21.15.87:0/791537801 wait complete. 2024-05-08T18:31:16.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.230+0000 7fd4af03f800 1 Processor -- start 2024-05-08T18:31:16.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.230+0000 7fd4af03f800 1 -- start start 2024-05-08T18:31:16.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.230+0000 7fd4af03f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 0x55fdc76c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.230+0000 7fd4af03f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fdc75d2600 con 0x55fdc75cbd50 2024-05-08T18:31:16.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.230+0000 7fd4acb37640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 0x55fdc76c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.230+0000 7fd4acb37640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 0x55fdc76c40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60502/0 (socket says 172.21.15.87:60502) 2024-05-08T18:31:16.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.230+0000 7fd4acb37640 1 -- 172.21.15.87:0/1332559051 learned_addr learned my addr 172.21.15.87:0/1332559051 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.231+0000 7fd4acb37640 1 -- 172.21.15.87:0/1332559051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdc76c4630 con 0x55fdc75cbd50 2024-05-08T18:31:16.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.231+0000 7fd4acb37640 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 0x55fdc76c40f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00524f0 tx=0x7fd4a0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.231+0000 7fd399602640 1 -- 172.21.15.87:0/1332559051 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a0073070 con 0x55fdc75cbd50 2024-05-08T18:31:16.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.231+0000 7fd399602640 1 -- 172.21.15.87:0/1332559051 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a005d440 con 0x55fdc75cbd50 2024-05-08T18:31:16.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.231+0000 7fd4af03f800 1 -- 172.21.15.87:0/1332559051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fdc76c48c0 con 0x55fdc75cbd50 2024-05-08T18:31:16.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.231+0000 7fd399602640 1 -- 172.21.15.87:0/1332559051 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a0057070 con 0x55fdc75cbd50 2024-05-08T18:31:16.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.231+0000 7fd4af03f800 1 -- 172.21.15.87:0/1332559051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdc76c74d0 con 0x55fdc75cbd50 2024-05-08T18:31:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.232+0000 7fd399602640 1 -- 172.21.15.87:0/1332559051 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd4a0076070 con 0x55fdc75cbd50 2024-05-08T18:31:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.232+0000 7fd399602640 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd39403bb50 0x7fd39403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.232+0000 7fd399602640 1 -- 172.21.15.87:0/1332559051 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd4a0094210 con 0x55fdc75cbd50 2024-05-08T18:31:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.232+0000 7fd4a7fff640 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd39403bb50 0x7fd39403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.232+0000 7fd4af03f800 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fdc75ce680 0x55fdc76cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.232+0000 7fd4af03f800 1 -- 172.21.15.87:0/1332559051 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc76cb810 con 0x55fdc75ce680 2024-05-08T18:31:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.232+0000 7fd4ad338640 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fdc75ce680 0x55fdc76cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.232+0000 7fd4a7fff640 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd39403bb50 0x7fd39403e010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd498000f60 tx=0x7fd498001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.233+0000 7fd4ad338640 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fdc75ce680 0x55fdc76cb290 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.233+0000 7fd4ad338640 1 -- 172.21.15.87:0/1332559051 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4a800a4a0 con 0x55fdc75ce680 2024-05-08T18:31:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.233+0000 7fd4af03f800 1 -- 172.21.15.87:0/1332559051 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc76c8860 con 0x55fdc75ce680 2024-05-08T18:31:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.233+0000 7fd4ad338640 1 -- 172.21.15.87:0/1332559051 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4a800a4a0 con 0x55fdc75ce680 2024-05-08T18:31:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.233+0000 7fd4af03f800 1 -- 172.21.15.87:0/1332559051 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc76cd630 con 0x55fdc75ce680 2024-05-08T18:31:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.233+0000 7fd4ad338640 1 -- 172.21.15.87:0/1332559051 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd4a800a4a0 con 0x55fdc75ce680 2024-05-08T18:31:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.233+0000 7fd4af03f800 1 -- 172.21.15.87:0/1332559051 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc76cc860 con 0x55fdc75ce680 2024-05-08T18:31:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.234+0000 7fd4ad338640 1 -- 172.21.15.87:0/1332559051 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4a800a4a0 con 0x55fdc75ce680 2024-05-08T18:31:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.234+0000 7fd4af03f800 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55fdc76ce9e0 0x55fdc76d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.234+0000 7fd4af03f800 1 -- 172.21.15.87:0/1332559051 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc76d1310 con 0x55fdc76ce9e0 2024-05-08T18:31:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.234+0000 7fd4acb37640 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55fdc76ce9e0 0x55fdc76d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.234+0000 7fd4acb37640 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55fdc76ce9e0 0x55fdc76d0dd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.235+0000 7fd4acb37640 1 -- 172.21.15.87:0/1332559051 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd4a0075030 con 0x55fdc76ce9e0 2024-05-08T18:31:16.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.235+0000 7fd4af03f800 1 Processor -- start 2024-05-08T18:31:16.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.235+0000 7fd4af03f800 1 -- start start 2024-05-08T18:31:16.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.235+0000 7fd4af03f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76df550 0x55fdc76df970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.235+0000 7fd4af03f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fdc74bcfc0 con 0x55fdc76df550 2024-05-08T18:31:16.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.235+0000 7fd4ad338640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76df550 0x55fdc76df970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.235+0000 7fd4ad338640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76df550 0x55fdc76df970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60514/0 (socket says 172.21.15.87:60514) 2024-05-08T18:31:16.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.235+0000 7fd4ad338640 1 -- 172.21.15.87:0/3309553161 learned_addr learned my addr 172.21.15.87:0/3309553161 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.236+0000 7fd4ad338640 1 -- 172.21.15.87:0/3309553161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdc76dfeb0 con 0x55fdc76df550 2024-05-08T18:31:16.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.236+0000 7fd4ad338640 1 --2- 172.21.15.87:0/3309553161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76df550 0x55fdc76df970 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55fdc76c5450 tx=0x7fd4a80178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.236+0000 7fd3927fc640 1 -- 172.21.15.87:0/3309553161 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a8013440 con 0x55fdc76df550 2024-05-08T18:31:16.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.236+0000 7fd3927fc640 1 -- 172.21.15.87:0/3309553161 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a80135e0 con 0x55fdc76df550 2024-05-08T18:31:16.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.236+0000 7fd4af03f800 1 -- 172.21.15.87:0/3309553161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fdc76e0920 con 0x55fdc76df550 2024-05-08T18:31:16.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.236+0000 7fd3927fc640 1 -- 172.21.15.87:0/3309553161 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a80138c0 con 0x55fdc76df550 2024-05-08T18:31:16.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.236+0000 7fd4af03f800 1 -- 172.21.15.87:0/3309553161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdc76e0e20 con 0x55fdc76df550 2024-05-08T18:31:16.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.237+0000 7fd3927fc640 1 -- 172.21.15.87:0/3309553161 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd4a8011040 con 0x55fdc76df550 2024-05-08T18:31:16.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.237+0000 7fd3927fc640 1 --2- 172.21.15.87:0/3309553161 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd38403bb50 0x7fd38403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.237+0000 7fd3927fc640 1 -- 172.21.15.87:0/3309553161 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd4a801d070 con 0x55fdc76df550 2024-05-08T18:31:16.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.237+0000 7fd4acb37640 1 --2- 172.21.15.87:0/3309553161 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd38403bb50 0x7fd38403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.237+0000 7fd4af03f800 1 Processor -- start 2024-05-08T18:31:16.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.238+0000 7fd4af03f800 1 -- start start 2024-05-08T18:31:16.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.238+0000 7fd4acb37640 1 --2- 172.21.15.87:0/3309553161 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd38403bb50 0x7fd38403e010 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00928e0 tx=0x7fd4a0092550 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.238+0000 7fd4af03f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76ec870 0x55fdc76ecc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.238+0000 7fd4af03f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fdc76bcec0 con 0x55fdc76ec870 2024-05-08T18:31:16.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.238+0000 7fd4ad338640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76ec870 0x55fdc76ecc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.238+0000 7fd4ad338640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76ec870 0x55fdc76ecc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60528/0 (socket says 172.21.15.87:60528) 2024-05-08T18:31:16.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.238+0000 7fd4ad338640 1 -- 172.21.15.87:0/488202773 learned_addr learned my addr 172.21.15.87:0/488202773 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.238+0000 7fd4ad338640 1 -- 172.21.15.87:0/488202773 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdc76ed260 con 0x55fdc76ec870 2024-05-08T18:31:16.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.238+0000 7fd4ad338640 1 --2- 172.21.15.87:0/488202773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76ec870 0x55fdc76ecc90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80529a0 tx=0x7fd4a8001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92cb681505113730 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.239+0000 7fd383fff640 1 -- 172.21.15.87:0/488202773 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a802ad80 con 0x55fdc76ec870 2024-05-08T18:31:16.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.239+0000 7fd383fff640 1 -- 172.21.15.87:0/488202773 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a80014f0 con 0x55fdc76ec870 2024-05-08T18:31:16.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.239+0000 7fd383fff640 1 -- 172.21.15.87:0/488202773 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a80017d0 con 0x55fdc76ec870 2024-05-08T18:31:16.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.239+0000 7fd4af03f800 1 -- 172.21.15.87:0/488202773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76ec870 msgr2=0x55fdc76ecc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.239+0000 7fd4af03f800 1 --2- 172.21.15.87:0/488202773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76ec870 0x55fdc76ecc90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80529a0 tx=0x7fd4a8001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:16.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.239+0000 7fd4af03f800 1 -- 172.21.15.87:0/488202773 shutdown_connections 2024-05-08T18:31:16.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.239+0000 7fd4af03f800 1 --2- 172.21.15.87:0/488202773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76ec870 0x55fdc76ecc90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.239+0000 7fd4af03f800 1 -- 172.21.15.87:0/488202773 >> 172.21.15.87:0/488202773 conn(0x55fdc76e8b80 msgr2=0x55fdc76e6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.239+0000 7fd4af03f800 1 -- 172.21.15.87:0/488202773 shutdown_connections 2024-05-08T18:31:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.239+0000 7fd4af03f800 1 -- 172.21.15.87:0/488202773 wait complete. 2024-05-08T18:31:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.239+0000 7fd4af03f800 1 Processor -- start 2024-05-08T18:31:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.239+0000 7fd4af03f800 1 -- start start 2024-05-08T18:31:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.240+0000 7fd4af03f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76ec870 0x55fdc76f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.240+0000 7fd4af03f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fdc76eda30 con 0x55fdc76ec870 2024-05-08T18:31:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.240+0000 7fd4ad338640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76ec870 0x55fdc76f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.240+0000 7fd4ad338640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76ec870 0x55fdc76f3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60534/0 (socket says 172.21.15.87:60534) 2024-05-08T18:31:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.240+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 learned_addr learned my addr 172.21.15.87:0/3937558042 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.240+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdc76f42e0 con 0x55fdc76ec870 2024-05-08T18:31:16.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.240+0000 7fd4ad338640 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76ec870 0x55fdc76f3da0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8001f90 tx=0x7fd4a800a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.240+0000 7fd3827fc640 1 -- 172.21.15.87:0/3937558042 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a8030070 con 0x55fdc76ec870 2024-05-08T18:31:16.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.240+0000 7fd3827fc640 1 -- 172.21.15.87:0/3937558042 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a8051310 con 0x55fdc76ec870 2024-05-08T18:31:16.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.240+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fdc76f4570 con 0x55fdc76ec870 2024-05-08T18:31:16.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.240+0000 7fd3827fc640 1 -- 172.21.15.87:0/3937558042 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a8013a60 con 0x55fdc76ec870 2024-05-08T18:31:16.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.240+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdc76f7220 con 0x55fdc76ec870 2024-05-08T18:31:16.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.241+0000 7fd3827fc640 1 -- 172.21.15.87:0/3937558042 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd4a8033070 con 0x55fdc76ec870 2024-05-08T18:31:16.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.241+0000 7fd3827fc640 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd37803bb50 0x7fd37803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.241+0000 7fd3827fc640 1 -- 172.21.15.87:0/3937558042 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd4a800e040 con 0x55fdc76ec870 2024-05-08T18:31:16.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.241+0000 7fd4acb37640 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd37803bb50 0x7fd37803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.242+0000 7fd4acb37640 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd37803bb50 0x7fd37803e010 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55fdc76cd590 tx=0x7fd4a0089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.242+0000 7fd4af03f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.242+0000 7fd4af03f800 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fdc76ff8b0 0x55fdc7701d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.242+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc77024c0 con 0x55fdc76ff8b0 2024-05-08T18:31:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.242+0000 7fd4a7fff640 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fdc76ff8b0 0x55fdc7701d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.242+0000 7fd4a7fff640 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fdc76ff8b0 0x55fdc7701d70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4af03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4af03f800 20 realm 2024-05-08T18:31:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4af03f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc76fed00 con 0x55fdc76ff8b0 2024-05-08T18:31:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4af03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4af03f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:16.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4af03f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7702fb0 con 0x55fdc76ff8b0 2024-05-08T18:31:16.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4af03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4af03f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7703880 con 0x55fdc76ff8b0 2024-05-08T18:31:16.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4af03f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:16.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4af03f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.243+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7703c20 con 0x55fdc76ff8b0 2024-05-08T18:31:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.244+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.244+0000 7fd4af03f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.244+0000 7fd4af03f800 20 searching for the correct realm 2024-05-08T18:31:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.244+0000 7fd4af03f800 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55fdc7705b00 0x55fdc7707f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.244+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7708600 con 0x55fdc7705b00 2024-05-08T18:31:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.244+0000 7fd4ad338640 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55fdc7705b00 0x55fdc7707f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.244+0000 7fd4ad338640 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55fdc7705b00 0x55fdc7707f30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.244+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.244+0000 7fd4ad338640 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd4a8035070 0x7fd4a80259d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.244+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7708600 con 0x7fd4a8035070 2024-05-08T18:31:16.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.245+0000 7fd4acb37640 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd4a8035070 0x7fd4a80259d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.245+0000 7fd4acb37640 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd4a8035070 0x7fd4a80259d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.245+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.245+0000 7fd4acb37640 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd4a0085040 0x7fd4a0076360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.245+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7708600 con 0x7fd4a0085040 2024-05-08T18:31:16.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.245+0000 7fd4a7fff640 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd4a0085040 0x7fd4a0076360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.246+0000 7fd4a7fff640 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd4a0085040 0x7fd4a0076360 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.246+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.246+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7708600 con 0x55fdc76ff8b0 2024-05-08T18:31:16.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.246+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.246+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7708600 con 0x55fdc76ff8b0 2024-05-08T18:31:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.246+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.246+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7708600 con 0x7fd4a0085040 2024-05-08T18:31:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.247+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.247+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7708600 con 0x7fd4a0085040 2024-05-08T18:31:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.247+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.247+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7708600 con 0x7fd4a8035070 2024-05-08T18:31:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.247+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.247+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7708600 con 0x55fdc7705b00 2024-05-08T18:31:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.247+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.247+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7708600 con 0x55fdc76ff8b0 2024-05-08T18:31:16.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.248+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.248+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7708600 con 0x7fd4a0085040 2024-05-08T18:31:16.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.248+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.248+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7708600 con 0x55fdc76ff8b0 2024-05-08T18:31:16.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.248+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.248+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7708600 con 0x7fd4a8035070 2024-05-08T18:31:16.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.248+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.248+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7708600 con 0x55fdc7705b00 2024-05-08T18:31:16.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.249+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.249+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7708600 con 0x55fdc7705b00 2024-05-08T18:31:16.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.249+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.249+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd4a8062040 con 0x7fd4a0085040 2024-05-08T18:31:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.249+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.249+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd4a8062040 con 0x55fdc7705b00 2024-05-08T18:31:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.249+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.249+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd4a8062040 con 0x55fdc7705b00 2024-05-08T18:31:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.250+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.250+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd4a8062040 con 0x55fdc76ff8b0 2024-05-08T18:31:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.250+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.250+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd4a8062040 con 0x55fdc76ff8b0 2024-05-08T18:31:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.250+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v20'2 uv2 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.250+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd4a8062040 con 0x7fd4a0085040 2024-05-08T18:31:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.251+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.251+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd4a8062040 con 0x55fdc7705b00 2024-05-08T18:31:16.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.251+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.251+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd4a8062040 con 0x7fd4a8035070 2024-05-08T18:31:16.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.251+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.251+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd4a8062040 con 0x55fdc76ff8b0 2024-05-08T18:31:16.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.251+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.251+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd4a8062040 con 0x7fd4a0085040 2024-05-08T18:31:16.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.252+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.252+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd4a8062040 con 0x55fdc7705b00 2024-05-08T18:31:16.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.252+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.252+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd4a8062040 con 0x7fd4a0085040 2024-05-08T18:31:16.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.252+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.252+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd4a8062040 con 0x7fd4a8035070 2024-05-08T18:31:16.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.253+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.253+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd4a8062040 con 0x55fdc7705b00 2024-05-08T18:31:16.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.253+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.253+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd4a8062040 con 0x7fd4a0085040 2024-05-08T18:31:16.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.253+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.253+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd4a8062040 con 0x55fdc76ff8b0 2024-05-08T18:31:16.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.253+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.253+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd4a8062040 con 0x7fd4a8035070 2024-05-08T18:31:16.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:16.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:16.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:16.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:16.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:16.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:16.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc77045d0 con 0x55fdc76ff8b0 2024-05-08T18:31:16.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7704e70 con 0x55fdc76ff8b0 2024-05-08T18:31:16.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:16.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7708a80 con 0x7fd4a0085040 2024-05-08T18:31:16.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:16.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 20 zone default found 2024-05-08T18:31:16.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 4 Realm: () 2024-05-08T18:31:16.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:16.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:16.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:16.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 20 zonegroup default 2024-05-08T18:31:16.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.254+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7708f30 con 0x7fd4a0085040 2024-05-08T18:31:16.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.255+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.255+0000 7fd4af03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.255+0000 7fd4af03f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.255+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770a910 con 0x55fdc7705b00 2024-05-08T18:31:16.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.255+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.255+0000 7fd4af03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.255+0000 7fd4af03f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.255+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770add0 con 0x55fdc7705b00 2024-05-08T18:31:16.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.255+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.255+0000 7fd4af03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.255+0000 7fd4af03f800 20 started sync module instance, tier type = 2024-05-08T18:31:16.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.255+0000 7fd4af03f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:16.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.255+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7709da0 con 0x7fd4a8035070 2024-05-08T18:31:16.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.256+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.256+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94548461134224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7709a00 con 0x7fd4a8035070 2024-05-08T18:31:16.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.256+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770bd00 con 0x55fdc76ff8b0 2024-05-08T18:31:16.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.259+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.259+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94548461140528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770c4a0 con 0x55fdc76ff8b0 2024-05-08T18:31:16.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.259+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770cfc0 con 0x55fdc7705b00 2024-05-08T18:31:16.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.259+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94548461134224] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.262+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.262+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94548461144720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770cf80 con 0x55fdc7705b00 2024-05-08T18:31:16.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.262+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770da70 con 0x7fd4a8035070 2024-05-08T18:31:16.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.262+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94548461140528] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.265+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94548461144720] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.265+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.265+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94548461138480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770bef0 con 0x7fd4a8035070 2024-05-08T18:31:16.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.265+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770e4b0 con 0x55fdc76ff8b0 2024-05-08T18:31:16.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.275+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.275+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94548461150480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770eb40 con 0x55fdc76ff8b0 2024-05-08T18:31:16.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.275+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770f640 con 0x7fd4a0085040 2024-05-08T18:31:16.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.277+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.277+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94548461154608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770f600 con 0x7fd4a0085040 2024-05-08T18:31:16.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.277+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7710580 con 0x7fd4a0085040 2024-05-08T18:31:16.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.277+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94548461138480] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.278+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94548461154608] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.279+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94548461150480] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.279+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.279+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94548461158576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7710580 con 0x7fd4a0085040 2024-05-08T18:31:16.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.279+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc77109a0 con 0x7fd4a0085040 2024-05-08T18:31:16.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.280+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.280+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94548461158576] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.280+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94548461156320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7710580 con 0x7fd4a0085040 2024-05-08T18:31:16.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.280+0000 7fd4af03f800 20 add_watcher() i=0 2024-05-08T18:31:16.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.280+0000 7fd4af03f800 20 add_watcher() i=1 2024-05-08T18:31:16.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.280+0000 7fd4af03f800 20 add_watcher() i=2 2024-05-08T18:31:16.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.280+0000 7fd4af03f800 20 add_watcher() i=3 2024-05-08T18:31:16.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.280+0000 7fd4af03f800 20 add_watcher() i=4 2024-05-08T18:31:16.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.280+0000 7fd4af03f800 20 add_watcher() i=5 2024-05-08T18:31:16.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.280+0000 7fd4af03f800 20 add_watcher() i=6 2024-05-08T18:31:16.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.281+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94548461156320] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.281+0000 7fd4af03f800 20 add_watcher() i=7 2024-05-08T18:31:16.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.281+0000 7fd4af03f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:16.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.281+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc77139d0 con 0x55fdc76ff8b0 2024-05-08T18:31:16.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.281+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.281+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94548461147520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7710e50 con 0x55fdc76ff8b0 2024-05-08T18:31:16.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.283+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94548461147520] v27'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.283+0000 7fd362fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:16.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.283+0000 7fd4af03f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:16.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.283+0000 7fd4af03f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:16.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.283+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771c250 con 0x55fdc76ff8b0 2024-05-08T18:31:16.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.284+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.284+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771c880 con 0x7fd4a0085040 2024-05-08T18:31:16.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.286+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.286+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771cd00 con 0x55fdc7705b00 2024-05-08T18:31:16.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.286+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.287+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771cd70 con 0x55fdc76ff8b0 2024-05-08T18:31:16.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.288+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.288+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771cea0 con 0x7fd4a8035070 2024-05-08T18:31:16.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.289+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.289+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771d830 con 0x55fdc7705b00 2024-05-08T18:31:16.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.290+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.290+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771d830 con 0x55fdc76ff8b0 2024-05-08T18:31:16.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.292+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.292+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771d830 con 0x7fd4a0085040 2024-05-08T18:31:16.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.293+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.293+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771d830 con 0x7fd4a8035070 2024-05-08T18:31:16.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.294+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.294+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771d8c0 con 0x55fdc7705b00 2024-05-08T18:31:16.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.296+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.296+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771d950 con 0x7fd4a8035070 2024-05-08T18:31:16.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.299+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.299+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771de00 con 0x7fd4a0085040 2024-05-08T18:31:16.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.300+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.300+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771de00 con 0x7fd4a8035070 2024-05-08T18:31:16.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.302+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.302+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771de00 con 0x7fd4a0085040 2024-05-08T18:31:16.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.303+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'23 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.303+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x55fdc76ff8b0 2024-05-08T18:31:16.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.305+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'38 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.305+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x55fdc7705b00 2024-05-08T18:31:16.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.306+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.306+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x7fd4a8035070 2024-05-08T18:31:16.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.307+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.307+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x55fdc7705b00 2024-05-08T18:31:16.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.308+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.308+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x55fdc76ff8b0 2024-05-08T18:31:16.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.309+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.309+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x55fdc76ff8b0 2024-05-08T18:31:16.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.311+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.311+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x55fdc7705b00 2024-05-08T18:31:16.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.312+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.312+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x7fd4a8035070 2024-05-08T18:31:16.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.314+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.314+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x55fdc7705b00 2024-05-08T18:31:16.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.315+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.315+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x55fdc7705b00 2024-05-08T18:31:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.317+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.317+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x55fdc7705b00 2024-05-08T18:31:16.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.319+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.319+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x55fdc7705b00 2024-05-08T18:31:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.320+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.321+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x7fd4a0085040 2024-05-08T18:31:16.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.323+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.323+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x55fdc7705b00 2024-05-08T18:31:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.324+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.324+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x7fd4a0085040 2024-05-08T18:31:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.326+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.326+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x55fdc7705b00 2024-05-08T18:31:16.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.328+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.328+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x7fd4a0085040 2024-05-08T18:31:16.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.329+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.329+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771dd70 con 0x7fd4a8035070 2024-05-08T18:31:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.330+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.330+0000 7fd361fe3640 20 reqs_thread_entry: start 2024-05-08T18:31:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.330+0000 7fd4af03f800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.330+0000 7fd4af03f800 20 Filter name: none 2024-05-08T18:31:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.330+0000 7fd2d37fe640 20 reqs_thread_entry: start 2024-05-08T18:31:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.331+0000 7fd4af03f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:31:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.331+0000 7fd4af03f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.331+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fdc7748c70 con 0x7fd4a0085040 2024-05-08T18:31:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.331+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.331+0000 7fd4af03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.331+0000 7fd4af03f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-08T18:31:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.331+0000 7fd4af03f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:31:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:could not remove user: unable to remove user, user does not exist 2024-05-08T18:31:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.332+0000 7fd362fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.332+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94548461147520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc771a5a0 con 0x55fdc76ff8b0 2024-05-08T18:31:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.333+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94548461147520] v27'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.333+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94548461134224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770d580 con 0x7fd4a8035070 2024-05-08T18:31:16.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.335+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94548461134224] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.335+0000 7fd4af03f800 20 remove_watcher() i=0 2024-05-08T18:31:16.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.335+0000 7fd4af03f800 2 removed watcher, disabling cache 2024-05-08T18:31:16.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.335+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94548461140528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770d580 con 0x55fdc76ff8b0 2024-05-08T18:31:16.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.336+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94548461140528] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.336+0000 7fd4af03f800 20 remove_watcher() i=1 2024-05-08T18:31:16.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.336+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94548461144720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770ba30 con 0x55fdc7705b00 2024-05-08T18:31:16.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.337+0000 7fd4ad338640 1 -- 172.21.15.87:0/3937558042 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94548461144720] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4a803c070 con 0x55fdc7705b00 2024-05-08T18:31:16.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.337+0000 7fd4af03f800 20 remove_watcher() i=2 2024-05-08T18:31:16.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.337+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94548461138480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770d580 con 0x7fd4a8035070 2024-05-08T18:31:16.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.338+0000 7fd4acb37640 1 -- 172.21.15.87:0/3937558042 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94548461138480] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4a0075030 con 0x7fd4a8035070 2024-05-08T18:31:16.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.338+0000 7fd4af03f800 20 remove_watcher() i=3 2024-05-08T18:31:16.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.338+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94548461150480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770ca90 con 0x55fdc76ff8b0 2024-05-08T18:31:16.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.344+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94548461150480] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x55fdc76ff8b0 2024-05-08T18:31:16.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.344+0000 7fd4af03f800 20 remove_watcher() i=4 2024-05-08T18:31:16.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.344+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94548461154608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770ba30 con 0x7fd4a0085040 2024-05-08T18:31:16.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.345+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94548461154608] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.345+0000 7fd4af03f800 20 remove_watcher() i=5 2024-05-08T18:31:16.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.345+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94548461158576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770d580 con 0x7fd4a0085040 2024-05-08T18:31:16.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.346+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94548461158576] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.346+0000 7fd4af03f800 20 remove_watcher() i=6 2024-05-08T18:31:16.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.346+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94548461156320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fdc770e110 con 0x7fd4a0085040 2024-05-08T18:31:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.347+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94548461156320] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd49800f610 con 0x7fd4a0085040 2024-05-08T18:31:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.347+0000 7fd4af03f800 20 remove_watcher() i=7 2024-05-08T18:31:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.347+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd4a0085040 msgr2=0x7fd4a0076360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.347+0000 7fd4af03f800 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd4a0085040 0x7fd4a0076360 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.347+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fdc76ff8b0 msgr2=0x55fdc7701d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.347+0000 7fd4af03f800 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fdc76ff8b0 0x55fdc7701d70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.347+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd4a8035070 msgr2=0x7fd4a80259d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.347+0000 7fd4af03f800 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd4a8035070 0x7fd4a80259d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.347+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55fdc7705b00 msgr2=0x55fdc7707f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.347+0000 7fd4af03f800 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55fdc7705b00 0x55fdc7707f30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.347+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd37803bb50 msgr2=0x7fd37803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.347+0000 7fd4af03f800 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd37803bb50 0x7fd37803e010 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55fdc76cd590 tx=0x7fd4a0089000 comp rx=0 tx=0).stop 2024-05-08T18:31:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.347+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76ec870 msgr2=0x55fdc76f3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.347+0000 7fd4af03f800 1 --2- 172.21.15.87:0/3937558042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76ec870 0x55fdc76f3da0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8001f90 tx=0x7fd4a800a0e0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.347+0000 7fd4a7fff640 1 -- 172.21.15.87:0/3937558042 reap_dead start 2024-05-08T18:31:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.347+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 shutdown_connections 2024-05-08T18:31:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.347+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 >> 172.21.15.87:0/3937558042 conn(0x55fdc76e8b80 msgr2=0x55fdc76e6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 shutdown_connections 2024-05-08T18:31:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 -- 172.21.15.87:0/3937558042 wait complete. 2024-05-08T18:31:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 -- 172.21.15.87:0/3309553161 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd38403bb50 msgr2=0x7fd38403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 --2- 172.21.15.87:0/3309553161 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd38403bb50 0x7fd38403e010 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00928e0 tx=0x7fd4a0092550 comp rx=0 tx=0).stop 2024-05-08T18:31:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 -- 172.21.15.87:0/3309553161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76df550 msgr2=0x55fdc76df970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 --2- 172.21.15.87:0/3309553161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76df550 0x55fdc76df970 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55fdc76c5450 tx=0x7fd4a80178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 -- 172.21.15.87:0/3309553161 shutdown_connections 2024-05-08T18:31:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 --2- 172.21.15.87:0/3309553161 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd38403bb50 0x7fd38403e010 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 --2- 172.21.15.87:0/3309553161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc76df550 0x55fdc76df970 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 -- 172.21.15.87:0/3309553161 >> 172.21.15.87:0/3309553161 conn(0x55fdc76d35f0 msgr2=0x55fdc76d39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 -- 172.21.15.87:0/3309553161 shutdown_connections 2024-05-08T18:31:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 -- 172.21.15.87:0/3309553161 wait complete. 2024-05-08T18:31:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 -- 172.21.15.87:0/1332559051 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55fdc76ce9e0 msgr2=0x55fdc76d0dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55fdc76ce9e0 0x55fdc76d0dd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 -- 172.21.15.87:0/1332559051 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fdc75ce680 msgr2=0x55fdc76cb290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fdc75ce680 0x55fdc76cb290 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 -- 172.21.15.87:0/1332559051 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd39403bb50 msgr2=0x7fd39403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd39403bb50 0x7fd39403e010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd498000f60 tx=0x7fd498001370 comp rx=0 tx=0).stop 2024-05-08T18:31:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 -- 172.21.15.87:0/1332559051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 msgr2=0x55fdc76c40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 0x55fdc76c40f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00524f0 tx=0x7fd4a0003020 comp rx=0 tx=0).stop 2024-05-08T18:31:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 -- 172.21.15.87:0/1332559051 shutdown_connections 2024-05-08T18:31:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fdc75ce680 0x55fdc76cb290 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55fdc76ce9e0 0x55fdc76d0dd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd39403bb50 0x7fd39403e010 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 --2- 172.21.15.87:0/1332559051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fdc75cbd50 0x55fdc76c40f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.348+0000 7fd4af03f800 1 -- 172.21.15.87:0/1332559051 >> 172.21.15.87:0/1332559051 conn(0x55fdc75c56a0 msgr2=0x55fdc76b6750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.349+0000 7fd4af03f800 1 -- 172.21.15.87:0/1332559051 shutdown_connections 2024-05-08T18:31:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.349+0000 7fd4af03f800 1 -- 172.21.15.87:0/1332559051 wait complete. 2024-05-08T18:31:16.355 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-08T18:31:16.355 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-08T18:31:16.355 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-08T18:31:16.356 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-08T18:31:16.399 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:16.399 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:16.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.402+0000 7fdb54d33800 1 Processor -- start 2024-05-08T18:31:16.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.402+0000 7fdb54d33800 1 -- start start 2024-05-08T18:31:16.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.402+0000 7fdb54d33800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560882ac0b80 0x560882ac0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.402+0000 7fdb54d33800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560882a35630 con 0x560882ac14e0 2024-05-08T18:31:16.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.402+0000 7fdb54d33800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x560882962e20 con 0x560882ac0b80 2024-05-08T18:31:16.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.402+0000 7fdb509ee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560882ac0b80 0x560882ac0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.402+0000 7fdb4bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x560882ac14e0 0x560882ac1990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41846/0 (socket says 172.21.15.87:41846) 2024-05-08T18:31:16.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.402+0000 7fdb4bfff640 1 -- 172.21.15.87:0/4260730300 learned_addr learned my addr 172.21.15.87:0/4260730300 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:16.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.403+0000 7fdb509ee640 1 -- 172.21.15.87:0/4260730300 >> v1:172.21.15.53:6789/0 conn(0x560882ac14e0 legacy=0x560882ac1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.403+0000 7fdb509ee640 1 -- 172.21.15.87:0/4260730300 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560882ac20a0 con 0x560882ac0b80 2024-05-08T18:31:16.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.404+0000 7fdb509ee640 1 --2- 172.21.15.87:0/4260730300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac0b80 0x560882ac0fa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400a470 tx=0x7fdb4401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc2c1fe8393184f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.405+0000 7fdb4b7fe640 1 -- 172.21.15.87:0/4260730300 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb44057070 con 0x560882ac0b80 2024-05-08T18:31:16.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.405+0000 7fdb4b7fe640 1 -- 172.21.15.87:0/4260730300 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb44052570 con 0x560882ac0b80 2024-05-08T18:31:16.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.405+0000 7fdb4b7fe640 1 -- 172.21.15.87:0/4260730300 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb44052870 con 0x560882ac0b80 2024-05-08T18:31:16.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.405+0000 7fdb54d33800 1 -- 172.21.15.87:0/4260730300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac0b80 msgr2=0x560882ac0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.405+0000 7fdb54d33800 1 --2- 172.21.15.87:0/4260730300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac0b80 0x560882ac0fa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400a470 tx=0x7fdb4401ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:16.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.405+0000 7fdb54d33800 1 -- 172.21.15.87:0/4260730300 shutdown_connections 2024-05-08T18:31:16.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.405+0000 7fdb54d33800 1 --2- 172.21.15.87:0/4260730300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac0b80 0x560882ac0fa0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.405+0000 7fdb54d33800 1 -- 172.21.15.87:0/4260730300 >> 172.21.15.87:0/4260730300 conn(0x560882abc720 msgr2=0x560882abeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.405+0000 7fdb54d33800 1 -- 172.21.15.87:0/4260730300 shutdown_connections 2024-05-08T18:31:16.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.405+0000 7fdb54d33800 1 -- 172.21.15.87:0/4260730300 wait complete. 2024-05-08T18:31:16.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.419+0000 7fdb54d33800 1 Processor -- start 2024-05-08T18:31:16.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.419+0000 7fdb54d33800 1 -- start start 2024-05-08T18:31:16.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.419+0000 7fdb54d33800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac0b80 0x560882bb5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.419+0000 7fdb54d33800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560882a0d5b0 con 0x560882ac0b80 2024-05-08T18:31:16.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.419+0000 7fdb509ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac0b80 0x560882bb5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.419+0000 7fdb509ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac0b80 0x560882bb5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60558/0 (socket says 172.21.15.87:60558) 2024-05-08T18:31:16.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.419+0000 7fdb509ee640 1 -- 172.21.15.87:0/1827131947 learned_addr learned my addr 172.21.15.87:0/1827131947 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.419+0000 7fdb509ee640 1 -- 172.21.15.87:0/1827131947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560882bb5fd0 con 0x560882ac0b80 2024-05-08T18:31:16.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.420+0000 7fdb509ee640 1 --2- 172.21.15.87:0/1827131947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac0b80 0x560882bb5a00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdb4401ced0 tx=0x7fdb4404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f1224b7e4340a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.420+0000 7fda3ee05640 1 -- 172.21.15.87:0/1827131947 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb44057040 con 0x560882ac0b80 2024-05-08T18:31:16.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.420+0000 7fda3ee05640 1 -- 172.21.15.87:0/1827131947 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb440529a0 con 0x560882ac0b80 2024-05-08T18:31:16.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.420+0000 7fda3ee05640 1 -- 172.21.15.87:0/1827131947 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb44052cc0 con 0x560882ac0b80 2024-05-08T18:31:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.421+0000 7fdb54d33800 1 -- 172.21.15.87:0/1827131947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac0b80 msgr2=0x560882bb5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.421+0000 7fdb54d33800 1 --2- 172.21.15.87:0/1827131947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac0b80 0x560882bb5a00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdb4401ced0 tx=0x7fdb4404c000 comp rx=0 tx=0).stop 2024-05-08T18:31:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.421+0000 7fdb54d33800 1 -- 172.21.15.87:0/1827131947 shutdown_connections 2024-05-08T18:31:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.421+0000 7fdb54d33800 1 --2- 172.21.15.87:0/1827131947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac0b80 0x560882bb5a00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.421+0000 7fdb54d33800 1 -- 172.21.15.87:0/1827131947 >> 172.21.15.87:0/1827131947 conn(0x560882abc720 msgr2=0x560882bb1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.421+0000 7fdb54d33800 1 -- 172.21.15.87:0/1827131947 shutdown_connections 2024-05-08T18:31:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.421+0000 7fdb54d33800 1 -- 172.21.15.87:0/1827131947 wait complete. 2024-05-08T18:31:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.421+0000 7fdb54d33800 1 Processor -- start 2024-05-08T18:31:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.421+0000 7fdb54d33800 1 -- start start 2024-05-08T18:31:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.421+0000 7fdb54d33800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac14e0 0x560882bbd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.421+0000 7fdb54d33800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560882ac25d0 con 0x560882ac14e0 2024-05-08T18:31:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.422+0000 7fdb509ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac14e0 0x560882bbd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.422+0000 7fdb509ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac14e0 0x560882bbd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60574/0 (socket says 172.21.15.87:60574) 2024-05-08T18:31:16.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.422+0000 7fdb509ee640 1 -- 172.21.15.87:0/2135807204 learned_addr learned my addr 172.21.15.87:0/2135807204 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.422+0000 7fdb509ee640 1 -- 172.21.15.87:0/2135807204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560882bbdb10 con 0x560882ac14e0 2024-05-08T18:31:16.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.422+0000 7fdb509ee640 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac14e0 0x560882bbd5d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdb44000c00 tx=0x7fdb44003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.422+0000 7fda3d602640 1 -- 172.21.15.87:0/2135807204 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb44073070 con 0x560882ac14e0 2024-05-08T18:31:16.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.422+0000 7fda3d602640 1 -- 172.21.15.87:0/2135807204 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4405d780 con 0x560882ac14e0 2024-05-08T18:31:16.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.422+0000 7fdb54d33800 1 -- 172.21.15.87:0/2135807204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560882bbdda0 con 0x560882ac14e0 2024-05-08T18:31:16.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.422+0000 7fda3d602640 1 -- 172.21.15.87:0/2135807204 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb44057070 con 0x560882ac14e0 2024-05-08T18:31:16.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.422+0000 7fdb54d33800 1 -- 172.21.15.87:0/2135807204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560882bc0a50 con 0x560882ac14e0 2024-05-08T18:31:16.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.423+0000 7fda3d602640 1 -- 172.21.15.87:0/2135807204 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fdb44076070 con 0x560882ac14e0 2024-05-08T18:31:16.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.423+0000 7fda3d602640 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda3803bb50 0x7fda3803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.423+0000 7fda3d602640 1 -- 172.21.15.87:0/2135807204 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fdb44094370 con 0x560882ac14e0 2024-05-08T18:31:16.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.423+0000 7fdb4bfff640 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda3803bb50 0x7fda3803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.424+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560882bc2800 0x560882bc4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.424+0000 7fdb54d33800 1 -- 172.21.15.87:0/2135807204 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882bc51c0 con 0x560882bc2800 2024-05-08T18:31:16.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.424+0000 7fdb511ef640 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560882bc2800 0x560882bc4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.424+0000 7fdb4bfff640 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda3803bb50 0x7fda3803e010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c000f60 tx=0x7fdb3c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.424+0000 7fdb511ef640 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560882bc2800 0x560882bc4bf0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.424+0000 7fdb511ef640 1 -- 172.21.15.87:0/2135807204 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb4c00a4a0 con 0x560882bc2800 2024-05-08T18:31:16.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.424+0000 7fdb54d33800 1 -- 172.21.15.87:0/2135807204 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882bc1de0 con 0x560882bc2800 2024-05-08T18:31:16.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.424+0000 7fdb511ef640 1 -- 172.21.15.87:0/2135807204 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb4c00a4a0 con 0x560882bc2800 2024-05-08T18:31:16.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.425+0000 7fdb54d33800 1 -- 172.21.15.87:0/2135807204 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882bc7000 con 0x560882bc2800 2024-05-08T18:31:16.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.425+0000 7fdb511ef640 1 -- 172.21.15.87:0/2135807204 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb4c00a4a0 con 0x560882bc2800 2024-05-08T18:31:16.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.425+0000 7fdb54d33800 1 -- 172.21.15.87:0/2135807204 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882bc6230 con 0x560882bc2800 2024-05-08T18:31:16.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.425+0000 7fdb511ef640 1 -- 172.21.15.87:0/2135807204 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb4c00a4a0 con 0x560882bc2800 2024-05-08T18:31:16.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.425+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560882bc83b0 0x560882bca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.425+0000 7fdb54d33800 1 -- 172.21.15.87:0/2135807204 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882bcace0 con 0x560882bc83b0 2024-05-08T18:31:16.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.425+0000 7fdb509ee640 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560882bc83b0 0x560882bca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.426+0000 7fdb509ee640 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560882bc83b0 0x560882bca7a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.426+0000 7fdb509ee640 1 -- 172.21.15.87:0/2135807204 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdb44075030 con 0x560882bc83b0 2024-05-08T18:31:16.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.426+0000 7fdb54d33800 1 Processor -- start 2024-05-08T18:31:16.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.426+0000 7fdb54d33800 1 -- start start 2024-05-08T18:31:16.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.426+0000 7fdb54d33800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882bd8f20 0x560882bd9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.426+0000 7fdb54d33800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5608829b3fc0 con 0x560882bd8f20 2024-05-08T18:31:16.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.427+0000 7fdb511ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882bd8f20 0x560882bd9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.427+0000 7fdb511ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882bd8f20 0x560882bd9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60590/0 (socket says 172.21.15.87:60590) 2024-05-08T18:31:16.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.427+0000 7fdb511ef640 1 -- 172.21.15.87:0/2128717070 learned_addr learned my addr 172.21.15.87:0/2128717070 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.427+0000 7fdb511ef640 1 -- 172.21.15.87:0/2128717070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560882bd9880 con 0x560882bd8f20 2024-05-08T18:31:16.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.427+0000 7fdb511ef640 1 --2- 172.21.15.87:0/2128717070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882bd8f20 0x560882bd9340 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x560882bbe9d0 tx=0x7fdb4c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.427+0000 7fda367fc640 1 -- 172.21.15.87:0/2128717070 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4c013440 con 0x560882bd8f20 2024-05-08T18:31:16.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.427+0000 7fda367fc640 1 -- 172.21.15.87:0/2128717070 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4c0135e0 con 0x560882bd8f20 2024-05-08T18:31:16.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.427+0000 7fdb54d33800 1 -- 172.21.15.87:0/2128717070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560882bda2f0 con 0x560882bd8f20 2024-05-08T18:31:16.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.427+0000 7fda367fc640 1 -- 172.21.15.87:0/2128717070 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4c0138c0 con 0x560882bd8f20 2024-05-08T18:31:16.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.427+0000 7fdb54d33800 1 -- 172.21.15.87:0/2128717070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560882bda7f0 con 0x560882bd8f20 2024-05-08T18:31:16.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.428+0000 7fda367fc640 1 -- 172.21.15.87:0/2128717070 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fdb4c011040 con 0x560882bd8f20 2024-05-08T18:31:16.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.428+0000 7fda367fc640 1 --2- 172.21.15.87:0/2128717070 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda2803bb50 0x7fda2803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.428+0000 7fda367fc640 1 -- 172.21.15.87:0/2128717070 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fdb4c01d070 con 0x560882bd8f20 2024-05-08T18:31:16.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.428+0000 7fdb509ee640 1 --2- 172.21.15.87:0/2128717070 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda2803bb50 0x7fda2803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.429+0000 7fdb54d33800 1 Processor -- start 2024-05-08T18:31:16.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.429+0000 7fdb509ee640 1 --2- 172.21.15.87:0/2128717070 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda2803bb50 0x7fda2803e010 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdb4405b730 tx=0x7fdb44092670 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.429+0000 7fdb54d33800 1 -- start start 2024-05-08T18:31:16.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.429+0000 7fdb54d33800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882be6240 0x560882be6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.429+0000 7fdb54d33800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560882bb6290 con 0x560882be6240 2024-05-08T18:31:16.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.429+0000 7fdb511ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882be6240 0x560882be6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.429+0000 7fdb511ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882be6240 0x560882be6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60602/0 (socket says 172.21.15.87:60602) 2024-05-08T18:31:16.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.429+0000 7fdb511ef640 1 -- 172.21.15.87:0/489107776 learned_addr learned my addr 172.21.15.87:0/489107776 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.429+0000 7fdb511ef640 1 -- 172.21.15.87:0/489107776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560882be6c30 con 0x560882be6240 2024-05-08T18:31:16.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.430+0000 7fdb511ef640 1 --2- 172.21.15.87:0/489107776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882be6240 0x560882be6660 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c0529a0 tx=0x7fdb4c001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546b8af36f322214 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.430+0000 7fda27fff640 1 -- 172.21.15.87:0/489107776 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4c02ad80 con 0x560882be6240 2024-05-08T18:31:16.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.430+0000 7fda27fff640 1 -- 172.21.15.87:0/489107776 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4c0014f0 con 0x560882be6240 2024-05-08T18:31:16.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.430+0000 7fda27fff640 1 -- 172.21.15.87:0/489107776 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4c001810 con 0x560882be6240 2024-05-08T18:31:16.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.430+0000 7fdb54d33800 1 -- 172.21.15.87:0/489107776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882be6240 msgr2=0x560882be6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.430+0000 7fdb54d33800 1 --2- 172.21.15.87:0/489107776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882be6240 0x560882be6660 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c0529a0 tx=0x7fdb4c001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:16.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.430+0000 7fdb54d33800 1 -- 172.21.15.87:0/489107776 shutdown_connections 2024-05-08T18:31:16.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.430+0000 7fdb54d33800 1 --2- 172.21.15.87:0/489107776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882be6240 0x560882be6660 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.430+0000 7fdb54d33800 1 -- 172.21.15.87:0/489107776 >> 172.21.15.87:0/489107776 conn(0x560882be25a0 msgr2=0x560882be0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.430+0000 7fdb54d33800 1 -- 172.21.15.87:0/489107776 shutdown_connections 2024-05-08T18:31:16.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.430+0000 7fdb54d33800 1 -- 172.21.15.87:0/489107776 wait complete. 2024-05-08T18:31:16.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.430+0000 7fdb54d33800 1 Processor -- start 2024-05-08T18:31:16.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.431+0000 7fdb54d33800 1 -- start start 2024-05-08T18:31:16.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.431+0000 7fdb54d33800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882be6240 0x560882bed830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.431+0000 7fdb54d33800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560882be73a0 con 0x560882be6240 2024-05-08T18:31:16.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.431+0000 7fdb511ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882be6240 0x560882bed830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.431+0000 7fdb511ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882be6240 0x560882bed830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60616/0 (socket says 172.21.15.87:60616) 2024-05-08T18:31:16.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.431+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 learned_addr learned my addr 172.21.15.87:0/2494013421 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.431+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560882bedd70 con 0x560882be6240 2024-05-08T18:31:16.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.431+0000 7fdb511ef640 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882be6240 0x560882bed830 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c001ea0 tx=0x7fdb4c052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.431+0000 7fda267fc640 1 -- 172.21.15.87:0/2494013421 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4c030020 con 0x560882be6240 2024-05-08T18:31:16.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.431+0000 7fda267fc640 1 -- 172.21.15.87:0/2494013421 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4c051330 con 0x560882be6240 2024-05-08T18:31:16.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.431+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560882bee000 con 0x560882be6240 2024-05-08T18:31:16.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.431+0000 7fda267fc640 1 -- 172.21.15.87:0/2494013421 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4c013a60 con 0x560882be6240 2024-05-08T18:31:16.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.431+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560882bf0cb0 con 0x560882be6240 2024-05-08T18:31:16.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.432+0000 7fda267fc640 1 -- 172.21.15.87:0/2494013421 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fdb4c033020 con 0x560882be6240 2024-05-08T18:31:16.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.432+0000 7fda267fc640 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda1c03bb50 0x7fda1c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.432+0000 7fda267fc640 1 -- 172.21.15.87:0/2494013421 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fdb4c00e040 con 0x560882be6240 2024-05-08T18:31:16.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.432+0000 7fdb509ee640 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda1c03bb50 0x7fda1c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.433+0000 7fdb509ee640 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda1c03bb50 0x7fda1c03e010 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdb4405b500 tx=0x7fdb44085000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.433+0000 7fdb54d33800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.433+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560882bf94b0 0x560882bfb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.433+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882bfc0c0 con 0x560882bf94b0 2024-05-08T18:31:16.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.433+0000 7fdb4bfff640 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560882bf94b0 0x560882bfb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.433+0000 7fdb4bfff640 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560882bf94b0 0x560882bfb970 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb3c009050 con 0x560882bf94b0 2024-05-08T18:31:16.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb54d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb54d33800 20 realm 2024-05-08T18:31:16.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb54d33800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882bf8900 con 0x560882bf94b0 2024-05-08T18:31:16.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb3c009050 con 0x560882bf94b0 2024-05-08T18:31:16.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb54d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb54d33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:16.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb54d33800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882bfcbb0 con 0x560882bf94b0 2024-05-08T18:31:16.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb3c009050 con 0x560882bf94b0 2024-05-08T18:31:16.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb54d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb54d33800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882bfd480 con 0x560882bf94b0 2024-05-08T18:31:16.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb3c009050 con 0x560882bf94b0 2024-05-08T18:31:16.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb54d33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:16.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb54d33800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.434+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882bfd820 con 0x560882bf94b0 2024-05-08T18:31:16.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.435+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdb3c009050 con 0x560882bf94b0 2024-05-08T18:31:16.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.435+0000 7fdb54d33800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:16.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.435+0000 7fdb54d33800 20 searching for the correct realm 2024-05-08T18:31:16.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.435+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560882bff700 0x560882c01af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.435+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x560882bff700 2024-05-08T18:31:16.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.435+0000 7fdb511ef640 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560882bff700 0x560882c01af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.435+0000 7fdb511ef640 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560882bff700 0x560882c01af0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.436+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.436+0000 7fdb511ef640 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fdb4c035020 0x7fdb4c02b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.436+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x7fdb4c035020 2024-05-08T18:31:16.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.436+0000 7fdb509ee640 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fdb4c035020 0x7fdb4c02b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.436+0000 7fdb509ee640 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fdb4c035020 0x7fdb4c02b3e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.436+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.436+0000 7fdb509ee640 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fdb44078060 0x7fdb4408b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.436+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x7fdb44078060 2024-05-08T18:31:16.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.437+0000 7fdb4bfff640 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fdb44078060 0x7fdb4408b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.437+0000 7fdb4bfff640 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fdb44078060 0x7fdb4408b5b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.437+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb3c009050 con 0x7fdb44078060 2024-05-08T18:31:16.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.437+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x560882bf94b0 2024-05-08T18:31:16.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.437+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb3c009050 con 0x560882bf94b0 2024-05-08T18:31:16.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.437+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x560882bf94b0 2024-05-08T18:31:16.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.438+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.438+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x7fdb44078060 2024-05-08T18:31:16.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.438+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.438+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x7fdb44078060 2024-05-08T18:31:16.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.438+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.438+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x7fdb4c035020 2024-05-08T18:31:16.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.438+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.438+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x560882bff700 2024-05-08T18:31:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.439+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.439+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x560882bf94b0 2024-05-08T18:31:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.439+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.439+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x7fdb44078060 2024-05-08T18:31:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.439+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.439+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x560882bf94b0 2024-05-08T18:31:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.439+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.439+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x7fdb4c035020 2024-05-08T18:31:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.440+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.440+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x560882bff700 2024-05-08T18:31:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.440+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.440+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x560882bff700 2024-05-08T18:31:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.440+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.440+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x7fdb44078060 2024-05-08T18:31:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.440+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.440+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x560882bff700 2024-05-08T18:31:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.441+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.441+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x560882bff700 2024-05-08T18:31:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.441+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.441+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x560882bf94b0 2024-05-08T18:31:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.441+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.441+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x560882bf94b0 2024-05-08T18:31:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.441+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v20'2 uv2 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.441+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x7fdb44078060 2024-05-08T18:31:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.442+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.442+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x560882bff700 2024-05-08T18:31:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.442+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.442+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x7fdb4c035020 2024-05-08T18:31:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.442+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.442+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x560882bf94b0 2024-05-08T18:31:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.442+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.442+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x7fdb44078060 2024-05-08T18:31:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.443+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.443+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x560882bff700 2024-05-08T18:31:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.443+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.443+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x7fdb44078060 2024-05-08T18:31:16.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.443+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.443+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x7fdb4c035020 2024-05-08T18:31:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.443+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.443+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x560882bff700 2024-05-08T18:31:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.444+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.444+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x7fdb44078060 2024-05-08T18:31:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.444+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.444+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x560882bf94b0 2024-05-08T18:31:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560882c021a0 con 0x7fdb4c035020 2024-05-08T18:31:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb54d33800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb54d33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb54d33800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb54d33800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb54d33800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb54d33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb54d33800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882bfe1a0 con 0x560882bf94b0 2024-05-08T18:31:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb54d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb54d33800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882bfea40 con 0x560882bf94b0 2024-05-08T18:31:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb54d33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb54d33800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.445+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882c02620 con 0x7fdb44078060 2024-05-08T18:31:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.446+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.446+0000 7fdb54d33800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.446+0000 7fdb54d33800 20 zone default found 2024-05-08T18:31:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.446+0000 7fdb54d33800 4 Realm: () 2024-05-08T18:31:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.446+0000 7fdb54d33800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.446+0000 7fdb54d33800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.446+0000 7fdb54d33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.446+0000 7fdb54d33800 20 zonegroup default 2024-05-08T18:31:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.446+0000 7fdb54d33800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.446+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882c02ad0 con 0x7fdb44078060 2024-05-08T18:31:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.446+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.446+0000 7fdb54d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.446+0000 7fdb54d33800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.446+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882c044b0 con 0x560882bff700 2024-05-08T18:31:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.447+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.447+0000 7fdb54d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.447+0000 7fdb54d33800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.447+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882c04950 con 0x560882bff700 2024-05-08T18:31:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.447+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.447+0000 7fdb54d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.447+0000 7fdb54d33800 20 started sync module instance, tier type = 2024-05-08T18:31:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.447+0000 7fdb54d33800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.447+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c03940 con 0x7fdb4c035020 2024-05-08T18:31:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.448+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.448+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94594553363760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c05260 con 0x7fdb4c035020 2024-05-08T18:31:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.448+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c05ab0 con 0x560882bf94b0 2024-05-08T18:31:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.449+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.449+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94594553370112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c06090 con 0x560882bf94b0 2024-05-08T18:31:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.449+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c06bb0 con 0x560882bff700 2024-05-08T18:31:16.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.450+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94594553363760] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.452+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94594553370112] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.452+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.452+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94594553374336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c05ae0 con 0x560882bff700 2024-05-08T18:31:16.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.452+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c075c0 con 0x7fdb4c035020 2024-05-08T18:31:16.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.453+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94594553374336] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.454+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.454+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94594553377040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c07960 con 0x7fdb4c035020 2024-05-08T18:31:16.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.454+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c08320 con 0x560882bf94b0 2024-05-08T18:31:16.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.457+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.457+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94594553380944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c08ac0 con 0x560882bf94b0 2024-05-08T18:31:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.457+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c095c0 con 0x7fdb44078060 2024-05-08T18:31:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.459+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94594553377040] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.459+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.460+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94594553385136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c09580 con 0x7fdb44078060 2024-05-08T18:31:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.460+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c0a000 con 0x7fdb44078060 2024-05-08T18:31:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.462+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94594553380944] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.462+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(56 notify.6 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.462+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94594553382160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c0a000 con 0x7fdb44078060 2024-05-08T18:31:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.462+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c0a9c0 con 0x7fdb44078060 2024-05-08T18:31:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.463+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.463+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94594553390352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c0ade0 con 0x7fdb44078060 2024-05-08T18:31:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.463+0000 7fdb54d33800 20 add_watcher() i=0 2024-05-08T18:31:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.463+0000 7fdb54d33800 20 add_watcher() i=1 2024-05-08T18:31:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.463+0000 7fdb54d33800 20 add_watcher() i=2 2024-05-08T18:31:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.463+0000 7fdb54d33800 20 add_watcher() i=3 2024-05-08T18:31:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.463+0000 7fdb54d33800 20 add_watcher() i=4 2024-05-08T18:31:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.465+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94594553390352] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.465+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(55 notify.5 [watch watch cookie 94594553385136] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.465+0000 7fdb54d33800 20 add_watcher() i=5 2024-05-08T18:31:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.465+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(57 notify.6 [watch watch cookie 94594553382160] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.465+0000 7fdb54d33800 20 add_watcher() i=6 2024-05-08T18:31:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.465+0000 7fdb54d33800 20 add_watcher() i=7 2024-05-08T18:31:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.465+0000 7fdb54d33800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.465+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882c0a930 con 0x560882bf94b0 2024-05-08T18:31:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.465+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.465+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94594553387856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c0a930 con 0x560882bf94b0 2024-05-08T18:31:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.466+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94594553387856] v27'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.466+0000 7fda06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.467+0000 7fdb54d33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.467+0000 7fdb54d33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.467+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c161c0 con 0x560882bf94b0 2024-05-08T18:31:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.469+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.469+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c16890 con 0x7fdb44078060 2024-05-08T18:31:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.470+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.470+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c16cd0 con 0x560882bff700 2024-05-08T18:31:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.472+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.472+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c170f0 con 0x560882bf94b0 2024-05-08T18:31:16.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.474+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'42 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.474+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c14050 con 0x7fdb4c035020 2024-05-08T18:31:16.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.475+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.475+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x560882bff700 2024-05-08T18:31:16.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.476+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.476+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x560882bf94b0 2024-05-08T18:31:16.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.477+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.477+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x7fdb44078060 2024-05-08T18:31:16.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.479+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.479+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x7fdb4c035020 2024-05-08T18:31:16.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.480+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.480+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x560882bff700 2024-05-08T18:31:16.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.481+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.481+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x7fdb4c035020 2024-05-08T18:31:16.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.483+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.483+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x7fdb44078060 2024-05-08T18:31:16.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.484+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.484+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x7fdb4c035020 2024-05-08T18:31:16.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.485+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.485+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x7fdb44078060 2024-05-08T18:31:16.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.487+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'25 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.487+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x560882bf94b0 2024-05-08T18:31:16.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.488+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'43 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.488+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x560882bff700 2024-05-08T18:31:16.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.489+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.489+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x7fdb4c035020 2024-05-08T18:31:16.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.490+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.490+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x560882bff700 2024-05-08T18:31:16.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.491+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.492+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x560882bf94b0 2024-05-08T18:31:16.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.493+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.493+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x560882bf94b0 2024-05-08T18:31:16.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.494+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'44 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.494+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x560882bff700 2024-05-08T18:31:16.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.495+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.495+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x7fdb4c035020 2024-05-08T18:31:16.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.496+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.496+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x560882bff700 2024-05-08T18:31:16.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.496+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.497+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x560882bff700 2024-05-08T18:31:16.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.497+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.497+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x560882bff700 2024-05-08T18:31:16.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.498+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.498+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x560882bff700 2024-05-08T18:31:16.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.500+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.500+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x7fdb44078060 2024-05-08T18:31:16.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.501+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.501+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x560882bff700 2024-05-08T18:31:16.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.503+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.503+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x7fdb44078060 2024-05-08T18:31:16.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.504+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.504+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x560882bff700 2024-05-08T18:31:16.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.505+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.505+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x7fdb44078060 2024-05-08T18:31:16.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.507+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.507+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c17bf0 con 0x7fdb4c035020 2024-05-08T18:31:16.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.508+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.508+0000 7fda05fe3640 20 reqs_thread_entry: start 2024-05-08T18:31:16.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.508+0000 7fdb54d33800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:16.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.509+0000 7fdb54d33800 20 Filter name: none 2024-05-08T18:31:16.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.509+0000 7fd9777fe640 20 reqs_thread_entry: start 2024-05-08T18:31:16.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.509+0000 7fdb54d33800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:16.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.509+0000 7fdb54d33800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.509+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560882c42f70 con 0x560882bf94b0 2024-05-08T18:31:16.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.509+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.509+0000 7fdb54d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.509+0000 7fdb54d33800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-05-08T18:31:16.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.509+0000 7fdb54d33800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:16.509 INFO:teuthology.orchestra.run.smithi087.stderr:could not remove user: unable to remove user, user does not exist 2024-05-08T18:31:16.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.510+0000 7fda06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:16.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.510+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94594553387856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c13320 con 0x560882bf94b0 2024-05-08T18:31:16.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.511+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94594553387856] v27'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.511+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94594553363760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c09b50 con 0x7fdb4c035020 2024-05-08T18:31:16.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.512+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94594553363760] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.513+0000 7fdb54d33800 20 remove_watcher() i=0 2024-05-08T18:31:16.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.513+0000 7fdb54d33800 2 removed watcher, disabling cache 2024-05-08T18:31:16.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.513+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94594553370112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c09b50 con 0x560882bf94b0 2024-05-08T18:31:16.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.513+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94594553370112] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.514+0000 7fdb54d33800 20 remove_watcher() i=1 2024-05-08T18:31:16.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.514+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94594553374336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c05600 con 0x560882bff700 2024-05-08T18:31:16.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.515+0000 7fdb511ef640 1 -- 172.21.15.87:0/2494013421 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94594553374336] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029070 con 0x560882bff700 2024-05-08T18:31:16.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.515+0000 7fdb54d33800 20 remove_watcher() i=2 2024-05-08T18:31:16.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.515+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94594553377040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c09b50 con 0x7fdb4c035020 2024-05-08T18:31:16.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.515+0000 7fdb509ee640 1 -- 172.21.15.87:0/2494013421 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94594553377040] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb44075030 con 0x7fdb4c035020 2024-05-08T18:31:16.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.516+0000 7fdb54d33800 20 remove_watcher() i=3 2024-05-08T18:31:16.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.516+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94594553380944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c06680 con 0x560882bf94b0 2024-05-08T18:31:16.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.516+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94594553380944] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x560882bf94b0 2024-05-08T18:31:16.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.516+0000 7fdb54d33800 20 remove_watcher() i=4 2024-05-08T18:31:16.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.516+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94594553385136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c05600 con 0x7fdb44078060 2024-05-08T18:31:16.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.518+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94594553385136] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.518+0000 7fdb54d33800 20 remove_watcher() i=5 2024-05-08T18:31:16.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.518+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94594553382160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c09b50 con 0x7fdb44078060 2024-05-08T18:31:16.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.519+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94594553382160] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.519+0000 7fdb54d33800 20 remove_watcher() i=6 2024-05-08T18:31:16.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.519+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94594553390352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560882c08050 con 0x7fdb44078060 2024-05-08T18:31:16.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94594553390352] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb3c02a040 con 0x7fdb44078060 2024-05-08T18:31:16.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb54d33800 20 remove_watcher() i=7 2024-05-08T18:31:16.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fdb44078060 msgr2=0x7fdb4408b5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fdb44078060 0x7fdb4408b5b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560882bf94b0 msgr2=0x560882bfb970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560882bf94b0 0x560882bfb970 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fdb4c035020 msgr2=0x7fdb4c02b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fdb4c035020 0x7fdb4c02b3e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560882bff700 msgr2=0x560882c01af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560882bff700 0x560882c01af0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda1c03bb50 msgr2=0x7fda1c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda1c03bb50 0x7fda1c03e010 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdb4405b500 tx=0x7fdb44085000 comp rx=0 tx=0).stop 2024-05-08T18:31:16.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882be6240 msgr2=0x560882bed830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2494013421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882be6240 0x560882bed830 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c001ea0 tx=0x7fdb4c052900 comp rx=0 tx=0).stop 2024-05-08T18:31:16.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 reap_dead start 2024-05-08T18:31:16.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb4bfff640 1 -- 172.21.15.87:0/2494013421 reap_dead start 2024-05-08T18:31:16.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 shutdown_connections 2024-05-08T18:31:16.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.520+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 >> 172.21.15.87:0/2494013421 conn(0x560882be25a0 msgr2=0x560882bdfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 shutdown_connections 2024-05-08T18:31:16.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 -- 172.21.15.87:0/2494013421 wait complete. 2024-05-08T18:31:16.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 -- 172.21.15.87:0/2128717070 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda2803bb50 msgr2=0x7fda2803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2128717070 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda2803bb50 0x7fda2803e010 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdb4405b730 tx=0x7fdb44092670 comp rx=0 tx=0).stop 2024-05-08T18:31:16.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 -- 172.21.15.87:0/2128717070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882bd8f20 msgr2=0x560882bd9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2128717070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882bd8f20 0x560882bd9340 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x560882bbe9d0 tx=0x7fdb4c0178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 -- 172.21.15.87:0/2128717070 shutdown_connections 2024-05-08T18:31:16.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2128717070 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda2803bb50 0x7fda2803e010 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2128717070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882bd8f20 0x560882bd9340 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 -- 172.21.15.87:0/2128717070 >> 172.21.15.87:0/2128717070 conn(0x560882bccfc0 msgr2=0x560882bcd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 -- 172.21.15.87:0/2128717070 shutdown_connections 2024-05-08T18:31:16.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 -- 172.21.15.87:0/2128717070 wait complete. 2024-05-08T18:31:16.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 -- 172.21.15.87:0/2135807204 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560882bc83b0 msgr2=0x560882bca7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560882bc83b0 0x560882bca7a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 -- 172.21.15.87:0/2135807204 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560882bc2800 msgr2=0x560882bc4bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560882bc2800 0x560882bc4bf0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 -- 172.21.15.87:0/2135807204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda3803bb50 msgr2=0x7fda3803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda3803bb50 0x7fda3803e010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c000f60 tx=0x7fdb3c0012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 -- 172.21.15.87:0/2135807204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac14e0 msgr2=0x560882bbd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac14e0 0x560882bbd5d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdb44000c00 tx=0x7fdb44003020 comp rx=0 tx=0).stop 2024-05-08T18:31:16.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 -- 172.21.15.87:0/2135807204 shutdown_connections 2024-05-08T18:31:16.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560882bc2800 0x560882bc4bf0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560882bc83b0 0x560882bca7a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda3803bb50 0x7fda3803e010 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 --2- 172.21.15.87:0/2135807204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560882ac14e0 0x560882bbd5d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.521+0000 7fdb54d33800 1 -- 172.21.15.87:0/2135807204 >> 172.21.15.87:0/2135807204 conn(0x560882abc720 msgr2=0x560882bafb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.522+0000 7fdb54d33800 1 -- 172.21.15.87:0/2135807204 shutdown_connections 2024-05-08T18:31:16.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.522+0000 7fdb54d33800 1 -- 172.21.15.87:0/2135807204 wait complete. 2024-05-08T18:31:16.528 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-08T18:31:16.528 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-08T18:31:16.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-08T18:31:16.529 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-05-08T18:31:16.615 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:16.615 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:16.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.618+0000 7fbd03923800 1 Processor -- start 2024-05-08T18:31:16.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.618+0000 7fbd03923800 1 -- start start 2024-05-08T18:31:16.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.618+0000 7fbd03923800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ddaeca53a0 0x55ddaeca57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.618+0000 7fbd03923800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ddaeca5e40 con 0x55ddaeca6560 2024-05-08T18:31:16.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.618+0000 7fbd03923800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55ddaeb45e20 con 0x55ddaeca53a0 2024-05-08T18:31:16.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.618+0000 7fbcff6b0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ddaeca53a0 0x55ddaeca57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.618+0000 7fbcf7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55ddaeca6560 0x55ddaeca69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41862/0 (socket says 172.21.15.87:41862) 2024-05-08T18:31:16.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.618+0000 7fbcf7fff640 1 -- 172.21.15.87:0/2366678005 learned_addr learned my addr 172.21.15.87:0/2366678005 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:16.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.618+0000 7fbcff6b0640 1 -- 172.21.15.87:0/2366678005 >> v1:172.21.15.53:6789/0 conn(0x55ddaeca6560 legacy=0x55ddaeca69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.618+0000 7fbcff6b0640 1 -- 172.21.15.87:0/2366678005 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddaeca7120 con 0x55ddaeca53a0 2024-05-08T18:31:16.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.620+0000 7fbcff6b0640 1 --2- 172.21.15.87:0/2366678005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 0x55ddaeca57c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000a470 tx=0x7fbcf001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b8f1e0a33e1d00 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.621+0000 7fbcfeeaf640 1 -- 172.21.15.87:0/2366678005 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf0057070 con 0x55ddaeca53a0 2024-05-08T18:31:16.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.621+0000 7fbcfeeaf640 1 -- 172.21.15.87:0/2366678005 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf004adc0 con 0x55ddaeca53a0 2024-05-08T18:31:16.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.621+0000 7fbcfeeaf640 1 -- 172.21.15.87:0/2366678005 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf0052590 con 0x55ddaeca53a0 2024-05-08T18:31:16.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.621+0000 7fbd03923800 1 -- 172.21.15.87:0/2366678005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 msgr2=0x55ddaeca57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.621+0000 7fbd03923800 1 --2- 172.21.15.87:0/2366678005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 0x55ddaeca57c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000a470 tx=0x7fbcf001ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:16.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.621+0000 7fbd03923800 1 -- 172.21.15.87:0/2366678005 shutdown_connections 2024-05-08T18:31:16.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.621+0000 7fbd03923800 1 --2- 172.21.15.87:0/2366678005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 0x55ddaeca57c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.621+0000 7fbd03923800 1 -- 172.21.15.87:0/2366678005 >> 172.21.15.87:0/2366678005 conn(0x55ddaeca0920 msgr2=0x55ddaeca2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.621+0000 7fbd03923800 1 -- 172.21.15.87:0/2366678005 shutdown_connections 2024-05-08T18:31:16.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.621+0000 7fbd03923800 1 -- 172.21.15.87:0/2366678005 wait complete. 2024-05-08T18:31:16.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.634+0000 7fbd03923800 1 Processor -- start 2024-05-08T18:31:16.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.634+0000 7fbd03923800 1 -- start start 2024-05-08T18:31:16.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.634+0000 7fbd03923800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 0x55ddaed967f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.634+0000 7fbd03923800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ddaebf05d0 con 0x55ddaeca53a0 2024-05-08T18:31:16.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.635+0000 7fbcff6b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 0x55ddaed967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.635+0000 7fbcff6b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 0x55ddaed967f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60632/0 (socket says 172.21.15.87:60632) 2024-05-08T18:31:16.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.635+0000 7fbcff6b0640 1 -- 172.21.15.87:0/2599928831 learned_addr learned my addr 172.21.15.87:0/2599928831 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.635+0000 7fbcff6b0640 1 -- 172.21.15.87:0/2599928831 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddaed96dc0 con 0x55ddaeca53a0 2024-05-08T18:31:16.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.635+0000 7fbcff6b0640 1 --2- 172.21.15.87:0/2599928831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 0x55ddaed967f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbcf001ced0 tx=0x7fbcf004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870565bacaa02d73 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.635+0000 7fbbed60a640 1 -- 172.21.15.87:0/2599928831 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf0057040 con 0x55ddaeca53a0 2024-05-08T18:31:16.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.635+0000 7fbbed60a640 1 -- 172.21.15.87:0/2599928831 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf0063070 con 0x55ddaeca53a0 2024-05-08T18:31:16.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.635+0000 7fbbed60a640 1 -- 172.21.15.87:0/2599928831 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf0052800 con 0x55ddaeca53a0 2024-05-08T18:31:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.636+0000 7fbd03923800 1 -- 172.21.15.87:0/2599928831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 msgr2=0x55ddaed967f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.636+0000 7fbd03923800 1 --2- 172.21.15.87:0/2599928831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 0x55ddaed967f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbcf001ced0 tx=0x7fbcf004c000 comp rx=0 tx=0).stop 2024-05-08T18:31:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.636+0000 7fbd03923800 1 -- 172.21.15.87:0/2599928831 shutdown_connections 2024-05-08T18:31:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.636+0000 7fbd03923800 1 --2- 172.21.15.87:0/2599928831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 0x55ddaed967f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.636+0000 7fbd03923800 1 -- 172.21.15.87:0/2599928831 >> 172.21.15.87:0/2599928831 conn(0x55ddaeca0920 msgr2=0x55ddaed92110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.636+0000 7fbd03923800 1 -- 172.21.15.87:0/2599928831 shutdown_connections 2024-05-08T18:31:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.636+0000 7fbd03923800 1 -- 172.21.15.87:0/2599928831 wait complete. 2024-05-08T18:31:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.636+0000 7fbd03923800 1 Processor -- start 2024-05-08T18:31:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.636+0000 7fbd03923800 1 -- start start 2024-05-08T18:31:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.637+0000 7fbd03923800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 0x55ddaed9e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.637+0000 7fbd03923800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ddaecaea30 con 0x55ddaeca53a0 2024-05-08T18:31:16.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.637+0000 7fbcff6b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 0x55ddaed9e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.637+0000 7fbcff6b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 0x55ddaed9e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60644/0 (socket says 172.21.15.87:60644) 2024-05-08T18:31:16.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.637+0000 7fbcff6b0640 1 -- 172.21.15.87:0/3742363574 learned_addr learned my addr 172.21.15.87:0/3742363574 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.637+0000 7fbcff6b0640 1 -- 172.21.15.87:0/3742363574 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddaed9e7f0 con 0x55ddaeca53a0 2024-05-08T18:31:16.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.637+0000 7fbcff6b0640 1 --2- 172.21.15.87:0/3742363574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 0x55ddaed9e2b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbcf001ced0 tx=0x7fbcf0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.637+0000 7fbbebe07640 1 -- 172.21.15.87:0/3742363574 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf006d070 con 0x55ddaeca53a0 2024-05-08T18:31:16.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.637+0000 7fbbebe07640 1 -- 172.21.15.87:0/3742363574 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf0052d20 con 0x55ddaeca53a0 2024-05-08T18:31:16.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.637+0000 7fbd03923800 1 -- 172.21.15.87:0/3742363574 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddaed9ea80 con 0x55ddaeca53a0 2024-05-08T18:31:16.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.637+0000 7fbbebe07640 1 -- 172.21.15.87:0/3742363574 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf0057050 con 0x55ddaeca53a0 2024-05-08T18:31:16.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.638+0000 7fbd03923800 1 -- 172.21.15.87:0/3742363574 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddaeda1690 con 0x55ddaeca53a0 2024-05-08T18:31:16.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.638+0000 7fbd03923800 1 Processor -- start 2024-05-08T18:31:16.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.638+0000 7fbd03923800 1 -- start start 2024-05-08T18:31:16.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.638+0000 7fbbebe07640 1 -- 172.21.15.87:0/3742363574 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbcf005d470 con 0x55ddaeca53a0 2024-05-08T18:31:16.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.638+0000 7fbd03923800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedab8f0 0x55ddaedabd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.638+0000 7fbd03923800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ddaeb96fc0 con 0x55ddaedab8f0 2024-05-08T18:31:16.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.639+0000 7fbcffeb1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedab8f0 0x55ddaedabd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.639+0000 7fbbebe07640 1 --2- 172.21.15.87:0/3742363574 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbbe403bb50 0x7fbbe403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.639+0000 7fbcffeb1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedab8f0 0x55ddaedabd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60660/0 (socket says 172.21.15.87:60660) 2024-05-08T18:31:16.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.639+0000 7fbcffeb1640 1 -- 172.21.15.87:0/3895511338 learned_addr learned my addr 172.21.15.87:0/3895511338 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.639+0000 7fbbebe07640 1 -- 172.21.15.87:0/3742363574 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fbcf00940a0 con 0x55ddaeca53a0 2024-05-08T18:31:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.639+0000 7fbcff6b0640 1 --2- 172.21.15.87:0/3742363574 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbbe403bb50 0x7fbbe403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.639+0000 7fbcffeb1640 1 -- 172.21.15.87:0/3895511338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddaedac250 con 0x55ddaedab8f0 2024-05-08T18:31:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.639+0000 7fbcffeb1640 1 --2- 172.21.15.87:0/3895511338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedab8f0 0x55ddaedabd10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800a430 tx=0x7fbcf800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebc102bbea3a24f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.639+0000 7fbcff6b0640 1 --2- 172.21.15.87:0/3742363574 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbbe403bb50 0x7fbbe403e010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbcf005efd0 tx=0x7fbcf005ef20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.639+0000 7fbbe9e03640 1 -- 172.21.15.87:0/3895511338 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf8015070 con 0x55ddaedab8f0 2024-05-08T18:31:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.639+0000 7fbbe9e03640 1 -- 172.21.15.87:0/3895511338 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf8001670 con 0x55ddaedab8f0 2024-05-08T18:31:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.639+0000 7fbbe9e03640 1 -- 172.21.15.87:0/3895511338 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf8001990 con 0x55ddaedab8f0 2024-05-08T18:31:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.639+0000 7fbd03923800 1 -- 172.21.15.87:0/3895511338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedab8f0 msgr2=0x55ddaedabd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.639+0000 7fbd03923800 1 --2- 172.21.15.87:0/3895511338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedab8f0 0x55ddaedabd10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800a430 tx=0x7fbcf800a8f0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.640+0000 7fbd03923800 1 -- 172.21.15.87:0/3895511338 shutdown_connections 2024-05-08T18:31:16.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.640+0000 7fbd03923800 1 --2- 172.21.15.87:0/3895511338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedab8f0 0x55ddaedabd10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.640+0000 7fbd03923800 1 -- 172.21.15.87:0/3895511338 >> 172.21.15.87:0/3895511338 conn(0x55ddaeca6560 msgr2=0x55ddaeda8390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.640+0000 7fbd03923800 1 -- 172.21.15.87:0/3895511338 shutdown_connections 2024-05-08T18:31:16.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.640+0000 7fbd03923800 1 -- 172.21.15.87:0/3895511338 wait complete. 2024-05-08T18:31:16.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.640+0000 7fbd03923800 1 Processor -- start 2024-05-08T18:31:16.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.640+0000 7fbd03923800 1 -- start start 2024-05-08T18:31:16.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.640+0000 7fbd03923800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedab8f0 0x55ddaedb2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.640+0000 7fbd03923800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ddaedacbe0 con 0x55ddaedab8f0 2024-05-08T18:31:16.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.640+0000 7fbcffeb1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedab8f0 0x55ddaedb2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.640+0000 7fbcffeb1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedab8f0 0x55ddaedb2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60662/0 (socket says 172.21.15.87:60662) 2024-05-08T18:31:16.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.640+0000 7fbcffeb1640 1 -- 172.21.15.87:0/1233106231 learned_addr learned my addr 172.21.15.87:0/1233106231 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.640+0000 7fbcffeb1640 1 -- 172.21.15.87:0/1233106231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddaedb32a0 con 0x55ddaedab8f0 2024-05-08T18:31:16.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.641+0000 7fbcffeb1640 1 --2- 172.21.15.87:0/1233106231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedab8f0 0x55ddaedb2d60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8013040 tx=0x7fbcf8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.641+0000 7fbbdbfff640 1 -- 172.21.15.87:0/1233106231 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf8020020 con 0x55ddaedab8f0 2024-05-08T18:31:16.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.641+0000 7fbbdbfff640 1 -- 172.21.15.87:0/1233106231 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf80108e0 con 0x55ddaedab8f0 2024-05-08T18:31:16.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.641+0000 7fbd03923800 1 -- 172.21.15.87:0/1233106231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddaedb3530 con 0x55ddaedab8f0 2024-05-08T18:31:16.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.641+0000 7fbbdbfff640 1 -- 172.21.15.87:0/1233106231 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf8015040 con 0x55ddaedab8f0 2024-05-08T18:31:16.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.641+0000 7fbd03923800 1 -- 172.21.15.87:0/1233106231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddaedb61e0 con 0x55ddaedab8f0 2024-05-08T18:31:16.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.642+0000 7fbbdbfff640 1 -- 172.21.15.87:0/1233106231 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbcf8023020 con 0x55ddaedab8f0 2024-05-08T18:31:16.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.642+0000 7fbbdbfff640 1 --2- 172.21.15.87:0/1233106231 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbbe003bb50 0x7fbbe003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.642+0000 7fbbdbfff640 1 -- 172.21.15.87:0/1233106231 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fbcf8052510 con 0x55ddaedab8f0 2024-05-08T18:31:16.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.642+0000 7fbcf7fff640 1 --2- 172.21.15.87:0/1233106231 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbbe003bb50 0x7fbbe003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.642+0000 7fbd03923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:16.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.642+0000 7fbd03923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:16.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.642+0000 7fbcf7fff640 1 --2- 172.21.15.87:0/1233106231 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbbe003bb50 0x7fbbe003e010 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbce8000f60 tx=0x7fbce8001230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.642+0000 7fbd03923800 1 Processor -- start 2024-05-08T18:31:16.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.643+0000 7fbd03923800 1 -- start start 2024-05-08T18:31:16.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.643+0000 7fbd03923800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedcd450 0x55ddaedcd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.643+0000 7fbd03923800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ddaed97080 con 0x55ddaedcd450 2024-05-08T18:31:16.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.643+0000 7fbcff6b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedcd450 0x55ddaedcd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.643+0000 7fbcff6b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedcd450 0x55ddaedcd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60676/0 (socket says 172.21.15.87:60676) 2024-05-08T18:31:16.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.643+0000 7fbcff6b0640 1 -- 172.21.15.87:0/852515715 learned_addr learned my addr 172.21.15.87:0/852515715 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.643+0000 7fbcff6b0640 1 -- 172.21.15.87:0/852515715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddaedcddb0 con 0x55ddaedcd450 2024-05-08T18:31:16.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.643+0000 7fbcff6b0640 1 --2- 172.21.15.87:0/852515715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedcd450 0x55ddaedcd870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00924c0 tx=0x7fbcf005c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.643+0000 7fbb77fff640 1 -- 172.21.15.87:0/852515715 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf008b030 con 0x55ddaedcd450 2024-05-08T18:31:16.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.644+0000 7fbb77fff640 1 -- 172.21.15.87:0/852515715 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf005b7d0 con 0x55ddaedcd450 2024-05-08T18:31:16.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.644+0000 7fbd03923800 1 -- 172.21.15.87:0/852515715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddaedce820 con 0x55ddaedcd450 2024-05-08T18:31:16.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.644+0000 7fbb77fff640 1 -- 172.21.15.87:0/852515715 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf005bbb0 con 0x55ddaedcd450 2024-05-08T18:31:16.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.644+0000 7fbd03923800 1 -- 172.21.15.87:0/852515715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddaedced20 con 0x55ddaedcd450 2024-05-08T18:31:16.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.644+0000 7fbb77fff640 1 -- 172.21.15.87:0/852515715 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbcf008e030 con 0x55ddaedcd450 2024-05-08T18:31:16.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.644+0000 7fbb77fff640 1 --2- 172.21.15.87:0/852515715 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbb4003bba0 0x7fbb4003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.645+0000 7fbb77fff640 1 -- 172.21.15.87:0/852515715 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fbcf008c070 con 0x55ddaedcd450 2024-05-08T18:31:16.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.645+0000 7fbcf7fff640 1 --2- 172.21.15.87:0/852515715 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbb4003bba0 0x7fbb4003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.645+0000 7fbb75ffb640 20 reqs_thread_entry: start 2024-05-08T18:31:16.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.645+0000 7fbd03923800 1 --2- 172.21.15.87:0/3742363574 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55ddaeddae50 0x55ddaeddd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.645+0000 7fbcf7fff640 1 --2- 172.21.15.87:0/852515715 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbb4003bba0 0x7fbb4003e060 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbce8001ed0 tx=0x7fbce800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.645+0000 7fbd03923800 1 -- 172.21.15.87:0/3742363574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ddaeddd9e0 con 0x55ddaeddae50 2024-05-08T18:31:16.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.645+0000 7fbcffeb1640 1 --2- 172.21.15.87:0/3742363574 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55ddaeddae50 0x55ddaeddd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.645+0000 7fbcffeb1640 1 --2- 172.21.15.87:0/3742363574 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55ddaeddae50 0x55ddaeddd310 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.646+0000 7fbcffeb1640 1 -- 172.21.15.87:0/3742363574 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbcf800e070 con 0x55ddaeddae50 2024-05-08T18:31:16.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.646+0000 7fbd03923800 1 -- 172.21.15.87:0/3742363574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ddaeddf2a0 con 0x55ddaeddae50 2024-05-08T18:31:16.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.646+0000 7fbcffeb1640 1 -- 172.21.15.87:0/3742363574 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbcf800e070 con 0x55ddaeddae50 2024-05-08T18:31:16.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.646+0000 7fbd03923800 1 -- 172.21.15.87:0/3742363574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ddaede3e10 con 0x55ddaeddae50 2024-05-08T18:31:16.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.647+0000 7fbcffeb1640 1 -- 172.21.15.87:0/3742363574 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [stat,call,call,writefull 0~993] v27'3 uv3 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fbcf800e070 con 0x55ddaeddae50 2024-05-08T18:31:16.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 -- 172.21.15.87:0/1233106231 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbbe003bb50 msgr2=0x7fbbe003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 --2- 172.21.15.87:0/1233106231 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbbe003bb50 0x7fbbe003e010 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbce8000f60 tx=0x7fbce8001230 comp rx=0 tx=0).stop 2024-05-08T18:31:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 -- 172.21.15.87:0/1233106231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedab8f0 msgr2=0x55ddaedb2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 --2- 172.21.15.87:0/1233106231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedab8f0 0x55ddaedb2d60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8013040 tx=0x7fbcf8003370 comp rx=0 tx=0).stop 2024-05-08T18:31:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 -- 172.21.15.87:0/1233106231 shutdown_connections 2024-05-08T18:31:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 --2- 172.21.15.87:0/1233106231 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbbe003bb50 0x7fbbe003e010 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 --2- 172.21.15.87:0/1233106231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedab8f0 0x55ddaedb2d60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 -- 172.21.15.87:0/1233106231 >> 172.21.15.87:0/1233106231 conn(0x55ddaeca6560 msgr2=0x55ddaeda59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 -- 172.21.15.87:0/1233106231 shutdown_connections 2024-05-08T18:31:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 -- 172.21.15.87:0/1233106231 wait complete. 2024-05-08T18:31:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 -- 172.21.15.87:0/852515715 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbb4003bba0 msgr2=0x7fbb4003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 --2- 172.21.15.87:0/852515715 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbb4003bba0 0x7fbb4003e060 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbce8001ed0 tx=0x7fbce800f000 comp rx=0 tx=0).stop 2024-05-08T18:31:16.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 -- 172.21.15.87:0/852515715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedcd450 msgr2=0x55ddaedcd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 --2- 172.21.15.87:0/852515715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedcd450 0x55ddaedcd870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00924c0 tx=0x7fbcf005c7a0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 -- 172.21.15.87:0/852515715 shutdown_connections 2024-05-08T18:31:16.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 --2- 172.21.15.87:0/852515715 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbb4003bba0 0x7fbb4003e060 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 --2- 172.21.15.87:0/852515715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaedcd450 0x55ddaedcd870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.648+0000 7fbd03923800 1 -- 172.21.15.87:0/852515715 >> 172.21.15.87:0/852515715 conn(0x55ddaedc1ee0 msgr2=0x55ddaedc2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.649+0000 7fbd03923800 1 -- 172.21.15.87:0/852515715 shutdown_connections 2024-05-08T18:31:16.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.649+0000 7fbd03923800 1 -- 172.21.15.87:0/852515715 wait complete. 2024-05-08T18:31:16.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.649+0000 7fbd03923800 1 -- 172.21.15.87:0/3742363574 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55ddaeddae50 msgr2=0x55ddaeddd310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.649+0000 7fbd03923800 1 --2- 172.21.15.87:0/3742363574 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55ddaeddae50 0x55ddaeddd310 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.649+0000 7fbd03923800 1 -- 172.21.15.87:0/3742363574 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbbe403bb50 msgr2=0x7fbbe403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.649+0000 7fbd03923800 1 --2- 172.21.15.87:0/3742363574 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbbe403bb50 0x7fbbe403e010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbcf005efd0 tx=0x7fbcf005ef20 comp rx=0 tx=0).stop 2024-05-08T18:31:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.649+0000 7fbd03923800 1 -- 172.21.15.87:0/3742363574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 msgr2=0x55ddaed9e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.649+0000 7fbd03923800 1 --2- 172.21.15.87:0/3742363574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 0x55ddaed9e2b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbcf001ced0 tx=0x7fbcf0002fb0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.649+0000 7fbd03923800 1 -- 172.21.15.87:0/3742363574 shutdown_connections 2024-05-08T18:31:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.649+0000 7fbd03923800 1 --2- 172.21.15.87:0/3742363574 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55ddaeddae50 0x55ddaeddd310 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.649+0000 7fbd03923800 1 --2- 172.21.15.87:0/3742363574 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbbe403bb50 0x7fbbe403e010 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.649+0000 7fbd03923800 1 --2- 172.21.15.87:0/3742363574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddaeca53a0 0x55ddaed9e2b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.649+0000 7fbd03923800 1 -- 172.21.15.87:0/3742363574 >> 172.21.15.87:0/3742363574 conn(0x55ddaeca0920 msgr2=0x55ddaed90910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.649+0000 7fbd03923800 1 -- 172.21.15.87:0/3742363574 shutdown_connections 2024-05-08T18:31:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.649+0000 7fbd03923800 1 -- 172.21.15.87:0/3742363574 wait complete. 2024-05-08T18:31:16.660 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"be5b96a9-27d9-41bc-99e2-d41218f7be5a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-08T18:31:16.660 DEBUG:tasks.util.rgw: json result: {'id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-08T18:31:16.662 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-05-08T18:31:16.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-05-08T18:31:16.662 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-05-08T18:31:16.704 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:16.704 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.707+0000 7fd07d887800 1 Processor -- start 2024-05-08T18:31:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.707+0000 7fd07d887800 1 -- start start 2024-05-08T18:31:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.707+0000 7fd07d887800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f08692b850 0x55f08692dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.707+0000 7fd07d887800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f08692e180 con 0x55f086927d40 2024-05-08T18:31:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.707+0000 7fd07d887800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f0867c7e20 con 0x55f08692b850 2024-05-08T18:31:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.707+0000 7fd073fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f08692b850 0x55f08692dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.707+0000 7fd073fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f08692b850 0x55f08692dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60684/0 (socket says 172.21.15.87:60684) 2024-05-08T18:31:16.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.707+0000 7fd073fff640 1 -- 172.21.15.87:0/1325088175 learned_addr learned my addr 172.21.15.87:0/1325088175 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.707+0000 7fd07b37f640 1 --1- 172.21.15.87:0/1325088175 >> v1:172.21.15.53:6789/0 conn(0x55f086927d40 0x55f08692a130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41864/0 (socket says 172.21.15.87:41864) 2024-05-08T18:31:16.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.707+0000 7fd073fff640 1 -- 172.21.15.87:0/1325088175 >> v1:172.21.15.53:6789/0 conn(0x55f086927d40 legacy=0x55f08692a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.707+0000 7fd073fff640 1 -- 172.21.15.87:0/1325088175 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f08692f360 con 0x55f08692b850 2024-05-08T18:31:16.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.709+0000 7fd073fff640 1 --2- 172.21.15.87:0/1325088175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08692b850 0x55f08692dc40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd06400a520 tx=0x7fd06401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2c26f49cb5c218 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.709+0000 7fd07ab7e640 1 -- 172.21.15.87:0/1325088175 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd064057070 con 0x55f08692b850 2024-05-08T18:31:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.709+0000 7fd07ab7e640 1 -- 172.21.15.87:0/1325088175 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd064052570 con 0x55f08692b850 2024-05-08T18:31:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.709+0000 7fd07ab7e640 1 -- 172.21.15.87:0/1325088175 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd06404ae60 con 0x55f08692b850 2024-05-08T18:31:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.710+0000 7fd07d887800 1 -- 172.21.15.87:0/1325088175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08692b850 msgr2=0x55f08692dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.710+0000 7fd07d887800 1 --2- 172.21.15.87:0/1325088175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08692b850 0x55f08692dc40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd06400a520 tx=0x7fd06401d010 comp rx=0 tx=0).stop 2024-05-08T18:31:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.710+0000 7fd07d887800 1 -- 172.21.15.87:0/1325088175 shutdown_connections 2024-05-08T18:31:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.710+0000 7fd07d887800 1 --2- 172.21.15.87:0/1325088175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08692b850 0x55f08692dc40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.710+0000 7fd07d887800 1 -- 172.21.15.87:0/1325088175 >> 172.21.15.87:0/1325088175 conn(0x55f086921710 msgr2=0x55f086923b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.710+0000 7fd07d887800 1 -- 172.21.15.87:0/1325088175 shutdown_connections 2024-05-08T18:31:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.710+0000 7fd07d887800 1 -- 172.21.15.87:0/1325088175 wait complete. 2024-05-08T18:31:16.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.723+0000 7fd07d887800 1 Processor -- start 2024-05-08T18:31:16.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.724+0000 7fd07d887800 1 -- start start 2024-05-08T18:31:16.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.724+0000 7fd07d887800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086927d40 0x55f086a18660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.724+0000 7fd07d887800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f0868725a0 con 0x55f086927d40 2024-05-08T18:31:16.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.724+0000 7fd07b37f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086927d40 0x55f086a18660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.724+0000 7fd07b37f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086927d40 0x55f086a18660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60692/0 (socket says 172.21.15.87:60692) 2024-05-08T18:31:16.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.724+0000 7fd07b37f640 1 -- 172.21.15.87:0/1078240766 learned_addr learned my addr 172.21.15.87:0/1078240766 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.724+0000 7fd07b37f640 1 -- 172.21.15.87:0/1078240766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f086a18c30 con 0x55f086927d40 2024-05-08T18:31:16.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.725+0000 7fd07b37f640 1 --2- 172.21.15.87:0/1078240766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086927d40 0x55f086a18660 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd06c001e90 tx=0x7fd06c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db30ab4143d90ec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.725+0000 7fcf6960a640 1 -- 172.21.15.87:0/1078240766 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd06c00e5c0 con 0x55f086927d40 2024-05-08T18:31:16.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.725+0000 7fcf6960a640 1 -- 172.21.15.87:0/1078240766 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd06c006070 con 0x55f086927d40 2024-05-08T18:31:16.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.725+0000 7fcf6960a640 1 -- 172.21.15.87:0/1078240766 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd06c00e890 con 0x55f086927d40 2024-05-08T18:31:16.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.725+0000 7fd07d887800 1 -- 172.21.15.87:0/1078240766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086927d40 msgr2=0x55f086a18660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.725+0000 7fd07d887800 1 --2- 172.21.15.87:0/1078240766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086927d40 0x55f086a18660 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd06c001e90 tx=0x7fd06c00b6c0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.725+0000 7fd07d887800 1 -- 172.21.15.87:0/1078240766 shutdown_connections 2024-05-08T18:31:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.725+0000 7fd07d887800 1 --2- 172.21.15.87:0/1078240766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086927d40 0x55f086a18660 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.725+0000 7fd07d887800 1 -- 172.21.15.87:0/1078240766 >> 172.21.15.87:0/1078240766 conn(0x55f086921710 msgr2=0x55f086a13f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.725+0000 7fd07d887800 1 -- 172.21.15.87:0/1078240766 shutdown_connections 2024-05-08T18:31:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.725+0000 7fd07d887800 1 -- 172.21.15.87:0/1078240766 wait complete. 2024-05-08T18:31:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.726+0000 7fd07d887800 1 Processor -- start 2024-05-08T18:31:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.726+0000 7fd07d887800 1 -- start start 2024-05-08T18:31:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.726+0000 7fd07d887800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086927d40 0x55f086a201e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.726+0000 7fd07d887800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f08692e650 con 0x55f086927d40 2024-05-08T18:31:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.726+0000 7fd07b37f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086927d40 0x55f086a201e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.726+0000 7fd07b37f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086927d40 0x55f086a201e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60702/0 (socket says 172.21.15.87:60702) 2024-05-08T18:31:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.726+0000 7fd07b37f640 1 -- 172.21.15.87:0/4002088102 learned_addr learned my addr 172.21.15.87:0/4002088102 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.726+0000 7fd07b37f640 1 -- 172.21.15.87:0/4002088102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f086a20720 con 0x55f086927d40 2024-05-08T18:31:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.726+0000 7fd07b37f640 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086927d40 0x55f086a201e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd06c00c010 tx=0x7fd06c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.727+0000 7fcf67e07640 1 -- 172.21.15.87:0/4002088102 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd06c00f8d0 con 0x55f086927d40 2024-05-08T18:31:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.727+0000 7fcf67e07640 1 -- 172.21.15.87:0/4002088102 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd06c00fa90 con 0x55f086927d40 2024-05-08T18:31:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.727+0000 7fcf67e07640 1 -- 172.21.15.87:0/4002088102 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd06c00fdb0 con 0x55f086927d40 2024-05-08T18:31:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.727+0000 7fd07d887800 1 -- 172.21.15.87:0/4002088102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f086a209b0 con 0x55f086927d40 2024-05-08T18:31:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.727+0000 7fd07d887800 1 -- 172.21.15.87:0/4002088102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f086a23660 con 0x55f086927d40 2024-05-08T18:31:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.727+0000 7fcf67e07640 1 -- 172.21.15.87:0/4002088102 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd06c017070 con 0x55f086927d40 2024-05-08T18:31:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.728+0000 7fcf67e07640 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcf6003bba0 0x7fcf6003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.728+0000 7fcf67e07640 1 -- 172.21.15.87:0/4002088102 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd06c015020 con 0x55f086927d40 2024-05-08T18:31:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.728+0000 7fd073fff640 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcf6003bba0 0x7fcf6003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.728+0000 7fd07d887800 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f08692b850 0x55f086a27420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.728+0000 7fd07d887800 1 -- 172.21.15.87:0/4002088102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086a279b0 con 0x55f08692b850 2024-05-08T18:31:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.728+0000 7fd07bb80640 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f08692b850 0x55f086a27420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.728+0000 7fd073fff640 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcf6003bba0 0x7fcf6003e060 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd064054000 tx=0x7fd06404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.728+0000 7fd07bb80640 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f08692b850 0x55f086a27420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.729+0000 7fd07bb80640 1 -- 172.21.15.87:0/4002088102 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd07400a4a0 con 0x55f08692b850 2024-05-08T18:31:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.729+0000 7fd07d887800 1 -- 172.21.15.87:0/4002088102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086a249f0 con 0x55f08692b850 2024-05-08T18:31:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.729+0000 7fd07bb80640 1 -- 172.21.15.87:0/4002088102 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd07400a4a0 con 0x55f08692b850 2024-05-08T18:31:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.729+0000 7fd07d887800 1 -- 172.21.15.87:0/4002088102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086a297f0 con 0x55f08692b850 2024-05-08T18:31:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.729+0000 7fd07bb80640 1 -- 172.21.15.87:0/4002088102 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd07400a4a0 con 0x55f08692b850 2024-05-08T18:31:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.729+0000 7fd07d887800 1 -- 172.21.15.87:0/4002088102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086a28a20 con 0x55f08692b850 2024-05-08T18:31:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.730+0000 7fd07bb80640 1 -- 172.21.15.87:0/4002088102 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd07400a4a0 con 0x55f08692b850 2024-05-08T18:31:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.730+0000 7fd07d887800 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f086a2aba0 0x55f086a2cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.730+0000 7fd07d887800 1 -- 172.21.15.87:0/4002088102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086a2d4d0 con 0x55f086a2aba0 2024-05-08T18:31:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.730+0000 7fd07b37f640 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f086a2aba0 0x55f086a2cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.730+0000 7fd07b37f640 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f086a2aba0 0x55f086a2cf90 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.730+0000 7fd07b37f640 1 -- 172.21.15.87:0/4002088102 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd06c02e070 con 0x55f086a2aba0 2024-05-08T18:31:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.731+0000 7fd07d887800 1 Processor -- start 2024-05-08T18:31:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.731+0000 7fd07d887800 1 -- start start 2024-05-08T18:31:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.731+0000 7fd07d887800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a3b710 0x55f086a3bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.731+0000 7fd07d887800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f086818fc0 con 0x55f086a3b710 2024-05-08T18:31:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.731+0000 7fd07bb80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a3b710 0x55f086a3bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.731+0000 7fd07bb80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a3b710 0x55f086a3bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60708/0 (socket says 172.21.15.87:60708) 2024-05-08T18:31:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.731+0000 7fd07bb80640 1 -- 172.21.15.87:0/2691400558 learned_addr learned my addr 172.21.15.87:0/2691400558 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.731+0000 7fd07bb80640 1 -- 172.21.15.87:0/2691400558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f086a3c070 con 0x55f086a3b710 2024-05-08T18:31:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.731+0000 7fd07bb80640 1 --2- 172.21.15.87:0/2691400558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a3b710 0x55f086a3bb30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55f086a215e0 tx=0x7fd0740178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.732+0000 7fcf65602640 1 -- 172.21.15.87:0/2691400558 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd074013440 con 0x55f086a3b710 2024-05-08T18:31:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.732+0000 7fcf65602640 1 -- 172.21.15.87:0/2691400558 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0740135e0 con 0x55f086a3b710 2024-05-08T18:31:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.732+0000 7fd07d887800 1 -- 172.21.15.87:0/2691400558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f086a3cae0 con 0x55f086a3b710 2024-05-08T18:31:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.732+0000 7fcf65602640 1 -- 172.21.15.87:0/2691400558 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0740138c0 con 0x55f086a3b710 2024-05-08T18:31:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.732+0000 7fd07d887800 1 -- 172.21.15.87:0/2691400558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f086a3cfe0 con 0x55f086a3b710 2024-05-08T18:31:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.732+0000 7fcf65602640 1 -- 172.21.15.87:0/2691400558 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd074011040 con 0x55f086a3b710 2024-05-08T18:31:16.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.733+0000 7fcf65602640 1 --2- 172.21.15.87:0/2691400558 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcf5403bba0 0x7fcf5403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.733+0000 7fcf65602640 1 -- 172.21.15.87:0/2691400558 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd07401d070 con 0x55f086a3b710 2024-05-08T18:31:16.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.733+0000 7fd07b37f640 1 --2- 172.21.15.87:0/2691400558 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcf5403bba0 0x7fcf5403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.733+0000 7fd07d887800 1 Processor -- start 2024-05-08T18:31:16.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.733+0000 7fd07b37f640 1 --2- 172.21.15.87:0/2691400558 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcf5403bba0 0x7fcf5403e060 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd06c00ff70 tx=0x7fd06c001260 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.733+0000 7fd07d887800 1 -- start start 2024-05-08T18:31:16.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.733+0000 7fd07d887800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a48a80 0x55f086a48ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.733+0000 7fd07d887800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f086a18fb0 con 0x55f086a48a80 2024-05-08T18:31:16.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.733+0000 7fd07bb80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a48a80 0x55f086a48ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.733+0000 7fd07bb80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a48a80 0x55f086a48ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60718/0 (socket says 172.21.15.87:60718) 2024-05-08T18:31:16.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.733+0000 7fd07bb80640 1 -- 172.21.15.87:0/1061382968 learned_addr learned my addr 172.21.15.87:0/1061382968 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.734+0000 7fd07bb80640 1 -- 172.21.15.87:0/1061382968 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f086a49470 con 0x55f086a48a80 2024-05-08T18:31:16.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.734+0000 7fd07bb80640 1 --2- 172.21.15.87:0/1061382968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a48a80 0x55f086a48ea0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd074052990 tx=0x7fd074029430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6c7c4e44fbf047 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.734+0000 7fcf5effd640 1 -- 172.21.15.87:0/1061382968 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd07402ad80 con 0x55f086a48a80 2024-05-08T18:31:16.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.734+0000 7fcf5effd640 1 -- 172.21.15.87:0/1061382968 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0740014f0 con 0x55f086a48a80 2024-05-08T18:31:16.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.734+0000 7fcf5effd640 1 -- 172.21.15.87:0/1061382968 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd074001810 con 0x55f086a48a80 2024-05-08T18:31:16.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.734+0000 7fd07d887800 1 -- 172.21.15.87:0/1061382968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a48a80 msgr2=0x55f086a48ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.734+0000 7fd07d887800 1 --2- 172.21.15.87:0/1061382968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a48a80 0x55f086a48ea0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd074052990 tx=0x7fd074029430 comp rx=0 tx=0).stop 2024-05-08T18:31:16.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.734+0000 7fd07d887800 1 -- 172.21.15.87:0/1061382968 shutdown_connections 2024-05-08T18:31:16.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.734+0000 7fd07d887800 1 --2- 172.21.15.87:0/1061382968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a48a80 0x55f086a48ea0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.734+0000 7fd07d887800 1 -- 172.21.15.87:0/1061382968 >> 172.21.15.87:0/1061382968 conn(0x55f086a44d00 msgr2=0x55f086a42db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.734+0000 7fd07d887800 1 -- 172.21.15.87:0/1061382968 shutdown_connections 2024-05-08T18:31:16.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.734+0000 7fd07d887800 1 -- 172.21.15.87:0/1061382968 wait complete. 2024-05-08T18:31:16.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.735+0000 7fd07d887800 1 Processor -- start 2024-05-08T18:31:16.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.735+0000 7fd07d887800 1 -- start start 2024-05-08T18:31:16.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.735+0000 7fd07d887800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a48a80 0x55f0869275e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.735+0000 7fd07d887800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f086a49bc0 con 0x55f086a48a80 2024-05-08T18:31:16.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.735+0000 7fd07bb80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a48a80 0x55f0869275e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.735+0000 7fd07bb80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a48a80 0x55f0869275e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60728/0 (socket says 172.21.15.87:60728) 2024-05-08T18:31:16.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.735+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 learned_addr learned my addr 172.21.15.87:0/3715005052 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.735+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f086927b20 con 0x55f086a48a80 2024-05-08T18:31:16.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.735+0000 7fd07bb80640 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a48a80 0x55f0869275e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd074001f40 tx=0x7fd0740528f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.735+0000 7fcf5d7fa640 1 -- 172.21.15.87:0/3715005052 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd074030020 con 0x55f086a48a80 2024-05-08T18:31:16.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.736+0000 7fcf5d7fa640 1 -- 172.21.15.87:0/3715005052 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd074051330 con 0x55f086a48a80 2024-05-08T18:31:16.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.736+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f086925cd0 con 0x55f086a48a80 2024-05-08T18:31:16.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.736+0000 7fcf5d7fa640 1 -- 172.21.15.87:0/3715005052 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd074013a60 con 0x55f086a48a80 2024-05-08T18:31:16.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.736+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0869261d0 con 0x55f086a48a80 2024-05-08T18:31:16.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.736+0000 7fcf5d7fa640 1 -- 172.21.15.87:0/3715005052 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd074033020 con 0x55f086a48a80 2024-05-08T18:31:16.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.736+0000 7fcf5d7fa640 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcf4403bb50 0x7fcf4403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.737+0000 7fcf5d7fa640 1 -- 172.21.15.87:0/3715005052 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd07400e040 con 0x55f086a48a80 2024-05-08T18:31:16.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.737+0000 7fd07b37f640 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcf4403bb50 0x7fcf4403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.737+0000 7fd07d887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.737+0000 7fd07d887800 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f086a5dd00 0x55f086a601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.737+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086a60910 con 0x55f086a5dd00 2024-05-08T18:31:16.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.737+0000 7fd073fff640 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f086a5dd00 0x55f086a601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.737+0000 7fd07b37f640 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcf4403bb50 0x7fcf4403e010 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd06c017fd0 tx=0x7fd06c046040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.737+0000 7fd073fff640 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f086a5dd00 0x55f086a601c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.737+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.737+0000 7fd07d887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.737+0000 7fd07d887800 20 realm 2024-05-08T18:31:16.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.737+0000 7fd07d887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.738+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086a60ce0 con 0x55f086a5dd00 2024-05-08T18:31:16.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.738+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.738+0000 7fd07d887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.738+0000 7fd07d887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:16.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.738+0000 7fd07d887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.738+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086a615b0 con 0x55f086a5dd00 2024-05-08T18:31:16.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.738+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.738+0000 7fd07d887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.738+0000 7fd07d887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.738+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086a61950 con 0x55f086a5dd00 2024-05-08T18:31:16.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.738+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.738+0000 7fd07d887800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:16.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.738+0000 7fd07d887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.738+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086a61d70 con 0x55f086a5dd00 2024-05-08T18:31:16.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.739+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.739+0000 7fd07d887800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:16.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.739+0000 7fd07d887800 20 searching for the correct realm 2024-05-08T18:31:16.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.739+0000 7fd07d887800 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f086a63dc0 0x55f086a661b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.739+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f086a66880 con 0x55f086a63dc0 2024-05-08T18:31:16.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.739+0000 7fd07bb80640 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f086a63dc0 0x55f086a661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.739+0000 7fd07bb80640 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f086a63dc0 0x55f086a661b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.739+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.739+0000 7fd07bb80640 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd074035020 0x7fd07402b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.739+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f086a66880 con 0x7fd074035020 2024-05-08T18:31:16.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.740+0000 7fd07b37f640 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd074035020 0x7fd07402b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.740+0000 7fd07b37f640 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd074035020 0x7fd07402b3e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.740+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06c02e070 con 0x7fd074035020 2024-05-08T18:31:16.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.740+0000 7fd07b37f640 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd06c00f070 0x7fd06c01a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.740+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f086a66880 con 0x7fd06c00f070 2024-05-08T18:31:16.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.741+0000 7fd073fff640 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd06c00f070 0x7fd06c01a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.741+0000 7fd073fff640 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd06c00f070 0x7fd06c01a480 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.741+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.741+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f086a66880 con 0x55f086a5dd00 2024-05-08T18:31:16.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.741+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.741+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f086a66880 con 0x55f086a5dd00 2024-05-08T18:31:16.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.742+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.742+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f086a66880 con 0x7fd06c00f070 2024-05-08T18:31:16.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.742+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.742+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f086a66880 con 0x7fd06c00f070 2024-05-08T18:31:16.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.742+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.742+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f086a66880 con 0x7fd074035020 2024-05-08T18:31:16.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.742+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06c02e070 con 0x7fd074035020 2024-05-08T18:31:16.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.742+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f086a66880 con 0x55f086a63dc0 2024-05-08T18:31:16.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.743+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.743+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f086a66880 con 0x55f086a5dd00 2024-05-08T18:31:16.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.743+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.743+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f086a66880 con 0x7fd06c00f070 2024-05-08T18:31:16.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.743+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.743+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f086a66880 con 0x55f086a5dd00 2024-05-08T18:31:16.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.743+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.743+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f086a66880 con 0x7fd074035020 2024-05-08T18:31:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.744+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd06c02e070 con 0x7fd074035020 2024-05-08T18:31:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.744+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x55f086a63dc0 2024-05-08T18:31:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.744+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.744+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x55f086a63dc0 2024-05-08T18:31:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.744+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.744+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x7fd06c00f070 2024-05-08T18:31:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.744+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.744+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x55f086a63dc0 2024-05-08T18:31:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.745+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.745+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x55f086a63dc0 2024-05-08T18:31:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.745+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.745+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x55f086a5dd00 2024-05-08T18:31:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.745+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.745+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x55f086a5dd00 2024-05-08T18:31:16.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.745+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.745+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x7fd06c00f070 2024-05-08T18:31:16.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.746+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.746+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x55f086a63dc0 2024-05-08T18:31:16.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.746+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.746+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x7fd074035020 2024-05-08T18:31:16.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.746+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06c02e070 con 0x7fd074035020 2024-05-08T18:31:16.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.746+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x55f086a5dd00 2024-05-08T18:31:16.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.746+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.746+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x7fd06c00f070 2024-05-08T18:31:16.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.747+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.747+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x55f086a63dc0 2024-05-08T18:31:16.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.747+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.747+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x7fd06c00f070 2024-05-08T18:31:16.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.747+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.747+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x7fd074035020 2024-05-08T18:31:16.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.747+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06c02e070 con 0x7fd074035020 2024-05-08T18:31:16.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.747+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x55f086a63dc0 2024-05-08T18:31:16.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.747+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.747+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x7fd06c00f070 2024-05-08T18:31:16.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.748+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.748+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x55f086a5dd00 2024-05-08T18:31:16.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.748+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.748+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd06c061060 con 0x7fd074035020 2024-05-08T18:31:16.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.748+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd06c02e070 con 0x7fd074035020 2024-05-08T18:31:16.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.748+0000 7fd07d887800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:16.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.748+0000 7fd07d887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:16.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.748+0000 7fd07d887800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:16.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.748+0000 7fd07d887800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:16.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.748+0000 7fd07d887800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:16.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.748+0000 7fd07d887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:16.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.748+0000 7fd07d887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.748+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086a62840 con 0x55f086a5dd00 2024-05-08T18:31:16.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd07d887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd07d887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086a630e0 con 0x55f086a5dd00 2024-05-08T18:31:16.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd07d887800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:16.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd07d887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086a62480 con 0x7fd06c00f070 2024-05-08T18:31:16.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd07d887800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:16.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd07d887800 20 zone default found 2024-05-08T18:31:16.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd07d887800 4 Realm: () 2024-05-08T18:31:16.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd07d887800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:16.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd07d887800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:16.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd07d887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:16.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd07d887800 20 zonegroup default 2024-05-08T18:31:16.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd07d887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.749+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086a66d00 con 0x7fd06c00f070 2024-05-08T18:31:16.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.750+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.750+0000 7fd07d887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.750+0000 7fd07d887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.750+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086a68b90 con 0x55f086a63dc0 2024-05-08T18:31:16.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.750+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.750+0000 7fd07d887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.750+0000 7fd07d887800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.750+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086a68f30 con 0x55f086a63dc0 2024-05-08T18:31:16.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.750+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.750+0000 7fd07d887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.750+0000 7fd07d887800 20 started sync module instance, tier type = 2024-05-08T18:31:16.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.750+0000 7fd07d887800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:16.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.750+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086a67fd0 con 0x7fd074035020 2024-05-08T18:31:16.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.751+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06c02e070 con 0x7fd074035020 2024-05-08T18:31:16.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.751+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94491539571648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086a687e0 con 0x7fd074035020 2024-05-08T18:31:16.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.751+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086a69c90 con 0x55f086a5dd00 2024-05-08T18:31:16.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.752+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94491539571648] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06c02e070 con 0x7fd074035020 2024-05-08T18:31:16.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.752+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.752+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94491539575504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086a6a080 con 0x55f086a5dd00 2024-05-08T18:31:16.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.752+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086a6aad0 con 0x55f086a63dc0 2024-05-08T18:31:16.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.754+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.754+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94491539575504] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.754+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94491539576560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086a6aec0 con 0x55f086a63dc0 2024-05-08T18:31:16.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.754+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086a6b8e0 con 0x7fd074035020 2024-05-08T18:31:16.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.756+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94491539576560] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.756+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06c02e070 con 0x7fd074035020 2024-05-08T18:31:16.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.756+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94491539583952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086a6bcd0 con 0x7fd074035020 2024-05-08T18:31:16.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.756+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086a6c6f0 con 0x55f086a5dd00 2024-05-08T18:31:16.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.758+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94491539583952] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06c02e070 con 0x7fd074035020 2024-05-08T18:31:16.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.760+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.760+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94491539587552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086a6cb10 con 0x55f086a5dd00 2024-05-08T18:31:16.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.760+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086a6d4d0 con 0x7fd06c00f070 2024-05-08T18:31:16.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.762+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94491539587552] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.762+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.762+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94491539580352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086a6d4d0 con 0x7fd06c00f070 2024-05-08T18:31:16.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.762+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086a6df10 con 0x7fd06c00f070 2024-05-08T18:31:16.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.763+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94491539580352] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.763+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.763+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94491539591712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086a6df10 con 0x7fd06c00f070 2024-05-08T18:31:16.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.763+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086a6e8d0 con 0x7fd06c00f070 2024-05-08T18:31:16.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.764+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94491539591712] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.764+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.764+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94491539594304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086a6e8d0 con 0x7fd06c00f070 2024-05-08T18:31:16.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.764+0000 7fd07d887800 20 add_watcher() i=0 2024-05-08T18:31:16.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.764+0000 7fd07d887800 20 add_watcher() i=1 2024-05-08T18:31:16.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.764+0000 7fd07d887800 20 add_watcher() i=2 2024-05-08T18:31:16.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.764+0000 7fd07d887800 20 add_watcher() i=3 2024-05-08T18:31:16.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.764+0000 7fd07d887800 20 add_watcher() i=4 2024-05-08T18:31:16.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.764+0000 7fd07d887800 20 add_watcher() i=5 2024-05-08T18:31:16.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.764+0000 7fd07d887800 20 add_watcher() i=6 2024-05-08T18:31:16.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.765+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94491539594304] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.765+0000 7fd07d887800 20 add_watcher() i=7 2024-05-08T18:31:16.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.765+0000 7fd07d887800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:16.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.765+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086a71cd0 con 0x55f086a5dd00 2024-05-08T18:31:16.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.765+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.765+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94491539596784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086a6f1f0 con 0x55f086a5dd00 2024-05-08T18:31:16.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.767+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94491539596784] v27'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.767+0000 7fcf31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:16.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.767+0000 7fd07d887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:16.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.767+0000 7fd07d887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:16.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.767+0000 7fd07d887800 5 note: GC not initialized 2024-05-08T18:31:16.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.768+0000 7fcf30fe1640 20 reqs_thread_entry: start 2024-05-08T18:31:16.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.768+0000 7fd07d887800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:16.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.768+0000 7fd07d887800 20 Filter name: none 2024-05-08T18:31:16.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.768+0000 7fceaa7fc640 20 reqs_thread_entry: start 2024-05-08T18:31:16.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.768+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa56b0 con 0x55f086a5dd00 2024-05-08T18:31:16.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.768+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.768+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa56d0 con 0x7fd074035020 2024-05-08T18:31:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.768+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd06c02e070 con 0x7fd074035020 2024-05-08T18:31:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.768+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a5dd00 2024-05-08T18:31:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.769+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.769+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a63dc0 2024-05-08T18:31:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.769+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.769+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a63dc0 2024-05-08T18:31:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.769+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.769+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a63dc0 2024-05-08T18:31:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.769+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.769+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a5dd00 2024-05-08T18:31:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.769+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.770+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a5dd00 2024-05-08T18:31:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.770+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.770+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a63dc0 2024-05-08T18:31:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.770+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.770+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a63dc0 2024-05-08T18:31:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.770+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.770+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x7fd06c00f070 2024-05-08T18:31:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.771+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.771+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a5dd00 2024-05-08T18:31:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.771+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.771+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x7fd074035020 2024-05-08T18:31:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.771+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd06c02e070 con 0x7fd074035020 2024-05-08T18:31:16.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.771+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a63dc0 2024-05-08T18:31:16.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.771+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.771+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x7fd06c00f070 2024-05-08T18:31:16.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.772+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.772+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x7fd06c00f070 2024-05-08T18:31:16.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.772+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.772+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a63dc0 2024-05-08T18:31:16.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.772+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.772+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x7fd06c00f070 2024-05-08T18:31:16.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.773+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.773+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a5dd00 2024-05-08T18:31:16.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.773+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.773+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a63dc0 2024-05-08T18:31:16.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.773+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.773+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x7fd06c00f070 2024-05-08T18:31:16.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.774+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.774+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x7fd074035020 2024-05-08T18:31:16.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.774+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd06c02e070 con 0x7fd074035020 2024-05-08T18:31:16.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.774+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x7fd06c00f070 2024-05-08T18:31:16.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.774+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.774+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a5dd00 2024-05-08T18:31:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.774+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.774+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a5dd00 2024-05-08T18:31:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.774+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.774+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a63dc0 2024-05-08T18:31:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.775+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.775+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a5dd00 2024-05-08T18:31:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.775+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.775+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a5dd00 2024-05-08T18:31:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.775+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.775+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a63dc0 2024-05-08T18:31:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.775+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.775+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a63dc0 2024-05-08T18:31:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.775+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.775+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a63dc0 2024-05-08T18:31:16.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.776+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.776+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x7fd06c00f070 2024-05-08T18:31:16.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.776+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.777+0000 7fcf31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:16.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.777+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94491539596784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a5dd00 2024-05-08T18:31:16.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.778+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94491539596784] v27'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.778+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94491539571648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x7fd074035020 2024-05-08T18:31:16.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.780+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94491539571648] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06c02e070 con 0x7fd074035020 2024-05-08T18:31:16.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.780+0000 7fd07d887800 20 remove_watcher() i=0 2024-05-08T18:31:16.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.780+0000 7fd07d887800 2 removed watcher, disabling cache 2024-05-08T18:31:16.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.780+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94491539575504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a5dd00 2024-05-08T18:31:16.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.781+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94491539575504] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.781+0000 7fd07d887800 20 remove_watcher() i=1 2024-05-08T18:31:16.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.781+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94491539576560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a63dc0 2024-05-08T18:31:16.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.782+0000 7fd07bb80640 1 -- 172.21.15.87:0/3715005052 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94491539576560] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd074052d70 con 0x55f086a63dc0 2024-05-08T18:31:16.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.782+0000 7fd07d887800 20 remove_watcher() i=2 2024-05-08T18:31:16.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.782+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94491539583952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x7fd074035020 2024-05-08T18:31:16.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.783+0000 7fd07b37f640 1 -- 172.21.15.87:0/3715005052 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94491539583952] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06c02e070 con 0x7fd074035020 2024-05-08T18:31:16.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.783+0000 7fd07d887800 20 remove_watcher() i=3 2024-05-08T18:31:16.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.783+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94491539587552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x55f086a5dd00 2024-05-08T18:31:16.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.785+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.1 v2:172.21.15.87:6808/2448644045 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94491539587552] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x55f086a5dd00 2024-05-08T18:31:16.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.786+0000 7fd07d887800 20 remove_watcher() i=4 2024-05-08T18:31:16.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.786+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94491539580352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x7fd06c00f070 2024-05-08T18:31:16.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.787+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94491539580352] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.787+0000 7fd07d887800 20 remove_watcher() i=5 2024-05-08T18:31:16.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.787+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94491539591712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x7fd06c00f070 2024-05-08T18:31:16.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.788+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94491539591712] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.788+0000 7fd07d887800 20 remove_watcher() i=6 2024-05-08T18:31:16.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.788+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94491539594304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f086aa5b70 con 0x7fd06c00f070 2024-05-08T18:31:16.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94491539594304] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd06405a040 con 0x7fd06c00f070 2024-05-08T18:31:16.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 20 remove_watcher() i=7 2024-05-08T18:31:16.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd06c00f070 msgr2=0x7fd06c01a480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd06c00f070 0x7fd06c01a480 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f086a5dd00 msgr2=0x55f086a601c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f086a5dd00 0x55f086a601c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd074035020 msgr2=0x7fd07402b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd074035020 0x7fd07402b3e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f086a63dc0 msgr2=0x55f086a661b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f086a63dc0 0x55f086a661b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcf4403bb50 msgr2=0x7fcf4403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcf4403bb50 0x7fcf4403e010 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd06c017fd0 tx=0x7fd06c046040 comp rx=0 tx=0).stop 2024-05-08T18:31:16.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a48a80 msgr2=0x55f0869275e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd073fff640 1 -- 172.21.15.87:0/3715005052 reap_dead start 2024-05-08T18:31:16.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a48a80 0x55f0869275e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd074001f40 tx=0x7fd0740528f0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 shutdown_connections 2024-05-08T18:31:16.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 --2- 172.21.15.87:0/3715005052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a48a80 0x55f0869275e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 >> 172.21.15.87:0/3715005052 conn(0x55f086a44d00 msgr2=0x55f086a423b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 shutdown_connections 2024-05-08T18:31:16.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 -- 172.21.15.87:0/3715005052 wait complete. 2024-05-08T18:31:16.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 -- 172.21.15.87:0/2691400558 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcf5403bba0 msgr2=0x7fcf5403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 --2- 172.21.15.87:0/2691400558 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcf5403bba0 0x7fcf5403e060 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd06c00ff70 tx=0x7fd06c001260 comp rx=0 tx=0).stop 2024-05-08T18:31:16.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 -- 172.21.15.87:0/2691400558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a3b710 msgr2=0x55f086a3bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 --2- 172.21.15.87:0/2691400558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a3b710 0x55f086a3bb30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55f086a215e0 tx=0x7fd0740178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 -- 172.21.15.87:0/2691400558 shutdown_connections 2024-05-08T18:31:16.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 --2- 172.21.15.87:0/2691400558 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcf5403bba0 0x7fcf5403e060 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 --2- 172.21.15.87:0/2691400558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086a3b710 0x55f086a3bb30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 -- 172.21.15.87:0/2691400558 >> 172.21.15.87:0/2691400558 conn(0x55f086a2f7b0 msgr2=0x55f086a2fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 -- 172.21.15.87:0/2691400558 shutdown_connections 2024-05-08T18:31:16.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.789+0000 7fd07d887800 1 -- 172.21.15.87:0/2691400558 wait complete. 2024-05-08T18:31:16.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.790+0000 7fd07d887800 1 -- 172.21.15.87:0/4002088102 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f086a2aba0 msgr2=0x55f086a2cf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.790+0000 7fd07d887800 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f086a2aba0 0x55f086a2cf90 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.790+0000 7fd07d887800 1 -- 172.21.15.87:0/4002088102 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f08692b850 msgr2=0x55f086a27420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.790+0000 7fd07d887800 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f08692b850 0x55f086a27420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.790+0000 7fd07d887800 1 -- 172.21.15.87:0/4002088102 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcf6003bba0 msgr2=0x7fcf6003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.790+0000 7fd07d887800 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcf6003bba0 0x7fcf6003e060 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd064054000 tx=0x7fd06404e000 comp rx=0 tx=0).stop 2024-05-08T18:31:16.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.790+0000 7fd07d887800 1 -- 172.21.15.87:0/4002088102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086927d40 msgr2=0x55f086a201e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.790+0000 7fd07d887800 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086927d40 0x55f086a201e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd06c00c010 tx=0x7fd06c000ed0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.790+0000 7fd07d887800 1 -- 172.21.15.87:0/4002088102 shutdown_connections 2024-05-08T18:31:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.790+0000 7fd07d887800 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f08692b850 0x55f086a27420 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.790+0000 7fd07d887800 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f086a2aba0 0x55f086a2cf90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.790+0000 7fd07d887800 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fcf6003bba0 0x7fcf6003e060 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.790+0000 7fd07d887800 1 --2- 172.21.15.87:0/4002088102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f086927d40 0x55f086a201e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.790+0000 7fd07d887800 1 -- 172.21.15.87:0/4002088102 >> 172.21.15.87:0/4002088102 conn(0x55f086921710 msgr2=0x55f086a12780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.790+0000 7fd07d887800 1 -- 172.21.15.87:0/4002088102 shutdown_connections 2024-05-08T18:31:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.790+0000 7fd07d887800 1 -- 172.21.15.87:0/4002088102 wait complete. 2024-05-08T18:31:16.810 INFO:teuthology.orchestra.run.smithi087.stdout:{"entries":[],"summary":[]} 2024-05-08T18:31:16.810 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-05-08T18:31:16.810 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:31:16.810 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:31:16.811 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:31:16.894 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:16.894 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:16.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.897+0000 7f5bee935800 1 Processor -- start 2024-05-08T18:31:16.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.897+0000 7f5bee935800 1 -- start start 2024-05-08T18:31:16.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.897+0000 7f5bee935800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561bab3f17e0 0x561bab3f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.897+0000 7f5bee935800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561bab3f4110 con 0x561bab3edcd0 2024-05-08T18:31:16.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.897+0000 7f5bee935800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x561bab28de20 con 0x561bab3f17e0 2024-05-08T18:31:16.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.897+0000 7f5be9dad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561bab3f17e0 0x561bab3f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.897+0000 7f5bea5ae640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x561bab3edcd0 0x561bab3f00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41866/0 (socket says 172.21.15.87:41866) 2024-05-08T18:31:16.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.897+0000 7f5bea5ae640 1 -- 172.21.15.87:0/172229074 learned_addr learned my addr 172.21.15.87:0/172229074 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:16.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.897+0000 7f5be9dad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561bab3f17e0 0x561bab3f3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60730/0 (socket says 172.21.15.87:60730) 2024-05-08T18:31:16.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.898+0000 7f5be9dad640 1 -- 172.21.15.87:0/172229074 >> v1:172.21.15.53:6789/0 conn(0x561bab3edcd0 legacy=0x561bab3f00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.898+0000 7f5be9dad640 1 -- 172.21.15.87:0/172229074 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bab3f52f0 con 0x561bab3f17e0 2024-05-08T18:31:16.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.899+0000 7f5be9dad640 1 --2- 172.21.15.87:0/172229074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3f17e0 0x561bab3f3bd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400a470 tx=0x7f5bd401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e1403374f84b27 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.900+0000 7f5be95ac640 1 -- 172.21.15.87:0/172229074 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd4057070 con 0x561bab3f17e0 2024-05-08T18:31:16.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.900+0000 7f5be95ac640 1 -- 172.21.15.87:0/172229074 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd4052570 con 0x561bab3f17e0 2024-05-08T18:31:16.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.900+0000 7f5be95ac640 1 -- 172.21.15.87:0/172229074 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd4052870 con 0x561bab3f17e0 2024-05-08T18:31:16.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.900+0000 7f5bee935800 1 -- 172.21.15.87:0/172229074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3f17e0 msgr2=0x561bab3f3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.900+0000 7f5bee935800 1 --2- 172.21.15.87:0/172229074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3f17e0 0x561bab3f3bd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400a470 tx=0x7f5bd401ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:16.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.900+0000 7f5bee935800 1 -- 172.21.15.87:0/172229074 shutdown_connections 2024-05-08T18:31:16.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.900+0000 7f5bee935800 1 --2- 172.21.15.87:0/172229074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3f17e0 0x561bab3f3bd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.900+0000 7f5bee935800 1 -- 172.21.15.87:0/172229074 >> 172.21.15.87:0/172229074 conn(0x561bab3e7720 msgr2=0x561bab3e9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.900+0000 7f5bee935800 1 -- 172.21.15.87:0/172229074 shutdown_connections 2024-05-08T18:31:16.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.900+0000 7f5bee935800 1 -- 172.21.15.87:0/172229074 wait complete. 2024-05-08T18:31:16.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.913+0000 7f5bee935800 1 Processor -- start 2024-05-08T18:31:16.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.913+0000 7f5bee935800 1 -- start start 2024-05-08T18:31:16.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.913+0000 7f5bee935800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3edcd0 0x561bab3ed610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.914+0000 7f5bee935800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561bab3385b0 con 0x561bab3edcd0 2024-05-08T18:31:16.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.914+0000 7f5bea5ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3edcd0 0x561bab3ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.914+0000 7f5bea5ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3edcd0 0x561bab3ed610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60740/0 (socket says 172.21.15.87:60740) 2024-05-08T18:31:16.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.914+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1914485083 learned_addr learned my addr 172.21.15.87:0/1914485083 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.914+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1914485083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bab3ebbd0 con 0x561bab3edcd0 2024-05-08T18:31:16.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.914+0000 7f5bea5ae640 1 --2- 172.21.15.87:0/1914485083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3edcd0 0x561bab3ed610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc001de0 tx=0x7f5bdc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548de0320abdc1c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.914+0000 7f5ad8608640 1 -- 172.21.15.87:0/1914485083 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bdc012020 con 0x561bab3edcd0 2024-05-08T18:31:16.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.914+0000 7f5ad8608640 1 -- 172.21.15.87:0/1914485083 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bdc00e5a0 con 0x561bab3edcd0 2024-05-08T18:31:16.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.914+0000 7f5ad8608640 1 -- 172.21.15.87:0/1914485083 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bdc00e8c0 con 0x561bab3edcd0 2024-05-08T18:31:16.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.915+0000 7f5bee935800 1 -- 172.21.15.87:0/1914485083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3edcd0 msgr2=0x561bab3ed610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.915+0000 7f5bee935800 1 --2- 172.21.15.87:0/1914485083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3edcd0 0x561bab3ed610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc001de0 tx=0x7f5bdc00b6c0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.915+0000 7f5bee935800 1 -- 172.21.15.87:0/1914485083 shutdown_connections 2024-05-08T18:31:16.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.915+0000 7f5bee935800 1 --2- 172.21.15.87:0/1914485083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3edcd0 0x561bab3ed610 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.915+0000 7f5bee935800 1 -- 172.21.15.87:0/1914485083 >> 172.21.15.87:0/1914485083 conn(0x561bab3e7720 msgr2=0x561bab4d9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.915+0000 7f5bee935800 1 -- 172.21.15.87:0/1914485083 shutdown_connections 2024-05-08T18:31:16.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.915+0000 7f5bee935800 1 -- 172.21.15.87:0/1914485083 wait complete. 2024-05-08T18:31:16.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.915+0000 7f5bee935800 1 Processor -- start 2024-05-08T18:31:16.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.915+0000 7f5bee935800 1 -- start start 2024-05-08T18:31:16.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.916+0000 7f5bee935800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3edcd0 0x561bab4e8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.916+0000 7f5bee935800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561bab3f45e0 con 0x561bab3edcd0 2024-05-08T18:31:16.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.916+0000 7f5bea5ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3edcd0 0x561bab4e8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.916+0000 7f5bea5ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3edcd0 0x561bab4e8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60750/0 (socket says 172.21.15.87:60750) 2024-05-08T18:31:16.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.916+0000 7f5bea5ae640 1 -- 172.21.15.87:0/429009941 learned_addr learned my addr 172.21.15.87:0/429009941 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.916+0000 7f5bea5ae640 1 -- 172.21.15.87:0/429009941 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bab4e8940 con 0x561bab3edcd0 2024-05-08T18:31:16.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.916+0000 7f5bea5ae640 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3edcd0 0x561bab4e8400 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c010 tx=0x7f5bdc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.916+0000 7f5ad6e05640 1 -- 172.21.15.87:0/429009941 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bdc012070 con 0x561bab3edcd0 2024-05-08T18:31:16.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.916+0000 7f5ad6e05640 1 -- 172.21.15.87:0/429009941 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bdc01a7a0 con 0x561bab3edcd0 2024-05-08T18:31:16.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.916+0000 7f5bee935800 1 -- 172.21.15.87:0/429009941 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561bab4e8bd0 con 0x561bab3edcd0 2024-05-08T18:31:16.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.916+0000 7f5ad6e05640 1 -- 172.21.15.87:0/429009941 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bdc01aa80 con 0x561bab3edcd0 2024-05-08T18:31:16.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.916+0000 7f5bee935800 1 -- 172.21.15.87:0/429009941 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bab4eb830 con 0x561bab3edcd0 2024-05-08T18:31:16.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.917+0000 7f5ad6e05640 1 -- 172.21.15.87:0/429009941 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5bdc015020 con 0x561bab3edcd0 2024-05-08T18:31:16.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.917+0000 7f5ad6e05640 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ad003bba0 0x7f5ad003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.917+0000 7f5ad6e05640 1 -- 172.21.15.87:0/429009941 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5bdc020070 con 0x561bab3edcd0 2024-05-08T18:31:16.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.917+0000 7f5be9dad640 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ad003bba0 0x7f5ad003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.918+0000 7f5bee935800 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561bab3f17e0 0x561bab4ef5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.918+0000 7f5bee935800 1 -- 172.21.15.87:0/429009941 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab4efb30 con 0x561bab3f17e0 2024-05-08T18:31:16.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.918+0000 7f5beadaf640 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561bab3f17e0 0x561bab4ef5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.918+0000 7f5be9dad640 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ad003bba0 0x7f5ad003e060 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4054000 tx=0x7f5bd404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.918+0000 7f5beadaf640 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561bab3f17e0 0x561bab4ef5f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.918+0000 7f5beadaf640 1 -- 172.21.15.87:0/429009941 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5be400a4a0 con 0x561bab3f17e0 2024-05-08T18:31:16.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.918+0000 7f5bee935800 1 -- 172.21.15.87:0/429009941 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab4ecbc0 con 0x561bab3f17e0 2024-05-08T18:31:16.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.919+0000 7f5beadaf640 1 -- 172.21.15.87:0/429009941 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5be400a4a0 con 0x561bab3f17e0 2024-05-08T18:31:16.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.919+0000 7f5bee935800 1 -- 172.21.15.87:0/429009941 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab4f19c0 con 0x561bab3f17e0 2024-05-08T18:31:16.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.919+0000 7f5beadaf640 1 -- 172.21.15.87:0/429009941 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5be400a4a0 con 0x561bab3f17e0 2024-05-08T18:31:16.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.919+0000 7f5bee935800 1 -- 172.21.15.87:0/429009941 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab4f0b00 con 0x561bab3f17e0 2024-05-08T18:31:16.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.919+0000 7f5beadaf640 1 -- 172.21.15.87:0/429009941 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5be400a4a0 con 0x561bab3f17e0 2024-05-08T18:31:16.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.919+0000 7f5bee935800 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561bab4f15d0 0x561bab4f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.919+0000 7f5bee935800 1 -- 172.21.15.87:0/429009941 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab4f55e0 con 0x561bab4f15d0 2024-05-08T18:31:16.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.919+0000 7f5bea5ae640 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561bab4f15d0 0x561bab4f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.920+0000 7f5bea5ae640 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561bab4f15d0 0x561bab4f4e50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.920+0000 7f5bea5ae640 1 -- 172.21.15.87:0/429009941 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5bdc02b070 con 0x561bab4f15d0 2024-05-08T18:31:16.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.920+0000 7f5bee935800 1 Processor -- start 2024-05-08T18:31:16.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.920+0000 7f5bee935800 1 -- start start 2024-05-08T18:31:16.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.921+0000 7f5bee935800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab503930 0x561bab503d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.921+0000 7f5bee935800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561bab2defc0 con 0x561bab503930 2024-05-08T18:31:16.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.921+0000 7f5beadaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab503930 0x561bab503d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.921+0000 7f5beadaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab503930 0x561bab503d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60766/0 (socket says 172.21.15.87:60766) 2024-05-08T18:31:16.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.921+0000 7f5beadaf640 1 -- 172.21.15.87:0/912877107 learned_addr learned my addr 172.21.15.87:0/912877107 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.921+0000 7f5beadaf640 1 -- 172.21.15.87:0/912877107 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bab504290 con 0x561bab503930 2024-05-08T18:31:16.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.921+0000 7f5beadaf640 1 --2- 172.21.15.87:0/912877107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab503930 0x561bab503d50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x561bab4eff30 tx=0x7f5be40178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.921+0000 7f5acffff640 1 -- 172.21.15.87:0/912877107 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be4013440 con 0x561bab503930 2024-05-08T18:31:16.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.921+0000 7f5acffff640 1 -- 172.21.15.87:0/912877107 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5be40135e0 con 0x561bab503930 2024-05-08T18:31:16.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.921+0000 7f5bee935800 1 -- 172.21.15.87:0/912877107 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561bab504d00 con 0x561bab503930 2024-05-08T18:31:16.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.921+0000 7f5acffff640 1 -- 172.21.15.87:0/912877107 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be40138c0 con 0x561bab503930 2024-05-08T18:31:16.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.921+0000 7f5bee935800 1 -- 172.21.15.87:0/912877107 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bab505200 con 0x561bab503930 2024-05-08T18:31:16.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.922+0000 7f5acffff640 1 -- 172.21.15.87:0/912877107 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5be4011040 con 0x561bab503930 2024-05-08T18:31:16.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.922+0000 7f5acffff640 1 --2- 172.21.15.87:0/912877107 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ac403bba0 0x7f5ac403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.922+0000 7f5acffff640 1 -- 172.21.15.87:0/912877107 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5be401d070 con 0x561bab503930 2024-05-08T18:31:16.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.922+0000 7f5bea5ae640 1 --2- 172.21.15.87:0/912877107 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ac403bba0 0x7f5ac403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.923+0000 7f5bee935800 1 Processor -- start 2024-05-08T18:31:16.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.923+0000 7f5bea5ae640 1 --2- 172.21.15.87:0/912877107 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ac403bba0 0x7f5ac403e060 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc022b30 tx=0x7f5bdc050ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.923+0000 7f5bee935800 1 -- start start 2024-05-08T18:31:16.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.923+0000 7f5bee935800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab510bf0 0x561bab511010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.923+0000 7f5bee935800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561bab3ebf50 con 0x561bab510bf0 2024-05-08T18:31:16.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.923+0000 7f5beadaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab510bf0 0x561bab511010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.923+0000 7f5beadaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab510bf0 0x561bab511010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60778/0 (socket says 172.21.15.87:60778) 2024-05-08T18:31:16.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.923+0000 7f5beadaf640 1 -- 172.21.15.87:0/1581268745 learned_addr learned my addr 172.21.15.87:0/1581268745 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.923+0000 7f5beadaf640 1 -- 172.21.15.87:0/1581268745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bab5115e0 con 0x561bab510bf0 2024-05-08T18:31:16.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.923+0000 7f5beadaf640 1 --2- 172.21.15.87:0/1581268745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab510bf0 0x561bab511010 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5be40528c0 tx=0x7f5be4001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e8229092ce11d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.924+0000 7f5acdffb640 1 -- 172.21.15.87:0/1581268745 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be404f070 con 0x561bab510bf0 2024-05-08T18:31:16.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.924+0000 7f5acdffb640 1 -- 172.21.15.87:0/1581268745 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5be402ad80 con 0x561bab510bf0 2024-05-08T18:31:16.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.924+0000 7f5acdffb640 1 -- 172.21.15.87:0/1581268745 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be4021d70 con 0x561bab510bf0 2024-05-08T18:31:16.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.924+0000 7f5bee935800 1 -- 172.21.15.87:0/1581268745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab510bf0 msgr2=0x561bab511010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.924+0000 7f5bee935800 1 --2- 172.21.15.87:0/1581268745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab510bf0 0x561bab511010 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5be40528c0 tx=0x7f5be4001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:16.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.924+0000 7f5bee935800 1 -- 172.21.15.87:0/1581268745 shutdown_connections 2024-05-08T18:31:16.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.924+0000 7f5bee935800 1 --2- 172.21.15.87:0/1581268745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab510bf0 0x561bab511010 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.924+0000 7f5bee935800 1 -- 172.21.15.87:0/1581268745 >> 172.21.15.87:0/1581268745 conn(0x561bab50cec0 msgr2=0x561bab50af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.924+0000 7f5bee935800 1 -- 172.21.15.87:0/1581268745 shutdown_connections 2024-05-08T18:31:16.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.924+0000 7f5bee935800 1 -- 172.21.15.87:0/1581268745 wait complete. 2024-05-08T18:31:16.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.924+0000 7f5bee935800 1 Processor -- start 2024-05-08T18:31:16.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.924+0000 7f5bee935800 1 -- start start 2024-05-08T18:31:16.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.925+0000 7f5bee935800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab510bf0 0x561bab518130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.925+0000 7f5bee935800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561bab511da0 con 0x561bab510bf0 2024-05-08T18:31:16.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.925+0000 7f5beadaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab510bf0 0x561bab518130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.925+0000 7f5beadaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab510bf0 0x561bab518130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60788/0 (socket says 172.21.15.87:60788) 2024-05-08T18:31:16.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.925+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 learned_addr learned my addr 172.21.15.87:0/1545740803 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.925+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bab518670 con 0x561bab510bf0 2024-05-08T18:31:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.925+0000 7f5beadaf640 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab510bf0 0x561bab518130 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5be4015fd0 tx=0x7f5be4018f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.925+0000 7f5abbfff640 1 -- 172.21.15.87:0/1545740803 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be4030020 con 0x561bab510bf0 2024-05-08T18:31:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.925+0000 7f5abbfff640 1 -- 172.21.15.87:0/1545740803 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5be40158e0 con 0x561bab510bf0 2024-05-08T18:31:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.925+0000 7f5abbfff640 1 -- 172.21.15.87:0/1545740803 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be4013a60 con 0x561bab510bf0 2024-05-08T18:31:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.925+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561bab518900 con 0x561bab510bf0 2024-05-08T18:31:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.925+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bab51b5b0 con 0x561bab510bf0 2024-05-08T18:31:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.926+0000 7f5abbfff640 1 -- 172.21.15.87:0/1545740803 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5be4033020 con 0x561bab510bf0 2024-05-08T18:31:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.926+0000 7f5abbfff640 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ab403bba0 0x7f5ab403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.927+0000 7f5abbfff640 1 -- 172.21.15.87:0/1545740803 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5be400e040 con 0x561bab510bf0 2024-05-08T18:31:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.927+0000 7f5bea5ae640 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ab403bba0 0x7f5ab403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.927+0000 7f5bee935800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.927+0000 7f5bee935800 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561bab523e00 0x561bab5262c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.927+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab526a10 con 0x561bab523e00 2024-05-08T18:31:16.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.927+0000 7f5bea5ae640 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ab403bba0 0x7f5ab403e060 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc02cfd0 tx=0x7f5bdc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.927+0000 7f5be9dad640 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561bab523e00 0x561bab5262c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.927+0000 7f5be9dad640 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561bab523e00 0x561bab5262c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.927+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.927+0000 7f5bee935800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5bee935800 20 realm 2024-05-08T18:31:16.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5bee935800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab526de0 con 0x561bab523e00 2024-05-08T18:31:16.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5bee935800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5bee935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:16.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5bee935800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab5276b0 con 0x561bab523e00 2024-05-08T18:31:16.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5bee935800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5bee935800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab527a50 con 0x561bab523e00 2024-05-08T18:31:16.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5bee935800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:16.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5bee935800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab527e70 con 0x561bab523e00 2024-05-08T18:31:16.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5bee935800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:16.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5bee935800 20 searching for the correct realm 2024-05-08T18:31:16.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5bee935800 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561bab529e70 0x561bab52c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.928+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x561bab529e70 2024-05-08T18:31:16.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.929+0000 7f5beadaf640 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561bab529e70 0x561bab52c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.929+0000 7f5beadaf640 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561bab529e70 0x561bab52c2c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.929+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be4029070 con 0x561bab529e70 2024-05-08T18:31:16.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.929+0000 7f5beadaf640 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5be4035020 0x7f5be4014210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.929+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x7f5be4035020 2024-05-08T18:31:16.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.929+0000 7f5bea5ae640 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5be4035020 0x7f5be4014210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.930+0000 7f5bea5ae640 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5be4035020 0x7f5be4014210 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.930+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1545740803 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bdc02b070 con 0x7f5be4035020 2024-05-08T18:31:16.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.930+0000 7f5bea5ae640 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f5bdc03c040 0x7f5bdc052a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:16.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.930+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x7f5bdc03c040 2024-05-08T18:31:16.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.930+0000 7f5be9dad640 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f5bdc03c040 0x7f5bdc052a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:16.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.931+0000 7f5be9dad640 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f5bdc03c040 0x7f5bdc052a80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:16.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.931+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.931+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x561bab523e00 2024-05-08T18:31:16.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.931+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.931+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x561bab523e00 2024-05-08T18:31:16.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.931+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.931+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x7f5bdc03c040 2024-05-08T18:31:16.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.931+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.931+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x7f5bdc03c040 2024-05-08T18:31:16.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.932+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.932+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x7f5be4035020 2024-05-08T18:31:16.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.932+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1545740803 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bdc02b070 con 0x7f5be4035020 2024-05-08T18:31:16.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.932+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x561bab529e70 2024-05-08T18:31:16.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.932+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be4029070 con 0x561bab529e70 2024-05-08T18:31:16.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.932+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x561bab523e00 2024-05-08T18:31:16.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.932+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.932+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x7f5bdc03c040 2024-05-08T18:31:16.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.933+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.933+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x561bab523e00 2024-05-08T18:31:16.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.933+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.933+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x7f5be4035020 2024-05-08T18:31:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.933+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1545740803 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5bdc02b070 con 0x7f5be4035020 2024-05-08T18:31:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.933+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x561bab529e70 2024-05-08T18:31:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.933+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be4029070 con 0x561bab529e70 2024-05-08T18:31:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.933+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x561bab529e70 2024-05-08T18:31:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.934+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be4029070 con 0x561bab529e70 2024-05-08T18:31:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.934+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x7f5bdc03c040 2024-05-08T18:31:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.934+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.934+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x561bab529e70 2024-05-08T18:31:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.934+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be4029070 con 0x561bab529e70 2024-05-08T18:31:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.934+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x561bab529e70 2024-05-08T18:31:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.935+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be4029070 con 0x561bab529e70 2024-05-08T18:31:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.935+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x561bab523e00 2024-05-08T18:31:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.935+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.935+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x561bab523e00 2024-05-08T18:31:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.935+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.935+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x7f5bdc03c040 2024-05-08T18:31:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.935+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.935+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x561bab529e70 2024-05-08T18:31:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.936+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be4029070 con 0x561bab529e70 2024-05-08T18:31:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.936+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x7f5be4035020 2024-05-08T18:31:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.936+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1545740803 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bdc02b070 con 0x7f5be4035020 2024-05-08T18:31:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.936+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x561bab523e00 2024-05-08T18:31:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.936+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.936+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x7f5bdc03c040 2024-05-08T18:31:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.937+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.937+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x561bab529e70 2024-05-08T18:31:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.937+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be4029070 con 0x561bab529e70 2024-05-08T18:31:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.937+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x7f5bdc03c040 2024-05-08T18:31:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.937+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.937+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x7f5be4035020 2024-05-08T18:31:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.937+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1545740803 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bdc02b070 con 0x7f5be4035020 2024-05-08T18:31:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.937+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x561bab529e70 2024-05-08T18:31:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.938+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be4029070 con 0x561bab529e70 2024-05-08T18:31:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.938+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x7f5bdc03c040 2024-05-08T18:31:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.938+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.938+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x561bab523e00 2024-05-08T18:31:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561bab52c990 con 0x7f5be4035020 2024-05-08T18:31:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1545740803 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bdc02b070 con 0x7f5be4035020 2024-05-08T18:31:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5bee935800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5bee935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5bee935800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5bee935800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5bee935800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:16.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5bee935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:16.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5bee935800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab528910 con 0x561bab523e00 2024-05-08T18:31:16.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5bee935800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5bee935800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab5291b0 con 0x561bab523e00 2024-05-08T18:31:16.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5bee935800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:16.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5bee935800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.939+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab528550 con 0x7f5bdc03c040 2024-05-08T18:31:16.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5bee935800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5bee935800 20 zone default found 2024-05-08T18:31:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5bee935800 4 Realm: () 2024-05-08T18:31:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5bee935800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5bee935800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5bee935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5bee935800 20 zonegroup default 2024-05-08T18:31:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5bee935800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab52ce60 con 0x7f5bdc03c040 2024-05-08T18:31:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5bee935800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5bee935800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab52ecf0 con 0x561bab529e70 2024-05-08T18:31:16.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5be4029070 con 0x561bab529e70 2024-05-08T18:31:16.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5bee935800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5bee935800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.940+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab52f090 con 0x561bab529e70 2024-05-08T18:31:16.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.941+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5be4029070 con 0x561bab529e70 2024-05-08T18:31:16.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.941+0000 7f5bee935800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.941+0000 7f5bee935800 20 started sync module instance, tier type = 2024-05-08T18:31:16.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.941+0000 7f5bee935800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:16.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.941+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab52e130 con 0x7f5be4035020 2024-05-08T18:31:16.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.942+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1545740803 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc02b070 con 0x7f5be4035020 2024-05-08T18:31:16.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.942+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94676838442320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab52f8e0 con 0x7f5be4035020 2024-05-08T18:31:16.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.942+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab530130 con 0x561bab523e00 2024-05-08T18:31:16.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.943+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.943+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94676838448256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab530670 con 0x561bab523e00 2024-05-08T18:31:16.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.943+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab531190 con 0x561bab529e70 2024-05-08T18:31:16.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.944+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1545740803 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94676838442320] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc02b070 con 0x7f5be4035020 2024-05-08T18:31:16.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.944+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be4029070 con 0x561bab529e70 2024-05-08T18:31:16.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.944+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94676838452320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab531580 con 0x561bab529e70 2024-05-08T18:31:16.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.944+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab531fb0 con 0x7f5be4035020 2024-05-08T18:31:16.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.944+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94676838448256] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.945+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94676838452320] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be4029070 con 0x561bab529e70 2024-05-08T18:31:16.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.945+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1545740803 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc02b070 con 0x7f5be4035020 2024-05-08T18:31:16.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.945+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94676838446128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab531ac0 con 0x7f5be4035020 2024-05-08T18:31:16.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.945+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab532970 con 0x561bab523e00 2024-05-08T18:31:16.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.947+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.947+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94676838459040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab533110 con 0x561bab523e00 2024-05-08T18:31:16.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.947+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab533c30 con 0x7f5bdc03c040 2024-05-08T18:31:16.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.949+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1545740803 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94676838446128] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc02b070 con 0x7f5be4035020 2024-05-08T18:31:16.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.949+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.949+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94676838463232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab533bf0 con 0x7f5bdc03c040 2024-05-08T18:31:16.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.949+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab534690 con 0x7f5bdc03c040 2024-05-08T18:31:16.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.951+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94676838459040] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.951+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94676838463232] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.954+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.954+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94676838449376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab532b60 con 0x7f5bdc03c040 2024-05-08T18:31:16.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.954+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab534b40 con 0x7f5bdc03c040 2024-05-08T18:31:16.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.955+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94676838449376] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.955+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.955+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94676838465984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab534b40 con 0x7f5bdc03c040 2024-05-08T18:31:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.955+0000 7f5bee935800 20 add_watcher() i=0 2024-05-08T18:31:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.955+0000 7f5bee935800 20 add_watcher() i=1 2024-05-08T18:31:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.955+0000 7f5bee935800 20 add_watcher() i=2 2024-05-08T18:31:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.955+0000 7f5bee935800 20 add_watcher() i=3 2024-05-08T18:31:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.955+0000 7f5bee935800 20 add_watcher() i=4 2024-05-08T18:31:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.955+0000 7f5bee935800 20 add_watcher() i=5 2024-05-08T18:31:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.955+0000 7f5bee935800 20 add_watcher() i=6 2024-05-08T18:31:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.956+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94676838465984] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.956+0000 7f5bee935800 20 add_watcher() i=7 2024-05-08T18:31:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.956+0000 7f5bee935800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.956+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab537f40 con 0x561bab523e00 2024-05-08T18:31:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.956+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.956+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94676838467680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab535460 con 0x561bab523e00 2024-05-08T18:31:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.957+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94676838467680] v27'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.957+0000 7f5aa0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.957+0000 7f5bee935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.957+0000 7f5bee935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.957+0000 7f5bee935800 5 note: GC not initialized 2024-05-08T18:31:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.958+0000 7f5a1b7fe640 20 reqs_thread_entry: start 2024-05-08T18:31:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.958+0000 7f5bee935800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:16.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.958+0000 7f5bee935800 20 Filter name: none 2024-05-08T18:31:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.958+0000 7f5a197fa640 20 reqs_thread_entry: start 2024-05-08T18:31:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.958+0000 7f5bee935800 20 rados->read ofs=0 len=0 2024-05-08T18:31:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.958+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561bab56ae70 con 0x561bab523e00 2024-05-08T18:31:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.958+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.958+0000 7f5bee935800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:could not fetch user info: no user info saved 2024-05-08T18:31:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.959+0000 7f5aa0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.959+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94676838467680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab56ae30 con 0x561bab523e00 2024-05-08T18:31:16.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.960+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94676838467680] v27'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.960+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94676838442320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab56ae30 con 0x7f5be4035020 2024-05-08T18:31:16.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.961+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1545740803 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94676838442320] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc02b070 con 0x7f5be4035020 2024-05-08T18:31:16.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.961+0000 7f5bee935800 20 remove_watcher() i=0 2024-05-08T18:31:16.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.961+0000 7f5bee935800 2 removed watcher, disabling cache 2024-05-08T18:31:16.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.961+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94676838448256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab56ae30 con 0x561bab523e00 2024-05-08T18:31:16.979 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-08T18:31:16.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.962+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94676838448256] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.962+0000 7f5bee935800 20 remove_watcher() i=1 2024-05-08T18:31:16.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.962+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94676838452320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab56ae30 con 0x561bab529e70 2024-05-08T18:31:16.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.964+0000 7f5beadaf640 1 -- 172.21.15.87:0/1545740803 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94676838452320] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be4029070 con 0x561bab529e70 2024-05-08T18:31:16.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.964+0000 7f5bee935800 20 remove_watcher() i=2 2024-05-08T18:31:16.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.964+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94676838446128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab56ae30 con 0x7f5be4035020 2024-05-08T18:31:16.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.965+0000 7f5bea5ae640 1 -- 172.21.15.87:0/1545740803 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94676838446128] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc02b070 con 0x7f5be4035020 2024-05-08T18:31:16.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.965+0000 7f5bee935800 20 remove_watcher() i=3 2024-05-08T18:31:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.965+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94676838459040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab56ae30 con 0x561bab523e00 2024-05-08T18:31:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.967+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94676838459040] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x561bab523e00 2024-05-08T18:31:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.967+0000 7f5bee935800 20 remove_watcher() i=4 2024-05-08T18:31:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.967+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94676838463232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab56ae30 con 0x7f5bdc03c040 2024-05-08T18:31:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.968+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94676838463232] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.968+0000 7f5bee935800 20 remove_watcher() i=5 2024-05-08T18:31:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.968+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94676838449376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab56ae30 con 0x7f5bdc03c040 2024-05-08T18:31:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.969+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94676838449376] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.969+0000 7f5bee935800 20 remove_watcher() i=6 2024-05-08T18:31:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.969+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94676838465984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561bab56ae30 con 0x7f5bdc03c040 2024-05-08T18:31:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94676838465984] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd405a040 con 0x7f5bdc03c040 2024-05-08T18:31:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 20 remove_watcher() i=7 2024-05-08T18:31:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f5bdc03c040 msgr2=0x7f5bdc052a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f5bdc03c040 0x7f5bdc052a80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561bab523e00 msgr2=0x561bab5262c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561bab523e00 0x561bab5262c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5be4035020 msgr2=0x7f5be4014210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5be4035020 0x7f5be4014210 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561bab529e70 msgr2=0x561bab52c2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561bab529e70 0x561bab52c2c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ab403bba0 msgr2=0x7f5ab403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ab403bba0 0x7f5ab403e060 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc02cfd0 tx=0x7f5bdc04e000 comp rx=0 tx=0).stop 2024-05-08T18:31:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab510bf0 msgr2=0x561bab518130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab510bf0 0x561bab518130 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5be4015fd0 tx=0x7f5be4018f90 comp rx=0 tx=0).stop 2024-05-08T18:31:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5be9dad640 1 -- 172.21.15.87:0/1545740803 reap_dead start 2024-05-08T18:31:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 shutdown_connections 2024-05-08T18:31:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 1 --2- 172.21.15.87:0/1545740803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab510bf0 0x561bab518130 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 >> 172.21.15.87:0/1545740803 conn(0x561bab50cec0 msgr2=0x561bab50aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 shutdown_connections 2024-05-08T18:31:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.970+0000 7f5bee935800 1 -- 172.21.15.87:0/1545740803 wait complete. 2024-05-08T18:31:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 -- 172.21.15.87:0/912877107 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ac403bba0 msgr2=0x7f5ac403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 --2- 172.21.15.87:0/912877107 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ac403bba0 0x7f5ac403e060 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc022b30 tx=0x7f5bdc050ca0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 -- 172.21.15.87:0/912877107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab503930 msgr2=0x561bab503d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 --2- 172.21.15.87:0/912877107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab503930 0x561bab503d50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x561bab4eff30 tx=0x7f5be40178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 -- 172.21.15.87:0/912877107 shutdown_connections 2024-05-08T18:31:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 --2- 172.21.15.87:0/912877107 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ac403bba0 0x7f5ac403e060 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 --2- 172.21.15.87:0/912877107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab503930 0x561bab503d50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 -- 172.21.15.87:0/912877107 >> 172.21.15.87:0/912877107 conn(0x561bab4f79d0 msgr2=0x561bab4f7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 -- 172.21.15.87:0/912877107 shutdown_connections 2024-05-08T18:31:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 -- 172.21.15.87:0/912877107 wait complete. 2024-05-08T18:31:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 -- 172.21.15.87:0/429009941 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561bab4f15d0 msgr2=0x561bab4f4e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561bab4f15d0 0x561bab4f4e50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 -- 172.21.15.87:0/429009941 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561bab3f17e0 msgr2=0x561bab4ef5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561bab3f17e0 0x561bab4ef5f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 -- 172.21.15.87:0/429009941 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ad003bba0 msgr2=0x7f5ad003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ad003bba0 0x7f5ad003e060 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4054000 tx=0x7f5bd404e000 comp rx=0 tx=0).stop 2024-05-08T18:31:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 -- 172.21.15.87:0/429009941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3edcd0 msgr2=0x561bab4e8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3edcd0 0x561bab4e8400 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c010 tx=0x7f5bdc000ed0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 -- 172.21.15.87:0/429009941 shutdown_connections 2024-05-08T18:31:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561bab3f17e0 0x561bab4ef5f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561bab4f15d0 0x561bab4f4e50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ad003bba0 0x7f5ad003e060 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 --2- 172.21.15.87:0/429009941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bab3edcd0 0x561bab4e8400 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 -- 172.21.15.87:0/429009941 >> 172.21.15.87:0/429009941 conn(0x561bab3e7720 msgr2=0x561bab3ec4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 -- 172.21.15.87:0/429009941 shutdown_connections 2024-05-08T18:31:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:16.971+0000 7f5bee935800 1 -- 172.21.15.87:0/429009941 wait complete. 2024-05-08T18:31:16.985 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-05-08T18:31:16.985 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-05-08T18:31:16.986 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-05-08T18:31:17.040 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:17.040 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:17.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.042+0000 7ff82691f800 1 Processor -- start 2024-05-08T18:31:17.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.042+0000 7ff82691f800 1 -- start start 2024-05-08T18:31:17.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.043+0000 7ff82691f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a6fa3bd6e0 0x55a6fa3bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.043+0000 7ff82691f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a6fa3c00a0 con 0x55a6fa3b92f0 2024-05-08T18:31:17.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.043+0000 7ff82691f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55a6fa259e20 con 0x55a6fa3bd6e0 2024-05-08T18:31:17.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.043+0000 7ff81bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a6fa3bd6e0 0x55a6fa3bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.043+0000 7ff81bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a6fa3bd6e0 0x55a6fa3bfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60804/0 (socket says 172.21.15.87:60804) 2024-05-08T18:31:17.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.043+0000 7ff81bfff640 1 -- 172.21.15.87:0/2878812357 learned_addr learned my addr 172.21.15.87:0/2878812357 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.043+0000 7ff821ddf640 1 -- 172.21.15.87:0/2878812357 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1280589087 0 0) 0x55a6fa3c00a0 con 0x55a6fa3b92f0 2024-05-08T18:31:17.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.043+0000 7ff821ddf640 1 -- 172.21.15.87:0/2878812357 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff810001e10 con 0x55a6fa3b92f0 2024-05-08T18:31:17.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.043+0000 7ff81bfff640 1 -- 172.21.15.87:0/2878812357 >> v1:172.21.15.53:6789/0 conn(0x55a6fa3b92f0 legacy=0x55a6fa3b9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.043+0000 7ff81bfff640 1 -- 172.21.15.87:0/2878812357 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6fa3c12d0 con 0x55a6fa3bd6e0 2024-05-08T18:31:17.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.045+0000 7ff81bfff640 1 --2- 172.21.15.87:0/2878812357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3bd6e0 0x55a6fa3bfad0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff80c00a520 tx=0x7ff80c01cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c0d8cbc0b0820b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.045+0000 7ff821ddf640 1 -- 172.21.15.87:0/2878812357 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff80c057070 con 0x55a6fa3bd6e0 2024-05-08T18:31:17.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.045+0000 7ff821ddf640 1 -- 172.21.15.87:0/2878812357 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80c052570 con 0x55a6fa3bd6e0 2024-05-08T18:31:17.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.045+0000 7ff821ddf640 1 -- 172.21.15.87:0/2878812357 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff80c052850 con 0x55a6fa3bd6e0 2024-05-08T18:31:17.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.046+0000 7ff82691f800 1 -- 172.21.15.87:0/2878812357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3bd6e0 msgr2=0x55a6fa3bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.046+0000 7ff82691f800 1 --2- 172.21.15.87:0/2878812357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3bd6e0 0x55a6fa3bfad0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff80c00a520 tx=0x7ff80c01cf30 comp rx=0 tx=0).stop 2024-05-08T18:31:17.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.046+0000 7ff82691f800 1 -- 172.21.15.87:0/2878812357 shutdown_connections 2024-05-08T18:31:17.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.046+0000 7ff82691f800 1 --2- 172.21.15.87:0/2878812357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3bd6e0 0x55a6fa3bfad0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.046+0000 7ff82691f800 1 -- 172.21.15.87:0/2878812357 >> 172.21.15.87:0/2878812357 conn(0x55a6fa3b4870 msgr2=0x55a6fa3b6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.046+0000 7ff82691f800 1 -- 172.21.15.87:0/2878812357 shutdown_connections 2024-05-08T18:31:17.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.046+0000 7ff82691f800 1 -- 172.21.15.87:0/2878812357 wait complete. 2024-05-08T18:31:17.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.060+0000 7ff82691f800 1 Processor -- start 2024-05-08T18:31:17.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.060+0000 7ff82691f800 1 -- start start 2024-05-08T18:31:17.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.060+0000 7ff82691f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3b92f0 0x55a6fa32ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.060+0000 7ff82691f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a6fa3046b0 con 0x55a6fa3b92f0 2024-05-08T18:31:17.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.060+0000 7ff8225e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3b92f0 0x55a6fa32ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.060+0000 7ff8225e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3b92f0 0x55a6fa32ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60812/0 (socket says 172.21.15.87:60812) 2024-05-08T18:31:17.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.060+0000 7ff8225e0640 1 -- 172.21.15.87:0/158266560 learned_addr learned my addr 172.21.15.87:0/158266560 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.061+0000 7ff8225e0640 1 -- 172.21.15.87:0/158266560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6fa32d270 con 0x55a6fa3b92f0 2024-05-08T18:31:17.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.061+0000 7ff8225e0640 1 --2- 172.21.15.87:0/158266560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3b92f0 0x55a6fa32ecb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff814001d60 tx=0x7ff81400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b6722f912d9fcd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.061+0000 7ff710608640 1 -- 172.21.15.87:0/158266560 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff81400f400 con 0x55a6fa3b92f0 2024-05-08T18:31:17.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.061+0000 7ff710608640 1 -- 172.21.15.87:0/158266560 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff81400f5c0 con 0x55a6fa3b92f0 2024-05-08T18:31:17.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.061+0000 7ff710608640 1 -- 172.21.15.87:0/158266560 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff81400f7b0 con 0x55a6fa3b92f0 2024-05-08T18:31:17.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.062+0000 7ff82691f800 1 -- 172.21.15.87:0/158266560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3b92f0 msgr2=0x55a6fa32ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.062+0000 7ff82691f800 1 --2- 172.21.15.87:0/158266560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3b92f0 0x55a6fa32ecb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff814001d60 tx=0x7ff81400b5b0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.062+0000 7ff82691f800 1 -- 172.21.15.87:0/158266560 shutdown_connections 2024-05-08T18:31:17.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.062+0000 7ff82691f800 1 --2- 172.21.15.87:0/158266560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3b92f0 0x55a6fa32ecb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.062+0000 7ff82691f800 1 -- 172.21.15.87:0/158266560 >> 172.21.15.87:0/158266560 conn(0x55a6fa3b4870 msgr2=0x55a6fa4a5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.062+0000 7ff82691f800 1 -- 172.21.15.87:0/158266560 shutdown_connections 2024-05-08T18:31:17.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.062+0000 7ff82691f800 1 -- 172.21.15.87:0/158266560 wait complete. 2024-05-08T18:31:17.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.062+0000 7ff82691f800 1 Processor -- start 2024-05-08T18:31:17.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.062+0000 7ff82691f800 1 -- start start 2024-05-08T18:31:17.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.062+0000 7ff82691f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3b92f0 0x55a6fa4b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.062+0000 7ff82691f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a6fa3c0570 con 0x55a6fa3b92f0 2024-05-08T18:31:17.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.062+0000 7ff8225e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3b92f0 0x55a6fa4b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.062+0000 7ff8225e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3b92f0 0x55a6fa4b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60814/0 (socket says 172.21.15.87:60814) 2024-05-08T18:31:17.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.062+0000 7ff8225e0640 1 -- 172.21.15.87:0/1243737658 learned_addr learned my addr 172.21.15.87:0/1243737658 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.063+0000 7ff8225e0640 1 -- 172.21.15.87:0/1243737658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6fa4b4780 con 0x55a6fa3b92f0 2024-05-08T18:31:17.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.063+0000 7ff8225e0640 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3b92f0 0x55a6fa4b4240 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55a6fa32e2e0 tx=0x7ff814000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.063+0000 7ff70ee05640 1 -- 172.21.15.87:0/1243737658 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff81401a7c0 con 0x55a6fa3b92f0 2024-05-08T18:31:17.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.063+0000 7ff70ee05640 1 -- 172.21.15.87:0/1243737658 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff81401a960 con 0x55a6fa3b92f0 2024-05-08T18:31:17.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.063+0000 7ff82691f800 1 -- 172.21.15.87:0/1243737658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6fa4b4a10 con 0x55a6fa3b92f0 2024-05-08T18:31:17.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.063+0000 7ff70ee05640 1 -- 172.21.15.87:0/1243737658 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff81401ac60 con 0x55a6fa3b92f0 2024-05-08T18:31:17.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.063+0000 7ff82691f800 1 -- 172.21.15.87:0/1243737658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6fa4b76c0 con 0x55a6fa3b92f0 2024-05-08T18:31:17.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.064+0000 7ff70ee05640 1 -- 172.21.15.87:0/1243737658 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff814017070 con 0x55a6fa3b92f0 2024-05-08T18:31:17.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.064+0000 7ff70ee05640 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff70803bb50 0x7ff70803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.064+0000 7ff70ee05640 1 -- 172.21.15.87:0/1243737658 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff814015020 con 0x55a6fa3b92f0 2024-05-08T18:31:17.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.064+0000 7ff81bfff640 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff70803bb50 0x7ff70803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.064+0000 7ff82691f800 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a6fa3bd6e0 0x55a6fa4bb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.064+0000 7ff82691f800 1 -- 172.21.15.87:0/1243737658 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4bba50 con 0x55a6fa3bd6e0 2024-05-08T18:31:17.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.064+0000 7ff822de1640 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a6fa3bd6e0 0x55a6fa4bb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.065+0000 7ff81bfff640 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff70803bb50 0x7ff70803e010 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff80c054000 tx=0x7ff80c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.065+0000 7ff822de1640 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a6fa3bd6e0 0x55a6fa4bb480 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.065+0000 7ff822de1640 1 -- 172.21.15.87:0/1243737658 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff81c00a4a0 con 0x55a6fa3bd6e0 2024-05-08T18:31:17.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.065+0000 7ff82691f800 1 -- 172.21.15.87:0/1243737658 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4b8a50 con 0x55a6fa3bd6e0 2024-05-08T18:31:17.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.065+0000 7ff822de1640 1 -- 172.21.15.87:0/1243737658 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff81c00a4a0 con 0x55a6fa3bd6e0 2024-05-08T18:31:17.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.065+0000 7ff82691f800 1 -- 172.21.15.87:0/1243737658 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4bd8e0 con 0x55a6fa3bd6e0 2024-05-08T18:31:17.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.066+0000 7ff822de1640 1 -- 172.21.15.87:0/1243737658 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff81c00a4a0 con 0x55a6fa3bd6e0 2024-05-08T18:31:17.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.066+0000 7ff82691f800 1 -- 172.21.15.87:0/1243737658 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4bcb10 con 0x55a6fa3bd6e0 2024-05-08T18:31:17.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.066+0000 7ff822de1640 1 -- 172.21.15.87:0/1243737658 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff81c00a4a0 con 0x55a6fa3bd6e0 2024-05-08T18:31:17.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.066+0000 7ff82691f800 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a6fa4bec90 0x55a6fa4c1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.066+0000 7ff82691f800 1 -- 172.21.15.87:0/1243737658 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4c15c0 con 0x55a6fa4bec90 2024-05-08T18:31:17.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.066+0000 7ff8225e0640 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a6fa4bec90 0x55a6fa4c1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.066+0000 7ff8225e0640 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a6fa4bec90 0x55a6fa4c1080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.067+0000 7ff8225e0640 1 -- 172.21.15.87:0/1243737658 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff81402e070 con 0x55a6fa4bec90 2024-05-08T18:31:17.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.067+0000 7ff82691f800 1 Processor -- start 2024-05-08T18:31:17.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.067+0000 7ff82691f800 1 -- start start 2024-05-08T18:31:17.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.067+0000 7ff82691f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4cf800 0x55a6fa4cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.067+0000 7ff82691f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a6fa2aafc0 con 0x55a6fa4cf800 2024-05-08T18:31:17.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.067+0000 7ff822de1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4cf800 0x55a6fa4cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.067+0000 7ff822de1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4cf800 0x55a6fa4cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60818/0 (socket says 172.21.15.87:60818) 2024-05-08T18:31:17.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.067+0000 7ff822de1640 1 -- 172.21.15.87:0/2621458062 learned_addr learned my addr 172.21.15.87:0/2621458062 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.067+0000 7ff822de1640 1 -- 172.21.15.87:0/2621458062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6fa4d0160 con 0x55a6fa4cf800 2024-05-08T18:31:17.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.068+0000 7ff822de1640 1 --2- 172.21.15.87:0/2621458062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4cf800 0x55a6fa4cfc20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55a6fa4b5640 tx=0x7ff81c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.068+0000 7ff707fff640 1 -- 172.21.15.87:0/2621458062 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff81c013440 con 0x55a6fa4cf800 2024-05-08T18:31:17.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.068+0000 7ff707fff640 1 -- 172.21.15.87:0/2621458062 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff81c0135e0 con 0x55a6fa4cf800 2024-05-08T18:31:17.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.068+0000 7ff82691f800 1 -- 172.21.15.87:0/2621458062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6fa4d0bd0 con 0x55a6fa4cf800 2024-05-08T18:31:17.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.068+0000 7ff707fff640 1 -- 172.21.15.87:0/2621458062 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff81c0138c0 con 0x55a6fa4cf800 2024-05-08T18:31:17.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.068+0000 7ff82691f800 1 -- 172.21.15.87:0/2621458062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6fa4d10d0 con 0x55a6fa4cf800 2024-05-08T18:31:17.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.069+0000 7ff707fff640 1 -- 172.21.15.87:0/2621458062 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff81c011040 con 0x55a6fa4cf800 2024-05-08T18:31:17.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.069+0000 7ff707fff640 1 --2- 172.21.15.87:0/2621458062 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6fc03bba0 0x7ff6fc03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.069+0000 7ff707fff640 1 -- 172.21.15.87:0/2621458062 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff81c01d070 con 0x55a6fa4cf800 2024-05-08T18:31:17.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.069+0000 7ff8225e0640 1 --2- 172.21.15.87:0/2621458062 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6fc03bba0 0x7ff6fc03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.069+0000 7ff82691f800 1 Processor -- start 2024-05-08T18:31:17.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.069+0000 7ff8225e0640 1 --2- 172.21.15.87:0/2621458062 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6fc03bba0 0x7ff6fc03e060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff8140513b0 tx=0x7ff8140012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.069+0000 7ff82691f800 1 -- start start 2024-05-08T18:31:17.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.069+0000 7ff82691f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4dcb50 0x55a6fa4dcf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.069+0000 7ff82691f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a6fa32d5f0 con 0x55a6fa4dcb50 2024-05-08T18:31:17.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.070+0000 7ff822de1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4dcb50 0x55a6fa4dcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.070+0000 7ff822de1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4dcb50 0x55a6fa4dcf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60834/0 (socket says 172.21.15.87:60834) 2024-05-08T18:31:17.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.070+0000 7ff822de1640 1 -- 172.21.15.87:0/1150742229 learned_addr learned my addr 172.21.15.87:0/1150742229 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.070+0000 7ff822de1640 1 -- 172.21.15.87:0/1150742229 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6fa4dd540 con 0x55a6fa4dcb50 2024-05-08T18:31:17.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.070+0000 7ff822de1640 1 --2- 172.21.15.87:0/1150742229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4dcb50 0x55a6fa4dcf70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff81c052990 tx=0x7ff81c029430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbb883764ed8b82 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.070+0000 7ff705ffb640 1 -- 172.21.15.87:0/1150742229 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff81c02ad80 con 0x55a6fa4dcb50 2024-05-08T18:31:17.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.070+0000 7ff705ffb640 1 -- 172.21.15.87:0/1150742229 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff81c0014f0 con 0x55a6fa4dcb50 2024-05-08T18:31:17.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.070+0000 7ff705ffb640 1 -- 172.21.15.87:0/1150742229 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff81c001810 con 0x55a6fa4dcb50 2024-05-08T18:31:17.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.071+0000 7ff82691f800 1 -- 172.21.15.87:0/1150742229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4dcb50 msgr2=0x55a6fa4dcf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.071+0000 7ff82691f800 1 --2- 172.21.15.87:0/1150742229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4dcb50 0x55a6fa4dcf70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff81c052990 tx=0x7ff81c029430 comp rx=0 tx=0).stop 2024-05-08T18:31:17.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.071+0000 7ff82691f800 1 -- 172.21.15.87:0/1150742229 shutdown_connections 2024-05-08T18:31:17.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.071+0000 7ff82691f800 1 --2- 172.21.15.87:0/1150742229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4dcb50 0x55a6fa4dcf70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.071+0000 7ff82691f800 1 -- 172.21.15.87:0/1150742229 >> 172.21.15.87:0/1150742229 conn(0x55a6fa4d8e10 msgr2=0x55a6fa4d6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.071+0000 7ff82691f800 1 -- 172.21.15.87:0/1150742229 shutdown_connections 2024-05-08T18:31:17.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.071+0000 7ff82691f800 1 -- 172.21.15.87:0/1150742229 wait complete. 2024-05-08T18:31:17.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.071+0000 7ff82691f800 1 Processor -- start 2024-05-08T18:31:17.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.071+0000 7ff82691f800 1 -- start start 2024-05-08T18:31:17.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.071+0000 7ff82691f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4dcb50 0x55a6fa4e40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.071+0000 7ff82691f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a6fa4ddc80 con 0x55a6fa4dcb50 2024-05-08T18:31:17.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.071+0000 7ff822de1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4dcb50 0x55a6fa4e40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.071+0000 7ff822de1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4dcb50 0x55a6fa4e40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60836/0 (socket says 172.21.15.87:60836) 2024-05-08T18:31:17.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.071+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 learned_addr learned my addr 172.21.15.87:0/2948271445 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.072+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6fa4e4630 con 0x55a6fa4dcb50 2024-05-08T18:31:17.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.072+0000 7ff822de1640 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4dcb50 0x55a6fa4e40f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff81c001f40 tx=0x7ff81c0528f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.072+0000 7ff6f3fff640 1 -- 172.21.15.87:0/2948271445 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff81c030020 con 0x55a6fa4dcb50 2024-05-08T18:31:17.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.072+0000 7ff6f3fff640 1 -- 172.21.15.87:0/2948271445 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff81c051330 con 0x55a6fa4dcb50 2024-05-08T18:31:17.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.072+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6fa4e48c0 con 0x55a6fa4dcb50 2024-05-08T18:31:17.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.072+0000 7ff6f3fff640 1 -- 172.21.15.87:0/2948271445 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff81c013a60 con 0x55a6fa4dcb50 2024-05-08T18:31:17.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.072+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6fa4e7570 con 0x55a6fa4dcb50 2024-05-08T18:31:17.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.073+0000 7ff6f3fff640 1 -- 172.21.15.87:0/2948271445 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff81c033020 con 0x55a6fa4dcb50 2024-05-08T18:31:17.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.073+0000 7ff6f3fff640 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6ec03bba0 0x7ff6ec03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.073+0000 7ff6f3fff640 1 -- 172.21.15.87:0/2948271445 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff81c00e040 con 0x55a6fa4dcb50 2024-05-08T18:31:17.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.073+0000 7ff8225e0640 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6ec03bba0 0x7ff6ec03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.073+0000 7ff8225e0640 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6ec03bba0 0x7ff6ec03e060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff81400bff0 tx=0x7ff814047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.074+0000 7ff82691f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.074+0000 7ff82691f800 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a6fa4efba0 0x55a6fa4f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.074+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f27b0 con 0x55a6fa4efba0 2024-05-08T18:31:17.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.074+0000 7ff81bfff640 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a6fa4efba0 0x55a6fa4f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.074+0000 7ff81bfff640 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a6fa4efba0 0x55a6fa4f2060 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.074+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.074+0000 7ff82691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.074+0000 7ff82691f800 20 realm 2024-05-08T18:31:17.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.074+0000 7ff82691f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.074+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f2b80 con 0x55a6fa4efba0 2024-05-08T18:31:17.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.074+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.074+0000 7ff82691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.074+0000 7ff82691f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:17.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.074+0000 7ff82691f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.074+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f3450 con 0x55a6fa4efba0 2024-05-08T18:31:17.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.075+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.075+0000 7ff82691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.075+0000 7ff82691f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.075+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f37f0 con 0x55a6fa4efba0 2024-05-08T18:31:17.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.075+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.075+0000 7ff82691f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:17.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.075+0000 7ff82691f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.075+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f4040 con 0x55a6fa4efba0 2024-05-08T18:31:17.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.075+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.075+0000 7ff82691f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:17.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.075+0000 7ff82691f800 20 searching for the correct realm 2024-05-08T18:31:17.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.075+0000 7ff82691f800 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a6fa4f5db0 0x55a6fa4f81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.075+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x55a6fa4f5db0 2024-05-08T18:31:17.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.075+0000 7ff822de1640 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a6fa4f5db0 0x55a6fa4f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.076+0000 7ff822de1640 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a6fa4f5db0 0x55a6fa4f81a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.076+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff81c052d70 con 0x55a6fa4f5db0 2024-05-08T18:31:17.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.076+0000 7ff822de1640 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff81c035020 0x7ff81c0404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.076+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x7ff81c035020 2024-05-08T18:31:17.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.076+0000 7ff8225e0640 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff81c035020 0x7ff81c0404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.077+0000 7ff8225e0640 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff81c035020 0x7ff81c0404b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.077+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff81402e070 con 0x7ff81c035020 2024-05-08T18:31:17.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.077+0000 7ff8225e0640 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff8140197b0 0x7ff814051760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.077+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x7ff8140197b0 2024-05-08T18:31:17.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.077+0000 7ff81bfff640 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff8140197b0 0x7ff814051760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.078+0000 7ff81bfff640 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff8140197b0 0x7ff814051760 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.078+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.078+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x55a6fa4efba0 2024-05-08T18:31:17.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.078+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.078+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x55a6fa4efba0 2024-05-08T18:31:17.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.078+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.078+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x7ff8140197b0 2024-05-08T18:31:17.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.079+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.079+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x7ff8140197b0 2024-05-08T18:31:17.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.079+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.079+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x7ff81c035020 2024-05-08T18:31:17.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.079+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff81402e070 con 0x7ff81c035020 2024-05-08T18:31:17.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.079+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x55a6fa4f5db0 2024-05-08T18:31:17.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.079+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff81c052d70 con 0x55a6fa4f5db0 2024-05-08T18:31:17.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.079+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x55a6fa4efba0 2024-05-08T18:31:17.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.079+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.079+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x7ff8140197b0 2024-05-08T18:31:17.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.080+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.080+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x55a6fa4efba0 2024-05-08T18:31:17.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.080+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.080+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x7ff81c035020 2024-05-08T18:31:17.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.080+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff81402e070 con 0x7ff81c035020 2024-05-08T18:31:17.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.080+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x55a6fa4f5db0 2024-05-08T18:31:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.081+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff81c052d70 con 0x55a6fa4f5db0 2024-05-08T18:31:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.081+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x55a6fa4f5db0 2024-05-08T18:31:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.081+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff81c052d70 con 0x55a6fa4f5db0 2024-05-08T18:31:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.081+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x7ff8140197b0 2024-05-08T18:31:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.081+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.081+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x55a6fa4f5db0 2024-05-08T18:31:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.081+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff81c052d70 con 0x55a6fa4f5db0 2024-05-08T18:31:17.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.081+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x55a6fa4f5db0 2024-05-08T18:31:17.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.082+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff81c052d70 con 0x55a6fa4f5db0 2024-05-08T18:31:17.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.082+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x55a6fa4efba0 2024-05-08T18:31:17.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.082+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.082+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x55a6fa4efba0 2024-05-08T18:31:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.082+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.082+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x7ff8140197b0 2024-05-08T18:31:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.082+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.082+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x55a6fa4f5db0 2024-05-08T18:31:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.082+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff81c052d70 con 0x55a6fa4f5db0 2024-05-08T18:31:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.083+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x7ff81c035020 2024-05-08T18:31:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.083+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff81402e070 con 0x7ff81c035020 2024-05-08T18:31:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.083+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x55a6fa4efba0 2024-05-08T18:31:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.083+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.083+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x7ff8140197b0 2024-05-08T18:31:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.084+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.084+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x55a6fa4f5db0 2024-05-08T18:31:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.084+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff81c052d70 con 0x55a6fa4f5db0 2024-05-08T18:31:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.084+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x7ff8140197b0 2024-05-08T18:31:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.084+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.084+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x7ff81c035020 2024-05-08T18:31:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.084+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff81402e070 con 0x7ff81c035020 2024-05-08T18:31:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.085+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x55a6fa4f5db0 2024-05-08T18:31:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.085+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff81c052d70 con 0x55a6fa4f5db0 2024-05-08T18:31:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.085+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x7ff8140197b0 2024-05-08T18:31:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.085+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.085+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x55a6fa4efba0 2024-05-08T18:31:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.085+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.085+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8730 con 0x7ff81c035020 2024-05-08T18:31:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff81402e070 con 0x7ff81c035020 2024-05-08T18:31:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f49f0 con 0x55a6fa4efba0 2024-05-08T18:31:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f5290 con 0x55a6fa4efba0 2024-05-08T18:31:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f8bb0 con 0x7ff8140197b0 2024-05-08T18:31:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 20 zone default found 2024-05-08T18:31:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 4 Realm: () 2024-05-08T18:31:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 20 zonegroup default 2024-05-08T18:31:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.086+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f9060 con 0x7ff8140197b0 2024-05-08T18:31:17.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.087+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.087+0000 7ff82691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.087+0000 7ff82691f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.087+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4faa40 con 0x55a6fa4f5db0 2024-05-08T18:31:17.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.087+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff81c052d70 con 0x55a6fa4f5db0 2024-05-08T18:31:17.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.087+0000 7ff82691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.087+0000 7ff82691f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.087+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4faef0 con 0x55a6fa4f5db0 2024-05-08T18:31:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.087+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff81c052d70 con 0x55a6fa4f5db0 2024-05-08T18:31:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.087+0000 7ff82691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.087+0000 7ff82691f800 20 started sync module instance, tier type = 2024-05-08T18:31:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.087+0000 7ff82691f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.087+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f9ed0 con 0x7ff81c035020 2024-05-08T18:31:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.088+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff81402e070 con 0x7ff81c035020 2024-05-08T18:31:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.088+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94175652455104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4f9b30 con 0x7ff81c035020 2024-05-08T18:31:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.088+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4fbe20 con 0x55a6fa4efba0 2024-05-08T18:31:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.091+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.091+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94175652461424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4fc6c0 con 0x55a6fa4efba0 2024-05-08T18:31:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.091+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4fd1b0 con 0x55a6fa4f5db0 2024-05-08T18:31:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.091+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94175652455104] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff81402e070 con 0x7ff81c035020 2024-05-08T18:31:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.094+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff81c052d70 con 0x55a6fa4f5db0 2024-05-08T18:31:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.094+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94175652461424] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.094+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94175652459344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4fc6c0 con 0x55a6fa4f5db0 2024-05-08T18:31:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.094+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4fda90 con 0x7ff81c035020 2024-05-08T18:31:17.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.097+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94175652459344] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff81c052d70 con 0x55a6fa4f5db0 2024-05-08T18:31:17.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.097+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff81402e070 con 0x7ff81c035020 2024-05-08T18:31:17.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.097+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94175652463120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4fc630 con 0x7ff81c035020 2024-05-08T18:31:17.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.097+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4fe950 con 0x55a6fa4efba0 2024-05-08T18:31:17.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.098+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.098+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94175652472448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4ff1f0 con 0x55a6fa4efba0 2024-05-08T18:31:17.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.098+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4ffc30 con 0x7ff8140197b0 2024-05-08T18:31:17.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.099+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.099+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94175652476672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4ffbf0 con 0x7ff8140197b0 2024-05-08T18:31:17.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.099+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa500bd0 con 0x7ff8140197b0 2024-05-08T18:31:17.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.101+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94175652476672] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.101+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94175652463120] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff81402e070 con 0x7ff81c035020 2024-05-08T18:31:17.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.102+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.102+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94175652470400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa500720 con 0x7ff8140197b0 2024-05-08T18:31:17.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.102+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa5010e0 con 0x7ff8140197b0 2024-05-08T18:31:17.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.104+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94175652472448] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.106+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94175652470400] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.106+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.106+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94175652474176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa500c30 con 0x7ff8140197b0 2024-05-08T18:31:17.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.106+0000 7ff82691f800 20 add_watcher() i=0 2024-05-08T18:31:17.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.106+0000 7ff82691f800 20 add_watcher() i=1 2024-05-08T18:31:17.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.106+0000 7ff82691f800 20 add_watcher() i=2 2024-05-08T18:31:17.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.106+0000 7ff82691f800 20 add_watcher() i=3 2024-05-08T18:31:17.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.106+0000 7ff82691f800 20 add_watcher() i=4 2024-05-08T18:31:17.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.106+0000 7ff82691f800 20 add_watcher() i=5 2024-05-08T18:31:17.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.106+0000 7ff82691f800 20 add_watcher() i=6 2024-05-08T18:31:17.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.107+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94175652474176] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.107+0000 7ff82691f800 20 add_watcher() i=7 2024-05-08T18:31:17.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.107+0000 7ff82691f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:17.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.108+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa504110 con 0x55a6fa4efba0 2024-05-08T18:31:17.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.108+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.108+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94175652482096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa501500 con 0x55a6fa4efba0 2024-05-08T18:31:17.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.109+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94175652482096] v27'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.109+0000 7ff6d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:17.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.109+0000 7ff82691f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:17.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.109+0000 7ff82691f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:17.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.109+0000 7ff82691f800 5 note: GC not initialized 2024-05-08T18:31:17.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.109+0000 7ff6537fe640 20 reqs_thread_entry: start 2024-05-08T18:31:17.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.109+0000 7ff82691f800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:17.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.109+0000 7ff82691f800 20 Filter name: none 2024-05-08T18:31:17.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff6517fa640 20 reqs_thread_entry: start 2024-05-08T18:31:17.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff82691f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:17.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff82691f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa537370 con 0x55a6fa4efba0 2024-05-08T18:31:17.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff82691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff82691f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-05-08T18:31:17.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff82691f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:17.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff82691f800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-05-08T18:31:17.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff82691f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa535b10 con 0x55a6fa4efba0 2024-05-08T18:31:17.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff82691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff82691f800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-05-08T18:31:17.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff82691f800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-08T18:31:17.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff82691f800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-05-08T18:31:17.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff82691f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.110+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa535b10 con 0x7ff8140197b0 2024-05-08T18:31:17.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.111+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.111+0000 7ff82691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.111+0000 7ff82691f800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-05-08T18:31:17.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.111+0000 7ff82691f800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-08T18:31:17.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.111+0000 7ff82691f800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-05-08T18:31:17.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.111+0000 7ff82691f800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-05-08T18:31:17.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.111+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa536530 con 0x55a6fa4efba0 2024-05-08T18:31:17.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.112+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v27'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.112+0000 7ff82691f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:17.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.112+0000 7ff82691f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:17.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.112+0000 7ff82691f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:31:17.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.112+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94175652699984 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa53acc0 con 0x55a6fa4efba0 2024-05-08T18:31:17.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.112+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== watch-notify(notify (1) cookie 94175652472448 notify 115964116992 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55a6fa5368d0 con 0x55a6fa4efba0 2024-05-08T18:31:17.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.112+0000 7ff705ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116992 cookie 94175652472448 notifier 4284 bl.length()=567 2024-05-08T18:31:17.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.112+0000 7ff705ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:17.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.112+0000 7ff705ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:17.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.112+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(66 notify.4 [notify cookie 94175652699984 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.112+0000 7ff705ffb640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7ff6e8003ea0 con 0x55a6fa4efba0 2024-05-08T18:31:17.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.113+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.113+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== watch-notify(notify_complete (2) cookie 94175652699984 notify 115964116992 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a6fa536f90 con 0x55a6fa4efba0 2024-05-08T18:31:17.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.113+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa538790 con 0x55a6fa4efba0 2024-05-08T18:31:17.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.114+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.114+0000 7ff82691f800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-05-08T18:31:17.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.114+0000 7ff82691f800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-08T18:31:17.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.114+0000 7ff82691f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-05-08T18:31:17.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.114+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94175652699840 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa538790 con 0x7ff81c035020 2024-05-08T18:31:17.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.115+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== watch-notify(notify (1) cookie 94175652463120 notify 115964116992 ret 0) ==== 211+0+0 (crc 0 0 0) 0x55a6fa4b76c0 con 0x7ff81c035020 2024-05-08T18:31:17.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.115+0000 7ff705ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116992 cookie 94175652463120 notifier 4284 bl.length()=169 2024-05-08T18:31:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.115+0000 7ff705ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-05-08T18:31:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.115+0000 7ff705ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-08T18:31:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.115+0000 7ff705ffb640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7ff6e8003ea0 con 0x7ff81c035020 2024-05-08T18:31:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.115+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(69 notify.3 [notify cookie 94175652699840 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff81402e070 con 0x7ff81c035020 2024-05-08T18:31:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.115+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== watch-notify(notify_complete (2) cookie 94175652699840 notify 115964116992 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a6fa4b4a10 con 0x7ff81c035020 2024-05-08T18:31:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.115+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff81402e070 con 0x7ff81c035020 2024-05-08T18:31:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.115+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa535ec0 con 0x7ff8140197b0 2024-05-08T18:31:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.116+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.116+0000 7ff82691f800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-05-08T18:31:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.116+0000 7ff82691f800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-08T18:31:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.116+0000 7ff82691f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-05-08T18:31:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.116+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94175652699744 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa53b0f0 con 0x7ff81c035020 2024-05-08T18:31:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.117+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== watch-notify(notify (1) cookie 94175652463120 notify 115964116993 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55a6fa4b4a10 con 0x7ff81c035020 2024-05-08T18:31:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.117+0000 7ff7057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 94175652463120 notifier 4284 bl.length()=177 2024-05-08T18:31:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.117+0000 7ff7057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-05-08T18:31:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.117+0000 7ff7057fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-08T18:31:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.117+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(72 notify.3 [notify cookie 94175652699744 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff81402e070 con 0x7ff81c035020 2024-05-08T18:31:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.117+0000 7ff7057fa640 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7ff658003400 con 0x7ff81c035020 2024-05-08T18:31:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.117+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== watch-notify(notify_complete (2) cookie 94175652699744 notify 115964116993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a6fa4b4780 con 0x7ff81c035020 2024-05-08T18:31:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.117+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff81402e070 con 0x7ff81c035020 2024-05-08T18:31:17.152 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.118+0000 7ff6d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.118+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94175652482096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa538340 con 0x55a6fa4efba0 2024-05-08T18:31:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.119+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94175652482096] v27'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.119+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94175652455104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa538340 con 0x7ff81c035020 2024-05-08T18:31:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.122+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94175652455104] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff81402e070 con 0x7ff81c035020 2024-05-08T18:31:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.122+0000 7ff82691f800 20 remove_watcher() i=0 2024-05-08T18:31:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.122+0000 7ff82691f800 2 removed watcher, disabling cache 2024-05-08T18:31:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.122+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94175652461424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4fa2c0 con 0x55a6fa4efba0 2024-05-08T18:31:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.123+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94175652461424] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.123+0000 7ff82691f800 20 remove_watcher() i=1 2024-05-08T18:31:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.123+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94175652459344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4fa2c0 con 0x55a6fa4f5db0 2024-05-08T18:31:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.125+0000 7ff822de1640 1 -- 172.21.15.87:0/2948271445 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94175652459344] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff81c052d70 con 0x55a6fa4f5db0 2024-05-08T18:31:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.125+0000 7ff82691f800 20 remove_watcher() i=2 2024-05-08T18:31:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.125+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94175652463120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4fa2c0 con 0x7ff81c035020 2024-05-08T18:31:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.126+0000 7ff8225e0640 1 -- 172.21.15.87:0/2948271445 <== osd.2 v2:172.21.15.87:6816/2108501615 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94175652463120] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff81402e070 con 0x7ff81c035020 2024-05-08T18:31:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.126+0000 7ff82691f800 20 remove_watcher() i=3 2024-05-08T18:31:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.126+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94175652472448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4fc210 con 0x55a6fa4efba0 2024-05-08T18:31:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.128+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94175652472448] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x55a6fa4efba0 2024-05-08T18:31:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.128+0000 7ff82691f800 20 remove_watcher() i=4 2024-05-08T18:31:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.128+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94175652476672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4fa2c0 con 0x7ff8140197b0 2024-05-08T18:31:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.129+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94175652476672] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.129+0000 7ff82691f800 20 remove_watcher() i=5 2024-05-08T18:31:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.129+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94175652470400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4fe680 con 0x7ff8140197b0 2024-05-08T18:31:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.134+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94175652470400] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.134+0000 7ff82691f800 20 remove_watcher() i=6 2024-05-08T18:31:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.134+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94175652474176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6fa4fc210 con 0x7ff8140197b0 2024-05-08T18:31:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94175652474176] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff80c05a040 con 0x7ff8140197b0 2024-05-08T18:31:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 20 remove_watcher() i=7 2024-05-08T18:31:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff8140197b0 msgr2=0x7ff814051760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff8140197b0 0x7ff814051760 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a6fa4efba0 msgr2=0x55a6fa4f2060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a6fa4efba0 0x55a6fa4f2060 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff81c035020 msgr2=0x7ff81c0404b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff81c035020 0x7ff81c0404b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a6fa4f5db0 msgr2=0x55a6fa4f81a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a6fa4f5db0 0x55a6fa4f81a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6ec03bba0 msgr2=0x7ff6ec03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6ec03bba0 0x7ff6ec03e060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff81400bff0 tx=0x7ff814047000 comp rx=0 tx=0).stop 2024-05-08T18:31:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4dcb50 msgr2=0x55a6fa4e40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4dcb50 0x55a6fa4e40f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff81c001f40 tx=0x7ff81c0528f0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff81bfff640 1 -- 172.21.15.87:0/2948271445 reap_dead start 2024-05-08T18:31:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 shutdown_connections 2024-05-08T18:31:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 1 --2- 172.21.15.87:0/2948271445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4dcb50 0x55a6fa4e40f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 >> 172.21.15.87:0/2948271445 conn(0x55a6fa4d8e10 msgr2=0x55a6fa4d64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 shutdown_connections 2024-05-08T18:31:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.135+0000 7ff82691f800 1 -- 172.21.15.87:0/2948271445 wait complete. 2024-05-08T18:31:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 -- 172.21.15.87:0/2621458062 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6fc03bba0 msgr2=0x7ff6fc03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 --2- 172.21.15.87:0/2621458062 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6fc03bba0 0x7ff6fc03e060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff8140513b0 tx=0x7ff8140012d0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 -- 172.21.15.87:0/2621458062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4cf800 msgr2=0x55a6fa4cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 --2- 172.21.15.87:0/2621458062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4cf800 0x55a6fa4cfc20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55a6fa4b5640 tx=0x7ff81c0178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 -- 172.21.15.87:0/2621458062 shutdown_connections 2024-05-08T18:31:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 --2- 172.21.15.87:0/2621458062 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6fc03bba0 0x7ff6fc03e060 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 --2- 172.21.15.87:0/2621458062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa4cf800 0x55a6fa4cfc20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 -- 172.21.15.87:0/2621458062 >> 172.21.15.87:0/2621458062 conn(0x55a6fa4c38a0 msgr2=0x55a6fa4c3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 -- 172.21.15.87:0/2621458062 shutdown_connections 2024-05-08T18:31:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 -- 172.21.15.87:0/2621458062 wait complete. 2024-05-08T18:31:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 -- 172.21.15.87:0/1243737658 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a6fa4bec90 msgr2=0x55a6fa4c1080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a6fa4bec90 0x55a6fa4c1080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 -- 172.21.15.87:0/1243737658 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a6fa3bd6e0 msgr2=0x55a6fa4bb480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a6fa3bd6e0 0x55a6fa4bb480 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 -- 172.21.15.87:0/1243737658 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff70803bb50 msgr2=0x7ff70803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff70803bb50 0x7ff70803e010 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff80c054000 tx=0x7ff80c04e000 comp rx=0 tx=0).stop 2024-05-08T18:31:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 -- 172.21.15.87:0/1243737658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3b92f0 msgr2=0x55a6fa4b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3b92f0 0x55a6fa4b4240 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55a6fa32e2e0 tx=0x7ff814000bc0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 -- 172.21.15.87:0/1243737658 shutdown_connections 2024-05-08T18:31:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a6fa3bd6e0 0x55a6fa4bb480 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a6fa4bec90 0x55a6fa4c1080 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff70803bb50 0x7ff70803e010 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 --2- 172.21.15.87:0/1243737658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6fa3b92f0 0x55a6fa4b4240 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 -- 172.21.15.87:0/1243737658 >> 172.21.15.87:0/1243737658 conn(0x55a6fa3b4870 msgr2=0x55a6fa32db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 -- 172.21.15.87:0/1243737658 shutdown_connections 2024-05-08T18:31:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.136+0000 7ff82691f800 1 -- 172.21.15.87:0/1243737658 wait complete. 2024-05-08T18:31:17.169 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:17.169 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-05-08T18:31:17.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-05-08T18:31:17.170 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-05-08T18:31:17.219 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:17.219 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:17.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.221+0000 7f853ea0f800 1 Processor -- start 2024-05-08T18:31:17.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.221+0000 7f853ea0f800 1 -- start start 2024-05-08T18:31:17.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.221+0000 7f853ea0f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d0ddba82d0 0x55d0ddba86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.221+0000 7f853ea0f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d0ddba8d70 con 0x55d0ddba9490 2024-05-08T18:31:17.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.221+0000 7f853ea0f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55d0dda48e20 con 0x55d0ddba82d0 2024-05-08T18:31:17.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.222+0000 7f853a140640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d0ddba82d0 0x55d0ddba86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.222+0000 7f853993f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55d0ddba9490 0x55d0ddba9910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41882/0 (socket says 172.21.15.87:41882) 2024-05-08T18:31:17.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.222+0000 7f853993f640 1 -- 172.21.15.87:0/1809350447 learned_addr learned my addr 172.21.15.87:0/1809350447 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:17.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.222+0000 7f853a140640 1 -- 172.21.15.87:0/1809350447 >> v1:172.21.15.53:6789/0 conn(0x55d0ddba9490 legacy=0x55d0ddba9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.222+0000 7f853a140640 1 -- 172.21.15.87:0/1809350447 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ddbaa050 con 0x55d0ddba82d0 2024-05-08T18:31:17.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.224+0000 7f853a140640 1 --2- 172.21.15.87:0/1809350447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 0x55d0ddba86f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f852c005fd0 tx=0x7f852c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbb22b64eded1d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.224+0000 7f853913e640 1 -- 172.21.15.87:0/1809350447 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f852c052560 con 0x55d0ddba82d0 2024-05-08T18:31:17.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.224+0000 7f853913e640 1 -- 172.21.15.87:0/1809350447 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f852c052700 con 0x55d0ddba82d0 2024-05-08T18:31:17.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.224+0000 7f853913e640 1 -- 172.21.15.87:0/1809350447 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f852c052a60 con 0x55d0ddba82d0 2024-05-08T18:31:17.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.224+0000 7f853ea0f800 1 -- 172.21.15.87:0/1809350447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 msgr2=0x55d0ddba86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.224+0000 7f853ea0f800 1 --2- 172.21.15.87:0/1809350447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 0x55d0ddba86f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f852c005fd0 tx=0x7f852c01ccc0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.224+0000 7f853ea0f800 1 -- 172.21.15.87:0/1809350447 shutdown_connections 2024-05-08T18:31:17.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.224+0000 7f853ea0f800 1 --2- 172.21.15.87:0/1809350447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 0x55d0ddba86f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.224+0000 7f853ea0f800 1 -- 172.21.15.87:0/1809350447 >> 172.21.15.87:0/1809350447 conn(0x55d0ddba3850 msgr2=0x55d0ddba5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.224+0000 7f853ea0f800 1 -- 172.21.15.87:0/1809350447 shutdown_connections 2024-05-08T18:31:17.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.224+0000 7f853ea0f800 1 -- 172.21.15.87:0/1809350447 wait complete. 2024-05-08T18:31:17.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.238+0000 7f853ea0f800 1 Processor -- start 2024-05-08T18:31:17.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.238+0000 7f853ea0f800 1 -- start start 2024-05-08T18:31:17.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.238+0000 7f853ea0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 0x55d0ddc99730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.238+0000 7f853ea0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d0ddaf35d0 con 0x55d0ddba82d0 2024-05-08T18:31:17.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.239+0000 7f853a140640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 0x55d0ddc99730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.239+0000 7f853a140640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 0x55d0ddc99730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60844/0 (socket says 172.21.15.87:60844) 2024-05-08T18:31:17.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.239+0000 7f853a140640 1 -- 172.21.15.87:0/290087597 learned_addr learned my addr 172.21.15.87:0/290087597 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.239+0000 7f853a140640 1 -- 172.21.15.87:0/290087597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ddc99d00 con 0x55d0ddba82d0 2024-05-08T18:31:17.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.239+0000 7f853a140640 1 --2- 172.21.15.87:0/290087597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 0x55d0ddc99730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f852c007000 tx=0x7f852c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a7dce54891c04e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.239+0000 7f8428608640 1 -- 172.21.15.87:0/290087597 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f852c0529e0 con 0x55d0ddba82d0 2024-05-08T18:31:17.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.239+0000 7f8428608640 1 -- 172.21.15.87:0/290087597 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f852c052b80 con 0x55d0ddba82d0 2024-05-08T18:31:17.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.239+0000 7f8428608640 1 -- 172.21.15.87:0/290087597 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f852c05c430 con 0x55d0ddba82d0 2024-05-08T18:31:17.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.240+0000 7f853ea0f800 1 -- 172.21.15.87:0/290087597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 msgr2=0x55d0ddc99730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.240+0000 7f853ea0f800 1 --2- 172.21.15.87:0/290087597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 0x55d0ddc99730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f852c007000 tx=0x7f852c04c000 comp rx=0 tx=0).stop 2024-05-08T18:31:17.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.240+0000 7f853ea0f800 1 -- 172.21.15.87:0/290087597 shutdown_connections 2024-05-08T18:31:17.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.240+0000 7f853ea0f800 1 --2- 172.21.15.87:0/290087597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 0x55d0ddc99730 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.240+0000 7f853ea0f800 1 -- 172.21.15.87:0/290087597 >> 172.21.15.87:0/290087597 conn(0x55d0ddba3850 msgr2=0x55d0ddc95050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.240+0000 7f853ea0f800 1 -- 172.21.15.87:0/290087597 shutdown_connections 2024-05-08T18:31:17.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.240+0000 7f853ea0f800 1 -- 172.21.15.87:0/290087597 wait complete. 2024-05-08T18:31:17.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.240+0000 7f853ea0f800 1 Processor -- start 2024-05-08T18:31:17.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.241+0000 7f853ea0f800 1 -- start start 2024-05-08T18:31:17.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.241+0000 7f853ea0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 0x55d0ddca1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.241+0000 7f853ea0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d0ddbb1960 con 0x55d0ddba82d0 2024-05-08T18:31:17.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.241+0000 7f853a140640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 0x55d0ddca1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.241+0000 7f853a140640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 0x55d0ddca1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60856/0 (socket says 172.21.15.87:60856) 2024-05-08T18:31:17.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.241+0000 7f853a140640 1 -- 172.21.15.87:0/2948707148 learned_addr learned my addr 172.21.15.87:0/2948707148 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.241+0000 7f853a140640 1 -- 172.21.15.87:0/2948707148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ddca1790 con 0x55d0ddba82d0 2024-05-08T18:31:17.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.241+0000 7f853a140640 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 0x55d0ddca1250 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f852c0526d0 tx=0x7f852c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.241+0000 7f8426e05640 1 -- 172.21.15.87:0/2948707148 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f852c075070 con 0x55d0ddba82d0 2024-05-08T18:31:17.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.242+0000 7f8426e05640 1 -- 172.21.15.87:0/2948707148 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f852c070410 con 0x55d0ddba82d0 2024-05-08T18:31:17.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.242+0000 7f853ea0f800 1 -- 172.21.15.87:0/2948707148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0ddca1a20 con 0x55d0ddba82d0 2024-05-08T18:31:17.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.242+0000 7f8426e05640 1 -- 172.21.15.87:0/2948707148 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f852c0529e0 con 0x55d0ddba82d0 2024-05-08T18:31:17.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.242+0000 7f853ea0f800 1 -- 172.21.15.87:0/2948707148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ddca46d0 con 0x55d0ddba82d0 2024-05-08T18:31:17.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.242+0000 7f8426e05640 1 -- 172.21.15.87:0/2948707148 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f852c078070 con 0x55d0ddba82d0 2024-05-08T18:31:17.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.243+0000 7f8426e05640 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f842003bba0 0x7f842003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.243+0000 7f8426e05640 1 -- 172.21.15.87:0/2948707148 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f852c06d070 con 0x55d0ddba82d0 2024-05-08T18:31:17.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.243+0000 7f853993f640 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f842003bba0 0x7f842003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.243+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d0ddba9490 0x55d0ddca8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.243+0000 7f853ea0f800 1 -- 172.21.15.87:0/2948707148 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddca89d0 con 0x55d0ddba9490 2024-05-08T18:31:17.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.243+0000 7f853a941640 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d0ddba9490 0x55d0ddca8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.243+0000 7f853993f640 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f842003bba0 0x7f842003e060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8530000f60 tx=0x7f85300012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.243+0000 7f853a941640 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d0ddba9490 0x55d0ddca8490 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.243+0000 7f853a941640 1 -- 172.21.15.87:0/2948707148 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85340083e0 con 0x55d0ddba9490 2024-05-08T18:31:17.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.243+0000 7f853ea0f800 1 -- 172.21.15.87:0/2948707148 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddca5a40 con 0x55d0ddba9490 2024-05-08T18:31:17.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.244+0000 7f853a941640 1 -- 172.21.15.87:0/2948707148 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85340083e0 con 0x55d0ddba9490 2024-05-08T18:31:17.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.244+0000 7f853ea0f800 1 -- 172.21.15.87:0/2948707148 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddcaa820 con 0x55d0ddba9490 2024-05-08T18:31:17.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.244+0000 7f853a941640 1 -- 172.21.15.87:0/2948707148 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f85340083e0 con 0x55d0ddba9490 2024-05-08T18:31:17.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.244+0000 7f853ea0f800 1 -- 172.21.15.87:0/2948707148 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddca9a50 con 0x55d0ddba9490 2024-05-08T18:31:17.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.244+0000 7f853a941640 1 -- 172.21.15.87:0/2948707148 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85340083e0 con 0x55d0ddba9490 2024-05-08T18:31:17.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.244+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d0ddcabbd0 0x55d0ddcadfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.244+0000 7f853ea0f800 1 -- 172.21.15.87:0/2948707148 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddcae500 con 0x55d0ddcabbd0 2024-05-08T18:31:17.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.245+0000 7f853a140640 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d0ddcabbd0 0x55d0ddcadfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.245+0000 7f853a140640 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d0ddcabbd0 0x55d0ddcadfc0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.245+0000 7f853a140640 1 -- 172.21.15.87:0/2948707148 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f852c077030 con 0x55d0ddcabbd0 2024-05-08T18:31:17.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.245+0000 7f853ea0f800 1 Processor -- start 2024-05-08T18:31:17.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.246+0000 7f853ea0f800 1 -- start start 2024-05-08T18:31:17.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.246+0000 7f853ea0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddb1def0 0x55d0ddb1c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.246+0000 7f853ea0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d0dda99fc0 con 0x55d0ddb1def0 2024-05-08T18:31:17.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.246+0000 7f853a941640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddb1def0 0x55d0ddb1c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.246+0000 7f853a941640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddb1def0 0x55d0ddb1c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60864/0 (socket says 172.21.15.87:60864) 2024-05-08T18:31:17.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.246+0000 7f853a941640 1 -- 172.21.15.87:0/3391251834 learned_addr learned my addr 172.21.15.87:0/3391251834 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.246+0000 7f853a941640 1 -- 172.21.15.87:0/3391251834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ddb1c8a0 con 0x55d0ddb1def0 2024-05-08T18:31:17.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.246+0000 7f853a941640 1 --2- 172.21.15.87:0/3391251834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddb1def0 0x55d0ddb1c360 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55d0ddca2650 tx=0x7f853400ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.246+0000 7f841ffff640 1 -- 172.21.15.87:0/3391251834 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f853401c070 con 0x55d0ddb1def0 2024-05-08T18:31:17.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.246+0000 7f841ffff640 1 -- 172.21.15.87:0/3391251834 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f853400bdc0 con 0x55d0ddb1def0 2024-05-08T18:31:17.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.246+0000 7f853ea0f800 1 -- 172.21.15.87:0/3391251834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0ddb1cb30 con 0x55d0ddb1def0 2024-05-08T18:31:17.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.247+0000 7f841ffff640 1 -- 172.21.15.87:0/3391251834 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8534018540 con 0x55d0ddb1def0 2024-05-08T18:31:17.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.247+0000 7f853ea0f800 1 -- 172.21.15.87:0/3391251834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ddb1d030 con 0x55d0ddb1def0 2024-05-08T18:31:17.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.247+0000 7f841ffff640 1 -- 172.21.15.87:0/3391251834 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f853401f070 con 0x55d0ddb1def0 2024-05-08T18:31:17.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.247+0000 7f841ffff640 1 --2- 172.21.15.87:0/3391251834 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f841403bb50 0x7f841403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.248+0000 7f841ffff640 1 -- 172.21.15.87:0/3391251834 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8534054730 con 0x55d0ddb1def0 2024-05-08T18:31:17.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.248+0000 7f853a140640 1 --2- 172.21.15.87:0/3391251834 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f841403bb50 0x7f841403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.248+0000 7f853ea0f800 1 Processor -- start 2024-05-08T18:31:17.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.248+0000 7f853a140640 1 --2- 172.21.15.87:0/3391251834 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f841403bb50 0x7f841403e010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f852c078b20 tx=0x7f852c051480 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.248+0000 7f853ea0f800 1 -- start start 2024-05-08T18:31:17.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.248+0000 7f853ea0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddccbd20 0x55d0ddccc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.248+0000 7f853ea0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d0ddc9a020 con 0x55d0ddccbd20 2024-05-08T18:31:17.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.248+0000 7f853a941640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddccbd20 0x55d0ddccc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.248+0000 7f853a941640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddccbd20 0x55d0ddccc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60880/0 (socket says 172.21.15.87:60880) 2024-05-08T18:31:17.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.248+0000 7f853a941640 1 -- 172.21.15.87:0/1377524667 learned_addr learned my addr 172.21.15.87:0/1377524667 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.248+0000 7f853a941640 1 -- 172.21.15.87:0/1377524667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ddccc710 con 0x55d0ddccbd20 2024-05-08T18:31:17.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.249+0000 7f853a941640 1 --2- 172.21.15.87:0/1377524667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddccbd20 0x55d0ddccc140 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8534052a60 tx=0x7f8534052d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55464f71a13622e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.249+0000 7f841dffb640 1 -- 172.21.15.87:0/1377524667 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f853404f070 con 0x55d0ddccbd20 2024-05-08T18:31:17.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.249+0000 7f841dffb640 1 -- 172.21.15.87:0/1377524667 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85340173a0 con 0x55d0ddccbd20 2024-05-08T18:31:17.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.249+0000 7f841dffb640 1 -- 172.21.15.87:0/1377524667 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8534051350 con 0x55d0ddccbd20 2024-05-08T18:31:17.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.249+0000 7f853ea0f800 1 -- 172.21.15.87:0/1377524667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddccbd20 msgr2=0x55d0ddccc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.249+0000 7f853ea0f800 1 --2- 172.21.15.87:0/1377524667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddccbd20 0x55d0ddccc140 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8534052a60 tx=0x7f8534052d30 comp rx=0 tx=0).stop 2024-05-08T18:31:17.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.249+0000 7f853ea0f800 1 -- 172.21.15.87:0/1377524667 shutdown_connections 2024-05-08T18:31:17.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.249+0000 7f853ea0f800 1 --2- 172.21.15.87:0/1377524667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddccbd20 0x55d0ddccc140 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.249+0000 7f853ea0f800 1 -- 172.21.15.87:0/1377524667 >> 172.21.15.87:0/1377524667 conn(0x55d0ddcc7fe0 msgr2=0x55d0ddcc6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.249+0000 7f853ea0f800 1 -- 172.21.15.87:0/1377524667 shutdown_connections 2024-05-08T18:31:17.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.249+0000 7f853ea0f800 1 -- 172.21.15.87:0/1377524667 wait complete. 2024-05-08T18:31:17.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.249+0000 7f853ea0f800 1 Processor -- start 2024-05-08T18:31:17.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.250+0000 7f853ea0f800 1 -- start start 2024-05-08T18:31:17.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.250+0000 7f853ea0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddccbd20 0x55d0ddcd32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.250+0000 7f853ea0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d0ddccce90 con 0x55d0ddccbd20 2024-05-08T18:31:17.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.250+0000 7f853a941640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddccbd20 0x55d0ddcd32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.250+0000 7f853a941640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddccbd20 0x55d0ddcd32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60886/0 (socket says 172.21.15.87:60886) 2024-05-08T18:31:17.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.250+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 learned_addr learned my addr 172.21.15.87:0/2853855907 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.250+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ddcd3830 con 0x55d0ddccbd20 2024-05-08T18:31:17.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.250+0000 7f853a941640 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddccbd20 0x55d0ddcd32f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f85340076b0 tx=0x7f85340529f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.250+0000 7f840bfff640 1 -- 172.21.15.87:0/2853855907 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8534014ea0 con 0x55d0ddccbd20 2024-05-08T18:31:17.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.250+0000 7f840bfff640 1 -- 172.21.15.87:0/2853855907 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f853404a040 con 0x55d0ddccbd20 2024-05-08T18:31:17.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.250+0000 7f840bfff640 1 -- 172.21.15.87:0/2853855907 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85340541a0 con 0x55d0ddccbd20 2024-05-08T18:31:17.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.250+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0ddcd3ac0 con 0x55d0ddccbd20 2024-05-08T18:31:17.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.250+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ddcd6770 con 0x55d0ddccbd20 2024-05-08T18:31:17.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.251+0000 7f840bfff640 1 -- 172.21.15.87:0/2853855907 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8534018730 con 0x55d0ddccbd20 2024-05-08T18:31:17.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.251+0000 7f840bfff640 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f840403bba0 0x7f840403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.251+0000 7f840bfff640 1 -- 172.21.15.87:0/2853855907 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8534034c60 con 0x55d0ddccbd20 2024-05-08T18:31:17.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.251+0000 7f853a140640 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f840403bba0 0x7f840403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.252+0000 7f853a140640 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f840403bba0 0x7f840403e060 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f852c05b780 tx=0x7f852c08d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.252+0000 7f853ea0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.252+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d0ddcdecf0 0x55d0ddce11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.252+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce1900 con 0x55d0ddcdecf0 2024-05-08T18:31:17.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.252+0000 7f853993f640 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d0ddcdecf0 0x55d0ddce11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.252+0000 7f853993f640 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d0ddcdecf0 0x55d0ddce11b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.252+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8530009050 con 0x55d0ddcdecf0 2024-05-08T18:31:17.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.253+0000 7f853ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.253+0000 7f853ea0f800 20 realm 2024-05-08T18:31:17.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.253+0000 7f853ea0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.253+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddcde140 con 0x55d0ddcdecf0 2024-05-08T18:31:17.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.253+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8530009050 con 0x55d0ddcdecf0 2024-05-08T18:31:17.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.253+0000 7f853ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.253+0000 7f853ea0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:17.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.253+0000 7f853ea0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.253+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce23f0 con 0x55d0ddcdecf0 2024-05-08T18:31:17.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.253+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8530009050 con 0x55d0ddcdecf0 2024-05-08T18:31:17.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.253+0000 7f853ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.253+0000 7f853ea0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.253+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce2cc0 con 0x55d0ddcdecf0 2024-05-08T18:31:17.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.253+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8530009050 con 0x55d0ddcdecf0 2024-05-08T18:31:17.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.253+0000 7f853ea0f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:17.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.253+0000 7f853ea0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.253+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce3060 con 0x55d0ddcdecf0 2024-05-08T18:31:17.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.254+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8530009050 con 0x55d0ddcdecf0 2024-05-08T18:31:17.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.254+0000 7f853ea0f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:17.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.254+0000 7f853ea0f800 20 searching for the correct realm 2024-05-08T18:31:17.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.254+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55d0ddce4f40 0x55d0ddce7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.254+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x55d0ddce4f40 2024-05-08T18:31:17.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.254+0000 7f853a941640 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55d0ddce4f40 0x55d0ddce7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.254+0000 7f853a941640 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55d0ddce4f40 0x55d0ddce7350 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.254+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8534028070 con 0x55d0ddce4f40 2024-05-08T18:31:17.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.255+0000 7f853a941640 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8534021070 0x7f853402b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.255+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x7f8534021070 2024-05-08T18:31:17.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.255+0000 7f853a140640 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8534021070 0x7f853402b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.255+0000 7f853a140640 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8534021070 0x7f853402b880 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.255+0000 7f853a140640 1 -- 172.21.15.87:0/2853855907 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f852c088040 con 0x7f8534021070 2024-05-08T18:31:17.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.255+0000 7f853a140640 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f852c0a2040 0x7f852c094440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.255+0000 7f853a140640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x7f852c0a2040 2024-05-08T18:31:17.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.256+0000 7f853993f640 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f852c0a2040 0x7f852c094440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.256+0000 7f853993f640 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f852c0a2040 0x7f852c094440 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.256+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8530009050 con 0x7f852c0a2040 2024-05-08T18:31:17.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.256+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x55d0ddcdecf0 2024-05-08T18:31:17.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.256+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8530009050 con 0x55d0ddcdecf0 2024-05-08T18:31:17.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.256+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x55d0ddcdecf0 2024-05-08T18:31:17.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.257+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.257+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x7f852c0a2040 2024-05-08T18:31:17.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.257+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.257+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x7f852c0a2040 2024-05-08T18:31:17.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.257+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.257+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x7f8534021070 2024-05-08T18:31:17.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.257+0000 7f853a140640 1 -- 172.21.15.87:0/2853855907 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f852c088040 con 0x7f8534021070 2024-05-08T18:31:17.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.257+0000 7f853a140640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x55d0ddce4f40 2024-05-08T18:31:17.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.258+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8534028070 con 0x55d0ddce4f40 2024-05-08T18:31:17.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.258+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x55d0ddcdecf0 2024-05-08T18:31:17.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.258+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.258+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x7f852c0a2040 2024-05-08T18:31:17.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.258+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.258+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x55d0ddcdecf0 2024-05-08T18:31:17.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.258+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.258+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x7f8534021070 2024-05-08T18:31:17.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.259+0000 7f853a140640 1 -- 172.21.15.87:0/2853855907 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f852c088040 con 0x7f8534021070 2024-05-08T18:31:17.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.259+0000 7f853a140640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x55d0ddce4f40 2024-05-08T18:31:17.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.259+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8534028070 con 0x55d0ddce4f40 2024-05-08T18:31:17.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.259+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x55d0ddce4f40 2024-05-08T18:31:17.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.259+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8534028070 con 0x55d0ddce4f40 2024-05-08T18:31:17.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.259+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x7f852c0a2040 2024-05-08T18:31:17.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.260+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.260+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x55d0ddce4f40 2024-05-08T18:31:17.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.260+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8534028070 con 0x55d0ddce4f40 2024-05-08T18:31:17.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.260+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x55d0ddce4f40 2024-05-08T18:31:17.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.260+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8534028070 con 0x55d0ddce4f40 2024-05-08T18:31:17.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.260+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x55d0ddcdecf0 2024-05-08T18:31:17.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.260+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.260+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x55d0ddcdecf0 2024-05-08T18:31:17.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.260+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.260+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x7f852c0a2040 2024-05-08T18:31:17.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.261+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.261+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x55d0ddce4f40 2024-05-08T18:31:17.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.261+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8534028070 con 0x55d0ddce4f40 2024-05-08T18:31:17.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.261+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x7f8534021070 2024-05-08T18:31:17.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.261+0000 7f853a140640 1 -- 172.21.15.87:0/2853855907 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f852c088040 con 0x7f8534021070 2024-05-08T18:31:17.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.261+0000 7f853a140640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x55d0ddcdecf0 2024-05-08T18:31:17.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.261+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.261+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x7f852c0a2040 2024-05-08T18:31:17.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.262+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.262+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x55d0ddce4f40 2024-05-08T18:31:17.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.262+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8534028070 con 0x55d0ddce4f40 2024-05-08T18:31:17.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.262+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x7f852c0a2040 2024-05-08T18:31:17.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.262+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.262+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x7f8534021070 2024-05-08T18:31:17.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.263+0000 7f853a140640 1 -- 172.21.15.87:0/2853855907 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f852c088040 con 0x7f8534021070 2024-05-08T18:31:17.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.263+0000 7f853a140640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x55d0ddce4f40 2024-05-08T18:31:17.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.263+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8534028070 con 0x55d0ddce4f40 2024-05-08T18:31:17.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.263+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x7f852c0a2040 2024-05-08T18:31:17.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.263+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.263+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x55d0ddcdecf0 2024-05-08T18:31:17.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.263+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.263+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7a20 con 0x7f8534021070 2024-05-08T18:31:17.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.264+0000 7f853a140640 1 -- 172.21.15.87:0/2853855907 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f852c088040 con 0x7f8534021070 2024-05-08T18:31:17.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.264+0000 7f853ea0f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:17.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.264+0000 7f853ea0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:17.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.264+0000 7f853ea0f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:17.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.264+0000 7f853ea0f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:17.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.264+0000 7f853ea0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:17.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.264+0000 7f853ea0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:17.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.264+0000 7f853ea0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.264+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce39b0 con 0x55d0ddcdecf0 2024-05-08T18:31:17.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.264+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.264+0000 7f853ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.264+0000 7f853ea0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.264+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce4250 con 0x55d0ddcdecf0 2024-05-08T18:31:17.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.264+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.264+0000 7f853ea0f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:17.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.264+0000 7f853ea0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.264+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce7ea0 con 0x7f852c0a2040 2024-05-08T18:31:17.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:17.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 20 zone default found 2024-05-08T18:31:17.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 4 Realm: () 2024-05-08T18:31:17.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:17.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:17.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:17.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 20 zonegroup default 2024-05-08T18:31:17.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce8350 con 0x7f852c0a2040 2024-05-08T18:31:17.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce9d30 con 0x55d0ddce4f40 2024-05-08T18:31:17.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8534028070 con 0x55d0ddce4f40 2024-05-08T18:31:17.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddcea190 con 0x55d0ddce4f40 2024-05-08T18:31:17.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8534028070 con 0x55d0ddce4f40 2024-05-08T18:31:17.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 20 started sync module instance, tier type = 2024-05-08T18:31:17.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:17.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.265+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce91c0 con 0x7f8534021070 2024-05-08T18:31:17.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.266+0000 7f853a140640 1 -- 172.21.15.87:0/2853855907 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f852c088040 con 0x7f8534021070 2024-05-08T18:31:17.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.267+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94355562862000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce8e20 con 0x7f8534021070 2024-05-08T18:31:17.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.267+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddceb0c0 con 0x55d0ddcdecf0 2024-05-08T18:31:17.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.268+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.268+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94355562868208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddceb8c0 con 0x55d0ddcdecf0 2024-05-08T18:31:17.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.268+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddcec3e0 con 0x55d0ddce4f40 2024-05-08T18:31:17.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.269+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94355562868208] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.270+0000 7f853a140640 1 -- 172.21.15.87:0/2853855907 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94355562862000] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f852c088040 con 0x7f8534021070 2024-05-08T18:31:17.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.271+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8534028070 con 0x55d0ddce4f40 2024-05-08T18:31:17.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.271+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94355562866160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddcec3a0 con 0x55d0ddce4f40 2024-05-08T18:31:17.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.271+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddcecc80 con 0x7f8534021070 2024-05-08T18:31:17.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.271+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94355562866160] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8534028070 con 0x55d0ddce4f40 2024-05-08T18:31:17.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.274+0000 7f853a140640 1 -- 172.21.15.87:0/2853855907 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f852c088040 con 0x7f8534021070 2024-05-08T18:31:17.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.274+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94355562874832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddced020 con 0x7f8534021070 2024-05-08T18:31:17.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.274+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddced870 con 0x55d0ddcdecf0 2024-05-08T18:31:17.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.276+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.276+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94355562878368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddcedff0 con 0x55d0ddcdecf0 2024-05-08T18:31:17.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.276+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddceeb10 con 0x7f852c0a2040 2024-05-08T18:31:17.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.281+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94355562878368] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.281+0000 7f853a140640 1 -- 172.21.15.87:0/2853855907 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94355562874832] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f852c088040 con 0x7f8534021070 2024-05-08T18:31:17.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.283+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.283+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94355562872496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddceead0 con 0x7f852c0a2040 2024-05-08T18:31:17.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.283+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddcef3b0 con 0x7f852c0a2040 2024-05-08T18:31:17.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.284+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(56 notify.6 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.284+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94355562884784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddceead0 con 0x7f852c0a2040 2024-05-08T18:31:17.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.284+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddcefee0 con 0x7f852c0a2040 2024-05-08T18:31:17.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.284+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94355562872496] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.285+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94355562884784] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.285+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.285+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94355562887632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddcef2d0 con 0x7f852c0a2040 2024-05-08T18:31:17.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.285+0000 7f853ea0f800 20 add_watcher() i=0 2024-05-08T18:31:17.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.285+0000 7f853ea0f800 20 add_watcher() i=1 2024-05-08T18:31:17.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.285+0000 7f853ea0f800 20 add_watcher() i=2 2024-05-08T18:31:17.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.285+0000 7f853ea0f800 20 add_watcher() i=3 2024-05-08T18:31:17.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.285+0000 7f853ea0f800 20 add_watcher() i=4 2024-05-08T18:31:17.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.285+0000 7f853ea0f800 20 add_watcher() i=5 2024-05-08T18:31:17.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.285+0000 7f853ea0f800 20 add_watcher() i=6 2024-05-08T18:31:17.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.286+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94355562887632] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.286+0000 7f853ea0f800 20 add_watcher() i=7 2024-05-08T18:31:17.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.286+0000 7f853ea0f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:17.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.286+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddcf2ed0 con 0x55d0ddcdecf0 2024-05-08T18:31:17.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.286+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.286+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94355562882528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddcf0350 con 0x55d0ddcdecf0 2024-05-08T18:31:17.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.287+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94355562882528] v27'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.287+0000 7f83f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:17.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.287+0000 7f853ea0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:17.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.287+0000 7f853ea0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:17.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.287+0000 7f853ea0f800 5 note: GC not initialized 2024-05-08T18:31:17.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.288+0000 7f836b7fe640 20 reqs_thread_entry: start 2024-05-08T18:31:17.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.288+0000 7f853ea0f800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:17.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.288+0000 7f853ea0f800 20 Filter name: none 2024-05-08T18:31:17.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.288+0000 7f83697fa640 20 reqs_thread_entry: start 2024-05-08T18:31:17.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.288+0000 7f853ea0f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:31:17.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.288+0000 7f853ea0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.288+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddd26260 con 0x7f852c0a2040 2024-05-08T18:31:17.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.288+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.288+0000 7f853ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.288+0000 7f853ea0f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-08T18:31:17.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.288+0000 7f853ea0f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:31:17.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.288+0000 7f853ea0f800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-05-08T18:31:17.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.288+0000 7f853ea0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.288+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddd24a00 con 0x55d0ddcdecf0 2024-05-08T18:31:17.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.289+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.289+0000 7f853ea0f800 20 rados_obj.operate() r=0 bl.length=7 2024-05-08T18:31:17.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.289+0000 7f853ea0f800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-05-08T18:31:17.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.289+0000 7f853ea0f800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-08T18:31:17.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.289+0000 7f853ea0f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:17.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.289+0000 7f853ea0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.289+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddd24df0 con 0x55d0ddcdecf0 2024-05-08T18:31:17.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.289+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.289+0000 7f853ea0f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:17.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.289+0000 7f853ea0f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:17.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.289+0000 7f853ea0f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:17.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.289+0000 7f853ea0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:17.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.289+0000 7f853ea0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-05-08T18:31:17.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.289+0000 7f853ea0f800 20 get_user_info_from_index found 0 xattrs 2024-05-08T18:31:17.303 INFO:teuthology.orchestra.run.smithi087.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-05-08T18:31:17.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.290+0000 7f83f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:17.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.290+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94355562882528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddcdb8d0 con 0x55d0ddcdecf0 2024-05-08T18:31:17.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.291+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94355562882528] v27'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.291+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94355562862000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddcee5e0 con 0x7f8534021070 2024-05-08T18:31:17.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.297+0000 7f853a140640 1 -- 172.21.15.87:0/2853855907 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94355562862000] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f852c088040 con 0x7f8534021070 2024-05-08T18:31:17.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.297+0000 7f853ea0f800 20 remove_watcher() i=0 2024-05-08T18:31:17.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.297+0000 7f853ea0f800 2 removed watcher, disabling cache 2024-05-08T18:31:17.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.297+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94355562868208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce95b0 con 0x55d0ddcdecf0 2024-05-08T18:31:17.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.298+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94355562868208] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.298+0000 7f853ea0f800 20 remove_watcher() i=1 2024-05-08T18:31:17.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.298+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94355562866160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce95b0 con 0x55d0ddce4f40 2024-05-08T18:31:17.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.299+0000 7f853a941640 1 -- 172.21.15.87:0/2853855907 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94355562866160] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8534028070 con 0x55d0ddce4f40 2024-05-08T18:31:17.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.299+0000 7f853ea0f800 20 remove_watcher() i=2 2024-05-08T18:31:17.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.299+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94355562874832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce95b0 con 0x7f8534021070 2024-05-08T18:31:17.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.300+0000 7f853a140640 1 -- 172.21.15.87:0/2853855907 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94355562874832] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f852c088040 con 0x7f8534021070 2024-05-08T18:31:17.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.300+0000 7f853ea0f800 20 remove_watcher() i=3 2024-05-08T18:31:17.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.300+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94355562878368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce95b0 con 0x55d0ddcdecf0 2024-05-08T18:31:17.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.301+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94355562878368] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853002a040 con 0x55d0ddcdecf0 2024-05-08T18:31:17.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.301+0000 7f853ea0f800 20 remove_watcher() i=4 2024-05-08T18:31:17.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.301+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94355562872496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddced5a0 con 0x7f852c0a2040 2024-05-08T18:31:17.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.303+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94355562872496] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.303+0000 7f853ea0f800 20 remove_watcher() i=5 2024-05-08T18:31:17.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.303+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94355562884784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddce95b0 con 0x7f852c0a2040 2024-05-08T18:31:17.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.304+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94355562884784] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.304+0000 7f853ea0f800 20 remove_watcher() i=6 2024-05-08T18:31:17.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.304+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94355562887632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d0ddcebeb0 con 0x7f852c0a2040 2024-05-08T18:31:17.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94355562887632] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853002a040 con 0x7f852c0a2040 2024-05-08T18:31:17.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 20 remove_watcher() i=7 2024-05-08T18:31:17.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f852c0a2040 msgr2=0x7f852c094440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f852c0a2040 0x7f852c094440 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d0ddcdecf0 msgr2=0x55d0ddce11b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d0ddcdecf0 0x55d0ddce11b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8534021070 msgr2=0x7f853402b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8534021070 0x7f853402b880 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55d0ddce4f40 msgr2=0x55d0ddce7350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55d0ddce4f40 0x55d0ddce7350 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f840403bba0 msgr2=0x7f840403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f840403bba0 0x7f840403e060 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f852c05b780 tx=0x7f852c08d000 comp rx=0 tx=0).stop 2024-05-08T18:31:17.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddccbd20 msgr2=0x55d0ddcd32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853993f640 1 -- 172.21.15.87:0/2853855907 reap_dead start 2024-05-08T18:31:17.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddccbd20 0x55d0ddcd32f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f85340076b0 tx=0x7f85340529f0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 shutdown_connections 2024-05-08T18:31:17.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2853855907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddccbd20 0x55d0ddcd32f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 >> 172.21.15.87:0/2853855907 conn(0x55d0ddcc7fe0 msgr2=0x55d0ddcc6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 shutdown_connections 2024-05-08T18:31:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 -- 172.21.15.87:0/2853855907 wait complete. 2024-05-08T18:31:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 -- 172.21.15.87:0/3391251834 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f841403bb50 msgr2=0x7f841403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 --2- 172.21.15.87:0/3391251834 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f841403bb50 0x7f841403e010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f852c078b20 tx=0x7f852c051480 comp rx=0 tx=0).stop 2024-05-08T18:31:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 -- 172.21.15.87:0/3391251834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddb1def0 msgr2=0x55d0ddb1c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 --2- 172.21.15.87:0/3391251834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddb1def0 0x55d0ddb1c360 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55d0ddca2650 tx=0x7f853400ef30 comp rx=0 tx=0).stop 2024-05-08T18:31:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 -- 172.21.15.87:0/3391251834 shutdown_connections 2024-05-08T18:31:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 --2- 172.21.15.87:0/3391251834 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f841403bb50 0x7f841403e010 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 --2- 172.21.15.87:0/3391251834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddb1def0 0x55d0ddb1c360 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.306+0000 7f853ea0f800 1 -- 172.21.15.87:0/3391251834 >> 172.21.15.87:0/3391251834 conn(0x55d0ddcb0820 msgr2=0x55d0ddcb0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 -- 172.21.15.87:0/3391251834 shutdown_connections 2024-05-08T18:31:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 -- 172.21.15.87:0/3391251834 wait complete. 2024-05-08T18:31:17.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 -- 172.21.15.87:0/2948707148 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d0ddcabbd0 msgr2=0x55d0ddcadfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d0ddcabbd0 0x55d0ddcadfc0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 -- 172.21.15.87:0/2948707148 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d0ddba9490 msgr2=0x55d0ddca8490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d0ddba9490 0x55d0ddca8490 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 -- 172.21.15.87:0/2948707148 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f842003bba0 msgr2=0x7f842003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f842003bba0 0x7f842003e060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8530000f60 tx=0x7f85300012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 -- 172.21.15.87:0/2948707148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 msgr2=0x55d0ddca1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 0x55d0ddca1250 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f852c0526d0 tx=0x7f852c003330 comp rx=0 tx=0).stop 2024-05-08T18:31:17.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 -- 172.21.15.87:0/2948707148 shutdown_connections 2024-05-08T18:31:17.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d0ddba9490 0x55d0ddca8490 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d0ddcabbd0 0x55d0ddcadfc0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f842003bba0 0x7f842003e060 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 --2- 172.21.15.87:0/2948707148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0ddba82d0 0x55d0ddca1250 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 -- 172.21.15.87:0/2948707148 >> 172.21.15.87:0/2948707148 conn(0x55d0ddba3850 msgr2=0x55d0ddc93850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 -- 172.21.15.87:0/2948707148 shutdown_connections 2024-05-08T18:31:17.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.307+0000 7f853ea0f800 1 -- 172.21.15.87:0/2948707148 wait complete. 2024-05-08T18:31:17.315 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-05-08T18:31:17.315 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:31:17.315 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:31:17.315 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:31:17.359 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:17.360 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:17.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.362+0000 7fefe8f2e800 1 Processor -- start 2024-05-08T18:31:17.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.362+0000 7fefe8f2e800 1 -- start start 2024-05-08T18:31:17.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.362+0000 7fefe8f2e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5576f6529b80 0x5576f6529fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.362+0000 7fefe8f2e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5576f649e630 con 0x5576f652a4e0 2024-05-08T18:31:17.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.362+0000 7fefe8f2e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5576f63cbe20 con 0x5576f6529b80 2024-05-08T18:31:17.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.363+0000 7fefe4c84640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5576f6529b80 0x5576f6529fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.363+0000 7fefdffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5576f652a4e0 0x5576f652a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41898/0 (socket says 172.21.15.87:41898) 2024-05-08T18:31:17.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.363+0000 7fefe4c84640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5576f6529b80 0x5576f6529fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60890/0 (socket says 172.21.15.87:60890) 2024-05-08T18:31:17.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.363+0000 7fefdffff640 1 -- 172.21.15.87:0/2612672454 learned_addr learned my addr 172.21.15.87:0/2612672454 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:17.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.363+0000 7fefe4c84640 1 -- 172.21.15.87:0/2612672454 >> v1:172.21.15.53:6789/0 conn(0x5576f652a4e0 legacy=0x5576f652a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.363+0000 7fefe4c84640 1 -- 172.21.15.87:0/2612672454 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576f652b0a0 con 0x5576f6529b80 2024-05-08T18:31:17.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.365+0000 7fefe4c84640 1 --2- 172.21.15.87:0/2612672454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 0x5576f6529fa0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fefd800a470 tx=0x7fefd801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9dd906abaf59dd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.365+0000 7fefdf7fe640 1 -- 172.21.15.87:0/2612672454 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd8057070 con 0x5576f6529b80 2024-05-08T18:31:17.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.365+0000 7fefdf7fe640 1 -- 172.21.15.87:0/2612672454 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd8052570 con 0x5576f6529b80 2024-05-08T18:31:17.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.365+0000 7fefdf7fe640 1 -- 172.21.15.87:0/2612672454 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd8052870 con 0x5576f6529b80 2024-05-08T18:31:17.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.365+0000 7fefe8f2e800 1 -- 172.21.15.87:0/2612672454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 msgr2=0x5576f6529fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.365+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/2612672454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 0x5576f6529fa0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fefd800a470 tx=0x7fefd801ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:17.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.366+0000 7fefe8f2e800 1 -- 172.21.15.87:0/2612672454 shutdown_connections 2024-05-08T18:31:17.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.366+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/2612672454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 0x5576f6529fa0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.366+0000 7fefe8f2e800 1 -- 172.21.15.87:0/2612672454 >> 172.21.15.87:0/2612672454 conn(0x5576f6525720 msgr2=0x5576f6527b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.366+0000 7fefe8f2e800 1 -- 172.21.15.87:0/2612672454 shutdown_connections 2024-05-08T18:31:17.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.366+0000 7fefe8f2e800 1 -- 172.21.15.87:0/2612672454 wait complete. 2024-05-08T18:31:17.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.379+0000 7fefe8f2e800 1 Processor -- start 2024-05-08T18:31:17.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.380+0000 7fefe8f2e800 1 -- start start 2024-05-08T18:31:17.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.380+0000 7fefe8f2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 0x5576f661ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.380+0000 7fefe8f2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5576f64765b0 con 0x5576f6529b80 2024-05-08T18:31:17.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.380+0000 7fefe4c84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 0x5576f661ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.380+0000 7fefe4c84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 0x5576f661ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60898/0 (socket says 172.21.15.87:60898) 2024-05-08T18:31:17.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.380+0000 7fefe4c84640 1 -- 172.21.15.87:0/1897403776 learned_addr learned my addr 172.21.15.87:0/1897403776 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.380+0000 7fefe4c84640 1 -- 172.21.15.87:0/1897403776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576f661f050 con 0x5576f6529b80 2024-05-08T18:31:17.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.380+0000 7fefe4c84640 1 --2- 172.21.15.87:0/1897403776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 0x5576f661ea80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fefd8055040 tx=0x7fefd804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e8111d57d87714 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.381+0000 7feed2e05640 1 -- 172.21.15.87:0/1897403776 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd8057040 con 0x5576f6529b80 2024-05-08T18:31:17.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.381+0000 7feed2e05640 1 -- 172.21.15.87:0/1897403776 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd8052990 con 0x5576f6529b80 2024-05-08T18:31:17.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.381+0000 7feed2e05640 1 -- 172.21.15.87:0/1897403776 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd8052c70 con 0x5576f6529b80 2024-05-08T18:31:17.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.381+0000 7fefe8f2e800 1 -- 172.21.15.87:0/1897403776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 msgr2=0x5576f661ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.381+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/1897403776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 0x5576f661ea80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fefd8055040 tx=0x7fefd804c000 comp rx=0 tx=0).stop 2024-05-08T18:31:17.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.381+0000 7fefe8f2e800 1 -- 172.21.15.87:0/1897403776 shutdown_connections 2024-05-08T18:31:17.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.381+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/1897403776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 0x5576f661ea80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.381+0000 7fefe8f2e800 1 -- 172.21.15.87:0/1897403776 >> 172.21.15.87:0/1897403776 conn(0x5576f6525720 msgr2=0x5576f661a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.381+0000 7fefe8f2e800 1 -- 172.21.15.87:0/1897403776 shutdown_connections 2024-05-08T18:31:17.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.381+0000 7fefe8f2e800 1 -- 172.21.15.87:0/1897403776 wait complete. 2024-05-08T18:31:17.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.382+0000 7fefe8f2e800 1 Processor -- start 2024-05-08T18:31:17.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.382+0000 7fefe8f2e800 1 -- start start 2024-05-08T18:31:17.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.382+0000 7fefe8f2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 0x5576f66264d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.382+0000 7fefe8f2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5576f652b5d0 con 0x5576f6529b80 2024-05-08T18:31:17.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.382+0000 7fefe4c84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 0x5576f66264d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.382+0000 7fefe4c84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 0x5576f66264d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60902/0 (socket says 172.21.15.87:60902) 2024-05-08T18:31:17.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.382+0000 7fefe4c84640 1 -- 172.21.15.87:0/851770693 learned_addr learned my addr 172.21.15.87:0/851770693 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.382+0000 7fefe4c84640 1 -- 172.21.15.87:0/851770693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576f6626a10 con 0x5576f6529b80 2024-05-08T18:31:17.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.382+0000 7fefe4c84640 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 0x5576f66264d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fefd800a470 tx=0x7fefd8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.383+0000 7feed1602640 1 -- 172.21.15.87:0/851770693 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd8073070 con 0x5576f6529b80 2024-05-08T18:31:17.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.383+0000 7feed1602640 1 -- 172.21.15.87:0/851770693 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd805d650 con 0x5576f6529b80 2024-05-08T18:31:17.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.383+0000 7fefe8f2e800 1 -- 172.21.15.87:0/851770693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576f6626ca0 con 0x5576f6529b80 2024-05-08T18:31:17.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.383+0000 7feed1602640 1 -- 172.21.15.87:0/851770693 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd8057070 con 0x5576f6529b80 2024-05-08T18:31:17.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.383+0000 7fefe8f2e800 1 -- 172.21.15.87:0/851770693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576f6629950 con 0x5576f6529b80 2024-05-08T18:31:17.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.383+0000 7feed1602640 1 -- 172.21.15.87:0/851770693 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fefd8076070 con 0x5576f6529b80 2024-05-08T18:31:17.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.384+0000 7feed1602640 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7feecc03bba0 0x7feecc03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.384+0000 7feed1602640 1 -- 172.21.15.87:0/851770693 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fefd80942f0 con 0x5576f6529b80 2024-05-08T18:31:17.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.384+0000 7fefdffff640 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7feecc03bba0 0x7feecc03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.384+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5576f652a4e0 0x5576f662d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.384+0000 7fefe8f2e800 1 -- 172.21.15.87:0/851770693 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f662dc50 con 0x5576f652a4e0 2024-05-08T18:31:17.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.384+0000 7fefe5485640 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5576f652a4e0 0x5576f662d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.384+0000 7fefdffff640 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7feecc03bba0 0x7feecc03e060 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fefd0001d90 tx=0x7fefd00012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.384+0000 7fefe5485640 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5576f652a4e0 0x5576f662d710 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.384+0000 7fefe5485640 1 -- 172.21.15.87:0/851770693 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefe000a4a0 con 0x5576f652a4e0 2024-05-08T18:31:17.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.384+0000 7fefe8f2e800 1 -- 172.21.15.87:0/851770693 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f662e4f0 con 0x5576f652a4e0 2024-05-08T18:31:17.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.385+0000 7fefe5485640 1 -- 172.21.15.87:0/851770693 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fefe000a4a0 con 0x5576f652a4e0 2024-05-08T18:31:17.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.385+0000 7fefe8f2e800 1 -- 172.21.15.87:0/851770693 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f662f8a0 con 0x5576f652a4e0 2024-05-08T18:31:17.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.385+0000 7fefe5485640 1 -- 172.21.15.87:0/851770693 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fefe000a4a0 con 0x5576f652a4e0 2024-05-08T18:31:17.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.385+0000 7fefe8f2e800 1 -- 172.21.15.87:0/851770693 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f662ed40 con 0x5576f652a4e0 2024-05-08T18:31:17.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.385+0000 7fefe5485640 1 -- 172.21.15.87:0/851770693 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fefe000a4a0 con 0x5576f652a4e0 2024-05-08T18:31:17.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.385+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5576f6630c50 0x5576f6633040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.385+0000 7fefe8f2e800 1 -- 172.21.15.87:0/851770693 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f6633650 con 0x5576f6630c50 2024-05-08T18:31:17.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.386+0000 7fefe4c84640 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5576f6630c50 0x5576f6633040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.386+0000 7fefe4c84640 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5576f6630c50 0x5576f6633040 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.386+0000 7fefe4c84640 1 -- 172.21.15.87:0/851770693 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fefd8075030 con 0x5576f6630c50 2024-05-08T18:31:17.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.387+0000 7fefe8f2e800 1 Processor -- start 2024-05-08T18:31:17.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.387+0000 7fefe8f2e800 1 -- start start 2024-05-08T18:31:17.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.387+0000 7fefe8f2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f66419a0 0x5576f6641dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.387+0000 7fefe8f2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5576f641cfc0 con 0x5576f66419a0 2024-05-08T18:31:17.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.387+0000 7fefe5485640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f66419a0 0x5576f6641dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.387+0000 7fefe5485640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f66419a0 0x5576f6641dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60904/0 (socket says 172.21.15.87:60904) 2024-05-08T18:31:17.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.387+0000 7fefe5485640 1 -- 172.21.15.87:0/761116993 learned_addr learned my addr 172.21.15.87:0/761116993 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.387+0000 7fefe5485640 1 -- 172.21.15.87:0/761116993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576f6642300 con 0x5576f66419a0 2024-05-08T18:31:17.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.387+0000 7fefe5485640 1 --2- 172.21.15.87:0/761116993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f66419a0 0x5576f6641dc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5576f66278d0 tx=0x7fefe00178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.388+0000 7feeca7fc640 1 -- 172.21.15.87:0/761116993 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefe0013440 con 0x5576f66419a0 2024-05-08T18:31:17.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.388+0000 7feeca7fc640 1 -- 172.21.15.87:0/761116993 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe00135e0 con 0x5576f66419a0 2024-05-08T18:31:17.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.388+0000 7fefe8f2e800 1 -- 172.21.15.87:0/761116993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576f6642d70 con 0x5576f66419a0 2024-05-08T18:31:17.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.388+0000 7feeca7fc640 1 -- 172.21.15.87:0/761116993 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefe00138c0 con 0x5576f66419a0 2024-05-08T18:31:17.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.388+0000 7fefe8f2e800 1 -- 172.21.15.87:0/761116993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576f6643270 con 0x5576f66419a0 2024-05-08T18:31:17.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.388+0000 7feeca7fc640 1 -- 172.21.15.87:0/761116993 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fefe0011040 con 0x5576f66419a0 2024-05-08T18:31:17.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.389+0000 7feeca7fc640 1 --2- 172.21.15.87:0/761116993 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7feebc03bba0 0x7feebc03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.389+0000 7feeca7fc640 1 -- 172.21.15.87:0/761116993 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fefe001d070 con 0x5576f66419a0 2024-05-08T18:31:17.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.389+0000 7fefe4c84640 1 --2- 172.21.15.87:0/761116993 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7feebc03bba0 0x7feebc03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.389+0000 7fefe8f2e800 1 Processor -- start 2024-05-08T18:31:17.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.389+0000 7fefe4c84640 1 --2- 172.21.15.87:0/761116993 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7feebc03bba0 0x7feebc03e060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fefd805b730 tx=0x7fefd8053f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.389+0000 7fefe8f2e800 1 -- start start 2024-05-08T18:31:17.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.389+0000 7fefe8f2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f664ecf0 0x5576f664f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.389+0000 7fefe8f2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5576f661f310 con 0x5576f664ecf0 2024-05-08T18:31:17.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.389+0000 7fefe5485640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f664ecf0 0x5576f664f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.389+0000 7fefe5485640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f664ecf0 0x5576f664f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60914/0 (socket says 172.21.15.87:60914) 2024-05-08T18:31:17.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.389+0000 7fefe5485640 1 -- 172.21.15.87:0/4178688012 learned_addr learned my addr 172.21.15.87:0/4178688012 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.390+0000 7fefe5485640 1 -- 172.21.15.87:0/4178688012 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576f664f6e0 con 0x5576f664ecf0 2024-05-08T18:31:17.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.390+0000 7fefe5485640 1 --2- 172.21.15.87:0/4178688012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f664ecf0 0x5576f664f110 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fefe0052970 tx=0x7fefe0001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c74c8bf1c7c751c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.390+0000 7feebbfff640 1 -- 172.21.15.87:0/4178688012 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefe0021d70 con 0x5576f664ecf0 2024-05-08T18:31:17.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.390+0000 7feebbfff640 1 -- 172.21.15.87:0/4178688012 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe002ac50 con 0x5576f664ecf0 2024-05-08T18:31:17.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.390+0000 7feebbfff640 1 -- 172.21.15.87:0/4178688012 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefe00540d0 con 0x5576f664ecf0 2024-05-08T18:31:17.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.390+0000 7fefe8f2e800 1 -- 172.21.15.87:0/4178688012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f664ecf0 msgr2=0x5576f664f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.390+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/4178688012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f664ecf0 0x5576f664f110 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fefe0052970 tx=0x7fefe0001b30 comp rx=0 tx=0).stop 2024-05-08T18:31:17.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.390+0000 7fefe8f2e800 1 -- 172.21.15.87:0/4178688012 shutdown_connections 2024-05-08T18:31:17.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.390+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/4178688012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f664ecf0 0x5576f664f110 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.390+0000 7fefe8f2e800 1 -- 172.21.15.87:0/4178688012 >> 172.21.15.87:0/4178688012 conn(0x5576f664afc0 msgr2=0x5576f6649020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.390+0000 7fefe8f2e800 1 -- 172.21.15.87:0/4178688012 shutdown_connections 2024-05-08T18:31:17.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.390+0000 7fefe8f2e800 1 -- 172.21.15.87:0/4178688012 wait complete. 2024-05-08T18:31:17.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.391+0000 7fefe8f2e800 1 Processor -- start 2024-05-08T18:31:17.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.391+0000 7fefe8f2e800 1 -- start start 2024-05-08T18:31:17.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.391+0000 7fefe8f2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f664ecf0 0x5576f6656280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.391+0000 7fefe8f2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5576f664fea0 con 0x5576f664ecf0 2024-05-08T18:31:17.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.391+0000 7fefe5485640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f664ecf0 0x5576f6656280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.391+0000 7fefe5485640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f664ecf0 0x5576f6656280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60920/0 (socket says 172.21.15.87:60920) 2024-05-08T18:31:17.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.391+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 learned_addr learned my addr 172.21.15.87:0/843890005 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.391+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576f66567c0 con 0x5576f664ecf0 2024-05-08T18:31:17.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.391+0000 7fefe5485640 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f664ecf0 0x5576f6656280 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fefe0001f40 tx=0x7fefe000a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.392+0000 7feeba7fc640 1 -- 172.21.15.87:0/843890005 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefe0030020 con 0x5576f664ecf0 2024-05-08T18:31:17.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.392+0000 7feeba7fc640 1 -- 172.21.15.87:0/843890005 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe0015ab0 con 0x5576f664ecf0 2024-05-08T18:31:17.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.392+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576f6656a50 con 0x5576f664ecf0 2024-05-08T18:31:17.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.392+0000 7feeba7fc640 1 -- 172.21.15.87:0/843890005 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefe002ae00 con 0x5576f664ecf0 2024-05-08T18:31:17.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.392+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576f6659700 con 0x5576f664ecf0 2024-05-08T18:31:17.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.392+0000 7feeba7fc640 1 -- 172.21.15.87:0/843890005 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fefe0033020 con 0x5576f664ecf0 2024-05-08T18:31:17.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.393+0000 7feeba7fc640 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7feeb003bb00 0x7feeb003dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.393+0000 7feeba7fc640 1 -- 172.21.15.87:0/843890005 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fefe000e040 con 0x5576f664ecf0 2024-05-08T18:31:17.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.393+0000 7fefe4c84640 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7feeb003bb00 0x7feeb003dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.393+0000 7fefe8f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.393+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5576f6661fa0 0x5576f6664460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.393+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f6664bb0 con 0x5576f6661fa0 2024-05-08T18:31:17.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.393+0000 7fefdffff640 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5576f6661fa0 0x5576f6664460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.393+0000 7fefe4c84640 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7feeb003bb00 0x7feeb003dfc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fefd8092980 tx=0x7fefd8087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.393+0000 7fefdffff640 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5576f6661fa0 0x5576f6664460 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.393+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefd0009050 con 0x5576f6661fa0 2024-05-08T18:31:17.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.393+0000 7fefe8f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.393+0000 7fefe8f2e800 20 realm 2024-05-08T18:31:17.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.393+0000 7fefe8f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.393+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f66613f0 con 0x5576f6661fa0 2024-05-08T18:31:17.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefd0009050 con 0x5576f6661fa0 2024-05-08T18:31:17.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefe8f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefe8f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:17.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefe8f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f6665690 con 0x5576f6661fa0 2024-05-08T18:31:17.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefd0009050 con 0x5576f6661fa0 2024-05-08T18:31:17.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefe8f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefe8f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f6665f60 con 0x5576f6661fa0 2024-05-08T18:31:17.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fefd0009050 con 0x5576f6661fa0 2024-05-08T18:31:17.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefe8f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:17.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefe8f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f6666300 con 0x5576f6661fa0 2024-05-08T18:31:17.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fefd0009050 con 0x5576f6661fa0 2024-05-08T18:31:17.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefe8f2e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:17.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefe8f2e800 20 searching for the correct realm 2024-05-08T18:31:17.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5576f66681e0 0x5576f666a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.394+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x5576f66681e0 2024-05-08T18:31:17.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.395+0000 7fefe5485640 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5576f66681e0 0x5576f666a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.395+0000 7fefe5485640 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5576f66681e0 0x5576f666a5d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.395+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefe0029070 con 0x5576f66681e0 2024-05-08T18:31:17.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.395+0000 7fefe5485640 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fefe0035020 0x7fefe00298f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.395+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x7fefe0035020 2024-05-08T18:31:17.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.395+0000 7fefe4c84640 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fefe0035020 0x7fefe00298f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.396+0000 7fefe4c84640 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fefe0035020 0x7fefe00298f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.396+0000 7fefe4c84640 1 -- 172.21.15.87:0/843890005 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd8075030 con 0x7fefe0035020 2024-05-08T18:31:17.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.396+0000 7fefe4c84640 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fefd80a2040 0x7fefd808b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.396+0000 7fefe4c84640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x7fefd80a2040 2024-05-08T18:31:17.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.396+0000 7fefdffff640 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fefd80a2040 0x7fefd808b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.397+0000 7fefdffff640 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fefd80a2040 0x7fefd808b530 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.397+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd0009050 con 0x7fefd80a2040 2024-05-08T18:31:17.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.397+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x5576f6661fa0 2024-05-08T18:31:17.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.397+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd0009050 con 0x5576f6661fa0 2024-05-08T18:31:17.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.397+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x5576f6661fa0 2024-05-08T18:31:17.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.397+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.397+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x7fefd80a2040 2024-05-08T18:31:17.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.398+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.398+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x7fefd80a2040 2024-05-08T18:31:17.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.398+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.398+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x7fefe0035020 2024-05-08T18:31:17.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.398+0000 7fefe4c84640 1 -- 172.21.15.87:0/843890005 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd8075030 con 0x7fefe0035020 2024-05-08T18:31:17.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.398+0000 7fefe4c84640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x5576f66681e0 2024-05-08T18:31:17.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.398+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefe0029070 con 0x5576f66681e0 2024-05-08T18:31:17.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.398+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x5576f6661fa0 2024-05-08T18:31:17.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.399+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.399+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x7fefd80a2040 2024-05-08T18:31:17.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.399+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.399+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x5576f6661fa0 2024-05-08T18:31:17.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.399+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.399+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x7fefe0035020 2024-05-08T18:31:17.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.399+0000 7fefe4c84640 1 -- 172.21.15.87:0/843890005 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fefd8075030 con 0x7fefe0035020 2024-05-08T18:31:17.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.399+0000 7fefe4c84640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x5576f66681e0 2024-05-08T18:31:17.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.400+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefe0029070 con 0x5576f66681e0 2024-05-08T18:31:17.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.400+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x5576f66681e0 2024-05-08T18:31:17.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.400+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefe0029070 con 0x5576f66681e0 2024-05-08T18:31:17.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.400+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x7fefd80a2040 2024-05-08T18:31:17.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.400+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.400+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x5576f66681e0 2024-05-08T18:31:17.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.400+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefe0029070 con 0x5576f66681e0 2024-05-08T18:31:17.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.400+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x5576f66681e0 2024-05-08T18:31:17.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.400+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefe0029070 con 0x5576f66681e0 2024-05-08T18:31:17.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.401+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x5576f6661fa0 2024-05-08T18:31:17.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.401+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.401+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x5576f6661fa0 2024-05-08T18:31:17.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.401+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.401+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x7fefd80a2040 2024-05-08T18:31:17.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.401+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.401+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x5576f66681e0 2024-05-08T18:31:17.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.402+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefe0029070 con 0x5576f66681e0 2024-05-08T18:31:17.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.402+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x7fefe0035020 2024-05-08T18:31:17.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.402+0000 7fefe4c84640 1 -- 172.21.15.87:0/843890005 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd8075030 con 0x7fefe0035020 2024-05-08T18:31:17.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.402+0000 7fefe4c84640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x5576f6661fa0 2024-05-08T18:31:17.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.402+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.402+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x7fefd80a2040 2024-05-08T18:31:17.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.402+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.402+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x5576f66681e0 2024-05-08T18:31:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.403+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefe0029070 con 0x5576f66681e0 2024-05-08T18:31:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.403+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x7fefd80a2040 2024-05-08T18:31:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.403+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.403+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x7fefe0035020 2024-05-08T18:31:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.403+0000 7fefe4c84640 1 -- 172.21.15.87:0/843890005 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd8075030 con 0x7fefe0035020 2024-05-08T18:31:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.403+0000 7fefe4c84640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x5576f66681e0 2024-05-08T18:31:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.403+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefe0029070 con 0x5576f66681e0 2024-05-08T18:31:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.403+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x7fefd80a2040 2024-05-08T18:31:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.404+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.404+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x5576f6661fa0 2024-05-08T18:31:17.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.404+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.404+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ac80 con 0x7fefe0035020 2024-05-08T18:31:17.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.404+0000 7fefe4c84640 1 -- 172.21.15.87:0/843890005 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd8075030 con 0x7fefe0035020 2024-05-08T18:31:17.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.404+0000 7fefe8f2e800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:17.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.404+0000 7fefe8f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:17.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.404+0000 7fefe8f2e800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:17.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.404+0000 7fefe8f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:17.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.404+0000 7fefe8f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:17.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.404+0000 7fefe8f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:17.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.404+0000 7fefe8f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.404+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f6666cb0 con 0x5576f6661fa0 2024-05-08T18:31:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefe8f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefe8f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f6667550 con 0x5576f6661fa0 2024-05-08T18:31:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefe8f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefe8f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f66668f0 con 0x7fefd80a2040 2024-05-08T18:31:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefe8f2e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefe8f2e800 20 zone default found 2024-05-08T18:31:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefe8f2e800 4 Realm: () 2024-05-08T18:31:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefe8f2e800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefe8f2e800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefe8f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefe8f2e800 20 zonegroup default 2024-05-08T18:31:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefe8f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.405+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f666b100 con 0x7fefd80a2040 2024-05-08T18:31:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.406+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.406+0000 7fefe8f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.406+0000 7fefe8f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.406+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f666cf90 con 0x5576f66681e0 2024-05-08T18:31:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.406+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fefe0029070 con 0x5576f66681e0 2024-05-08T18:31:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.406+0000 7fefe8f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.406+0000 7fefe8f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.406+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f666d330 con 0x5576f66681e0 2024-05-08T18:31:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.406+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fefe0029070 con 0x5576f66681e0 2024-05-08T18:31:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.406+0000 7fefe8f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.406+0000 7fefe8f2e800 20 started sync module instance, tier type = 2024-05-08T18:31:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.406+0000 7fefe8f2e800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.406+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f666c3d0 con 0x7fefe0035020 2024-05-08T18:31:17.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.407+0000 7fefe4c84640 1 -- 172.21.15.87:0/843890005 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd8075030 con 0x7fefe0035020 2024-05-08T18:31:17.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.407+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93969428432880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f666c030 con 0x7fefe0035020 2024-05-08T18:31:17.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.407+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f666e030 con 0x5576f6661fa0 2024-05-08T18:31:17.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.408+0000 7fefe4c84640 1 -- 172.21.15.87:0/843890005 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93969428432880] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd8075030 con 0x7fefe0035020 2024-05-08T18:31:17.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.408+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.408+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93969428437168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f666e420 con 0x5576f6661fa0 2024-05-08T18:31:17.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.408+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f666ee70 con 0x5576f66681e0 2024-05-08T18:31:17.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.409+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93969428437168] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.410+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefe0029070 con 0x5576f66681e0 2024-05-08T18:31:17.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.410+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93969428441440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f666f260 con 0x5576f66681e0 2024-05-08T18:31:17.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.410+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f666fca0 con 0x7fefe0035020 2024-05-08T18:31:17.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.411+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93969428441440] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefe0029070 con 0x5576f66681e0 2024-05-08T18:31:17.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.412+0000 7fefe4c84640 1 -- 172.21.15.87:0/843890005 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd8075030 con 0x7fefe0035020 2024-05-08T18:31:17.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.412+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93969428445040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f6670090 con 0x7fefe0035020 2024-05-08T18:31:17.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.412+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f6670ad0 con 0x5576f6661fa0 2024-05-08T18:31:17.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.416+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.416+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93969428448672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f6671370 con 0x5576f6661fa0 2024-05-08T18:31:17.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.416+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f6671e10 con 0x7fefd80a2040 2024-05-08T18:31:17.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.418+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.418+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93969428453600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f6671dd0 con 0x7fefd80a2040 2024-05-08T18:31:17.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.418+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f6672d80 con 0x7fefd80a2040 2024-05-08T18:31:17.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.419+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(56 notify.6 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.419+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93969428457648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f6673230 con 0x7fefd80a2040 2024-05-08T18:31:17.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.419+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f6673cd0 con 0x7fefd80a2040 2024-05-08T18:31:17.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.420+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93969428453600] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.420+0000 7fefe4c84640 1 -- 172.21.15.87:0/843890005 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93969428445040] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd8075030 con 0x7fefe0035020 2024-05-08T18:31:17.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.421+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93969428457648] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.424+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93969428448672] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.424+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.424+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93969428438416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f66737a0 con 0x7fefd80a2040 2024-05-08T18:31:17.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.424+0000 7fefe8f2e800 20 add_watcher() i=0 2024-05-08T18:31:17.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.424+0000 7fefe8f2e800 20 add_watcher() i=1 2024-05-08T18:31:17.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.424+0000 7fefe8f2e800 20 add_watcher() i=2 2024-05-08T18:31:17.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.424+0000 7fefe8f2e800 20 add_watcher() i=3 2024-05-08T18:31:17.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.424+0000 7fefe8f2e800 20 add_watcher() i=4 2024-05-08T18:31:17.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.424+0000 7fefe8f2e800 20 add_watcher() i=5 2024-05-08T18:31:17.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.424+0000 7fefe8f2e800 20 add_watcher() i=6 2024-05-08T18:31:17.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.425+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93969428438416] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.425+0000 7fefe8f2e800 20 add_watcher() i=7 2024-05-08T18:31:17.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.425+0000 7fefe8f2e800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:17.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.425+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f6672200 con 0x5576f6661fa0 2024-05-08T18:31:17.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.426+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.426+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93969428451008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f6672200 con 0x5576f6661fa0 2024-05-08T18:31:17.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.428+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93969428451008] v27'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.428+0000 7fee9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:17.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.428+0000 7fefe8f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:17.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.428+0000 7fefe8f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:17.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.428+0000 7fefe8f2e800 5 note: GC not initialized 2024-05-08T18:31:17.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.428+0000 7fee99fe3640 20 reqs_thread_entry: start 2024-05-08T18:31:17.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.429+0000 7fefe8f2e800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:17.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.429+0000 7fefe8f2e800 20 Filter name: none 2024-05-08T18:31:17.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.429+0000 7fee0b7fe640 20 reqs_thread_entry: start 2024-05-08T18:31:17.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.429+0000 7fefe8f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.429+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576f66a91a0 con 0x5576f6661fa0 2024-05-08T18:31:17.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.429+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.429+0000 7fefe8f2e800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:17.445 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:17.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.430+0000 7fee9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:17.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.430+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93969428451008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f66a80f0 con 0x5576f6661fa0 2024-05-08T18:31:17.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.431+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93969428451008] v27'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.431+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93969428432880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f6670ec0 con 0x7fefe0035020 2024-05-08T18:31:17.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.432+0000 7fefe4c84640 1 -- 172.21.15.87:0/843890005 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93969428432880] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd8075030 con 0x7fefe0035020 2024-05-08T18:31:17.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.432+0000 7fefe8f2e800 20 remove_watcher() i=0 2024-05-08T18:31:17.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.432+0000 7fefe8f2e800 2 removed watcher, disabling cache 2024-05-08T18:31:17.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.432+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93969428437168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f666c7f0 con 0x5576f6661fa0 2024-05-08T18:31:17.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.433+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93969428437168] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.433+0000 7fefe8f2e800 20 remove_watcher() i=1 2024-05-08T18:31:17.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.433+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93969428441440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f666c7f0 con 0x5576f66681e0 2024-05-08T18:31:17.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.434+0000 7fefe5485640 1 -- 172.21.15.87:0/843890005 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93969428441440] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefe0029070 con 0x5576f66681e0 2024-05-08T18:31:17.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.434+0000 7fefe8f2e800 20 remove_watcher() i=2 2024-05-08T18:31:17.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.434+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93969428445040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f666e960 con 0x7fefe0035020 2024-05-08T18:31:17.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.435+0000 7fefe4c84640 1 -- 172.21.15.87:0/843890005 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93969428445040] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd8075030 con 0x7fefe0035020 2024-05-08T18:31:17.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.435+0000 7fefe8f2e800 20 remove_watcher() i=3 2024-05-08T18:31:17.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.435+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93969428448672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f666c7f0 con 0x5576f6661fa0 2024-05-08T18:31:17.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.437+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93969428448672] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x5576f6661fa0 2024-05-08T18:31:17.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.437+0000 7fefe8f2e800 20 remove_watcher() i=4 2024-05-08T18:31:17.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.437+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93969428453600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f666e960 con 0x7fefd80a2040 2024-05-08T18:31:17.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.438+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93969428453600] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.438+0000 7fefe8f2e800 20 remove_watcher() i=5 2024-05-08T18:31:17.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.438+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93969428457648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f66705a0 con 0x7fefd80a2040 2024-05-08T18:31:17.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.439+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93969428457648] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.440+0000 7fefe8f2e800 20 remove_watcher() i=6 2024-05-08T18:31:17.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.440+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93969428438416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576f66705a0 con 0x7fefd80a2040 2024-05-08T18:31:17.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93969428438416] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd002a040 con 0x7fefd80a2040 2024-05-08T18:31:17.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 20 remove_watcher() i=7 2024-05-08T18:31:17.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fefd80a2040 msgr2=0x7fefd808b530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fefd80a2040 0x7fefd808b530 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5576f6661fa0 msgr2=0x5576f6664460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5576f6661fa0 0x5576f6664460 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fefe0035020 msgr2=0x7fefe00298f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fefe0035020 0x7fefe00298f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5576f66681e0 msgr2=0x5576f666a5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5576f66681e0 0x5576f666a5d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7feeb003bb00 msgr2=0x7feeb003dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7feeb003bb00 0x7feeb003dfc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fefd8092980 tx=0x7fefd8087000 comp rx=0 tx=0).stop 2024-05-08T18:31:17.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f664ecf0 msgr2=0x5576f6656280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefdffff640 1 -- 172.21.15.87:0/843890005 reap_dead start 2024-05-08T18:31:17.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f664ecf0 0x5576f6656280 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fefe0001f40 tx=0x7fefe000a0e0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 shutdown_connections 2024-05-08T18:31:17.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/843890005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f664ecf0 0x5576f6656280 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 >> 172.21.15.87:0/843890005 conn(0x5576f664afc0 msgr2=0x5576f6648ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 shutdown_connections 2024-05-08T18:31:17.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 -- 172.21.15.87:0/843890005 wait complete. 2024-05-08T18:31:17.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 -- 172.21.15.87:0/761116993 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7feebc03bba0 msgr2=0x7feebc03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/761116993 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7feebc03bba0 0x7feebc03e060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fefd805b730 tx=0x7fefd8053f50 comp rx=0 tx=0).stop 2024-05-08T18:31:17.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 -- 172.21.15.87:0/761116993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f66419a0 msgr2=0x5576f6641dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/761116993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f66419a0 0x5576f6641dc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5576f66278d0 tx=0x7fefe00178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 -- 172.21.15.87:0/761116993 shutdown_connections 2024-05-08T18:31:17.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/761116993 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7feebc03bba0 0x7feebc03e060 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/761116993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f66419a0 0x5576f6641dc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 -- 172.21.15.87:0/761116993 >> 172.21.15.87:0/761116993 conn(0x5576f6635a40 msgr2=0x5576f6635e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 -- 172.21.15.87:0/761116993 shutdown_connections 2024-05-08T18:31:17.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.441+0000 7fefe8f2e800 1 -- 172.21.15.87:0/761116993 wait complete. 2024-05-08T18:31:17.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.442+0000 7fefe8f2e800 1 -- 172.21.15.87:0/851770693 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5576f6630c50 msgr2=0x5576f6633040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.442+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5576f6630c50 0x5576f6633040 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.442+0000 7fefe8f2e800 1 -- 172.21.15.87:0/851770693 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5576f652a4e0 msgr2=0x5576f662d710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.442+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5576f652a4e0 0x5576f662d710 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.442+0000 7fefe8f2e800 1 -- 172.21.15.87:0/851770693 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7feecc03bba0 msgr2=0x7feecc03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.442+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7feecc03bba0 0x7feecc03e060 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fefd0001d90 tx=0x7fefd00012f0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.442+0000 7fefe8f2e800 1 -- 172.21.15.87:0/851770693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 msgr2=0x5576f66264d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.442+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 0x5576f66264d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fefd800a470 tx=0x7fefd8003020 comp rx=0 tx=0).stop 2024-05-08T18:31:17.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.442+0000 7fefe8f2e800 1 -- 172.21.15.87:0/851770693 shutdown_connections 2024-05-08T18:31:17.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.442+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5576f652a4e0 0x5576f662d710 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.442+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5576f6630c50 0x5576f6633040 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.442+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7feecc03bba0 0x7feecc03e060 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.442+0000 7fefe8f2e800 1 --2- 172.21.15.87:0/851770693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576f6529b80 0x5576f66264d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.442+0000 7fefe8f2e800 1 -- 172.21.15.87:0/851770693 >> 172.21.15.87:0/851770693 conn(0x5576f6525720 msgr2=0x5576f6618ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.442+0000 7fefe8f2e800 1 -- 172.21.15.87:0/851770693 shutdown_connections 2024-05-08T18:31:17.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.442+0000 7fefe8f2e800 1 -- 172.21.15.87:0/851770693 wait complete. 2024-05-08T18:31:17.460 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:17.461 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-05-08T18:31:17.461 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-05-08T18:31:17.461 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-05-08T18:31:17.505 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:17.505 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:17.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.507+0000 7ff8b4e1f800 1 Processor -- start 2024-05-08T18:31:17.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.507+0000 7ff8b4e1f800 1 -- start start 2024-05-08T18:31:17.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.508+0000 7ff8b4e1f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5646683fcde0 0x5646683fb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.508+0000 7ff8b4e1f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5646683fbdc0 con 0x5646683fb880 2024-05-08T18:31:17.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.508+0000 7ff8b4e1f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x564668327e20 con 0x5646683fcde0 2024-05-08T18:31:17.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.508+0000 7ff8b291e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5646683fcde0 0x5646683fb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.508+0000 7ff8aa11d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5646683fb880 0x56466848f140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41902/0 (socket says 172.21.15.87:41902) 2024-05-08T18:31:17.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.508+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1588302925 learned_addr learned my addr 172.21.15.87:0/1588302925 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:17.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.508+0000 7ff8b291e640 1 -- 172.21.15.87:0/1588302925 >> v1:172.21.15.53:6789/0 conn(0x5646683fb880 legacy=0x56466848f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.508+0000 7ff8b291e640 1 -- 172.21.15.87:0/1588302925 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646683fbf90 con 0x5646683fcde0 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.510+0000 7ff8b291e640 1 --2- 172.21.15.87:0/1588302925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fcde0 0x5646683fb340 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400a470 tx=0x7ff8a401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd8ecdf21ee4b28 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.510+0000 7ff8b211d640 1 -- 172.21.15.87:0/1588302925 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8a4057070 con 0x5646683fcde0 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.510+0000 7ff8b211d640 1 -- 172.21.15.87:0/1588302925 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a404adc0 con 0x5646683fcde0 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.510+0000 7ff8b211d640 1 -- 172.21.15.87:0/1588302925 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8a4052590 con 0x5646683fcde0 2024-05-08T18:31:17.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.511+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1588302925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fcde0 msgr2=0x5646683fb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.511+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/1588302925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fcde0 0x5646683fb340 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400a470 tx=0x7ff8a401ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.511+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1588302925 shutdown_connections 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.511+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/1588302925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fcde0 0x5646683fb340 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.511+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1588302925 >> 172.21.15.87:0/1588302925 conn(0x564668482830 msgr2=0x564668484c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.511+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1588302925 shutdown_connections 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.511+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1588302925 wait complete. 2024-05-08T18:31:17.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.524+0000 7ff8b4e1f800 1 Processor -- start 2024-05-08T18:31:17.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.524+0000 7ff8b4e1f800 1 -- start start 2024-05-08T18:31:17.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.525+0000 7ff8b4e1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fb880 0x56466857a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.525+0000 7ff8b4e1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5646683d25b0 con 0x5646683fb880 2024-05-08T18:31:17.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.525+0000 7ff8b291e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fb880 0x56466857a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.525+0000 7ff8b291e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fb880 0x56466857a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60934/0 (socket says 172.21.15.87:60934) 2024-05-08T18:31:17.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.525+0000 7ff8b291e640 1 -- 172.21.15.87:0/3409110534 learned_addr learned my addr 172.21.15.87:0/3409110534 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.525+0000 7ff8b291e640 1 -- 172.21.15.87:0/3409110534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56466857ae90 con 0x5646683fb880 2024-05-08T18:31:17.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.525+0000 7ff8b291e640 1 --2- 172.21.15.87:0/3409110534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fb880 0x56466857a8c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff8a401ced0 tx=0x7ff8a404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9049c93578353f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.526+0000 7ff7a0e09640 1 -- 172.21.15.87:0/3409110534 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8a4057040 con 0x5646683fb880 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.526+0000 7ff7a0e09640 1 -- 172.21.15.87:0/3409110534 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a4063070 con 0x5646683fb880 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.526+0000 7ff7a0e09640 1 -- 172.21.15.87:0/3409110534 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8a4052800 con 0x5646683fb880 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.526+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/3409110534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fb880 msgr2=0x56466857a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.526+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/3409110534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fb880 0x56466857a8c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff8a401ced0 tx=0x7ff8a404c000 comp rx=0 tx=0).stop 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.526+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/3409110534 shutdown_connections 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.526+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/3409110534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fb880 0x56466857a8c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.526+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/3409110534 >> 172.21.15.87:0/3409110534 conn(0x564668482830 msgr2=0x5646685761e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.526+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/3409110534 shutdown_connections 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.526+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/3409110534 wait complete. 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.527+0000 7ff8b4e1f800 1 Processor -- start 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.527+0000 7ff8b4e1f800 1 -- start start 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.527+0000 7ff8b4e1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fb880 0x564668582370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.527+0000 7ff8b4e1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564668492b40 con 0x5646683fb880 2024-05-08T18:31:17.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.527+0000 7ff8b291e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fb880 0x564668582370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.527+0000 7ff8b291e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fb880 0x564668582370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60944/0 (socket says 172.21.15.87:60944) 2024-05-08T18:31:17.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.527+0000 7ff8b291e640 1 -- 172.21.15.87:0/2426427256 learned_addr learned my addr 172.21.15.87:0/2426427256 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.527+0000 7ff8b291e640 1 -- 172.21.15.87:0/2426427256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646685828b0 con 0x5646683fb880 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.528+0000 7ff8b291e640 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fb880 0x564668582370 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff8a404ad90 tx=0x7ff8a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.528+0000 7ff79f606640 1 -- 172.21.15.87:0/2426427256 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8a406d070 con 0x5646683fb880 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.528+0000 7ff79f606640 1 -- 172.21.15.87:0/2426427256 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a4052d00 con 0x5646683fb880 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.528+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2426427256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564668582b40 con 0x5646683fb880 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.528+0000 7ff79f606640 1 -- 172.21.15.87:0/2426427256 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8a4057050 con 0x5646683fb880 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.528+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2426427256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646685857f0 con 0x5646683fb880 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.529+0000 7ff79f606640 1 -- 172.21.15.87:0/2426427256 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff8a405d470 con 0x5646683fb880 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.529+0000 7ff79f606640 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff79803bb50 0x7ff79803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.529+0000 7ff79f606640 1 -- 172.21.15.87:0/2426427256 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff8a4093ab0 con 0x5646683fb880 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.529+0000 7ff8aa11d640 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff79803bb50 0x7ff79803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.529+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5646683fcde0 0x5646685895b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.529+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2426427256 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564668589b80 con 0x5646683fcde0 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.529+0000 7ff8b311f640 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5646683fcde0 0x5646685895b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.529+0000 7ff8aa11d640 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff79803bb50 0x7ff79803e010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff89c000f60 tx=0x7ff89c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.530+0000 7ff8b311f640 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5646683fcde0 0x5646685895b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.530+0000 7ff8b311f640 1 -- 172.21.15.87:0/2426427256 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8ac00a4a0 con 0x5646683fcde0 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.530+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2426427256 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564668586b80 con 0x5646683fcde0 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.530+0000 7ff8b311f640 1 -- 172.21.15.87:0/2426427256 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff8ac00a4a0 con 0x5646683fcde0 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.530+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2426427256 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56466858b9f0 con 0x5646683fcde0 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.530+0000 7ff8b311f640 1 -- 172.21.15.87:0/2426427256 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff8ac00a4a0 con 0x5646683fcde0 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.530+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2426427256 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56466858ab30 con 0x5646683fcde0 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.531+0000 7ff8b311f640 1 -- 172.21.15.87:0/2426427256 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff8ac00a4a0 con 0x5646683fcde0 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.531+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56466858b600 0x56466858ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.531+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2426427256 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56466858f5d0 con 0x56466858b600 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.531+0000 7ff8b291e640 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56466858b600 0x56466858ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.531+0000 7ff8b291e640 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56466858b600 0x56466858ee40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.531+0000 7ff8b291e640 1 -- 172.21.15.87:0/2426427256 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff8a405a040 con 0x56466858b600 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.532+0000 7ff8b4e1f800 1 Processor -- start 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.532+0000 7ff8b4e1f800 1 -- start start 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.532+0000 7ff8b4e1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56466859d920 0x56466859dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.532+0000 7ff8b4e1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564668378fc0 con 0x56466859d920 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.532+0000 7ff8b311f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56466859d920 0x56466859dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.532+0000 7ff8b311f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56466859d920 0x56466859dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60954/0 (socket says 172.21.15.87:60954) 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.532+0000 7ff8b311f640 1 -- 172.21.15.87:0/2616946204 learned_addr learned my addr 172.21.15.87:0/2616946204 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.532+0000 7ff8b311f640 1 -- 172.21.15.87:0/2616946204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56466859e280 con 0x56466859d920 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.532+0000 7ff8b311f640 1 --2- 172.21.15.87:0/2616946204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56466859d920 0x56466859dd40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x564668589f60 tx=0x7ff8ac0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.533+0000 7ff79ce01640 1 -- 172.21.15.87:0/2616946204 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac013440 con 0x56466859d920 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.533+0000 7ff79ce01640 1 -- 172.21.15.87:0/2616946204 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ac0135e0 con 0x56466859d920 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.533+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2616946204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56466859ecf0 con 0x56466859d920 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.533+0000 7ff79ce01640 1 -- 172.21.15.87:0/2616946204 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac0138c0 con 0x56466859d920 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.533+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2616946204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56466859f1f0 con 0x56466859d920 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.533+0000 7ff79ce01640 1 -- 172.21.15.87:0/2616946204 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff8ac011040 con 0x56466859d920 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.534+0000 7ff79ce01640 1 --2- 172.21.15.87:0/2616946204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff78c03bb50 0x7ff78c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.534+0000 7ff79ce01640 1 -- 172.21.15.87:0/2616946204 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff8ac01d070 con 0x56466859d920 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.534+0000 7ff8b291e640 1 --2- 172.21.15.87:0/2616946204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff78c03bb50 0x7ff78c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.534+0000 7ff8b4e1f800 1 Processor -- start 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.534+0000 7ff8b291e640 1 --2- 172.21.15.87:0/2616946204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff78c03bb50 0x7ff78c03e010 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4091f60 tx=0x7ff8a405fcd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.534+0000 7ff8b4e1f800 1 -- start start 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.534+0000 7ff8b4e1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646685aabf0 0x5646685ab010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.534+0000 7ff8b4e1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56466857b150 con 0x5646685aabf0 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.534+0000 7ff8b311f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646685aabf0 0x5646685ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.534+0000 7ff8b311f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646685aabf0 0x5646685ab010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60970/0 (socket says 172.21.15.87:60970) 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.534+0000 7ff8b311f640 1 -- 172.21.15.87:0/4215599122 learned_addr learned my addr 172.21.15.87:0/4215599122 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.535+0000 7ff8b311f640 1 -- 172.21.15.87:0/4215599122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646685ab5e0 con 0x5646685aabf0 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.535+0000 7ff8b311f640 1 --2- 172.21.15.87:0/4215599122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646685aabf0 0x5646685ab010 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac052ae0 tx=0x7ff8ac021de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62a1508d0f2120 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.535+0000 7ff7967fc640 1 -- 172.21.15.87:0/4215599122 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac015a80 con 0x5646685aabf0 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.535+0000 7ff7967fc640 1 -- 172.21.15.87:0/4215599122 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ac015430 con 0x5646685aabf0 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.535+0000 7ff7967fc640 1 -- 172.21.15.87:0/4215599122 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac02a350 con 0x5646685aabf0 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.535+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/4215599122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646685aabf0 msgr2=0x5646685ab010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.535+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/4215599122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646685aabf0 0x5646685ab010 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac052ae0 tx=0x7ff8ac021de0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.535+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/4215599122 shutdown_connections 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.535+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/4215599122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646685aabf0 0x5646685ab010 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.535+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/4215599122 >> 172.21.15.87:0/4215599122 conn(0x5646685a6fa0 msgr2=0x5646685a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.535+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/4215599122 shutdown_connections 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.535+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/4215599122 wait complete. 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.536+0000 7ff8b4e1f800 1 Processor -- start 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.536+0000 7ff8b4e1f800 1 -- start start 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.536+0000 7ff8b4e1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646685aabf0 0x5646685b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.536+0000 7ff8b4e1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5646685abd40 con 0x5646685aabf0 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.536+0000 7ff8b311f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646685aabf0 0x5646685b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.536+0000 7ff8b311f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646685aabf0 0x5646685b21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60984/0 (socket says 172.21.15.87:60984) 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.536+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 learned_addr learned my addr 172.21.15.87:0/1721182157 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.536+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646685b26e0 con 0x5646685aabf0 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.537+0000 7ff8b311f640 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646685aabf0 0x5646685b21a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac042040 tx=0x7ff8ac052a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.537+0000 7ff794ff9640 1 -- 172.21.15.87:0/1721182157 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac030070 con 0x5646685aabf0 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.537+0000 7ff794ff9640 1 -- 172.21.15.87:0/1721182157 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ac013c20 con 0x5646685aabf0 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.537+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646685b2970 con 0x5646685aabf0 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.537+0000 7ff794ff9640 1 -- 172.21.15.87:0/1721182157 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac051320 con 0x5646685aabf0 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.537+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646685b5620 con 0x5646685aabf0 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.537+0000 7ff794ff9640 1 -- 172.21.15.87:0/1721182157 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff8ac033070 con 0x5646685aabf0 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.538+0000 7ff794ff9640 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff77c03bb50 0x7ff77c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.538+0000 7ff794ff9640 1 -- 172.21.15.87:0/1721182157 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff8ac00e040 con 0x5646685aabf0 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.538+0000 7ff8b291e640 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff77c03bb50 0x7ff77c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.538+0000 7ff8b291e640 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff77c03bb50 0x7ff77c03e010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x56466858f9d0 tx=0x7ff8a4083000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.538+0000 7ff8b4e1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.538+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5646685bde60 0x5646685c0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.538+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646685c0a70 con 0x5646685bde60 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.538+0000 7ff8aa11d640 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5646685bde60 0x5646685c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.539+0000 7ff8aa11d640 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5646685bde60 0x5646685c0320 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.539+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff89c009050 con 0x5646685bde60 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.539+0000 7ff8b4e1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.539+0000 7ff8b4e1f800 20 realm 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.539+0000 7ff8b4e1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.539+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646685bd2b0 con 0x5646685bde60 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.539+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff89c009050 con 0x5646685bde60 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.539+0000 7ff8b4e1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.539+0000 7ff8b4e1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.539+0000 7ff8b4e1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.539+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646685c1560 con 0x5646685bde60 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.539+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff89c009050 con 0x5646685bde60 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.539+0000 7ff8b4e1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.539+0000 7ff8b4e1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.539+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646685c1e30 con 0x5646685bde60 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.540+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff89c009050 con 0x5646685bde60 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.540+0000 7ff8b4e1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.540+0000 7ff8b4e1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.540+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646685c21d0 con 0x5646685bde60 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.540+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff89c009050 con 0x5646685bde60 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.540+0000 7ff8b4e1f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.540+0000 7ff8b4e1f800 20 searching for the correct realm 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.540+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5646685c40b0 0x5646685c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.540+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5646685c6b50 con 0x5646685c40b0 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.540+0000 7ff8b311f640 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5646685c40b0 0x5646685c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.540+0000 7ff8b311f640 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5646685c40b0 0x5646685c64a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.541+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac03c070 con 0x5646685c40b0 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.541+0000 7ff8b311f640 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff8ac035070 0x7ff8ac0558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.541+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5646685c6b50 con 0x7ff8ac035070 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.541+0000 7ff8b291e640 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff8ac035070 0x7ff8ac0558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.541+0000 7ff8b291e640 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff8ac035070 0x7ff8ac0558b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.541+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a405a040 con 0x7ff8ac035070 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.541+0000 7ff8b291e640 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff8a4066380 0x7ff8a4093050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.541+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5646685c6b50 con 0x7ff8a4066380 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.542+0000 7ff8aa11d640 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff8a4066380 0x7ff8a4093050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.542+0000 7ff8aa11d640 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff8a4066380 0x7ff8a4093050 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.542+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff89c009050 con 0x7ff8a4066380 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.542+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5646685c6b50 con 0x5646685bde60 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.543+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff89c009050 con 0x5646685bde60 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.543+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5646685c6b50 con 0x5646685bde60 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.543+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.543+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5646685c6b50 con 0x7ff8a4066380 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.543+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.543+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5646685c6b50 con 0x7ff8a4066380 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.543+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.543+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5646685c6b50 con 0x7ff8ac035070 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.544+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a405a040 con 0x7ff8ac035070 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.544+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5646685c6b50 con 0x5646685c40b0 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.544+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac03c070 con 0x5646685c40b0 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.544+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5646685c6b50 con 0x5646685bde60 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.544+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.544+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5646685c6b50 con 0x7ff8a4066380 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.544+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.544+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5646685c6b50 con 0x5646685bde60 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.544+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.544+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5646685c6b50 con 0x7ff8ac035070 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.545+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff8a405a040 con 0x7ff8ac035070 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.545+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5646685c6b50 con 0x5646685c40b0 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.545+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac03c070 con 0x5646685c40b0 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.545+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5646685c6b50 con 0x5646685c40b0 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.545+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac03c070 con 0x5646685c40b0 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.545+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff8ac062040 con 0x7ff8a4066380 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.545+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.545+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff8ac062040 con 0x5646685c40b0 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.546+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac03c070 con 0x5646685c40b0 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.546+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff8ac062040 con 0x5646685c40b0 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.546+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac03c070 con 0x5646685c40b0 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.546+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff8ac062040 con 0x5646685bde60 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.546+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.546+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff8ac062040 con 0x5646685bde60 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.546+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.546+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff8ac062040 con 0x7ff8a4066380 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.547+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.547+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff8ac062040 con 0x5646685c40b0 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.547+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac03c070 con 0x5646685c40b0 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.547+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff8ac062040 con 0x7ff8ac035070 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.547+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a405a040 con 0x7ff8ac035070 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.547+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff8ac062040 con 0x5646685bde60 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.547+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.547+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff8ac062040 con 0x7ff8a4066380 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.548+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.548+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff8ac062040 con 0x5646685c40b0 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.548+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac03c070 con 0x5646685c40b0 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.548+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff8ac062040 con 0x7ff8a4066380 2024-05-08T18:31:17.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.548+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.548+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff8ac062040 con 0x7ff8ac035070 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.549+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a405a040 con 0x7ff8ac035070 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.549+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff8ac062040 con 0x5646685c40b0 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.549+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac03c070 con 0x5646685c40b0 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.549+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff8ac062040 con 0x7ff8a4066380 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.549+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.549+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff8ac062040 con 0x5646685bde60 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.549+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.549+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff8ac062040 con 0x7ff8ac035070 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.550+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a405a040 con 0x7ff8ac035070 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.550+0000 7ff8b4e1f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.550+0000 7ff8b4e1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.550+0000 7ff8b4e1f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.550+0000 7ff8b4e1f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.550+0000 7ff8b4e1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.550+0000 7ff8b4e1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.550+0000 7ff8b4e1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.550+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646685c2b50 con 0x5646685bde60 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.550+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.550+0000 7ff8b4e1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.550+0000 7ff8b4e1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.550+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646685c33f0 con 0x5646685bde60 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.550+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.550+0000 7ff8b4e1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.550+0000 7ff8b4e1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.550+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646685c6fd0 con 0x7ff8a4066380 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 20 zone default found 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 4 Realm: () 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 20 zonegroup default 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646685c7480 con 0x7ff8a4066380 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646685c8e60 con 0x5646685c40b0 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff8ac03c070 con 0x5646685c40b0 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646685c9300 con 0x5646685c40b0 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff8ac03c070 con 0x5646685c40b0 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 20 started sync module instance, tier type = 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.551+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685c82f0 con 0x7ff8ac035070 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.552+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a405a040 con 0x7ff8ac035070 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.552+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94860398593760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685c7f50 con 0x7ff8ac035070 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.553+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685ca230 con 0x5646685bde60 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.554+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.554+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94860398600032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685caa50 con 0x5646685bde60 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.554+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685cb550 con 0x5646685c40b0 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.555+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94860398593760] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a405a040 con 0x7ff8ac035070 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.555+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8ac03c070 con 0x5646685c40b0 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.555+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94860398604352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685cb510 con 0x5646685c40b0 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.555+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94860398600032] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.555+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685cbfd0 con 0x7ff8ac035070 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.556+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94860398604352] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8ac03c070 con 0x5646685c40b0 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.557+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a405a040 con 0x7ff8ac035070 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.557+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94860398601520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685cbae0 con 0x7ff8ac035070 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.557+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685cc990 con 0x5646685bde60 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.559+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.559+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94860398609632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685ccdb0 con 0x5646685bde60 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.559+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685cd880 con 0x7ff8a4066380 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.561+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94860398601520] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a405a040 con 0x7ff8ac035070 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.561+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.561+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94860398613360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685cd840 con 0x7ff8a4066380 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.561+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685ce2b0 con 0x7ff8a4066380 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.563+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94860398609632] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.563+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94860398613360] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.565+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.565+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94860398597984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685cc900 con 0x7ff8a4066380 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.565+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685ce760 con 0x7ff8a4066380 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.566+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.566+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94860398617264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685ceb80 con 0x7ff8a4066380 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.566+0000 7ff8b4e1f800 20 add_watcher() i=0 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.566+0000 7ff8b4e1f800 20 add_watcher() i=1 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.566+0000 7ff8b4e1f800 20 add_watcher() i=2 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.566+0000 7ff8b4e1f800 20 add_watcher() i=3 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.566+0000 7ff8b4e1f800 20 add_watcher() i=4 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.566+0000 7ff8b4e1f800 20 add_watcher() i=5 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.566+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94860398597984] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.566+0000 7ff8b4e1f800 20 add_watcher() i=6 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.567+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94860398617264] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.567+0000 7ff8b4e1f800 20 add_watcher() i=7 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.567+0000 7ff8b4e1f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.567+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646685cdde0 con 0x5646685bde60 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.568+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.568+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94860398618320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685cdde0 con 0x5646685bde60 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.569+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94860398618320] v27'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.569+0000 7ff7697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.569+0000 7ff8b4e1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.569+0000 7ff8b4e1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.569+0000 7ff8b4e1f800 5 note: GC not initialized 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.569+0000 7ff6e3fff640 20 reqs_thread_entry: start 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.569+0000 7ff8b4e1f800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.569+0000 7ff8b4e1f800 20 Filter name: none 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.570+0000 7ff6e1ffb640 20 reqs_thread_entry: start 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.570+0000 7ff8b4e1f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.570+0000 7ff8b4e1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.570+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564668605100 con 0x5646685bde60 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.570+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.570+0000 7ff8b4e1f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.570+0000 7ff8b4e1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.570+0000 7ff8b4e1f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.570+0000 7ff8b4e1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.570+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564668604be0 con 0x7ff8ac035070 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.570+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7ff8a405a040 con 0x7ff8ac035070 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.570+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56466860b2e0 con 0x5646685bde60 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.571+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v27'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.571+0000 7ff8b4e1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.571+0000 7ff8b4e1f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.571+0000 7ff8b4e1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.571+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94860398865792 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564668607f50 con 0x5646685bde60 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.572+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== watch-notify(notify (1) cookie 94860398609632 notify 115964116993 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5646683fbdc0 con 0x5646685bde60 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.572+0000 7ff7967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 94860398609632 notifier 4305 bl.length()=567 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.572+0000 7ff7967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.572+0000 7ff7967fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.572+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(65 notify.4 [notify cookie 94860398865792 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.572+0000 7ff7967fc640 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7ff778003ea0 con 0x5646685bde60 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.572+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.572+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== watch-notify(notify_complete (2) cookie 94860398865792 notify 115964116993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff89c02e9f0 con 0x5646685bde60 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.573+0000 7ff7697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.573+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94860398618320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685b9e40 con 0x5646685bde60 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.574+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94860398618320] v27'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.574+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94860398593760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685ce6d0 con 0x7ff8ac035070 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.575+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94860398593760] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a405a040 con 0x7ff8ac035070 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.575+0000 7ff8b4e1f800 20 remove_watcher() i=0 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.575+0000 7ff8b4e1f800 2 removed watcher, disabling cache 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.575+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94860398600032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685ce6d0 con 0x5646685bde60 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.576+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94860398600032] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.576+0000 7ff8b4e1f800 20 remove_watcher() i=1 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.576+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94860398604352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685c9f60 con 0x5646685c40b0 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.577+0000 7ff8b311f640 1 -- 172.21.15.87:0/1721182157 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94860398604352] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8ac03c070 con 0x5646685c40b0 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.577+0000 7ff8b4e1f800 20 remove_watcher() i=2 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.577+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94860398601520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685ce6d0 con 0x7ff8ac035070 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.578+0000 7ff8b291e640 1 -- 172.21.15.87:0/1721182157 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94860398601520] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a405a040 con 0x7ff8ac035070 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.578+0000 7ff8b4e1f800 20 remove_watcher() i=3 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.578+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94860398609632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685cb040 con 0x5646685bde60 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.580+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94860398609632] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x5646685bde60 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.580+0000 7ff8b4e1f800 20 remove_watcher() i=4 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.580+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94860398613360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685c9f60 con 0x7ff8a4066380 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.581+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94860398613360] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.581+0000 7ff8b4e1f800 20 remove_watcher() i=5 2024-05-08T18:31:17.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.581+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94860398597984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685ce6d0 con 0x7ff8a4066380 2024-05-08T18:31:17.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.582+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94860398597984] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.582+0000 7ff8b4e1f800 20 remove_watcher() i=6 2024-05-08T18:31:17.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.582+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94860398617264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646685cc4e0 con 0x7ff8a4066380 2024-05-08T18:31:17.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94860398617264] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff89c02a040 con 0x7ff8a4066380 2024-05-08T18:31:17.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 20 remove_watcher() i=7 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff8a4066380 msgr2=0x7ff8a4093050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff8a4066380 0x7ff8a4093050 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5646685bde60 msgr2=0x5646685c0320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5646685bde60 0x5646685c0320 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff8ac035070 msgr2=0x7ff8ac0558b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff8ac035070 0x7ff8ac0558b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5646685c40b0 msgr2=0x5646685c64a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5646685c40b0 0x5646685c64a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff77c03bb50 msgr2=0x7ff77c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff77c03bb50 0x7ff77c03e010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x56466858f9d0 tx=0x7ff8a4083000 comp rx=0 tx=0).stop 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8aa11d640 1 -- 172.21.15.87:0/1721182157 reap_dead start 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646685aabf0 msgr2=0x5646685b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646685aabf0 0x5646685b21a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac042040 tx=0x7ff8ac052a40 comp rx=0 tx=0).stop 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 shutdown_connections 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/1721182157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646685aabf0 0x5646685b21a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 >> 172.21.15.87:0/1721182157 conn(0x5646685a6fa0 msgr2=0x5646685ac460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 shutdown_connections 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/1721182157 wait complete. 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2616946204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff78c03bb50 msgr2=0x7ff78c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/2616946204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff78c03bb50 0x7ff78c03e010 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4091f60 tx=0x7ff8a405fcd0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2616946204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56466859d920 msgr2=0x56466859dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/2616946204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56466859d920 0x56466859dd40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x564668589f60 tx=0x7ff8ac0178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2616946204 shutdown_connections 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/2616946204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff78c03bb50 0x7ff78c03e010 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.583+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/2616946204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56466859d920 0x56466859dd40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2616946204 >> 172.21.15.87:0/2616946204 conn(0x5646685919c0 msgr2=0x564668591dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2616946204 shutdown_connections 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2616946204 wait complete. 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2426427256 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56466858b600 msgr2=0x56466858ee40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56466858b600 0x56466858ee40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2426427256 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5646683fcde0 msgr2=0x5646685895b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5646683fcde0 0x5646685895b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2426427256 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff79803bb50 msgr2=0x7ff79803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff79803bb50 0x7ff79803e010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff89c000f60 tx=0x7ff89c0012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2426427256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fb880 msgr2=0x564668582370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fb880 0x564668582370 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff8a404ad90 tx=0x7ff8a4002fb0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2426427256 shutdown_connections 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5646683fcde0 0x5646685895b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56466858b600 0x56466858ee40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff79803bb50 0x7ff79803e010 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 --2- 172.21.15.87:0/2426427256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646683fb880 0x564668582370 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2426427256 >> 172.21.15.87:0/2426427256 conn(0x564668482830 msgr2=0x5646685749e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2426427256 shutdown_connections 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.584+0000 7ff8b4e1f800 1 -- 172.21.15.87:0/2426427256 wait complete. 2024-05-08T18:31:17.591 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:17.591 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:31:17.592 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:31:17.592 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:31:17.635 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:17.636 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:17.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.638+0000 7f5a2eda2800 1 Processor -- start 2024-05-08T18:31:17.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.638+0000 7f5a2eda2800 1 -- start start 2024-05-08T18:31:17.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.638+0000 7f5a2eda2800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a478342520 0x55a478342940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.638+0000 7f5a2eda2800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a478342f70 con 0x55a478345560 2024-05-08T18:31:17.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.638+0000 7f5a2eda2800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55a4781e4e20 con 0x55a478342520 2024-05-08T18:31:17.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.639+0000 7f5a2c89a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a478342520 0x55a478342940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.639+0000 7f5a2c099640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55a478345560 0x55a478345a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41918/0 (socket says 172.21.15.87:41918) 2024-05-08T18:31:17.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.639+0000 7f5a2c89a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a478342520 0x55a478342940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60986/0 (socket says 172.21.15.87:60986) 2024-05-08T18:31:17.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.639+0000 7f5a2c099640 1 -- 172.21.15.87:0/2587817933 learned_addr learned my addr 172.21.15.87:0/2587817933 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:17.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.639+0000 7f5a2c89a640 1 -- 172.21.15.87:0/2587817933 >> v1:172.21.15.53:6789/0 conn(0x55a478345560 legacy=0x55a478345a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.639+0000 7f5a2c89a640 1 -- 172.21.15.87:0/2587817933 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a478346120 con 0x55a478342520 2024-05-08T18:31:17.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.641+0000 7f5a2c89a640 1 --2- 172.21.15.87:0/2587817933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 0x55a478342940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5a24005fd0 tx=0x7f5a2401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d647a5ae9a819c3a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.641+0000 7f5a2b898640 1 -- 172.21.15.87:0/2587817933 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a24052560 con 0x55a478342520 2024-05-08T18:31:17.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.641+0000 7f5a2b898640 1 -- 172.21.15.87:0/2587817933 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a24052700 con 0x55a478342520 2024-05-08T18:31:17.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.641+0000 7f5a2b898640 1 -- 172.21.15.87:0/2587817933 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a24052a60 con 0x55a478342520 2024-05-08T18:31:17.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.641+0000 7f5a2eda2800 1 -- 172.21.15.87:0/2587817933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 msgr2=0x55a478342940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.641+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/2587817933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 0x55a478342940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5a24005fd0 tx=0x7f5a2401ccc0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.642+0000 7f5a2eda2800 1 -- 172.21.15.87:0/2587817933 shutdown_connections 2024-05-08T18:31:17.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.642+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/2587817933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 0x55a478342940 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.642+0000 7f5a2eda2800 1 -- 172.21.15.87:0/2587817933 >> 172.21.15.87:0/2587817933 conn(0x55a47833dea0 msgr2=0x55a4783402c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.642+0000 7f5a2eda2800 1 -- 172.21.15.87:0/2587817933 shutdown_connections 2024-05-08T18:31:17.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.642+0000 7f5a2eda2800 1 -- 172.21.15.87:0/2587817933 wait complete. 2024-05-08T18:31:17.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.655+0000 7f5a2eda2800 1 Processor -- start 2024-05-08T18:31:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.655+0000 7f5a2eda2800 1 -- start start 2024-05-08T18:31:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.655+0000 7f5a2eda2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 0x55a478344ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.656+0000 7f5a2eda2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a47828f5b0 con 0x55a478342520 2024-05-08T18:31:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.656+0000 7f5a2c89a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 0x55a478344ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.656+0000 7f5a2c89a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 0x55a478344ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60990/0 (socket says 172.21.15.87:60990) 2024-05-08T18:31:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.656+0000 7f5a2c89a640 1 -- 172.21.15.87:0/3152667925 learned_addr learned my addr 172.21.15.87:0/3152667925 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.656+0000 7f5a2c89a640 1 -- 172.21.15.87:0/3152667925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a478343460 con 0x55a478342520 2024-05-08T18:31:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.656+0000 7f5a2c89a640 1 --2- 172.21.15.87:0/3152667925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 0x55a478344ea0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5a24007000 tx=0x7f5a2404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e34751313153ff6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.656+0000 7f591ae0d640 1 -- 172.21.15.87:0/3152667925 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a24052cd0 con 0x55a478342520 2024-05-08T18:31:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.656+0000 7f591ae0d640 1 -- 172.21.15.87:0/3152667925 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a240528b0 con 0x55a478342520 2024-05-08T18:31:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.656+0000 7f591ae0d640 1 -- 172.21.15.87:0/3152667925 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a2405c430 con 0x55a478342520 2024-05-08T18:31:17.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.657+0000 7f5a2eda2800 1 -- 172.21.15.87:0/3152667925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 msgr2=0x55a478344ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.657+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/3152667925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 0x55a478344ea0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5a24007000 tx=0x7f5a2404c000 comp rx=0 tx=0).stop 2024-05-08T18:31:17.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.657+0000 7f5a2eda2800 1 -- 172.21.15.87:0/3152667925 shutdown_connections 2024-05-08T18:31:17.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.657+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/3152667925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 0x55a478344ea0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.657+0000 7f5a2eda2800 1 -- 172.21.15.87:0/3152667925 >> 172.21.15.87:0/3152667925 conn(0x55a47833dea0 msgr2=0x55a478431020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.657+0000 7f5a2eda2800 1 -- 172.21.15.87:0/3152667925 shutdown_connections 2024-05-08T18:31:17.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.657+0000 7f5a2eda2800 1 -- 172.21.15.87:0/3152667925 wait complete. 2024-05-08T18:31:17.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.657+0000 7f5a2eda2800 1 Processor -- start 2024-05-08T18:31:17.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.658+0000 7f5a2eda2800 1 -- start start 2024-05-08T18:31:17.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.658+0000 7f5a2eda2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 0x55a47843f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.658+0000 7f5a2eda2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a47834d9d0 con 0x55a478342520 2024-05-08T18:31:17.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.658+0000 7f5a2c89a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 0x55a47843f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.658+0000 7f5a2c89a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 0x55a47843f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60992/0 (socket says 172.21.15.87:60992) 2024-05-08T18:31:17.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.658+0000 7f5a2c89a640 1 -- 172.21.15.87:0/4100602895 learned_addr learned my addr 172.21.15.87:0/4100602895 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.658+0000 7f5a2c89a640 1 -- 172.21.15.87:0/4100602895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a47843f890 con 0x55a478342520 2024-05-08T18:31:17.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.658+0000 7f5a2c89a640 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 0x55a47843f350 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5a2401b9b0 tx=0x7f5a24003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.658+0000 7f591960a640 1 -- 172.21.15.87:0/4100602895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a24074070 con 0x55a478342520 2024-05-08T18:31:17.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.658+0000 7f591960a640 1 -- 172.21.15.87:0/4100602895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a2406f430 con 0x55a478342520 2024-05-08T18:31:17.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.658+0000 7f5a2eda2800 1 -- 172.21.15.87:0/4100602895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a47843fb20 con 0x55a478342520 2024-05-08T18:31:17.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.659+0000 7f591960a640 1 -- 172.21.15.87:0/4100602895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a2406f710 con 0x55a478342520 2024-05-08T18:31:17.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.659+0000 7f5a2eda2800 1 -- 172.21.15.87:0/4100602895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4784427d0 con 0x55a478342520 2024-05-08T18:31:17.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.659+0000 7f591960a640 1 -- 172.21.15.87:0/4100602895 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5a24077070 con 0x55a478342520 2024-05-08T18:31:17.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.660+0000 7f591960a640 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f591403bb50 0x7f591403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.660+0000 7f591960a640 1 -- 172.21.15.87:0/4100602895 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5a2406c050 con 0x55a478342520 2024-05-08T18:31:17.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.660+0000 7f5a2c099640 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f591403bb50 0x7f591403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.660+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a478345560 0x55a478446590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.660+0000 7f5a2eda2800 1 -- 172.21.15.87:0/4100602895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a478446b60 con 0x55a478345560 2024-05-08T18:31:17.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.660+0000 7f5a2d09b640 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a478345560 0x55a478446590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.660+0000 7f5a2c099640 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f591403bb50 0x7f591403e010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5a14000f60 tx=0x7f5a140012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.660+0000 7f5a2d09b640 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a478345560 0x55a478446590 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.660+0000 7f5a2d09b640 1 -- 172.21.15.87:0/4100602895 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a1c0083e0 con 0x55a478345560 2024-05-08T18:31:17.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.660+0000 7f5a2eda2800 1 -- 172.21.15.87:0/4100602895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a478443b40 con 0x55a478345560 2024-05-08T18:31:17.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.661+0000 7f5a2d09b640 1 -- 172.21.15.87:0/4100602895 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5a1c0083e0 con 0x55a478345560 2024-05-08T18:31:17.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.661+0000 7f5a2eda2800 1 -- 172.21.15.87:0/4100602895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a478448960 con 0x55a478345560 2024-05-08T18:31:17.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.661+0000 7f5a2d09b640 1 -- 172.21.15.87:0/4100602895 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5a1c0083e0 con 0x55a478345560 2024-05-08T18:31:17.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.661+0000 7f5a2eda2800 1 -- 172.21.15.87:0/4100602895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a478447b90 con 0x55a478345560 2024-05-08T18:31:17.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.661+0000 7f5a2d09b640 1 -- 172.21.15.87:0/4100602895 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5a1c0083e0 con 0x55a478345560 2024-05-08T18:31:17.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.661+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a478449d10 0x55a47844c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.661+0000 7f5a2eda2800 1 -- 172.21.15.87:0/4100602895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47844c640 con 0x55a478449d10 2024-05-08T18:31:17.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.661+0000 7f5a2c89a640 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a478449d10 0x55a47844c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.662+0000 7f5a2c89a640 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a478449d10 0x55a47844c100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.662+0000 7f5a2c89a640 1 -- 172.21.15.87:0/4100602895 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5a24094040 con 0x55a478449d10 2024-05-08T18:31:17.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.663+0000 7f5a2eda2800 1 Processor -- start 2024-05-08T18:31:17.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.663+0000 7f5a2eda2800 1 -- start start 2024-05-08T18:31:17.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.663+0000 7f5a2eda2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a47845a880 0x55a47845aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.663+0000 7f5a2eda2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a478235fc0 con 0x55a47845a880 2024-05-08T18:31:17.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.663+0000 7f5a2d09b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a47845a880 0x55a47845aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.663+0000 7f5a2d09b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a47845a880 0x55a47845aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60994/0 (socket says 172.21.15.87:60994) 2024-05-08T18:31:17.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.663+0000 7f5a2d09b640 1 -- 172.21.15.87:0/2869641971 learned_addr learned my addr 172.21.15.87:0/2869641971 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.663+0000 7f5a2d09b640 1 -- 172.21.15.87:0/2869641971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a47845b1e0 con 0x55a47845a880 2024-05-08T18:31:17.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.664+0000 7f5a2d09b640 1 --2- 172.21.15.87:0/2869641971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a47845a880 0x55a47845aca0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55a478440220 tx=0x7f5a1c00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.664+0000 7f59127fc640 1 -- 172.21.15.87:0/2869641971 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a1c01c070 con 0x55a47845a880 2024-05-08T18:31:17.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.664+0000 7f59127fc640 1 -- 172.21.15.87:0/2869641971 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a1c018410 con 0x55a47845a880 2024-05-08T18:31:17.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.664+0000 7f5a2eda2800 1 -- 172.21.15.87:0/2869641971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a47845bc50 con 0x55a47845a880 2024-05-08T18:31:17.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.664+0000 7f59127fc640 1 -- 172.21.15.87:0/2869641971 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a1c018730 con 0x55a47845a880 2024-05-08T18:31:17.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.664+0000 7f5a2eda2800 1 -- 172.21.15.87:0/2869641971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a47845c150 con 0x55a47845a880 2024-05-08T18:31:17.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.665+0000 7f59127fc640 1 -- 172.21.15.87:0/2869641971 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5a1c01f070 con 0x55a47845a880 2024-05-08T18:31:17.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.665+0000 7f59127fc640 1 --2- 172.21.15.87:0/2869641971 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f590403bb50 0x7f590403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.665+0000 7f59127fc640 1 -- 172.21.15.87:0/2869641971 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5a1c0546c0 con 0x55a47845a880 2024-05-08T18:31:17.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.665+0000 7f5a2c89a640 1 --2- 172.21.15.87:0/2869641971 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f590403bb50 0x7f590403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.665+0000 7f5a2eda2800 1 Processor -- start 2024-05-08T18:31:17.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.665+0000 7f5a2c89a640 1 --2- 172.21.15.87:0/2869641971 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f590403bb50 0x7f590403e010 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a24000f80 tx=0x7f5a24051480 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.665+0000 7f5a2eda2800 1 -- start start 2024-05-08T18:31:17.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.665+0000 7f5a2eda2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478467c30 0x55a478468050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.665+0000 7f5a2eda2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a478343780 con 0x55a478467c30 2024-05-08T18:31:17.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.666+0000 7f5a2d09b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478467c30 0x55a478468050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.666+0000 7f5a2d09b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478467c30 0x55a478468050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32774/0 (socket says 172.21.15.87:32774) 2024-05-08T18:31:17.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.666+0000 7f5a2d09b640 1 -- 172.21.15.87:0/127611876 learned_addr learned my addr 172.21.15.87:0/127611876 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.666+0000 7f5a2d09b640 1 -- 172.21.15.87:0/127611876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a478468620 con 0x55a478467c30 2024-05-08T18:31:17.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.666+0000 7f5a2d09b640 1 --2- 172.21.15.87:0/127611876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478467c30 0x55a478468050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c052a30 tx=0x7f5a1c014c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb2374f11d31337 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.666+0000 7f5903fff640 1 -- 172.21.15.87:0/127611876 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a1c0144c0 con 0x55a478467c30 2024-05-08T18:31:17.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.666+0000 7f5903fff640 1 -- 172.21.15.87:0/127611876 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a1c014660 con 0x55a478467c30 2024-05-08T18:31:17.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.666+0000 7f5903fff640 1 -- 172.21.15.87:0/127611876 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a1c017850 con 0x55a478467c30 2024-05-08T18:31:17.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.667+0000 7f5a2eda2800 1 -- 172.21.15.87:0/127611876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478467c30 msgr2=0x55a478468050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.667+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/127611876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478467c30 0x55a478468050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c052a30 tx=0x7f5a1c014c40 comp rx=0 tx=0).stop 2024-05-08T18:31:17.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.667+0000 7f5a2eda2800 1 -- 172.21.15.87:0/127611876 shutdown_connections 2024-05-08T18:31:17.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.667+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/127611876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478467c30 0x55a478468050 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.667+0000 7f5a2eda2800 1 -- 172.21.15.87:0/127611876 >> 172.21.15.87:0/127611876 conn(0x55a478463f00 msgr2=0x55a478461f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.667+0000 7f5a2eda2800 1 -- 172.21.15.87:0/127611876 shutdown_connections 2024-05-08T18:31:17.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.667+0000 7f5a2eda2800 1 -- 172.21.15.87:0/127611876 wait complete. 2024-05-08T18:31:17.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.667+0000 7f5a2eda2800 1 Processor -- start 2024-05-08T18:31:17.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.667+0000 7f5a2eda2800 1 -- start start 2024-05-08T18:31:17.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.667+0000 7f5a2eda2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478467c30 0x55a47846f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.667+0000 7f5a2eda2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a478468db0 con 0x55a478467c30 2024-05-08T18:31:17.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.668+0000 7f5a2d09b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478467c30 0x55a47846f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.668+0000 7f5a2d09b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478467c30 0x55a47846f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32782/0 (socket says 172.21.15.87:32782) 2024-05-08T18:31:17.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.668+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 learned_addr learned my addr 172.21.15.87:0/316239945 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.668+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a47846f6c0 con 0x55a478467c30 2024-05-08T18:31:17.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.668+0000 7f5a2d09b640 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478467c30 0x55a47846f180 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c052d50 tx=0x7f5a1c0529c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.668+0000 7f59027fc640 1 -- 172.21.15.87:0/316239945 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a1c018ad0 con 0x55a478467c30 2024-05-08T18:31:17.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.668+0000 7f59027fc640 1 -- 172.21.15.87:0/316239945 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a1c02f030 con 0x55a478467c30 2024-05-08T18:31:17.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.668+0000 7f59027fc640 1 -- 172.21.15.87:0/316239945 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a1c018de0 con 0x55a478467c30 2024-05-08T18:31:17.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.668+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a47846f9b0 con 0x55a478467c30 2024-05-08T18:31:17.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.668+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a478472600 con 0x55a478467c30 2024-05-08T18:31:17.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.669+0000 7f59027fc640 1 -- 172.21.15.87:0/316239945 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5a1c02b450 con 0x55a478467c30 2024-05-08T18:31:17.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.670+0000 7f59027fc640 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f58f803bb50 0x7f58f803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.670+0000 7f59027fc640 1 -- 172.21.15.87:0/316239945 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5a1c049030 con 0x55a478467c30 2024-05-08T18:31:17.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.670+0000 7f5a2eda2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.670+0000 7f5a2c89a640 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f58f803bb50 0x7f58f803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.670+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a47847ad20 0x55a47847d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.670+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47847d910 con 0x55a47847ad20 2024-05-08T18:31:17.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.670+0000 7f5a2c099640 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a47847ad20 0x55a47847d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.670+0000 7f5a2c89a640 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f58f803bb50 0x7f58f803e010 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5a24051510 tx=0x7f5a2408b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.670+0000 7f5a2c099640 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a47847ad20 0x55a47847d1c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a14009050 con 0x55a47847ad20 2024-05-08T18:31:17.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 20 realm 2024-05-08T18:31:17.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47847a230 con 0x55a47847ad20 2024-05-08T18:31:17.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a14009050 con 0x55a47847ad20 2024-05-08T18:31:17.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:17.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47847e410 con 0x55a47847ad20 2024-05-08T18:31:17.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a14009050 con 0x55a47847ad20 2024-05-08T18:31:17.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47847ece0 con 0x55a47847ad20 2024-05-08T18:31:17.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5a14009050 con 0x55a47847ad20 2024-05-08T18:31:17.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:17.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47847f080 con 0x55a47847ad20 2024-05-08T18:31:17.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5a14009050 con 0x55a47847ad20 2024-05-08T18:31:17.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:17.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 20 searching for the correct realm 2024-05-08T18:31:17.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a478480f60 0x55a478483350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.671+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x55a478480f60 2024-05-08T18:31:17.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.672+0000 7f5a2d09b640 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a478480f60 0x55a478483350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.672+0000 7f5a2d09b640 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a478480f60 0x55a478483350 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.672+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1c03b070 con 0x55a478480f60 2024-05-08T18:31:17.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.672+0000 7f5a2d09b640 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5a1c007c20 0x7f5a1c033830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.672+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x7f5a1c007c20 2024-05-08T18:31:17.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.672+0000 7f5a2c89a640 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5a1c007c20 0x7f5a1c033830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.673+0000 7f5a2c89a640 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5a1c007c20 0x7f5a1c033830 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.673+0000 7f5a2c89a640 1 -- 172.21.15.87:0/316239945 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a24094040 con 0x7f5a1c007c20 2024-05-08T18:31:17.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.673+0000 7f5a2c89a640 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f5a240a1040 0x7f5a2406e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.673+0000 7f5a2c89a640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x7f5a240a1040 2024-05-08T18:31:17.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.673+0000 7f5a2c099640 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f5a240a1040 0x7f5a2406e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.674+0000 7f5a2c099640 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f5a240a1040 0x7f5a2406e7d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.674+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a14009050 con 0x7f5a240a1040 2024-05-08T18:31:17.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.674+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x55a47847ad20 2024-05-08T18:31:17.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.674+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a14009050 con 0x55a47847ad20 2024-05-08T18:31:17.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.674+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x55a47847ad20 2024-05-08T18:31:17.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.674+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.674+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x7f5a240a1040 2024-05-08T18:31:17.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.675+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.675+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x7f5a240a1040 2024-05-08T18:31:17.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.675+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.675+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x7f5a1c007c20 2024-05-08T18:31:17.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.675+0000 7f5a2c89a640 1 -- 172.21.15.87:0/316239945 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a24094040 con 0x7f5a1c007c20 2024-05-08T18:31:17.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.675+0000 7f5a2c89a640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x55a478480f60 2024-05-08T18:31:17.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.675+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1c03b070 con 0x55a478480f60 2024-05-08T18:31:17.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.675+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x55a47847ad20 2024-05-08T18:31:17.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.675+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.675+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x7f5a240a1040 2024-05-08T18:31:17.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.676+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.676+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x55a47847ad20 2024-05-08T18:31:17.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.676+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.676+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x7f5a1c007c20 2024-05-08T18:31:17.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.676+0000 7f5a2c89a640 1 -- 172.21.15.87:0/316239945 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5a24094040 con 0x7f5a1c007c20 2024-05-08T18:31:17.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.676+0000 7f5a2c89a640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x55a478480f60 2024-05-08T18:31:17.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.677+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1c061040 con 0x55a478480f60 2024-05-08T18:31:17.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.677+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x55a478480f60 2024-05-08T18:31:17.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.677+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1c061040 con 0x55a478480f60 2024-05-08T18:31:17.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.677+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x7f5a240a1040 2024-05-08T18:31:17.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.677+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.677+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x55a478480f60 2024-05-08T18:31:17.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.678+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1c061040 con 0x55a478480f60 2024-05-08T18:31:17.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.678+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x55a478480f60 2024-05-08T18:31:17.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.678+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1c061040 con 0x55a478480f60 2024-05-08T18:31:17.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.678+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x55a47847ad20 2024-05-08T18:31:17.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.678+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.678+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x55a47847ad20 2024-05-08T18:31:17.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.678+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.678+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x7f5a240a1040 2024-05-08T18:31:17.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.679+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.679+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x55a478480f60 2024-05-08T18:31:17.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.679+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1c061040 con 0x55a478480f60 2024-05-08T18:31:17.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.679+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x7f5a1c007c20 2024-05-08T18:31:17.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.679+0000 7f5a2c89a640 1 -- 172.21.15.87:0/316239945 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a24094040 con 0x7f5a1c007c20 2024-05-08T18:31:17.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.679+0000 7f5a2c89a640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x55a47847ad20 2024-05-08T18:31:17.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.679+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.679+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x7f5a240a1040 2024-05-08T18:31:17.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.680+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.680+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x55a478480f60 2024-05-08T18:31:17.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.680+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1c061040 con 0x55a478480f60 2024-05-08T18:31:17.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.680+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x7f5a240a1040 2024-05-08T18:31:17.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.680+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.680+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x7f5a1c007c20 2024-05-08T18:31:17.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.680+0000 7f5a2c89a640 1 -- 172.21.15.87:0/316239945 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a24094040 con 0x7f5a1c007c20 2024-05-08T18:31:17.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.680+0000 7f5a2c89a640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x55a478480f60 2024-05-08T18:31:17.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.680+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1c061040 con 0x55a478480f60 2024-05-08T18:31:17.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.680+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x7f5a240a1040 2024-05-08T18:31:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.681+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.681+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x55a47847ad20 2024-05-08T18:31:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.681+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.681+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4784839d0 con 0x7f5a1c007c20 2024-05-08T18:31:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.681+0000 7f5a2c89a640 1 -- 172.21.15.87:0/316239945 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a24094040 con 0x7f5a1c007c20 2024-05-08T18:31:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.681+0000 7f5a2eda2800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.681+0000 7f5a2eda2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.681+0000 7f5a2eda2800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.681+0000 7f5a2eda2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.681+0000 7f5a2eda2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.681+0000 7f5a2eda2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.681+0000 7f5a2eda2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.681+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47847fa30 con 0x55a47847ad20 2024-05-08T18:31:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.681+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.681+0000 7f5a2eda2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.681+0000 7f5a2eda2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.681+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4784802d0 con 0x55a47847ad20 2024-05-08T18:31:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.682+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.682+0000 7f5a2eda2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.682+0000 7f5a2eda2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.682+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47847f670 con 0x7f5a240a1040 2024-05-08T18:31:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.682+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.682+0000 7f5a2eda2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.682+0000 7f5a2eda2800 20 zone default found 2024-05-08T18:31:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.682+0000 7f5a2eda2800 4 Realm: () 2024-05-08T18:31:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.682+0000 7f5a2eda2800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.682+0000 7f5a2eda2800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:17.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.682+0000 7f5a2eda2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:17.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.682+0000 7f5a2eda2800 20 zonegroup default 2024-05-08T18:31:17.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.682+0000 7f5a2eda2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.682+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a478483e30 con 0x7f5a240a1040 2024-05-08T18:31:17.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.683+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.683+0000 7f5a2eda2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.683+0000 7f5a2eda2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.683+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a478485cc0 con 0x55a478480f60 2024-05-08T18:31:17.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.683+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5a1c061040 con 0x55a478480f60 2024-05-08T18:31:17.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.683+0000 7f5a2eda2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.683+0000 7f5a2eda2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.683+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a478486060 con 0x55a478480f60 2024-05-08T18:31:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.683+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5a1c061040 con 0x55a478480f60 2024-05-08T18:31:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.683+0000 7f5a2eda2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.683+0000 7f5a2eda2800 20 started sync module instance, tier type = 2024-05-08T18:31:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.683+0000 7f5a2eda2800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.683+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a478485100 con 0x7f5a1c007c20 2024-05-08T18:31:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.684+0000 7f5a2c89a640 1 -- 172.21.15.87:0/316239945 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a24094040 con 0x7f5a1c007c20 2024-05-08T18:31:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.684+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94164881003808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4784868b0 con 0x7f5a1c007c20 2024-05-08T18:31:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.684+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a478487100 con 0x55a47847ad20 2024-05-08T18:31:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.686+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.686+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94164881009744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a478487600 con 0x55a47847ad20 2024-05-08T18:31:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.686+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a478488070 con 0x55a478480f60 2024-05-08T18:31:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.686+0000 7f5a2c89a640 1 -- 172.21.15.87:0/316239945 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94164881003808] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a24094040 con 0x7f5a1c007c20 2024-05-08T18:31:17.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.687+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1c061040 con 0x55a478480f60 2024-05-08T18:31:17.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.687+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94164881007616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4784880b0 con 0x55a478480f60 2024-05-08T18:31:17.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.687+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a478488bb0 con 0x7f5a1c007c20 2024-05-08T18:31:17.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.687+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94164881009744] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.688+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94164881007616] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1c061040 con 0x55a478480f60 2024-05-08T18:31:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.688+0000 7f5a2c89a640 1 -- 172.21.15.87:0/316239945 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a24094040 con 0x7f5a1c007c20 2024-05-08T18:31:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.688+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94164881016480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a478487bc0 con 0x7f5a1c007c20 2024-05-08T18:31:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.688+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4784895f0 con 0x55a47847ad20 2024-05-08T18:31:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.690+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.690+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94164881019680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a478489cd0 con 0x55a47847ad20 2024-05-08T18:31:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.690+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47848a7f0 con 0x7f5a240a1040 2024-05-08T18:31:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.692+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.692+0000 7f5a2c89a640 1 -- 172.21.15.87:0/316239945 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94164881016480] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a24094040 con 0x7f5a1c007c20 2024-05-08T18:31:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.692+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94164881010800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47848a7b0 con 0x7f5a240a1040 2024-05-08T18:31:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.692+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47848b200 con 0x7f5a240a1040 2024-05-08T18:31:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.692+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94164881019680] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.694+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(56 notify.6 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.694+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94164881010800] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.694+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94164881020736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47848ad50 con 0x7f5a240a1040 2024-05-08T18:31:17.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.694+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47848b710 con 0x7f5a240a1040 2024-05-08T18:31:17.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.696+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.696+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94164881027680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47848bb30 con 0x7f5a240a1040 2024-05-08T18:31:17.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.696+0000 7f5a2eda2800 20 add_watcher() i=0 2024-05-08T18:31:17.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.696+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94164881020736] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.696+0000 7f5a2eda2800 20 add_watcher() i=1 2024-05-08T18:31:17.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.696+0000 7f5a2eda2800 20 add_watcher() i=2 2024-05-08T18:31:17.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.696+0000 7f5a2eda2800 20 add_watcher() i=3 2024-05-08T18:31:17.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.696+0000 7f5a2eda2800 20 add_watcher() i=4 2024-05-08T18:31:17.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.696+0000 7f5a2eda2800 20 add_watcher() i=5 2024-05-08T18:31:17.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.696+0000 7f5a2eda2800 20 add_watcher() i=6 2024-05-08T18:31:17.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.698+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94164881027680] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.698+0000 7f5a2eda2800 20 add_watcher() i=7 2024-05-08T18:31:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.698+0000 7f5a2eda2800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.698+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47848bb30 con 0x55a47847ad20 2024-05-08T18:31:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.698+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.698+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94164881028736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47848bb10 con 0x55a47847ad20 2024-05-08T18:31:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.699+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94164881028736] v27'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.699+0000 7f58e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.699+0000 7f5a2eda2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.699+0000 7f5a2eda2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.699+0000 7f5a2eda2800 5 note: GC not initialized 2024-05-08T18:31:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.700+0000 7f58e1fe3640 20 reqs_thread_entry: start 2024-05-08T18:31:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.700+0000 7f5a2eda2800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.700+0000 7f5a2eda2800 20 Filter name: none 2024-05-08T18:31:17.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.700+0000 7f58537fe640 20 reqs_thread_entry: start 2024-05-08T18:31:17.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.700+0000 7f5a2eda2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.700+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4784c1b30 con 0x55a47847ad20 2024-05-08T18:31:17.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.700+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.700+0000 7f5a2eda2800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:17.703 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:17.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.701+0000 7f58e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:17.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.701+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94164881028736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4784c0a80 con 0x55a47847ad20 2024-05-08T18:31:17.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.702+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94164881028736] v27'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.702+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94164881003808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47848b680 con 0x7f5a1c007c20 2024-05-08T18:31:17.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.703+0000 7f5a2c89a640 1 -- 172.21.15.87:0/316239945 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94164881003808] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a24094040 con 0x7f5a1c007c20 2024-05-08T18:31:17.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.703+0000 7f5a2eda2800 20 remove_watcher() i=0 2024-05-08T18:31:17.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.703+0000 7f5a2eda2800 2 removed watcher, disabling cache 2024-05-08T18:31:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.703+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94164881009744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a478485520 con 0x55a47847ad20 2024-05-08T18:31:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.704+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94164881009744] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.705+0000 7f5a2eda2800 20 remove_watcher() i=1 2024-05-08T18:31:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.705+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94164881007616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a478485520 con 0x55a478480f60 2024-05-08T18:31:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.705+0000 7f5a2d09b640 1 -- 172.21.15.87:0/316239945 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94164881007616] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1c061040 con 0x55a478480f60 2024-05-08T18:31:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.705+0000 7f5a2eda2800 20 remove_watcher() i=2 2024-05-08T18:31:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.705+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94164881016480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a478485520 con 0x7f5a1c007c20 2024-05-08T18:31:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.706+0000 7f5a2c89a640 1 -- 172.21.15.87:0/316239945 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94164881016480] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a24094040 con 0x7f5a1c007c20 2024-05-08T18:31:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.706+0000 7f5a2eda2800 20 remove_watcher() i=3 2024-05-08T18:31:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.706+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94164881019680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a478485520 con 0x55a47847ad20 2024-05-08T18:31:17.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.708+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94164881019680] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x55a47847ad20 2024-05-08T18:31:17.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.708+0000 7f5a2eda2800 20 remove_watcher() i=4 2024-05-08T18:31:17.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.708+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94164881010800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a478489320 con 0x7f5a240a1040 2024-05-08T18:31:17.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.709+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94164881010800] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.709+0000 7f5a2eda2800 20 remove_watcher() i=5 2024-05-08T18:31:17.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.709+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94164881020736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a478489320 con 0x7f5a240a1040 2024-05-08T18:31:17.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.711+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94164881020736] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.711+0000 7f5a2eda2800 20 remove_watcher() i=6 2024-05-08T18:31:17.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.711+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94164881027680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4784897d0 con 0x7f5a240a1040 2024-05-08T18:31:17.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.712+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94164881027680] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a1402a040 con 0x7f5a240a1040 2024-05-08T18:31:17.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.712+0000 7f5a2eda2800 20 remove_watcher() i=7 2024-05-08T18:31:17.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f5a240a1040 msgr2=0x7f5a2406e7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f5a240a1040 0x7f5a2406e7d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a47847ad20 msgr2=0x55a47847d1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a47847ad20 0x55a47847d1c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5a1c007c20 msgr2=0x7f5a1c033830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5a1c007c20 0x7f5a1c033830 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a478480f60 msgr2=0x55a478483350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a478480f60 0x55a478483350 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f58f803bb50 msgr2=0x7f58f803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f58f803bb50 0x7f58f803e010 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5a24051510 tx=0x7f5a2408b000 comp rx=0 tx=0).stop 2024-05-08T18:31:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478467c30 msgr2=0x55a47846f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/316239945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478467c30 0x55a47846f180 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c052d50 tx=0x7f5a1c0529c0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 reap_dead start 2024-05-08T18:31:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2c099640 1 -- 172.21.15.87:0/316239945 reap_dead start 2024-05-08T18:31:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 shutdown_connections 2024-05-08T18:31:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 >> 172.21.15.87:0/316239945 conn(0x55a478463f00 msgr2=0x55a478461560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 shutdown_connections 2024-05-08T18:31:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 -- 172.21.15.87:0/316239945 wait complete. 2024-05-08T18:31:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 -- 172.21.15.87:0/2869641971 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f590403bb50 msgr2=0x7f590403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/2869641971 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f590403bb50 0x7f590403e010 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a24000f80 tx=0x7f5a24051480 comp rx=0 tx=0).stop 2024-05-08T18:31:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 -- 172.21.15.87:0/2869641971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a47845a880 msgr2=0x55a47845aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/2869641971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a47845a880 0x55a47845aca0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55a478440220 tx=0x7f5a1c00ef30 comp rx=0 tx=0).stop 2024-05-08T18:31:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 -- 172.21.15.87:0/2869641971 shutdown_connections 2024-05-08T18:31:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/2869641971 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f590403bb50 0x7f590403e010 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/2869641971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a47845a880 0x55a47845aca0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 -- 172.21.15.87:0/2869641971 >> 172.21.15.87:0/2869641971 conn(0x55a47844e920 msgr2=0x55a47844ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 -- 172.21.15.87:0/2869641971 shutdown_connections 2024-05-08T18:31:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.713+0000 7f5a2eda2800 1 -- 172.21.15.87:0/2869641971 wait complete. 2024-05-08T18:31:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.714+0000 7f5a2eda2800 1 -- 172.21.15.87:0/4100602895 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a478449d10 msgr2=0x55a47844c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.714+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a478449d10 0x55a47844c100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.714+0000 7f5a2eda2800 1 -- 172.21.15.87:0/4100602895 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a478345560 msgr2=0x55a478446590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.714+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a478345560 0x55a478446590 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.714+0000 7f5a2eda2800 1 -- 172.21.15.87:0/4100602895 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f591403bb50 msgr2=0x7f591403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.714+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f591403bb50 0x7f591403e010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5a14000f60 tx=0x7f5a140012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.714+0000 7f5a2eda2800 1 -- 172.21.15.87:0/4100602895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 msgr2=0x55a47843f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.714+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 0x55a47843f350 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5a2401b9b0 tx=0x7f5a24003330 comp rx=0 tx=0).stop 2024-05-08T18:31:17.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.714+0000 7f5a2eda2800 1 -- 172.21.15.87:0/4100602895 shutdown_connections 2024-05-08T18:31:17.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.714+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a478345560 0x55a478446590 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.714+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a478449d10 0x55a47844c100 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.714+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f591403bb50 0x7f591403e010 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.714+0000 7f5a2eda2800 1 --2- 172.21.15.87:0/4100602895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a478342520 0x55a47843f350 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.714+0000 7f5a2eda2800 1 -- 172.21.15.87:0/4100602895 >> 172.21.15.87:0/4100602895 conn(0x55a47833dea0 msgr2=0x55a478343ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.714+0000 7f5a2eda2800 1 -- 172.21.15.87:0/4100602895 shutdown_connections 2024-05-08T18:31:17.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.714+0000 7f5a2eda2800 1 -- 172.21.15.87:0/4100602895 wait complete. 2024-05-08T18:31:17.721 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:17.721 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-05-08T18:31:17.721 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-05-08T18:31:17.721 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-05-08T18:31:17.765 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:17.765 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:17.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.768+0000 7f67d7210800 1 Processor -- start 2024-05-08T18:31:17.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.768+0000 7f67d7210800 1 -- start start 2024-05-08T18:31:17.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.768+0000 7f67d7210800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e9e0abf7d0 0x55e9e0abfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.768+0000 7f67d7210800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e9e0ac82e0 con 0x55e9e0ac0130 2024-05-08T18:31:17.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.768+0000 7f67d7210800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e9e095fe20 con 0x55e9e0abf7d0 2024-05-08T18:31:17.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.768+0000 7f67d2876640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e9e0abf7d0 0x55e9e0abfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.768+0000 7f67d2876640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e9e0abf7d0 0x55e9e0abfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32786/0 (socket says 172.21.15.87:32786) 2024-05-08T18:31:17.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.768+0000 7f67d2876640 1 -- 172.21.15.87:0/3475347700 learned_addr learned my addr 172.21.15.87:0/3475347700 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.768+0000 7f67cbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55e9e0ac0130 0x55e9e0ac6a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41920/0 (socket says 172.21.15.87:41920) 2024-05-08T18:31:17.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.769+0000 7f67d2876640 1 -- 172.21.15.87:0/3475347700 >> v1:172.21.15.53:6789/0 conn(0x55e9e0ac0130 legacy=0x55e9e0ac6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.769+0000 7f67d2876640 1 -- 172.21.15.87:0/3475347700 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9e0ac9510 con 0x55e9e0abf7d0 2024-05-08T18:31:17.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.770+0000 7f67d2876640 1 --2- 172.21.15.87:0/3475347700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 0x55e9e0abfbf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f67c400a520 tx=0x7f67c401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c760cf202da4c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.771+0000 7f67d2075640 1 -- 172.21.15.87:0/3475347700 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c4057070 con 0x55e9e0abf7d0 2024-05-08T18:31:17.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.771+0000 7f67d2075640 1 -- 172.21.15.87:0/3475347700 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c4052570 con 0x55e9e0abf7d0 2024-05-08T18:31:17.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.771+0000 7f67d2075640 1 -- 172.21.15.87:0/3475347700 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c404ae60 con 0x55e9e0abf7d0 2024-05-08T18:31:17.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.771+0000 7f67d7210800 1 -- 172.21.15.87:0/3475347700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 msgr2=0x55e9e0abfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.771+0000 7f67d7210800 1 --2- 172.21.15.87:0/3475347700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 0x55e9e0abfbf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f67c400a520 tx=0x7f67c401d010 comp rx=0 tx=0).stop 2024-05-08T18:31:17.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.771+0000 7f67d7210800 1 -- 172.21.15.87:0/3475347700 shutdown_connections 2024-05-08T18:31:17.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.771+0000 7f67d7210800 1 --2- 172.21.15.87:0/3475347700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 0x55e9e0abfbf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.771+0000 7f67d7210800 1 -- 172.21.15.87:0/3475347700 >> 172.21.15.87:0/3475347700 conn(0x55e9e0ab8ea0 msgr2=0x55e9e0abb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.771+0000 7f67d7210800 1 -- 172.21.15.87:0/3475347700 shutdown_connections 2024-05-08T18:31:17.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.771+0000 7f67d7210800 1 -- 172.21.15.87:0/3475347700 wait complete. 2024-05-08T18:31:17.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.785+0000 7f67d7210800 1 Processor -- start 2024-05-08T18:31:17.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.785+0000 7f67d7210800 1 -- start start 2024-05-08T18:31:17.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.785+0000 7f67d7210800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 0x55e9e0bb2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.785+0000 7f67d7210800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e9e0a0a5b0 con 0x55e9e0abf7d0 2024-05-08T18:31:17.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.785+0000 7f67d2876640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 0x55e9e0bb2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.785+0000 7f67d2876640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 0x55e9e0bb2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32796/0 (socket says 172.21.15.87:32796) 2024-05-08T18:31:17.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.785+0000 7f67d2876640 1 -- 172.21.15.87:0/2859270778 learned_addr learned my addr 172.21.15.87:0/2859270778 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.785+0000 7f67d2876640 1 -- 172.21.15.87:0/2859270778 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9e0bb2e20 con 0x55e9e0abf7d0 2024-05-08T18:31:17.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.786+0000 7f67d2876640 1 --2- 172.21.15.87:0/2859270778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 0x55e9e0bb2850 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f67c4055040 tx=0x7f67c404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7130afe822184d69 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.786+0000 7f66c0e09640 1 -- 172.21.15.87:0/2859270778 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c4057040 con 0x55e9e0abf7d0 2024-05-08T18:31:17.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.786+0000 7f66c0e09640 1 -- 172.21.15.87:0/2859270778 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c4052720 con 0x55e9e0abf7d0 2024-05-08T18:31:17.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.786+0000 7f66c0e09640 1 -- 172.21.15.87:0/2859270778 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c4052a20 con 0x55e9e0abf7d0 2024-05-08T18:31:17.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.786+0000 7f67d7210800 1 -- 172.21.15.87:0/2859270778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 msgr2=0x55e9e0bb2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.786+0000 7f67d7210800 1 --2- 172.21.15.87:0/2859270778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 0x55e9e0bb2850 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f67c4055040 tx=0x7f67c404c000 comp rx=0 tx=0).stop 2024-05-08T18:31:17.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.787+0000 7f67d7210800 1 -- 172.21.15.87:0/2859270778 shutdown_connections 2024-05-08T18:31:17.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.787+0000 7f67d7210800 1 --2- 172.21.15.87:0/2859270778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 0x55e9e0bb2850 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.787+0000 7f67d7210800 1 -- 172.21.15.87:0/2859270778 >> 172.21.15.87:0/2859270778 conn(0x55e9e0ab8ea0 msgr2=0x55e9e0bae170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.787+0000 7f67d7210800 1 -- 172.21.15.87:0/2859270778 shutdown_connections 2024-05-08T18:31:17.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.787+0000 7f67d7210800 1 -- 172.21.15.87:0/2859270778 wait complete. 2024-05-08T18:31:17.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.787+0000 7f67d7210800 1 Processor -- start 2024-05-08T18:31:17.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.787+0000 7f67d7210800 1 -- start start 2024-05-08T18:31:17.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.787+0000 7f67d7210800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 0x55e9e0bba2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.787+0000 7f67d7210800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e9e0ac8750 con 0x55e9e0abf7d0 2024-05-08T18:31:17.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.787+0000 7f67d2876640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 0x55e9e0bba2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.787+0000 7f67d2876640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 0x55e9e0bba2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32798/0 (socket says 172.21.15.87:32798) 2024-05-08T18:31:17.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.787+0000 7f67d2876640 1 -- 172.21.15.87:0/2023622546 learned_addr learned my addr 172.21.15.87:0/2023622546 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.787+0000 7f67d2876640 1 -- 172.21.15.87:0/2023622546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9e0bba820 con 0x55e9e0abf7d0 2024-05-08T18:31:17.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.788+0000 7f67d2876640 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 0x55e9e0bba2e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f67c4052540 tx=0x7f67c4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.788+0000 7f66bf606640 1 -- 172.21.15.87:0/2023622546 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c4073070 con 0x55e9e0abf7d0 2024-05-08T18:31:17.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.788+0000 7f66bf606640 1 -- 172.21.15.87:0/2023622546 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c405d440 con 0x55e9e0abf7d0 2024-05-08T18:31:17.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.788+0000 7f67d7210800 1 -- 172.21.15.87:0/2023622546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9e0bbaab0 con 0x55e9e0abf7d0 2024-05-08T18:31:17.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.788+0000 7f66bf606640 1 -- 172.21.15.87:0/2023622546 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c4057070 con 0x55e9e0abf7d0 2024-05-08T18:31:17.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.788+0000 7f67d7210800 1 -- 172.21.15.87:0/2023622546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9e0bbd760 con 0x55e9e0abf7d0 2024-05-08T18:31:17.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.789+0000 7f66bf606640 1 -- 172.21.15.87:0/2023622546 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f67c4076070 con 0x55e9e0abf7d0 2024-05-08T18:31:17.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.789+0000 7f66bf606640 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f66b803bba0 0x7f66b803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.789+0000 7f66bf606640 1 -- 172.21.15.87:0/2023622546 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f67c4093fe0 con 0x55e9e0abf7d0 2024-05-08T18:31:17.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.789+0000 7f67cbfff640 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f66b803bba0 0x7f66b803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.789+0000 7f67d7210800 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e9e0ac0130 0x55e9e0bc1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.789+0000 7f67d7210800 1 -- 172.21.15.87:0/2023622546 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bc1a60 con 0x55e9e0ac0130 2024-05-08T18:31:17.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.789+0000 7f67d3077640 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e9e0ac0130 0x55e9e0bc1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.789+0000 7f67cbfff640 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f66b803bba0 0x7f66b803e060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f67bc000f60 tx=0x7f67bc001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.789+0000 7f67d3077640 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e9e0ac0130 0x55e9e0bc1520 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.790+0000 7f67d3077640 1 -- 172.21.15.87:0/2023622546 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67cc00a4a0 con 0x55e9e0ac0130 2024-05-08T18:31:17.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.790+0000 7f67d7210800 1 -- 172.21.15.87:0/2023622546 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bbead0 con 0x55e9e0ac0130 2024-05-08T18:31:17.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.790+0000 7f67d3077640 1 -- 172.21.15.87:0/2023622546 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f67cc00a4a0 con 0x55e9e0ac0130 2024-05-08T18:31:17.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.790+0000 7f67d7210800 1 -- 172.21.15.87:0/2023622546 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bc3870 con 0x55e9e0ac0130 2024-05-08T18:31:17.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.790+0000 7f67d3077640 1 -- 172.21.15.87:0/2023622546 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f67cc00a4a0 con 0x55e9e0ac0130 2024-05-08T18:31:17.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.790+0000 7f67d7210800 1 -- 172.21.15.87:0/2023622546 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bc2aa0 con 0x55e9e0ac0130 2024-05-08T18:31:17.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.791+0000 7f67d3077640 1 -- 172.21.15.87:0/2023622546 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f67cc00a4a0 con 0x55e9e0ac0130 2024-05-08T18:31:17.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.791+0000 7f67d7210800 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55e9e0bc4c20 0x55e9e0bc7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.791+0000 7f67d7210800 1 -- 172.21.15.87:0/2023622546 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bc7550 con 0x55e9e0bc4c20 2024-05-08T18:31:17.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.791+0000 7f67d2876640 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55e9e0bc4c20 0x55e9e0bc7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.791+0000 7f67d2876640 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55e9e0bc4c20 0x55e9e0bc7010 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.791+0000 7f67d2876640 1 -- 172.21.15.87:0/2023622546 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f67c4075030 con 0x55e9e0bc4c20 2024-05-08T18:31:17.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.792+0000 7f67d7210800 1 Processor -- start 2024-05-08T18:31:17.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.792+0000 7f67d7210800 1 -- start start 2024-05-08T18:31:17.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.792+0000 7f67d7210800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0bd5790 0x55e9e0bd5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.792+0000 7f67d7210800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e9e09b0fc0 con 0x55e9e0bd5790 2024-05-08T18:31:17.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.792+0000 7f67d3077640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0bd5790 0x55e9e0bd5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.792+0000 7f67d3077640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0bd5790 0x55e9e0bd5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32808/0 (socket says 172.21.15.87:32808) 2024-05-08T18:31:17.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.792+0000 7f67d3077640 1 -- 172.21.15.87:0/1298470593 learned_addr learned my addr 172.21.15.87:0/1298470593 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.792+0000 7f67d3077640 1 -- 172.21.15.87:0/1298470593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9e0bd60f0 con 0x55e9e0bd5790 2024-05-08T18:31:17.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.793+0000 7f67d3077640 1 --2- 172.21.15.87:0/1298470593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0bd5790 0x55e9e0bd5bb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55e9e0bbb6e0 tx=0x7f67cc0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.793+0000 7f66bce01640 1 -- 172.21.15.87:0/1298470593 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67cc013440 con 0x55e9e0bd5790 2024-05-08T18:31:17.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.793+0000 7f66bce01640 1 -- 172.21.15.87:0/1298470593 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67cc0135e0 con 0x55e9e0bd5790 2024-05-08T18:31:17.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.793+0000 7f67d7210800 1 -- 172.21.15.87:0/1298470593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9e0bd6b60 con 0x55e9e0bd5790 2024-05-08T18:31:17.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.793+0000 7f66bce01640 1 -- 172.21.15.87:0/1298470593 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67cc0138c0 con 0x55e9e0bd5790 2024-05-08T18:31:17.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.793+0000 7f67d7210800 1 -- 172.21.15.87:0/1298470593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9e0bd7060 con 0x55e9e0bd5790 2024-05-08T18:31:17.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.794+0000 7f66bce01640 1 -- 172.21.15.87:0/1298470593 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f67cc011040 con 0x55e9e0bd5790 2024-05-08T18:31:17.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.794+0000 7f66bce01640 1 --2- 172.21.15.87:0/1298470593 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f66ac03bba0 0x7f66ac03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.794+0000 7f66bce01640 1 -- 172.21.15.87:0/1298470593 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f67cc01d070 con 0x55e9e0bd5790 2024-05-08T18:31:17.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.794+0000 7f67d2876640 1 --2- 172.21.15.87:0/1298470593 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f66ac03bba0 0x7f66ac03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.794+0000 7f67d7210800 1 Processor -- start 2024-05-08T18:31:17.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.794+0000 7f67d7210800 1 -- start start 2024-05-08T18:31:17.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.794+0000 7f67d2876640 1 --2- 172.21.15.87:0/1298470593 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f66ac03bba0 0x7f66ac03e060 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f67c405dfd0 tx=0x7f67c405df20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.794+0000 7f67d7210800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0be2ae0 0x55e9e0be2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.794+0000 7f67d7210800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e9e0bb30e0 con 0x55e9e0be2ae0 2024-05-08T18:31:17.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.795+0000 7f67d3077640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0be2ae0 0x55e9e0be2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.795+0000 7f67d3077640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0be2ae0 0x55e9e0be2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32824/0 (socket says 172.21.15.87:32824) 2024-05-08T18:31:17.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.795+0000 7f67d3077640 1 -- 172.21.15.87:0/967357694 learned_addr learned my addr 172.21.15.87:0/967357694 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.795+0000 7f67d3077640 1 -- 172.21.15.87:0/967357694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9e0be34d0 con 0x55e9e0be2ae0 2024-05-08T18:31:17.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.795+0000 7f67d3077640 1 --2- 172.21.15.87:0/967357694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0be2ae0 0x55e9e0be2f00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f67cc052990 tx=0x7f67cc029430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d512c2563104fd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.795+0000 7f66b67fc640 1 -- 172.21.15.87:0/967357694 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67cc02ad80 con 0x55e9e0be2ae0 2024-05-08T18:31:17.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.795+0000 7f66b67fc640 1 -- 172.21.15.87:0/967357694 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67cc0014f0 con 0x55e9e0be2ae0 2024-05-08T18:31:17.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.795+0000 7f66b67fc640 1 -- 172.21.15.87:0/967357694 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67cc001810 con 0x55e9e0be2ae0 2024-05-08T18:31:17.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.795+0000 7f67d7210800 1 -- 172.21.15.87:0/967357694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0be2ae0 msgr2=0x55e9e0be2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.795+0000 7f67d7210800 1 --2- 172.21.15.87:0/967357694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0be2ae0 0x55e9e0be2f00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f67cc052990 tx=0x7f67cc029430 comp rx=0 tx=0).stop 2024-05-08T18:31:17.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.796+0000 7f67d7210800 1 -- 172.21.15.87:0/967357694 shutdown_connections 2024-05-08T18:31:17.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.796+0000 7f67d7210800 1 --2- 172.21.15.87:0/967357694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0be2ae0 0x55e9e0be2f00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.796+0000 7f67d7210800 1 -- 172.21.15.87:0/967357694 >> 172.21.15.87:0/967357694 conn(0x55e9e0bdedf0 msgr2=0x55e9e0bdce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.796+0000 7f67d7210800 1 -- 172.21.15.87:0/967357694 shutdown_connections 2024-05-08T18:31:17.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.796+0000 7f67d7210800 1 -- 172.21.15.87:0/967357694 wait complete. 2024-05-08T18:31:17.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.796+0000 7f67d7210800 1 Processor -- start 2024-05-08T18:31:17.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.796+0000 7f67d7210800 1 -- start start 2024-05-08T18:31:17.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.796+0000 7f67d7210800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0be2ae0 0x55e9e0bea070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.796+0000 7f67d7210800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e9e0be3c20 con 0x55e9e0be2ae0 2024-05-08T18:31:17.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.796+0000 7f67d3077640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0be2ae0 0x55e9e0bea070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.796+0000 7f67d3077640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0be2ae0 0x55e9e0bea070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32840/0 (socket says 172.21.15.87:32840) 2024-05-08T18:31:17.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.796+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 learned_addr learned my addr 172.21.15.87:0/2782736066 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.796+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9e0bea5b0 con 0x55e9e0be2ae0 2024-05-08T18:31:17.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.797+0000 7f67d3077640 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0be2ae0 0x55e9e0bea070 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f67cc001f40 tx=0x7f67cc0528f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.797+0000 7f66b4ff9640 1 -- 172.21.15.87:0/2782736066 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67cc030020 con 0x55e9e0be2ae0 2024-05-08T18:31:17.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.797+0000 7f66b4ff9640 1 -- 172.21.15.87:0/2782736066 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67cc051310 con 0x55e9e0be2ae0 2024-05-08T18:31:17.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.797+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9e0bea840 con 0x55e9e0be2ae0 2024-05-08T18:31:17.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.797+0000 7f66b4ff9640 1 -- 172.21.15.87:0/2782736066 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67cc013a60 con 0x55e9e0be2ae0 2024-05-08T18:31:17.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.797+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9e0bed4f0 con 0x55e9e0be2ae0 2024-05-08T18:31:17.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.798+0000 7f66b4ff9640 1 -- 172.21.15.87:0/2782736066 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f67cc033020 con 0x55e9e0be2ae0 2024-05-08T18:31:17.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.798+0000 7f66b4ff9640 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f669c03bba0 0x7f669c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.798+0000 7f66b4ff9640 1 -- 172.21.15.87:0/2782736066 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f67cc00e040 con 0x55e9e0be2ae0 2024-05-08T18:31:17.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.798+0000 7f67d2876640 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f669c03bba0 0x7f669c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.798+0000 7f67d2876640 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f669c03bba0 0x7f669c03e060 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f67c405cfd0 tx=0x7f67c407e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.798+0000 7f67d7210800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.799+0000 7f67d7210800 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e9e0bf5b20 0x55e9e0bf7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.799+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bf8730 con 0x55e9e0bf5b20 2024-05-08T18:31:17.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.799+0000 7f67cbfff640 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e9e0bf5b20 0x55e9e0bf7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.799+0000 7f67cbfff640 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e9e0bf5b20 0x55e9e0bf7fe0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.799+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.799+0000 7f67d7210800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.799+0000 7f67d7210800 20 realm 2024-05-08T18:31:17.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.799+0000 7f67d7210800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.799+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bf4f70 con 0x55e9e0bf5b20 2024-05-08T18:31:17.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.799+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.799+0000 7f67d7210800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.799+0000 7f67d7210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:17.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.799+0000 7f67d7210800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.799+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bf9220 con 0x55e9e0bf5b20 2024-05-08T18:31:17.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.800+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.800+0000 7f67d7210800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.800+0000 7f67d7210800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.800+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bf9af0 con 0x55e9e0bf5b20 2024-05-08T18:31:17.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.800+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.800+0000 7f67d7210800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:17.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.800+0000 7f67d7210800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.800+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bf9e90 con 0x55e9e0bf5b20 2024-05-08T18:31:17.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.800+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.800+0000 7f67d7210800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:17.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.800+0000 7f67d7210800 20 searching for the correct realm 2024-05-08T18:31:17.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.800+0000 7f67d7210800 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55e9e0bfbd70 0x55e9e0bfe1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.800+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x55e9e0bfbd70 2024-05-08T18:31:17.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.800+0000 7f67d3077640 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55e9e0bfbd70 0x55e9e0bfe1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.800+0000 7f67d3077640 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55e9e0bfbd70 0x55e9e0bfe1a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.801+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67cc052d70 con 0x55e9e0bfbd70 2024-05-08T18:31:17.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.801+0000 7f67d3077640 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f67cc035020 0x7f67cc0298d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.801+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x7f67cc035020 2024-05-08T18:31:17.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.801+0000 7f67d2876640 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f67cc035020 0x7f67cc0298d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.801+0000 7f67d2876640 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f67cc035020 0x7f67cc0298d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.802+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c4086040 con 0x7f67cc035020 2024-05-08T18:31:17.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.802+0000 7f67d2876640 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f67c4078060 0x7f67c408a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.802+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x7f67c4078060 2024-05-08T18:31:17.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.802+0000 7f67cbfff640 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f67c4078060 0x7f67c408a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.802+0000 7f67cbfff640 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f67c4078060 0x7f67c408a460 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.803+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.803+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x55e9e0bf5b20 2024-05-08T18:31:17.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.803+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.803+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x55e9e0bf5b20 2024-05-08T18:31:17.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.803+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.803+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x7f67c4078060 2024-05-08T18:31:17.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.803+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.803+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x7f67c4078060 2024-05-08T18:31:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.804+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.804+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x7f67cc035020 2024-05-08T18:31:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.804+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c4086040 con 0x7f67cc035020 2024-05-08T18:31:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.804+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x55e9e0bfbd70 2024-05-08T18:31:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.804+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67cc052d70 con 0x55e9e0bfbd70 2024-05-08T18:31:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.804+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x55e9e0bf5b20 2024-05-08T18:31:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.804+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.804+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x7f67c4078060 2024-05-08T18:31:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.805+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.805+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x55e9e0bf5b20 2024-05-08T18:31:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.805+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.805+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x7f67cc035020 2024-05-08T18:31:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.805+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f67c4086040 con 0x7f67cc035020 2024-05-08T18:31:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.805+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x55e9e0bfbd70 2024-05-08T18:31:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.805+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67cc052d70 con 0x55e9e0bfbd70 2024-05-08T18:31:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.805+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x55e9e0bfbd70 2024-05-08T18:31:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.806+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67cc052d70 con 0x55e9e0bfbd70 2024-05-08T18:31:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.806+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x7f67c4078060 2024-05-08T18:31:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.806+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.806+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x55e9e0bfbd70 2024-05-08T18:31:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.806+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67cc052d70 con 0x55e9e0bfbd70 2024-05-08T18:31:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.806+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x55e9e0bfbd70 2024-05-08T18:31:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.806+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67cc052d70 con 0x55e9e0bfbd70 2024-05-08T18:31:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.806+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x55e9e0bf5b20 2024-05-08T18:31:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.807+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.807+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x55e9e0bf5b20 2024-05-08T18:31:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.807+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.807+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x7f67c4078060 2024-05-08T18:31:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.808+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.808+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x55e9e0bfbd70 2024-05-08T18:31:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.808+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67cc052d70 con 0x55e9e0bfbd70 2024-05-08T18:31:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.808+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x7f67cc035020 2024-05-08T18:31:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.808+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c4086040 con 0x7f67cc035020 2024-05-08T18:31:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.808+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x55e9e0bf5b20 2024-05-08T18:31:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.808+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.808+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x7f67c4078060 2024-05-08T18:31:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.809+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.809+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x55e9e0bfbd70 2024-05-08T18:31:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.809+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67cc052d70 con 0x55e9e0bfbd70 2024-05-08T18:31:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.809+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x7f67c4078060 2024-05-08T18:31:17.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.809+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.809+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x7f67cc035020 2024-05-08T18:31:17.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.809+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c4086040 con 0x7f67cc035020 2024-05-08T18:31:17.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.809+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x55e9e0bfbd70 2024-05-08T18:31:17.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.810+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67cc052d70 con 0x55e9e0bfbd70 2024-05-08T18:31:17.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.810+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x7f67c4078060 2024-05-08T18:31:17.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.810+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.810+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x55e9e0bf5b20 2024-05-08T18:31:17.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.810+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.810+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfe870 con 0x7f67cc035020 2024-05-08T18:31:17.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.810+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c4086040 con 0x7f67cc035020 2024-05-08T18:31:17.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.810+0000 7f67d7210800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:17.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.810+0000 7f67d7210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:17.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.810+0000 7f67d7210800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:17.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.810+0000 7f67d7210800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:17.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.810+0000 7f67d7210800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:17.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.810+0000 7f67d7210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:17.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.810+0000 7f67d7210800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.810+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfa7e0 con 0x55e9e0bf5b20 2024-05-08T18:31:17.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfb080 con 0x55e9e0bf5b20 2024-05-08T18:31:17.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:17.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfecf0 con 0x7f67c4078060 2024-05-08T18:31:17.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:17.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 20 zone default found 2024-05-08T18:31:17.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 4 Realm: () 2024-05-08T18:31:17.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:17.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:17.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:17.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 20 zonegroup default 2024-05-08T18:31:17.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bfac90 con 0x7f67c4078060 2024-05-08T18:31:17.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.811+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c00bd0 con 0x55e9e0bfbd70 2024-05-08T18:31:17.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.812+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f67cc052d70 con 0x55e9e0bfbd70 2024-05-08T18:31:17.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.812+0000 7f67d7210800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.812+0000 7f67d7210800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.812+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c01020 con 0x55e9e0bfbd70 2024-05-08T18:31:17.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.812+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f67cc052d70 con 0x55e9e0bfbd70 2024-05-08T18:31:17.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.812+0000 7f67d7210800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.812+0000 7f67d7210800 20 started sync module instance, tier type = 2024-05-08T18:31:17.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.812+0000 7f67d7210800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:17.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.812+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c00070 con 0x7f67cc035020 2024-05-08T18:31:17.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.813+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c4086040 con 0x7f67cc035020 2024-05-08T18:31:17.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.813+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94462986421344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c01930 con 0x7f67cc035020 2024-05-08T18:31:17.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.813+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c02180 con 0x55e9e0bf5b20 2024-05-08T18:31:17.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.814+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94462986421344] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c4086040 con 0x7f67cc035020 2024-05-08T18:31:17.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.814+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.814+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94462986425472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c02200 con 0x55e9e0bf5b20 2024-05-08T18:31:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.814+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c02d20 con 0x55e9e0bfbd70 2024-05-08T18:31:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.815+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94462986425472] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.816+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67cc052d70 con 0x55e9e0bfbd70 2024-05-08T18:31:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.816+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94462986430448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c03110 con 0x55e9e0bfbd70 2024-05-08T18:31:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.816+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c03b50 con 0x7f67cc035020 2024-05-08T18:31:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.817+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94462986430448] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67cc052d70 con 0x55e9e0bfbd70 2024-05-08T18:31:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.817+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c4086040 con 0x7f67cc035020 2024-05-08T18:31:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.817+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94462986434080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c03f40 con 0x7f67cc035020 2024-05-08T18:31:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.817+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c04940 con 0x55e9e0bf5b20 2024-05-08T18:31:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.819+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.819+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94462986437712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c05210 con 0x55e9e0bf5b20 2024-05-08T18:31:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.819+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c05cc0 con 0x7f67c4078060 2024-05-08T18:31:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.820+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.820+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94462986442656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c05cc0 con 0x7f67c4078060 2024-05-08T18:31:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.820+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c06c00 con 0x7f67c4078060 2024-05-08T18:31:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.821+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94462986442656] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.822+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94462986434080] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c4086040 con 0x7f67cc035020 2024-05-08T18:31:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.824+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94462986437712] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.824+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.825+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94462986427600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c04d60 con 0x7f67c4078060 2024-05-08T18:31:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.825+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c06bc0 con 0x7f67c4078060 2024-05-08T18:31:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.825+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.825+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94462986444848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c07070 con 0x7f67c4078060 2024-05-08T18:31:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.825+0000 7f67d7210800 20 add_watcher() i=0 2024-05-08T18:31:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.825+0000 7f67d7210800 20 add_watcher() i=1 2024-05-08T18:31:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.826+0000 7f67d7210800 20 add_watcher() i=2 2024-05-08T18:31:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.826+0000 7f67d7210800 20 add_watcher() i=3 2024-05-08T18:31:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.826+0000 7f67d7210800 20 add_watcher() i=4 2024-05-08T18:31:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.826+0000 7f67d7210800 20 add_watcher() i=5 2024-05-08T18:31:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.826+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94462986427600] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.826+0000 7f67d7210800 20 add_watcher() i=6 2024-05-08T18:31:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.827+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94462986444848] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.827+0000 7f67d7210800 20 add_watcher() i=7 2024-05-08T18:31:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.827+0000 7f67d7210800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.827+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c066d0 con 0x55e9e0bf5b20 2024-05-08T18:31:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.828+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.828+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94462986447808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c066d0 con 0x55e9e0bf5b20 2024-05-08T18:31:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.828+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94462986447808] v27'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.829+0000 7f66897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.829+0000 7f67d7210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.829+0000 7f67d7210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.829+0000 7f67d7210800 5 note: GC not initialized 2024-05-08T18:31:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.829+0000 7f6603fff640 20 reqs_thread_entry: start 2024-05-08T18:31:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.829+0000 7f67d7210800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.829+0000 7f67d7210800 20 Filter name: none 2024-05-08T18:31:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.829+0000 7f6601ffb640 20 reqs_thread_entry: start 2024-05-08T18:31:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.829+0000 7f67d7210800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.829+0000 7f67d7210800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.829+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c3d4e0 con 0x55e9e0bf5b20 2024-05-08T18:31:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.830+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.830+0000 7f67d7210800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.830+0000 7f67d7210800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.830+0000 7f67d7210800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.830+0000 7f67d7210800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:17.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.830+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c3cfc0 con 0x7f67cc035020 2024-05-08T18:31:17.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.830+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f67c4086040 con 0x7f67cc035020 2024-05-08T18:31:17.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.830+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c43650 con 0x55e9e0bf5b20 2024-05-08T18:31:17.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.831+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v27'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.831+0000 7f67d7210800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:17.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.831+0000 7f67d7210800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:17.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.831+0000 7f67d7210800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:31:17.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.831+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94462986694976 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c40310 con 0x55e9e0bf5b20 2024-05-08T18:31:17.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.831+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== watch-notify(notify (1) cookie 94462986437712 notify 115964116994 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f67bc018040 con 0x55e9e0bf5b20 2024-05-08T18:31:17.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.831+0000 7f66b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116994 cookie 94462986437712 notifier 4319 bl.length()=567 2024-05-08T18:31:17.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.831+0000 7f66b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:17.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.831+0000 7f66b67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:17.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.831+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(65 notify.4 [notify cookie 94462986694976 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.831+0000 7f66b67fc640 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f6698003ea0 con 0x55e9e0bf5b20 2024-05-08T18:31:17.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.832+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.832+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== watch-notify(notify_complete (2) cookie 94462986694976 notify 115964116994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f67bc009050 con 0x55e9e0bf5b20 2024-05-08T18:31:17.835 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:17.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.833+0000 7f66897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:17.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.833+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94462986447808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0bf1810 con 0x55e9e0bf5b20 2024-05-08T18:31:17.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.834+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94462986447808] v27'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.834+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94462986421344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c06bc0 con 0x7f67cc035020 2024-05-08T18:31:17.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.837+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94462986421344] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c4086040 con 0x7f67cc035020 2024-05-08T18:31:17.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.837+0000 7f67d7210800 20 remove_watcher() i=0 2024-05-08T18:31:17.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.837+0000 7f67d7210800 2 removed watcher, disabling cache 2024-05-08T18:31:17.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.837+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94462986425472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c06bc0 con 0x55e9e0bf5b20 2024-05-08T18:31:17.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.838+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94462986425472] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.838+0000 7f67d7210800 20 remove_watcher() i=1 2024-05-08T18:31:17.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.838+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94462986430448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c01480 con 0x55e9e0bfbd70 2024-05-08T18:31:17.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.839+0000 7f67d3077640 1 -- 172.21.15.87:0/2782736066 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94462986430448] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67cc052d70 con 0x55e9e0bfbd70 2024-05-08T18:31:17.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.839+0000 7f67d7210800 20 remove_watcher() i=2 2024-05-08T18:31:17.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.839+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94462986434080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c06bc0 con 0x7f67cc035020 2024-05-08T18:31:17.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.840+0000 7f67d2876640 1 -- 172.21.15.87:0/2782736066 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94462986434080] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c4086040 con 0x7f67cc035020 2024-05-08T18:31:17.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.840+0000 7f67d7210800 20 remove_watcher() i=3 2024-05-08T18:31:17.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.840+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94462986437712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c027f0 con 0x55e9e0bf5b20 2024-05-08T18:31:17.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.841+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94462986437712] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x55e9e0bf5b20 2024-05-08T18:31:17.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.841+0000 7f67d7210800 20 remove_watcher() i=4 2024-05-08T18:31:17.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.841+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94462986442656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c01480 con 0x7f67c4078060 2024-05-08T18:31:17.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.842+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94462986442656] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.842+0000 7f67d7210800 20 remove_watcher() i=5 2024-05-08T18:31:17.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.842+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94462986427600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c06bc0 con 0x7f67c4078060 2024-05-08T18:31:17.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.844+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94462986427600] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.844+0000 7f67d7210800 20 remove_watcher() i=6 2024-05-08T18:31:17.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.844+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94462986444848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9e0c04450 con 0x7f67c4078060 2024-05-08T18:31:17.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94462986444848] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67bc00f610 con 0x7f67c4078060 2024-05-08T18:31:17.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67d7210800 20 remove_watcher() i=7 2024-05-08T18:31:17.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f67c4078060 msgr2=0x7f67c408a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67d7210800 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f67c4078060 0x7f67c408a460 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e9e0bf5b20 msgr2=0x55e9e0bf7fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67d7210800 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e9e0bf5b20 0x55e9e0bf7fe0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f67cc035020 msgr2=0x7f67cc0298d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67d7210800 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f67cc035020 0x7f67cc0298d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55e9e0bfbd70 msgr2=0x55e9e0bfe1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67d7210800 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55e9e0bfbd70 0x55e9e0bfe1a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f669c03bba0 msgr2=0x7f669c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67d7210800 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f669c03bba0 0x7f669c03e060 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f67c405cfd0 tx=0x7f67c407e000 comp rx=0 tx=0).stop 2024-05-08T18:31:17.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0be2ae0 msgr2=0x55e9e0bea070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67d7210800 1 --2- 172.21.15.87:0/2782736066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0be2ae0 0x55e9e0bea070 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f67cc001f40 tx=0x7f67cc0528f0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 reap_dead start 2024-05-08T18:31:17.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67cbfff640 1 -- 172.21.15.87:0/2782736066 reap_dead start 2024-05-08T18:31:17.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 shutdown_connections 2024-05-08T18:31:17.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.845+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 >> 172.21.15.87:0/2782736066 conn(0x55e9e0bdedf0 msgr2=0x55e9e0bdc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 shutdown_connections 2024-05-08T18:31:17.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 -- 172.21.15.87:0/2782736066 wait complete. 2024-05-08T18:31:17.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 -- 172.21.15.87:0/1298470593 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f66ac03bba0 msgr2=0x7f66ac03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 --2- 172.21.15.87:0/1298470593 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f66ac03bba0 0x7f66ac03e060 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f67c405dfd0 tx=0x7f67c405df20 comp rx=0 tx=0).stop 2024-05-08T18:31:17.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 -- 172.21.15.87:0/1298470593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0bd5790 msgr2=0x55e9e0bd5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 --2- 172.21.15.87:0/1298470593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0bd5790 0x55e9e0bd5bb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55e9e0bbb6e0 tx=0x7f67cc0178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 -- 172.21.15.87:0/1298470593 shutdown_connections 2024-05-08T18:31:17.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 --2- 172.21.15.87:0/1298470593 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f66ac03bba0 0x7f66ac03e060 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 --2- 172.21.15.87:0/1298470593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0bd5790 0x55e9e0bd5bb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 -- 172.21.15.87:0/1298470593 >> 172.21.15.87:0/1298470593 conn(0x55e9e0bc9830 msgr2=0x55e9e0bc9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 -- 172.21.15.87:0/1298470593 shutdown_connections 2024-05-08T18:31:17.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 -- 172.21.15.87:0/1298470593 wait complete. 2024-05-08T18:31:17.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 -- 172.21.15.87:0/2023622546 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55e9e0bc4c20 msgr2=0x55e9e0bc7010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55e9e0bc4c20 0x55e9e0bc7010 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 -- 172.21.15.87:0/2023622546 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e9e0ac0130 msgr2=0x55e9e0bc1520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e9e0ac0130 0x55e9e0bc1520 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 -- 172.21.15.87:0/2023622546 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f66b803bba0 msgr2=0x7f66b803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f66b803bba0 0x7f66b803e060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f67bc000f60 tx=0x7f67bc001370 comp rx=0 tx=0).stop 2024-05-08T18:31:17.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 -- 172.21.15.87:0/2023622546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 msgr2=0x55e9e0bba2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 0x55e9e0bba2e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f67c4052540 tx=0x7f67c4003020 comp rx=0 tx=0).stop 2024-05-08T18:31:17.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 -- 172.21.15.87:0/2023622546 shutdown_connections 2024-05-08T18:31:17.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e9e0ac0130 0x55e9e0bc1520 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55e9e0bc4c20 0x55e9e0bc7010 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f66b803bba0 0x7f66b803e060 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 --2- 172.21.15.87:0/2023622546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9e0abf7d0 0x55e9e0bba2e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.846+0000 7f67d7210800 1 -- 172.21.15.87:0/2023622546 >> 172.21.15.87:0/2023622546 conn(0x55e9e0ab8ea0 msgr2=0x55e9e0bac970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.847+0000 7f67d7210800 1 -- 172.21.15.87:0/2023622546 shutdown_connections 2024-05-08T18:31:17.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.847+0000 7f67d7210800 1 -- 172.21.15.87:0/2023622546 wait complete. 2024-05-08T18:31:17.853 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:17.853 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:31:17.854 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:31:17.854 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:31:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:17.898 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:17.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.900+0000 7f32d1533800 1 Processor -- start 2024-05-08T18:31:17.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.900+0000 7f32d1533800 1 -- start start 2024-05-08T18:31:17.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.900+0000 7f32d1533800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561b7a3d76a0 0x561b7a3d9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.900+0000 7f32d1533800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561b7a3da060 con 0x561b7a3d32b0 2024-05-08T18:31:17.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.900+0000 7f32d1533800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x561b7a273e20 con 0x561b7a3d76a0 2024-05-08T18:31:17.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.900+0000 7f32c7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561b7a3d76a0 0x561b7a3d9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.901+0000 7f32c7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561b7a3d76a0 0x561b7a3d9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32856/0 (socket says 172.21.15.87:32856) 2024-05-08T18:31:17.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.901+0000 7f32c7fff640 1 -- 172.21.15.87:0/1955557625 learned_addr learned my addr 172.21.15.87:0/1955557625 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.901+0000 7f32cd2eb640 1 --1- 172.21.15.87:0/1955557625 >> v1:172.21.15.53:6789/0 conn(0x561b7a3d32b0 0x561b7a3d36d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41930/0 (socket says 172.21.15.87:41930) 2024-05-08T18:31:17.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.901+0000 7f32c7fff640 1 -- 172.21.15.87:0/1955557625 >> v1:172.21.15.53:6789/0 conn(0x561b7a3d32b0 legacy=0x561b7a3d36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.901+0000 7f32c7fff640 1 -- 172.21.15.87:0/1955557625 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7a3db290 con 0x561b7a3d76a0 2024-05-08T18:31:17.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.903+0000 7f32c7fff640 1 --2- 172.21.15.87:0/1955557625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d76a0 0x561b7a3d9a90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f32b800a520 tx=0x7f32b801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626dd85ba9790a28 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.903+0000 7f32ccaea640 1 -- 172.21.15.87:0/1955557625 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32b8057070 con 0x561b7a3d76a0 2024-05-08T18:31:17.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.903+0000 7f32ccaea640 1 -- 172.21.15.87:0/1955557625 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b8052570 con 0x561b7a3d76a0 2024-05-08T18:31:17.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.903+0000 7f32ccaea640 1 -- 172.21.15.87:0/1955557625 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32b804ae60 con 0x561b7a3d76a0 2024-05-08T18:31:17.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.903+0000 7f32d1533800 1 -- 172.21.15.87:0/1955557625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d76a0 msgr2=0x561b7a3d9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.903+0000 7f32d1533800 1 --2- 172.21.15.87:0/1955557625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d76a0 0x561b7a3d9a90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f32b800a520 tx=0x7f32b801d010 comp rx=0 tx=0).stop 2024-05-08T18:31:17.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.903+0000 7f32d1533800 1 -- 172.21.15.87:0/1955557625 shutdown_connections 2024-05-08T18:31:17.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.903+0000 7f32d1533800 1 --2- 172.21.15.87:0/1955557625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d76a0 0x561b7a3d9a90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.903+0000 7f32d1533800 1 -- 172.21.15.87:0/1955557625 >> 172.21.15.87:0/1955557625 conn(0x561b7a3ce830 msgr2=0x561b7a3d0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.903+0000 7f32d1533800 1 -- 172.21.15.87:0/1955557625 shutdown_connections 2024-05-08T18:31:17.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.903+0000 7f32d1533800 1 -- 172.21.15.87:0/1955557625 wait complete. 2024-05-08T18:31:17.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.917+0000 7f32d1533800 1 Processor -- start 2024-05-08T18:31:17.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.917+0000 7f32d1533800 1 -- start start 2024-05-08T18:31:17.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.917+0000 7f32d1533800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d32b0 0x561b7a4c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.917+0000 7f32d1533800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561b7a31e5b0 con 0x561b7a3d32b0 2024-05-08T18:31:17.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.917+0000 7f32cd2eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d32b0 0x561b7a4c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.917+0000 7f32cd2eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d32b0 0x561b7a4c4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32858/0 (socket says 172.21.15.87:32858) 2024-05-08T18:31:17.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.917+0000 7f32cd2eb640 1 -- 172.21.15.87:0/3860892820 learned_addr learned my addr 172.21.15.87:0/3860892820 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.917+0000 7f32cd2eb640 1 -- 172.21.15.87:0/3860892820 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7a4c4bf0 con 0x561b7a3d32b0 2024-05-08T18:31:17.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.918+0000 7f32cd2eb640 1 --2- 172.21.15.87:0/3860892820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d32b0 0x561b7a4c4620 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f32c000b230 tx=0x7f32c000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5a6837497956fd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.918+0000 7f31bb606640 1 -- 172.21.15.87:0/3860892820 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c000e5c0 con 0x561b7a3d32b0 2024-05-08T18:31:17.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.918+0000 7f31bb606640 1 -- 172.21.15.87:0/3860892820 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c0006070 con 0x561b7a3d32b0 2024-05-08T18:31:17.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.918+0000 7f31bb606640 1 -- 172.21.15.87:0/3860892820 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c000e890 con 0x561b7a3d32b0 2024-05-08T18:31:17.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.919+0000 7f32d1533800 1 -- 172.21.15.87:0/3860892820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d32b0 msgr2=0x561b7a4c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.919+0000 7f32d1533800 1 --2- 172.21.15.87:0/3860892820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d32b0 0x561b7a4c4620 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f32c000b230 tx=0x7f32c000b6f0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.919+0000 7f32d1533800 1 -- 172.21.15.87:0/3860892820 shutdown_connections 2024-05-08T18:31:17.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.919+0000 7f32d1533800 1 --2- 172.21.15.87:0/3860892820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d32b0 0x561b7a4c4620 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.919+0000 7f32d1533800 1 -- 172.21.15.87:0/3860892820 >> 172.21.15.87:0/3860892820 conn(0x561b7a3ce830 msgr2=0x561b7a4bff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.919+0000 7f32d1533800 1 -- 172.21.15.87:0/3860892820 shutdown_connections 2024-05-08T18:31:17.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.919+0000 7f32d1533800 1 -- 172.21.15.87:0/3860892820 wait complete. 2024-05-08T18:31:17.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.919+0000 7f32d1533800 1 Processor -- start 2024-05-08T18:31:17.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.919+0000 7f32d1533800 1 -- start start 2024-05-08T18:31:17.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.919+0000 7f32d1533800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d32b0 0x561b7a4cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.919+0000 7f32d1533800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561b7a3da530 con 0x561b7a3d32b0 2024-05-08T18:31:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.919+0000 7f32cd2eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d32b0 0x561b7a4cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.919+0000 7f32cd2eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d32b0 0x561b7a4cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32866/0 (socket says 172.21.15.87:32866) 2024-05-08T18:31:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.919+0000 7f32cd2eb640 1 -- 172.21.15.87:0/2039625136 learned_addr learned my addr 172.21.15.87:0/2039625136 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.919+0000 7f32cd2eb640 1 -- 172.21.15.87:0/2039625136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7a4cc700 con 0x561b7a3d32b0 2024-05-08T18:31:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.920+0000 7f32cd2eb640 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d32b0 0x561b7a4cc1c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f32c0000fd0 tx=0x7f32c0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.920+0000 7f31b9e03640 1 -- 172.21.15.87:0/2039625136 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c000f8d0 con 0x561b7a3d32b0 2024-05-08T18:31:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.920+0000 7f31b9e03640 1 -- 172.21.15.87:0/2039625136 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c000fa90 con 0x561b7a3d32b0 2024-05-08T18:31:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.920+0000 7f32d1533800 1 -- 172.21.15.87:0/2039625136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b7a4cc990 con 0x561b7a3d32b0 2024-05-08T18:31:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.920+0000 7f31b9e03640 1 -- 172.21.15.87:0/2039625136 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c000fdb0 con 0x561b7a3d32b0 2024-05-08T18:31:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.920+0000 7f32d1533800 1 -- 172.21.15.87:0/2039625136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b7a4cf640 con 0x561b7a3d32b0 2024-05-08T18:31:17.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.921+0000 7f31b9e03640 1 -- 172.21.15.87:0/2039625136 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f32c0017070 con 0x561b7a3d32b0 2024-05-08T18:31:17.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.921+0000 7f31b9e03640 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31b403bba0 0x7f31b403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.921+0000 7f31b9e03640 1 -- 172.21.15.87:0/2039625136 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f32c0015020 con 0x561b7a3d32b0 2024-05-08T18:31:17.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.921+0000 7f32c7fff640 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31b403bba0 0x7f31b403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.921+0000 7f32d1533800 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561b7a3d76a0 0x561b7a4d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.921+0000 7f32d1533800 1 -- 172.21.15.87:0/2039625136 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a4d3980 con 0x561b7a3d76a0 2024-05-08T18:31:17.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.921+0000 7f32cdaec640 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561b7a3d76a0 0x561b7a4d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.921+0000 7f32c7fff640 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31b403bba0 0x7f31b403e060 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f32b8054000 tx=0x7f32b804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.922+0000 7f32cdaec640 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561b7a3d76a0 0x561b7a4d3400 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.922+0000 7f32cdaec640 1 -- 172.21.15.87:0/2039625136 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32c800a4a0 con 0x561b7a3d76a0 2024-05-08T18:31:17.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.922+0000 7f32d1533800 1 -- 172.21.15.87:0/2039625136 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a4d09d0 con 0x561b7a3d76a0 2024-05-08T18:31:17.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.922+0000 7f32cdaec640 1 -- 172.21.15.87:0/2039625136 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32c800a4a0 con 0x561b7a3d76a0 2024-05-08T18:31:17.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.922+0000 7f32d1533800 1 -- 172.21.15.87:0/2039625136 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a4d57a0 con 0x561b7a3d76a0 2024-05-08T18:31:17.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.922+0000 7f32cdaec640 1 -- 172.21.15.87:0/2039625136 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f32c800a4a0 con 0x561b7a3d76a0 2024-05-08T18:31:17.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.922+0000 7f32d1533800 1 -- 172.21.15.87:0/2039625136 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a4d49d0 con 0x561b7a3d76a0 2024-05-08T18:31:17.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.923+0000 7f32cdaec640 1 -- 172.21.15.87:0/2039625136 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32c800a4a0 con 0x561b7a3d76a0 2024-05-08T18:31:17.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.923+0000 7f32d1533800 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561b7a4d6b50 0x561b7a4d8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.923+0000 7f32d1533800 1 -- 172.21.15.87:0/2039625136 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a4d9480 con 0x561b7a4d6b50 2024-05-08T18:31:17.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.923+0000 7f32cd2eb640 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561b7a4d6b50 0x561b7a4d8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.923+0000 7f32cd2eb640 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561b7a4d6b50 0x561b7a4d8f40 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.923+0000 7f32cd2eb640 1 -- 172.21.15.87:0/2039625136 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f32c002e070 con 0x561b7a4d6b50 2024-05-08T18:31:17.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.924+0000 7f32d1533800 1 Processor -- start 2024-05-08T18:31:17.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.924+0000 7f32d1533800 1 -- start start 2024-05-08T18:31:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.924+0000 7f32d1533800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a4e76c0 0x561b7a4e7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.924+0000 7f32d1533800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561b7a2c4fc0 con 0x561b7a4e76c0 2024-05-08T18:31:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.924+0000 7f32cdaec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a4e76c0 0x561b7a4e7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.924+0000 7f32cdaec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a4e76c0 0x561b7a4e7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32882/0 (socket says 172.21.15.87:32882) 2024-05-08T18:31:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.924+0000 7f32cdaec640 1 -- 172.21.15.87:0/3672816879 learned_addr learned my addr 172.21.15.87:0/3672816879 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.924+0000 7f32cdaec640 1 -- 172.21.15.87:0/3672816879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7a4e8020 con 0x561b7a4e76c0 2024-05-08T18:31:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.925+0000 7f32cdaec640 1 --2- 172.21.15.87:0/3672816879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a4e76c0 0x561b7a4e7ae0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x561b7a4cd5c0 tx=0x7f32c80178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.925+0000 7f31b2ffd640 1 -- 172.21.15.87:0/3672816879 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c8013440 con 0x561b7a4e76c0 2024-05-08T18:31:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.925+0000 7f31b2ffd640 1 -- 172.21.15.87:0/3672816879 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c80135e0 con 0x561b7a4e76c0 2024-05-08T18:31:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.925+0000 7f31b2ffd640 1 -- 172.21.15.87:0/3672816879 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c80138c0 con 0x561b7a4e76c0 2024-05-08T18:31:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.925+0000 7f32d1533800 1 -- 172.21.15.87:0/3672816879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b7a4e8a90 con 0x561b7a4e76c0 2024-05-08T18:31:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.925+0000 7f32d1533800 1 -- 172.21.15.87:0/3672816879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b7a4e8f90 con 0x561b7a4e76c0 2024-05-08T18:31:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.926+0000 7f31b2ffd640 1 -- 172.21.15.87:0/3672816879 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f32c8011040 con 0x561b7a4e76c0 2024-05-08T18:31:17.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.926+0000 7f31b2ffd640 1 --2- 172.21.15.87:0/3672816879 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31a403bba0 0x7f31a403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.926+0000 7f31b2ffd640 1 -- 172.21.15.87:0/3672816879 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f32c801d070 con 0x561b7a4e76c0 2024-05-08T18:31:17.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.926+0000 7f32cd2eb640 1 --2- 172.21.15.87:0/3672816879 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31a403bba0 0x7f31a403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.926+0000 7f32d1533800 1 Processor -- start 2024-05-08T18:31:17.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.926+0000 7f32d1533800 1 -- start start 2024-05-08T18:31:17.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.926+0000 7f32cd2eb640 1 --2- 172.21.15.87:0/3672816879 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31a403bba0 0x7f31a403e060 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f32c0000c00 tx=0x7f32c0051740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.926+0000 7f32d1533800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a348920 0x561b7a348d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.926+0000 7f32d1533800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561b7a4c4f70 con 0x561b7a348920 2024-05-08T18:31:17.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.927+0000 7f32cdaec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a348920 0x561b7a348d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.927+0000 7f32cdaec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a348920 0x561b7a348d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32888/0 (socket says 172.21.15.87:32888) 2024-05-08T18:31:17.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.927+0000 7f32cdaec640 1 -- 172.21.15.87:0/612410342 learned_addr learned my addr 172.21.15.87:0/612410342 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.927+0000 7f32cdaec640 1 -- 172.21.15.87:0/612410342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7a347120 con 0x561b7a348920 2024-05-08T18:31:17.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.927+0000 7f32cdaec640 1 --2- 172.21.15.87:0/612410342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a348920 0x561b7a348d40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f32c8052990 tx=0x7f32c8029430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d4cf293d893c5e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.927+0000 7f31b0ff9640 1 -- 172.21.15.87:0/612410342 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c80540d0 con 0x561b7a348920 2024-05-08T18:31:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.927+0000 7f31b0ff9640 1 -- 172.21.15.87:0/612410342 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c8054270 con 0x561b7a348920 2024-05-08T18:31:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.927+0000 7f31b0ff9640 1 -- 172.21.15.87:0/612410342 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c8001660 con 0x561b7a348920 2024-05-08T18:31:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.928+0000 7f32d1533800 1 -- 172.21.15.87:0/612410342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a348920 msgr2=0x561b7a348d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.928+0000 7f32d1533800 1 --2- 172.21.15.87:0/612410342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a348920 0x561b7a348d40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f32c8052990 tx=0x7f32c8029430 comp rx=0 tx=0).stop 2024-05-08T18:31:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.928+0000 7f32d1533800 1 -- 172.21.15.87:0/612410342 shutdown_connections 2024-05-08T18:31:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.928+0000 7f32d1533800 1 --2- 172.21.15.87:0/612410342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a348920 0x561b7a348d40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.928+0000 7f32d1533800 1 -- 172.21.15.87:0/612410342 >> 172.21.15.87:0/612410342 conn(0x561b7a4f0d00 msgr2=0x561b7a4eed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.928+0000 7f32d1533800 1 -- 172.21.15.87:0/612410342 shutdown_connections 2024-05-08T18:31:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.928+0000 7f32d1533800 1 -- 172.21.15.87:0/612410342 wait complete. 2024-05-08T18:31:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.928+0000 7f32d1533800 1 Processor -- start 2024-05-08T18:31:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.928+0000 7f32d1533800 1 -- start start 2024-05-08T18:31:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.928+0000 7f32d1533800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a348920 0x561b7a4fe1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.928+0000 7f32d1533800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561b7a3475f0 con 0x561b7a348920 2024-05-08T18:31:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.928+0000 7f32cdaec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a348920 0x561b7a4fe1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.928+0000 7f32cdaec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a348920 0x561b7a4fe1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32904/0 (socket says 172.21.15.87:32904) 2024-05-08T18:31:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.928+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 learned_addr learned my addr 172.21.15.87:0/438099512 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.928+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7a4fe6e0 con 0x561b7a348920 2024-05-08T18:31:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.929+0000 7f32cdaec640 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a348920 0x561b7a4fe1a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f32c804d010 tx=0x7f32c80528f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.929+0000 7f31a2ffd640 1 -- 172.21.15.87:0/438099512 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c8030020 con 0x561b7a348920 2024-05-08T18:31:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.929+0000 7f31a2ffd640 1 -- 172.21.15.87:0/438099512 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c8015ab0 con 0x561b7a348920 2024-05-08T18:31:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.929+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b7a4fe970 con 0x561b7a348920 2024-05-08T18:31:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.929+0000 7f31a2ffd640 1 -- 172.21.15.87:0/438099512 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c80540d0 con 0x561b7a348920 2024-05-08T18:31:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.929+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b7a501620 con 0x561b7a348920 2024-05-08T18:31:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.929+0000 7f31a2ffd640 1 -- 172.21.15.87:0/438099512 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f32c8033020 con 0x561b7a348920 2024-05-08T18:31:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.930+0000 7f31a2ffd640 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f319803bb00 0x7f319803dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.930+0000 7f31a2ffd640 1 -- 172.21.15.87:0/438099512 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f32c800e040 con 0x561b7a348920 2024-05-08T18:31:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.930+0000 7f32cd2eb640 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f319803bb00 0x7f319803dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.930+0000 7f32d1533800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.930+0000 7f32d1533800 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561b7a509c30 0x561b7a50c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.930+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a50c840 con 0x561b7a509c30 2024-05-08T18:31:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.930+0000 7f32cd2eb640 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f319803bb00 0x7f319803dfc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f32c001dfd0 tx=0x7f32c0048000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.930+0000 7f32c7fff640 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561b7a509c30 0x561b7a50c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.931+0000 7f32c7fff640 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561b7a509c30 0x561b7a50c0f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.931+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.931+0000 7f32d1533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.931+0000 7f32d1533800 20 realm 2024-05-08T18:31:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.931+0000 7f32d1533800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.931+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a50cc10 con 0x561b7a509c30 2024-05-08T18:31:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.931+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.931+0000 7f32d1533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.931+0000 7f32d1533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.931+0000 7f32d1533800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.931+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a50d4e0 con 0x561b7a509c30 2024-05-08T18:31:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.931+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.931+0000 7f32d1533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.931+0000 7f32d1533800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.931+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a50d880 con 0x561b7a509c30 2024-05-08T18:31:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.932+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.932+0000 7f32d1533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.932+0000 7f32d1533800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.932+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a50dca0 con 0x561b7a509c30 2024-05-08T18:31:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.932+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.932+0000 7f32d1533800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.932+0000 7f32d1533800 20 searching for the correct realm 2024-05-08T18:31:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.932+0000 7f32d1533800 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561b7a50fc90 0x561b7a512130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.932+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x561b7a50fc90 2024-05-08T18:31:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.932+0000 7f32cdaec640 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561b7a50fc90 0x561b7a512130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.932+0000 7f32cdaec640 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561b7a50fc90 0x561b7a512130 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.933+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c8029070 con 0x561b7a50fc90 2024-05-08T18:31:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.933+0000 7f32cdaec640 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f32c8035020 0x7f32c802c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.933+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x7f32c8035020 2024-05-08T18:31:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.933+0000 7f32cd2eb640 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f32c8035020 0x7f32c802c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.933+0000 7f32cd2eb640 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f32c8035020 0x7f32c802c480 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.933+0000 7f32cd2eb640 1 -- 172.21.15.87:0/438099512 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c003a070 con 0x7f32c8035020 2024-05-08T18:31:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.933+0000 7f32cd2eb640 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f32c000f070 0x7f32c001c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.933+0000 7f32cd2eb640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x7f32c000f070 2024-05-08T18:31:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.934+0000 7f32c7fff640 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f32c000f070 0x7f32c001c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.934+0000 7f32c7fff640 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f32c000f070 0x7f32c001c820 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.934+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.934+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x561b7a509c30 2024-05-08T18:31:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.935+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.935+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x561b7a509c30 2024-05-08T18:31:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.935+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.935+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x7f32c000f070 2024-05-08T18:31:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.935+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.935+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x7f32c000f070 2024-05-08T18:31:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.935+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.935+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x7f32c8035020 2024-05-08T18:31:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.936+0000 7f32cd2eb640 1 -- 172.21.15.87:0/438099512 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c003a070 con 0x7f32c8035020 2024-05-08T18:31:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.936+0000 7f32cd2eb640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x561b7a50fc90 2024-05-08T18:31:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.936+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c8029070 con 0x561b7a50fc90 2024-05-08T18:31:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.936+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x561b7a509c30 2024-05-08T18:31:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.936+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.936+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x7f32c000f070 2024-05-08T18:31:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.936+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.936+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x561b7a509c30 2024-05-08T18:31:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.937+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.937+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x7f32c8035020 2024-05-08T18:31:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.937+0000 7f32cd2eb640 1 -- 172.21.15.87:0/438099512 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f32c003a070 con 0x7f32c8035020 2024-05-08T18:31:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.937+0000 7f32cd2eb640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x561b7a50fc90 2024-05-08T18:31:17.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.937+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c8029070 con 0x561b7a50fc90 2024-05-08T18:31:17.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.937+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x561b7a50fc90 2024-05-08T18:31:17.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.937+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c8029070 con 0x561b7a50fc90 2024-05-08T18:31:17.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.937+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x7f32c000f070 2024-05-08T18:31:17.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.938+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.938+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x561b7a50fc90 2024-05-08T18:31:17.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.938+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c8029070 con 0x561b7a50fc90 2024-05-08T18:31:17.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.938+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x561b7a50fc90 2024-05-08T18:31:17.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.938+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c8029070 con 0x561b7a50fc90 2024-05-08T18:31:17.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.938+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x561b7a509c30 2024-05-08T18:31:17.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.938+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.938+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x561b7a509c30 2024-05-08T18:31:17.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.938+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.938+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x7f32c000f070 2024-05-08T18:31:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.939+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.939+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x561b7a50fc90 2024-05-08T18:31:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.939+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c8029070 con 0x561b7a50fc90 2024-05-08T18:31:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.939+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x7f32c8035020 2024-05-08T18:31:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.939+0000 7f32cd2eb640 1 -- 172.21.15.87:0/438099512 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c003a070 con 0x7f32c8035020 2024-05-08T18:31:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.939+0000 7f32cd2eb640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x561b7a509c30 2024-05-08T18:31:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.940+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.940+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x7f32c000f070 2024-05-08T18:31:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.940+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.940+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x561b7a50fc90 2024-05-08T18:31:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.940+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c8029070 con 0x561b7a50fc90 2024-05-08T18:31:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.940+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x7f32c000f070 2024-05-08T18:31:17.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.940+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.941+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x7f32c8035020 2024-05-08T18:31:17.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.941+0000 7f32cd2eb640 1 -- 172.21.15.87:0/438099512 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c003a070 con 0x7f32c8035020 2024-05-08T18:31:17.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.941+0000 7f32cd2eb640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x561b7a50fc90 2024-05-08T18:31:17.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.941+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c8029070 con 0x561b7a50fc90 2024-05-08T18:31:17.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.941+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x7f32c000f070 2024-05-08T18:31:17.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.941+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.941+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x561b7a509c30 2024-05-08T18:31:17.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512800 con 0x7f32c8035020 2024-05-08T18:31:17.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32cd2eb640 1 -- 172.21.15.87:0/438099512 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c003a070 con 0x7f32c8035020 2024-05-08T18:31:17.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32d1533800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:17.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32d1533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:17.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32d1533800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:17.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32d1533800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:17.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32d1533800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:17.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32d1533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:17.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32d1533800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a50e6e0 con 0x561b7a509c30 2024-05-08T18:31:17.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32d1533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32d1533800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a50ef80 con 0x561b7a509c30 2024-05-08T18:31:17.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32d1533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:17.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32d1533800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.942+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a50e320 con 0x7f32c000f070 2024-05-08T18:31:17.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32d1533800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:17.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32d1533800 20 zone default found 2024-05-08T18:31:17.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32d1533800 4 Realm: () 2024-05-08T18:31:17.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32d1533800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:17.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32d1533800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:17.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32d1533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:17.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32d1533800 20 zonegroup default 2024-05-08T18:31:17.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32d1533800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a512c80 con 0x7f32c000f070 2024-05-08T18:31:17.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32d1533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32d1533800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a514b10 con 0x561b7a50fc90 2024-05-08T18:31:17.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32c8029070 con 0x561b7a50fc90 2024-05-08T18:31:17.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32d1533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32d1533800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.943+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a514eb0 con 0x561b7a50fc90 2024-05-08T18:31:17.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.944+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32c8029070 con 0x561b7a50fc90 2024-05-08T18:31:17.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.944+0000 7f32d1533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:17.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.944+0000 7f32d1533800 20 started sync module instance, tier type = 2024-05-08T18:31:17.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.944+0000 7f32d1533800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:17.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.944+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a513f50 con 0x7f32c8035020 2024-05-08T18:31:17.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.945+0000 7f32cd2eb640 1 -- 172.21.15.87:0/438099512 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c003a070 con 0x7f32c8035020 2024-05-08T18:31:17.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.945+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94676016251712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a514760 con 0x7f32c8035020 2024-05-08T18:31:17.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.945+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a515bb0 con 0x561b7a509c30 2024-05-08T18:31:17.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.948+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.948+0000 7f32cd2eb640 1 -- 172.21.15.87:0/438099512 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94676016251712] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c003a070 con 0x7f32c8035020 2024-05-08T18:31:17.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.948+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94676016256048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a515fa0 con 0x561b7a509c30 2024-05-08T18:31:17.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.948+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a5169c0 con 0x561b7a50fc90 2024-05-08T18:31:17.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.950+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c8029070 con 0x561b7a50fc90 2024-05-08T18:31:17.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.950+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94676016260272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a517290 con 0x561b7a50fc90 2024-05-08T18:31:17.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.950+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a517d70 con 0x7f32c8035020 2024-05-08T18:31:17.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.950+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94676016256048] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.951+0000 7f32cd2eb640 1 -- 172.21.15.87:0/438099512 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c003a070 con 0x7f32c8035020 2024-05-08T18:31:17.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.951+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94676016260272] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c8029070 con 0x561b7a50fc90 2024-05-08T18:31:17.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.951+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94676016257200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a517290 con 0x7f32c8035020 2024-05-08T18:31:17.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.951+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a518690 con 0x561b7a509c30 2024-05-08T18:31:17.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.953+0000 7f32cd2eb640 1 -- 172.21.15.87:0/438099512 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94676016257200] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c003a070 con 0x7f32c8035020 2024-05-08T18:31:17.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.956+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.956+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94676016267616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a518a80 con 0x561b7a509c30 2024-05-08T18:31:17.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.956+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a519480 con 0x7f32c000f070 2024-05-08T18:31:17.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.957+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94676016267616] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.957+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.957+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94676016262624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a519440 con 0x7f32c000f070 2024-05-08T18:31:17.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.957+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a519e90 con 0x7f32c000f070 2024-05-08T18:31:17.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.959+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(56 notify.6 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.959+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94676016273888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a51a2b0 con 0x7f32c000f070 2024-05-08T18:31:17.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.959+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a51add0 con 0x7f32c000f070 2024-05-08T18:31:17.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.961+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.961+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94676016277664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a51b240 con 0x7f32c000f070 2024-05-08T18:31:17.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.961+0000 7f32d1533800 20 add_watcher() i=0 2024-05-08T18:31:17.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.961+0000 7f32d1533800 20 add_watcher() i=1 2024-05-08T18:31:17.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.961+0000 7f32d1533800 20 add_watcher() i=2 2024-05-08T18:31:17.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.961+0000 7f32d1533800 20 add_watcher() i=3 2024-05-08T18:31:17.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.961+0000 7f32d1533800 20 add_watcher() i=4 2024-05-08T18:31:17.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.961+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(55 notify.5 [watch watch cookie 94676016262624] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.961+0000 7f32d1533800 20 add_watcher() i=5 2024-05-08T18:31:17.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.961+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94676016273888] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.961+0000 7f32d1533800 20 add_watcher() i=6 2024-05-08T18:31:17.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.962+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94676016277664] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.962+0000 7f32d1533800 20 add_watcher() i=7 2024-05-08T18:31:17.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.962+0000 7f32d1533800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:17.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.962+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a519e00 con 0x561b7a509c30 2024-05-08T18:31:17.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.962+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.962+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94676016278928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a519e00 con 0x561b7a509c30 2024-05-08T18:31:17.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.964+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94676016278928] v27'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.964+0000 7f31837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:17.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.964+0000 7f32d1533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:17.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.964+0000 7f32d1533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:17.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.964+0000 7f32d1533800 5 note: GC not initialized 2024-05-08T18:31:17.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.964+0000 7f31827e4640 20 reqs_thread_entry: start 2024-05-08T18:31:17.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.964+0000 7f32d1533800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:17.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.964+0000 7f32d1533800 20 Filter name: none 2024-05-08T18:31:17.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.965+0000 7f30f3fff640 20 reqs_thread_entry: start 2024-05-08T18:31:17.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.965+0000 7f32d1533800 20 rados->read ofs=0 len=0 2024-05-08T18:31:17.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.965+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561b7a550c90 con 0x561b7a509c30 2024-05-08T18:31:17.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.965+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.965+0000 7f32d1533800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:17.968 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:17.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.966+0000 7f31837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:17.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.966+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94676016278928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a54f730 con 0x561b7a509c30 2024-05-08T18:31:17.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.967+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94676016278928] v27'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.967+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94676016251712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a51ad90 con 0x7f32c8035020 2024-05-08T18:31:17.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.968+0000 7f32cd2eb640 1 -- 172.21.15.87:0/438099512 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94676016251712] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c003a070 con 0x7f32c8035020 2024-05-08T18:31:17.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.968+0000 7f32d1533800 20 remove_watcher() i=0 2024-05-08T18:31:17.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.968+0000 7f32d1533800 2 removed watcher, disabling cache 2024-05-08T18:31:17.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.968+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94676016256048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a514340 con 0x561b7a509c30 2024-05-08T18:31:17.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.972+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94676016256048] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.972+0000 7f32d1533800 20 remove_watcher() i=1 2024-05-08T18:31:17.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.972+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94676016260272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a514340 con 0x561b7a50fc90 2024-05-08T18:31:17.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.973+0000 7f32cdaec640 1 -- 172.21.15.87:0/438099512 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94676016260272] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c8029070 con 0x561b7a50fc90 2024-05-08T18:31:17.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.973+0000 7f32d1533800 20 remove_watcher() i=2 2024-05-08T18:31:17.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.973+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94676016257200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a514340 con 0x7f32c8035020 2024-05-08T18:31:17.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.976+0000 7f32cd2eb640 1 -- 172.21.15.87:0/438099512 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94676016257200] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c003a070 con 0x7f32c8035020 2024-05-08T18:31:17.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.976+0000 7f32d1533800 20 remove_watcher() i=3 2024-05-08T18:31:17.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.976+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94676016267616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a515430 con 0x561b7a509c30 2024-05-08T18:31:17.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.980+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94676016267616] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x561b7a509c30 2024-05-08T18:31:17.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.980+0000 7f32d1533800 20 remove_watcher() i=4 2024-05-08T18:31:17.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.980+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94676016262624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a515430 con 0x7f32c000f070 2024-05-08T18:31:17.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.982+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94676016262624] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.982+0000 7f32d1533800 20 remove_watcher() i=5 2024-05-08T18:31:17.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.982+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94676016273888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a516de0 con 0x7f32c000f070 2024-05-08T18:31:17.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.984+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94676016273888] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.984+0000 7f32d1533800 20 remove_watcher() i=6 2024-05-08T18:31:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.984+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94676016277664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561b7a5199e0 con 0x7f32c000f070 2024-05-08T18:31:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94676016277664] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b805a040 con 0x7f32c000f070 2024-05-08T18:31:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32d1533800 20 remove_watcher() i=7 2024-05-08T18:31:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f32c000f070 msgr2=0x7f32c001c820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32d1533800 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f32c000f070 0x7f32c001c820 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561b7a509c30 msgr2=0x561b7a50c0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32d1533800 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561b7a509c30 0x561b7a50c0f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f32c8035020 msgr2=0x7f32c802c480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32d1533800 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f32c8035020 0x7f32c802c480 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561b7a50fc90 msgr2=0x561b7a512130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32d1533800 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561b7a50fc90 0x561b7a512130 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f319803bb00 msgr2=0x7f319803dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32d1533800 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f319803bb00 0x7f319803dfc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f32c001dfd0 tx=0x7f32c0048000 comp rx=0 tx=0).stop 2024-05-08T18:31:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a348920 msgr2=0x561b7a4fe1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32c7fff640 1 -- 172.21.15.87:0/438099512 reap_dead start 2024-05-08T18:31:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32d1533800 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a348920 0x561b7a4fe1a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f32c804d010 tx=0x7f32c80528f0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 shutdown_connections 2024-05-08T18:31:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32d1533800 1 --2- 172.21.15.87:0/438099512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a348920 0x561b7a4fe1a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.985+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 >> 172.21.15.87:0/438099512 conn(0x561b7a4f0d00 msgr2=0x561b7a4ee360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 shutdown_connections 2024-05-08T18:31:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 -- 172.21.15.87:0/438099512 wait complete. 2024-05-08T18:31:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 -- 172.21.15.87:0/3672816879 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31a403bba0 msgr2=0x7f31a403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 --2- 172.21.15.87:0/3672816879 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31a403bba0 0x7f31a403e060 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f32c0000c00 tx=0x7f32c0051740 comp rx=0 tx=0).stop 2024-05-08T18:31:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 -- 172.21.15.87:0/3672816879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a4e76c0 msgr2=0x561b7a4e7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 --2- 172.21.15.87:0/3672816879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a4e76c0 0x561b7a4e7ae0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x561b7a4cd5c0 tx=0x7f32c80178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 -- 172.21.15.87:0/3672816879 shutdown_connections 2024-05-08T18:31:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 --2- 172.21.15.87:0/3672816879 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31a403bba0 0x7f31a403e060 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 --2- 172.21.15.87:0/3672816879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a4e76c0 0x561b7a4e7ae0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 -- 172.21.15.87:0/3672816879 >> 172.21.15.87:0/3672816879 conn(0x561b7a4db760 msgr2=0x561b7a4dbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 -- 172.21.15.87:0/3672816879 shutdown_connections 2024-05-08T18:31:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 -- 172.21.15.87:0/3672816879 wait complete. 2024-05-08T18:31:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 -- 172.21.15.87:0/2039625136 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561b7a4d6b50 msgr2=0x561b7a4d8f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561b7a4d6b50 0x561b7a4d8f40 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 -- 172.21.15.87:0/2039625136 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561b7a3d76a0 msgr2=0x561b7a4d3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561b7a3d76a0 0x561b7a4d3400 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 -- 172.21.15.87:0/2039625136 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31b403bba0 msgr2=0x7f31b403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31b403bba0 0x7f31b403e060 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f32b8054000 tx=0x7f32b804e000 comp rx=0 tx=0).stop 2024-05-08T18:31:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 -- 172.21.15.87:0/2039625136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d32b0 msgr2=0x561b7a4cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d32b0 0x561b7a4cc1c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f32c0000fd0 tx=0x7f32c0000ed0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 -- 172.21.15.87:0/2039625136 shutdown_connections 2024-05-08T18:31:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561b7a3d76a0 0x561b7a4d3400 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561b7a4d6b50 0x561b7a4d8f40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31b403bba0 0x7f31b403e060 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 --2- 172.21.15.87:0/2039625136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b7a3d32b0 0x561b7a4cc1c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 -- 172.21.15.87:0/2039625136 >> 172.21.15.87:0/2039625136 conn(0x561b7a3ce830 msgr2=0x561b7a4be740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.986+0000 7f32d1533800 1 -- 172.21.15.87:0/2039625136 shutdown_connections 2024-05-08T18:31:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:17.987+0000 7f32d1533800 1 -- 172.21.15.87:0/2039625136 wait complete. 2024-05-08T18:31:17.993 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:17.993 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-05-08T18:31:17.993 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-05-08T18:31:17.994 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-05-08T18:31:18.082 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:18.083 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:18.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.085+0000 7f8b95d2d800 1 Processor -- start 2024-05-08T18:31:18.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.085+0000 7f8b95d2d800 1 -- start start 2024-05-08T18:31:18.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.085+0000 7f8b95d2d800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5610603fe160 0x5610603fe580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.085+0000 7f8b95d2d800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5610603fec00 con 0x5610603ff3c0 2024-05-08T18:31:18.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.085+0000 7f8b95d2d800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56106029fe20 con 0x5610603fe160 2024-05-08T18:31:18.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.086+0000 7f8b91978640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5610603fe160 0x5610603fe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.086+0000 7f8b8bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5610603ff3c0 0x5610603ff840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41932/0 (socket says 172.21.15.87:41932) 2024-05-08T18:31:18.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.086+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3154371307 learned_addr learned my addr 172.21.15.87:0/3154371307 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:18.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.086+0000 7f8b91978640 1 -- 172.21.15.87:0/3154371307 >> v1:172.21.15.53:6789/0 conn(0x5610603ff3c0 legacy=0x5610603ff840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.086+0000 7f8b91978640 1 -- 172.21.15.87:0/3154371307 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610603fff80 con 0x5610603fe160 2024-05-08T18:31:18.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.088+0000 7f8b91978640 1 --2- 172.21.15.87:0/3154371307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 0x5610603fe580 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400a470 tx=0x7f8b8401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159c8c82db27feb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.088+0000 7f8b91177640 1 -- 172.21.15.87:0/3154371307 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b84057070 con 0x5610603fe160 2024-05-08T18:31:18.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.088+0000 7f8b91177640 1 -- 172.21.15.87:0/3154371307 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b8404adc0 con 0x5610603fe160 2024-05-08T18:31:18.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.088+0000 7f8b91177640 1 -- 172.21.15.87:0/3154371307 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b84052590 con 0x5610603fe160 2024-05-08T18:31:18.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.088+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3154371307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 msgr2=0x5610603fe580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.088+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/3154371307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 0x5610603fe580 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400a470 tx=0x7f8b8401ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:18.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.088+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3154371307 shutdown_connections 2024-05-08T18:31:18.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.088+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/3154371307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 0x5610603fe580 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.088+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3154371307 >> 172.21.15.87:0/3154371307 conn(0x5610603f9740 msgr2=0x5610603fbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.089+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3154371307 shutdown_connections 2024-05-08T18:31:18.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.089+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3154371307 wait complete. 2024-05-08T18:31:18.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.102+0000 7f8b95d2d800 1 Processor -- start 2024-05-08T18:31:18.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.102+0000 7f8b95d2d800 1 -- start start 2024-05-08T18:31:18.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.102+0000 7f8b95d2d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 0x5610603722e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.102+0000 7f8b95d2d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56106034a5d0 con 0x5610603fe160 2024-05-08T18:31:18.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.102+0000 7f8b91978640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 0x5610603722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.103+0000 7f8b91978640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 0x5610603722e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32916/0 (socket says 172.21.15.87:32916) 2024-05-08T18:31:18.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.103+0000 7f8b91978640 1 -- 172.21.15.87:0/23826261 learned_addr learned my addr 172.21.15.87:0/23826261 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.103+0000 7f8b91978640 1 -- 172.21.15.87:0/23826261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610604f3590 con 0x5610603fe160 2024-05-08T18:31:18.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.103+0000 7f8b91978640 1 --2- 172.21.15.87:0/23826261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 0x5610603722e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8b84055040 tx=0x7f8b8404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c628bebe21ea8f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.103+0000 7f8a7fe07640 1 -- 172.21.15.87:0/23826261 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b84057040 con 0x5610603fe160 2024-05-08T18:31:18.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.103+0000 7f8a7fe07640 1 -- 172.21.15.87:0/23826261 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b84063070 con 0x5610603fe160 2024-05-08T18:31:18.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.103+0000 7f8a7fe07640 1 -- 172.21.15.87:0/23826261 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b8405d790 con 0x5610603fe160 2024-05-08T18:31:18.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.104+0000 7f8b95d2d800 1 -- 172.21.15.87:0/23826261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 msgr2=0x5610603722e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.104+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/23826261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 0x5610603722e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8b84055040 tx=0x7f8b8404c000 comp rx=0 tx=0).stop 2024-05-08T18:31:18.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.104+0000 7f8b95d2d800 1 -- 172.21.15.87:0/23826261 shutdown_connections 2024-05-08T18:31:18.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.104+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/23826261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 0x5610603722e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.104+0000 7f8b95d2d800 1 -- 172.21.15.87:0/23826261 >> 172.21.15.87:0/23826261 conn(0x5610603f9740 msgr2=0x5610604eb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.104+0000 7f8b95d2d800 1 -- 172.21.15.87:0/23826261 shutdown_connections 2024-05-08T18:31:18.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.104+0000 7f8b95d2d800 1 -- 172.21.15.87:0/23826261 wait complete. 2024-05-08T18:31:18.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.104+0000 7f8b95d2d800 1 Processor -- start 2024-05-08T18:31:18.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.104+0000 7f8b95d2d800 1 -- start start 2024-05-08T18:31:18.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.104+0000 7f8b95d2d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 0x5610604f0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.104+0000 7f8b95d2d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561060407890 con 0x5610603fe160 2024-05-08T18:31:18.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.105+0000 7f8b91978640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 0x5610604f0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.105+0000 7f8b91978640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 0x5610604f0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32926/0 (socket says 172.21.15.87:32926) 2024-05-08T18:31:18.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.105+0000 7f8b91978640 1 -- 172.21.15.87:0/2235817059 learned_addr learned my addr 172.21.15.87:0/2235817059 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.105+0000 7f8b91978640 1 -- 172.21.15.87:0/2235817059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610604ef5b0 con 0x5610603fe160 2024-05-08T18:31:18.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.105+0000 7f8b91978640 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 0x5610604f0ec0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400a470 tx=0x7f8b84002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.105+0000 7f8a7e604640 1 -- 172.21.15.87:0/2235817059 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b84057050 con 0x5610603fe160 2024-05-08T18:31:18.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.105+0000 7f8a7e604640 1 -- 172.21.15.87:0/2235817059 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b8405dc90 con 0x5610603fe160 2024-05-08T18:31:18.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.105+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2235817059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610604ef840 con 0x5610603fe160 2024-05-08T18:31:18.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.105+0000 7f8a7e604640 1 -- 172.21.15.87:0/2235817059 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b84052440 con 0x5610603fe160 2024-05-08T18:31:18.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.105+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2235817059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610604efdc0 con 0x5610603fe160 2024-05-08T18:31:18.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.106+0000 7f8a7e604640 1 -- 172.21.15.87:0/2235817059 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8b840525e0 con 0x5610603fe160 2024-05-08T18:31:18.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.106+0000 7f8a7e604640 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8a7803bba0 0x7f8a7803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.106+0000 7f8a7e604640 1 -- 172.21.15.87:0/2235817059 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8b840940a0 con 0x5610603fe160 2024-05-08T18:31:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.106+0000 7f8b8bfff640 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8a7803bba0 0x7f8a7803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.106+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5610603ff3c0 0x561060501870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.106+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2235817059 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561060501db0 con 0x5610603ff3c0 2024-05-08T18:31:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.107+0000 7f8b92179640 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5610603ff3c0 0x561060501870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.107+0000 7f8b8bfff640 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8a7803bba0 0x7f8a7803e060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c000f60 tx=0x7f8b7c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.107+0000 7f8b92179640 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5610603ff3c0 0x561060501870 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.107+0000 7f8b92179640 1 -- 172.21.15.87:0/2235817059 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b8c00a4a0 con 0x5610603ff3c0 2024-05-08T18:31:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.107+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2235817059 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561060502600 con 0x5610603ff3c0 2024-05-08T18:31:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.107+0000 7f8b92179640 1 -- 172.21.15.87:0/2235817059 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b8c00a4a0 con 0x5610603ff3c0 2024-05-08T18:31:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.107+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2235817059 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610605039b0 con 0x5610603ff3c0 2024-05-08T18:31:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.108+0000 7f8b92179640 1 -- 172.21.15.87:0/2235817059 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8b8c00a4a0 con 0x5610603ff3c0 2024-05-08T18:31:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.108+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2235817059 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561060502e50 con 0x5610603ff3c0 2024-05-08T18:31:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.108+0000 7f8b92179640 1 -- 172.21.15.87:0/2235817059 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b8c00a4a0 con 0x5610603ff3c0 2024-05-08T18:31:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.108+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561060504e20 0x561060507210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.108+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2235817059 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610605078b0 con 0x561060504e20 2024-05-08T18:31:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.108+0000 7f8b91978640 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561060504e20 0x561060507210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.109+0000 7f8b91978640 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561060504e20 0x561060507210 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.109+0000 7f8b91978640 1 -- 172.21.15.87:0/2235817059 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8b84078070 con 0x561060504e20 2024-05-08T18:31:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.110+0000 7f8b95d2d800 1 Processor -- start 2024-05-08T18:31:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.110+0000 7f8b95d2d800 1 -- start start 2024-05-08T18:31:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.110+0000 7f8b95d2d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060515bc0 0x561060515fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.110+0000 7f8b95d2d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5610604f1400 con 0x561060515bc0 2024-05-08T18:31:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.110+0000 7f8b92179640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060515bc0 0x561060515fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.110+0000 7f8b92179640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060515bc0 0x561060515fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32928/0 (socket says 172.21.15.87:32928) 2024-05-08T18:31:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.110+0000 7f8b92179640 1 -- 172.21.15.87:0/1409548362 learned_addr learned my addr 172.21.15.87:0/1409548362 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.110+0000 7f8b92179640 1 -- 172.21.15.87:0/1409548362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561060516520 con 0x561060515bc0 2024-05-08T18:31:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.110+0000 7f8b92179640 1 --2- 172.21.15.87:0/1409548362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060515bc0 0x561060515fe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x5610604f0c00 tx=0x7f8b8c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.111+0000 7f8a777fe640 1 -- 172.21.15.87:0/1409548362 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c013440 con 0x561060515bc0 2024-05-08T18:31:18.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.111+0000 7f8a777fe640 1 -- 172.21.15.87:0/1409548362 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b8c0135e0 con 0x561060515bc0 2024-05-08T18:31:18.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.111+0000 7f8a777fe640 1 -- 172.21.15.87:0/1409548362 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c0138c0 con 0x561060515bc0 2024-05-08T18:31:18.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.111+0000 7f8b95d2d800 1 -- 172.21.15.87:0/1409548362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561060516f90 con 0x561060515bc0 2024-05-08T18:31:18.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.111+0000 7f8b95d2d800 1 -- 172.21.15.87:0/1409548362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561060517490 con 0x561060515bc0 2024-05-08T18:31:18.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.111+0000 7f8a777fe640 1 -- 172.21.15.87:0/1409548362 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8b8c011040 con 0x561060515bc0 2024-05-08T18:31:18.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.112+0000 7f8a777fe640 1 --2- 172.21.15.87:0/1409548362 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8a6c03bba0 0x7f8a6c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.112+0000 7f8a777fe640 1 -- 172.21.15.87:0/1409548362 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8b8c01d070 con 0x561060515bc0 2024-05-08T18:31:18.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.112+0000 7f8b91978640 1 --2- 172.21.15.87:0/1409548362 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8a6c03bba0 0x7f8a6c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.112+0000 7f8b95d2d800 1 Processor -- start 2024-05-08T18:31:18.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.112+0000 7f8b91978640 1 --2- 172.21.15.87:0/1409548362 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8a6c03bba0 0x7f8a6c03e060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8b8405ce40 tx=0x7f8b8405cf30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.112+0000 7f8b95d2d800 1 -- start start 2024-05-08T18:31:18.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.112+0000 7f8b95d2d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060522e50 0x561060523270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.112+0000 7f8b95d2d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5610602f0fc0 con 0x561060522e50 2024-05-08T18:31:18.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.112+0000 7f8b92179640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060522e50 0x561060523270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.112+0000 7f8b92179640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060522e50 0x561060523270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32930/0 (socket says 172.21.15.87:32930) 2024-05-08T18:31:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.112+0000 7f8b92179640 1 -- 172.21.15.87:0/2626987829 learned_addr learned my addr 172.21.15.87:0/2626987829 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.113+0000 7f8b92179640 1 -- 172.21.15.87:0/2626987829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561060523840 con 0x561060522e50 2024-05-08T18:31:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.113+0000 7f8b92179640 1 --2- 172.21.15.87:0/2626987829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060522e50 0x561060523270 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c052930 tx=0x7f8b8c001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4874fbd6d11f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.113+0000 7f8a757fa640 1 -- 172.21.15.87:0/2626987829 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c0540d0 con 0x561060522e50 2024-05-08T18:31:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.113+0000 7f8a757fa640 1 -- 172.21.15.87:0/2626987829 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b8c054270 con 0x561060522e50 2024-05-08T18:31:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.113+0000 7f8a757fa640 1 -- 172.21.15.87:0/2626987829 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c001640 con 0x561060522e50 2024-05-08T18:31:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.113+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2626987829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060522e50 msgr2=0x561060523270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.113+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/2626987829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060522e50 0x561060523270 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c052930 tx=0x7f8b8c001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.113+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2626987829 shutdown_connections 2024-05-08T18:31:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.113+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/2626987829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060522e50 0x561060523270 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.113+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2626987829 >> 172.21.15.87:0/2626987829 conn(0x56106051f1b0 msgr2=0x56106051d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.113+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2626987829 shutdown_connections 2024-05-08T18:31:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.113+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2626987829 wait complete. 2024-05-08T18:31:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.114+0000 7f8b95d2d800 1 Processor -- start 2024-05-08T18:31:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.114+0000 7f8b95d2d800 1 -- start start 2024-05-08T18:31:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.114+0000 7f8b95d2d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060522e50 0x56106052a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.114+0000 7f8b95d2d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561060523e30 con 0x561060522e50 2024-05-08T18:31:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.114+0000 7f8b92179640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060522e50 0x56106052a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.114+0000 7f8b92179640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060522e50 0x56106052a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32940/0 (socket says 172.21.15.87:32940) 2024-05-08T18:31:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.114+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 learned_addr learned my addr 172.21.15.87:0/3532049243 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.115+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56106052a870 con 0x561060522e50 2024-05-08T18:31:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.115+0000 7f8b92179640 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060522e50 0x56106052a330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c015fd0 tx=0x7f8b8c052890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.115+0000 7f8a637fe640 1 -- 172.21.15.87:0/3532049243 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c030020 con 0x561060522e50 2024-05-08T18:31:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.115+0000 7f8a637fe640 1 -- 172.21.15.87:0/3532049243 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b8c015ad0 con 0x561060522e50 2024-05-08T18:31:18.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.115+0000 7f8a637fe640 1 -- 172.21.15.87:0/3532049243 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c02ae60 con 0x561060522e50 2024-05-08T18:31:18.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.115+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56106052ab00 con 0x561060522e50 2024-05-08T18:31:18.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.115+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56106052d7b0 con 0x561060522e50 2024-05-08T18:31:18.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.116+0000 7f8a637fe640 1 -- 172.21.15.87:0/3532049243 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8b8c033020 con 0x561060522e50 2024-05-08T18:31:18.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.116+0000 7f8a637fe640 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8a5c03bba0 0x7f8a5c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.116+0000 7f8a637fe640 1 -- 172.21.15.87:0/3532049243 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8b8c00e040 con 0x561060522e50 2024-05-08T18:31:18.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.116+0000 7f8b91978640 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8a5c03bba0 0x7f8a5c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.116+0000 7f8b91978640 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8a5c03bba0 0x7f8a5c03e060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b840911b0 tx=0x7f8b8407f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.117+0000 7f8b95d2d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.117+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561060535f80 0x561060538440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.117+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561060538b90 con 0x561060535f80 2024-05-08T18:31:18.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.117+0000 7f8b8bfff640 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561060535f80 0x561060538440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.117+0000 7f8b8bfff640 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561060535f80 0x561060538440 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.117+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b7c009050 con 0x561060535f80 2024-05-08T18:31:18.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.117+0000 7f8b95d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.117+0000 7f8b95d2d800 20 realm 2024-05-08T18:31:18.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.117+0000 7f8b95d2d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.117+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5610605353d0 con 0x561060535f80 2024-05-08T18:31:18.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.117+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b7c009050 con 0x561060535f80 2024-05-08T18:31:18.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.117+0000 7f8b95d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.117+0000 7f8b95d2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:18.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.117+0000 7f8b95d2d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.117+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561060539680 con 0x561060535f80 2024-05-08T18:31:18.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.118+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b7c009050 con 0x561060535f80 2024-05-08T18:31:18.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.118+0000 7f8b95d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.118+0000 7f8b95d2d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.118+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561060539f50 con 0x561060535f80 2024-05-08T18:31:18.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.118+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b7c009050 con 0x561060535f80 2024-05-08T18:31:18.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.118+0000 7f8b95d2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:18.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.118+0000 7f8b95d2d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.118+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56106053a2f0 con 0x561060535f80 2024-05-08T18:31:18.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.118+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8b7c009050 con 0x561060535f80 2024-05-08T18:31:18.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.118+0000 7f8b95d2d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:18.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.118+0000 7f8b95d2d800 20 searching for the correct realm 2024-05-08T18:31:18.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.118+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56106053c1d0 0x56106053e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.118+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x56106053c1d0 2024-05-08T18:31:18.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.118+0000 7f8b92179640 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56106053c1d0 0x56106053e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.118+0000 7f8b92179640 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56106053c1d0 0x56106053e5c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.119+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c029070 con 0x56106053c1d0 2024-05-08T18:31:18.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.119+0000 7f8b92179640 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8b8c035020 0x7f8b8c02b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.119+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x7f8b8c035020 2024-05-08T18:31:18.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.119+0000 7f8b91978640 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8b8c035020 0x7f8b8c02b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.119+0000 7f8b91978640 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8b8c035020 0x7f8b8c02b3e0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.120+0000 7f8b91978640 1 -- 172.21.15.87:0/3532049243 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84078070 con 0x7f8b8c035020 2024-05-08T18:31:18.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.120+0000 7f8b91978640 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8b84066380 0x7f8b84087470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.120+0000 7f8b91978640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x7f8b84066380 2024-05-08T18:31:18.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.120+0000 7f8b8bfff640 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8b84066380 0x7f8b84087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.120+0000 7f8b8bfff640 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8b84066380 0x7f8b84087470 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.121+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c009050 con 0x7f8b84066380 2024-05-08T18:31:18.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.121+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x561060535f80 2024-05-08T18:31:18.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.121+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c009050 con 0x561060535f80 2024-05-08T18:31:18.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.121+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x561060535f80 2024-05-08T18:31:18.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.121+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.121+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x7f8b84066380 2024-05-08T18:31:18.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.121+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.121+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x7f8b84066380 2024-05-08T18:31:18.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.122+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.122+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x7f8b8c035020 2024-05-08T18:31:18.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.122+0000 7f8b91978640 1 -- 172.21.15.87:0/3532049243 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84078070 con 0x7f8b8c035020 2024-05-08T18:31:18.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.122+0000 7f8b91978640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x56106053c1d0 2024-05-08T18:31:18.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.122+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c029070 con 0x56106053c1d0 2024-05-08T18:31:18.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.122+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x561060535f80 2024-05-08T18:31:18.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.122+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.122+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x7f8b84066380 2024-05-08T18:31:18.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.123+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.123+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x561060535f80 2024-05-08T18:31:18.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.123+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.123+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x7f8b8c035020 2024-05-08T18:31:18.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.123+0000 7f8b91978640 1 -- 172.21.15.87:0/3532049243 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8b84078070 con 0x7f8b8c035020 2024-05-08T18:31:18.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.123+0000 7f8b91978640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x56106053c1d0 2024-05-08T18:31:18.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.123+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c029070 con 0x56106053c1d0 2024-05-08T18:31:18.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.123+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x56106053c1d0 2024-05-08T18:31:18.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.123+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c029070 con 0x56106053c1d0 2024-05-08T18:31:18.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.123+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x7f8b84066380 2024-05-08T18:31:18.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.124+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.124+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x56106053c1d0 2024-05-08T18:31:18.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.124+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c029070 con 0x56106053c1d0 2024-05-08T18:31:18.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.124+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x56106053c1d0 2024-05-08T18:31:18.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.124+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c029070 con 0x56106053c1d0 2024-05-08T18:31:18.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.124+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x561060535f80 2024-05-08T18:31:18.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.124+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.124+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x561060535f80 2024-05-08T18:31:18.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.125+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.125+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x7f8b84066380 2024-05-08T18:31:18.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.125+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.125+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x56106053c1d0 2024-05-08T18:31:18.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.125+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c029070 con 0x56106053c1d0 2024-05-08T18:31:18.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.125+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x7f8b8c035020 2024-05-08T18:31:18.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.125+0000 7f8b91978640 1 -- 172.21.15.87:0/3532049243 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84078070 con 0x7f8b8c035020 2024-05-08T18:31:18.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.125+0000 7f8b91978640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x561060535f80 2024-05-08T18:31:18.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.126+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.126+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x7f8b84066380 2024-05-08T18:31:18.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.126+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.126+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x56106053c1d0 2024-05-08T18:31:18.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.126+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c029070 con 0x56106053c1d0 2024-05-08T18:31:18.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.126+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x7f8b84066380 2024-05-08T18:31:18.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.127+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.127+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x7f8b8c035020 2024-05-08T18:31:18.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.127+0000 7f8b91978640 1 -- 172.21.15.87:0/3532049243 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84078070 con 0x7f8b8c035020 2024-05-08T18:31:18.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.127+0000 7f8b91978640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x56106053c1d0 2024-05-08T18:31:18.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.127+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c029070 con 0x56106053c1d0 2024-05-08T18:31:18.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.127+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x7f8b84066380 2024-05-08T18:31:18.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.127+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.127+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x561060535f80 2024-05-08T18:31:18.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56106053ec70 con 0x7f8b8c035020 2024-05-08T18:31:18.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b91978640 1 -- 172.21.15.87:0/3532049243 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84078070 con 0x7f8b8c035020 2024-05-08T18:31:18.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b95d2d800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:18.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b95d2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:18.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b95d2d800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:18.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b95d2d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:18.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b95d2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:18.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b95d2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:18.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b95d2d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56106053ac70 con 0x561060535f80 2024-05-08T18:31:18.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b95d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b95d2d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56106053b510 con 0x561060535f80 2024-05-08T18:31:18.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b95d2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:18.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b95d2d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.128+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56106053f0f0 con 0x7f8b84066380 2024-05-08T18:31:18.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b95d2d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:18.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b95d2d800 20 zone default found 2024-05-08T18:31:18.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b95d2d800 4 Realm: () 2024-05-08T18:31:18.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b95d2d800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:18.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b95d2d800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:18.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b95d2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:18.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b95d2d800 20 zonegroup default 2024-05-08T18:31:18.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b95d2d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56106053b140 con 0x7f8b84066380 2024-05-08T18:31:18.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b95d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b95d2d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561060541000 con 0x56106053c1d0 2024-05-08T18:31:18.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b8c029070 con 0x56106053c1d0 2024-05-08T18:31:18.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b95d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b95d2d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561060541430 con 0x56106053c1d0 2024-05-08T18:31:18.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b8c029070 con 0x56106053c1d0 2024-05-08T18:31:18.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.129+0000 7f8b95d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.130+0000 7f8b95d2d800 20 started sync module instance, tier type = 2024-05-08T18:31:18.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.130+0000 7f8b95d2d800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:18.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.130+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610605404a0 con 0x7f8b8c035020 2024-05-08T18:31:18.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.130+0000 7f8b91978640 1 -- 172.21.15.87:0/3532049243 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84078070 con 0x7f8b8c035020 2024-05-08T18:31:18.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.130+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94628335585424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060541d40 con 0x7f8b8c035020 2024-05-08T18:31:18.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.130+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060542590 con 0x561060535f80 2024-05-08T18:31:18.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.131+0000 7f8b91978640 1 -- 172.21.15.87:0/3532049243 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94628335585424] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84078070 con 0x7f8b8c035020 2024-05-08T18:31:18.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.132+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.132+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94628335589520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060542590 con 0x561060535f80 2024-05-08T18:31:18.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.132+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610605430b0 con 0x56106053c1d0 2024-05-08T18:31:18.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.133+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8c029070 con 0x56106053c1d0 2024-05-08T18:31:18.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.133+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94628335594368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060543950 con 0x56106053c1d0 2024-05-08T18:31:18.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.133+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060544440 con 0x7f8b8c035020 2024-05-08T18:31:18.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.134+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94628335594368] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8c029070 con 0x56106053c1d0 2024-05-08T18:31:18.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.135+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94628335589520] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.140+0000 7f8b91978640 1 -- 172.21.15.87:0/3532049243 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84078070 con 0x7f8b8c035020 2024-05-08T18:31:18.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.140+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94628335591648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060543950 con 0x7f8b8c035020 2024-05-08T18:31:18.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.140+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060544ce0 con 0x561060535f80 2024-05-08T18:31:18.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.144+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.144+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94628335602224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060545580 con 0x561060535f80 2024-05-08T18:31:18.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.144+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060546030 con 0x7f8b84066380 2024-05-08T18:31:18.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.148+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.148+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94628335606544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060546030 con 0x7f8b84066380 2024-05-08T18:31:18.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.148+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060546f70 con 0x7f8b84066380 2024-05-08T18:31:18.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.148+0000 7f8b91978640 1 -- 172.21.15.87:0/3532049243 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94628335591648] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84078070 con 0x7f8b8c035020 2024-05-08T18:31:18.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.152+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94628335602224] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.152+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94628335606544] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.152+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.152+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94628335603920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060546f30 con 0x7f8b84066380 2024-05-08T18:31:18.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.152+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060547360 con 0x7f8b84066380 2024-05-08T18:31:18.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.153+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94628335603920] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.153+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.153+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94628335610432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060546f30 con 0x7f8b84066380 2024-05-08T18:31:18.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.153+0000 7f8b95d2d800 20 add_watcher() i=0 2024-05-08T18:31:18.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.153+0000 7f8b95d2d800 20 add_watcher() i=1 2024-05-08T18:31:18.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.153+0000 7f8b95d2d800 20 add_watcher() i=2 2024-05-08T18:31:18.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.153+0000 7f8b95d2d800 20 add_watcher() i=3 2024-05-08T18:31:18.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.153+0000 7f8b95d2d800 20 add_watcher() i=4 2024-05-08T18:31:18.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.153+0000 7f8b95d2d800 20 add_watcher() i=5 2024-05-08T18:31:18.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.153+0000 7f8b95d2d800 20 add_watcher() i=6 2024-05-08T18:31:18.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.154+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94628335610432] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.154+0000 7f8b95d2d800 20 add_watcher() i=7 2024-05-08T18:31:18.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.154+0000 7f8b95d2d800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:18.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.154+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56106054a390 con 0x561060535f80 2024-05-08T18:31:18.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.154+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.154+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94628335608336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060547810 con 0x561060535f80 2024-05-08T18:31:18.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.156+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94628335608336] v27'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.156+0000 7f8a437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:18.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.156+0000 7f8b95d2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:18.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.156+0000 7f8b95d2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:18.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.156+0000 7f8b95d2d800 5 note: GC not initialized 2024-05-08T18:31:18.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.156+0000 7f8a427fc640 20 reqs_thread_entry: start 2024-05-08T18:31:18.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.156+0000 7f8b95d2d800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:18.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.156+0000 7f8b95d2d800 20 Filter name: none 2024-05-08T18:31:18.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.156+0000 7f89b3fff640 20 reqs_thread_entry: start 2024-05-08T18:31:18.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.156+0000 7f8b95d2d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:18.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.156+0000 7f8b95d2d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.156+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56106057d7e0 con 0x561060535f80 2024-05-08T18:31:18.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.157+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.157+0000 7f8b95d2d800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:18.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.157+0000 7f8b95d2d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:18.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.157+0000 7f8b95d2d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:18.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.157+0000 7f8b95d2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:18.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.157+0000 7f8b95d2d800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-08T18:31:18.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.157+0000 7f8b95d2d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.157+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56106057e0f0 con 0x7f8b84066380 2024-05-08T18:31:18.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.157+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.157+0000 7f8b95d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.157+0000 7f8b95d2d800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-08T18:31:18.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.157+0000 7f8b95d2d800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:31:18.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.157+0000 7f8b95d2d800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:31:18.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.157+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060583b50 con 0x561060535f80 2024-05-08T18:31:18.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.160+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v27'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.160+0000 7f8b95d2d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:18.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.160+0000 7f8b95d2d800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:18.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.160+0000 7f8b95d2d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:31:18.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.160+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94628335858960 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56106057f190 con 0x561060535f80 2024-05-08T18:31:18.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.160+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== watch-notify(notify (1) cookie 94628335602224 notify 115964116995 ret 0) ==== 720+0+0 (crc 0 0 0) 0x5610603fec00 con 0x561060535f80 2024-05-08T18:31:18.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.160+0000 7f8a757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 94628335602224 notifier 4333 bl.length()=678 2024-05-08T18:31:18.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.160+0000 7f8a757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:18.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.160+0000 7f8a757fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:18.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.160+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(65 notify.4 [notify cookie 94628335858960 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.160+0000 7f8a757fa640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f8a54003ea0 con 0x561060535f80 2024-05-08T18:31:18.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.161+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.161+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== watch-notify(notify_complete (2) cookie 94628335858960 notify 115964116995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8b7c02ea50 con 0x561060535f80 2024-05-08T18:31:18.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.161+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060583510 con 0x7f8b84066380 2024-05-08T18:31:18.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.162+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.162+0000 7f8b95d2d800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:31:18.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.162+0000 7f8b95d2d800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:31:18.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.162+0000 7f8b95d2d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:31:18.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.162+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94628335858960 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56106057ece0 con 0x56106053c1d0 2024-05-08T18:31:18.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.162+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== watch-notify(notify (1) cookie 94628335594368 notify 115964116992 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56106052d7b0 con 0x56106053c1d0 2024-05-08T18:31:18.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.162+0000 7f8a757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116992 cookie 94628335594368 notifier 4333 bl.length()=177 2024-05-08T18:31:18.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.162+0000 7f8a757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:31:18.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.162+0000 7f8a757fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:31:18.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.162+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(68 notify.2 [notify cookie 94628335858960 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8b8c029070 con 0x56106053c1d0 2024-05-08T18:31:18.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.162+0000 7f8a757fa640 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f8a54003ea0 con 0x56106053c1d0 2024-05-08T18:31:18.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.163+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== watch-notify(notify_complete (2) cookie 94628335858960 notify 115964116992 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8b8c069020 con 0x56106053c1d0 2024-05-08T18:31:18.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.163+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8c06b040 con 0x56106053c1d0 2024-05-08T18:31:18.163 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T18:31:18.158600Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:18.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.164+0000 7f8a437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:18.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.164+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94628335608336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56106057f5c0 con 0x561060535f80 2024-05-08T18:31:18.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.165+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94628335608336] v27'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.165+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94628335585424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060546210 con 0x7f8b8c035020 2024-05-08T18:31:18.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.166+0000 7f8b91978640 1 -- 172.21.15.87:0/3532049243 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94628335585424] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84078070 con 0x7f8b8c035020 2024-05-08T18:31:18.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.166+0000 7f8b95d2d800 20 remove_watcher() i=0 2024-05-08T18:31:18.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.166+0000 7f8b95d2d800 2 removed watcher, disabling cache 2024-05-08T18:31:18.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.166+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94628335589520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060540890 con 0x561060535f80 2024-05-08T18:31:18.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.169+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94628335589520] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.169+0000 7f8b95d2d800 20 remove_watcher() i=1 2024-05-08T18:31:18.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.169+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94628335594368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060540890 con 0x56106053c1d0 2024-05-08T18:31:18.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.170+0000 7f8b92179640 1 -- 172.21.15.87:0/3532049243 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94628335594368] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8c06b040 con 0x56106053c1d0 2024-05-08T18:31:18.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.170+0000 7f8b95d2d800 20 remove_watcher() i=2 2024-05-08T18:31:18.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.170+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94628335591648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060542b80 con 0x7f8b8c035020 2024-05-08T18:31:18.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.173+0000 7f8b91978640 1 -- 172.21.15.87:0/3532049243 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94628335591648] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84078070 con 0x7f8b8c035020 2024-05-08T18:31:18.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.173+0000 7f8b95d2d800 20 remove_watcher() i=3 2024-05-08T18:31:18.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.173+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94628335602224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060540890 con 0x561060535f80 2024-05-08T18:31:18.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.174+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94628335602224] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x561060535f80 2024-05-08T18:31:18.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.174+0000 7f8b95d2d800 20 remove_watcher() i=4 2024-05-08T18:31:18.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.174+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94628335606544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5610605420e0 con 0x7f8b84066380 2024-05-08T18:31:18.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.175+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94628335606544] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.175+0000 7f8b95d2d800 20 remove_watcher() i=5 2024-05-08T18:31:18.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.175+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94628335603920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060542b80 con 0x7f8b84066380 2024-05-08T18:31:18.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.178+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94628335603920] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.178+0000 7f8b95d2d800 20 remove_watcher() i=6 2024-05-08T18:31:18.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.178+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94628335610432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561060544a30 con 0x7f8b84066380 2024-05-08T18:31:18.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94628335610432] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02a040 con 0x7f8b84066380 2024-05-08T18:31:18.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 20 remove_watcher() i=7 2024-05-08T18:31:18.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8b84066380 msgr2=0x7f8b84087470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8b84066380 0x7f8b84087470 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561060535f80 msgr2=0x561060538440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561060535f80 0x561060538440 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8b8c035020 msgr2=0x7f8b8c02b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8b8c035020 0x7f8b8c02b3e0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56106053c1d0 msgr2=0x56106053e5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56106053c1d0 0x56106053e5c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8a5c03bba0 msgr2=0x7f8a5c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8a5c03bba0 0x7f8a5c03e060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b840911b0 tx=0x7f8b8407f000 comp rx=0 tx=0).stop 2024-05-08T18:31:18.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060522e50 msgr2=0x56106052a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/3532049243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060522e50 0x56106052a330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c015fd0 tx=0x7f8b8c052890 comp rx=0 tx=0).stop 2024-05-08T18:31:18.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 reap_dead start 2024-05-08T18:31:18.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b8bfff640 1 -- 172.21.15.87:0/3532049243 reap_dead start 2024-05-08T18:31:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 shutdown_connections 2024-05-08T18:31:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 >> 172.21.15.87:0/3532049243 conn(0x56106051f1b0 msgr2=0x56106051c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 shutdown_connections 2024-05-08T18:31:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 -- 172.21.15.87:0/3532049243 wait complete. 2024-05-08T18:31:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 -- 172.21.15.87:0/1409548362 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8a6c03bba0 msgr2=0x7f8a6c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/1409548362 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8a6c03bba0 0x7f8a6c03e060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8b8405ce40 tx=0x7f8b8405cf30 comp rx=0 tx=0).stop 2024-05-08T18:31:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 -- 172.21.15.87:0/1409548362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060515bc0 msgr2=0x561060515fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/1409548362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060515bc0 0x561060515fe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x5610604f0c00 tx=0x7f8b8c0178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 -- 172.21.15.87:0/1409548362 shutdown_connections 2024-05-08T18:31:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/1409548362 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8a6c03bba0 0x7f8a6c03e060 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/1409548362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561060515bc0 0x561060515fe0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 -- 172.21.15.87:0/1409548362 >> 172.21.15.87:0/1409548362 conn(0x561060509c60 msgr2=0x56106050a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.179+0000 7f8b95d2d800 1 -- 172.21.15.87:0/1409548362 shutdown_connections 2024-05-08T18:31:18.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.180+0000 7f8b95d2d800 1 -- 172.21.15.87:0/1409548362 wait complete. 2024-05-08T18:31:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.180+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2235817059 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561060504e20 msgr2=0x561060507210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.180+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561060504e20 0x561060507210 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.180+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2235817059 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5610603ff3c0 msgr2=0x561060501870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.180+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5610603ff3c0 0x561060501870 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.180+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2235817059 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8a7803bba0 msgr2=0x7f8a7803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.180+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8a7803bba0 0x7f8a7803e060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c000f60 tx=0x7f8b7c0012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.180+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2235817059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 msgr2=0x5610604f0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.180+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 0x5610604f0ec0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400a470 tx=0x7f8b84002fb0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.180+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2235817059 shutdown_connections 2024-05-08T18:31:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.180+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5610603ff3c0 0x561060501870 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.180+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561060504e20 0x561060507210 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.180+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8a7803bba0 0x7f8a7803e060 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.180+0000 7f8b95d2d800 1 --2- 172.21.15.87:0/2235817059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5610603fe160 0x5610604f0ec0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.180+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2235817059 >> 172.21.15.87:0/2235817059 conn(0x5610603f9740 msgr2=0x5610604e9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.180+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2235817059 shutdown_connections 2024-05-08T18:31:18.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.180+0000 7f8b95d2d800 1 -- 172.21.15.87:0/2235817059 wait complete. 2024-05-08T18:31:18.187 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T18:31:18.158600Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:18.187 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:31:18.187 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:31:18.187 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:31:18.231 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:18.231 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:18.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.233+0000 7fd4f7d46800 1 Processor -- start 2024-05-08T18:31:18.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.233+0000 7fd4f7d46800 1 -- start start 2024-05-08T18:31:18.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.234+0000 7fd4f7d46800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c14d6a46a0 0x55c14d6a6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.234+0000 7fd4f7d46800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c14d6a7060 con 0x55c14d6a02b0 2024-05-08T18:31:18.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.234+0000 7fd4f7d46800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55c14d540e20 con 0x55c14d6a46a0 2024-05-08T18:31:18.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.234+0000 7fd4f5044640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c14d6a46a0 0x55c14d6a6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.234+0000 7fd4f5845640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55c14d6a02b0 0x55c14d6a06d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41936/0 (socket says 172.21.15.87:41936) 2024-05-08T18:31:18.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.234+0000 7fd4f5845640 1 -- 172.21.15.87:0/804289549 learned_addr learned my addr 172.21.15.87:0/804289549 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:18.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.234+0000 7fd4f5044640 1 -- 172.21.15.87:0/804289549 >> v1:172.21.15.53:6789/0 conn(0x55c14d6a02b0 legacy=0x55c14d6a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.234+0000 7fd4f5044640 1 -- 172.21.15.87:0/804289549 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14d6a8290 con 0x55c14d6a46a0 2024-05-08T18:31:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.236+0000 7fd4f5044640 1 --2- 172.21.15.87:0/804289549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a46a0 0x55c14d6a6a90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00a470 tx=0x7fd4ec01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0fbdfe7ec7f09e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.236+0000 7fd4f4843640 1 -- 172.21.15.87:0/804289549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec057070 con 0x55c14d6a46a0 2024-05-08T18:31:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.236+0000 7fd4f4843640 1 -- 172.21.15.87:0/804289549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec052570 con 0x55c14d6a46a0 2024-05-08T18:31:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.236+0000 7fd4f4843640 1 -- 172.21.15.87:0/804289549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec052870 con 0x55c14d6a46a0 2024-05-08T18:31:18.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.237+0000 7fd4f7d46800 1 -- 172.21.15.87:0/804289549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a46a0 msgr2=0x55c14d6a6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.237+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/804289549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a46a0 0x55c14d6a6a90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00a470 tx=0x7fd4ec01ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.237+0000 7fd4f7d46800 1 -- 172.21.15.87:0/804289549 shutdown_connections 2024-05-08T18:31:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.237+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/804289549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a46a0 0x55c14d6a6a90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.237+0000 7fd4f7d46800 1 -- 172.21.15.87:0/804289549 >> 172.21.15.87:0/804289549 conn(0x55c14d69b830 msgr2=0x55c14d69dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.237+0000 7fd4f7d46800 1 -- 172.21.15.87:0/804289549 shutdown_connections 2024-05-08T18:31:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.237+0000 7fd4f7d46800 1 -- 172.21.15.87:0/804289549 wait complete. 2024-05-08T18:31:18.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.250+0000 7fd4f7d46800 1 Processor -- start 2024-05-08T18:31:18.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.250+0000 7fd4f7d46800 1 -- start start 2024-05-08T18:31:18.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.251+0000 7fd4f7d46800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a02b0 0x55c14d615c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.251+0000 7fd4f7d46800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c14d5eb5b0 con 0x55c14d6a02b0 2024-05-08T18:31:18.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.251+0000 7fd4f5845640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a02b0 0x55c14d615c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.251+0000 7fd4f5845640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a02b0 0x55c14d615c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32954/0 (socket says 172.21.15.87:32954) 2024-05-08T18:31:18.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.251+0000 7fd4f5845640 1 -- 172.21.15.87:0/117333456 learned_addr learned my addr 172.21.15.87:0/117333456 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.251+0000 7fd4f5845640 1 -- 172.21.15.87:0/117333456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14d614230 con 0x55c14d6a02b0 2024-05-08T18:31:18.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.251+0000 7fd4f5845640 1 --2- 172.21.15.87:0/117333456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a02b0 0x55c14d615c70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8001e10 tx=0x7fd4e800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89d346c0f47d9e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.251+0000 7fd3e3e07640 1 -- 172.21.15.87:0/117333456 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4e8012020 con 0x55c14d6a02b0 2024-05-08T18:31:18.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.251+0000 7fd3e3e07640 1 -- 172.21.15.87:0/117333456 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e800e5a0 con 0x55c14d6a02b0 2024-05-08T18:31:18.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.251+0000 7fd3e3e07640 1 -- 172.21.15.87:0/117333456 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4e800e8e0 con 0x55c14d6a02b0 2024-05-08T18:31:18.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.252+0000 7fd4f7d46800 1 -- 172.21.15.87:0/117333456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a02b0 msgr2=0x55c14d615c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.252+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/117333456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a02b0 0x55c14d615c70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8001e10 tx=0x7fd4e800b780 comp rx=0 tx=0).stop 2024-05-08T18:31:18.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.252+0000 7fd4f7d46800 1 -- 172.21.15.87:0/117333456 shutdown_connections 2024-05-08T18:31:18.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.252+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/117333456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a02b0 0x55c14d615c70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.252+0000 7fd4f7d46800 1 -- 172.21.15.87:0/117333456 >> 172.21.15.87:0/117333456 conn(0x55c14d69b830 msgr2=0x55c14d78cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.252+0000 7fd4f7d46800 1 -- 172.21.15.87:0/117333456 shutdown_connections 2024-05-08T18:31:18.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.252+0000 7fd4f7d46800 1 -- 172.21.15.87:0/117333456 wait complete. 2024-05-08T18:31:18.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.252+0000 7fd4f7d46800 1 Processor -- start 2024-05-08T18:31:18.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.252+0000 7fd4f7d46800 1 -- start start 2024-05-08T18:31:18.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.253+0000 7fd4f7d46800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a02b0 0x55c14d79b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.253+0000 7fd4f7d46800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c14d6a7530 con 0x55c14d6a02b0 2024-05-08T18:31:18.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.253+0000 7fd4f5845640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a02b0 0x55c14d79b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.253+0000 7fd4f5845640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a02b0 0x55c14d79b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32964/0 (socket says 172.21.15.87:32964) 2024-05-08T18:31:18.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.253+0000 7fd4f5845640 1 -- 172.21.15.87:0/245532556 learned_addr learned my addr 172.21.15.87:0/245532556 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.253+0000 7fd4f5845640 1 -- 172.21.15.87:0/245532556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14d79b950 con 0x55c14d6a02b0 2024-05-08T18:31:18.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.253+0000 7fd4f5845640 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a02b0 0x55c14d79b410 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8001e10 tx=0x7fd4e8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.253+0000 7fd3e2604640 1 -- 172.21.15.87:0/245532556 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4e8012030 con 0x55c14d6a02b0 2024-05-08T18:31:18.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.253+0000 7fd3e2604640 1 -- 172.21.15.87:0/245532556 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e801a7a0 con 0x55c14d6a02b0 2024-05-08T18:31:18.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.253+0000 7fd4f7d46800 1 -- 172.21.15.87:0/245532556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c14d79bbe0 con 0x55c14d6a02b0 2024-05-08T18:31:18.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.253+0000 7fd3e2604640 1 -- 172.21.15.87:0/245532556 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4e801aac0 con 0x55c14d6a02b0 2024-05-08T18:31:18.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.254+0000 7fd4f7d46800 1 -- 172.21.15.87:0/245532556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c14d79e840 con 0x55c14d6a02b0 2024-05-08T18:31:18.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.255+0000 7fd3e2604640 1 -- 172.21.15.87:0/245532556 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd4e8015020 con 0x55c14d6a02b0 2024-05-08T18:31:18.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.255+0000 7fd3e2604640 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd3dc03bba0 0x7fd3dc03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.255+0000 7fd3e2604640 1 -- 172.21.15.87:0/245532556 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd4e8020030 con 0x55c14d6a02b0 2024-05-08T18:31:18.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.255+0000 7fd4f5044640 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd3dc03bba0 0x7fd3dc03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.255+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c14d6a46a0 0x55c14d7a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.255+0000 7fd4f7d46800 1 -- 172.21.15.87:0/245532556 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7a2b40 con 0x55c14d6a46a0 2024-05-08T18:31:18.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.255+0000 7fd4f6046640 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c14d6a46a0 0x55c14d7a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.255+0000 7fd4f5044640 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd3dc03bba0 0x7fd3dc03e060 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec054000 tx=0x7fd4ec04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.255+0000 7fd4f6046640 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c14d6a46a0 0x55c14d7a2600 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.256+0000 7fd4f6046640 1 -- 172.21.15.87:0/245532556 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4f000a4a0 con 0x55c14d6a46a0 2024-05-08T18:31:18.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.256+0000 7fd4f7d46800 1 -- 172.21.15.87:0/245532556 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d79fbb0 con 0x55c14d6a46a0 2024-05-08T18:31:18.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.256+0000 7fd4f6046640 1 -- 172.21.15.87:0/245532556 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4f000a4a0 con 0x55c14d6a46a0 2024-05-08T18:31:18.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.256+0000 7fd4f7d46800 1 -- 172.21.15.87:0/245532556 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7a4950 con 0x55c14d6a46a0 2024-05-08T18:31:18.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.256+0000 7fd4f6046640 1 -- 172.21.15.87:0/245532556 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd4f000a4a0 con 0x55c14d6a46a0 2024-05-08T18:31:18.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.256+0000 7fd4f7d46800 1 -- 172.21.15.87:0/245532556 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7a3b80 con 0x55c14d6a46a0 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.256+0000 7fd4f6046640 1 -- 172.21.15.87:0/245532556 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4f000a4a0 con 0x55c14d6a46a0 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.257+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55c14d7a5d00 0x55c14d7a80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.257+0000 7fd4f7d46800 1 -- 172.21.15.87:0/245532556 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7a8630 con 0x55c14d7a5d00 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.257+0000 7fd4f5845640 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55c14d7a5d00 0x55c14d7a80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.257+0000 7fd4f5845640 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55c14d7a5d00 0x55c14d7a80f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.257+0000 7fd4f5845640 1 -- 172.21.15.87:0/245532556 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd4e8043130 con 0x55c14d7a5d00 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.258+0000 7fd4f7d46800 1 Processor -- start 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.258+0000 7fd4f7d46800 1 -- start start 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.258+0000 7fd4f7d46800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7b6890 0x55c14d7b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.258+0000 7fd4f7d46800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c14d591fc0 con 0x55c14d7b6890 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.258+0000 7fd4f6046640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7b6890 0x55c14d7b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.258+0000 7fd4f6046640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7b6890 0x55c14d7b6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32976/0 (socket says 172.21.15.87:32976) 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.258+0000 7fd4f6046640 1 -- 172.21.15.87:0/2760165335 learned_addr learned my addr 172.21.15.87:0/2760165335 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.258+0000 7fd4f6046640 1 -- 172.21.15.87:0/2760165335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14d7b71f0 con 0x55c14d7b6890 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.259+0000 7fd4f6046640 1 --2- 172.21.15.87:0/2760165335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7b6890 0x55c14d7b6cb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55c14d79c7c0 tx=0x7fd4f00178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.259+0000 7fd3db7fe640 1 -- 172.21.15.87:0/2760165335 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4f0013440 con 0x55c14d7b6890 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.259+0000 7fd3db7fe640 1 -- 172.21.15.87:0/2760165335 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f00135e0 con 0x55c14d7b6890 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.259+0000 7fd4f7d46800 1 -- 172.21.15.87:0/2760165335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c14d7b7c60 con 0x55c14d7b6890 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.259+0000 7fd3db7fe640 1 -- 172.21.15.87:0/2760165335 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00138c0 con 0x55c14d7b6890 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.259+0000 7fd4f7d46800 1 -- 172.21.15.87:0/2760165335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c14d7b8160 con 0x55c14d7b6890 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.260+0000 7fd3db7fe640 1 -- 172.21.15.87:0/2760165335 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd4f0011040 con 0x55c14d7b6890 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.260+0000 7fd3db7fe640 1 --2- 172.21.15.87:0/2760165335 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd3d003bb50 0x7fd3d003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.260+0000 7fd3db7fe640 1 -- 172.21.15.87:0/2760165335 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd4f001d070 con 0x55c14d7b6890 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.260+0000 7fd4f5845640 1 --2- 172.21.15.87:0/2760165335 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd3d003bb50 0x7fd3d003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.260+0000 7fd4f7d46800 1 Processor -- start 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.260+0000 7fd4f5845640 1 --2- 172.21.15.87:0/2760165335 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd3d003bb50 0x7fd3d003e010 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd4e800efd0 tx=0x7fd4e8050f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.260+0000 7fd4f7d46800 1 -- start start 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.260+0000 7fd4f7d46800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7c3bb0 0x55c14d7c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.260+0000 7fd4f7d46800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c14d6145b0 con 0x55c14d7c3bb0 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.261+0000 7fd4f6046640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7c3bb0 0x55c14d7c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.261+0000 7fd4f6046640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7c3bb0 0x55c14d7c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32984/0 (socket says 172.21.15.87:32984) 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.261+0000 7fd4f6046640 1 -- 172.21.15.87:0/2388471 learned_addr learned my addr 172.21.15.87:0/2388471 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.261+0000 7fd4f6046640 1 -- 172.21.15.87:0/2388471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14d7c45a0 con 0x55c14d7c3bb0 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.261+0000 7fd4f6046640 1 --2- 172.21.15.87:0/2388471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7c3bb0 0x55c14d7c3fd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00529a0 tx=0x7fd4f0001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c60a5bc08edd51 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.261+0000 7fd3d97fa640 1 -- 172.21.15.87:0/2388471 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4f002ad80 con 0x55c14d7c3bb0 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.261+0000 7fd3d97fa640 1 -- 172.21.15.87:0/2388471 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f00540d0 con 0x55c14d7c3bb0 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.261+0000 7fd3d97fa640 1 -- 172.21.15.87:0/2388471 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00543f0 con 0x55c14d7c3bb0 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.261+0000 7fd4f7d46800 1 -- 172.21.15.87:0/2388471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7c3bb0 msgr2=0x55c14d7c3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.261+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/2388471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7c3bb0 0x55c14d7c3fd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00529a0 tx=0x7fd4f0001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.262+0000 7fd4f7d46800 1 -- 172.21.15.87:0/2388471 shutdown_connections 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.262+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/2388471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7c3bb0 0x55c14d7c3fd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.262+0000 7fd4f7d46800 1 -- 172.21.15.87:0/2388471 >> 172.21.15.87:0/2388471 conn(0x55c14d7bff10 msgr2=0x55c14d7bdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.262+0000 7fd4f7d46800 1 -- 172.21.15.87:0/2388471 shutdown_connections 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.262+0000 7fd4f7d46800 1 -- 172.21.15.87:0/2388471 wait complete. 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.262+0000 7fd4f7d46800 1 Processor -- start 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.262+0000 7fd4f7d46800 1 -- start start 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.262+0000 7fd4f7d46800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7c3bb0 0x55c14d7cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.262+0000 7fd4f7d46800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c14d7c4d10 con 0x55c14d7c3bb0 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.262+0000 7fd4f6046640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7c3bb0 0x55c14d7cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.262+0000 7fd4f6046640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7c3bb0 0x55c14d7cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32994/0 (socket says 172.21.15.87:32994) 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.262+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 learned_addr learned my addr 172.21.15.87:0/4006939408 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.262+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14d7cb6e0 con 0x55c14d7c3bb0 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.263+0000 7fd4f6046640 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7c3bb0 0x55c14d7cb1a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0052c90 tx=0x7fd4f0052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.263+0000 7fd3c77fe640 1 -- 172.21.15.87:0/4006939408 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4f0030020 con 0x55c14d7c3bb0 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.263+0000 7fd3c77fe640 1 -- 172.21.15.87:0/4006939408 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f0051310 con 0x55c14d7c3bb0 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.263+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c14d7cb970 con 0x55c14d7c3bb0 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.263+0000 7fd3c77fe640 1 -- 172.21.15.87:0/4006939408 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4f0013a60 con 0x55c14d7c3bb0 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.263+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c14d7ce620 con 0x55c14d7c3bb0 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.264+0000 7fd3c77fe640 1 -- 172.21.15.87:0/4006939408 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd4f0033020 con 0x55c14d7c3bb0 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.264+0000 7fd3c77fe640 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd3c003bb50 0x7fd3c003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.264+0000 7fd3c77fe640 1 -- 172.21.15.87:0/4006939408 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd4f000e040 con 0x55c14d7c3bb0 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.264+0000 7fd4f7d46800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.264+0000 7fd4f5845640 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd3c003bb50 0x7fd3c003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.264+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c14d7d6e00 0x55c14d7d92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.264+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7d99f0 con 0x55c14d7d6e00 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.264+0000 7fd4f5044640 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c14d7d6e00 0x55c14d7d92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.264+0000 7fd4f5845640 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd3c003bb50 0x7fd3c003e010 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8043420 tx=0x7fd4e8047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.265+0000 7fd4f5044640 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c14d7d6e00 0x55c14d7d92a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.265+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.265+0000 7fd4f7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.265+0000 7fd4f7d46800 20 realm 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.265+0000 7fd4f7d46800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.265+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7d9dc0 con 0x55c14d7d6e00 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.265+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.265+0000 7fd4f7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.265+0000 7fd4f7d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.265+0000 7fd4f7d46800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.265+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7da690 con 0x55c14d7d6e00 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.265+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.265+0000 7fd4f7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.265+0000 7fd4f7d46800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.265+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7daa30 con 0x55c14d7d6e00 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.266+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.266+0000 7fd4f7d46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.266+0000 7fd4f7d46800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.266+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7dae50 con 0x55c14d7d6e00 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.266+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.266+0000 7fd4f7d46800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.266+0000 7fd4f7d46800 20 searching for the correct realm 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.266+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55c14d7dce50 0x55c14d7df2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.266+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x55c14d7dce50 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.266+0000 7fd4f6046640 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55c14d7dce50 0x55c14d7df2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.266+0000 7fd4f6046640 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55c14d7dce50 0x55c14d7df2a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.267+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f0029070 con 0x55c14d7dce50 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.267+0000 7fd4f6046640 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd4f0035020 0x7fd4f002b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.267+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x7fd4f0035020 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.267+0000 7fd4f5845640 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd4f0035020 0x7fd4f002b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.267+0000 7fd4f5845640 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd4f0035020 0x7fd4f002b3e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.267+0000 7fd4f5845640 1 -- 172.21.15.87:0/4006939408 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e8043130 con 0x7fd4f0035020 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.267+0000 7fd4f5845640 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd4e8017050 0x7fd4e80163b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.267+0000 7fd4f5845640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x7fd4e8017050 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.268+0000 7fd4f5044640 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd4e8017050 0x7fd4e80163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.268+0000 7fd4f5044640 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd4e8017050 0x7fd4e80163b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.268+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.268+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x55c14d7d6e00 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.268+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.268+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x55c14d7d6e00 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.269+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.269+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x7fd4e8017050 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.269+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.269+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x7fd4e8017050 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.269+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.269+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x7fd4f0035020 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.269+0000 7fd4f5845640 1 -- 172.21.15.87:0/4006939408 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e8043130 con 0x7fd4f0035020 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.269+0000 7fd4f5845640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x55c14d7dce50 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.270+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f0029070 con 0x55c14d7dce50 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.270+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x55c14d7d6e00 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.270+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.270+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x7fd4e8017050 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.270+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.270+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x55c14d7d6e00 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.270+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.270+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x7fd4f0035020 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.271+0000 7fd4f5845640 1 -- 172.21.15.87:0/4006939408 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd4e8043130 con 0x7fd4f0035020 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.271+0000 7fd4f5845640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x55c14d7dce50 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.271+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f0029070 con 0x55c14d7dce50 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.271+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x55c14d7dce50 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.271+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f0063040 con 0x55c14d7dce50 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.271+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x7fd4e8017050 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.271+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.271+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x55c14d7dce50 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.272+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f0063040 con 0x55c14d7dce50 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.272+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x55c14d7dce50 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.272+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f0063040 con 0x55c14d7dce50 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.272+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x55c14d7d6e00 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.272+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.272+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x55c14d7d6e00 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.272+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.272+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x7fd4e8017050 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.272+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.272+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x55c14d7dce50 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.273+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f0063040 con 0x55c14d7dce50 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.273+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x7fd4f0035020 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.273+0000 7fd4f5845640 1 -- 172.21.15.87:0/4006939408 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e8043130 con 0x7fd4f0035020 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.273+0000 7fd4f5845640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x55c14d7d6e00 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.273+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.273+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x7fd4e8017050 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.273+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.273+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x55c14d7dce50 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.274+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f0063040 con 0x55c14d7dce50 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.274+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x7fd4e8017050 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.274+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.274+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x7fd4f0035020 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.274+0000 7fd4f5845640 1 -- 172.21.15.87:0/4006939408 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e8043130 con 0x7fd4f0035020 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.274+0000 7fd4f5845640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x55c14d7dce50 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.274+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f0063040 con 0x55c14d7dce50 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.274+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x7fd4e8017050 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.275+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.275+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x55c14d7d6e00 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.275+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.275+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7df970 con 0x7fd4f0035020 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.275+0000 7fd4f5845640 1 -- 172.21.15.87:0/4006939408 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e8043130 con 0x7fd4f0035020 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.275+0000 7fd4f7d46800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.275+0000 7fd4f7d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.275+0000 7fd4f7d46800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.275+0000 7fd4f7d46800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.275+0000 7fd4f7d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.275+0000 7fd4f7d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.275+0000 7fd4f7d46800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.275+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7db8f0 con 0x55c14d7d6e00 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.275+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.275+0000 7fd4f7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.275+0000 7fd4f7d46800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7dc190 con 0x55c14d7d6e00 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f7d46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f7d46800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7db530 con 0x7fd4e8017050 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f7d46800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f7d46800 20 zone default found 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f7d46800 4 Realm: () 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f7d46800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f7d46800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f7d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f7d46800 20 zonegroup default 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f7d46800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7dfe40 con 0x7fd4e8017050 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f7d46800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.276+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e1cd0 con 0x55c14d7dce50 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.277+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4f0063040 con 0x55c14d7dce50 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.277+0000 7fd4f7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.277+0000 7fd4f7d46800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.277+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e2070 con 0x55c14d7dce50 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.277+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4f0063040 con 0x55c14d7dce50 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.277+0000 7fd4f7d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.277+0000 7fd4f7d46800 20 started sync module instance, tier type = 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.277+0000 7fd4f7d46800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.277+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e1110 con 0x7fd4f0035020 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.278+0000 7fd4f5845640 1 -- 172.21.15.87:0/4006939408 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e8043130 con 0x7fd4f0035020 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.278+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94288717157680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e28c0 con 0x7fd4f0035020 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.278+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e3110 con 0x55c14d7d6e00 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.280+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.280+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94288717163616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e3690 con 0x55c14d7d6e00 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.280+0000 7fd4f5845640 1 -- 172.21.15.87:0/4006939408 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94288717157680] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e8043130 con 0x7fd4f0035020 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.280+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e41b0 con 0x55c14d7dce50 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.282+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f0063040 con 0x55c14d7dce50 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.282+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94288717167744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e45a0 con 0x55c14d7dce50 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.282+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94288717163616] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.282+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e4e20 con 0x7fd4f0035020 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.283+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94288717167744] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f0063040 con 0x55c14d7dce50 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.284+0000 7fd4f5845640 1 -- 172.21.15.87:0/4006939408 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e8043130 con 0x7fd4f0035020 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.284+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94288717171056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e45a0 con 0x7fd4f0035020 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.285+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e58f0 con 0x55c14d7d6e00 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.286+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.286+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94288717173728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e61c0 con 0x55c14d7d6e00 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.286+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e6c30 con 0x7fd4e8017050 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.287+0000 7fd4f5845640 1 -- 172.21.15.87:0/4006939408 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94288717171056] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e8043130 con 0x7fd4f0035020 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.288+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94288717173728] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.288+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.288+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94288717178752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e6120 con 0x7fd4e8017050 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.288+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e6be0 con 0x7fd4e8017050 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.289+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94288717178752] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.291+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.291+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94288717175920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e6090 con 0x7fd4e8017050 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.291+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e7b20 con 0x7fd4e8017050 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.292+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.292+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94288717182576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e7f40 con 0x7fd4e8017050 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.292+0000 7fd4f7d46800 20 add_watcher() i=0 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.292+0000 7fd4f7d46800 20 add_watcher() i=1 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.292+0000 7fd4f7d46800 20 add_watcher() i=2 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.292+0000 7fd4f7d46800 20 add_watcher() i=3 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.292+0000 7fd4f7d46800 20 add_watcher() i=4 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.292+0000 7fd4f7d46800 20 add_watcher() i=5 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.293+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94288717175920] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.293+0000 7fd4f7d46800 20 add_watcher() i=6 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.293+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94288717182576] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.293+0000 7fd4f7d46800 20 add_watcher() i=7 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.293+0000 7fd4f7d46800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.293+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e7050 con 0x55c14d7d6e00 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.294+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.294+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94288717183632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e7050 con 0x55c14d7d6e00 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.295+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94288717183632] v27'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.295+0000 7fd3a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.295+0000 7fd4f7d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.295+0000 7fd4f7d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.295+0000 7fd4f7d46800 5 note: GC not initialized 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.295+0000 7fd3a67fc640 20 reqs_thread_entry: start 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.295+0000 7fd4f7d46800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.295+0000 7fd4f7d46800 20 Filter name: none 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.295+0000 7fd317fff640 20 reqs_thread_entry: start 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.295+0000 7fd4f7d46800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.295+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c14d81de80 con 0x55c14d7d6e00 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.296+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.296+0000 7fd4f7d46800 20 rados_obj.operate() r=0 bl.length=502 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T18:31:18.158600Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.297+0000 7fd3a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.297+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94288717183632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d81ca50 con 0x55c14d7d6e00 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.298+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94288717183632] v27'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.298+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94288717157680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e7a90 con 0x7fd4f0035020 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.299+0000 7fd4f5845640 1 -- 172.21.15.87:0/4006939408 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94288717157680] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e8043130 con 0x7fd4f0035020 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.299+0000 7fd4f7d46800 20 remove_watcher() i=0 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.299+0000 7fd4f7d46800 2 removed watcher, disabling cache 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.299+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94288717163616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e1530 con 0x55c14d7d6e00 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.300+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94288717163616] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.300+0000 7fd4f7d46800 20 remove_watcher() i=1 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.300+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94288717167744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e1530 con 0x55c14d7dce50 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.301+0000 7fd4f6046640 1 -- 172.21.15.87:0/4006939408 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94288717167744] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f0063040 con 0x55c14d7dce50 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.301+0000 7fd4f7d46800 20 remove_watcher() i=2 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.301+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94288717171056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e3c80 con 0x7fd4f0035020 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.302+0000 7fd4f5845640 1 -- 172.21.15.87:0/4006939408 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94288717171056] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e8043130 con 0x7fd4f0035020 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.302+0000 7fd4f7d46800 20 remove_watcher() i=3 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.302+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94288717173728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e1530 con 0x55c14d7d6e00 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.303+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94288717173728] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x55c14d7d6e00 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.303+0000 7fd4f7d46800 20 remove_watcher() i=4 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.303+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94288717178752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e4970 con 0x7fd4e8017050 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.304+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94288717178752] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.304+0000 7fd4f7d46800 20 remove_watcher() i=5 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.304+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94288717175920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e3c80 con 0x7fd4e8017050 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.305+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94288717175920] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.305+0000 7fd4f7d46800 20 remove_watcher() i=6 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.305+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94288717182576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c14d7e53e0 con 0x7fd4e8017050 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94288717182576] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05a040 con 0x7fd4e8017050 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 20 remove_watcher() i=7 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd4e8017050 msgr2=0x7fd4e80163b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd4e8017050 0x7fd4e80163b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c14d7d6e00 msgr2=0x55c14d7d92a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c14d7d6e00 0x55c14d7d92a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd4f0035020 msgr2=0x7fd4f002b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd4f0035020 0x7fd4f002b3e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55c14d7dce50 msgr2=0x55c14d7df2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55c14d7dce50 0x55c14d7df2a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd3c003bb50 msgr2=0x7fd3c003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd3c003bb50 0x7fd3c003e010 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8043420 tx=0x7fd4e8047000 comp rx=0 tx=0).stop 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7c3bb0 msgr2=0x55c14d7cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7c3bb0 0x55c14d7cb1a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0052c90 tx=0x7fd4f0052900 comp rx=0 tx=0).stop 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f5044640 1 -- 172.21.15.87:0/4006939408 reap_dead start 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 shutdown_connections 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/4006939408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7c3bb0 0x55c14d7cb1a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 >> 172.21.15.87:0/4006939408 conn(0x55c14d7bff10 msgr2=0x55c14d7bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 shutdown_connections 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.306+0000 7fd4f7d46800 1 -- 172.21.15.87:0/4006939408 wait complete. 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 -- 172.21.15.87:0/2760165335 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd3d003bb50 msgr2=0x7fd3d003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/2760165335 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd3d003bb50 0x7fd3d003e010 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd4e800efd0 tx=0x7fd4e8050f50 comp rx=0 tx=0).stop 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 -- 172.21.15.87:0/2760165335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7b6890 msgr2=0x55c14d7b6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/2760165335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7b6890 0x55c14d7b6cb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55c14d79c7c0 tx=0x7fd4f00178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 -- 172.21.15.87:0/2760165335 shutdown_connections 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/2760165335 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd3d003bb50 0x7fd3d003e010 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/2760165335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d7b6890 0x55c14d7b6cb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 -- 172.21.15.87:0/2760165335 >> 172.21.15.87:0/2760165335 conn(0x55c14d7aa930 msgr2=0x55c14d7aad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 -- 172.21.15.87:0/2760165335 shutdown_connections 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 -- 172.21.15.87:0/2760165335 wait complete. 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 -- 172.21.15.87:0/245532556 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55c14d7a5d00 msgr2=0x55c14d7a80f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55c14d7a5d00 0x55c14d7a80f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 -- 172.21.15.87:0/245532556 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c14d6a46a0 msgr2=0x55c14d7a2600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c14d6a46a0 0x55c14d7a2600 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 -- 172.21.15.87:0/245532556 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd3dc03bba0 msgr2=0x7fd3dc03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd3dc03bba0 0x7fd3dc03e060 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec054000 tx=0x7fd4ec04e000 comp rx=0 tx=0).stop 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 -- 172.21.15.87:0/245532556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a02b0 msgr2=0x55c14d79b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a02b0 0x55c14d79b410 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8001e10 tx=0x7fd4e8000ed0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 -- 172.21.15.87:0/245532556 shutdown_connections 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c14d6a46a0 0x55c14d7a2600 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55c14d7a5d00 0x55c14d7a80f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd3dc03bba0 0x7fd3dc03e060 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 --2- 172.21.15.87:0/245532556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14d6a02b0 0x55c14d79b410 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 -- 172.21.15.87:0/245532556 >> 172.21.15.87:0/245532556 conn(0x55c14d69b830 msgr2=0x55c14d614b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 -- 172.21.15.87:0/245532556 shutdown_connections 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.307+0000 7fd4f7d46800 1 -- 172.21.15.87:0/245532556 wait complete. 2024-05-08T18:31:18.314 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T18:31:18.158600Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:18.314 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-05-08T18:31:18.314 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-05-08T18:31:18.315 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-05-08T18:31:18.361 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:18.361 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.363+0000 7f6a13c87800 1 Processor -- start 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.363+0000 7f6a13c87800 1 -- start start 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.363+0000 7f6a13c87800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558c59397ce0 0x558c5939a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.363+0000 7f6a13c87800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558c5939e120 con 0x558c5939a610 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.363+0000 7f6a13c87800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x558c59237e20 con 0x558c59397ce0 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.364+0000 7f6a1177f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558c59397ce0 0x558c5939a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.364+0000 7f6a0bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x558c5939a610 0x558c5939ca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41938/0 (socket says 172.21.15.87:41938) 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.364+0000 7f6a1177f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558c59397ce0 0x558c5939a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33004/0 (socket says 172.21.15.87:33004) 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.364+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3817447251 learned_addr learned my addr 172.21.15.87:0/3817447251 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.364+0000 7f6a1177f640 1 -- 172.21.15.87:0/3817447251 >> v1:172.21.15.53:6789/0 conn(0x558c5939a610 legacy=0x558c5939ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.364+0000 7f6a1177f640 1 -- 172.21.15.87:0/3817447251 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c5939f300 con 0x558c59397ce0 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.366+0000 7f6a1177f640 1 --2- 172.21.15.87:0/3817447251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 0x558c5939a0d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400a470 tx=0x7f6a0401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f1e6fb7f20d908 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.366+0000 7f6a10f7e640 1 -- 172.21.15.87:0/3817447251 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a04057070 con 0x558c59397ce0 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.366+0000 7f6a10f7e640 1 -- 172.21.15.87:0/3817447251 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a04052570 con 0x558c59397ce0 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.366+0000 7f6a10f7e640 1 -- 172.21.15.87:0/3817447251 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a04052870 con 0x558c59397ce0 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.366+0000 7f6a13c87800 1 -- 172.21.15.87:0/3817447251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 msgr2=0x558c5939a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.366+0000 7f6a13c87800 1 --2- 172.21.15.87:0/3817447251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 0x558c5939a0d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400a470 tx=0x7f6a0401ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.366+0000 7f6a13c87800 1 -- 172.21.15.87:0/3817447251 shutdown_connections 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.366+0000 7f6a13c87800 1 --2- 172.21.15.87:0/3817447251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 0x558c5939a0d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.366+0000 7f6a13c87800 1 -- 172.21.15.87:0/3817447251 >> 172.21.15.87:0/3817447251 conn(0x558c59391730 msgr2=0x558c59393b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.367+0000 7f6a13c87800 1 -- 172.21.15.87:0/3817447251 shutdown_connections 2024-05-08T18:31:18.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.367+0000 7f6a13c87800 1 -- 172.21.15.87:0/3817447251 wait complete. 2024-05-08T18:31:18.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.380+0000 7f6a13c87800 1 Processor -- start 2024-05-08T18:31:18.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.380+0000 7f6a13c87800 1 -- start start 2024-05-08T18:31:18.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.380+0000 7f6a13c87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 0x558c59488690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.380+0000 7f6a13c87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558c592e25c0 con 0x558c59397ce0 2024-05-08T18:31:18.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.381+0000 7f6a1177f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 0x558c59488690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.381+0000 7f6a1177f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 0x558c59488690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33008/0 (socket says 172.21.15.87:33008) 2024-05-08T18:31:18.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.381+0000 7f6a1177f640 1 -- 172.21.15.87:0/1691321432 learned_addr learned my addr 172.21.15.87:0/1691321432 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.381+0000 7f6a1177f640 1 -- 172.21.15.87:0/1691321432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c59488c60 con 0x558c59397ce0 2024-05-08T18:31:18.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.381+0000 7f6a1177f640 1 --2- 172.21.15.87:0/1691321432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 0x558c59488690 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6a04055040 tx=0x7f6a0404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731b02ee1850611c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.381+0000 7f68ff606640 1 -- 172.21.15.87:0/1691321432 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a04057040 con 0x558c59397ce0 2024-05-08T18:31:18.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.381+0000 7f68ff606640 1 -- 172.21.15.87:0/1691321432 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a04052990 con 0x558c59397ce0 2024-05-08T18:31:18.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.381+0000 7f68ff606640 1 -- 172.21.15.87:0/1691321432 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a04052c70 con 0x558c59397ce0 2024-05-08T18:31:18.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.382+0000 7f6a13c87800 1 -- 172.21.15.87:0/1691321432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 msgr2=0x558c59488690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.382+0000 7f6a13c87800 1 --2- 172.21.15.87:0/1691321432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 0x558c59488690 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6a04055040 tx=0x7f6a0404c000 comp rx=0 tx=0).stop 2024-05-08T18:31:18.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.382+0000 7f6a13c87800 1 -- 172.21.15.87:0/1691321432 shutdown_connections 2024-05-08T18:31:18.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.382+0000 7f6a13c87800 1 --2- 172.21.15.87:0/1691321432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 0x558c59488690 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.382+0000 7f6a13c87800 1 -- 172.21.15.87:0/1691321432 >> 172.21.15.87:0/1691321432 conn(0x558c59391730 msgr2=0x558c59483fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.382+0000 7f6a13c87800 1 -- 172.21.15.87:0/1691321432 shutdown_connections 2024-05-08T18:31:18.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.382+0000 7f6a13c87800 1 -- 172.21.15.87:0/1691321432 wait complete. 2024-05-08T18:31:18.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.382+0000 7f6a13c87800 1 Processor -- start 2024-05-08T18:31:18.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.383+0000 7f6a13c87800 1 -- start start 2024-05-08T18:31:18.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.383+0000 7f6a13c87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 0x558c59397620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.383+0000 7f6a13c87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558c5939e590 con 0x558c59397ce0 2024-05-08T18:31:18.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.383+0000 7f6a1177f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 0x558c59397620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.383+0000 7f6a1177f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 0x558c59397620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33024/0 (socket says 172.21.15.87:33024) 2024-05-08T18:31:18.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.383+0000 7f6a1177f640 1 -- 172.21.15.87:0/372080234 learned_addr learned my addr 172.21.15.87:0/372080234 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.383+0000 7f6a1177f640 1 -- 172.21.15.87:0/372080234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c59395d10 con 0x558c59397ce0 2024-05-08T18:31:18.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.383+0000 7f6a1177f640 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 0x558c59397620 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400a470 tx=0x7f6a04003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.383+0000 7f68fde03640 1 -- 172.21.15.87:0/372080234 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a04073070 con 0x558c59397ce0 2024-05-08T18:31:18.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.383+0000 7f68fde03640 1 -- 172.21.15.87:0/372080234 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0405d650 con 0x558c59397ce0 2024-05-08T18:31:18.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.383+0000 7f6a13c87800 1 -- 172.21.15.87:0/372080234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c59395fa0 con 0x558c59397ce0 2024-05-08T18:31:18.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.383+0000 7f68fde03640 1 -- 172.21.15.87:0/372080234 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a04057070 con 0x558c59397ce0 2024-05-08T18:31:18.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.383+0000 7f6a13c87800 1 -- 172.21.15.87:0/372080234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c593964c0 con 0x558c59397ce0 2024-05-08T18:31:18.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.384+0000 7f68fde03640 1 -- 172.21.15.87:0/372080234 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6a04076070 con 0x558c59397ce0 2024-05-08T18:31:18.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.384+0000 7f68fde03640 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f68f803bba0 0x7f68f803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.384+0000 7f68fde03640 1 -- 172.21.15.87:0/372080234 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6a040942f0 con 0x558c59397ce0 2024-05-08T18:31:18.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.385+0000 7f6a0bfff640 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f68f803bba0 0x7f68f803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.385+0000 7f6a13c87800 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558c5939a610 0x558c59499530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.385+0000 7f6a13c87800 1 -- 172.21.15.87:0/372080234 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c59499ac0 con 0x558c5939a610 2024-05-08T18:31:18.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.385+0000 7f6a11f80640 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558c5939a610 0x558c59499530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.385+0000 7f6a0bfff640 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f68f803bba0 0x7f68f803e060 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f69fc000f60 tx=0x7f69fc0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.385+0000 7f6a11f80640 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558c5939a610 0x558c59499530 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.385+0000 7f6a11f80640 1 -- 172.21.15.87:0/372080234 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a0c00a4a0 con 0x558c5939a610 2024-05-08T18:31:18.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.385+0000 7f6a13c87800 1 -- 172.21.15.87:0/372080234 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c5949a3a0 con 0x558c5939a610 2024-05-08T18:31:18.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.386+0000 7f6a11f80640 1 -- 172.21.15.87:0/372080234 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a0c00a4a0 con 0x558c5939a610 2024-05-08T18:31:18.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.386+0000 7f6a13c87800 1 -- 172.21.15.87:0/372080234 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c5949b790 con 0x558c5939a610 2024-05-08T18:31:18.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.386+0000 7f6a11f80640 1 -- 172.21.15.87:0/372080234 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6a0c00a4a0 con 0x558c5939a610 2024-05-08T18:31:18.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.386+0000 7f6a13c87800 1 -- 172.21.15.87:0/372080234 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c5949abf0 con 0x558c5939a610 2024-05-08T18:31:18.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.386+0000 7f6a11f80640 1 -- 172.21.15.87:0/372080234 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a0c00a4a0 con 0x558c5939a610 2024-05-08T18:31:18.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.386+0000 7f6a13c87800 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558c5949cc40 0x558c5949f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.386+0000 7f6a13c87800 1 -- 172.21.15.87:0/372080234 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c5949f6d0 con 0x558c5949cc40 2024-05-08T18:31:18.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.386+0000 7f6a1177f640 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558c5949cc40 0x558c5949f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.387+0000 7f6a1177f640 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558c5949cc40 0x558c5949f030 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.387+0000 7f6a1177f640 1 -- 172.21.15.87:0/372080234 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6a04075030 con 0x558c5949cc40 2024-05-08T18:31:18.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.387+0000 7f6a13c87800 1 Processor -- start 2024-05-08T18:31:18.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.388+0000 7f6a13c87800 1 -- start start 2024-05-08T18:31:18.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.388+0000 7f6a13c87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594ad9e0 0x558c594ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.388+0000 7f6a13c87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558c59397b60 con 0x558c594ad9e0 2024-05-08T18:31:18.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.388+0000 7f6a11f80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594ad9e0 0x558c594ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.388+0000 7f6a11f80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594ad9e0 0x558c594ade00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33030/0 (socket says 172.21.15.87:33030) 2024-05-08T18:31:18.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.388+0000 7f6a11f80640 1 -- 172.21.15.87:0/3650759347 learned_addr learned my addr 172.21.15.87:0/3650759347 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.388+0000 7f6a11f80640 1 -- 172.21.15.87:0/3650759347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c594ae340 con 0x558c594ad9e0 2024-05-08T18:31:18.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.388+0000 7f6a11f80640 1 --2- 172.21.15.87:0/3650759347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594ad9e0 0x558c594ade00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x558c59397360 tx=0x7f6a0c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.389+0000 7f68f6ffd640 1 -- 172.21.15.87:0/3650759347 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c013440 con 0x558c594ad9e0 2024-05-08T18:31:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.389+0000 7f68f6ffd640 1 -- 172.21.15.87:0/3650759347 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0c0135e0 con 0x558c594ad9e0 2024-05-08T18:31:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.389+0000 7f6a13c87800 1 -- 172.21.15.87:0/3650759347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c594aedb0 con 0x558c594ad9e0 2024-05-08T18:31:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.389+0000 7f68f6ffd640 1 -- 172.21.15.87:0/3650759347 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c0138c0 con 0x558c594ad9e0 2024-05-08T18:31:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.389+0000 7f6a13c87800 1 -- 172.21.15.87:0/3650759347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c594af2b0 con 0x558c594ad9e0 2024-05-08T18:31:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.389+0000 7f68f6ffd640 1 -- 172.21.15.87:0/3650759347 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6a0c011040 con 0x558c594ad9e0 2024-05-08T18:31:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.390+0000 7f68f6ffd640 1 --2- 172.21.15.87:0/3650759347 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f68e803bba0 0x7f68e803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.390+0000 7f68f6ffd640 1 -- 172.21.15.87:0/3650759347 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6a0c01d070 con 0x558c594ad9e0 2024-05-08T18:31:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.390+0000 7f6a1177f640 1 --2- 172.21.15.87:0/3650759347 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f68e803bba0 0x7f68e803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.390+0000 7f6a13c87800 1 Processor -- start 2024-05-08T18:31:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.390+0000 7f6a13c87800 1 -- start start 2024-05-08T18:31:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.390+0000 7f6a1177f640 1 --2- 172.21.15.87:0/3650759347 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f68e803bba0 0x7f68e803e060 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6a0405b730 tx=0x7f6a04053f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.390+0000 7f6a13c87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594bac70 0x558c594bb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.390+0000 7f6a13c87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558c59288fc0 con 0x558c594bac70 2024-05-08T18:31:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.390+0000 7f6a11f80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594bac70 0x558c594bb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.390+0000 7f6a11f80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594bac70 0x558c594bb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33044/0 (socket says 172.21.15.87:33044) 2024-05-08T18:31:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.390+0000 7f6a11f80640 1 -- 172.21.15.87:0/1428922172 learned_addr learned my addr 172.21.15.87:0/1428922172 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.391+0000 7f6a11f80640 1 -- 172.21.15.87:0/1428922172 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c594bb660 con 0x558c594bac70 2024-05-08T18:31:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.391+0000 7f6a11f80640 1 --2- 172.21.15.87:0/1428922172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594bac70 0x558c594bb090 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0103f0 tx=0x7f6a0c001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35438d48f6fbee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.391+0000 7f68f4ff9640 1 -- 172.21.15.87:0/1428922172 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c02ad80 con 0x558c594bac70 2024-05-08T18:31:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.391+0000 7f68f4ff9640 1 -- 172.21.15.87:0/1428922172 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0c0540d0 con 0x558c594bac70 2024-05-08T18:31:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.391+0000 7f68f4ff9640 1 -- 172.21.15.87:0/1428922172 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c0014f0 con 0x558c594bac70 2024-05-08T18:31:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.391+0000 7f6a13c87800 1 -- 172.21.15.87:0/1428922172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594bac70 msgr2=0x558c594bb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.391+0000 7f6a13c87800 1 --2- 172.21.15.87:0/1428922172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594bac70 0x558c594bb090 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0103f0 tx=0x7f6a0c001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.391+0000 7f6a13c87800 1 -- 172.21.15.87:0/1428922172 shutdown_connections 2024-05-08T18:31:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.391+0000 7f6a13c87800 1 --2- 172.21.15.87:0/1428922172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594bac70 0x558c594bb090 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.391+0000 7f6a13c87800 1 -- 172.21.15.87:0/1428922172 >> 172.21.15.87:0/1428922172 conn(0x558c594b6fd0 msgr2=0x558c594b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.391+0000 7f6a13c87800 1 -- 172.21.15.87:0/1428922172 shutdown_connections 2024-05-08T18:31:18.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.391+0000 7f6a13c87800 1 -- 172.21.15.87:0/1428922172 wait complete. 2024-05-08T18:31:18.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.392+0000 7f6a13c87800 1 Processor -- start 2024-05-08T18:31:18.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.392+0000 7f6a13c87800 1 -- start start 2024-05-08T18:31:18.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.392+0000 7f6a13c87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594bac70 0x558c594c2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.392+0000 7f6a13c87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558c594bbc50 con 0x558c594bac70 2024-05-08T18:31:18.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.392+0000 7f6a11f80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594bac70 0x558c594c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.392+0000 7f6a11f80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594bac70 0x558c594c2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33050/0 (socket says 172.21.15.87:33050) 2024-05-08T18:31:18.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.392+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 learned_addr learned my addr 172.21.15.87:0/3028126685 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.392+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c594c2690 con 0x558c594bac70 2024-05-08T18:31:18.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.392+0000 7f6a11f80640 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594bac70 0x558c594c2150 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c04d010 tx=0x7f6a0c052890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.392+0000 7f68e6ffd640 1 -- 172.21.15.87:0/3028126685 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c030020 con 0x558c594bac70 2024-05-08T18:31:18.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.392+0000 7f68e6ffd640 1 -- 172.21.15.87:0/3028126685 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0c051310 con 0x558c594bac70 2024-05-08T18:31:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.392+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c594c2920 con 0x558c594bac70 2024-05-08T18:31:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.392+0000 7f68e6ffd640 1 -- 172.21.15.87:0/3028126685 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c013a60 con 0x558c594bac70 2024-05-08T18:31:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.393+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c594c55d0 con 0x558c594bac70 2024-05-08T18:31:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.393+0000 7f68e6ffd640 1 -- 172.21.15.87:0/3028126685 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6a0c033020 con 0x558c594bac70 2024-05-08T18:31:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.394+0000 7f68e6ffd640 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f68dc03bba0 0x7f68dc03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.394+0000 7f68e6ffd640 1 -- 172.21.15.87:0/3028126685 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6a0c00e040 con 0x558c594bac70 2024-05-08T18:31:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.394+0000 7f6a1177f640 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f68dc03bba0 0x7f68dc03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.394+0000 7f6a1177f640 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f68dc03bba0 0x7f68dc03e060 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a04092980 tx=0x7f6a04087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.394+0000 7f6a13c87800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.394+0000 7f6a13c87800 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558c594cdd90 0x558c594d0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.394+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c594d09a0 con 0x558c594cdd90 2024-05-08T18:31:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.394+0000 7f6a0bfff640 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558c594cdd90 0x558c594d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.395+0000 7f6a0bfff640 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558c594cdd90 0x558c594d0250 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.395+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69fc009050 con 0x558c594cdd90 2024-05-08T18:31:18.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.395+0000 7f6a13c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.395+0000 7f6a13c87800 20 realm 2024-05-08T18:31:18.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.395+0000 7f6a13c87800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.395+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c594cd1e0 con 0x558c594cdd90 2024-05-08T18:31:18.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.395+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69fc009050 con 0x558c594cdd90 2024-05-08T18:31:18.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.395+0000 7f6a13c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.395+0000 7f6a13c87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:18.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.395+0000 7f6a13c87800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.395+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c594d1490 con 0x558c594cdd90 2024-05-08T18:31:18.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.395+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69fc009050 con 0x558c594cdd90 2024-05-08T18:31:18.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.395+0000 7f6a13c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.395+0000 7f6a13c87800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.395+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c594d1d60 con 0x558c594cdd90 2024-05-08T18:31:18.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.396+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69fc009050 con 0x558c594cdd90 2024-05-08T18:31:18.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.396+0000 7f6a13c87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:18.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.396+0000 7f6a13c87800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.396+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c594d2100 con 0x558c594cdd90 2024-05-08T18:31:18.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.396+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f69fc009050 con 0x558c594cdd90 2024-05-08T18:31:18.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.396+0000 7f6a13c87800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:18.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.396+0000 7f6a13c87800 20 searching for the correct realm 2024-05-08T18:31:18.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.396+0000 7f6a13c87800 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x558c594d3fe0 0x558c594d63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.396+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x558c594d3fe0 2024-05-08T18:31:18.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.396+0000 7f6a11f80640 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x558c594d3fe0 0x558c594d63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.396+0000 7f6a11f80640 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x558c594d3fe0 0x558c594d63d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.397+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c029070 con 0x558c594d3fe0 2024-05-08T18:31:18.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.397+0000 7f6a11f80640 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6a0c035020 0x7f6a0c02b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.397+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x7f6a0c035020 2024-05-08T18:31:18.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.397+0000 7f6a1177f640 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6a0c035020 0x7f6a0c02b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.397+0000 7f6a1177f640 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6a0c035020 0x7f6a0c02b3e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.397+0000 7f6a1177f640 1 -- 172.21.15.87:0/3028126685 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a04075030 con 0x7f6a0c035020 2024-05-08T18:31:18.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.397+0000 7f6a1177f640 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6a040a2040 0x7f6a0408b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.397+0000 7f6a1177f640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x7f6a040a2040 2024-05-08T18:31:18.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.398+0000 7f6a0bfff640 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6a040a2040 0x7f6a0408b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.398+0000 7f6a0bfff640 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6a040a2040 0x7f6a0408b530 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.398+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc009050 con 0x7f6a040a2040 2024-05-08T18:31:18.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.398+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x558c594cdd90 2024-05-08T18:31:18.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.398+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc009050 con 0x558c594cdd90 2024-05-08T18:31:18.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.398+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x558c594cdd90 2024-05-08T18:31:18.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.399+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.399+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x7f6a040a2040 2024-05-08T18:31:18.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.399+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.399+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x7f6a040a2040 2024-05-08T18:31:18.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.399+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.399+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x7f6a0c035020 2024-05-08T18:31:18.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.399+0000 7f6a1177f640 1 -- 172.21.15.87:0/3028126685 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a04075030 con 0x7f6a0c035020 2024-05-08T18:31:18.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.399+0000 7f6a1177f640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x558c594d3fe0 2024-05-08T18:31:18.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.400+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c029070 con 0x558c594d3fe0 2024-05-08T18:31:18.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.400+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x558c594cdd90 2024-05-08T18:31:18.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.400+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.400+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x7f6a040a2040 2024-05-08T18:31:18.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.400+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.400+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x558c594cdd90 2024-05-08T18:31:18.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.400+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.400+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x7f6a0c035020 2024-05-08T18:31:18.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.401+0000 7f6a1177f640 1 -- 172.21.15.87:0/3028126685 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6a04075030 con 0x7f6a0c035020 2024-05-08T18:31:18.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.401+0000 7f6a1177f640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x558c594d3fe0 2024-05-08T18:31:18.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.401+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c029070 con 0x558c594d3fe0 2024-05-08T18:31:18.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.401+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x558c594d3fe0 2024-05-08T18:31:18.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.401+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c029070 con 0x558c594d3fe0 2024-05-08T18:31:18.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.401+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x7f6a040a2040 2024-05-08T18:31:18.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.401+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.401+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x558c594d3fe0 2024-05-08T18:31:18.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.402+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c029070 con 0x558c594d3fe0 2024-05-08T18:31:18.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.402+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x558c594d3fe0 2024-05-08T18:31:18.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.402+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c029070 con 0x558c594d3fe0 2024-05-08T18:31:18.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.402+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x558c594cdd90 2024-05-08T18:31:18.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.402+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.402+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x558c594cdd90 2024-05-08T18:31:18.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.402+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.402+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x7f6a040a2040 2024-05-08T18:31:18.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.403+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.403+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x558c594d3fe0 2024-05-08T18:31:18.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.403+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c029070 con 0x558c594d3fe0 2024-05-08T18:31:18.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.403+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x7f6a0c035020 2024-05-08T18:31:18.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.403+0000 7f6a1177f640 1 -- 172.21.15.87:0/3028126685 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a04075030 con 0x7f6a0c035020 2024-05-08T18:31:18.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.403+0000 7f6a1177f640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x558c594cdd90 2024-05-08T18:31:18.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.404+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.404+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x7f6a040a2040 2024-05-08T18:31:18.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.404+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.404+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x558c594d3fe0 2024-05-08T18:31:18.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.404+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c029070 con 0x558c594d3fe0 2024-05-08T18:31:18.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.404+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x7f6a040a2040 2024-05-08T18:31:18.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.404+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.404+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x7f6a0c035020 2024-05-08T18:31:18.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.405+0000 7f6a1177f640 1 -- 172.21.15.87:0/3028126685 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a04075030 con 0x7f6a0c035020 2024-05-08T18:31:18.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.405+0000 7f6a1177f640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x558c594d3fe0 2024-05-08T18:31:18.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.405+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c029070 con 0x558c594d3fe0 2024-05-08T18:31:18.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.405+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x7f6a040a2040 2024-05-08T18:31:18.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.405+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.406+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x558c594cdd90 2024-05-08T18:31:18.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.406+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.406+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6a80 con 0x7f6a0c035020 2024-05-08T18:31:18.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.406+0000 7f6a1177f640 1 -- 172.21.15.87:0/3028126685 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a04075030 con 0x7f6a0c035020 2024-05-08T18:31:18.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.406+0000 7f6a13c87800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:18.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.406+0000 7f6a13c87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:18.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.406+0000 7f6a13c87800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:18.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.406+0000 7f6a13c87800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:18.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.406+0000 7f6a13c87800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:18.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.406+0000 7f6a13c87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:18.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.406+0000 7f6a13c87800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.406+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c594d2a80 con 0x558c594cdd90 2024-05-08T18:31:18.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.406+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.406+0000 7f6a13c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.406+0000 7f6a13c87800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.406+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c594d3320 con 0x558c594cdd90 2024-05-08T18:31:18.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a13c87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:18.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a13c87800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c594d6f00 con 0x7f6a040a2040 2024-05-08T18:31:18.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a13c87800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:18.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a13c87800 20 zone default found 2024-05-08T18:31:18.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a13c87800 4 Realm: () 2024-05-08T18:31:18.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a13c87800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:18.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a13c87800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:18.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a13c87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:18.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a13c87800 20 zonegroup default 2024-05-08T18:31:18.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a13c87800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c594d73b0 con 0x7f6a040a2040 2024-05-08T18:31:18.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a13c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a13c87800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c594d8d90 con 0x558c594d3fe0 2024-05-08T18:31:18.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.407+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a0c029070 con 0x558c594d3fe0 2024-05-08T18:31:18.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.408+0000 7f6a13c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.408+0000 7f6a13c87800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.408+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c594d91c0 con 0x558c594d3fe0 2024-05-08T18:31:18.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.408+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a0c029070 con 0x558c594d3fe0 2024-05-08T18:31:18.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.408+0000 7f6a13c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.408+0000 7f6a13c87800 20 started sync module instance, tier type = 2024-05-08T18:31:18.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.408+0000 7f6a13c87800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:18.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.408+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594d8220 con 0x7f6a0c035020 2024-05-08T18:31:18.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.409+0000 7f6a1177f640 1 -- 172.21.15.87:0/3028126685 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a04075030 con 0x7f6a0c035020 2024-05-08T18:31:18.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.409+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94061282035216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594d9ad0 con 0x7f6a0c035020 2024-05-08T18:31:18.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.409+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594da320 con 0x558c594cdd90 2024-05-08T18:31:18.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.410+0000 7f6a1177f640 1 -- 172.21.15.87:0/3028126685 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94061282035216] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a04075030 con 0x7f6a0c035020 2024-05-08T18:31:18.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.410+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.410+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94061282039328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594da380 con 0x558c594cdd90 2024-05-08T18:31:18.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.410+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594dae70 con 0x558c594d3fe0 2024-05-08T18:31:18.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.411+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94061282039328] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.411+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c029070 con 0x558c594d3fe0 2024-05-08T18:31:18.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.411+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94061282044224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594db290 con 0x558c594d3fe0 2024-05-08T18:31:18.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.411+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594dbcd0 con 0x7f6a0c035020 2024-05-08T18:31:18.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.412+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94061282044224] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c029070 con 0x558c594d3fe0 2024-05-08T18:31:18.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.412+0000 7f6a1177f640 1 -- 172.21.15.87:0/3028126685 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a04075030 con 0x7f6a0c035020 2024-05-08T18:31:18.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.412+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94061282047904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594dc0c0 con 0x7f6a0c035020 2024-05-08T18:31:18.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.412+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594dcb40 con 0x558c594cdd90 2024-05-08T18:31:18.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.413+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.413+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94061282051632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594dd3e0 con 0x558c594cdd90 2024-05-08T18:31:18.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.413+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594ddea0 con 0x7f6a040a2040 2024-05-08T18:31:18.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.414+0000 7f6a1177f640 1 -- 172.21.15.87:0/3028126685 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94061282047904] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a04075030 con 0x7f6a0c035020 2024-05-08T18:31:18.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.415+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94061282051632] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.415+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.415+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94061282056560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594dce40 con 0x7f6a040a2040 2024-05-08T18:31:18.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.415+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594de740 con 0x7f6a040a2040 2024-05-08T18:31:18.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.416+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94061282056560] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.416+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.416+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94061282041456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594dce40 con 0x7f6a040a2040 2024-05-08T18:31:18.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.416+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594ded60 con 0x7f6a040a2040 2024-05-08T18:31:18.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.417+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.417+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94061282060464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594df180 con 0x7f6a040a2040 2024-05-08T18:31:18.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.417+0000 7f6a13c87800 20 add_watcher() i=0 2024-05-08T18:31:18.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.417+0000 7f6a13c87800 20 add_watcher() i=1 2024-05-08T18:31:18.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.417+0000 7f6a13c87800 20 add_watcher() i=2 2024-05-08T18:31:18.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.417+0000 7f6a13c87800 20 add_watcher() i=3 2024-05-08T18:31:18.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.417+0000 7f6a13c87800 20 add_watcher() i=4 2024-05-08T18:31:18.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.417+0000 7f6a13c87800 20 add_watcher() i=5 2024-05-08T18:31:18.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.417+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94061282041456] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.417+0000 7f6a13c87800 20 add_watcher() i=6 2024-05-08T18:31:18.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.418+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94061282060464] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.418+0000 7f6a13c87800 20 add_watcher() i=7 2024-05-08T18:31:18.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.418+0000 7f6a13c87800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:18.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.418+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c594de290 con 0x558c594cdd90 2024-05-08T18:31:18.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.418+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.418+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94061282061520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594de290 con 0x558c594cdd90 2024-05-08T18:31:18.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.419+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94061282061520] v27'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.419+0000 7f68c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:18.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.419+0000 7f6a13c87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:18.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.419+0000 7f6a13c87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:18.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.419+0000 7f6a13c87800 5 note: GC not initialized 2024-05-08T18:31:18.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.419+0000 7f68c67e4640 20 reqs_thread_entry: start 2024-05-08T18:31:18.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.420+0000 7f6a13c87800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:18.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.420+0000 7f6a13c87800 20 Filter name: none 2024-05-08T18:31:18.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.420+0000 7f6837fff640 20 reqs_thread_entry: start 2024-05-08T18:31:18.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.420+0000 7f6a13c87800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:18.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.420+0000 7f6a13c87800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.420+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c59515710 con 0x558c594cdd90 2024-05-08T18:31:18.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.420+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.420+0000 7f6a13c87800 20 rados_obj.operate() r=0 bl.length=502 2024-05-08T18:31:18.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.420+0000 7f6a13c87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:18.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.420+0000 7f6a13c87800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:18.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.420+0000 7f6a13c87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:18.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.420+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c5951bc50 con 0x558c594cdd90 2024-05-08T18:31:18.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.421+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v27'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.421+0000 7f6a13c87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:18.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.421+0000 7f6a13c87800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:18.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.421+0000 7f6a13c87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:31:18.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.421+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94061282309648 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c59517290 con 0x558c594cdd90 2024-05-08T18:31:18.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.422+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== watch-notify(notify (1) cookie 94061282051632 notify 115964116996 ret 0) ==== 609+0+0 (crc 0 0 0) 0x558c5939e120 con 0x558c594cdd90 2024-05-08T18:31:18.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.422+0000 7f68f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 94061282051632 notifier 4347 bl.length()=567 2024-05-08T18:31:18.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.422+0000 7f68f4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:18.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.422+0000 7f68f4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:18.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.422+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(64 notify.4 [notify cookie 94061282309648 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.422+0000 7f68f4ff9640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f68d4003ea0 con 0x558c594cdd90 2024-05-08T18:31:18.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.422+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.422+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== watch-notify(notify_complete (2) cookie 94061282309648 notify 115964116996 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f69fc02e9f0 con 0x558c594cdd90 2024-05-08T18:31:18.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.422+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c5951b610 con 0x7f6a040a2040 2024-05-08T18:31:18.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.423+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v27'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.423+0000 7f6a13c87800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:31:18.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.423+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94061282309648 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558c59516de0 con 0x558c594d3fe0 2024-05-08T18:31:18.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.423+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== watch-notify(notify (1) cookie 94061282044224 notify 115964116993 ret 0) ==== 212+0+0 (crc 0 0 0) 0x558c594c55d0 con 0x558c594d3fe0 2024-05-08T18:31:18.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.423+0000 7f68f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 94061282044224 notifier 4347 bl.length()=170 2024-05-08T18:31:18.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.423+0000 7f68f4ff9640 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f68d4003ea0 con 0x558c594d3fe0 2024-05-08T18:31:18.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.423+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 notify.2 [notify cookie 94061282309648 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6a0c029070 con 0x558c594d3fe0 2024-05-08T18:31:18.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.424+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== watch-notify(notify_complete (2) cookie 94061282309648 notify 115964116993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558c594c2920 con 0x558c594d3fe0 2024-05-08T18:31:18.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.424+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c029070 con 0x558c594d3fe0 2024-05-08T18:31:18.435 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:18.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.425+0000 7f68c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:18.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.425+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94061282061520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594cb440 con 0x558c594cdd90 2024-05-08T18:31:18.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.426+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94061282061520] v27'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.426+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94061282035216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594decd0 con 0x7f6a0c035020 2024-05-08T18:31:18.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.427+0000 7f6a1177f640 1 -- 172.21.15.87:0/3028126685 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94061282035216] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a04075030 con 0x7f6a0c035020 2024-05-08T18:31:18.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.427+0000 7f6a13c87800 20 remove_watcher() i=0 2024-05-08T18:31:18.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.427+0000 7f6a13c87800 2 removed watcher, disabling cache 2024-05-08T18:31:18.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.427+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94061282039328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594d8610 con 0x558c594cdd90 2024-05-08T18:31:18.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.428+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94061282039328] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.428+0000 7f6a13c87800 20 remove_watcher() i=1 2024-05-08T18:31:18.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.428+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94061282044224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594d8610 con 0x558c594d3fe0 2024-05-08T18:31:18.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.429+0000 7f6a11f80640 1 -- 172.21.15.87:0/3028126685 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94061282044224] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c029070 con 0x558c594d3fe0 2024-05-08T18:31:18.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.429+0000 7f6a13c87800 20 remove_watcher() i=2 2024-05-08T18:31:18.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.429+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94061282047904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594da940 con 0x7f6a0c035020 2024-05-08T18:31:18.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.430+0000 7f6a1177f640 1 -- 172.21.15.87:0/3028126685 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94061282047904] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a04075030 con 0x7f6a0c035020 2024-05-08T18:31:18.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.430+0000 7f6a13c87800 20 remove_watcher() i=3 2024-05-08T18:31:18.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.430+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94061282051632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594d8610 con 0x558c594cdd90 2024-05-08T18:31:18.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.430+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94061282051632] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x558c594cdd90 2024-05-08T18:31:18.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.431+0000 7f6a13c87800 20 remove_watcher() i=4 2024-05-08T18:31:18.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.431+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94061282056560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594dc630 con 0x7f6a040a2040 2024-05-08T18:31:18.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.431+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94061282056560] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.431+0000 7f6a13c87800 20 remove_watcher() i=5 2024-05-08T18:31:18.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.431+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94061282041456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594dc630 con 0x7f6a040a2040 2024-05-08T18:31:18.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.432+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94061282041456] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.432+0000 7f6a13c87800 20 remove_watcher() i=6 2024-05-08T18:31:18.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.432+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94061282060464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558c594dc630 con 0x7f6a040a2040 2024-05-08T18:31:18.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.433+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94061282060464] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc02a040 con 0x7f6a040a2040 2024-05-08T18:31:18.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.433+0000 7f6a13c87800 20 remove_watcher() i=7 2024-05-08T18:31:18.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.433+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6a040a2040 msgr2=0x7f6a0408b530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.433+0000 7f6a13c87800 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6a040a2040 0x7f6a0408b530 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.433+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558c594cdd90 msgr2=0x558c594d0250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.433+0000 7f6a13c87800 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558c594cdd90 0x558c594d0250 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.433+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6a0c035020 msgr2=0x7f6a0c02b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.433+0000 7f6a13c87800 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6a0c035020 0x7f6a0c02b3e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.433+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x558c594d3fe0 msgr2=0x558c594d63d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.433+0000 7f6a13c87800 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x558c594d3fe0 0x558c594d63d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f68dc03bba0 msgr2=0x7f68dc03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f68dc03bba0 0x7f68dc03e060 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a04092980 tx=0x7f6a04087000 comp rx=0 tx=0).stop 2024-05-08T18:31:18.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594bac70 msgr2=0x558c594c2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a0bfff640 1 -- 172.21.15.87:0/3028126685 reap_dead start 2024-05-08T18:31:18.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594bac70 0x558c594c2150 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c04d010 tx=0x7f6a0c052890 comp rx=0 tx=0).stop 2024-05-08T18:31:18.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 shutdown_connections 2024-05-08T18:31:18.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 --2- 172.21.15.87:0/3028126685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594bac70 0x558c594c2150 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 >> 172.21.15.87:0/3028126685 conn(0x558c594b6fd0 msgr2=0x558c594b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 shutdown_connections 2024-05-08T18:31:18.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 -- 172.21.15.87:0/3028126685 wait complete. 2024-05-08T18:31:18.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 -- 172.21.15.87:0/3650759347 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f68e803bba0 msgr2=0x7f68e803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 --2- 172.21.15.87:0/3650759347 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f68e803bba0 0x7f68e803e060 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6a0405b730 tx=0x7f6a04053f50 comp rx=0 tx=0).stop 2024-05-08T18:31:18.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 -- 172.21.15.87:0/3650759347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594ad9e0 msgr2=0x558c594ade00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 --2- 172.21.15.87:0/3650759347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594ad9e0 0x558c594ade00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x558c59397360 tx=0x7f6a0c0178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 -- 172.21.15.87:0/3650759347 shutdown_connections 2024-05-08T18:31:18.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 --2- 172.21.15.87:0/3650759347 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f68e803bba0 0x7f68e803e060 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 --2- 172.21.15.87:0/3650759347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c594ad9e0 0x558c594ade00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 -- 172.21.15.87:0/3650759347 >> 172.21.15.87:0/3650759347 conn(0x558c594a1a80 msgr2=0x558c594a1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 -- 172.21.15.87:0/3650759347 shutdown_connections 2024-05-08T18:31:18.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.434+0000 7f6a13c87800 1 -- 172.21.15.87:0/3650759347 wait complete. 2024-05-08T18:31:18.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.435+0000 7f6a13c87800 1 -- 172.21.15.87:0/372080234 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558c5949cc40 msgr2=0x558c5949f030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.435+0000 7f6a13c87800 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558c5949cc40 0x558c5949f030 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.435+0000 7f6a13c87800 1 -- 172.21.15.87:0/372080234 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558c5939a610 msgr2=0x558c59499530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.435+0000 7f6a13c87800 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558c5939a610 0x558c59499530 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.435+0000 7f6a13c87800 1 -- 172.21.15.87:0/372080234 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f68f803bba0 msgr2=0x7f68f803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.435+0000 7f6a13c87800 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f68f803bba0 0x7f68f803e060 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f69fc000f60 tx=0x7f69fc0012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.435+0000 7f6a13c87800 1 -- 172.21.15.87:0/372080234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 msgr2=0x558c59397620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.435+0000 7f6a13c87800 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 0x558c59397620 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400a470 tx=0x7f6a04003020 comp rx=0 tx=0).stop 2024-05-08T18:31:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.435+0000 7f6a13c87800 1 -- 172.21.15.87:0/372080234 shutdown_connections 2024-05-08T18:31:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.435+0000 7f6a13c87800 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558c5939a610 0x558c59499530 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.435+0000 7f6a13c87800 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558c5949cc40 0x558c5949f030 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.435+0000 7f6a13c87800 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f68f803bba0 0x7f68f803e060 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.435+0000 7f6a13c87800 1 --2- 172.21.15.87:0/372080234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c59397ce0 0x558c59397620 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.435+0000 7f6a13c87800 1 -- 172.21.15.87:0/372080234 >> 172.21.15.87:0/372080234 conn(0x558c59391730 msgr2=0x558c594827b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.435+0000 7f6a13c87800 1 -- 172.21.15.87:0/372080234 shutdown_connections 2024-05-08T18:31:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.435+0000 7f6a13c87800 1 -- 172.21.15.87:0/372080234 wait complete. 2024-05-08T18:31:18.446 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:18.446 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-05-08T18:31:18.447 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-05-08T18:31:18.447 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-05-08T18:31:18.492 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:18.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.495+0000 7f994f062800 1 Processor -- start 2024-05-08T18:31:18.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.495+0000 7f994f062800 1 -- start start 2024-05-08T18:31:18.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.495+0000 7f994f062800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56301321d570 0x56301321fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.495+0000 7f994f062800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563013220090 con 0x56301318c4c0 2024-05-08T18:31:18.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.495+0000 7f994f062800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5630130b9e20 con 0x56301321d570 2024-05-08T18:31:18.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.496+0000 7f9944359640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56301321d570 0x56301321fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.496+0000 7f994cb5a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56301318c4c0 0x56301321bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41950/0 (socket says 172.21.15.87:41950) 2024-05-08T18:31:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.496+0000 7f994cb5a640 1 -- 172.21.15.87:0/155718468 learned_addr learned my addr 172.21.15.87:0/155718468 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.496+0000 7f9944359640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56301321d570 0x56301321fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33052/0 (socket says 172.21.15.87:33052) 2024-05-08T18:31:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.496+0000 7f9944359640 1 -- 172.21.15.87:0/155718468 >> v1:172.21.15.53:6789/0 conn(0x56301318c4c0 legacy=0x56301321bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.496+0000 7f9944359640 1 -- 172.21.15.87:0/155718468 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630132212c0 con 0x56301321d570 2024-05-08T18:31:18.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.498+0000 7f9944359640 1 --2- 172.21.15.87:0/155718468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301321d570 0x56301321fa10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f993400a470 tx=0x7f993401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975fcdcbc80347c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.498+0000 7f9947fff640 1 -- 172.21.15.87:0/155718468 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9934057070 con 0x56301321d570 2024-05-08T18:31:18.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.498+0000 7f9947fff640 1 -- 172.21.15.87:0/155718468 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9934052570 con 0x56301321d570 2024-05-08T18:31:18.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.498+0000 7f9947fff640 1 -- 172.21.15.87:0/155718468 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9934052870 con 0x56301321d570 2024-05-08T18:31:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.499+0000 7f994f062800 1 -- 172.21.15.87:0/155718468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301321d570 msgr2=0x56301321fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.499+0000 7f994f062800 1 --2- 172.21.15.87:0/155718468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301321d570 0x56301321fa10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f993400a470 tx=0x7f993401ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.499+0000 7f994f062800 1 -- 172.21.15.87:0/155718468 shutdown_connections 2024-05-08T18:31:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.499+0000 7f994f062800 1 --2- 172.21.15.87:0/155718468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301321d570 0x56301321fa10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.499+0000 7f994f062800 1 -- 172.21.15.87:0/155718468 >> 172.21.15.87:0/155718468 conn(0x563013213730 msgr2=0x563013215b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.499+0000 7f994f062800 1 -- 172.21.15.87:0/155718468 shutdown_connections 2024-05-08T18:31:18.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.499+0000 7f994f062800 1 -- 172.21.15.87:0/155718468 wait complete. 2024-05-08T18:31:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.512+0000 7f994f062800 1 Processor -- start 2024-05-08T18:31:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.512+0000 7f994f062800 1 -- start start 2024-05-08T18:31:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.512+0000 7f994f062800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301318c4c0 0x563013219720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.512+0000 7f994f062800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5630131645c0 con 0x56301318c4c0 2024-05-08T18:31:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.513+0000 7f994cb5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301318c4c0 0x563013219720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.513+0000 7f994cb5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301318c4c0 0x563013219720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33056/0 (socket says 172.21.15.87:33056) 2024-05-08T18:31:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.513+0000 7f994cb5a640 1 -- 172.21.15.87:0/825512210 learned_addr learned my addr 172.21.15.87:0/825512210 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.513+0000 7f994cb5a640 1 -- 172.21.15.87:0/825512210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563013217ce0 con 0x56301318c4c0 2024-05-08T18:31:18.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.513+0000 7f994cb5a640 1 --2- 172.21.15.87:0/825512210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301318c4c0 0x563013219720 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f993c001de0 tx=0x7f993c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a904fd57e917fe00 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.513+0000 7f983ae0d640 1 -- 172.21.15.87:0/825512210 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c012020 con 0x56301318c4c0 2024-05-08T18:31:18.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.513+0000 7f983ae0d640 1 -- 172.21.15.87:0/825512210 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993c00e5a0 con 0x56301318c4c0 2024-05-08T18:31:18.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.513+0000 7f983ae0d640 1 -- 172.21.15.87:0/825512210 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c00e8c0 con 0x56301318c4c0 2024-05-08T18:31:18.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.514+0000 7f994f062800 1 -- 172.21.15.87:0/825512210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301318c4c0 msgr2=0x563013219720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.514+0000 7f994f062800 1 --2- 172.21.15.87:0/825512210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301318c4c0 0x563013219720 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f993c001de0 tx=0x7f993c00b6c0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.514+0000 7f994f062800 1 -- 172.21.15.87:0/825512210 shutdown_connections 2024-05-08T18:31:18.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.514+0000 7f994f062800 1 --2- 172.21.15.87:0/825512210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301318c4c0 0x563013219720 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.514+0000 7f994f062800 1 -- 172.21.15.87:0/825512210 >> 172.21.15.87:0/825512210 conn(0x563013213730 msgr2=0x563013305f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.514+0000 7f994f062800 1 -- 172.21.15.87:0/825512210 shutdown_connections 2024-05-08T18:31:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.514+0000 7f994f062800 1 -- 172.21.15.87:0/825512210 wait complete. 2024-05-08T18:31:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.514+0000 7f994f062800 1 Processor -- start 2024-05-08T18:31:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.514+0000 7f994f062800 1 -- start start 2024-05-08T18:31:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.515+0000 7f994f062800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301318c4c0 0x5630133143c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.515+0000 7f994f062800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563013220560 con 0x56301318c4c0 2024-05-08T18:31:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.515+0000 7f994cb5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301318c4c0 0x5630133143c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.515+0000 7f994cb5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301318c4c0 0x5630133143c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33060/0 (socket says 172.21.15.87:33060) 2024-05-08T18:31:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.515+0000 7f994cb5a640 1 -- 172.21.15.87:0/2316928916 learned_addr learned my addr 172.21.15.87:0/2316928916 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.515+0000 7f994cb5a640 1 -- 172.21.15.87:0/2316928916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563013314900 con 0x56301318c4c0 2024-05-08T18:31:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.515+0000 7f994cb5a640 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301318c4c0 0x5630133143c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f993c00c010 tx=0x7f993c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.515+0000 7f983960a640 1 -- 172.21.15.87:0/2316928916 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c012070 con 0x56301318c4c0 2024-05-08T18:31:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.515+0000 7f983960a640 1 -- 172.21.15.87:0/2316928916 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993c01a7a0 con 0x56301318c4c0 2024-05-08T18:31:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.515+0000 7f983960a640 1 -- 172.21.15.87:0/2316928916 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c01aa80 con 0x56301318c4c0 2024-05-08T18:31:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.515+0000 7f994f062800 1 -- 172.21.15.87:0/2316928916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563013314b90 con 0x56301318c4c0 2024-05-08T18:31:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.515+0000 7f994f062800 1 -- 172.21.15.87:0/2316928916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563013317840 con 0x56301318c4c0 2024-05-08T18:31:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.516+0000 7f983960a640 1 -- 172.21.15.87:0/2316928916 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f993c015020 con 0x56301318c4c0 2024-05-08T18:31:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.516+0000 7f983960a640 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f983403bb50 0x7f983403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.516+0000 7f983960a640 1 -- 172.21.15.87:0/2316928916 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f993c020070 con 0x56301318c4c0 2024-05-08T18:31:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.516+0000 7f9944359640 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f983403bb50 0x7f983403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.517+0000 7f994f062800 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56301321d570 0x56301331b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.517+0000 7f994f062800 1 -- 172.21.15.87:0/2316928916 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56301331bb40 con 0x56301321d570 2024-05-08T18:31:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.517+0000 7f994d35b640 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56301321d570 0x56301331b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.517+0000 7f9944359640 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f983403bb50 0x7f983403e010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9934054000 tx=0x7f993404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.517+0000 7f994d35b640 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56301321d570 0x56301331b600 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.517+0000 7f994d35b640 1 -- 172.21.15.87:0/2316928916 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f994800a4a0 con 0x56301321d570 2024-05-08T18:31:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.517+0000 7f994f062800 1 -- 172.21.15.87:0/2316928916 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563013318bd0 con 0x56301321d570 2024-05-08T18:31:18.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.517+0000 7f994d35b640 1 -- 172.21.15.87:0/2316928916 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f994800a4a0 con 0x56301321d570 2024-05-08T18:31:18.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.518+0000 7f994f062800 1 -- 172.21.15.87:0/2316928916 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56301331d980 con 0x56301321d570 2024-05-08T18:31:18.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.518+0000 7f994d35b640 1 -- 172.21.15.87:0/2316928916 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f994800a4a0 con 0x56301321d570 2024-05-08T18:31:18.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.518+0000 7f994f062800 1 -- 172.21.15.87:0/2316928916 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56301331cbb0 con 0x56301321d570 2024-05-08T18:31:18.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.518+0000 7f994d35b640 1 -- 172.21.15.87:0/2316928916 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f994800a4a0 con 0x56301321d570 2024-05-08T18:31:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.518+0000 7f994f062800 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56301331ed30 0x563013321120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.518+0000 7f994f062800 1 -- 172.21.15.87:0/2316928916 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563013321660 con 0x56301331ed30 2024-05-08T18:31:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.518+0000 7f994cb5a640 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56301331ed30 0x563013321120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.519+0000 7f994cb5a640 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56301331ed30 0x563013321120 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.519+0000 7f994cb5a640 1 -- 172.21.15.87:0/2316928916 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f993c02b070 con 0x56301331ed30 2024-05-08T18:31:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.519+0000 7f994f062800 1 Processor -- start 2024-05-08T18:31:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.519+0000 7f994f062800 1 -- start start 2024-05-08T18:31:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.519+0000 7f994f062800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301332f930 0x56301332fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.519+0000 7f994f062800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56301310afc0 con 0x56301332f930 2024-05-08T18:31:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.520+0000 7f994d35b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301332f930 0x56301332fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.520+0000 7f994d35b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301332f930 0x56301332fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33062/0 (socket says 172.21.15.87:33062) 2024-05-08T18:31:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.520+0000 7f994d35b640 1 -- 172.21.15.87:0/1119087784 learned_addr learned my addr 172.21.15.87:0/1119087784 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.520+0000 7f994d35b640 1 -- 172.21.15.87:0/1119087784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563013330290 con 0x56301332f930 2024-05-08T18:31:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.520+0000 7f994d35b640 1 --2- 172.21.15.87:0/1119087784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301332f930 0x56301332fd50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5630133157c0 tx=0x7f99480178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.520+0000 7f98327fc640 1 -- 172.21.15.87:0/1119087784 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9948013440 con 0x56301332f930 2024-05-08T18:31:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.520+0000 7f98327fc640 1 -- 172.21.15.87:0/1119087784 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99480135e0 con 0x56301332f930 2024-05-08T18:31:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.520+0000 7f994f062800 1 -- 172.21.15.87:0/1119087784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563013330d00 con 0x56301332f930 2024-05-08T18:31:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.520+0000 7f98327fc640 1 -- 172.21.15.87:0/1119087784 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99480138c0 con 0x56301332f930 2024-05-08T18:31:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.520+0000 7f994f062800 1 -- 172.21.15.87:0/1119087784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563013331200 con 0x56301332f930 2024-05-08T18:31:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.521+0000 7f98327fc640 1 -- 172.21.15.87:0/1119087784 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9948011040 con 0x56301332f930 2024-05-08T18:31:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.521+0000 7f98327fc640 1 --2- 172.21.15.87:0/1119087784 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f982403bba0 0x7f982403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.521+0000 7f98327fc640 1 -- 172.21.15.87:0/1119087784 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f994801d070 con 0x56301332f930 2024-05-08T18:31:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.521+0000 7f994cb5a640 1 --2- 172.21.15.87:0/1119087784 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f982403bba0 0x7f982403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.522+0000 7f994f062800 1 Processor -- start 2024-05-08T18:31:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.522+0000 7f994f062800 1 -- start start 2024-05-08T18:31:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.522+0000 7f994cb5a640 1 --2- 172.21.15.87:0/1119087784 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f982403bba0 0x7f982403e060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f993c00b6e0 tx=0x7f993c050ce0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.522+0000 7f994f062800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301333cbc0 0x56301333cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.522+0000 7f994f062800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563013218060 con 0x56301333cbc0 2024-05-08T18:31:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.522+0000 7f994d35b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301333cbc0 0x56301333cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.522+0000 7f994d35b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301333cbc0 0x56301333cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33078/0 (socket says 172.21.15.87:33078) 2024-05-08T18:31:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.522+0000 7f994d35b640 1 -- 172.21.15.87:0/81158841 learned_addr learned my addr 172.21.15.87:0/81158841 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.522+0000 7f994d35b640 1 -- 172.21.15.87:0/81158841 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56301333d5b0 con 0x56301333cbc0 2024-05-08T18:31:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.523+0000 7f994d35b640 1 --2- 172.21.15.87:0/81158841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301333cbc0 0x56301333cfe0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9948052930 tx=0x7f9948001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547cc6e445da8dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.523+0000 7f9823fff640 1 -- 172.21.15.87:0/81158841 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994802ad80 con 0x56301333cbc0 2024-05-08T18:31:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.523+0000 7f9823fff640 1 -- 172.21.15.87:0/81158841 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99480540d0 con 0x56301333cbc0 2024-05-08T18:31:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.523+0000 7f9823fff640 1 -- 172.21.15.87:0/81158841 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99480543d0 con 0x56301333cbc0 2024-05-08T18:31:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.523+0000 7f994f062800 1 -- 172.21.15.87:0/81158841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301333cbc0 msgr2=0x56301333cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.523+0000 7f994f062800 1 --2- 172.21.15.87:0/81158841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301333cbc0 0x56301333cfe0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9948052930 tx=0x7f9948001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.523+0000 7f994f062800 1 -- 172.21.15.87:0/81158841 shutdown_connections 2024-05-08T18:31:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.523+0000 7f994f062800 1 --2- 172.21.15.87:0/81158841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301333cbc0 0x56301333cfe0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.523+0000 7f994f062800 1 -- 172.21.15.87:0/81158841 >> 172.21.15.87:0/81158841 conn(0x563013338f20 msgr2=0x563013336f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.523+0000 7f994f062800 1 -- 172.21.15.87:0/81158841 shutdown_connections 2024-05-08T18:31:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.523+0000 7f994f062800 1 -- 172.21.15.87:0/81158841 wait complete. 2024-05-08T18:31:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.523+0000 7f994f062800 1 Processor -- start 2024-05-08T18:31:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.523+0000 7f994f062800 1 -- start start 2024-05-08T18:31:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.524+0000 7f994f062800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301333cbc0 0x563013344230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.524+0000 7f994f062800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56301333dd20 con 0x56301333cbc0 2024-05-08T18:31:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.524+0000 7f994d35b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301333cbc0 0x563013344230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.524+0000 7f994d35b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301333cbc0 0x563013344230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33094/0 (socket says 172.21.15.87:33094) 2024-05-08T18:31:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.524+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 learned_addr learned my addr 172.21.15.87:0/2774622793 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.524+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563013344770 con 0x56301333cbc0 2024-05-08T18:31:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.524+0000 7f994d35b640 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301333cbc0 0x563013344230 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9948051820 tx=0x7f9948052890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.524+0000 7f98227fc640 1 -- 172.21.15.87:0/2774622793 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9948030020 con 0x56301333cbc0 2024-05-08T18:31:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.524+0000 7f98227fc640 1 -- 172.21.15.87:0/2774622793 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9948051310 con 0x56301333cbc0 2024-05-08T18:31:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.524+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563013344a00 con 0x56301333cbc0 2024-05-08T18:31:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.524+0000 7f98227fc640 1 -- 172.21.15.87:0/2774622793 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9948013a60 con 0x56301333cbc0 2024-05-08T18:31:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.524+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630133476b0 con 0x56301333cbc0 2024-05-08T18:31:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.525+0000 7f98227fc640 1 -- 172.21.15.87:0/2774622793 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9948033020 con 0x56301333cbc0 2024-05-08T18:31:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.525+0000 7f98227fc640 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f981803bba0 0x7f981803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.525+0000 7f98227fc640 1 -- 172.21.15.87:0/2774622793 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f994800e040 con 0x56301333cbc0 2024-05-08T18:31:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.525+0000 7f994cb5a640 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f981803bba0 0x7f981803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.526+0000 7f994cb5a640 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f981803bba0 0x7f981803e060 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f993c043270 tx=0x7f993c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.526+0000 7f994f062800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.526+0000 7f994f062800 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56301334fee0 0x5630133523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.526+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563013352af0 con 0x56301334fee0 2024-05-08T18:31:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.526+0000 7f9944359640 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56301334fee0 0x5630133523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.526+0000 7f9944359640 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56301334fee0 0x5630133523a0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f994f062800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f994f062800 20 realm 2024-05-08T18:31:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f994f062800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563013352ec0 con 0x56301334fee0 2024-05-08T18:31:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f994f062800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f994f062800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f994f062800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563013353790 con 0x56301334fee0 2024-05-08T18:31:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f994f062800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f994f062800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563013353b30 con 0x56301334fee0 2024-05-08T18:31:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f994f062800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f994f062800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.527+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563013354380 con 0x56301334fee0 2024-05-08T18:31:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.528+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.528+0000 7f994f062800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.528+0000 7f994f062800 20 searching for the correct realm 2024-05-08T18:31:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.528+0000 7f994f062800 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5630133560f0 0x5630133584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.528+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x5630133560f0 2024-05-08T18:31:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.528+0000 7f994d35b640 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5630133560f0 0x5630133584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.528+0000 7f994d35b640 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5630133560f0 0x5630133584e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.528+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9948029070 con 0x5630133560f0 2024-05-08T18:31:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.529+0000 7f994d35b640 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9948035020 0x7f994802ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.529+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x7f9948035020 2024-05-08T18:31:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.529+0000 7f994cb5a640 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9948035020 0x7f994802ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.529+0000 7f994cb5a640 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9948035020 0x7f994802ba30 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.529+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c02b070 con 0x7f9948035020 2024-05-08T18:31:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.529+0000 7f994cb5a640 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f993c017050 0x7f993c0227d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.529+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x7f993c017050 2024-05-08T18:31:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.529+0000 7f9944359640 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f993c017050 0x7f993c0227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.530+0000 7f9944359640 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f993c017050 0x7f993c0227d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.530+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.530+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x56301334fee0 2024-05-08T18:31:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.530+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.530+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x56301334fee0 2024-05-08T18:31:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.531+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.531+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x7f993c017050 2024-05-08T18:31:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.531+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.531+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x7f993c017050 2024-05-08T18:31:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.531+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.531+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x7f9948035020 2024-05-08T18:31:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.531+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c02b070 con 0x7f9948035020 2024-05-08T18:31:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.531+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x5630133560f0 2024-05-08T18:31:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.532+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9948029070 con 0x5630133560f0 2024-05-08T18:31:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.532+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x56301334fee0 2024-05-08T18:31:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.532+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.532+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x7f993c017050 2024-05-08T18:31:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.532+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.532+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x56301334fee0 2024-05-08T18:31:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.532+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.532+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x7f9948035020 2024-05-08T18:31:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.533+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f993c02b070 con 0x7f9948035020 2024-05-08T18:31:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.533+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x5630133560f0 2024-05-08T18:31:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.533+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9948029070 con 0x5630133560f0 2024-05-08T18:31:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.533+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x5630133560f0 2024-05-08T18:31:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.533+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9948029070 con 0x5630133560f0 2024-05-08T18:31:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.533+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x7f993c017050 2024-05-08T18:31:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.534+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.534+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x5630133560f0 2024-05-08T18:31:18.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.534+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9948029070 con 0x5630133560f0 2024-05-08T18:31:18.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.534+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x5630133560f0 2024-05-08T18:31:18.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.534+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9948029070 con 0x5630133560f0 2024-05-08T18:31:18.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.534+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x56301334fee0 2024-05-08T18:31:18.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.534+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.534+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x56301334fee0 2024-05-08T18:31:18.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.535+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.535+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x7f993c017050 2024-05-08T18:31:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.535+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.535+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x5630133560f0 2024-05-08T18:31:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.535+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9948029070 con 0x5630133560f0 2024-05-08T18:31:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.535+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x7f9948035020 2024-05-08T18:31:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.535+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c02b070 con 0x7f9948035020 2024-05-08T18:31:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.535+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x56301334fee0 2024-05-08T18:31:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.536+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.536+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x7f993c017050 2024-05-08T18:31:18.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.536+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.536+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x5630133560f0 2024-05-08T18:31:18.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.536+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9948029070 con 0x5630133560f0 2024-05-08T18:31:18.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.536+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x7f993c017050 2024-05-08T18:31:18.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.537+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.537+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x7f9948035020 2024-05-08T18:31:18.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.537+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c02b070 con 0x7f9948035020 2024-05-08T18:31:18.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.537+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x5630133560f0 2024-05-08T18:31:18.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.537+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9948029070 con 0x5630133560f0 2024-05-08T18:31:18.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.537+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x7f993c017050 2024-05-08T18:31:18.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.538+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.538+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x56301334fee0 2024-05-08T18:31:18.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.538+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.538+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563013358a70 con 0x7f9948035020 2024-05-08T18:31:18.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.538+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c02b070 con 0x7f9948035020 2024-05-08T18:31:18.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.538+0000 7f994f062800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:18.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.538+0000 7f994f062800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:18.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.538+0000 7f994f062800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:18.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.538+0000 7f994f062800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:18.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.538+0000 7f994f062800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:18.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.538+0000 7f994f062800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:18.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.538+0000 7f994f062800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.538+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563013354d00 con 0x56301334fee0 2024-05-08T18:31:18.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.538+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.538+0000 7f994f062800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.538+0000 7f994f062800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.538+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5630133555a0 con 0x56301334fee0 2024-05-08T18:31:18.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.539+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.539+0000 7f994f062800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:18.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.539+0000 7f994f062800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.539+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563013358ef0 con 0x7f993c017050 2024-05-08T18:31:18.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.539+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.539+0000 7f994f062800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:18.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.539+0000 7f994f062800 20 zone default found 2024-05-08T18:31:18.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.539+0000 7f994f062800 4 Realm: () 2024-05-08T18:31:18.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.539+0000 7f994f062800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:18.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.539+0000 7f994f062800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:18.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.539+0000 7f994f062800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:18.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.539+0000 7f994f062800 20 zonegroup default 2024-05-08T18:31:18.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.539+0000 7f994f062800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.539+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5630133593a0 con 0x7f993c017050 2024-05-08T18:31:18.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.540+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.540+0000 7f994f062800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.540+0000 7f994f062800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.540+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56301335ad80 con 0x5630133560f0 2024-05-08T18:31:18.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.540+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9948029070 con 0x5630133560f0 2024-05-08T18:31:18.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.540+0000 7f994f062800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.540+0000 7f994f062800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.540+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56301335b240 con 0x5630133560f0 2024-05-08T18:31:18.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.540+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9948029070 con 0x5630133560f0 2024-05-08T18:31:18.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.540+0000 7f994f062800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.540+0000 7f994f062800 20 started sync module instance, tier type = 2024-05-08T18:31:18.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.540+0000 7f994f062800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:18.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.540+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301335a210 con 0x7f9948035020 2024-05-08T18:31:18.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.541+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c02b070 con 0x7f9948035020 2024-05-08T18:31:18.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.541+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94764480701952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563013359e70 con 0x7f9948035020 2024-05-08T18:31:18.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.541+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301335c170 con 0x56301334fee0 2024-05-08T18:31:18.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.542+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94764480701952] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c02b070 con 0x7f9948035020 2024-05-08T18:31:18.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.542+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.542+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94764480707776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301335c0e0 con 0x56301334fee0 2024-05-08T18:31:18.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.542+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301335d030 con 0x5630133560f0 2024-05-08T18:31:18.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.543+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9948029070 con 0x5630133560f0 2024-05-08T18:31:18.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.544+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94764480711552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301335d8d0 con 0x5630133560f0 2024-05-08T18:31:18.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.544+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301335e3a0 con 0x7f9948035020 2024-05-08T18:31:18.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.544+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94764480707776] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.544+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94764480711552] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9948029070 con 0x5630133560f0 2024-05-08T18:31:18.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.545+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c02b070 con 0x7f9948035020 2024-05-08T18:31:18.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.545+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94764480709984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301335d8d0 con 0x7f9948035020 2024-05-08T18:31:18.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.545+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301335ec40 con 0x56301334fee0 2024-05-08T18:31:18.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.546+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.546+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94764480719216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301335f4e0 con 0x56301334fee0 2024-05-08T18:31:18.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.546+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301335ff90 con 0x7f993c017050 2024-05-08T18:31:18.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.546+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94764480709984] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c02b070 con 0x7f9948035020 2024-05-08T18:31:18.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.547+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.547+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94764480713760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301335ff50 con 0x7f993c017050 2024-05-08T18:31:18.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.547+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5630133609c0 con 0x7f993c017050 2024-05-08T18:31:18.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.547+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94764480719216] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.547+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94764480713760] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.548+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.548+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94764480720944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301335ff50 con 0x7f993c017050 2024-05-08T18:31:18.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.548+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563013360e70 con 0x7f993c017050 2024-05-08T18:31:18.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.549+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.549+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94764480727488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563013361290 con 0x7f993c017050 2024-05-08T18:31:18.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.549+0000 7f994f062800 20 add_watcher() i=0 2024-05-08T18:31:18.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.549+0000 7f994f062800 20 add_watcher() i=1 2024-05-08T18:31:18.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.549+0000 7f994f062800 20 add_watcher() i=2 2024-05-08T18:31:18.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.549+0000 7f994f062800 20 add_watcher() i=3 2024-05-08T18:31:18.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.549+0000 7f994f062800 20 add_watcher() i=4 2024-05-08T18:31:18.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.549+0000 7f994f062800 20 add_watcher() i=5 2024-05-08T18:31:18.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.549+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94764480720944] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.549+0000 7f994f062800 20 add_watcher() i=6 2024-05-08T18:31:18.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.549+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94764480727488] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.549+0000 7f994f062800 20 add_watcher() i=7 2024-05-08T18:31:18.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.549+0000 7f994f062800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:18.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.549+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56301335faa0 con 0x56301334fee0 2024-05-08T18:31:18.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.550+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.550+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94764480728544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301335faa0 con 0x56301334fee0 2024-05-08T18:31:18.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.551+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94764480728544] v27'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.551+0000 7f9802fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:18.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.551+0000 7f994f062800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:18.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.551+0000 7f994f062800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:18.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.551+0000 7f994f062800 5 note: GC not initialized 2024-05-08T18:31:18.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.551+0000 7f9801fe3640 20 reqs_thread_entry: start 2024-05-08T18:31:18.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.551+0000 7f994f062800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:18.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.551+0000 7f994f062800 20 Filter name: none 2024-05-08T18:31:18.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.551+0000 7f97737fe640 20 reqs_thread_entry: start 2024-05-08T18:31:18.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.551+0000 7f994f062800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:18.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.551+0000 7f994f062800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.551+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5630133976e0 con 0x56301334fee0 2024-05-08T18:31:18.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.552+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.552+0000 7f994f062800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:18.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.552+0000 7f994f062800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:18.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.552+0000 7f994f062800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:18.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.552+0000 7f994f062800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.552+0000 7f994f062800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-05-08T18:31:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.552+0000 7f994f062800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.552+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563013397ff0 con 0x56301334fee0 2024-05-08T18:31:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.552+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.552+0000 7f994f062800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.552+0000 7f994f062800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-05-08T18:31:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.552+0000 7f994f062800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-08T18:31:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.552+0000 7f994f062800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-05-08T18:31:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.552+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301339da80 con 0x56301334fee0 2024-05-08T18:31:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.553+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v27'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.553+0000 7f994f062800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.553+0000 7f994f062800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.553+0000 7f994f062800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:31:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.553+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94764480975936 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563013399000 con 0x56301334fee0 2024-05-08T18:31:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.554+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== watch-notify(notify (1) cookie 94764480719216 notify 115964116997 ret 0) ==== 774+0+0 (crc 0 0 0) 0x5630132212c0 con 0x56301334fee0 2024-05-08T18:31:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.554+0000 7f9823fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 94764480719216 notifier 4354 bl.length()=732 2024-05-08T18:31:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.554+0000 7f9823fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.554+0000 7f9823fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.554+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(65 notify.4 [notify cookie 94764480975936 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.554+0000 7f9823fff640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f9810003ea0 con 0x56301334fee0 2024-05-08T18:31:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.554+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.554+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== watch-notify(notify_complete (2) cookie 94764480975936 notify 115964116997 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f993405dc30 con 0x56301334fee0 2024-05-08T18:31:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.554+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301339d440 con 0x56301334fee0 2024-05-08T18:31:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.555+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.555+0000 7f994f062800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-05-08T18:31:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.555+0000 7f994f062800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-08T18:31:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.555+0000 7f994f062800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-05-08T18:31:18.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.555+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94764480975936 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563013398b50 con 0x7f9948035020 2024-05-08T18:31:18.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.555+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== watch-notify(notify (1) cookie 94764480701952 notify 115964116994 ret 0) ==== 208+0+0 (crc 0 0 0) 0x563013317840 con 0x7f9948035020 2024-05-08T18:31:18.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.555+0000 7f98237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116994 cookie 94764480701952 notifier 4354 bl.length()=166 2024-05-08T18:31:18.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.555+0000 7f98237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-05-08T18:31:18.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.555+0000 7f98237fe640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-08T18:31:18.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.555+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(68 notify.0 [notify cookie 94764480975936 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f993c02b070 con 0x7f9948035020 2024-05-08T18:31:18.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.555+0000 7f98237fe640 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f9780003400 con 0x7f9948035020 2024-05-08T18:31:18.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.556+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== watch-notify(notify_complete (2) cookie 94764480975936 notify 115964116994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563013314b90 con 0x7f9948035020 2024-05-08T18:31:18.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.556+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c02b070 con 0x7f9948035020 2024-05-08T18:31:18.569 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"cNJD8qytJnIBjFzXJ5z7RXQjTh7agGe7UWza8sNM","active":true,"create_date":"2024-05-08T18:31:18.553386Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:18.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.557+0000 7f9802fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:18.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.557+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94764480728544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563013396270 con 0x56301334fee0 2024-05-08T18:31:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.557+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94764480728544] v27'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.557+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94764480701952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563013360de0 con 0x7f9948035020 2024-05-08T18:31:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.558+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94764480701952] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c02b070 con 0x7f9948035020 2024-05-08T18:31:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.558+0000 7f994f062800 20 remove_watcher() i=0 2024-05-08T18:31:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.558+0000 7f994f062800 2 removed watcher, disabling cache 2024-05-08T18:31:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.558+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94764480707776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563013360de0 con 0x56301334fee0 2024-05-08T18:31:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.560+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94764480707776] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.560+0000 7f994f062800 20 remove_watcher() i=1 2024-05-08T18:31:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.560+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94764480711552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301335bcc0 con 0x5630133560f0 2024-05-08T18:31:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.561+0000 7f994d35b640 1 -- 172.21.15.87:0/2774622793 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94764480711552] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9948029070 con 0x5630133560f0 2024-05-08T18:31:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.561+0000 7f994f062800 20 remove_watcher() i=2 2024-05-08T18:31:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.561+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94764480709984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563013360de0 con 0x7f9948035020 2024-05-08T18:31:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.562+0000 7f994cb5a640 1 -- 172.21.15.87:0/2774622793 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94764480709984] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c02b070 con 0x7f9948035020 2024-05-08T18:31:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.562+0000 7f994f062800 20 remove_watcher() i=3 2024-05-08T18:31:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.562+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94764480719216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301335cb80 con 0x56301334fee0 2024-05-08T18:31:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.563+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94764480719216] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x56301334fee0 2024-05-08T18:31:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.563+0000 7f994f062800 20 remove_watcher() i=4 2024-05-08T18:31:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.563+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94764480713760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301335bcc0 con 0x7f993c017050 2024-05-08T18:31:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.564+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94764480713760] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.564+0000 7f994f062800 20 remove_watcher() i=5 2024-05-08T18:31:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.564+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94764480720944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563013360de0 con 0x7f993c017050 2024-05-08T18:31:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.565+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94764480720944] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.565+0000 7f994f062800 20 remove_watcher() i=6 2024-05-08T18:31:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.565+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94764480727488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56301335e970 con 0x7f993c017050 2024-05-08T18:31:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94764480727488] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c017050 2024-05-08T18:31:18.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 20 remove_watcher() i=7 2024-05-08T18:31:18.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f993c017050 msgr2=0x7f993c0227d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f993c017050 0x7f993c0227d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56301334fee0 msgr2=0x5630133523a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56301334fee0 0x5630133523a0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9948035020 msgr2=0x7f994802ba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9948035020 0x7f994802ba30 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5630133560f0 msgr2=0x5630133584e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5630133560f0 0x5630133584e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f981803bba0 msgr2=0x7f981803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f981803bba0 0x7f981803e060 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f993c043270 tx=0x7f993c04e000 comp rx=0 tx=0).stop 2024-05-08T18:31:18.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f9944359640 1 -- 172.21.15.87:0/2774622793 reap_dead start 2024-05-08T18:31:18.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301333cbc0 msgr2=0x563013344230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301333cbc0 0x563013344230 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9948051820 tx=0x7f9948052890 comp rx=0 tx=0).stop 2024-05-08T18:31:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 shutdown_connections 2024-05-08T18:31:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 1 --2- 172.21.15.87:0/2774622793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301333cbc0 0x563013344230 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 >> 172.21.15.87:0/2774622793 conn(0x563013338f20 msgr2=0x563013336580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 shutdown_connections 2024-05-08T18:31:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.566+0000 7f994f062800 1 -- 172.21.15.87:0/2774622793 wait complete. 2024-05-08T18:31:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 -- 172.21.15.87:0/1119087784 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f982403bba0 msgr2=0x7f982403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 --2- 172.21.15.87:0/1119087784 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f982403bba0 0x7f982403e060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f993c00b6e0 tx=0x7f993c050ce0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 -- 172.21.15.87:0/1119087784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301332f930 msgr2=0x56301332fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 --2- 172.21.15.87:0/1119087784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301332f930 0x56301332fd50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5630133157c0 tx=0x7f99480178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 -- 172.21.15.87:0/1119087784 shutdown_connections 2024-05-08T18:31:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 --2- 172.21.15.87:0/1119087784 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f982403bba0 0x7f982403e060 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 --2- 172.21.15.87:0/1119087784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301332f930 0x56301332fd50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 -- 172.21.15.87:0/1119087784 >> 172.21.15.87:0/1119087784 conn(0x5630133239d0 msgr2=0x563013323dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 -- 172.21.15.87:0/1119087784 shutdown_connections 2024-05-08T18:31:18.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 -- 172.21.15.87:0/1119087784 wait complete. 2024-05-08T18:31:18.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 -- 172.21.15.87:0/2316928916 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56301331ed30 msgr2=0x563013321120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56301331ed30 0x563013321120 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 -- 172.21.15.87:0/2316928916 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56301321d570 msgr2=0x56301331b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56301321d570 0x56301331b600 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 -- 172.21.15.87:0/2316928916 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f983403bb50 msgr2=0x7f983403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f983403bb50 0x7f983403e010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9934054000 tx=0x7f993404e000 comp rx=0 tx=0).stop 2024-05-08T18:31:18.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 -- 172.21.15.87:0/2316928916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301318c4c0 msgr2=0x5630133143c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301318c4c0 0x5630133143c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f993c00c010 tx=0x7f993c000ed0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 -- 172.21.15.87:0/2316928916 shutdown_connections 2024-05-08T18:31:18.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56301321d570 0x56301331b600 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56301331ed30 0x563013321120 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f983403bb50 0x7f983403e010 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 --2- 172.21.15.87:0/2316928916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56301318c4c0 0x5630133143c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 -- 172.21.15.87:0/2316928916 >> 172.21.15.87:0/2316928916 conn(0x563013213730 msgr2=0x5630132185c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 -- 172.21.15.87:0/2316928916 shutdown_connections 2024-05-08T18:31:18.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.567+0000 7f994f062800 1 -- 172.21.15.87:0/2316928916 wait complete. 2024-05-08T18:31:18.580 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'cNJD8qytJnIBjFzXJ5z7RXQjTh7agGe7UWza8sNM', 'active': True, 'create_date': '2024-05-08T18:31:18.553386Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:18.580 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-05-08T18:31:18.580 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-05-08T18:31:18.581 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-05-08T18:31:18.629 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:18.629 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.632+0000 7f6466129800 1 Processor -- start 2024-05-08T18:31:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.632+0000 7f6466129800 1 -- start start 2024-05-08T18:31:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.632+0000 7f6466129800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55dec4f216c0 0x55dec4f23ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.632+0000 7f6466129800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dec4f24080 con 0x55dec4f1d2d0 2024-05-08T18:31:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.632+0000 7f6466129800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55dec4dbde20 con 0x55dec4f216c0 2024-05-08T18:31:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.632+0000 7f64616e3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55dec4f216c0 0x55dec4f23ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.632+0000 7f64616e3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55dec4f216c0 0x55dec4f23ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33096/0 (socket says 172.21.15.87:33096) 2024-05-08T18:31:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.632+0000 7f64616e3640 1 -- 172.21.15.87:0/1193571696 learned_addr learned my addr 172.21.15.87:0/1193571696 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.632+0000 7f6461ee4640 1 --1- 172.21.15.87:0/1193571696 >> v1:172.21.15.53:6789/0 conn(0x55dec4f1d2d0 0x55dec4f1d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41958/0 (socket says 172.21.15.87:41958) 2024-05-08T18:31:18.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.633+0000 7f64616e3640 1 -- 172.21.15.87:0/1193571696 >> v1:172.21.15.53:6789/0 conn(0x55dec4f1d2d0 legacy=0x55dec4f1d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.633+0000 7f64616e3640 1 -- 172.21.15.87:0/1193571696 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dec4f252b0 con 0x55dec4f216c0 2024-05-08T18:31:18.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.634+0000 7f64616e3640 1 --2- 172.21.15.87:0/1193571696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f216c0 0x55dec4f23ab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f645800a520 tx=0x7f645801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e0b3b3ceec79e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.635+0000 7f6460ee2640 1 -- 172.21.15.87:0/1193571696 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6458057070 con 0x55dec4f216c0 2024-05-08T18:31:18.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.635+0000 7f6460ee2640 1 -- 172.21.15.87:0/1193571696 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6458052570 con 0x55dec4f216c0 2024-05-08T18:31:18.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.635+0000 7f6460ee2640 1 -- 172.21.15.87:0/1193571696 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645804ae60 con 0x55dec4f216c0 2024-05-08T18:31:18.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.635+0000 7f6466129800 1 -- 172.21.15.87:0/1193571696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f216c0 msgr2=0x55dec4f23ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.635+0000 7f6466129800 1 --2- 172.21.15.87:0/1193571696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f216c0 0x55dec4f23ab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f645800a520 tx=0x7f645801d010 comp rx=0 tx=0).stop 2024-05-08T18:31:18.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.635+0000 7f6466129800 1 -- 172.21.15.87:0/1193571696 shutdown_connections 2024-05-08T18:31:18.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.635+0000 7f6466129800 1 --2- 172.21.15.87:0/1193571696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f216c0 0x55dec4f23ab0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.635+0000 7f6466129800 1 -- 172.21.15.87:0/1193571696 >> 172.21.15.87:0/1193571696 conn(0x55dec4f18850 msgr2=0x55dec4f1ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.635+0000 7f6466129800 1 -- 172.21.15.87:0/1193571696 shutdown_connections 2024-05-08T18:31:18.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.635+0000 7f6466129800 1 -- 172.21.15.87:0/1193571696 wait complete. 2024-05-08T18:31:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.649+0000 7f6466129800 1 Processor -- start 2024-05-08T18:31:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.650+0000 7f6466129800 1 -- start start 2024-05-08T18:31:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.650+0000 7f6466129800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f1d2d0 0x55dec500e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.650+0000 7f6466129800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dec4e685d0 con 0x55dec4f1d2d0 2024-05-08T18:31:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.650+0000 7f6461ee4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f1d2d0 0x55dec500e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.650+0000 7f6461ee4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f1d2d0 0x55dec500e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33100/0 (socket says 172.21.15.87:33100) 2024-05-08T18:31:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.650+0000 7f6461ee4640 1 -- 172.21.15.87:0/1400452018 learned_addr learned my addr 172.21.15.87:0/1400452018 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.650+0000 7f6461ee4640 1 -- 172.21.15.87:0/1400452018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dec500ec90 con 0x55dec4f1d2d0 2024-05-08T18:31:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.650+0000 7f6461ee4640 1 --2- 172.21.15.87:0/1400452018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f1d2d0 0x55dec500e6c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f645400b230 tx=0x7f645400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d98a7ae2c1c047 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.651+0000 7f634fe07640 1 -- 172.21.15.87:0/1400452018 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645400e5c0 con 0x55dec4f1d2d0 2024-05-08T18:31:18.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.651+0000 7f634fe07640 1 -- 172.21.15.87:0/1400452018 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6454006070 con 0x55dec4f1d2d0 2024-05-08T18:31:18.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.651+0000 7f634fe07640 1 -- 172.21.15.87:0/1400452018 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645400e890 con 0x55dec4f1d2d0 2024-05-08T18:31:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.651+0000 7f6466129800 1 -- 172.21.15.87:0/1400452018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f1d2d0 msgr2=0x55dec500e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.651+0000 7f6466129800 1 --2- 172.21.15.87:0/1400452018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f1d2d0 0x55dec500e6c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f645400b230 tx=0x7f645400b6f0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.651+0000 7f6466129800 1 -- 172.21.15.87:0/1400452018 shutdown_connections 2024-05-08T18:31:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.651+0000 7f6466129800 1 --2- 172.21.15.87:0/1400452018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f1d2d0 0x55dec500e6c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.651+0000 7f6466129800 1 -- 172.21.15.87:0/1400452018 >> 172.21.15.87:0/1400452018 conn(0x55dec4f18850 msgr2=0x55dec5009fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.651+0000 7f6466129800 1 -- 172.21.15.87:0/1400452018 shutdown_connections 2024-05-08T18:31:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.651+0000 7f6466129800 1 -- 172.21.15.87:0/1400452018 wait complete. 2024-05-08T18:31:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.652+0000 7f6466129800 1 Processor -- start 2024-05-08T18:31:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.652+0000 7f6466129800 1 -- start start 2024-05-08T18:31:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.652+0000 7f6466129800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f1d2d0 0x55dec5016260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.652+0000 7f6466129800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dec4f24550 con 0x55dec4f1d2d0 2024-05-08T18:31:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.652+0000 7f6461ee4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f1d2d0 0x55dec5016260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.652+0000 7f6461ee4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f1d2d0 0x55dec5016260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33108/0 (socket says 172.21.15.87:33108) 2024-05-08T18:31:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.652+0000 7f6461ee4640 1 -- 172.21.15.87:0/3071943393 learned_addr learned my addr 172.21.15.87:0/3071943393 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.652+0000 7f6461ee4640 1 -- 172.21.15.87:0/3071943393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dec50167a0 con 0x55dec4f1d2d0 2024-05-08T18:31:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.653+0000 7f6461ee4640 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f1d2d0 0x55dec5016260 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6454000c00 tx=0x7f6454000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.653+0000 7f634e604640 1 -- 172.21.15.87:0/3071943393 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645400f8d0 con 0x55dec4f1d2d0 2024-05-08T18:31:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.653+0000 7f634e604640 1 -- 172.21.15.87:0/3071943393 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f645400fa90 con 0x55dec4f1d2d0 2024-05-08T18:31:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.653+0000 7f6466129800 1 -- 172.21.15.87:0/3071943393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dec5016a30 con 0x55dec4f1d2d0 2024-05-08T18:31:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.653+0000 7f634e604640 1 -- 172.21.15.87:0/3071943393 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645400fdb0 con 0x55dec4f1d2d0 2024-05-08T18:31:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.653+0000 7f6466129800 1 -- 172.21.15.87:0/3071943393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dec50196e0 con 0x55dec4f1d2d0 2024-05-08T18:31:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.654+0000 7f634e604640 1 -- 172.21.15.87:0/3071943393 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6454017070 con 0x55dec4f1d2d0 2024-05-08T18:31:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.654+0000 7f634e604640 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f634803bb50 0x7f634803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.654+0000 7f634e604640 1 -- 172.21.15.87:0/3071943393 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6454015020 con 0x55dec4f1d2d0 2024-05-08T18:31:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.654+0000 7f64616e3640 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f634803bb50 0x7f634803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.654+0000 7f6466129800 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dec4f216c0 0x55dec501d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.654+0000 7f6466129800 1 -- 172.21.15.87:0/3071943393 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec501da20 con 0x55dec4f216c0 2024-05-08T18:31:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.654+0000 7f64626e5640 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dec4f216c0 0x55dec501d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.654+0000 7f64616e3640 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f634803bb50 0x7f634803e010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6458054000 tx=0x7f645804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.654+0000 7f64626e5640 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dec4f216c0 0x55dec501d4a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.655+0000 7f64626e5640 1 -- 172.21.15.87:0/3071943393 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f645c00a4a0 con 0x55dec4f216c0 2024-05-08T18:31:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.655+0000 7f6466129800 1 -- 172.21.15.87:0/3071943393 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec501aa70 con 0x55dec4f216c0 2024-05-08T18:31:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.655+0000 7f64626e5640 1 -- 172.21.15.87:0/3071943393 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f645c00a4a0 con 0x55dec4f216c0 2024-05-08T18:31:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.655+0000 7f6466129800 1 -- 172.21.15.87:0/3071943393 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec501f840 con 0x55dec4f216c0 2024-05-08T18:31:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.655+0000 7f64626e5640 1 -- 172.21.15.87:0/3071943393 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f645c00a4a0 con 0x55dec4f216c0 2024-05-08T18:31:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.655+0000 7f6466129800 1 -- 172.21.15.87:0/3071943393 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec501ea70 con 0x55dec4f216c0 2024-05-08T18:31:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.655+0000 7f64626e5640 1 -- 172.21.15.87:0/3071943393 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f645c00a4a0 con 0x55dec4f216c0 2024-05-08T18:31:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.655+0000 7f6466129800 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55dec5020bf0 0x55dec5022fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.655+0000 7f6466129800 1 -- 172.21.15.87:0/3071943393 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec5023520 con 0x55dec5020bf0 2024-05-08T18:31:18.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.656+0000 7f6461ee4640 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55dec5020bf0 0x55dec5022fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.656+0000 7f6461ee4640 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55dec5020bf0 0x55dec5022fe0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.656+0000 7f6461ee4640 1 -- 172.21.15.87:0/3071943393 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f645402e070 con 0x55dec5020bf0 2024-05-08T18:31:18.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.657+0000 7f6466129800 1 Processor -- start 2024-05-08T18:31:18.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.657+0000 7f6466129800 1 -- start start 2024-05-08T18:31:18.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.657+0000 7f6466129800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec5031760 0x55dec5031b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.657+0000 7f6466129800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dec4e0efc0 con 0x55dec5031760 2024-05-08T18:31:18.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.657+0000 7f64626e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec5031760 0x55dec5031b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.657+0000 7f64626e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec5031760 0x55dec5031b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33120/0 (socket says 172.21.15.87:33120) 2024-05-08T18:31:18.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.657+0000 7f64626e5640 1 -- 172.21.15.87:0/4077188302 learned_addr learned my addr 172.21.15.87:0/4077188302 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.657+0000 7f64626e5640 1 -- 172.21.15.87:0/4077188302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dec50320c0 con 0x55dec5031760 2024-05-08T18:31:18.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.658+0000 7f64626e5640 1 --2- 172.21.15.87:0/4077188302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec5031760 0x55dec5031b80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55dec5017660 tx=0x7f645c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.658+0000 7f63477fe640 1 -- 172.21.15.87:0/4077188302 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645c013440 con 0x55dec5031760 2024-05-08T18:31:18.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.658+0000 7f63477fe640 1 -- 172.21.15.87:0/4077188302 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f645c0135e0 con 0x55dec5031760 2024-05-08T18:31:18.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.658+0000 7f6466129800 1 -- 172.21.15.87:0/4077188302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dec5032b30 con 0x55dec5031760 2024-05-08T18:31:18.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.658+0000 7f63477fe640 1 -- 172.21.15.87:0/4077188302 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645c0138c0 con 0x55dec5031760 2024-05-08T18:31:18.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.658+0000 7f6466129800 1 -- 172.21.15.87:0/4077188302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dec5033030 con 0x55dec5031760 2024-05-08T18:31:18.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.659+0000 7f63477fe640 1 -- 172.21.15.87:0/4077188302 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f645c011040 con 0x55dec5031760 2024-05-08T18:31:18.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.659+0000 7f63477fe640 1 --2- 172.21.15.87:0/4077188302 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f633c03bba0 0x7f633c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.659+0000 7f63477fe640 1 -- 172.21.15.87:0/4077188302 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f645c01d070 con 0x55dec5031760 2024-05-08T18:31:18.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.659+0000 7f6461ee4640 1 --2- 172.21.15.87:0/4077188302 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f633c03bba0 0x7f633c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.659+0000 7f6466129800 1 Processor -- start 2024-05-08T18:31:18.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.659+0000 7f6461ee4640 1 --2- 172.21.15.87:0/4077188302 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f633c03bba0 0x7f633c03e060 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6454051950 tx=0x7f6454001540 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.659+0000 7f6466129800 1 -- start start 2024-05-08T18:31:18.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.659+0000 7f6466129800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec503eab0 0x55dec503eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.659+0000 7f6466129800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dec500f010 con 0x55dec503eab0 2024-05-08T18:31:18.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.659+0000 7f64626e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec503eab0 0x55dec503eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.659+0000 7f64626e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec503eab0 0x55dec503eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33134/0 (socket says 172.21.15.87:33134) 2024-05-08T18:31:18.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.659+0000 7f64626e5640 1 -- 172.21.15.87:0/1058377196 learned_addr learned my addr 172.21.15.87:0/1058377196 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.660+0000 7f64626e5640 1 -- 172.21.15.87:0/1058377196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dec503f4a0 con 0x55dec503eab0 2024-05-08T18:31:18.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.660+0000 7f64626e5640 1 --2- 172.21.15.87:0/1058377196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec503eab0 0x55dec503eed0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f645c0103f0 tx=0x7f645c029430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c381ba5965dec1c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.660+0000 7f63457fa640 1 -- 172.21.15.87:0/1058377196 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645c0540d0 con 0x55dec503eab0 2024-05-08T18:31:18.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.660+0000 7f63457fa640 1 -- 172.21.15.87:0/1058377196 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f645c054270 con 0x55dec503eab0 2024-05-08T18:31:18.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.660+0000 7f63457fa640 1 -- 172.21.15.87:0/1058377196 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645c001640 con 0x55dec503eab0 2024-05-08T18:31:18.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.660+0000 7f6466129800 1 -- 172.21.15.87:0/1058377196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec503eab0 msgr2=0x55dec503eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.660+0000 7f6466129800 1 --2- 172.21.15.87:0/1058377196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec503eab0 0x55dec503eed0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f645c0103f0 tx=0x7f645c029430 comp rx=0 tx=0).stop 2024-05-08T18:31:18.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.660+0000 7f6466129800 1 -- 172.21.15.87:0/1058377196 shutdown_connections 2024-05-08T18:31:18.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.660+0000 7f6466129800 1 --2- 172.21.15.87:0/1058377196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec503eab0 0x55dec503eed0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.660+0000 7f6466129800 1 -- 172.21.15.87:0/1058377196 >> 172.21.15.87:0/1058377196 conn(0x55dec503ad80 msgr2=0x55dec5038de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.660+0000 7f6466129800 1 -- 172.21.15.87:0/1058377196 shutdown_connections 2024-05-08T18:31:18.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.660+0000 7f6466129800 1 -- 172.21.15.87:0/1058377196 wait complete. 2024-05-08T18:31:18.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.661+0000 7f6466129800 1 Processor -- start 2024-05-08T18:31:18.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.661+0000 7f6466129800 1 -- start start 2024-05-08T18:31:18.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.661+0000 7f6466129800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec503eab0 0x55dec5045ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.661+0000 7f6466129800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dec503fc60 con 0x55dec503eab0 2024-05-08T18:31:18.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.661+0000 7f64626e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec503eab0 0x55dec5045ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.661+0000 7f64626e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec503eab0 0x55dec5045ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33150/0 (socket says 172.21.15.87:33150) 2024-05-08T18:31:18.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.661+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 learned_addr learned my addr 172.21.15.87:0/3455261082 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.661+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dec5046530 con 0x55dec503eab0 2024-05-08T18:31:18.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.662+0000 7f64626e5640 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec503eab0 0x55dec5045ff0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f645c04d010 tx=0x7f645c0528f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.662+0000 7f63337fe640 1 -- 172.21.15.87:0/3455261082 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645c030020 con 0x55dec503eab0 2024-05-08T18:31:18.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.662+0000 7f63337fe640 1 -- 172.21.15.87:0/3455261082 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f645c015ad0 con 0x55dec503eab0 2024-05-08T18:31:18.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.662+0000 7f63337fe640 1 -- 172.21.15.87:0/3455261082 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645c015430 con 0x55dec503eab0 2024-05-08T18:31:18.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.662+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dec50467c0 con 0x55dec503eab0 2024-05-08T18:31:18.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.662+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dec5049470 con 0x55dec503eab0 2024-05-08T18:31:18.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.662+0000 7f63337fe640 1 -- 172.21.15.87:0/3455261082 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f645c033020 con 0x55dec503eab0 2024-05-08T18:31:18.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.663+0000 7f63337fe640 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f632c03bab0 0x7f632c03df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.663+0000 7f63337fe640 1 -- 172.21.15.87:0/3455261082 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f645c00e040 con 0x55dec503eab0 2024-05-08T18:31:18.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.663+0000 7f6461ee4640 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f632c03bab0 0x7f632c03df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.663+0000 7f6461ee4640 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f632c03bab0 0x7f632c03df70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f645400ff70 tx=0x7f6454042000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.663+0000 7f6466129800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.663+0000 7f6466129800 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dec5051b90 0x55dec5054050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.663+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec50547a0 con 0x55dec5051b90 2024-05-08T18:31:18.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.663+0000 7f64616e3640 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dec5051b90 0x55dec5054050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.664+0000 7f64616e3640 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dec5051b90 0x55dec5054050 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.664+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.664+0000 7f6466129800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.664+0000 7f6466129800 20 realm 2024-05-08T18:31:18.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.664+0000 7f6466129800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.664+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec5054b70 con 0x55dec5051b90 2024-05-08T18:31:18.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.664+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.664+0000 7f6466129800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.664+0000 7f6466129800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:18.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.664+0000 7f6466129800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.664+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec5055440 con 0x55dec5051b90 2024-05-08T18:31:18.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.664+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.664+0000 7f6466129800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.664+0000 7f6466129800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.664+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec50557e0 con 0x55dec5051b90 2024-05-08T18:31:18.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.665+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.665+0000 7f6466129800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:18.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.665+0000 7f6466129800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.665+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec5056030 con 0x55dec5051b90 2024-05-08T18:31:18.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.665+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.665+0000 7f6466129800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:18.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.665+0000 7f6466129800 20 searching for the correct realm 2024-05-08T18:31:18.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.665+0000 7f6466129800 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55dec5057da0 0x55dec505a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.665+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x55dec5057da0 2024-05-08T18:31:18.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.665+0000 7f64626e5640 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55dec5057da0 0x55dec505a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.665+0000 7f64626e5640 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55dec5057da0 0x55dec505a190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.666+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c029070 con 0x55dec5057da0 2024-05-08T18:31:18.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.666+0000 7f64626e5640 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f645c035020 0x7f645c004600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.666+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x7f645c035020 2024-05-08T18:31:18.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.666+0000 7f6461ee4640 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f645c035020 0x7f645c004600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.666+0000 7f6461ee4640 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f645c035020 0x7f645c004600 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.666+0000 7f6461ee4640 1 -- 172.21.15.87:0/3455261082 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6454044d70 con 0x7f645c035020 2024-05-08T18:31:18.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.667+0000 7f6461ee4640 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f645400f070 0x7f645404a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.667+0000 7f6461ee4640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x7f645400f070 2024-05-08T18:31:18.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.667+0000 7f64616e3640 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f645400f070 0x7f645404a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.667+0000 7f64616e3640 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f645400f070 0x7f645404a760 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.667+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.667+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x55dec5051b90 2024-05-08T18:31:18.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.668+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.668+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x55dec5051b90 2024-05-08T18:31:18.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.668+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.668+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x7f645400f070 2024-05-08T18:31:18.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.668+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.668+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x7f645400f070 2024-05-08T18:31:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.668+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.668+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x7f645c035020 2024-05-08T18:31:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.669+0000 7f6461ee4640 1 -- 172.21.15.87:0/3455261082 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6454044d70 con 0x7f645c035020 2024-05-08T18:31:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.669+0000 7f6461ee4640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x55dec5057da0 2024-05-08T18:31:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.669+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c029070 con 0x55dec5057da0 2024-05-08T18:31:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.669+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x55dec5051b90 2024-05-08T18:31:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.669+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.669+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x7f645400f070 2024-05-08T18:31:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.669+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.669+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x55dec5051b90 2024-05-08T18:31:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.670+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.670+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x7f645c035020 2024-05-08T18:31:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.670+0000 7f6461ee4640 1 -- 172.21.15.87:0/3455261082 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6454044d70 con 0x7f645c035020 2024-05-08T18:31:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.670+0000 7f6461ee4640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x55dec5057da0 2024-05-08T18:31:18.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.670+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c061040 con 0x55dec5057da0 2024-05-08T18:31:18.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.670+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x55dec5057da0 2024-05-08T18:31:18.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.670+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c061040 con 0x55dec5057da0 2024-05-08T18:31:18.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.670+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x7f645400f070 2024-05-08T18:31:18.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.671+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.671+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x55dec5057da0 2024-05-08T18:31:18.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.671+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c061040 con 0x55dec5057da0 2024-05-08T18:31:18.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.671+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x55dec5057da0 2024-05-08T18:31:18.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.671+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c061040 con 0x55dec5057da0 2024-05-08T18:31:18.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.671+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x55dec5051b90 2024-05-08T18:31:18.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.671+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.671+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x55dec5051b90 2024-05-08T18:31:18.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.672+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.672+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x7f645400f070 2024-05-08T18:31:18.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.672+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.672+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x55dec5057da0 2024-05-08T18:31:18.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.672+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c061040 con 0x55dec5057da0 2024-05-08T18:31:18.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.672+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x7f645c035020 2024-05-08T18:31:18.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.673+0000 7f6461ee4640 1 -- 172.21.15.87:0/3455261082 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6454044d70 con 0x7f645c035020 2024-05-08T18:31:18.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.673+0000 7f6461ee4640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x55dec5051b90 2024-05-08T18:31:18.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.673+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.673+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x7f645400f070 2024-05-08T18:31:18.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.673+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.673+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x55dec5057da0 2024-05-08T18:31:18.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.673+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c061040 con 0x55dec5057da0 2024-05-08T18:31:18.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.673+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x7f645400f070 2024-05-08T18:31:18.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.674+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.674+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x7f645c035020 2024-05-08T18:31:18.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.674+0000 7f6461ee4640 1 -- 172.21.15.87:0/3455261082 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6454044d70 con 0x7f645c035020 2024-05-08T18:31:18.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.674+0000 7f6461ee4640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x55dec5057da0 2024-05-08T18:31:18.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.674+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c061040 con 0x55dec5057da0 2024-05-08T18:31:18.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.674+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x7f645400f070 2024-05-08T18:31:18.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.674+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.674+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x55dec5051b90 2024-05-08T18:31:18.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dec505a720 con 0x7f645c035020 2024-05-08T18:31:18.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f6461ee4640 1 -- 172.21.15.87:0/3455261082 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6454044d70 con 0x7f645c035020 2024-05-08T18:31:18.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f6466129800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:18.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f6466129800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:18.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f6466129800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:18.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f6466129800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:18.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f6466129800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:18.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f6466129800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:18.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f6466129800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec5056980 con 0x55dec5051b90 2024-05-08T18:31:18.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f6466129800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f6466129800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec5057220 con 0x55dec5051b90 2024-05-08T18:31:18.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f6466129800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:18.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f6466129800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.675+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec505aba0 con 0x7f645400f070 2024-05-08T18:31:18.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.676+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.676+0000 7f6466129800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:18.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.676+0000 7f6466129800 20 zone default found 2024-05-08T18:31:18.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.676+0000 7f6466129800 4 Realm: () 2024-05-08T18:31:18.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.676+0000 7f6466129800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:18.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.676+0000 7f6466129800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:18.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.676+0000 7f6466129800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:18.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.676+0000 7f6466129800 20 zonegroup default 2024-05-08T18:31:18.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.676+0000 7f6466129800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.676+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec505b050 con 0x7f645400f070 2024-05-08T18:31:18.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.676+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.676+0000 7f6466129800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.676+0000 7f6466129800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.676+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec505ca30 con 0x55dec5057da0 2024-05-08T18:31:18.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.676+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f645c061040 con 0x55dec5057da0 2024-05-08T18:31:18.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.677+0000 7f6466129800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.677+0000 7f6466129800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.677+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec505ced0 con 0x55dec5057da0 2024-05-08T18:31:18.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.677+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f645c061040 con 0x55dec5057da0 2024-05-08T18:31:18.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.677+0000 7f6466129800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.677+0000 7f6466129800 20 started sync module instance, tier type = 2024-05-08T18:31:18.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.677+0000 7f6466129800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:18.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.677+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec505bec0 con 0x7f645c035020 2024-05-08T18:31:18.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.678+0000 7f6461ee4640 1 -- 172.21.15.87:0/3455261082 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6454044d70 con 0x7f645c035020 2024-05-08T18:31:18.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.678+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94415276589744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec505d7e0 con 0x7f645c035020 2024-05-08T18:31:18.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.678+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec505e030 con 0x55dec5051b90 2024-05-08T18:31:18.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.679+0000 7f6461ee4640 1 -- 172.21.15.87:0/3455261082 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94415276589744] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6454044d70 con 0x7f645c035020 2024-05-08T18:31:18.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.679+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.679+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94415276593968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec505e090 con 0x55dec5051b90 2024-05-08T18:31:18.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.679+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec505eba0 con 0x55dec5057da0 2024-05-08T18:31:18.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.680+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645c061040 con 0x55dec5057da0 2024-05-08T18:31:18.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.680+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94415276598864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec505f440 con 0x55dec5057da0 2024-05-08T18:31:18.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.680+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec505ff40 con 0x7f645c035020 2024-05-08T18:31:18.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.680+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94415276593968] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.682+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94415276598864] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645c061040 con 0x55dec5057da0 2024-05-08T18:31:18.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.682+0000 7f6461ee4640 1 -- 172.21.15.87:0/3455261082 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6454044d70 con 0x7f645c035020 2024-05-08T18:31:18.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.682+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94415276596096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec505f440 con 0x7f645c035020 2024-05-08T18:31:18.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.682+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec5060820 con 0x55dec5051b90 2024-05-08T18:31:18.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.683+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.684+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94415276606256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec50610c0 con 0x55dec5051b90 2024-05-08T18:31:18.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.684+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec5061b60 con 0x7f645400f070 2024-05-08T18:31:18.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.684+0000 7f6461ee4640 1 -- 172.21.15.87:0/3455261082 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94415276596096] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6454044d70 con 0x7f645c035020 2024-05-08T18:31:18.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.685+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94415276606256] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.685+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.685+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94415276611120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec5060bc0 con 0x7f645400f070 2024-05-08T18:31:18.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.685+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec5062400 con 0x7f645400f070 2024-05-08T18:31:18.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.686+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(56 notify.6 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.686+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94415276608368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec5062400 con 0x7f645400f070 2024-05-08T18:31:18.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.686+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec5062f20 con 0x7f645400f070 2024-05-08T18:31:18.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.686+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94415276611120] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.687+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94415276608368] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.687+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.687+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94415276616176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec5061f00 con 0x7f645400f070 2024-05-08T18:31:18.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.687+0000 7f6466129800 20 add_watcher() i=0 2024-05-08T18:31:18.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.687+0000 7f6466129800 20 add_watcher() i=1 2024-05-08T18:31:18.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.687+0000 7f6466129800 20 add_watcher() i=2 2024-05-08T18:31:18.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.687+0000 7f6466129800 20 add_watcher() i=3 2024-05-08T18:31:18.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.687+0000 7f6466129800 20 add_watcher() i=4 2024-05-08T18:31:18.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.687+0000 7f6466129800 20 add_watcher() i=5 2024-05-08T18:31:18.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.687+0000 7f6466129800 20 add_watcher() i=6 2024-05-08T18:31:18.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.688+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94415276616176] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.688+0000 7f6466129800 20 add_watcher() i=7 2024-05-08T18:31:18.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.688+0000 7f6466129800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:18.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.688+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec50623e0 con 0x55dec5051b90 2024-05-08T18:31:18.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.688+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.688+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94415276601232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec50623e0 con 0x55dec5051b90 2024-05-08T18:31:18.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.689+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94415276601232] v27'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.689+0000 7f63137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:18.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.690+0000 7f6466129800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:18.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.690+0000 7f6466129800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:18.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.690+0000 7f6466129800 5 note: GC not initialized 2024-05-08T18:31:18.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.690+0000 7f63127fc640 20 reqs_thread_entry: start 2024-05-08T18:31:18.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.690+0000 7f6466129800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:18.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.690+0000 7f6466129800 20 Filter name: none 2024-05-08T18:31:18.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.690+0000 7f6283fff640 20 reqs_thread_entry: start 2024-05-08T18:31:18.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.690+0000 7f6466129800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:18.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.690+0000 7f6466129800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.690+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec5099240 con 0x55dec5051b90 2024-05-08T18:31:18.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.691+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.691+0000 7f6466129800 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T18:31:18.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.691+0000 7f6466129800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:18.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.691+0000 7f6466129800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:18.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.691+0000 7f6466129800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:18.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.691+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec509f910 con 0x55dec5051b90 2024-05-08T18:31:18.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.692+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v27'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.692+0000 7f6466129800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:18.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.692+0000 7f6466129800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:18.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.692+0000 7f6466129800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:31:18.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.692+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94415276864208 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dec509af70 con 0x55dec5051b90 2024-05-08T18:31:18.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.692+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== watch-notify(notify (1) cookie 94415276606256 notify 115964116998 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55dec4f252b0 con 0x55dec5051b90 2024-05-08T18:31:18.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.692+0000 7f63457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116998 cookie 94415276606256 notifier 4361 bl.length()=732 2024-05-08T18:31:18.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.692+0000 7f63457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:18.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.692+0000 7f63457fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:18.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.692+0000 7f63457fa640 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f6324003ea0 con 0x55dec5051b90 2024-05-08T18:31:18.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.692+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(64 notify.4 [notify cookie 94415276864208 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.692+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== watch-notify(notify_complete (2) cookie 94415276864208 notify 115964116998 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f645805d9f0 con 0x55dec5051b90 2024-05-08T18:31:18.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.692+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.702 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:18.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.693+0000 7f63137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:18.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.693+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94415276601232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec509aac0 con 0x55dec5051b90 2024-05-08T18:31:18.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.694+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94415276601232] v27'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.694+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94415276589744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec509af70 con 0x7f645c035020 2024-05-08T18:31:18.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.697+0000 7f6461ee4640 1 -- 172.21.15.87:0/3455261082 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94415276589744] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6454044d70 con 0x7f645c035020 2024-05-08T18:31:18.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.697+0000 7f6466129800 20 remove_watcher() i=0 2024-05-08T18:31:18.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.697+0000 7f6466129800 2 removed watcher, disabling cache 2024-05-08T18:31:18.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.697+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94415276593968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec505c2b0 con 0x55dec5051b90 2024-05-08T18:31:18.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.698+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94415276593968] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.698+0000 7f6466129800 20 remove_watcher() i=1 2024-05-08T18:31:18.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.698+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94415276598864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec505d330 con 0x55dec5057da0 2024-05-08T18:31:18.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.699+0000 7f64626e5640 1 -- 172.21.15.87:0/3455261082 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94415276598864] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645c061040 con 0x55dec5057da0 2024-05-08T18:31:18.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.699+0000 7f6466129800 20 remove_watcher() i=2 2024-05-08T18:31:18.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.699+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94415276596096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec505c2b0 con 0x7f645c035020 2024-05-08T18:31:18.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.700+0000 7f6461ee4640 1 -- 172.21.15.87:0/3455261082 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94415276596096] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6454044d70 con 0x7f645c035020 2024-05-08T18:31:18.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.700+0000 7f6466129800 20 remove_watcher() i=3 2024-05-08T18:31:18.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.700+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94415276606256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec505d330 con 0x55dec5051b90 2024-05-08T18:31:18.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.701+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94415276606256] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645805a040 con 0x55dec5051b90 2024-05-08T18:31:18.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.701+0000 7f6466129800 20 remove_watcher() i=4 2024-05-08T18:31:18.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.701+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94415276611120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec505db80 con 0x7f645400f070 2024-05-08T18:31:18.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.702+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94415276611120] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.702+0000 7f6466129800 20 remove_watcher() i=5 2024-05-08T18:31:18.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.702+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94415276608368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec505c2b0 con 0x7f645400f070 2024-05-08T18:31:18.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.703+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94415276608368] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.703+0000 7f6466129800 20 remove_watcher() i=6 2024-05-08T18:31:18.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.703+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94415276616176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dec505d330 con 0x7f645400f070 2024-05-08T18:31:18.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.704+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94415276616176] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645805a040 con 0x7f645400f070 2024-05-08T18:31:18.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.704+0000 7f6466129800 20 remove_watcher() i=7 2024-05-08T18:31:18.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.704+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f645400f070 msgr2=0x7f645404a760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.704+0000 7f6466129800 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f645400f070 0x7f645404a760 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.704+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dec5051b90 msgr2=0x55dec5054050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.704+0000 7f6466129800 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dec5051b90 0x55dec5054050 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.704+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f645c035020 msgr2=0x7f645c004600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.704+0000 7f6466129800 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f645c035020 0x7f645c004600 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55dec5057da0 msgr2=0x55dec505a190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55dec5057da0 0x55dec505a190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f632c03bab0 msgr2=0x7f632c03df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f632c03bab0 0x7f632c03df70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f645400ff70 tx=0x7f6454042000 comp rx=0 tx=0).stop 2024-05-08T18:31:18.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec503eab0 msgr2=0x55dec5045ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec503eab0 0x55dec5045ff0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f645c04d010 tx=0x7f645c0528f0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f64616e3640 1 -- 172.21.15.87:0/3455261082 reap_dead start 2024-05-08T18:31:18.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 shutdown_connections 2024-05-08T18:31:18.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 --2- 172.21.15.87:0/3455261082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec503eab0 0x55dec5045ff0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 >> 172.21.15.87:0/3455261082 conn(0x55dec503ad80 msgr2=0x55dec5038db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 shutdown_connections 2024-05-08T18:31:18.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 -- 172.21.15.87:0/3455261082 wait complete. 2024-05-08T18:31:18.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 -- 172.21.15.87:0/4077188302 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f633c03bba0 msgr2=0x7f633c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 --2- 172.21.15.87:0/4077188302 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f633c03bba0 0x7f633c03e060 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6454051950 tx=0x7f6454001540 comp rx=0 tx=0).stop 2024-05-08T18:31:18.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 -- 172.21.15.87:0/4077188302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec5031760 msgr2=0x55dec5031b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 --2- 172.21.15.87:0/4077188302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec5031760 0x55dec5031b80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55dec5017660 tx=0x7f645c0178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 -- 172.21.15.87:0/4077188302 shutdown_connections 2024-05-08T18:31:18.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 --2- 172.21.15.87:0/4077188302 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f633c03bba0 0x7f633c03e060 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 --2- 172.21.15.87:0/4077188302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec5031760 0x55dec5031b80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 -- 172.21.15.87:0/4077188302 >> 172.21.15.87:0/4077188302 conn(0x55dec5025800 msgr2=0x55dec5025c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 -- 172.21.15.87:0/4077188302 shutdown_connections 2024-05-08T18:31:18.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 -- 172.21.15.87:0/4077188302 wait complete. 2024-05-08T18:31:18.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 -- 172.21.15.87:0/3071943393 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55dec5020bf0 msgr2=0x55dec5022fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.705+0000 7f6466129800 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55dec5020bf0 0x55dec5022fe0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.706+0000 7f6466129800 1 -- 172.21.15.87:0/3071943393 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dec4f216c0 msgr2=0x55dec501d4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.706+0000 7f6466129800 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dec4f216c0 0x55dec501d4a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.706+0000 7f6466129800 1 -- 172.21.15.87:0/3071943393 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f634803bb50 msgr2=0x7f634803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.706+0000 7f6466129800 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f634803bb50 0x7f634803e010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6458054000 tx=0x7f645804e000 comp rx=0 tx=0).stop 2024-05-08T18:31:18.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.706+0000 7f6466129800 1 -- 172.21.15.87:0/3071943393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f1d2d0 msgr2=0x55dec5016260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.706+0000 7f6466129800 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f1d2d0 0x55dec5016260 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6454000c00 tx=0x7f6454000ed0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.706+0000 7f6466129800 1 -- 172.21.15.87:0/3071943393 shutdown_connections 2024-05-08T18:31:18.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.706+0000 7f6466129800 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dec4f216c0 0x55dec501d4a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.706+0000 7f6466129800 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55dec5020bf0 0x55dec5022fe0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.706+0000 7f6466129800 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f634803bb50 0x7f634803e010 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.706+0000 7f6466129800 1 --2- 172.21.15.87:0/3071943393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dec4f1d2d0 0x55dec5016260 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.706+0000 7f6466129800 1 -- 172.21.15.87:0/3071943393 >> 172.21.15.87:0/3071943393 conn(0x55dec4f18850 msgr2=0x55dec50087e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.706+0000 7f6466129800 1 -- 172.21.15.87:0/3071943393 shutdown_connections 2024-05-08T18:31:18.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.706+0000 7f6466129800 1 -- 172.21.15.87:0/3071943393 wait complete. 2024-05-08T18:31:18.715 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:18.715 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:31:18.715 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:31:18.715 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:31:18.759 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:18.759 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:18.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.761+0000 7f8c76d22800 1 Processor -- start 2024-05-08T18:31:18.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.762+0000 7f8c76d22800 1 -- start start 2024-05-08T18:31:18.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.762+0000 7f8c76d22800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562091923860 0x562091925c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.762+0000 7f8c76d22800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562091926190 con 0x56209191fd50 2024-05-08T18:31:18.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.762+0000 7f8c76d22800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5620917bfe20 con 0x562091923860 2024-05-08T18:31:18.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.762+0000 7f8c6a162640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562091923860 0x562091925c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.762+0000 7f8c72963640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56209191fd50 0x562091922140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41972/0 (socket says 172.21.15.87:41972) 2024-05-08T18:31:18.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.762+0000 7f8c6a162640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562091923860 0x562091925c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33160/0 (socket says 172.21.15.87:33160) 2024-05-08T18:31:18.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.762+0000 7f8c72963640 1 -- 172.21.15.87:0/517435237 learned_addr learned my addr 172.21.15.87:0/517435237 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:18.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.762+0000 7f8c6a162640 1 -- 172.21.15.87:0/517435237 >> v1:172.21.15.53:6789/0 conn(0x56209191fd50 legacy=0x562091922140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.762+0000 7f8c6a162640 1 -- 172.21.15.87:0/517435237 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562091927370 con 0x562091923860 2024-05-08T18:31:18.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.764+0000 7f8c6a162640 1 --2- 172.21.15.87:0/517435237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091923860 0x562091925c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00a470 tx=0x7f8c5c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13aaae8286a38f0c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.764+0000 7f8c72162640 1 -- 172.21.15.87:0/517435237 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c5c057070 con 0x562091923860 2024-05-08T18:31:18.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.764+0000 7f8c72162640 1 -- 172.21.15.87:0/517435237 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c5c052570 con 0x562091923860 2024-05-08T18:31:18.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.764+0000 7f8c72162640 1 -- 172.21.15.87:0/517435237 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c5c052870 con 0x562091923860 2024-05-08T18:31:18.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.765+0000 7f8c76d22800 1 -- 172.21.15.87:0/517435237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091923860 msgr2=0x562091925c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.765+0000 7f8c76d22800 1 --2- 172.21.15.87:0/517435237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091923860 0x562091925c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00a470 tx=0x7f8c5c01ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:18.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.765+0000 7f8c76d22800 1 -- 172.21.15.87:0/517435237 shutdown_connections 2024-05-08T18:31:18.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.765+0000 7f8c76d22800 1 --2- 172.21.15.87:0/517435237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091923860 0x562091925c50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.765+0000 7f8c76d22800 1 -- 172.21.15.87:0/517435237 >> 172.21.15.87:0/517435237 conn(0x5620919196a0 msgr2=0x56209191bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.765+0000 7f8c76d22800 1 -- 172.21.15.87:0/517435237 shutdown_connections 2024-05-08T18:31:18.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.765+0000 7f8c76d22800 1 -- 172.21.15.87:0/517435237 wait complete. 2024-05-08T18:31:18.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.778+0000 7f8c76d22800 1 Processor -- start 2024-05-08T18:31:18.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.778+0000 7f8c76d22800 1 -- start start 2024-05-08T18:31:18.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.778+0000 7f8c76d22800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56209191fd50 0x562091a10670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.779+0000 7f8c76d22800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56209186a5b0 con 0x56209191fd50 2024-05-08T18:31:18.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.779+0000 7f8c72963640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56209191fd50 0x562091a10670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.779+0000 7f8c72963640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56209191fd50 0x562091a10670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33170/0 (socket says 172.21.15.87:33170) 2024-05-08T18:31:18.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.779+0000 7f8c72963640 1 -- 172.21.15.87:0/1506744132 learned_addr learned my addr 172.21.15.87:0/1506744132 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.779+0000 7f8c72963640 1 -- 172.21.15.87:0/1506744132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562091a10c40 con 0x56209191fd50 2024-05-08T18:31:18.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.779+0000 7f8c72963640 1 --2- 172.21.15.87:0/1506744132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56209191fd50 0x562091a10670 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8c64001de0 tx=0x7f8c6400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad84d51f21ac0ac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.779+0000 7f8b60e09640 1 -- 172.21.15.87:0/1506744132 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c64012020 con 0x56209191fd50 2024-05-08T18:31:18.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.779+0000 7f8b60e09640 1 -- 172.21.15.87:0/1506744132 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6400e5a0 con 0x56209191fd50 2024-05-08T18:31:18.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.779+0000 7f8b60e09640 1 -- 172.21.15.87:0/1506744132 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c6400e8c0 con 0x56209191fd50 2024-05-08T18:31:18.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.780+0000 7f8c76d22800 1 -- 172.21.15.87:0/1506744132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56209191fd50 msgr2=0x562091a10670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.780+0000 7f8c76d22800 1 --2- 172.21.15.87:0/1506744132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56209191fd50 0x562091a10670 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8c64001de0 tx=0x7f8c6400b6c0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.780+0000 7f8c76d22800 1 -- 172.21.15.87:0/1506744132 shutdown_connections 2024-05-08T18:31:18.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.780+0000 7f8c76d22800 1 --2- 172.21.15.87:0/1506744132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56209191fd50 0x562091a10670 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.780+0000 7f8c76d22800 1 -- 172.21.15.87:0/1506744132 >> 172.21.15.87:0/1506744132 conn(0x5620919196a0 msgr2=0x562091a0bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.780+0000 7f8c76d22800 1 -- 172.21.15.87:0/1506744132 shutdown_connections 2024-05-08T18:31:18.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.780+0000 7f8c76d22800 1 -- 172.21.15.87:0/1506744132 wait complete. 2024-05-08T18:31:18.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.780+0000 7f8c76d22800 1 Processor -- start 2024-05-08T18:31:18.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.781+0000 7f8c76d22800 1 -- start start 2024-05-08T18:31:18.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.781+0000 7f8c76d22800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56209191fd50 0x56209191f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.781+0000 7f8c76d22800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562091926660 con 0x56209191fd50 2024-05-08T18:31:18.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.781+0000 7f8c72963640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56209191fd50 0x56209191f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.781+0000 7f8c72963640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56209191fd50 0x56209191f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33180/0 (socket says 172.21.15.87:33180) 2024-05-08T18:31:18.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.781+0000 7f8c72963640 1 -- 172.21.15.87:0/1748320191 learned_addr learned my addr 172.21.15.87:0/1748320191 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.781+0000 7f8c72963640 1 -- 172.21.15.87:0/1748320191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56209191fb80 con 0x56209191fd50 2024-05-08T18:31:18.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.781+0000 7f8c72963640 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56209191fd50 0x56209191f640 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400c010 tx=0x7f8c64000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.781+0000 7f8b5f606640 1 -- 172.21.15.87:0/1748320191 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c64012070 con 0x56209191fd50 2024-05-08T18:31:18.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.781+0000 7f8b5f606640 1 -- 172.21.15.87:0/1748320191 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6401a7a0 con 0x56209191fd50 2024-05-08T18:31:18.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.781+0000 7f8c76d22800 1 -- 172.21.15.87:0/1748320191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56209191dd80 con 0x56209191fd50 2024-05-08T18:31:18.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.781+0000 7f8b5f606640 1 -- 172.21.15.87:0/1748320191 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c6401aa80 con 0x56209191fd50 2024-05-08T18:31:18.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.782+0000 7f8c76d22800 1 -- 172.21.15.87:0/1748320191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56209191e2a0 con 0x56209191fd50 2024-05-08T18:31:18.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.782+0000 7f8b5f606640 1 -- 172.21.15.87:0/1748320191 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8c64015020 con 0x56209191fd50 2024-05-08T18:31:18.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.782+0000 7f8b5f606640 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8b5803bba0 0x7f8b5803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.783+0000 7f8b5f606640 1 -- 172.21.15.87:0/1748320191 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8c64020070 con 0x56209191fd50 2024-05-08T18:31:18.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.783+0000 7f8c6a162640 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8b5803bba0 0x7f8b5803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.783+0000 7f8c76d22800 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562091923860 0x562091a21600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.783+0000 7f8c76d22800 1 -- 172.21.15.87:0/1748320191 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562091a21b40 con 0x562091923860 2024-05-08T18:31:18.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.783+0000 7f8c73164640 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562091923860 0x562091a21600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.783+0000 7f8c6a162640 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8b5803bba0 0x7f8b5803e060 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c054000 tx=0x7f8c5c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.783+0000 7f8c73164640 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562091923860 0x562091a21600 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.783+0000 7f8c73164640 1 -- 172.21.15.87:0/1748320191 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c6c00a4a0 con 0x562091923860 2024-05-08T18:31:18.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.783+0000 7f8c76d22800 1 -- 172.21.15.87:0/1748320191 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56209191e7a0 con 0x562091923860 2024-05-08T18:31:18.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.784+0000 7f8c73164640 1 -- 172.21.15.87:0/1748320191 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c6c00a4a0 con 0x562091923860 2024-05-08T18:31:18.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.784+0000 7f8c76d22800 1 -- 172.21.15.87:0/1748320191 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562091a23960 con 0x562091923860 2024-05-08T18:31:18.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.784+0000 7f8c73164640 1 -- 172.21.15.87:0/1748320191 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8c6c00a4a0 con 0x562091923860 2024-05-08T18:31:18.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.784+0000 7f8c76d22800 1 -- 172.21.15.87:0/1748320191 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562091a22b90 con 0x562091923860 2024-05-08T18:31:18.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.784+0000 7f8c73164640 1 -- 172.21.15.87:0/1748320191 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c6c00a4a0 con 0x562091923860 2024-05-08T18:31:18.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.784+0000 7f8c76d22800 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562091a24d10 0x562091a27100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.784+0000 7f8c76d22800 1 -- 172.21.15.87:0/1748320191 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562091a27640 con 0x562091a24d10 2024-05-08T18:31:18.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.784+0000 7f8c72963640 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562091a24d10 0x562091a27100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.785+0000 7f8c72963640 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562091a24d10 0x562091a27100 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.785+0000 7f8c72963640 1 -- 172.21.15.87:0/1748320191 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8c6402b070 con 0x562091a24d10 2024-05-08T18:31:18.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.785+0000 7f8c76d22800 1 Processor -- start 2024-05-08T18:31:18.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.785+0000 7f8c76d22800 1 -- start start 2024-05-08T18:31:18.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.785+0000 7f8c76d22800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a358a0 0x562091a35cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.785+0000 7f8c76d22800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562091810fc0 con 0x562091a358a0 2024-05-08T18:31:18.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.786+0000 7f8c73164640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a358a0 0x562091a35cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.786+0000 7f8c73164640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a358a0 0x562091a35cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33182/0 (socket says 172.21.15.87:33182) 2024-05-08T18:31:18.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.786+0000 7f8c73164640 1 -- 172.21.15.87:0/1523481570 learned_addr learned my addr 172.21.15.87:0/1523481570 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.786+0000 7f8c73164640 1 -- 172.21.15.87:0/1523481570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562091a36200 con 0x562091a358a0 2024-05-08T18:31:18.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.786+0000 7f8c73164640 1 --2- 172.21.15.87:0/1523481570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a358a0 0x562091a35cc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x56209191f380 tx=0x7f8c6c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.786+0000 7f8b5ce01640 1 -- 172.21.15.87:0/1523481570 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c6c013440 con 0x562091a358a0 2024-05-08T18:31:18.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.786+0000 7f8b5ce01640 1 -- 172.21.15.87:0/1523481570 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6c0135e0 con 0x562091a358a0 2024-05-08T18:31:18.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.786+0000 7f8c76d22800 1 -- 172.21.15.87:0/1523481570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562091a36c70 con 0x562091a358a0 2024-05-08T18:31:18.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.786+0000 7f8b5ce01640 1 -- 172.21.15.87:0/1523481570 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c6c0138c0 con 0x562091a358a0 2024-05-08T18:31:18.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.786+0000 7f8c76d22800 1 -- 172.21.15.87:0/1523481570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562091a37170 con 0x562091a358a0 2024-05-08T18:31:18.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.787+0000 7f8b5ce01640 1 -- 172.21.15.87:0/1523481570 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8c6c011040 con 0x562091a358a0 2024-05-08T18:31:18.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.787+0000 7f8b5ce01640 1 --2- 172.21.15.87:0/1523481570 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8b4c03bba0 0x7f8b4c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.787+0000 7f8b5ce01640 1 -- 172.21.15.87:0/1523481570 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8c6c01d070 con 0x562091a358a0 2024-05-08T18:31:18.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.787+0000 7f8c72963640 1 --2- 172.21.15.87:0/1523481570 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8b4c03bba0 0x7f8b4c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.788+0000 7f8c76d22800 1 Processor -- start 2024-05-08T18:31:18.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.788+0000 7f8c72963640 1 --2- 172.21.15.87:0/1523481570 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8b4c03bba0 0x7f8b4c03e060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8c64022b30 tx=0x7f8c64050ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.788+0000 7f8c76d22800 1 -- start start 2024-05-08T18:31:18.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.788+0000 7f8c76d22800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a42bf0 0x562091a43010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.788+0000 7f8c76d22800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562091a10fc0 con 0x562091a42bf0 2024-05-08T18:31:18.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.788+0000 7f8c73164640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a42bf0 0x562091a43010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.788+0000 7f8c73164640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a42bf0 0x562091a43010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33188/0 (socket says 172.21.15.87:33188) 2024-05-08T18:31:18.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.788+0000 7f8c73164640 1 -- 172.21.15.87:0/52426820 learned_addr learned my addr 172.21.15.87:0/52426820 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.788+0000 7f8c73164640 1 -- 172.21.15.87:0/52426820 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562091a435e0 con 0x562091a42bf0 2024-05-08T18:31:18.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.788+0000 7f8c73164640 1 --2- 172.21.15.87:0/52426820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a42bf0 0x562091a43010 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0103f0 tx=0x7f8c6c029430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae227441f77620e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.789+0000 7f8b567fc640 1 -- 172.21.15.87:0/52426820 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c6c02ad80 con 0x562091a42bf0 2024-05-08T18:31:18.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.789+0000 7f8b567fc640 1 -- 172.21.15.87:0/52426820 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6c0014f0 con 0x562091a42bf0 2024-05-08T18:31:18.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.789+0000 7f8b567fc640 1 -- 172.21.15.87:0/52426820 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c6c0157b0 con 0x562091a42bf0 2024-05-08T18:31:18.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.789+0000 7f8c76d22800 1 -- 172.21.15.87:0/52426820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a42bf0 msgr2=0x562091a43010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.789+0000 7f8c76d22800 1 --2- 172.21.15.87:0/52426820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a42bf0 0x562091a43010 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0103f0 tx=0x7f8c6c029430 comp rx=0 tx=0).stop 2024-05-08T18:31:18.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.789+0000 7f8c76d22800 1 -- 172.21.15.87:0/52426820 shutdown_connections 2024-05-08T18:31:18.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.789+0000 7f8c76d22800 1 --2- 172.21.15.87:0/52426820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a42bf0 0x562091a43010 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.789+0000 7f8c76d22800 1 -- 172.21.15.87:0/52426820 >> 172.21.15.87:0/52426820 conn(0x562091a3eec0 msgr2=0x562091a3cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.789+0000 7f8c76d22800 1 -- 172.21.15.87:0/52426820 shutdown_connections 2024-05-08T18:31:18.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.789+0000 7f8c76d22800 1 -- 172.21.15.87:0/52426820 wait complete. 2024-05-08T18:31:18.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.789+0000 7f8c76d22800 1 Processor -- start 2024-05-08T18:31:18.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.789+0000 7f8c76d22800 1 -- start start 2024-05-08T18:31:18.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.790+0000 7f8c76d22800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a42bf0 0x562091a4a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.790+0000 7f8c76d22800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562091a43da0 con 0x562091a42bf0 2024-05-08T18:31:18.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.790+0000 7f8c73164640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a42bf0 0x562091a4a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.790+0000 7f8c73164640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a42bf0 0x562091a4a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33202/0 (socket says 172.21.15.87:33202) 2024-05-08T18:31:18.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.790+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 learned_addr learned my addr 172.21.15.87:0/3520340962 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.790+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562091a4a6c0 con 0x562091a42bf0 2024-05-08T18:31:18.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.790+0000 7f8c73164640 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a42bf0 0x562091a4a180 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c04d010 tx=0x7f8c6c0528f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.790+0000 7f8b54ff9640 1 -- 172.21.15.87:0/3520340962 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c6c030020 con 0x562091a42bf0 2024-05-08T18:31:18.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.790+0000 7f8b54ff9640 1 -- 172.21.15.87:0/3520340962 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6c051310 con 0x562091a42bf0 2024-05-08T18:31:18.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.790+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562091a4a950 con 0x562091a42bf0 2024-05-08T18:31:18.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.790+0000 7f8b54ff9640 1 -- 172.21.15.87:0/3520340962 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c6c013a60 con 0x562091a42bf0 2024-05-08T18:31:18.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.790+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562091a4d600 con 0x562091a42bf0 2024-05-08T18:31:18.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.791+0000 7f8b54ff9640 1 -- 172.21.15.87:0/3520340962 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8c6c033020 con 0x562091a42bf0 2024-05-08T18:31:18.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.791+0000 7f8b54ff9640 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8b3c03bba0 0x7f8b3c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.791+0000 7f8b54ff9640 1 -- 172.21.15.87:0/3520340962 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8c6c00e040 con 0x562091a42bf0 2024-05-08T18:31:18.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.791+0000 7f8c72963640 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8b3c03bba0 0x7f8b3c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.791+0000 7f8c76d22800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.792+0000 7f8c76d22800 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562091a55c70 0x562091a58130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.792+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562091a58880 con 0x562091a55c70 2024-05-08T18:31:18.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.792+0000 7f8c6a162640 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562091a55c70 0x562091a58130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.792+0000 7f8c72963640 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8b3c03bba0 0x7f8b3c03e060 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8c6402cfd0 tx=0x7f8c64047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.792+0000 7f8c6a162640 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562091a55c70 0x562091a58130 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.792+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.792+0000 7f8c76d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.792+0000 7f8c76d22800 20 realm 2024-05-08T18:31:18.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.792+0000 7f8c76d22800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.792+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562091a58c50 con 0x562091a55c70 2024-05-08T18:31:18.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.792+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.792+0000 7f8c76d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.792+0000 7f8c76d22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:18.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.792+0000 7f8c76d22800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.792+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562091a59520 con 0x562091a55c70 2024-05-08T18:31:18.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.793+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.793+0000 7f8c76d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.793+0000 7f8c76d22800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.793+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562091a598c0 con 0x562091a55c70 2024-05-08T18:31:18.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.793+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.793+0000 7f8c76d22800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:18.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.793+0000 7f8c76d22800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.793+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562091a59ce0 con 0x562091a55c70 2024-05-08T18:31:18.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.793+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.793+0000 7f8c76d22800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:18.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.793+0000 7f8c76d22800 20 searching for the correct realm 2024-05-08T18:31:18.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.793+0000 7f8c76d22800 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562091a5bce0 0x562091a5e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.793+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x562091a5bce0 2024-05-08T18:31:18.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.793+0000 7f8c73164640 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562091a5bce0 0x562091a5e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.794+0000 7f8c73164640 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562091a5bce0 0x562091a5e130 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.794+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6c052d70 con 0x562091a5bce0 2024-05-08T18:31:18.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.794+0000 7f8c73164640 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8c6c035020 0x7f8c6c0298c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.794+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x7f8c6c035020 2024-05-08T18:31:18.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.794+0000 7f8c72963640 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8c6c035020 0x7f8c6c0298c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.794+0000 7f8c72963640 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8c6c035020 0x7f8c6c0298c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.795+0000 7f8c72963640 1 -- 172.21.15.87:0/3520340962 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6402b070 con 0x7f8c6c035020 2024-05-08T18:31:18.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.795+0000 7f8c72963640 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8c6403c040 0x7f8c64052a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.795+0000 7f8c72963640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x7f8c6403c040 2024-05-08T18:31:18.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.795+0000 7f8c6a162640 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8c6403c040 0x7f8c64052a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.795+0000 7f8c6a162640 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8c6403c040 0x7f8c64052a80 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.795+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.795+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x562091a55c70 2024-05-08T18:31:18.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.796+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.796+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x562091a55c70 2024-05-08T18:31:18.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.796+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.796+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x7f8c6403c040 2024-05-08T18:31:18.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.796+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.796+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x7f8c6403c040 2024-05-08T18:31:18.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.796+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.796+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x7f8c6c035020 2024-05-08T18:31:18.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.797+0000 7f8c72963640 1 -- 172.21.15.87:0/3520340962 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6402b070 con 0x7f8c6c035020 2024-05-08T18:31:18.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.797+0000 7f8c72963640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x562091a5bce0 2024-05-08T18:31:18.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.797+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6c052d70 con 0x562091a5bce0 2024-05-08T18:31:18.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.797+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x562091a55c70 2024-05-08T18:31:18.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.797+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.797+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x7f8c6403c040 2024-05-08T18:31:18.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.798+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.798+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x562091a55c70 2024-05-08T18:31:18.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.798+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.798+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x7f8c6c035020 2024-05-08T18:31:18.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.798+0000 7f8c72963640 1 -- 172.21.15.87:0/3520340962 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8c6402b070 con 0x7f8c6c035020 2024-05-08T18:31:18.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.798+0000 7f8c72963640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x562091a5bce0 2024-05-08T18:31:18.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.798+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6c052d70 con 0x562091a5bce0 2024-05-08T18:31:18.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.798+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x562091a5bce0 2024-05-08T18:31:18.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.799+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6c052d70 con 0x562091a5bce0 2024-05-08T18:31:18.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.799+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x7f8c6403c040 2024-05-08T18:31:18.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.799+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.799+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x562091a5bce0 2024-05-08T18:31:18.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.799+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6c052d70 con 0x562091a5bce0 2024-05-08T18:31:18.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.799+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x562091a5bce0 2024-05-08T18:31:18.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.799+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6c052d70 con 0x562091a5bce0 2024-05-08T18:31:18.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.799+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x562091a55c70 2024-05-08T18:31:18.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.799+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.799+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x562091a55c70 2024-05-08T18:31:18.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.800+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.800+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x7f8c6403c040 2024-05-08T18:31:18.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.800+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.800+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x562091a5bce0 2024-05-08T18:31:18.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.800+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6c052d70 con 0x562091a5bce0 2024-05-08T18:31:18.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.800+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x7f8c6c035020 2024-05-08T18:31:18.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.800+0000 7f8c72963640 1 -- 172.21.15.87:0/3520340962 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6402b070 con 0x7f8c6c035020 2024-05-08T18:31:18.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.800+0000 7f8c72963640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x562091a55c70 2024-05-08T18:31:18.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.801+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.801+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x7f8c6403c040 2024-05-08T18:31:18.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.801+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.801+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x562091a5bce0 2024-05-08T18:31:18.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.801+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6c052d70 con 0x562091a5bce0 2024-05-08T18:31:18.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.801+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x7f8c6403c040 2024-05-08T18:31:18.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.802+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.802+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x7f8c6c035020 2024-05-08T18:31:18.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.802+0000 7f8c72963640 1 -- 172.21.15.87:0/3520340962 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6402b070 con 0x7f8c6c035020 2024-05-08T18:31:18.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.802+0000 7f8c72963640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x562091a5bce0 2024-05-08T18:31:18.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.802+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6c052d70 con 0x562091a5bce0 2024-05-08T18:31:18.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.802+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x7f8c6403c040 2024-05-08T18:31:18.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.802+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.802+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x562091a55c70 2024-05-08T18:31:18.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562091a5e800 con 0x7f8c6c035020 2024-05-08T18:31:18.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c72963640 1 -- 172.21.15.87:0/3520340962 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6402b070 con 0x7f8c6c035020 2024-05-08T18:31:18.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c76d22800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:18.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c76d22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:18.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c76d22800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:18.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c76d22800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:18.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c76d22800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:18.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c76d22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:18.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c76d22800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562091a5a780 con 0x562091a55c70 2024-05-08T18:31:18.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c76d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c76d22800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562091a5b020 con 0x562091a55c70 2024-05-08T18:31:18.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c76d22800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:18.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c76d22800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.803+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562091a5a3c0 con 0x7f8c6403c040 2024-05-08T18:31:18.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:18.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 20 zone default found 2024-05-08T18:31:18.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 4 Realm: () 2024-05-08T18:31:18.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:18.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:18.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:18.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 20 zonegroup default 2024-05-08T18:31:18.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562091a5ecd0 con 0x7f8c6403c040 2024-05-08T18:31:18.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562091a60b60 con 0x562091a5bce0 2024-05-08T18:31:18.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c6c052d70 con 0x562091a5bce0 2024-05-08T18:31:18.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562091a60f00 con 0x562091a5bce0 2024-05-08T18:31:18.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c6c052d70 con 0x562091a5bce0 2024-05-08T18:31:18.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 20 started sync module instance, tier type = 2024-05-08T18:31:18.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.804+0000 7f8c76d22800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:18.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.805+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a5fff0 con 0x7f8c6c035020 2024-05-08T18:31:18.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.806+0000 7f8c72963640 1 -- 172.21.15.87:0/3520340962 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c6402b070 con 0x7f8c6c035020 2024-05-08T18:31:18.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.806+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94697882518544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a5fc50 con 0x7f8c6c035020 2024-05-08T18:31:18.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.806+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a61dc0 con 0x562091a55c70 2024-05-08T18:31:18.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.806+0000 7f8c72963640 1 -- 172.21.15.87:0/3520340962 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94697882518544] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c6402b070 con 0x7f8c6c035020 2024-05-08T18:31:18.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.807+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.807+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94697882523920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a621e0 con 0x562091a55c70 2024-05-08T18:31:18.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.807+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a62ba0 con 0x562091a5bce0 2024-05-08T18:31:18.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.808+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c6c052d70 con 0x562091a5bce0 2024-05-08T18:31:18.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.808+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94697882527472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a633f0 con 0x562091a5bce0 2024-05-08T18:31:18.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.808+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a63ed0 con 0x7f8c6c035020 2024-05-08T18:31:18.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.808+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94697882523920] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.809+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94697882527472] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c6c052d70 con 0x562091a5bce0 2024-05-08T18:31:18.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.809+0000 7f8c72963640 1 -- 172.21.15.87:0/3520340962 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c6402b070 con 0x7f8c6c035020 2024-05-08T18:31:18.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.809+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94697882524976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a633f0 con 0x7f8c6c035020 2024-05-08T18:31:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.809+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a647b0 con 0x562091a55c70 2024-05-08T18:31:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.810+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.810+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94697882534592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a65050 con 0x562091a55c70 2024-05-08T18:31:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.810+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a65af0 con 0x7f8c6403c040 2024-05-08T18:31:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.810+0000 7f8c72963640 1 -- 172.21.15.87:0/3520340962 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94697882524976] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c6402b070 con 0x7f8c6c035020 2024-05-08T18:31:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.811+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94697882534592] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.811+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.811+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94697882539456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a64b50 con 0x7f8c6403c040 2024-05-08T18:31:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.811+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a66390 con 0x7f8c6403c040 2024-05-08T18:31:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.812+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94697882539456] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.812+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.812+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94697882536592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a65e40 con 0x7f8c6403c040 2024-05-08T18:31:18.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.812+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a66920 con 0x7f8c6403c040 2024-05-08T18:31:18.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.813+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94697882536592] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.813+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.813+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94697882543056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a668e0 con 0x7f8c6403c040 2024-05-08T18:31:18.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.813+0000 7f8c76d22800 20 add_watcher() i=0 2024-05-08T18:31:18.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.813+0000 7f8c76d22800 20 add_watcher() i=1 2024-05-08T18:31:18.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.813+0000 7f8c76d22800 20 add_watcher() i=2 2024-05-08T18:31:18.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.813+0000 7f8c76d22800 20 add_watcher() i=3 2024-05-08T18:31:18.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.813+0000 7f8c76d22800 20 add_watcher() i=4 2024-05-08T18:31:18.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.813+0000 7f8c76d22800 20 add_watcher() i=5 2024-05-08T18:31:18.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.813+0000 7f8c76d22800 20 add_watcher() i=6 2024-05-08T18:31:18.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.814+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94697882543056] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.814+0000 7f8c76d22800 20 add_watcher() i=7 2024-05-08T18:31:18.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.814+0000 7f8c76d22800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:18.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.814+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562091a69d40 con 0x562091a55c70 2024-05-08T18:31:18.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.814+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.814+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94697882529600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a67260 con 0x562091a55c70 2024-05-08T18:31:18.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.815+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94697882529600] v27'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.815+0000 7f8b297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:18.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.815+0000 7f8c76d22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:18.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.815+0000 7f8c76d22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:18.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.815+0000 7f8c76d22800 5 note: GC not initialized 2024-05-08T18:31:18.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.815+0000 7f8aa3fff640 20 reqs_thread_entry: start 2024-05-08T18:31:18.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.816+0000 7f8c76d22800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:18.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.816+0000 7f8c76d22800 20 Filter name: none 2024-05-08T18:31:18.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.816+0000 7f8aa1ffb640 20 reqs_thread_entry: start 2024-05-08T18:31:18.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.816+0000 7f8c76d22800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.816+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562091a9cc60 con 0x562091a55c70 2024-05-08T18:31:18.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.816+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.816+0000 7f8c76d22800 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T18:31:18.828 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:18.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.817+0000 7f8b297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:18.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.817+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94697882529600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a9b850 con 0x562091a55c70 2024-05-08T18:31:18.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.818+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94697882529600] v27'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.818+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94697882518544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a62f40 con 0x7f8c6c035020 2024-05-08T18:31:18.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.819+0000 7f8c72963640 1 -- 172.21.15.87:0/3520340962 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94697882518544] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c6402b070 con 0x7f8c6c035020 2024-05-08T18:31:18.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.819+0000 7f8c76d22800 20 remove_watcher() i=0 2024-05-08T18:31:18.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.819+0000 7f8c76d22800 2 removed watcher, disabling cache 2024-05-08T18:31:18.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.819+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94697882523920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a60410 con 0x562091a55c70 2024-05-08T18:31:18.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.821+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94697882523920] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.821+0000 7f8c76d22800 20 remove_watcher() i=1 2024-05-08T18:31:18.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.821+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94697882527472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a60410 con 0x562091a5bce0 2024-05-08T18:31:18.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.822+0000 7f8c73164640 1 -- 172.21.15.87:0/3520340962 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94697882527472] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c6c052d70 con 0x562091a5bce0 2024-05-08T18:31:18.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.822+0000 7f8c76d22800 20 remove_watcher() i=2 2024-05-08T18:31:18.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.822+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94697882524976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a60410 con 0x7f8c6c035020 2024-05-08T18:31:18.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.824+0000 7f8c72963640 1 -- 172.21.15.87:0/3520340962 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94697882524976] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c6402b070 con 0x7f8c6c035020 2024-05-08T18:31:18.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.824+0000 7f8c76d22800 20 remove_watcher() i=3 2024-05-08T18:31:18.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.824+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94697882534592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a60410 con 0x562091a55c70 2024-05-08T18:31:18.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.826+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94697882534592] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x562091a55c70 2024-05-08T18:31:18.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.826+0000 7f8c76d22800 20 remove_watcher() i=4 2024-05-08T18:31:18.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.826+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94697882539456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a60410 con 0x7f8c6403c040 2024-05-08T18:31:18.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.827+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94697882539456] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.827+0000 7f8c76d22800 20 remove_watcher() i=5 2024-05-08T18:31:18.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.827+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94697882536592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a60410 con 0x7f8c6403c040 2024-05-08T18:31:18.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.828+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94697882536592] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.828+0000 7f8c76d22800 20 remove_watcher() i=6 2024-05-08T18:31:18.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.828+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94697882543056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562091a60410 con 0x7f8c6403c040 2024-05-08T18:31:18.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.829+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94697882543056] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5c05a040 con 0x7f8c6403c040 2024-05-08T18:31:18.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.829+0000 7f8c76d22800 20 remove_watcher() i=7 2024-05-08T18:31:18.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.829+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8c6403c040 msgr2=0x7f8c64052a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.829+0000 7f8c76d22800 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8c6403c040 0x7f8c64052a80 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.829+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562091a55c70 msgr2=0x562091a58130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.829+0000 7f8c76d22800 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562091a55c70 0x562091a58130 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.829+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8c6c035020 msgr2=0x7f8c6c0298c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.829+0000 7f8c76d22800 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8c6c035020 0x7f8c6c0298c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.829+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562091a5bce0 msgr2=0x562091a5e130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.829+0000 7f8c76d22800 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562091a5bce0 0x562091a5e130 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8b3c03bba0 msgr2=0x7f8b3c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8b3c03bba0 0x7f8b3c03e060 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8c6402cfd0 tx=0x7f8c64047000 comp rx=0 tx=0).stop 2024-05-08T18:31:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a42bf0 msgr2=0x562091a4a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 --2- 172.21.15.87:0/3520340962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a42bf0 0x562091a4a180 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c04d010 tx=0x7f8c6c0528f0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 reap_dead start 2024-05-08T18:31:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c6a162640 1 -- 172.21.15.87:0/3520340962 reap_dead start 2024-05-08T18:31:18.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 shutdown_connections 2024-05-08T18:31:18.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 >> 172.21.15.87:0/3520340962 conn(0x562091a3eec0 msgr2=0x562091a3cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 shutdown_connections 2024-05-08T18:31:18.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 -- 172.21.15.87:0/3520340962 wait complete. 2024-05-08T18:31:18.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 -- 172.21.15.87:0/1523481570 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8b4c03bba0 msgr2=0x7f8b4c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 --2- 172.21.15.87:0/1523481570 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8b4c03bba0 0x7f8b4c03e060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8c64022b30 tx=0x7f8c64050ca0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 -- 172.21.15.87:0/1523481570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a358a0 msgr2=0x562091a35cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 --2- 172.21.15.87:0/1523481570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a358a0 0x562091a35cc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x56209191f380 tx=0x7f8c6c0178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 -- 172.21.15.87:0/1523481570 shutdown_connections 2024-05-08T18:31:18.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 --2- 172.21.15.87:0/1523481570 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8b4c03bba0 0x7f8b4c03e060 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 --2- 172.21.15.87:0/1523481570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562091a358a0 0x562091a35cc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 -- 172.21.15.87:0/1523481570 >> 172.21.15.87:0/1523481570 conn(0x562091a29940 msgr2=0x562091a29d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 -- 172.21.15.87:0/1523481570 shutdown_connections 2024-05-08T18:31:18.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 -- 172.21.15.87:0/1523481570 wait complete. 2024-05-08T18:31:18.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 -- 172.21.15.87:0/1748320191 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562091a24d10 msgr2=0x562091a27100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562091a24d10 0x562091a27100 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 -- 172.21.15.87:0/1748320191 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562091923860 msgr2=0x562091a21600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562091923860 0x562091a21600 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 -- 172.21.15.87:0/1748320191 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8b5803bba0 msgr2=0x7f8b5803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8b5803bba0 0x7f8b5803e060 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c054000 tx=0x7f8c5c04e000 comp rx=0 tx=0).stop 2024-05-08T18:31:18.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 -- 172.21.15.87:0/1748320191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56209191fd50 msgr2=0x56209191f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.830+0000 7f8c76d22800 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56209191fd50 0x56209191f640 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400c010 tx=0x7f8c64000ed0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.831+0000 7f8c76d22800 1 -- 172.21.15.87:0/1748320191 shutdown_connections 2024-05-08T18:31:18.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.831+0000 7f8c76d22800 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562091923860 0x562091a21600 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.831+0000 7f8c76d22800 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562091a24d10 0x562091a27100 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.831+0000 7f8c76d22800 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8b5803bba0 0x7f8b5803e060 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.831+0000 7f8c76d22800 1 --2- 172.21.15.87:0/1748320191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56209191fd50 0x56209191f640 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.831+0000 7f8c76d22800 1 -- 172.21.15.87:0/1748320191 >> 172.21.15.87:0/1748320191 conn(0x5620919196a0 msgr2=0x562091a0a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.831+0000 7f8c76d22800 1 -- 172.21.15.87:0/1748320191 shutdown_connections 2024-05-08T18:31:18.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.831+0000 7f8c76d22800 1 -- 172.21.15.87:0/1748320191 wait complete. 2024-05-08T18:31:18.840 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:18.840 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:31:18.840 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:31:18.840 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:31:18.885 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:18.885 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:18.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.887+0000 7f4c55612800 1 Processor -- start 2024-05-08T18:31:18.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.887+0000 7f4c55612800 1 -- start start 2024-05-08T18:31:18.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.887+0000 7f4c55612800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556feeeab2b0 0x556feeeab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.887+0000 7f4c55612800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556feeeabd50 con 0x556feeeac470 2024-05-08T18:31:18.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.887+0000 7f4c55612800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x556feed4be20 con 0x556feeeab2b0 2024-05-08T18:31:18.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.888+0000 7f4c50c76640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556feeeab2b0 0x556feeeab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.888+0000 7f4c50475640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x556feeeac470 0x556feeeac8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41974/0 (socket says 172.21.15.87:41974) 2024-05-08T18:31:18.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.888+0000 7f4c50475640 1 -- 172.21.15.87:0/998462591 learned_addr learned my addr 172.21.15.87:0/998462591 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:18.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.888+0000 7f4c4fc74640 1 -- 172.21.15.87:0/998462591 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1751312680 0 0) 0x556feeeabd50 con 0x556feeeac470 2024-05-08T18:31:18.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.888+0000 7f4c4fc74640 1 -- 172.21.15.87:0/998462591 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c3c001e10 con 0x556feeeac470 2024-05-08T18:31:18.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.888+0000 7f4c50c76640 1 -- 172.21.15.87:0/998462591 >> v1:172.21.15.53:6789/0 conn(0x556feeeac470 legacy=0x556feeeac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.888+0000 7f4c50c76640 1 -- 172.21.15.87:0/998462591 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556feeead030 con 0x556feeeab2b0 2024-05-08T18:31:18.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.890+0000 7f4c50c76640 1 --2- 172.21.15.87:0/998462591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 0x556feeeab6d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4c40005fd0 tx=0x7f4c4001cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae3c38392e38e37 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.890+0000 7f4c4fc74640 1 -- 172.21.15.87:0/998462591 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c4004adc0 con 0x556feeeab2b0 2024-05-08T18:31:18.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.890+0000 7f4c4fc74640 1 -- 172.21.15.87:0/998462591 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c40052430 con 0x556feeeab2b0 2024-05-08T18:31:18.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.890+0000 7f4c4fc74640 1 -- 172.21.15.87:0/998462591 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c40052790 con 0x556feeeab2b0 2024-05-08T18:31:18.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.891+0000 7f4c55612800 1 -- 172.21.15.87:0/998462591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 msgr2=0x556feeeab6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.891+0000 7f4c55612800 1 --2- 172.21.15.87:0/998462591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 0x556feeeab6d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4c40005fd0 tx=0x7f4c4001cbe0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.891+0000 7f4c55612800 1 -- 172.21.15.87:0/998462591 shutdown_connections 2024-05-08T18:31:18.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.891+0000 7f4c55612800 1 --2- 172.21.15.87:0/998462591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 0x556feeeab6d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.891+0000 7f4c55612800 1 -- 172.21.15.87:0/998462591 >> 172.21.15.87:0/998462591 conn(0x556feeea6830 msgr2=0x556feeea8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.891+0000 7f4c55612800 1 -- 172.21.15.87:0/998462591 shutdown_connections 2024-05-08T18:31:18.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.891+0000 7f4c55612800 1 -- 172.21.15.87:0/998462591 wait complete. 2024-05-08T18:31:18.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.904+0000 7f4c55612800 1 Processor -- start 2024-05-08T18:31:18.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.904+0000 7f4c55612800 1 -- start start 2024-05-08T18:31:18.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.904+0000 7f4c55612800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 0x556feee20c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.904+0000 7f4c55612800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556feedf65b0 con 0x556feeeab2b0 2024-05-08T18:31:18.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.904+0000 7f4c50c76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 0x556feee20c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.905+0000 7f4c50c76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 0x556feee20c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33212/0 (socket says 172.21.15.87:33212) 2024-05-08T18:31:18.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.905+0000 7f4c50c76640 1 -- 172.21.15.87:0/3723091076 learned_addr learned my addr 172.21.15.87:0/3723091076 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.905+0000 7f4c50c76640 1 -- 172.21.15.87:0/3723091076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556feee1f230 con 0x556feeeab2b0 2024-05-08T18:31:18.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.905+0000 7f4c50c76640 1 --2- 172.21.15.87:0/3723091076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 0x556feee20c70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4c40007000 tx=0x7f4c4004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654427e8a62132d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.905+0000 7f4b3ee0d640 1 -- 172.21.15.87:0/3723091076 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c40063070 con 0x556feeeab2b0 2024-05-08T18:31:18.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.905+0000 7f4b3ee0d640 1 -- 172.21.15.87:0/3723091076 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c40052980 con 0x556feeeab2b0 2024-05-08T18:31:18.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.905+0000 7f4b3ee0d640 1 -- 172.21.15.87:0/3723091076 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c40052c60 con 0x556feeeab2b0 2024-05-08T18:31:18.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.906+0000 7f4c55612800 1 -- 172.21.15.87:0/3723091076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 msgr2=0x556feee20c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.906+0000 7f4c55612800 1 --2- 172.21.15.87:0/3723091076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 0x556feee20c70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4c40007000 tx=0x7f4c4004c000 comp rx=0 tx=0).stop 2024-05-08T18:31:18.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.906+0000 7f4c55612800 1 -- 172.21.15.87:0/3723091076 shutdown_connections 2024-05-08T18:31:18.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.906+0000 7f4c55612800 1 --2- 172.21.15.87:0/3723091076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 0x556feee20c70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.906+0000 7f4c55612800 1 -- 172.21.15.87:0/3723091076 >> 172.21.15.87:0/3723091076 conn(0x556feeea6830 msgr2=0x556feef97dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.906+0000 7f4c55612800 1 -- 172.21.15.87:0/3723091076 shutdown_connections 2024-05-08T18:31:18.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.906+0000 7f4c55612800 1 -- 172.21.15.87:0/3723091076 wait complete. 2024-05-08T18:31:18.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.906+0000 7f4c55612800 1 Processor -- start 2024-05-08T18:31:18.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.906+0000 7f4c55612800 1 -- start start 2024-05-08T18:31:18.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.906+0000 7f4c55612800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 0x556feefa61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.906+0000 7f4c55612800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556feeeb4940 con 0x556feeeab2b0 2024-05-08T18:31:18.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.907+0000 7f4c50c76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 0x556feefa61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.907+0000 7f4c50c76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 0x556feefa61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33228/0 (socket says 172.21.15.87:33228) 2024-05-08T18:31:18.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.907+0000 7f4c50c76640 1 -- 172.21.15.87:0/3143826789 learned_addr learned my addr 172.21.15.87:0/3143826789 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.907+0000 7f4c50c76640 1 -- 172.21.15.87:0/3143826789 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556feefa66e0 con 0x556feeeab2b0 2024-05-08T18:31:18.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.907+0000 7f4c50c76640 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 0x556feefa61a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4c40061040 tx=0x7f4c40003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.907+0000 7f4b3d60a640 1 -- 172.21.15.87:0/3143826789 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c4006b070 con 0x556feeeab2b0 2024-05-08T18:31:18.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.907+0000 7f4b3d60a640 1 -- 172.21.15.87:0/3143826789 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c4005e8f0 con 0x556feeeab2b0 2024-05-08T18:31:18.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.907+0000 7f4b3d60a640 1 -- 172.21.15.87:0/3143826789 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c40063040 con 0x556feeeab2b0 2024-05-08T18:31:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.907+0000 7f4c55612800 1 -- 172.21.15.87:0/3143826789 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556feefa6970 con 0x556feeeab2b0 2024-05-08T18:31:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.908+0000 7f4c55612800 1 -- 172.21.15.87:0/3143826789 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556feefa95d0 con 0x556feeeab2b0 2024-05-08T18:31:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.908+0000 7f4b3d60a640 1 -- 172.21.15.87:0/3143826789 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4c40070450 con 0x556feeeab2b0 2024-05-08T18:31:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.908+0000 7f4b3d60a640 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b3803bb50 0x7f4b3803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.908+0000 7f4b3d60a640 1 -- 172.21.15.87:0/3143826789 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4c40094330 con 0x556feeeab2b0 2024-05-08T18:31:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.909+0000 7f4c50475640 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b3803bb50 0x7f4b3803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.909+0000 7f4c55612800 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556feeeac470 0x556feefad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.909+0000 7f4c55612800 1 -- 172.21.15.87:0/3143826789 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556feefad910 con 0x556feeeac470 2024-05-08T18:31:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.909+0000 7f4c51477640 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556feeeac470 0x556feefad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.909+0000 7f4c50475640 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b3803bb50 0x7f4b3803e010 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4c38000f60 tx=0x7f4c380010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.909+0000 7f4c51477640 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556feeeac470 0x556feefad390 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.909+0000 7f4c51477640 1 -- 172.21.15.87:0/3143826789 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c480083e0 con 0x556feeeac470 2024-05-08T18:31:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.909+0000 7f4c55612800 1 -- 172.21.15.87:0/3143826789 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556feefaa920 con 0x556feeeac470 2024-05-08T18:31:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.910+0000 7f4c51477640 1 -- 172.21.15.87:0/3143826789 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c480083e0 con 0x556feeeac470 2024-05-08T18:31:18.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.910+0000 7f4c55612800 1 -- 172.21.15.87:0/3143826789 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556feefaf760 con 0x556feeeac470 2024-05-08T18:31:18.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.910+0000 7f4c51477640 1 -- 172.21.15.87:0/3143826789 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4c480083e0 con 0x556feeeac470 2024-05-08T18:31:18.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.910+0000 7f4c55612800 1 -- 172.21.15.87:0/3143826789 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556feefae8d0 con 0x556feeeac470 2024-05-08T18:31:18.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.910+0000 7f4c51477640 1 -- 172.21.15.87:0/3143826789 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c480083e0 con 0x556feeeac470 2024-05-08T18:31:18.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.910+0000 7f4c55612800 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556feefaf340 0x556feefb2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.910+0000 7f4c55612800 1 -- 172.21.15.87:0/3143826789 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556feefb3350 con 0x556feefaf340 2024-05-08T18:31:18.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.910+0000 7f4c50c76640 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556feefaf340 0x556feefb2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.911+0000 7f4c50c76640 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556feefaf340 0x556feefb2bc0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.911+0000 7f4c50c76640 1 -- 172.21.15.87:0/3143826789 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4c4006d070 con 0x556feefaf340 2024-05-08T18:31:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.911+0000 7f4c55612800 1 Processor -- start 2024-05-08T18:31:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.911+0000 7f4c55612800 1 -- start start 2024-05-08T18:31:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.911+0000 7f4c55612800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefc1680 0x556feefc1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.911+0000 7f4c55612800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556feed9cfc0 con 0x556feefc1680 2024-05-08T18:31:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.912+0000 7f4c51477640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefc1680 0x556feefc1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.912+0000 7f4c51477640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefc1680 0x556feefc1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33232/0 (socket says 172.21.15.87:33232) 2024-05-08T18:31:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.912+0000 7f4c51477640 1 -- 172.21.15.87:0/1204535991 learned_addr learned my addr 172.21.15.87:0/1204535991 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.912+0000 7f4c51477640 1 -- 172.21.15.87:0/1204535991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556feefc1fe0 con 0x556feefc1680 2024-05-08T18:31:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.912+0000 7f4c51477640 1 --2- 172.21.15.87:0/1204535991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefc1680 0x556feefc1aa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x556feefa7020 tx=0x7f4c4800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.912+0000 7f4b36ffd640 1 -- 172.21.15.87:0/1204535991 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c4801c070 con 0x556feefc1680 2024-05-08T18:31:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.912+0000 7f4b36ffd640 1 -- 172.21.15.87:0/1204535991 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c48018410 con 0x556feefc1680 2024-05-08T18:31:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.912+0000 7f4b36ffd640 1 -- 172.21.15.87:0/1204535991 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c48018730 con 0x556feefc1680 2024-05-08T18:31:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.912+0000 7f4c55612800 1 -- 172.21.15.87:0/1204535991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556feefc2a50 con 0x556feefc1680 2024-05-08T18:31:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.912+0000 7f4c55612800 1 -- 172.21.15.87:0/1204535991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556feefc2f50 con 0x556feefc1680 2024-05-08T18:31:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.913+0000 7f4b36ffd640 1 -- 172.21.15.87:0/1204535991 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4c4801f070 con 0x556feefc1680 2024-05-08T18:31:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.913+0000 7f4b36ffd640 1 --2- 172.21.15.87:0/1204535991 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b2803bb50 0x7f4b2803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.913+0000 7f4b36ffd640 1 -- 172.21.15.87:0/1204535991 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4c48054670 con 0x556feefc1680 2024-05-08T18:31:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.913+0000 7f4c50c76640 1 --2- 172.21.15.87:0/1204535991 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b2803bb50 0x7f4b2803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.914+0000 7f4c55612800 1 Processor -- start 2024-05-08T18:31:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.914+0000 7f4c50c76640 1 --2- 172.21.15.87:0/1204535991 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b2803bb50 0x7f4b2803e010 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4c40054010 tx=0x7f4c4008d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.914+0000 7f4c55612800 1 -- start start 2024-05-08T18:31:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.914+0000 7f4c55612800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefcea00 0x556feefcee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.914+0000 7f4c55612800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556feee1f550 con 0x556feefcea00 2024-05-08T18:31:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.914+0000 7f4c51477640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefcea00 0x556feefcee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.914+0000 7f4c51477640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefcea00 0x556feefcee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33234/0 (socket says 172.21.15.87:33234) 2024-05-08T18:31:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.914+0000 7f4c51477640 1 -- 172.21.15.87:0/40835320 learned_addr learned my addr 172.21.15.87:0/40835320 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.914+0000 7f4c51477640 1 -- 172.21.15.87:0/40835320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556feefcf3f0 con 0x556feefcea00 2024-05-08T18:31:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.914+0000 7f4c51477640 1 --2- 172.21.15.87:0/40835320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefcea00 0x556feefcee20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4c48014fd0 tx=0x7f4c48052b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8812cda2f4e353b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.914+0000 7f4b34ff9640 1 -- 172.21.15.87:0/40835320 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c48007c20 con 0x556feefcea00 2024-05-08T18:31:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.915+0000 7f4b34ff9640 1 -- 172.21.15.87:0/40835320 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c48007dc0 con 0x556feefcea00 2024-05-08T18:31:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.915+0000 7f4b34ff9640 1 -- 172.21.15.87:0/40835320 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c48017850 con 0x556feefcea00 2024-05-08T18:31:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.915+0000 7f4c55612800 1 -- 172.21.15.87:0/40835320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefcea00 msgr2=0x556feefcee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.915+0000 7f4c55612800 1 --2- 172.21.15.87:0/40835320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefcea00 0x556feefcee20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4c48014fd0 tx=0x7f4c48052b20 comp rx=0 tx=0).stop 2024-05-08T18:31:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.915+0000 7f4c55612800 1 -- 172.21.15.87:0/40835320 shutdown_connections 2024-05-08T18:31:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.915+0000 7f4c55612800 1 --2- 172.21.15.87:0/40835320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefcea00 0x556feefcee20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.915+0000 7f4c55612800 1 -- 172.21.15.87:0/40835320 >> 172.21.15.87:0/40835320 conn(0x556feefcad10 msgr2=0x556feefc8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.915+0000 7f4c55612800 1 -- 172.21.15.87:0/40835320 shutdown_connections 2024-05-08T18:31:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.915+0000 7f4c55612800 1 -- 172.21.15.87:0/40835320 wait complete. 2024-05-08T18:31:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.915+0000 7f4c55612800 1 Processor -- start 2024-05-08T18:31:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.915+0000 7f4c55612800 1 -- start start 2024-05-08T18:31:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.915+0000 7f4c55612800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefcea00 0x556feefd5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.915+0000 7f4c55612800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556feefcfbc0 con 0x556feefcea00 2024-05-08T18:31:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.916+0000 7f4c51477640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefcea00 0x556feefd5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.916+0000 7f4c51477640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefcea00 0x556feefd5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33244/0 (socket says 172.21.15.87:33244) 2024-05-08T18:31:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.916+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 learned_addr learned my addr 172.21.15.87:0/649974787 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.916+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556feefd6440 con 0x556feefcea00 2024-05-08T18:31:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.916+0000 7f4c51477640 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefcea00 0x556feefd5f00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4c48007a20 tx=0x7f4c48052970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.916+0000 7f4b2e7fc640 1 -- 172.21.15.87:0/649974787 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c48049040 con 0x556feefcea00 2024-05-08T18:31:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.916+0000 7f4b2e7fc640 1 -- 172.21.15.87:0/649974787 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c4802f030 con 0x556feefcea00 2024-05-08T18:31:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.916+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556feefd66d0 con 0x556feefcea00 2024-05-08T18:31:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.916+0000 7f4b2e7fc640 1 -- 172.21.15.87:0/649974787 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c480512d0 con 0x556feefcea00 2024-05-08T18:31:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.916+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556feefd9380 con 0x556feefcea00 2024-05-08T18:31:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.917+0000 7f4b2e7fc640 1 -- 172.21.15.87:0/649974787 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4c480514c0 con 0x556feefcea00 2024-05-08T18:31:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.917+0000 7f4b2e7fc640 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b1803bb50 0x7f4b1803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.917+0000 7f4b2e7fc640 1 -- 172.21.15.87:0/649974787 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4c48035c80 con 0x556feefcea00 2024-05-08T18:31:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.917+0000 7f4c50c76640 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b1803bb50 0x7f4b1803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.917+0000 7f4c55612800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.917+0000 7f4c55612800 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556feefe19c0 0x556feefe3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.918+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556feefe45d0 con 0x556feefe19c0 2024-05-08T18:31:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.918+0000 7f4c50475640 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556feefe19c0 0x556feefe3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.918+0000 7f4c50c76640 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b1803bb50 0x7f4b1803e010 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4c400929c0 tx=0x7f4c40078000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.918+0000 7f4c50475640 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556feefe19c0 0x556feefe3e80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.918+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c38009050 con 0x556feefe19c0 2024-05-08T18:31:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.918+0000 7f4c55612800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.918+0000 7f4c55612800 20 realm 2024-05-08T18:31:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.918+0000 7f4c55612800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.918+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556feefe0e60 con 0x556feefe19c0 2024-05-08T18:31:18.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.918+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c38009050 con 0x556feefe19c0 2024-05-08T18:31:18.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.918+0000 7f4c55612800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.918+0000 7f4c55612800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:18.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.918+0000 7f4c55612800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.918+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556feefe50b0 con 0x556feefe19c0 2024-05-08T18:31:18.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.919+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c38009050 con 0x556feefe19c0 2024-05-08T18:31:18.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.919+0000 7f4c55612800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.919+0000 7f4c55612800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.919+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556feefe5980 con 0x556feefe19c0 2024-05-08T18:31:18.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.919+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c38009050 con 0x556feefe19c0 2024-05-08T18:31:18.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.919+0000 7f4c55612800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:18.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.919+0000 7f4c55612800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.919+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556feefe5d20 con 0x556feefe19c0 2024-05-08T18:31:18.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.919+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4c38009050 con 0x556feefe19c0 2024-05-08T18:31:18.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.919+0000 7f4c55612800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:18.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.919+0000 7f4c55612800 20 searching for the correct realm 2024-05-08T18:31:18.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.919+0000 7f4c55612800 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556feefe7c50 0x556feefea060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.919+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x556feefe7c50 2024-05-08T18:31:18.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.919+0000 7f4c51477640 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556feefe7c50 0x556feefea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.919+0000 7f4c51477640 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556feefe7c50 0x556feefea060 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.920+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4803b070 con 0x556feefe7c50 2024-05-08T18:31:18.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.920+0000 7f4c51477640 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c48021070 0x7f4c480189a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.920+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x7f4c48021070 2024-05-08T18:31:18.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.920+0000 7f4c50c76640 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c48021070 0x7f4c480189a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.920+0000 7f4c50c76640 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c48021070 0x7f4c480189a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.921+0000 7f4c50c76640 1 -- 172.21.15.87:0/649974787 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4006d070 con 0x7f4c48021070 2024-05-08T18:31:18.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.921+0000 7f4c50c76640 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c40070070 0x7f4c40067970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:18.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.921+0000 7f4c50c76640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x7f4c40070070 2024-05-08T18:31:18.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.921+0000 7f4c50475640 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c40070070 0x7f4c40067970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:18.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.921+0000 7f4c50475640 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c40070070 0x7f4c40067970 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:18.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.922+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c38009050 con 0x7f4c40070070 2024-05-08T18:31:18.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.922+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x556feefe19c0 2024-05-08T18:31:18.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.922+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c38009050 con 0x556feefe19c0 2024-05-08T18:31:18.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.922+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x556feefe19c0 2024-05-08T18:31:18.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.922+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.922+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x7f4c40070070 2024-05-08T18:31:18.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.922+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.922+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x7f4c40070070 2024-05-08T18:31:18.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.923+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.923+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x7f4c48021070 2024-05-08T18:31:18.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.923+0000 7f4c50c76640 1 -- 172.21.15.87:0/649974787 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4006d070 con 0x7f4c48021070 2024-05-08T18:31:18.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.923+0000 7f4c50c76640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x556feefe7c50 2024-05-08T18:31:18.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.923+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4803b070 con 0x556feefe7c50 2024-05-08T18:31:18.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.923+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x556feefe19c0 2024-05-08T18:31:18.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.923+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.923+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x7f4c40070070 2024-05-08T18:31:18.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.924+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.924+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x556feefe19c0 2024-05-08T18:31:18.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.924+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.924+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x7f4c48021070 2024-05-08T18:31:18.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.924+0000 7f4c50c76640 1 -- 172.21.15.87:0/649974787 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4c4006d070 con 0x7f4c48021070 2024-05-08T18:31:18.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.924+0000 7f4c50c76640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x556feefe7c50 2024-05-08T18:31:18.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.925+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c48061040 con 0x556feefe7c50 2024-05-08T18:31:18.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.925+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x556feefe7c50 2024-05-08T18:31:18.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.925+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c48061040 con 0x556feefe7c50 2024-05-08T18:31:18.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.925+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x7f4c40070070 2024-05-08T18:31:18.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.925+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.925+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x556feefe7c50 2024-05-08T18:31:18.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.925+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c48061040 con 0x556feefe7c50 2024-05-08T18:31:18.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.925+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x556feefe7c50 2024-05-08T18:31:18.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.926+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c48061040 con 0x556feefe7c50 2024-05-08T18:31:18.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.926+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x556feefe19c0 2024-05-08T18:31:18.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.926+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.926+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x556feefe19c0 2024-05-08T18:31:18.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.926+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.926+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x7f4c40070070 2024-05-08T18:31:18.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.926+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.926+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x556feefe7c50 2024-05-08T18:31:18.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.927+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c48061040 con 0x556feefe7c50 2024-05-08T18:31:18.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.927+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x7f4c48021070 2024-05-08T18:31:18.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.927+0000 7f4c50c76640 1 -- 172.21.15.87:0/649974787 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4006d070 con 0x7f4c48021070 2024-05-08T18:31:18.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.927+0000 7f4c50c76640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x556feefe19c0 2024-05-08T18:31:18.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.927+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.927+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x7f4c40070070 2024-05-08T18:31:18.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.927+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.927+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x556feefe7c50 2024-05-08T18:31:18.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.928+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c48061040 con 0x556feefe7c50 2024-05-08T18:31:18.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.928+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x7f4c40070070 2024-05-08T18:31:18.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.928+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.928+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x7f4c48021070 2024-05-08T18:31:18.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.928+0000 7f4c50c76640 1 -- 172.21.15.87:0/649974787 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4006d070 con 0x7f4c48021070 2024-05-08T18:31:18.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.928+0000 7f4c50c76640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x556feefe7c50 2024-05-08T18:31:18.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.929+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c48061040 con 0x556feefe7c50 2024-05-08T18:31:18.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.929+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x7f4c40070070 2024-05-08T18:31:18.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.929+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.929+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x556feefe19c0 2024-05-08T18:31:18.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.929+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.929+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556feefea730 con 0x7f4c48021070 2024-05-08T18:31:18.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c50c76640 1 -- 172.21.15.87:0/649974787 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4006d070 con 0x7f4c48021070 2024-05-08T18:31:18.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:18.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:18.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:18.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:18.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:18.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:18.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556feefe66d0 con 0x556feefe19c0 2024-05-08T18:31:18.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556feefe6f70 con 0x556feefe19c0 2024-05-08T18:31:18.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:18.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556feefe6310 con 0x7f4c40070070 2024-05-08T18:31:18.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:18.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 20 zone default found 2024-05-08T18:31:18.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 4 Realm: () 2024-05-08T18:31:18.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:18.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:18.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:18.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 20 zonegroup default 2024-05-08T18:31:18.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.930+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556feefeabb0 con 0x7f4c40070070 2024-05-08T18:31:18.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.931+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.931+0000 7f4c55612800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.931+0000 7f4c55612800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.931+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556feefeca40 con 0x556feefe7c50 2024-05-08T18:31:18.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.931+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c48061040 con 0x556feefe7c50 2024-05-08T18:31:18.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.931+0000 7f4c55612800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.931+0000 7f4c55612800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.931+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556feefecde0 con 0x556feefe7c50 2024-05-08T18:31:18.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.931+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c48061040 con 0x556feefe7c50 2024-05-08T18:31:18.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.931+0000 7f4c55612800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:18.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.931+0000 7f4c55612800 20 started sync module instance, tier type = 2024-05-08T18:31:18.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.931+0000 7f4c55612800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:18.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.931+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feefebe80 con 0x7f4c48021070 2024-05-08T18:31:18.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.932+0000 7f4c50c76640 1 -- 172.21.15.87:0/649974787 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4006d070 con 0x7f4c48021070 2024-05-08T18:31:18.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.932+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93939239404144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feefec690 con 0x7f4c48021070 2024-05-08T18:31:18.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.932+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feefedb40 con 0x556feefe19c0 2024-05-08T18:31:18.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.933+0000 7f4c50c76640 1 -- 172.21.15.87:0/649974787 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93939239404144] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4006d070 con 0x7f4c48021070 2024-05-08T18:31:18.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.933+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.933+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93939239408000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feefedf60 con 0x556feefe19c0 2024-05-08T18:31:18.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.934+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feefee980 con 0x556feefe7c50 2024-05-08T18:31:18.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.935+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93939239408000] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.935+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c48061040 con 0x556feefe7c50 2024-05-08T18:31:18.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.935+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93939239412848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feefee940 con 0x556feefe7c50 2024-05-08T18:31:18.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.935+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feefef430 con 0x7f4c48021070 2024-05-08T18:31:18.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.936+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93939239412848] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c48061040 con 0x556feefe7c50 2024-05-08T18:31:18.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.936+0000 7f4c50c76640 1 -- 172.21.15.87:0/649974787 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4006d070 con 0x7f4c48021070 2024-05-08T18:31:18.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.936+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93939239415616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feefef820 con 0x7f4c48021070 2024-05-08T18:31:18.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.936+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feeff0260 con 0x556feefe19c0 2024-05-08T18:31:18.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.937+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.937+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93939239419184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feeff0b00 con 0x556feefe19c0 2024-05-08T18:31:18.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.937+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feeff15a0 con 0x7f4c40070070 2024-05-08T18:31:18.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.937+0000 7f4c50c76640 1 -- 172.21.15.87:0/649974787 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93939239415616] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4006d070 con 0x7f4c48021070 2024-05-08T18:31:18.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.938+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.938+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93939239424144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feeff1560 con 0x7f4c40070070 2024-05-08T18:31:18.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.938+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feeff1fe0 con 0x7f4c40070070 2024-05-08T18:31:18.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.938+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93939239419184] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.939+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93939239424144] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.939+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.939+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93939239409056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feeff1b30 con 0x7f4c40070070 2024-05-08T18:31:18.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.939+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feeff24f0 con 0x7f4c40070070 2024-05-08T18:31:18.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.940+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.940+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93939239409056] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.940+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93939239428160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feeff2460 con 0x7f4c40070070 2024-05-08T18:31:18.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.940+0000 7f4c55612800 20 add_watcher() i=0 2024-05-08T18:31:18.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.940+0000 7f4c55612800 20 add_watcher() i=1 2024-05-08T18:31:18.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.940+0000 7f4c55612800 20 add_watcher() i=2 2024-05-08T18:31:18.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.940+0000 7f4c55612800 20 add_watcher() i=3 2024-05-08T18:31:18.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.940+0000 7f4c55612800 20 add_watcher() i=4 2024-05-08T18:31:18.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.940+0000 7f4c55612800 20 add_watcher() i=5 2024-05-08T18:31:18.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.940+0000 7f4c55612800 20 add_watcher() i=6 2024-05-08T18:31:18.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.941+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93939239428160] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.941+0000 7f4c55612800 20 add_watcher() i=7 2024-05-08T18:31:18.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.941+0000 7f4c55612800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:18.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.941+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556feeff5860 con 0x556feefe19c0 2024-05-08T18:31:18.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.941+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.941+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93939239421408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feeff2d80 con 0x556feefe19c0 2024-05-08T18:31:18.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.942+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93939239421408] v27'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.942+0000 7f4b077de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:18.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.942+0000 7f4c55612800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:18.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.942+0000 7f4c55612800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:18.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.942+0000 7f4c55612800 5 note: GC not initialized 2024-05-08T18:31:18.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.942+0000 7f4b067dc640 20 reqs_thread_entry: start 2024-05-08T18:31:18.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.942+0000 7f4c55612800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:18.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.942+0000 7f4c55612800 20 Filter name: none 2024-05-08T18:31:18.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.942+0000 7f4a77fff640 20 reqs_thread_entry: start 2024-05-08T18:31:18.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.943+0000 7f4c55612800 20 rados->read ofs=0 len=0 2024-05-08T18:31:18.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.943+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556fef028910 con 0x556feefe19c0 2024-05-08T18:31:18.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.943+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.943+0000 7f4c55612800 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T18:31:18.951 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:18.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.944+0000 7f4b077de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:18.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.944+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93939239421408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556fef0274e0 con 0x556feefe19c0 2024-05-08T18:31:18.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.945+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93939239421408] v27'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.945+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93939239404144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feeff05e0 con 0x7f4c48021070 2024-05-08T18:31:18.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.946+0000 7f4c50c76640 1 -- 172.21.15.87:0/649974787 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93939239404144] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4006d070 con 0x7f4c48021070 2024-05-08T18:31:18.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.946+0000 7f4c55612800 20 remove_watcher() i=0 2024-05-08T18:31:18.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.946+0000 7f4c55612800 2 removed watcher, disabling cache 2024-05-08T18:31:18.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.946+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93939239408000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feefec270 con 0x556feefe19c0 2024-05-08T18:31:18.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.947+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93939239408000] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.947+0000 7f4c55612800 20 remove_watcher() i=1 2024-05-08T18:31:18.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.947+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93939239412848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feefec270 con 0x556feefe7c50 2024-05-08T18:31:18.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.948+0000 7f4c51477640 1 -- 172.21.15.87:0/649974787 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93939239412848] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c48061040 con 0x556feefe7c50 2024-05-08T18:31:18.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.948+0000 7f4c55612800 20 remove_watcher() i=2 2024-05-08T18:31:18.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.948+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93939239415616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feefee470 con 0x7f4c48021070 2024-05-08T18:31:18.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.949+0000 7f4c50c76640 1 -- 172.21.15.87:0/649974787 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93939239415616] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4006d070 con 0x7f4c48021070 2024-05-08T18:31:18.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.949+0000 7f4c55612800 20 remove_watcher() i=3 2024-05-08T18:31:18.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.949+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93939239419184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feefec270 con 0x556feefe19c0 2024-05-08T18:31:18.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.949+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93939239419184] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x556feefe19c0 2024-05-08T18:31:18.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.950+0000 7f4c55612800 20 remove_watcher() i=4 2024-05-08T18:31:18.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.950+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93939239424144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feefeef40 con 0x7f4c40070070 2024-05-08T18:31:18.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.950+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93939239424144] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.950+0000 7f4c55612800 20 remove_watcher() i=5 2024-05-08T18:31:18.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.950+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93939239409056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feefee470 con 0x7f4c40070070 2024-05-08T18:31:18.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.951+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93939239409056] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.951+0000 7f4c55612800 20 remove_watcher() i=6 2024-05-08T18:31:18.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.951+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93939239428160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556feefed630 con 0x7f4c40070070 2024-05-08T18:31:18.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93939239428160] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3802a040 con 0x7f4c40070070 2024-05-08T18:31:18.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c55612800 20 remove_watcher() i=7 2024-05-08T18:31:18.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c40070070 msgr2=0x7f4c40067970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c55612800 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c40070070 0x7f4c40067970 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556feefe19c0 msgr2=0x556feefe3e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c55612800 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556feefe19c0 0x556feefe3e80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c48021070 msgr2=0x7f4c480189a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c55612800 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c48021070 0x7f4c480189a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556feefe7c50 msgr2=0x556feefea060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c55612800 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556feefe7c50 0x556feefea060 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b1803bb50 msgr2=0x7f4b1803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c55612800 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b1803bb50 0x7f4b1803e010 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4c400929c0 tx=0x7f4c40078000 comp rx=0 tx=0).stop 2024-05-08T18:31:18.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefcea00 msgr2=0x556feefd5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c55612800 1 --2- 172.21.15.87:0/649974787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefcea00 0x556feefd5f00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4c48007a20 tx=0x7f4c48052970 comp rx=0 tx=0).stop 2024-05-08T18:31:18.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 reap_dead start 2024-05-08T18:31:18.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c50475640 1 -- 172.21.15.87:0/649974787 reap_dead start 2024-05-08T18:31:18.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 shutdown_connections 2024-05-08T18:31:18.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.952+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 >> 172.21.15.87:0/649974787 conn(0x556feefcad10 msgr2=0x556feefc83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 shutdown_connections 2024-05-08T18:31:18.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 -- 172.21.15.87:0/649974787 wait complete. 2024-05-08T18:31:18.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 -- 172.21.15.87:0/1204535991 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b2803bb50 msgr2=0x7f4b2803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 --2- 172.21.15.87:0/1204535991 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b2803bb50 0x7f4b2803e010 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4c40054010 tx=0x7f4c4008d040 comp rx=0 tx=0).stop 2024-05-08T18:31:18.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 -- 172.21.15.87:0/1204535991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefc1680 msgr2=0x556feefc1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 --2- 172.21.15.87:0/1204535991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefc1680 0x556feefc1aa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x556feefa7020 tx=0x7f4c4800ef30 comp rx=0 tx=0).stop 2024-05-08T18:31:18.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 -- 172.21.15.87:0/1204535991 shutdown_connections 2024-05-08T18:31:18.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 --2- 172.21.15.87:0/1204535991 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b2803bb50 0x7f4b2803e010 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 --2- 172.21.15.87:0/1204535991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feefc1680 0x556feefc1aa0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 -- 172.21.15.87:0/1204535991 >> 172.21.15.87:0/1204535991 conn(0x556feefb5720 msgr2=0x556feefb5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 -- 172.21.15.87:0/1204535991 shutdown_connections 2024-05-08T18:31:18.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 -- 172.21.15.87:0/1204535991 wait complete. 2024-05-08T18:31:18.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 -- 172.21.15.87:0/3143826789 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556feefaf340 msgr2=0x556feefb2bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556feefaf340 0x556feefb2bc0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 -- 172.21.15.87:0/3143826789 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556feeeac470 msgr2=0x556feefad390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556feeeac470 0x556feefad390 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 -- 172.21.15.87:0/3143826789 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b3803bb50 msgr2=0x7f4b3803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b3803bb50 0x7f4b3803e010 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4c38000f60 tx=0x7f4c380010a0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 -- 172.21.15.87:0/3143826789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 msgr2=0x556feefa61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:18.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 0x556feefa61a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4c40061040 tx=0x7f4c40003330 comp rx=0 tx=0).stop 2024-05-08T18:31:18.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 -- 172.21.15.87:0/3143826789 shutdown_connections 2024-05-08T18:31:18.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556feeeac470 0x556feefad390 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556feefaf340 0x556feefb2bc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b3803bb50 0x7f4b3803e010 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 --2- 172.21.15.87:0/3143826789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556feeeab2b0 0x556feefa61a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:18.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 -- 172.21.15.87:0/3143826789 >> 172.21.15.87:0/3143826789 conn(0x556feeea6830 msgr2=0x556feee1fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:18.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.953+0000 7f4c55612800 1 -- 172.21.15.87:0/3143826789 shutdown_connections 2024-05-08T18:31:18.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:18.954+0000 7f4c55612800 1 -- 172.21.15.87:0/3143826789 wait complete. 2024-05-08T18:31:18.962 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:18.962 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-05-08T18:31:18.962 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-05-08T18:31:18.962 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-05-08T18:31:19.010 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:19.010 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:19.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.013+0000 7fab27b2f800 1 Processor -- start 2024-05-08T18:31:19.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.013+0000 7fab27b2f800 1 -- start start 2024-05-08T18:31:19.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.013+0000 7fab27b2f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555d0a38d880 0x555d0a38fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.013+0000 7fab27b2f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555d0a3901b0 con 0x555d0a389d70 2024-05-08T18:31:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.013+0000 7fab27b2f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x555d0a229e20 con 0x555d0a38d880 2024-05-08T18:31:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.013+0000 7fab1afed640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555d0a38d880 0x555d0a38fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.013+0000 7fab237ee640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x555d0a389d70 0x555d0a38c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:41984/0 (socket says 172.21.15.87:41984) 2024-05-08T18:31:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.013+0000 7fab237ee640 1 -- 172.21.15.87:0/2127172379 learned_addr learned my addr 172.21.15.87:0/2127172379 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.013+0000 7fab1afed640 1 -- 172.21.15.87:0/2127172379 >> v1:172.21.15.53:6789/0 conn(0x555d0a389d70 legacy=0x555d0a38c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.013+0000 7fab1afed640 1 -- 172.21.15.87:0/2127172379 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d0a391390 con 0x555d0a38d880 2024-05-08T18:31:19.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.015+0000 7fab1afed640 1 --2- 172.21.15.87:0/2127172379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a38d880 0x555d0a38fc70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fab0c00a470 tx=0x7fab0c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f6bad13cec90c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.015+0000 7fab22fed640 1 -- 172.21.15.87:0/2127172379 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab0c057070 con 0x555d0a38d880 2024-05-08T18:31:19.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.015+0000 7fab22fed640 1 -- 172.21.15.87:0/2127172379 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab0c052570 con 0x555d0a38d880 2024-05-08T18:31:19.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.015+0000 7fab22fed640 1 -- 172.21.15.87:0/2127172379 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab0c052870 con 0x555d0a38d880 2024-05-08T18:31:19.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.016+0000 7fab27b2f800 1 -- 172.21.15.87:0/2127172379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a38d880 msgr2=0x555d0a38fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.016+0000 7fab27b2f800 1 --2- 172.21.15.87:0/2127172379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a38d880 0x555d0a38fc70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fab0c00a470 tx=0x7fab0c01ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.016+0000 7fab27b2f800 1 -- 172.21.15.87:0/2127172379 shutdown_connections 2024-05-08T18:31:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.016+0000 7fab27b2f800 1 --2- 172.21.15.87:0/2127172379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a38d880 0x555d0a38fc70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.016+0000 7fab27b2f800 1 -- 172.21.15.87:0/2127172379 >> 172.21.15.87:0/2127172379 conn(0x555d0a383740 msgr2=0x555d0a385b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.016+0000 7fab27b2f800 1 -- 172.21.15.87:0/2127172379 shutdown_connections 2024-05-08T18:31:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.016+0000 7fab27b2f800 1 -- 172.21.15.87:0/2127172379 wait complete. 2024-05-08T18:31:19.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.029+0000 7fab27b2f800 1 Processor -- start 2024-05-08T18:31:19.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.030+0000 7fab27b2f800 1 -- start start 2024-05-08T18:31:19.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.030+0000 7fab27b2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a389d70 0x555d0a3896b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.030+0000 7fab27b2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d0a2d45d0 con 0x555d0a389d70 2024-05-08T18:31:19.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.030+0000 7fab237ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a389d70 0x555d0a3896b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.030+0000 7fab237ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a389d70 0x555d0a3896b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33254/0 (socket says 172.21.15.87:33254) 2024-05-08T18:31:19.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.030+0000 7fab237ee640 1 -- 172.21.15.87:0/2668499926 learned_addr learned my addr 172.21.15.87:0/2668499926 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.030+0000 7fab237ee640 1 -- 172.21.15.87:0/2668499926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d0a387c70 con 0x555d0a389d70 2024-05-08T18:31:19.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.030+0000 7fab237ee640 1 --2- 172.21.15.87:0/2668499926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a389d70 0x555d0a3896b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fab14001d50 tx=0x7fab1400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677a6d870f717069 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.031+0000 7faa1160a640 1 -- 172.21.15.87:0/2668499926 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab14013030 con 0x555d0a389d70 2024-05-08T18:31:19.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.031+0000 7faa1160a640 1 -- 172.21.15.87:0/2668499926 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab1400e470 con 0x555d0a389d70 2024-05-08T18:31:19.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.031+0000 7faa1160a640 1 -- 172.21.15.87:0/2668499926 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab1400e810 con 0x555d0a389d70 2024-05-08T18:31:19.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.031+0000 7fab27b2f800 1 -- 172.21.15.87:0/2668499926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a389d70 msgr2=0x555d0a3896b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.031+0000 7fab27b2f800 1 --2- 172.21.15.87:0/2668499926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a389d70 0x555d0a3896b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fab14001d50 tx=0x7fab1400b6c0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.031+0000 7fab27b2f800 1 -- 172.21.15.87:0/2668499926 shutdown_connections 2024-05-08T18:31:19.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.031+0000 7fab27b2f800 1 --2- 172.21.15.87:0/2668499926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a389d70 0x555d0a3896b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.031+0000 7fab27b2f800 1 -- 172.21.15.87:0/2668499926 >> 172.21.15.87:0/2668499926 conn(0x555d0a383740 msgr2=0x555d0a475fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.031+0000 7fab27b2f800 1 -- 172.21.15.87:0/2668499926 shutdown_connections 2024-05-08T18:31:19.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.032+0000 7fab27b2f800 1 -- 172.21.15.87:0/2668499926 wait complete. 2024-05-08T18:31:19.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.032+0000 7fab27b2f800 1 Processor -- start 2024-05-08T18:31:19.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.032+0000 7fab27b2f800 1 -- start start 2024-05-08T18:31:19.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.032+0000 7fab27b2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a389d70 0x555d0a484420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.032+0000 7fab27b2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d0a390680 con 0x555d0a389d70 2024-05-08T18:31:19.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.032+0000 7fab237ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a389d70 0x555d0a484420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.032+0000 7fab237ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a389d70 0x555d0a484420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33268/0 (socket says 172.21.15.87:33268) 2024-05-08T18:31:19.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.032+0000 7fab237ee640 1 -- 172.21.15.87:0/2353290673 learned_addr learned my addr 172.21.15.87:0/2353290673 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.032+0000 7fab237ee640 1 -- 172.21.15.87:0/2353290673 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d0a484960 con 0x555d0a389d70 2024-05-08T18:31:19.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.032+0000 7fab237ee640 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a389d70 0x555d0a484420 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x555d0a388ce0 tx=0x7fab14000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.033+0000 7faa0fe07640 1 -- 172.21.15.87:0/2353290673 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab14027070 con 0x555d0a389d70 2024-05-08T18:31:19.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.033+0000 7faa0fe07640 1 -- 172.21.15.87:0/2353290673 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab14019900 con 0x555d0a389d70 2024-05-08T18:31:19.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.033+0000 7fab27b2f800 1 -- 172.21.15.87:0/2353290673 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d0a484bf0 con 0x555d0a389d70 2024-05-08T18:31:19.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.033+0000 7faa0fe07640 1 -- 172.21.15.87:0/2353290673 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab14019c40 con 0x555d0a389d70 2024-05-08T18:31:19.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.033+0000 7fab27b2f800 1 -- 172.21.15.87:0/2353290673 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d0a4878a0 con 0x555d0a389d70 2024-05-08T18:31:19.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.034+0000 7faa0fe07640 1 -- 172.21.15.87:0/2353290673 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fab1402a070 con 0x555d0a389d70 2024-05-08T18:31:19.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.034+0000 7faa0fe07640 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7faa0803bb50 0x7faa0803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.034+0000 7faa0fe07640 1 -- 172.21.15.87:0/2353290673 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fab1401f070 con 0x555d0a389d70 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.034+0000 7fab1afed640 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7faa0803bb50 0x7faa0803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.034+0000 7fab27b2f800 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555d0a38d880 0x555d0a48b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.034+0000 7fab27b2f800 1 -- 172.21.15.87:0/2353290673 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a48bbf0 con 0x555d0a38d880 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.034+0000 7fab23fef640 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555d0a38d880 0x555d0a48b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.034+0000 7fab1afed640 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7faa0803bb50 0x7faa0803e010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fab0c054000 tx=0x7fab0c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.034+0000 7fab23fef640 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555d0a38d880 0x555d0a48b660 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.035+0000 7fab23fef640 1 -- 172.21.15.87:0/2353290673 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab1c00a4a0 con 0x555d0a38d880 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.035+0000 7fab27b2f800 1 -- 172.21.15.87:0/2353290673 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a488c30 con 0x555d0a38d880 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.035+0000 7fab23fef640 1 -- 172.21.15.87:0/2353290673 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab1c00a4a0 con 0x555d0a38d880 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.035+0000 7fab27b2f800 1 -- 172.21.15.87:0/2353290673 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a48da10 con 0x555d0a38d880 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.035+0000 7fab23fef640 1 -- 172.21.15.87:0/2353290673 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fab1c00a4a0 con 0x555d0a38d880 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.035+0000 7fab27b2f800 1 -- 172.21.15.87:0/2353290673 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a48cb50 con 0x555d0a38d880 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.036+0000 7fab23fef640 1 -- 172.21.15.87:0/2353290673 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab1c00a4a0 con 0x555d0a38d880 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.036+0000 7fab27b2f800 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555d0a48d620 0x555d0a490e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.036+0000 7fab27b2f800 1 -- 172.21.15.87:0/2353290673 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4915f0 con 0x555d0a48d620 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.036+0000 7fab237ee640 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555d0a48d620 0x555d0a490e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.036+0000 7fab237ee640 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555d0a48d620 0x555d0a490e60 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.036+0000 7fab237ee640 1 -- 172.21.15.87:0/2353290673 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fab14029030 con 0x555d0a48d620 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.037+0000 7fab27b2f800 1 Processor -- start 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.037+0000 7fab27b2f800 1 -- start start 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.037+0000 7fab27b2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a49f940 0x555d0a49fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.037+0000 7fab27b2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d0a27afc0 con 0x555d0a49f940 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.037+0000 7fab23fef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a49f940 0x555d0a49fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.037+0000 7fab23fef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a49f940 0x555d0a49fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33276/0 (socket says 172.21.15.87:33276) 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.037+0000 7fab23fef640 1 -- 172.21.15.87:0/3987129278 learned_addr learned my addr 172.21.15.87:0/3987129278 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.037+0000 7fab23fef640 1 -- 172.21.15.87:0/3987129278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d0a4a02a0 con 0x555d0a49f940 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.037+0000 7fab23fef640 1 --2- 172.21.15.87:0/3987129278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a49f940 0x555d0a49fd60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x555d0a48bfd0 tx=0x7fab1c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.038+0000 7faa0d602640 1 -- 172.21.15.87:0/3987129278 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab1c013440 con 0x555d0a49f940 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.038+0000 7faa0d602640 1 -- 172.21.15.87:0/3987129278 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab1c0135e0 con 0x555d0a49f940 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.038+0000 7fab27b2f800 1 -- 172.21.15.87:0/3987129278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d0a4a0d10 con 0x555d0a49f940 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.038+0000 7faa0d602640 1 -- 172.21.15.87:0/3987129278 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab1c0138c0 con 0x555d0a49f940 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.038+0000 7fab27b2f800 1 -- 172.21.15.87:0/3987129278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d0a4a1210 con 0x555d0a49f940 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.038+0000 7faa0d602640 1 -- 172.21.15.87:0/3987129278 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fab1c011040 con 0x555d0a49f940 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.039+0000 7faa0d602640 1 --2- 172.21.15.87:0/3987129278 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa9fc03bb50 0x7fa9fc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.039+0000 7faa0d602640 1 -- 172.21.15.87:0/3987129278 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fab1c01d070 con 0x555d0a49f940 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.039+0000 7fab237ee640 1 --2- 172.21.15.87:0/3987129278 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa9fc03bb50 0x7fa9fc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.039+0000 7fab27b2f800 1 Processor -- start 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.039+0000 7fab27b2f800 1 -- start start 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.039+0000 7fab237ee640 1 --2- 172.21.15.87:0/3987129278 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa9fc03bb50 0x7fa9fc03e010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fab14001520 tx=0x7fab14050e50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.039+0000 7fab27b2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a4acd20 0x555d0a4ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.039+0000 7fab27b2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d0a387ff0 con 0x555d0a4acd20 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.039+0000 7fab23fef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a4acd20 0x555d0a4ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.039+0000 7fab23fef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a4acd20 0x555d0a4ad140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33280/0 (socket says 172.21.15.87:33280) 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.039+0000 7fab23fef640 1 -- 172.21.15.87:0/1437045261 learned_addr learned my addr 172.21.15.87:0/1437045261 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.040+0000 7fab23fef640 1 -- 172.21.15.87:0/1437045261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d0a4ad710 con 0x555d0a4acd20 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.040+0000 7fab23fef640 1 --2- 172.21.15.87:0/1437045261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a4acd20 0x555d0a4ad140 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0529e0 tx=0x7fab1c021de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f279e59077c5674 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.040+0000 7faa06ffd640 1 -- 172.21.15.87:0/1437045261 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab1c015430 con 0x555d0a4acd20 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.040+0000 7faa06ffd640 1 -- 172.21.15.87:0/1437045261 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab1c001310 con 0x555d0a4acd20 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.040+0000 7faa06ffd640 1 -- 172.21.15.87:0/1437045261 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab1c0155d0 con 0x555d0a4acd20 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.040+0000 7fab27b2f800 1 -- 172.21.15.87:0/1437045261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a4acd20 msgr2=0x555d0a4ad140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.040+0000 7fab27b2f800 1 --2- 172.21.15.87:0/1437045261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a4acd20 0x555d0a4ad140 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0529e0 tx=0x7fab1c021de0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.040+0000 7fab27b2f800 1 -- 172.21.15.87:0/1437045261 shutdown_connections 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.040+0000 7fab27b2f800 1 --2- 172.21.15.87:0/1437045261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a4acd20 0x555d0a4ad140 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.040+0000 7fab27b2f800 1 -- 172.21.15.87:0/1437045261 >> 172.21.15.87:0/1437045261 conn(0x555d0a4a8fa0 msgr2=0x555d0a4a7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.040+0000 7fab27b2f800 1 -- 172.21.15.87:0/1437045261 shutdown_connections 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.040+0000 7fab27b2f800 1 -- 172.21.15.87:0/1437045261 wait complete. 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.041+0000 7fab27b2f800 1 Processor -- start 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.041+0000 7fab27b2f800 1 -- start start 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.041+0000 7fab27b2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a4acd20 0x555d0a4b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.041+0000 7fab27b2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d0a4ade40 con 0x555d0a4acd20 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.041+0000 7fab23fef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a4acd20 0x555d0a4b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.041+0000 7fab23fef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a4acd20 0x555d0a4b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33290/0 (socket says 172.21.15.87:33290) 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.041+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 learned_addr learned my addr 172.21.15.87:0/1864608741 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.041+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d0a4b47e0 con 0x555d0a4acd20 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.041+0000 7fab23fef640 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a4acd20 0x555d0a4b42a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fab1c02a500 tx=0x7fab1c052940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.042+0000 7faa057fa640 1 -- 172.21.15.87:0/1864608741 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab1c030020 con 0x555d0a4acd20 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.042+0000 7faa057fa640 1 -- 172.21.15.87:0/1864608741 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab1c013e20 con 0x555d0a4acd20 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.042+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d0a4b4a70 con 0x555d0a4acd20 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.042+0000 7faa057fa640 1 -- 172.21.15.87:0/1864608741 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab1c054410 con 0x555d0a4acd20 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.042+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d0a4b7720 con 0x555d0a4acd20 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.042+0000 7faa057fa640 1 -- 172.21.15.87:0/1864608741 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fab1c033020 con 0x555d0a4acd20 2024-05-08T18:31:19.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.042+0000 7faa057fa640 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa9ec03bba0 0x7fa9ec03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.043+0000 7faa057fa640 1 -- 172.21.15.87:0/1864608741 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fab1c00e040 con 0x555d0a4acd20 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.043+0000 7fab237ee640 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa9ec03bba0 0x7fa9ec03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.043+0000 7fab237ee640 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa9ec03bba0 0x7fa9ec03e060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fab14050f80 tx=0x7fab14032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.043+0000 7fab27b2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.043+0000 7fab27b2f800 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555d0a4bff20 0x555d0a4c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.043+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c2b30 con 0x555d0a4bff20 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.043+0000 7fab1afed640 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555d0a4bff20 0x555d0a4c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab1afed640 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555d0a4bff20 0x555d0a4c23e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab27b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab27b2f800 20 realm 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab27b2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c2f00 con 0x555d0a4bff20 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab27b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab27b2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab27b2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c37d0 con 0x555d0a4bff20 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab27b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab27b2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c3b70 con 0x555d0a4bff20 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab27b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab27b2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.044+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c43c0 con 0x555d0a4bff20 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.045+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.045+0000 7fab27b2f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.045+0000 7fab27b2f800 20 searching for the correct realm 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.045+0000 7fab27b2f800 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x555d0a4c6130 0x555d0a4c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.045+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c8ab0 con 0x555d0a4c6130 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.045+0000 7fab23fef640 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x555d0a4c6130 0x555d0a4c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.045+0000 7fab23fef640 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x555d0a4c6130 0x555d0a4c8520 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.046+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab1c051020 con 0x555d0a4c6130 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.046+0000 7fab23fef640 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fab1c035020 0x7fab1c0409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.046+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c8ab0 con 0x7fab1c035020 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.046+0000 7fab237ee640 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fab1c035020 0x7fab1c0409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.046+0000 7fab237ee640 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fab1c035020 0x7fab1c0409f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.046+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab14029030 con 0x7fab1c035020 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.046+0000 7fab237ee640 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fab1402c060 0x7fab1402b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.046+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c8ab0 con 0x7fab1402c060 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.046+0000 7fab1afed640 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fab1402c060 0x7fab1402b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.047+0000 7fab1afed640 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fab1402c060 0x7fab1402b580 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.047+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.047+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c8ab0 con 0x555d0a4bff20 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.047+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.047+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c8ab0 con 0x555d0a4bff20 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.047+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.047+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c8ab0 con 0x7fab1402c060 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.048+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.048+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c8ab0 con 0x7fab1402c060 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.048+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.048+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c8ab0 con 0x7fab1c035020 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.048+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab14029030 con 0x7fab1c035020 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.048+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c8ab0 con 0x555d0a4c6130 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.048+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab1c051020 con 0x555d0a4c6130 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.048+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c8ab0 con 0x555d0a4bff20 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.049+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.049+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c8ab0 con 0x7fab1402c060 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.049+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.049+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c8ab0 con 0x555d0a4bff20 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.049+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.049+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c8ab0 con 0x7fab1c035020 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.049+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fab14029030 con 0x7fab1c035020 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.049+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c8ab0 con 0x555d0a4c6130 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.049+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab1c051020 con 0x555d0a4c6130 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.049+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c8ab0 con 0x555d0a4c6130 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.050+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab1c051020 con 0x555d0a4c6130 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.050+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fab1c062040 con 0x7fab1402c060 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.050+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.050+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fab1c062040 con 0x555d0a4c6130 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.050+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab1c051020 con 0x555d0a4c6130 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.050+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fab1c062040 con 0x555d0a4c6130 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.050+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab1c051020 con 0x555d0a4c6130 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.050+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fab1c062040 con 0x555d0a4bff20 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.051+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.051+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fab1c062040 con 0x555d0a4bff20 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.051+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.051+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fab1c062040 con 0x7fab1402c060 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.051+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.051+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fab1c062040 con 0x555d0a4c6130 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.051+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab1c051020 con 0x555d0a4c6130 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.051+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fab1c062040 con 0x7fab1c035020 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.052+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab14029030 con 0x7fab1c035020 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.052+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fab1c062040 con 0x555d0a4bff20 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.052+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.052+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fab1c062040 con 0x7fab1402c060 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.052+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.052+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fab1c062040 con 0x555d0a4c6130 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.053+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab1c051020 con 0x555d0a4c6130 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.053+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fab1c062040 con 0x7fab1402c060 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.053+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.053+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fab1c062040 con 0x7fab1c035020 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.053+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab14029030 con 0x7fab1c035020 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.053+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fab1c062040 con 0x555d0a4c6130 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.053+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab1c051020 con 0x555d0a4c6130 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.053+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fab1c062040 con 0x7fab1402c060 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.054+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.054+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fab1c062040 con 0x555d0a4bff20 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.054+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.054+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fab1c062040 con 0x7fab1c035020 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.054+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab14029030 con 0x7fab1c035020 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.054+0000 7fab27b2f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.054+0000 7fab27b2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.054+0000 7fab27b2f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.054+0000 7fab27b2f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.054+0000 7fab27b2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.054+0000 7fab27b2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.054+0000 7fab27b2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.054+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c4d70 con 0x555d0a4bff20 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.054+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.054+0000 7fab27b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.054+0000 7fab27b2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.054+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c5610 con 0x555d0a4bff20 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.055+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.055+0000 7fab27b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.055+0000 7fab27b2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.055+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c8f30 con 0x7fab1402c060 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.055+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.055+0000 7fab27b2f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.055+0000 7fab27b2f800 20 zone default found 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.055+0000 7fab27b2f800 4 Realm: () 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.055+0000 7fab27b2f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.055+0000 7fab27b2f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.055+0000 7fab27b2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.055+0000 7fab27b2f800 20 zonegroup default 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.055+0000 7fab27b2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.055+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4c93e0 con 0x7fab1402c060 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.056+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.056+0000 7fab27b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.056+0000 7fab27b2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.056+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4cadc0 con 0x555d0a4c6130 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.056+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab1c051020 con 0x555d0a4c6130 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.056+0000 7fab27b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.056+0000 7fab27b2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.056+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4cb270 con 0x555d0a4c6130 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.056+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab1c051020 con 0x555d0a4c6130 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.056+0000 7fab27b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.056+0000 7fab27b2f800 20 started sync module instance, tier type = 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.056+0000 7fab27b2f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.056+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4ca250 con 0x7fab1c035020 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.057+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab14029030 con 0x7fab1c035020 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.057+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93858093114944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4cbb80 con 0x7fab1c035020 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.057+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4cc3d0 con 0x555d0a4bff20 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.058+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93858093114944] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab14029030 con 0x7fab1c035020 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.058+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.058+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93858093119184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4cc430 con 0x555d0a4bff20 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.058+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4ccf40 con 0x555d0a4c6130 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.059+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab1c051020 con 0x555d0a4c6130 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.059+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93858093124080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4ccf40 con 0x555d0a4c6130 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.059+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4cdf20 con 0x7fab1c035020 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.059+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93858093119184] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.060+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93858093124080] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab1c051020 con 0x555d0a4c6130 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.060+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab14029030 con 0x7fab1c035020 2024-05-08T18:31:19.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.060+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93858093126448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4cda30 con 0x7fab1c035020 2024-05-08T18:31:19.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.060+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4ce960 con 0x555d0a4bff20 2024-05-08T18:31:19.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.061+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.061+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93858093130928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4ced80 con 0x555d0a4bff20 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.061+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4cf7d0 con 0x7fab1402c060 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.061+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93858093126448] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab14029030 con 0x7fab1c035020 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.062+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.062+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93858093130928] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.062+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93858093134528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4cf790 con 0x7fab1402c060 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.062+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4cfd30 con 0x7fab1402c060 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.063+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93858093134528] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.064+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.064+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93858093131984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4cfd30 con 0x7fab1402c060 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.064+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4d06f0 con 0x7fab1402c060 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.065+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.065+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93858093138496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4d0b10 con 0x7fab1402c060 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.065+0000 7fab27b2f800 20 add_watcher() i=0 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.065+0000 7fab27b2f800 20 add_watcher() i=1 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.065+0000 7fab27b2f800 20 add_watcher() i=2 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.065+0000 7fab27b2f800 20 add_watcher() i=3 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.065+0000 7fab27b2f800 20 add_watcher() i=4 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.065+0000 7fab27b2f800 20 add_watcher() i=5 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.065+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93858093131984] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.065+0000 7fab27b2f800 20 add_watcher() i=6 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.066+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93858093138496] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.066+0000 7fab27b2f800 20 add_watcher() i=7 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.066+0000 7fab27b2f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.066+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4d0b10 con 0x555d0a4bff20 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.066+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.066+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93858093139552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4d0a80 con 0x555d0a4bff20 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.067+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93858093139552] v27'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.067+0000 7fa9d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.067+0000 7fab27b2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.067+0000 7fab27b2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.067+0000 7fab27b2f800 5 note: GC not initialized 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.067+0000 7fa9d8fe1640 20 reqs_thread_entry: start 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab27b2f800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab27b2f800 20 Filter name: none 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fa9527fc640 20 reqs_thread_entry: start 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab27b2f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab27b2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a506f00 con 0x555d0a4bff20 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab27b2f800 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab27b2f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab27b2f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab27b2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab27b2f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab27b2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a507b10 con 0x7fab1c035020 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fab14029030 con 0x7fab1c035020 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab27b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab27b2f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab27b2f800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab27b2f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.068+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a50d990 con 0x555d0a4bff20 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.070+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v27'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.070+0000 7fab27b2f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.070+0000 7fab27b2f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.070+0000 7fab27b2f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.070+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93858093388656 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a5093f0 con 0x555d0a4bff20 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.070+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== watch-notify(notify (1) cookie 93858093130928 notify 115964116999 ret 0) ==== 891+0+0 (crc 0 0 0) 0x555d0a391390 con 0x555d0a4bff20 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.070+0000 7faa06ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116999 cookie 93858093130928 notifier 4382 bl.length()=849 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.070+0000 7faa06ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.070+0000 7faa06ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.070+0000 7faa06ffd640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fa9e8003ea0 con 0x555d0a4bff20 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.070+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(65 notify.4 [notify cookie 93858093388656 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.070+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.070+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== watch-notify(notify_complete (2) cookie 93858093388656 notify 115964116999 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fab0c091430 con 0x555d0a4bff20 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.070+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a50d370 con 0x7fab1c035020 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.072+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fab14029030 con 0x7fab1c035020 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.072+0000 7fab27b2f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.072+0000 7fab27b2f800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.072+0000 7fab27b2f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.072+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93858093388656 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555d0a5093f0 con 0x7fab1c035020 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.072+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== watch-notify(notify (1) cookie 93858093114944 notify 115964116995 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7fab14058040 con 0x7fab1c035020 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.072+0000 7faa067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 93858093114944 notifier 4382 bl.length()=166 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.072+0000 7faa067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.072+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(68 notify.0 [notify cookie 93858093388656 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab14029030 con 0x7fab1c035020 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.072+0000 7faa067fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.072+0000 7faa067fc640 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fa958003400 con 0x7fab1c035020 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.072+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab14029030 con 0x7fab1c035020 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.072+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== watch-notify(notify_complete (2) cookie 93858093388656 notify 115964116995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555d0a4878a0 con 0x7fab1c035020 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-08T18:31:19.069601Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.073+0000 7fa9d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.073+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93858093139552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a5093f0 con 0x555d0a4bff20 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.074+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93858093139552] v27'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.074+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93858093114944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a5093f0 con 0x7fab1c035020 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.075+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93858093114944] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab14029030 con 0x7fab1c035020 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.075+0000 7fab27b2f800 20 remove_watcher() i=0 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.075+0000 7fab27b2f800 2 removed watcher, disabling cache 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.075+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93858093119184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a5093f0 con 0x555d0a4bff20 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.076+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93858093119184] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.076+0000 7fab27b2f800 20 remove_watcher() i=1 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.076+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93858093124080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a5093f0 con 0x555d0a4c6130 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.077+0000 7fab23fef640 1 -- 172.21.15.87:0/1864608741 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93858093124080] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab1c051020 con 0x555d0a4c6130 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.077+0000 7fab27b2f800 20 remove_watcher() i=2 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.077+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93858093126448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a5093f0 con 0x7fab1c035020 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.078+0000 7fab237ee640 1 -- 172.21.15.87:0/1864608741 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93858093126448] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab14029030 con 0x7fab1c035020 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.078+0000 7fab27b2f800 20 remove_watcher() i=3 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.078+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93858093130928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a5093f0 con 0x555d0a4bff20 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.079+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93858093130928] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x555d0a4bff20 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.079+0000 7fab27b2f800 20 remove_watcher() i=4 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.079+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93858093134528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a5093f0 con 0x7fab1402c060 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.080+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93858093134528] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.080+0000 7fab27b2f800 20 remove_watcher() i=5 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.080+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93858093131984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4cb6d0 con 0x7fab1402c060 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.081+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93858093131984] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.081+0000 7fab27b2f800 20 remove_watcher() i=6 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.081+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93858093138496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555d0a4cb6d0 con 0x7fab1402c060 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93858093138496] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab0c05a040 con 0x7fab1402c060 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab27b2f800 20 remove_watcher() i=7 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fab1402c060 msgr2=0x7fab1402b580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab27b2f800 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fab1402c060 0x7fab1402b580 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555d0a4bff20 msgr2=0x555d0a4c23e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab27b2f800 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555d0a4bff20 0x555d0a4c23e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fab1c035020 msgr2=0x7fab1c0409f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab27b2f800 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fab1c035020 0x7fab1c0409f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x555d0a4c6130 msgr2=0x555d0a4c8520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab27b2f800 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x555d0a4c6130 0x555d0a4c8520 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa9ec03bba0 msgr2=0x7fa9ec03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab27b2f800 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa9ec03bba0 0x7fa9ec03e060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fab14050f80 tx=0x7fab14032000 comp rx=0 tx=0).stop 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab1afed640 1 -- 172.21.15.87:0/1864608741 reap_dead start 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a4acd20 msgr2=0x555d0a4b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab27b2f800 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a4acd20 0x555d0a4b42a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fab1c02a500 tx=0x7fab1c052940 comp rx=0 tx=0).stop 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 shutdown_connections 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab27b2f800 1 --2- 172.21.15.87:0/1864608741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a4acd20 0x555d0a4b42a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 >> 172.21.15.87:0/1864608741 conn(0x555d0a4a8fa0 msgr2=0x555d0a4a6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.082+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 shutdown_connections 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 -- 172.21.15.87:0/1864608741 wait complete. 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 -- 172.21.15.87:0/3987129278 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa9fc03bb50 msgr2=0x7fa9fc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 --2- 172.21.15.87:0/3987129278 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa9fc03bb50 0x7fa9fc03e010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fab14001520 tx=0x7fab14050e50 comp rx=0 tx=0).stop 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 -- 172.21.15.87:0/3987129278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a49f940 msgr2=0x555d0a49fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 --2- 172.21.15.87:0/3987129278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a49f940 0x555d0a49fd60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x555d0a48bfd0 tx=0x7fab1c0178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 -- 172.21.15.87:0/3987129278 shutdown_connections 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 --2- 172.21.15.87:0/3987129278 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa9fc03bb50 0x7fa9fc03e010 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 --2- 172.21.15.87:0/3987129278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a49f940 0x555d0a49fd60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 -- 172.21.15.87:0/3987129278 >> 172.21.15.87:0/3987129278 conn(0x555d0a4939e0 msgr2=0x555d0a493de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 -- 172.21.15.87:0/3987129278 shutdown_connections 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 -- 172.21.15.87:0/3987129278 wait complete. 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 -- 172.21.15.87:0/2353290673 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555d0a48d620 msgr2=0x555d0a490e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555d0a48d620 0x555d0a490e60 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 -- 172.21.15.87:0/2353290673 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555d0a38d880 msgr2=0x555d0a48b660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555d0a38d880 0x555d0a48b660 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 -- 172.21.15.87:0/2353290673 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7faa0803bb50 msgr2=0x7faa0803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7faa0803bb50 0x7faa0803e010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fab0c054000 tx=0x7fab0c04e000 comp rx=0 tx=0).stop 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 -- 172.21.15.87:0/2353290673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a389d70 msgr2=0x555d0a484420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a389d70 0x555d0a484420 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x555d0a388ce0 tx=0x7fab14000bc0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 -- 172.21.15.87:0/2353290673 shutdown_connections 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555d0a38d880 0x555d0a48b660 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555d0a48d620 0x555d0a490e60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7faa0803bb50 0x7faa0803e010 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 --2- 172.21.15.87:0/2353290673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d0a389d70 0x555d0a484420 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 -- 172.21.15.87:0/2353290673 >> 172.21.15.87:0/2353290673 conn(0x555d0a383740 msgr2=0x555d0a388550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 -- 172.21.15.87:0/2353290673 shutdown_connections 2024-05-08T18:31:19.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.083+0000 7fab27b2f800 1 -- 172.21.15.87:0/2353290673 wait complete. 2024-05-08T18:31:19.093 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-08T18:31:19.069601Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:19.093 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:31:19.093 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:31:19.093 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:31:19.137 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:19.137 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:19.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.140+0000 7f7b92727800 1 Processor -- start 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.140+0000 7f7b92727800 1 -- start start 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.140+0000 7f7b92727800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562565379cd0 0x56256537c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.140+0000 7f7b92727800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562565380110 con 0x56256537c600 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.140+0000 7f7b92727800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x562565219e20 con 0x562565379cd0 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.140+0000 7f7b8e36a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562565379cd0 0x56256537c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.140+0000 7f7b87fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56256537c600 0x56256537e9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42000/0 (socket says 172.21.15.87:42000) 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.140+0000 7f7b87fff640 1 -- 172.21.15.87:0/3983995743 learned_addr learned my addr 172.21.15.87:0/3983995743 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.141+0000 7f7b8e36a640 1 -- 172.21.15.87:0/3983995743 >> v1:172.21.15.53:6789/0 conn(0x56256537c600 legacy=0x56256537e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.141+0000 7f7b8e36a640 1 -- 172.21.15.87:0/3983995743 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625653812f0 con 0x562565379cd0 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.142+0000 7f7b8e36a640 1 --2- 172.21.15.87:0/3983995743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 0x56256537c0c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000a470 tx=0x7f7b8001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd04eae0c7d8d58 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.143+0000 7f7b8db69640 1 -- 172.21.15.87:0/3983995743 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b80057070 con 0x562565379cd0 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.143+0000 7f7b8db69640 1 -- 172.21.15.87:0/3983995743 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b80052570 con 0x562565379cd0 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.143+0000 7f7b8db69640 1 -- 172.21.15.87:0/3983995743 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b80052870 con 0x562565379cd0 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.143+0000 7f7b92727800 1 -- 172.21.15.87:0/3983995743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 msgr2=0x56256537c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.143+0000 7f7b92727800 1 --2- 172.21.15.87:0/3983995743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 0x56256537c0c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000a470 tx=0x7f7b8001ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.143+0000 7f7b92727800 1 -- 172.21.15.87:0/3983995743 shutdown_connections 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.143+0000 7f7b92727800 1 --2- 172.21.15.87:0/3983995743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 0x56256537c0c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.143+0000 7f7b92727800 1 -- 172.21.15.87:0/3983995743 >> 172.21.15.87:0/3983995743 conn(0x562565373720 msgr2=0x562565375b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.143+0000 7f7b92727800 1 -- 172.21.15.87:0/3983995743 shutdown_connections 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.143+0000 7f7b92727800 1 -- 172.21.15.87:0/3983995743 wait complete. 2024-05-08T18:31:19.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.157+0000 7f7b92727800 1 Processor -- start 2024-05-08T18:31:19.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.157+0000 7f7b92727800 1 -- start start 2024-05-08T18:31:19.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.157+0000 7f7b92727800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 0x56256546a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.157+0000 7f7b92727800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5625652c45b0 con 0x562565379cd0 2024-05-08T18:31:19.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.157+0000 7f7b8e36a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 0x56256546a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.157+0000 7f7b8e36a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 0x56256546a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33300/0 (socket says 172.21.15.87:33300) 2024-05-08T18:31:19.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.157+0000 7f7b8e36a640 1 -- 172.21.15.87:0/1283797113 learned_addr learned my addr 172.21.15.87:0/1283797113 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.158+0000 7f7b8e36a640 1 -- 172.21.15.87:0/1283797113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56256546abf0 con 0x562565379cd0 2024-05-08T18:31:19.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.158+0000 7f7b8e36a640 1 --2- 172.21.15.87:0/1283797113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 0x56256546a620 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7b80055040 tx=0x7f7b8004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d196f57ad8ad3a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.158+0000 7f7a7c608640 1 -- 172.21.15.87:0/1283797113 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b80057040 con 0x562565379cd0 2024-05-08T18:31:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.158+0000 7f7a7c608640 1 -- 172.21.15.87:0/1283797113 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b80052990 con 0x562565379cd0 2024-05-08T18:31:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.158+0000 7f7a7c608640 1 -- 172.21.15.87:0/1283797113 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b80052c70 con 0x562565379cd0 2024-05-08T18:31:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.159+0000 7f7b92727800 1 -- 172.21.15.87:0/1283797113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 msgr2=0x56256546a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.159+0000 7f7b92727800 1 --2- 172.21.15.87:0/1283797113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 0x56256546a620 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7b80055040 tx=0x7f7b8004c000 comp rx=0 tx=0).stop 2024-05-08T18:31:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.159+0000 7f7b92727800 1 -- 172.21.15.87:0/1283797113 shutdown_connections 2024-05-08T18:31:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.159+0000 7f7b92727800 1 --2- 172.21.15.87:0/1283797113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 0x56256546a620 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.159+0000 7f7b92727800 1 -- 172.21.15.87:0/1283797113 >> 172.21.15.87:0/1283797113 conn(0x562565373720 msgr2=0x562565465f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.159+0000 7f7b92727800 1 -- 172.21.15.87:0/1283797113 shutdown_connections 2024-05-08T18:31:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.159+0000 7f7b92727800 1 -- 172.21.15.87:0/1283797113 wait complete. 2024-05-08T18:31:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.159+0000 7f7b92727800 1 Processor -- start 2024-05-08T18:31:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.159+0000 7f7b92727800 1 -- start start 2024-05-08T18:31:19.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.159+0000 7f7b92727800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 0x5625654720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.159+0000 7f7b92727800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562565380580 con 0x562565379cd0 2024-05-08T18:31:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.159+0000 7f7b8e36a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 0x5625654720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.159+0000 7f7b8e36a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 0x5625654720e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33308/0 (socket says 172.21.15.87:33308) 2024-05-08T18:31:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.159+0000 7f7b8e36a640 1 -- 172.21.15.87:0/16973959 learned_addr learned my addr 172.21.15.87:0/16973959 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.160+0000 7f7b8e36a640 1 -- 172.21.15.87:0/16973959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562565472620 con 0x562565379cd0 2024-05-08T18:31:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.160+0000 7f7b8e36a640 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 0x5625654720e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000a470 tx=0x7f7b80003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.160+0000 7f7a7ae05640 1 -- 172.21.15.87:0/16973959 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b80073070 con 0x562565379cd0 2024-05-08T18:31:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.160+0000 7f7a7ae05640 1 -- 172.21.15.87:0/16973959 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b8005d780 con 0x562565379cd0 2024-05-08T18:31:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.160+0000 7f7b92727800 1 -- 172.21.15.87:0/16973959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625654728b0 con 0x562565379cd0 2024-05-08T18:31:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.160+0000 7f7a7ae05640 1 -- 172.21.15.87:0/16973959 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b80057070 con 0x562565379cd0 2024-05-08T18:31:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.160+0000 7f7b92727800 1 -- 172.21.15.87:0/16973959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625654754c0 con 0x562565379cd0 2024-05-08T18:31:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.161+0000 7f7a7ae05640 1 -- 172.21.15.87:0/16973959 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7b80076070 con 0x562565379cd0 2024-05-08T18:31:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.161+0000 7f7a7ae05640 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a7403bb50 0x7f7a7403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.161+0000 7f7a7ae05640 1 -- 172.21.15.87:0/16973959 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7b80094470 con 0x562565379cd0 2024-05-08T18:31:19.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.161+0000 7f7b87fff640 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a7403bb50 0x7f7a7403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.161+0000 7f7b92727800 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56256537c600 0x562565479280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.161+0000 7f7b92727800 1 -- 172.21.15.87:0/16973959 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625654797c0 con 0x56256537c600 2024-05-08T18:31:19.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.161+0000 7f7b8eb6b640 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56256537c600 0x562565479280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.161+0000 7f7b87fff640 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a7403bb50 0x7f7a7403e010 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7b78000f60 tx=0x7f7b780012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.162+0000 7f7b8eb6b640 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56256537c600 0x562565479280 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.162+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/16973959 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b8800a4a0 con 0x56256537c600 2024-05-08T18:31:19.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.162+0000 7f7b92727800 1 -- 172.21.15.87:0/16973959 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562565476850 con 0x56256537c600 2024-05-08T18:31:19.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.162+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/16973959 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b8800a4a0 con 0x56256537c600 2024-05-08T18:31:19.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.162+0000 7f7b92727800 1 -- 172.21.15.87:0/16973959 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56256547b5c0 con 0x56256537c600 2024-05-08T18:31:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.162+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/16973959 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7b8800a4a0 con 0x56256537c600 2024-05-08T18:31:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.162+0000 7f7b92727800 1 -- 172.21.15.87:0/16973959 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56256547a7f0 con 0x56256537c600 2024-05-08T18:31:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.163+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/16973959 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b8800a4a0 con 0x56256537c600 2024-05-08T18:31:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.163+0000 7f7b92727800 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56256547c970 0x56256547ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.163+0000 7f7b92727800 1 -- 172.21.15.87:0/16973959 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56256547f2a0 con 0x56256547c970 2024-05-08T18:31:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.163+0000 7f7b8e36a640 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56256547c970 0x56256547ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.163+0000 7f7b8e36a640 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56256547c970 0x56256547ed60 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.163+0000 7f7b8e36a640 1 -- 172.21.15.87:0/16973959 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b80075030 con 0x56256547c970 2024-05-08T18:31:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.164+0000 7f7b92727800 1 Processor -- start 2024-05-08T18:31:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.164+0000 7f7b92727800 1 -- start start 2024-05-08T18:31:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.164+0000 7f7b92727800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56256548d4e0 0x56256548d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.164+0000 7f7b92727800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56256526afc0 con 0x56256548d4e0 2024-05-08T18:31:19.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.164+0000 7f7b8eb6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56256548d4e0 0x56256548d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.164+0000 7f7b8eb6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56256548d4e0 0x56256548d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33314/0 (socket says 172.21.15.87:33314) 2024-05-08T18:31:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.164+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/7548328 learned_addr learned my addr 172.21.15.87:0/7548328 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.164+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/7548328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56256548de40 con 0x56256548d4e0 2024-05-08T18:31:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.165+0000 7f7b8eb6b640 1 --2- 172.21.15.87:0/7548328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56256548d4e0 0x56256548d900 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x562565473440 tx=0x7f7b880178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.165+0000 7f7a73fff640 1 -- 172.21.15.87:0/7548328 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b88013440 con 0x56256548d4e0 2024-05-08T18:31:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.165+0000 7f7a73fff640 1 -- 172.21.15.87:0/7548328 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b880135e0 con 0x56256548d4e0 2024-05-08T18:31:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.165+0000 7f7b92727800 1 -- 172.21.15.87:0/7548328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56256548e8b0 con 0x56256548d4e0 2024-05-08T18:31:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.165+0000 7f7a73fff640 1 -- 172.21.15.87:0/7548328 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b880138c0 con 0x56256548d4e0 2024-05-08T18:31:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.165+0000 7f7b92727800 1 -- 172.21.15.87:0/7548328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56256548edb0 con 0x56256548d4e0 2024-05-08T18:31:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.166+0000 7f7a73fff640 1 -- 172.21.15.87:0/7548328 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7b88011040 con 0x56256548d4e0 2024-05-08T18:31:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.166+0000 7f7a73fff640 1 --2- 172.21.15.87:0/7548328 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a6803bb50 0x7f7a6803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.166+0000 7f7a73fff640 1 -- 172.21.15.87:0/7548328 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7b8801d070 con 0x56256548d4e0 2024-05-08T18:31:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.166+0000 7f7b8e36a640 1 --2- 172.21.15.87:0/7548328 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a6803bb50 0x7f7a6803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.166+0000 7f7b92727800 1 Processor -- start 2024-05-08T18:31:19.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.166+0000 7f7b8e36a640 1 --2- 172.21.15.87:0/7548328 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a6803bb50 0x7f7a6803e010 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7b8005b730 tx=0x7f7b80092770 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.166+0000 7f7b92727800 1 -- start start 2024-05-08T18:31:19.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.166+0000 7f7b92727800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625653792c0 0x5625653796e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.166+0000 7f7b92727800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56256546aeb0 con 0x5625653792c0 2024-05-08T18:31:19.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.166+0000 7f7b8eb6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625653792c0 0x5625653796e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.167+0000 7f7b8eb6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625653792c0 0x5625653796e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33326/0 (socket says 172.21.15.87:33326) 2024-05-08T18:31:19.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.167+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/2559381187 learned_addr learned my addr 172.21.15.87:0/2559381187 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.167+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/2559381187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562565377ac0 con 0x5625653792c0 2024-05-08T18:31:19.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.167+0000 7f7b8eb6b640 1 --2- 172.21.15.87:0/2559381187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625653792c0 0x5625653796e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7b880529a0 tx=0x7f7b88001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147b07cce08e7eeb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.167+0000 7f7a71ffb640 1 -- 172.21.15.87:0/2559381187 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b8802ad80 con 0x5625653792c0 2024-05-08T18:31:19.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.167+0000 7f7a71ffb640 1 -- 172.21.15.87:0/2559381187 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b880540d0 con 0x5625653792c0 2024-05-08T18:31:19.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.167+0000 7f7a71ffb640 1 -- 172.21.15.87:0/2559381187 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b880543f0 con 0x5625653792c0 2024-05-08T18:31:19.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.167+0000 7f7b92727800 1 -- 172.21.15.87:0/2559381187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625653792c0 msgr2=0x5625653796e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.167+0000 7f7b92727800 1 --2- 172.21.15.87:0/2559381187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625653792c0 0x5625653796e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7b880529a0 tx=0x7f7b88001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:19.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.167+0000 7f7b92727800 1 -- 172.21.15.87:0/2559381187 shutdown_connections 2024-05-08T18:31:19.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.167+0000 7f7b92727800 1 --2- 172.21.15.87:0/2559381187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625653792c0 0x5625653796e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.167+0000 7f7b92727800 1 -- 172.21.15.87:0/2559381187 >> 172.21.15.87:0/2559381187 conn(0x562565496b60 msgr2=0x562565494bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.167+0000 7f7b92727800 1 -- 172.21.15.87:0/2559381187 shutdown_connections 2024-05-08T18:31:19.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.168+0000 7f7b92727800 1 -- 172.21.15.87:0/2559381187 wait complete. 2024-05-08T18:31:19.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.168+0000 7f7b92727800 1 Processor -- start 2024-05-08T18:31:19.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.168+0000 7f7b92727800 1 -- start start 2024-05-08T18:31:19.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.168+0000 7f7b92727800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625653792c0 0x5625654a3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.168+0000 7f7b92727800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562565377f90 con 0x5625653792c0 2024-05-08T18:31:19.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.168+0000 7f7b8eb6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625653792c0 0x5625654a3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.168+0000 7f7b8eb6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625653792c0 0x5625654a3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33340/0 (socket says 172.21.15.87:33340) 2024-05-08T18:31:19.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.168+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 learned_addr learned my addr 172.21.15.87:0/4046646805 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.168+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625654a44a0 con 0x5625653792c0 2024-05-08T18:31:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.169+0000 7f7b8eb6b640 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625653792c0 0x5625654a3f60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7b88015fd0 tx=0x7f7b88052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.169+0000 7f7a5ffff640 1 -- 172.21.15.87:0/4046646805 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b88030020 con 0x5625653792c0 2024-05-08T18:31:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.169+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625654a4730 con 0x5625653792c0 2024-05-08T18:31:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.169+0000 7f7a5ffff640 1 -- 172.21.15.87:0/4046646805 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b88051310 con 0x5625653792c0 2024-05-08T18:31:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.169+0000 7f7a5ffff640 1 -- 172.21.15.87:0/4046646805 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b88013a60 con 0x5625653792c0 2024-05-08T18:31:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.169+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625654a73e0 con 0x5625653792c0 2024-05-08T18:31:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.169+0000 7f7a5ffff640 1 -- 172.21.15.87:0/4046646805 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7b88033020 con 0x5625653792c0 2024-05-08T18:31:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.170+0000 7f7a5ffff640 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a5803bb50 0x7f7a5803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.170+0000 7f7a5ffff640 1 -- 172.21.15.87:0/4046646805 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7b8800e040 con 0x5625653792c0 2024-05-08T18:31:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.170+0000 7f7b8e36a640 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a5803bb50 0x7f7a5803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.170+0000 7f7b92727800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.170+0000 7f7b92727800 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5625654afbc0 0x5625654b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.170+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625654b27d0 con 0x5625654afbc0 2024-05-08T18:31:19.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.170+0000 7f7b87fff640 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5625654afbc0 0x5625654b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.170+0000 7f7b8e36a640 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a5803bb50 0x7f7a5803e010 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7b80092b00 tx=0x7f7b80085000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.170+0000 7f7b87fff640 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5625654afbc0 0x5625654b2080 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b78009050 con 0x5625654afbc0 2024-05-08T18:31:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b92727800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b92727800 20 realm 2024-05-08T18:31:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b92727800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625654af010 con 0x5625654afbc0 2024-05-08T18:31:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b78009050 con 0x5625654afbc0 2024-05-08T18:31:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b92727800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b92727800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b92727800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625654b32b0 con 0x5625654afbc0 2024-05-08T18:31:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b78009050 con 0x5625654afbc0 2024-05-08T18:31:19.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b92727800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b92727800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625654b3b80 con 0x5625654afbc0 2024-05-08T18:31:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b78009050 con 0x5625654afbc0 2024-05-08T18:31:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b92727800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b92727800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.171+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625654b3f20 con 0x5625654afbc0 2024-05-08T18:31:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.172+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7b78009050 con 0x5625654afbc0 2024-05-08T18:31:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.172+0000 7f7b92727800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.172+0000 7f7b92727800 20 searching for the correct realm 2024-05-08T18:31:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.172+0000 7f7b92727800 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5625654b5e00 0x5625654b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.172+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x5625654b5e00 2024-05-08T18:31:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.172+0000 7f7b8eb6b640 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5625654b5e00 0x5625654b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.172+0000 7f7b8eb6b640 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5625654b5e00 0x5625654b81f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.172+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b88029070 con 0x5625654b5e00 2024-05-08T18:31:19.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.172+0000 7f7b8eb6b640 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f7b88035020 0x7f7b88008970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.172+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x7f7b88035020 2024-05-08T18:31:19.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.173+0000 7f7b8e36a640 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f7b88035020 0x7f7b88008970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.173+0000 7f7b8e36a640 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f7b88035020 0x7f7b88008970 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.173+0000 7f7b8e36a640 1 -- 172.21.15.87:0/4046646805 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80075030 con 0x7f7b88035020 2024-05-08T18:31:19.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.173+0000 7f7b8e36a640 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7b80078060 0x7f7b80076580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.173+0000 7f7b8e36a640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x7f7b80078060 2024-05-08T18:31:19.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.173+0000 7f7b87fff640 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7b80078060 0x7f7b80076580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.174+0000 7f7b87fff640 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7b80078060 0x7f7b80076580 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.174+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78009050 con 0x7f7b80078060 2024-05-08T18:31:19.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.174+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x5625654afbc0 2024-05-08T18:31:19.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.174+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78009050 con 0x5625654afbc0 2024-05-08T18:31:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.174+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x5625654afbc0 2024-05-08T18:31:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.174+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.174+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x7f7b80078060 2024-05-08T18:31:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.175+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.175+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x7f7b80078060 2024-05-08T18:31:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.175+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.175+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x7f7b88035020 2024-05-08T18:31:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.175+0000 7f7b8e36a640 1 -- 172.21.15.87:0/4046646805 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80075030 con 0x7f7b88035020 2024-05-08T18:31:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.175+0000 7f7b8e36a640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x5625654b5e00 2024-05-08T18:31:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.175+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b88029070 con 0x5625654b5e00 2024-05-08T18:31:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.175+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x5625654afbc0 2024-05-08T18:31:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.175+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.175+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x7f7b80078060 2024-05-08T18:31:19.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.176+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.176+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x5625654afbc0 2024-05-08T18:31:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.176+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.176+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x7f7b88035020 2024-05-08T18:31:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.176+0000 7f7b8e36a640 1 -- 172.21.15.87:0/4046646805 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7b80075030 con 0x7f7b88035020 2024-05-08T18:31:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.176+0000 7f7b8e36a640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x5625654b5e00 2024-05-08T18:31:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.177+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b88029070 con 0x5625654b5e00 2024-05-08T18:31:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.177+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x5625654b5e00 2024-05-08T18:31:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.177+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b88029070 con 0x5625654b5e00 2024-05-08T18:31:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.177+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x7f7b80078060 2024-05-08T18:31:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.177+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.177+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x5625654b5e00 2024-05-08T18:31:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.177+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b88029070 con 0x5625654b5e00 2024-05-08T18:31:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.177+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x5625654b5e00 2024-05-08T18:31:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.178+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b88029070 con 0x5625654b5e00 2024-05-08T18:31:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.178+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x5625654afbc0 2024-05-08T18:31:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.178+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.178+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x5625654afbc0 2024-05-08T18:31:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.178+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.178+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x7f7b80078060 2024-05-08T18:31:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.178+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.178+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x5625654b5e00 2024-05-08T18:31:19.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.179+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b88029070 con 0x5625654b5e00 2024-05-08T18:31:19.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.179+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x7f7b88035020 2024-05-08T18:31:19.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.179+0000 7f7b8e36a640 1 -- 172.21.15.87:0/4046646805 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80075030 con 0x7f7b88035020 2024-05-08T18:31:19.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.179+0000 7f7b8e36a640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x5625654afbc0 2024-05-08T18:31:19.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.179+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.179+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x7f7b80078060 2024-05-08T18:31:19.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.179+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.179+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x5625654b5e00 2024-05-08T18:31:19.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.180+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b88029070 con 0x5625654b5e00 2024-05-08T18:31:19.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.180+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x7f7b80078060 2024-05-08T18:31:19.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.180+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.180+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x7f7b88035020 2024-05-08T18:31:19.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.180+0000 7f7b8e36a640 1 -- 172.21.15.87:0/4046646805 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80075030 con 0x7f7b88035020 2024-05-08T18:31:19.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.180+0000 7f7b8e36a640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x5625654b5e00 2024-05-08T18:31:19.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.180+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b88029070 con 0x5625654b5e00 2024-05-08T18:31:19.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.180+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x7f7b80078060 2024-05-08T18:31:19.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.181+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.181+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x5625654afbc0 2024-05-08T18:31:19.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.181+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.181+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625654b88a0 con 0x7f7b88035020 2024-05-08T18:31:19.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.181+0000 7f7b8e36a640 1 -- 172.21.15.87:0/4046646805 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80075030 con 0x7f7b88035020 2024-05-08T18:31:19.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.181+0000 7f7b92727800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:19.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.181+0000 7f7b92727800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:19.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.181+0000 7f7b92727800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:19.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.181+0000 7f7b92727800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:19.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.181+0000 7f7b92727800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:19.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.181+0000 7f7b92727800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:19.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.181+0000 7f7b92727800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.181+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625654b48d0 con 0x5625654afbc0 2024-05-08T18:31:19.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.181+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.181+0000 7f7b92727800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.181+0000 7f7b92727800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.181+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625654b5170 con 0x5625654afbc0 2024-05-08T18:31:19.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b92727800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:19.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b92727800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625654b4510 con 0x7f7b80078060 2024-05-08T18:31:19.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b92727800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:19.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b92727800 20 zone default found 2024-05-08T18:31:19.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b92727800 4 Realm: () 2024-05-08T18:31:19.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b92727800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:19.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b92727800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:19.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b92727800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:19.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b92727800 20 zonegroup default 2024-05-08T18:31:19.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b92727800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625654b8d00 con 0x7f7b80078060 2024-05-08T18:31:19.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b92727800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b92727800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.182+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625654bab90 con 0x5625654b5e00 2024-05-08T18:31:19.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.183+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b88029070 con 0x5625654b5e00 2024-05-08T18:31:19.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.183+0000 7f7b92727800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.183+0000 7f7b92727800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.183+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625654baf30 con 0x5625654b5e00 2024-05-08T18:31:19.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.183+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b88029070 con 0x5625654b5e00 2024-05-08T18:31:19.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.183+0000 7f7b92727800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.183+0000 7f7b92727800 20 started sync module instance, tier type = 2024-05-08T18:31:19.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.183+0000 7f7b92727800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:19.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.183+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654b9fd0 con 0x7f7b88035020 2024-05-08T18:31:19.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.184+0000 7f7b8e36a640 1 -- 172.21.15.87:0/4046646805 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80075030 con 0x7f7b88035020 2024-05-08T18:31:19.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.184+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94718613234624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654ba7e0 con 0x7f7b88035020 2024-05-08T18:31:19.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.184+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654bbcb0 con 0x5625654afbc0 2024-05-08T18:31:19.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.185+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.185+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94718613239680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654bc550 con 0x5625654afbc0 2024-05-08T18:31:19.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.185+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654bd050 con 0x5625654b5e00 2024-05-08T18:31:19.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.185+0000 7f7b8e36a640 1 -- 172.21.15.87:0/4046646805 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94718613234624] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80075030 con 0x7f7b88035020 2024-05-08T18:31:19.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.186+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94718613239680] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.186+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b88029070 con 0x5625654b5e00 2024-05-08T18:31:19.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.186+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94718613238480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654bc550 con 0x5625654b5e00 2024-05-08T18:31:19.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.186+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654bd950 con 0x7f7b88035020 2024-05-08T18:31:19.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.187+0000 7f7b8e36a640 1 -- 172.21.15.87:0/4046646805 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80075030 con 0x7f7b88035020 2024-05-08T18:31:19.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.187+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94718613247040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654be1f0 con 0x7f7b88035020 2024-05-08T18:31:19.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.187+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654becc0 con 0x5625654afbc0 2024-05-08T18:31:19.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.187+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94718613238480] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b88029070 con 0x5625654b5e00 2024-05-08T18:31:19.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.188+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.188+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94718613252016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654bf0b0 con 0x5625654afbc0 2024-05-08T18:31:19.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.188+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654bfab0 con 0x7f7b80078060 2024-05-08T18:31:19.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.188+0000 7f7b8e36a640 1 -- 172.21.15.87:0/4046646805 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94718613247040] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80075030 con 0x7f7b88035020 2024-05-08T18:31:19.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.189+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.189+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94718613249344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654bfa70 con 0x7f7b80078060 2024-05-08T18:31:19.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.189+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654c04c0 con 0x7f7b80078060 2024-05-08T18:31:19.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.189+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94718613252016] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.190+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94718613249344] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.190+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.190+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94718613255616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654bf9e0 con 0x7f7b80078060 2024-05-08T18:31:19.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.190+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654c0970 con 0x7f7b80078060 2024-05-08T18:31:19.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.191+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94718613255616] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.191+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.191+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94718613258256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654c08e0 con 0x7f7b80078060 2024-05-08T18:31:19.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.191+0000 7f7b92727800 20 add_watcher() i=0 2024-05-08T18:31:19.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.191+0000 7f7b92727800 20 add_watcher() i=1 2024-05-08T18:31:19.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.191+0000 7f7b92727800 20 add_watcher() i=2 2024-05-08T18:31:19.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.191+0000 7f7b92727800 20 add_watcher() i=3 2024-05-08T18:31:19.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.191+0000 7f7b92727800 20 add_watcher() i=4 2024-05-08T18:31:19.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.191+0000 7f7b92727800 20 add_watcher() i=5 2024-05-08T18:31:19.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.191+0000 7f7b92727800 20 add_watcher() i=6 2024-05-08T18:31:19.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.192+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94718613258256] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.192+0000 7f7b92727800 20 add_watcher() i=7 2024-05-08T18:31:19.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.192+0000 7f7b92727800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:19.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.192+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625654c3d40 con 0x5625654afbc0 2024-05-08T18:31:19.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.192+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.192+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94718613259776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654c1260 con 0x5625654afbc0 2024-05-08T18:31:19.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.193+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94718613259776] v27'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.193+0000 7f7a44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:19.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.193+0000 7f7b92727800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:19.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.193+0000 7f7b92727800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:19.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.193+0000 7f7b92727800 5 note: GC not initialized 2024-05-08T18:31:19.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.194+0000 7f79bf7fe640 20 reqs_thread_entry: start 2024-05-08T18:31:19.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.194+0000 7f7b92727800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:19.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.194+0000 7f7b92727800 20 Filter name: none 2024-05-08T18:31:19.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.194+0000 7f79bd7fa640 20 reqs_thread_entry: start 2024-05-08T18:31:19.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.194+0000 7f7b92727800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.194+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625654f6d80 con 0x5625654afbc0 2024-05-08T18:31:19.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.194+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.194+0000 7f7b92727800 20 rados_obj.operate() r=0 bl.length=673 2024-05-08T18:31:19.206 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-08T18:31:19.069601Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:19.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.195+0000 7f7a44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:19.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.195+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94718613259776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654f7160 con 0x5625654afbc0 2024-05-08T18:31:19.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.196+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94718613259776] v27'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.196+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94718613234624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654f7160 con 0x7f7b88035020 2024-05-08T18:31:19.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.197+0000 7f7b8e36a640 1 -- 172.21.15.87:0/4046646805 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94718613234624] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80075030 con 0x7f7b88035020 2024-05-08T18:31:19.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.197+0000 7f7b92727800 20 remove_watcher() i=0 2024-05-08T18:31:19.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.197+0000 7f7b92727800 2 removed watcher, disabling cache 2024-05-08T18:31:19.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.197+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94718613239680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654ba3c0 con 0x5625654afbc0 2024-05-08T18:31:19.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.198+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94718613239680] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.199+0000 7f7b92727800 20 remove_watcher() i=1 2024-05-08T18:31:19.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.199+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94718613238480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654ba3c0 con 0x5625654b5e00 2024-05-08T18:31:19.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.200+0000 7f7b8eb6b640 1 -- 172.21.15.87:0/4046646805 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94718613238480] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b88029070 con 0x5625654b5e00 2024-05-08T18:31:19.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.200+0000 7f7b92727800 20 remove_watcher() i=2 2024-05-08T18:31:19.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.200+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94718613247040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654ba3c0 con 0x7f7b88035020 2024-05-08T18:31:19.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.201+0000 7f7b8e36a640 1 -- 172.21.15.87:0/4046646805 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94718613247040] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80075030 con 0x7f7b88035020 2024-05-08T18:31:19.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.201+0000 7f7b92727800 20 remove_watcher() i=3 2024-05-08T18:31:19.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.201+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94718613252016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654bb2d0 con 0x5625654afbc0 2024-05-08T18:31:19.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.202+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94718613252016] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x5625654afbc0 2024-05-08T18:31:19.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.202+0000 7f7b92727800 20 remove_watcher() i=4 2024-05-08T18:31:19.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.202+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94718613249344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654be7b0 con 0x7f7b80078060 2024-05-08T18:31:19.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.202+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94718613249344] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.202+0000 7f7b92727800 20 remove_watcher() i=5 2024-05-08T18:31:19.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.203+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94718613255616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654be7b0 con 0x7f7b80078060 2024-05-08T18:31:19.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.204+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94718613255616] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.204+0000 7f7b92727800 20 remove_watcher() i=6 2024-05-08T18:31:19.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.204+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94718613258256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625654be7b0 con 0x7f7b80078060 2024-05-08T18:31:19.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.204+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94718613258256] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7802a040 con 0x7f7b80078060 2024-05-08T18:31:19.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.204+0000 7f7b92727800 20 remove_watcher() i=7 2024-05-08T18:31:19.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7b80078060 msgr2=0x7f7b80076580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7b80078060 0x7f7b80076580 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5625654afbc0 msgr2=0x5625654b2080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5625654afbc0 0x5625654b2080 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f7b88035020 msgr2=0x7f7b88008970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f7b88035020 0x7f7b88008970 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5625654b5e00 msgr2=0x5625654b81f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5625654b5e00 0x5625654b81f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a5803bb50 msgr2=0x7f7a5803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a5803bb50 0x7f7a5803e010 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7b80092b00 tx=0x7f7b80085000 comp rx=0 tx=0).stop 2024-05-08T18:31:19.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625653792c0 msgr2=0x5625654a3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 --2- 172.21.15.87:0/4046646805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625653792c0 0x5625654a3f60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7b88015fd0 tx=0x7f7b88052900 comp rx=0 tx=0).stop 2024-05-08T18:31:19.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 reap_dead start 2024-05-08T18:31:19.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b87fff640 1 -- 172.21.15.87:0/4046646805 reap_dead start 2024-05-08T18:31:19.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 shutdown_connections 2024-05-08T18:31:19.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 >> 172.21.15.87:0/4046646805 conn(0x562565496b60 msgr2=0x5625654941c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 shutdown_connections 2024-05-08T18:31:19.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 -- 172.21.15.87:0/4046646805 wait complete. 2024-05-08T18:31:19.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 -- 172.21.15.87:0/7548328 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a6803bb50 msgr2=0x7f7a6803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 --2- 172.21.15.87:0/7548328 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a6803bb50 0x7f7a6803e010 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7b8005b730 tx=0x7f7b80092770 comp rx=0 tx=0).stop 2024-05-08T18:31:19.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 -- 172.21.15.87:0/7548328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56256548d4e0 msgr2=0x56256548d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 --2- 172.21.15.87:0/7548328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56256548d4e0 0x56256548d900 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x562565473440 tx=0x7f7b880178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 -- 172.21.15.87:0/7548328 shutdown_connections 2024-05-08T18:31:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 --2- 172.21.15.87:0/7548328 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a6803bb50 0x7f7a6803e010 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 --2- 172.21.15.87:0/7548328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56256548d4e0 0x56256548d900 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 -- 172.21.15.87:0/7548328 >> 172.21.15.87:0/7548328 conn(0x562565481580 msgr2=0x562565481980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 -- 172.21.15.87:0/7548328 shutdown_connections 2024-05-08T18:31:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.205+0000 7f7b92727800 1 -- 172.21.15.87:0/7548328 wait complete. 2024-05-08T18:31:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.206+0000 7f7b92727800 1 -- 172.21.15.87:0/16973959 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56256547c970 msgr2=0x56256547ed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.206+0000 7f7b92727800 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56256547c970 0x56256547ed60 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.206+0000 7f7b92727800 1 -- 172.21.15.87:0/16973959 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56256537c600 msgr2=0x562565479280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.206+0000 7f7b92727800 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56256537c600 0x562565479280 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.206+0000 7f7b92727800 1 -- 172.21.15.87:0/16973959 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a7403bb50 msgr2=0x7f7a7403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.206+0000 7f7b92727800 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a7403bb50 0x7f7a7403e010 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7b78000f60 tx=0x7f7b780012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.206+0000 7f7b92727800 1 -- 172.21.15.87:0/16973959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 msgr2=0x5625654720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.206+0000 7f7b92727800 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 0x5625654720e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000a470 tx=0x7f7b80003020 comp rx=0 tx=0).stop 2024-05-08T18:31:19.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.206+0000 7f7b92727800 1 -- 172.21.15.87:0/16973959 shutdown_connections 2024-05-08T18:31:19.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.206+0000 7f7b92727800 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56256537c600 0x562565479280 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.206+0000 7f7b92727800 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56256547c970 0x56256547ed60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.206+0000 7f7b92727800 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a7403bb50 0x7f7a7403e010 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.206+0000 7f7b92727800 1 --2- 172.21.15.87:0/16973959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562565379cd0 0x5625654720e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.206+0000 7f7b92727800 1 -- 172.21.15.87:0/16973959 >> 172.21.15.87:0/16973959 conn(0x562565373720 msgr2=0x562565464740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.206+0000 7f7b92727800 1 -- 172.21.15.87:0/16973959 shutdown_connections 2024-05-08T18:31:19.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.206+0000 7f7b92727800 1 -- 172.21.15.87:0/16973959 wait complete. 2024-05-08T18:31:19.217 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-08T18:31:19.069601Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:19.217 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-05-08T18:31:19.217 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-05-08T18:31:19.217 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-05-08T18:31:19.263 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:19.263 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:19.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.266+0000 7f654a91f800 1 Processor -- start 2024-05-08T18:31:19.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.266+0000 7f654a91f800 1 -- start start 2024-05-08T18:31:19.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.266+0000 7f654a91f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5562da9096d0 0x5562da9121d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.266+0000 7f654a91f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5562da87cd90 con 0x5562da907b90 2024-05-08T18:31:19.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.266+0000 7f654a91f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5562da7a9e20 con 0x5562da9096d0 2024-05-08T18:31:19.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.266+0000 7f6545dbb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5562da9096d0 0x5562da9121d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.266+0000 7f65465bc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5562da907b90 0x5562da907fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42008/0 (socket says 172.21.15.87:42008) 2024-05-08T18:31:19.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.266+0000 7f65465bc640 1 -- 172.21.15.87:0/3182250408 learned_addr learned my addr 172.21.15.87:0/3182250408 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:19.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.267+0000 7f6545dbb640 1 -- 172.21.15.87:0/3182250408 >> v1:172.21.15.53:6789/0 conn(0x5562da907b90 legacy=0x5562da907fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.267+0000 7f6545dbb640 1 -- 172.21.15.87:0/3182250408 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562da87cf60 con 0x5562da9096d0 2024-05-08T18:31:19.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.268+0000 7f6545dbb640 1 --2- 172.21.15.87:0/3182250408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da9096d0 0x5562da9121d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f653c00a470 tx=0x7f653c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1daa177c9d302137 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.268+0000 7f65455ba640 1 -- 172.21.15.87:0/3182250408 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f653c057070 con 0x5562da9096d0 2024-05-08T18:31:19.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.269+0000 7f65455ba640 1 -- 172.21.15.87:0/3182250408 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653c052570 con 0x5562da9096d0 2024-05-08T18:31:19.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.269+0000 7f65455ba640 1 -- 172.21.15.87:0/3182250408 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f653c052870 con 0x5562da9096d0 2024-05-08T18:31:19.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.269+0000 7f654a91f800 1 -- 172.21.15.87:0/3182250408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da9096d0 msgr2=0x5562da9121d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.269+0000 7f654a91f800 1 --2- 172.21.15.87:0/3182250408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da9096d0 0x5562da9121d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f653c00a470 tx=0x7f653c01ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:19.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.269+0000 7f654a91f800 1 -- 172.21.15.87:0/3182250408 shutdown_connections 2024-05-08T18:31:19.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.269+0000 7f654a91f800 1 --2- 172.21.15.87:0/3182250408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da9096d0 0x5562da9121d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.269+0000 7f654a91f800 1 -- 172.21.15.87:0/3182250408 >> 172.21.15.87:0/3182250408 conn(0x5562da9036b0 msgr2=0x5562da905b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.269+0000 7f654a91f800 1 -- 172.21.15.87:0/3182250408 shutdown_connections 2024-05-08T18:31:19.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.269+0000 7f654a91f800 1 -- 172.21.15.87:0/3182250408 wait complete. 2024-05-08T18:31:19.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.282+0000 7f654a91f800 1 Processor -- start 2024-05-08T18:31:19.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.283+0000 7f654a91f800 1 -- start start 2024-05-08T18:31:19.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.283+0000 7f654a91f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da907b90 0x5562da9fc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.283+0000 7f654a91f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5562da8545c0 con 0x5562da907b90 2024-05-08T18:31:19.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.283+0000 7f65465bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da907b90 0x5562da9fc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.283+0000 7f65465bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da907b90 0x5562da9fc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33354/0 (socket says 172.21.15.87:33354) 2024-05-08T18:31:19.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.283+0000 7f65465bc640 1 -- 172.21.15.87:0/566165670 learned_addr learned my addr 172.21.15.87:0/566165670 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.283+0000 7f65465bc640 1 -- 172.21.15.87:0/566165670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562da9fcdc0 con 0x5562da907b90 2024-05-08T18:31:19.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.283+0000 7f65465bc640 1 --2- 172.21.15.87:0/566165670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da907b90 0x5562da9fc7f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6538001d50 tx=0x7f653800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93edbf63ebabe230 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.284+0000 7f6434608640 1 -- 172.21.15.87:0/566165670 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6538013030 con 0x5562da907b90 2024-05-08T18:31:19.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.284+0000 7f6434608640 1 -- 172.21.15.87:0/566165670 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653800e470 con 0x5562da907b90 2024-05-08T18:31:19.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.284+0000 7f6434608640 1 -- 172.21.15.87:0/566165670 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f653800e810 con 0x5562da907b90 2024-05-08T18:31:19.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.284+0000 7f654a91f800 1 -- 172.21.15.87:0/566165670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da907b90 msgr2=0x5562da9fc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.284+0000 7f654a91f800 1 --2- 172.21.15.87:0/566165670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da907b90 0x5562da9fc7f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6538001d50 tx=0x7f653800b6c0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.284+0000 7f654a91f800 1 -- 172.21.15.87:0/566165670 shutdown_connections 2024-05-08T18:31:19.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.284+0000 7f654a91f800 1 --2- 172.21.15.87:0/566165670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da907b90 0x5562da9fc7f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.284+0000 7f654a91f800 1 -- 172.21.15.87:0/566165670 >> 172.21.15.87:0/566165670 conn(0x5562da9036b0 msgr2=0x5562da9f8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.284+0000 7f654a91f800 1 -- 172.21.15.87:0/566165670 shutdown_connections 2024-05-08T18:31:19.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.284+0000 7f654a91f800 1 -- 172.21.15.87:0/566165670 wait complete. 2024-05-08T18:31:19.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.285+0000 7f654a91f800 1 Processor -- start 2024-05-08T18:31:19.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.285+0000 7f654a91f800 1 -- start start 2024-05-08T18:31:19.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.285+0000 7f654a91f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da907b90 0x5562daa04390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.285+0000 7f654a91f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5562da9129e0 con 0x5562da907b90 2024-05-08T18:31:19.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.285+0000 7f65465bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da907b90 0x5562daa04390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.285+0000 7f65465bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da907b90 0x5562daa04390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33358/0 (socket says 172.21.15.87:33358) 2024-05-08T18:31:19.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.285+0000 7f65465bc640 1 -- 172.21.15.87:0/4214404286 learned_addr learned my addr 172.21.15.87:0/4214404286 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.285+0000 7f65465bc640 1 -- 172.21.15.87:0/4214404286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562daa048d0 con 0x5562da907b90 2024-05-08T18:31:19.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.285+0000 7f65465bc640 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da907b90 0x5562daa04390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x5562da9fd580 tx=0x7f6538000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.286+0000 7f6432e05640 1 -- 172.21.15.87:0/4214404286 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6538027070 con 0x5562da907b90 2024-05-08T18:31:19.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.286+0000 7f6432e05640 1 -- 172.21.15.87:0/4214404286 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6538019900 con 0x5562da907b90 2024-05-08T18:31:19.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.286+0000 7f654a91f800 1 -- 172.21.15.87:0/4214404286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562daa04b60 con 0x5562da907b90 2024-05-08T18:31:19.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.286+0000 7f6432e05640 1 -- 172.21.15.87:0/4214404286 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6538019c40 con 0x5562da907b90 2024-05-08T18:31:19.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.286+0000 7f654a91f800 1 -- 172.21.15.87:0/4214404286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562daa07810 con 0x5562da907b90 2024-05-08T18:31:19.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.287+0000 7f6432e05640 1 -- 172.21.15.87:0/4214404286 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f653802a070 con 0x5562da907b90 2024-05-08T18:31:19.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.287+0000 7f6432e05640 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f642c03bb50 0x7f642c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.287+0000 7f6432e05640 1 -- 172.21.15.87:0/4214404286 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f653801f070 con 0x5562da907b90 2024-05-08T18:31:19.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.287+0000 7f6545dbb640 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f642c03bb50 0x7f642c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.287+0000 7f654a91f800 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5562da9096d0 0x5562daa0b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.287+0000 7f654a91f800 1 -- 172.21.15.87:0/4214404286 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa0bb50 con 0x5562da9096d0 2024-05-08T18:31:19.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.287+0000 7f6546dbd640 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5562da9096d0 0x5562daa0b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.287+0000 7f6545dbb640 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f642c03bb50 0x7f642c03e010 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f653c054000 tx=0x7f653c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.287+0000 7f6546dbd640 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5562da9096d0 0x5562daa0b5d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.288+0000 7f6546dbd640 1 -- 172.21.15.87:0/4214404286 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f654000a4a0 con 0x5562da9096d0 2024-05-08T18:31:19.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.288+0000 7f654a91f800 1 -- 172.21.15.87:0/4214404286 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa08ba0 con 0x5562da9096d0 2024-05-08T18:31:19.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.288+0000 7f6546dbd640 1 -- 172.21.15.87:0/4214404286 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f654000a4a0 con 0x5562da9096d0 2024-05-08T18:31:19.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.288+0000 7f654a91f800 1 -- 172.21.15.87:0/4214404286 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa0d970 con 0x5562da9096d0 2024-05-08T18:31:19.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.288+0000 7f6546dbd640 1 -- 172.21.15.87:0/4214404286 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f654000a4a0 con 0x5562da9096d0 2024-05-08T18:31:19.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.288+0000 7f654a91f800 1 -- 172.21.15.87:0/4214404286 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa0cba0 con 0x5562da9096d0 2024-05-08T18:31:19.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.289+0000 7f6546dbd640 1 -- 172.21.15.87:0/4214404286 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f654000a4a0 con 0x5562da9096d0 2024-05-08T18:31:19.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.289+0000 7f654a91f800 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5562daa0ed20 0x5562daa11110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.289+0000 7f654a91f800 1 -- 172.21.15.87:0/4214404286 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa11650 con 0x5562daa0ed20 2024-05-08T18:31:19.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.289+0000 7f65465bc640 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5562daa0ed20 0x5562daa11110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.289+0000 7f65465bc640 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5562daa0ed20 0x5562daa11110 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.289+0000 7f65465bc640 1 -- 172.21.15.87:0/4214404286 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6538029030 con 0x5562daa0ed20 2024-05-08T18:31:19.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.290+0000 7f654a91f800 1 Processor -- start 2024-05-08T18:31:19.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.290+0000 7f654a91f800 1 -- start start 2024-05-08T18:31:19.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.290+0000 7f654a91f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa1f890 0x5562daa1fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.290+0000 7f654a91f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5562da7fafc0 con 0x5562daa1f890 2024-05-08T18:31:19.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.290+0000 7f6546dbd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa1f890 0x5562daa1fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.290+0000 7f6546dbd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa1f890 0x5562daa1fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33374/0 (socket says 172.21.15.87:33374) 2024-05-08T18:31:19.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.290+0000 7f6546dbd640 1 -- 172.21.15.87:0/249844678 learned_addr learned my addr 172.21.15.87:0/249844678 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.290+0000 7f6546dbd640 1 -- 172.21.15.87:0/249844678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562daa201f0 con 0x5562daa1f890 2024-05-08T18:31:19.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.290+0000 7f6546dbd640 1 --2- 172.21.15.87:0/249844678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa1f890 0x5562daa1fcb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x5562daa05790 tx=0x7f65400178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.291+0000 7f642bfff640 1 -- 172.21.15.87:0/249844678 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6540013440 con 0x5562daa1f890 2024-05-08T18:31:19.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.291+0000 7f642bfff640 1 -- 172.21.15.87:0/249844678 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65400135e0 con 0x5562daa1f890 2024-05-08T18:31:19.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.291+0000 7f654a91f800 1 -- 172.21.15.87:0/249844678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562daa20c60 con 0x5562daa1f890 2024-05-08T18:31:19.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.291+0000 7f642bfff640 1 -- 172.21.15.87:0/249844678 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65400138c0 con 0x5562daa1f890 2024-05-08T18:31:19.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.291+0000 7f654a91f800 1 -- 172.21.15.87:0/249844678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562daa21160 con 0x5562daa1f890 2024-05-08T18:31:19.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.291+0000 7f642bfff640 1 -- 172.21.15.87:0/249844678 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6540011040 con 0x5562daa1f890 2024-05-08T18:31:19.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.292+0000 7f642bfff640 1 --2- 172.21.15.87:0/249844678 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f642003bb50 0x7f642003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.292+0000 7f642bfff640 1 -- 172.21.15.87:0/249844678 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f654001d070 con 0x5562daa1f890 2024-05-08T18:31:19.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.292+0000 7f65465bc640 1 --2- 172.21.15.87:0/249844678 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f642003bb50 0x7f642003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.292+0000 7f654a91f800 1 Processor -- start 2024-05-08T18:31:19.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.292+0000 7f65465bc640 1 --2- 172.21.15.87:0/249844678 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f642003bb50 0x7f642003e010 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6538001520 tx=0x7f6538050e50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.292+0000 7f654a91f800 1 -- start start 2024-05-08T18:31:19.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.292+0000 7f654a91f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa2cc00 0x5562daa2d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.292+0000 7f654a91f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5562da9fd140 con 0x5562daa2cc00 2024-05-08T18:31:19.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.292+0000 7f6546dbd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa2cc00 0x5562daa2d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.292+0000 7f6546dbd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa2cc00 0x5562daa2d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33380/0 (socket says 172.21.15.87:33380) 2024-05-08T18:31:19.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.292+0000 7f6546dbd640 1 -- 172.21.15.87:0/2024426933 learned_addr learned my addr 172.21.15.87:0/2024426933 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.293+0000 7f6546dbd640 1 -- 172.21.15.87:0/2024426933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562daa2d5f0 con 0x5562daa2cc00 2024-05-08T18:31:19.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.293+0000 7f6546dbd640 1 --2- 172.21.15.87:0/2024426933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa2cc00 0x5562daa2d020 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f65400529a0 tx=0x7f6540001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f9bf6f872ac04b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.293+0000 7f6429ffb640 1 -- 172.21.15.87:0/2024426933 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f654002ad80 con 0x5562daa2cc00 2024-05-08T18:31:19.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.293+0000 7f6429ffb640 1 -- 172.21.15.87:0/2024426933 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65400014f0 con 0x5562daa2cc00 2024-05-08T18:31:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.293+0000 7f6429ffb640 1 -- 172.21.15.87:0/2024426933 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65400017f0 con 0x5562daa2cc00 2024-05-08T18:31:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.293+0000 7f654a91f800 1 -- 172.21.15.87:0/2024426933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa2cc00 msgr2=0x5562daa2d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.293+0000 7f654a91f800 1 --2- 172.21.15.87:0/2024426933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa2cc00 0x5562daa2d020 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f65400529a0 tx=0x7f6540001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.293+0000 7f654a91f800 1 -- 172.21.15.87:0/2024426933 shutdown_connections 2024-05-08T18:31:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.293+0000 7f654a91f800 1 --2- 172.21.15.87:0/2024426933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa2cc00 0x5562daa2d020 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.293+0000 7f654a91f800 1 -- 172.21.15.87:0/2024426933 >> 172.21.15.87:0/2024426933 conn(0x5562daa28ec0 msgr2=0x5562daa26f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.293+0000 7f654a91f800 1 -- 172.21.15.87:0/2024426933 shutdown_connections 2024-05-08T18:31:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.293+0000 7f654a91f800 1 -- 172.21.15.87:0/2024426933 wait complete. 2024-05-08T18:31:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.294+0000 7f654a91f800 1 Processor -- start 2024-05-08T18:31:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.294+0000 7f654a91f800 1 -- start start 2024-05-08T18:31:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.294+0000 7f654a91f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa2cc00 0x5562daa341d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.294+0000 7f654a91f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5562daa2dd70 con 0x5562daa2cc00 2024-05-08T18:31:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.294+0000 7f6546dbd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa2cc00 0x5562daa341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.294+0000 7f6546dbd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa2cc00 0x5562daa341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33388/0 (socket says 172.21.15.87:33388) 2024-05-08T18:31:19.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.294+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 learned_addr learned my addr 172.21.15.87:0/3608912187 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.294+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562daa34710 con 0x5562daa2cc00 2024-05-08T18:31:19.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.295+0000 7f6546dbd640 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa2cc00 0x5562daa341d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f654004d010 tx=0x7f6540052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.295+0000 7f6417fff640 1 -- 172.21.15.87:0/3608912187 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6540030020 con 0x5562daa2cc00 2024-05-08T18:31:19.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.295+0000 7f6417fff640 1 -- 172.21.15.87:0/3608912187 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65400511e0 con 0x5562daa2cc00 2024-05-08T18:31:19.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.295+0000 7f6417fff640 1 -- 172.21.15.87:0/3608912187 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f654004b070 con 0x5562daa2cc00 2024-05-08T18:31:19.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.295+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562daa349a0 con 0x5562daa2cc00 2024-05-08T18:31:19.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.295+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562daa37650 con 0x5562daa2cc00 2024-05-08T18:31:19.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.295+0000 7f6417fff640 1 -- 172.21.15.87:0/3608912187 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6540033020 con 0x5562daa2cc00 2024-05-08T18:31:19.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.296+0000 7f6417fff640 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f641003bb50 0x7f641003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.296+0000 7f6417fff640 1 -- 172.21.15.87:0/3608912187 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f654000e040 con 0x5562daa2cc00 2024-05-08T18:31:19.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.296+0000 7f65465bc640 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f641003bb50 0x7f641003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.296+0000 7f65465bc640 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f641003bb50 0x7f641003e010 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6538050f80 tx=0x7f6538032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.296+0000 7f654a91f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.296+0000 7f654a91f800 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5562daa3fe50 0x5562daa42310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.296+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa42a60 con 0x5562daa3fe50 2024-05-08T18:31:19.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.296+0000 7f6545dbb640 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5562daa3fe50 0x5562daa42310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.297+0000 7f6545dbb640 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5562daa3fe50 0x5562daa42310 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.297+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.297+0000 7f654a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.297+0000 7f654a91f800 20 realm 2024-05-08T18:31:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.297+0000 7f654a91f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.297+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa42e30 con 0x5562daa3fe50 2024-05-08T18:31:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.297+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.297+0000 7f654a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.297+0000 7f654a91f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.297+0000 7f654a91f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.297+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa43700 con 0x5562daa3fe50 2024-05-08T18:31:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.297+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.297+0000 7f654a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.297+0000 7f654a91f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.297+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa43aa0 con 0x5562daa3fe50 2024-05-08T18:31:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.298+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.298+0000 7f654a91f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:19.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.298+0000 7f654a91f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.298+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa442f0 con 0x5562daa3fe50 2024-05-08T18:31:19.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.298+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.298+0000 7f654a91f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:19.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.298+0000 7f654a91f800 20 searching for the correct realm 2024-05-08T18:31:19.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.298+0000 7f654a91f800 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5562daa46060 0x5562daa48450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.298+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562daa489e0 con 0x5562daa46060 2024-05-08T18:31:19.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.298+0000 7f6546dbd640 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5562daa46060 0x5562daa48450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.298+0000 7f6546dbd640 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5562daa46060 0x5562daa48450 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.299+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6540029070 con 0x5562daa46060 2024-05-08T18:31:19.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.299+0000 7f6546dbd640 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6540035020 0x7f6540013a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.299+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562daa489e0 con 0x7f6540035020 2024-05-08T18:31:19.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.299+0000 7f65465bc640 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6540035020 0x7f6540013a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.299+0000 7f65465bc640 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6540035020 0x7f6540013a60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.299+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538029030 con 0x7f6540035020 2024-05-08T18:31:19.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.299+0000 7f65465bc640 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f653802c060 0x7f653802b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.299+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562daa489e0 con 0x7f653802c060 2024-05-08T18:31:19.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.300+0000 7f6545dbb640 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f653802c060 0x7f653802b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.300+0000 7f6545dbb640 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f653802c060 0x7f653802b580 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.300+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.300+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562daa489e0 con 0x5562daa3fe50 2024-05-08T18:31:19.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.300+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.300+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562daa489e0 con 0x5562daa3fe50 2024-05-08T18:31:19.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.301+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.301+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562daa489e0 con 0x7f653802c060 2024-05-08T18:31:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.301+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.301+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562daa489e0 con 0x7f653802c060 2024-05-08T18:31:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.301+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.301+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562daa489e0 con 0x7f6540035020 2024-05-08T18:31:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.301+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538029030 con 0x7f6540035020 2024-05-08T18:31:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.301+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562daa489e0 con 0x5562daa46060 2024-05-08T18:31:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.302+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6540029070 con 0x5562daa46060 2024-05-08T18:31:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.302+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562daa489e0 con 0x5562daa3fe50 2024-05-08T18:31:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.302+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.302+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562daa489e0 con 0x7f653802c060 2024-05-08T18:31:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.302+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.302+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562daa489e0 con 0x5562daa3fe50 2024-05-08T18:31:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.302+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.302+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562daa489e0 con 0x7f6540035020 2024-05-08T18:31:19.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.303+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6538029030 con 0x7f6540035020 2024-05-08T18:31:19.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.303+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562daa489e0 con 0x5562daa46060 2024-05-08T18:31:19.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.303+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6540029070 con 0x5562daa46060 2024-05-08T18:31:19.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.303+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562daa489e0 con 0x5562daa46060 2024-05-08T18:31:19.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.303+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6540029070 con 0x5562daa46060 2024-05-08T18:31:19.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.303+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f6540061040 con 0x7f653802c060 2024-05-08T18:31:19.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.303+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.303+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f6540061040 con 0x5562daa46060 2024-05-08T18:31:19.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.304+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6540029070 con 0x5562daa46060 2024-05-08T18:31:19.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.304+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f6540061040 con 0x5562daa46060 2024-05-08T18:31:19.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.304+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6540029070 con 0x5562daa46060 2024-05-08T18:31:19.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.304+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f6540061040 con 0x5562daa3fe50 2024-05-08T18:31:19.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.304+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.304+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f6540061040 con 0x5562daa3fe50 2024-05-08T18:31:19.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.304+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.304+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f6540061040 con 0x7f653802c060 2024-05-08T18:31:19.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.305+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.305+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f6540061040 con 0x5562daa46060 2024-05-08T18:31:19.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.305+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6540029070 con 0x5562daa46060 2024-05-08T18:31:19.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.305+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f6540061040 con 0x7f6540035020 2024-05-08T18:31:19.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.305+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538029030 con 0x7f6540035020 2024-05-08T18:31:19.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.305+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f6540061040 con 0x5562daa3fe50 2024-05-08T18:31:19.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.305+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.305+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f6540061040 con 0x7f653802c060 2024-05-08T18:31:19.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.306+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.306+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f6540061040 con 0x5562daa46060 2024-05-08T18:31:19.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.306+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6540029070 con 0x5562daa46060 2024-05-08T18:31:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.306+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f6540061040 con 0x7f653802c060 2024-05-08T18:31:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.306+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.306+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f6540061040 con 0x7f6540035020 2024-05-08T18:31:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.306+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538029030 con 0x7f6540035020 2024-05-08T18:31:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.306+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f6540061040 con 0x5562daa46060 2024-05-08T18:31:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.307+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6540029070 con 0x5562daa46060 2024-05-08T18:31:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.307+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f6540061040 con 0x7f653802c060 2024-05-08T18:31:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.307+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.307+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f6540061040 con 0x5562daa3fe50 2024-05-08T18:31:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.307+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.307+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f6540061040 con 0x7f6540035020 2024-05-08T18:31:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.307+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538029030 con 0x7f6540035020 2024-05-08T18:31:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.307+0000 7f654a91f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.307+0000 7f654a91f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.307+0000 7f654a91f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.307+0000 7f654a91f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.307+0000 7f654a91f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.307+0000 7f654a91f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.307+0000 7f654a91f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.307+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa44ca0 con 0x5562daa3fe50 2024-05-08T18:31:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f654a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f654a91f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa45540 con 0x5562daa3fe50 2024-05-08T18:31:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f654a91f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f654a91f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa48e60 con 0x7f653802c060 2024-05-08T18:31:19.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f654a91f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:19.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f654a91f800 20 zone default found 2024-05-08T18:31:19.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f654a91f800 4 Realm: () 2024-05-08T18:31:19.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f654a91f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:19.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f654a91f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:19.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f654a91f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:19.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f654a91f800 20 zonegroup default 2024-05-08T18:31:19.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f654a91f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa49310 con 0x7f653802c060 2024-05-08T18:31:19.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.308+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.309+0000 7f654a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.309+0000 7f654a91f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.309+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4acf0 con 0x5562daa46060 2024-05-08T18:31:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.309+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6540029070 con 0x5562daa46060 2024-05-08T18:31:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.309+0000 7f654a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.309+0000 7f654a91f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.309+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4b5d0 con 0x5562daa46060 2024-05-08T18:31:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.309+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6540029070 con 0x5562daa46060 2024-05-08T18:31:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.309+0000 7f654a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.309+0000 7f654a91f800 20 started sync module instance, tier type = 2024-05-08T18:31:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.309+0000 7f654a91f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.309+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa49ce0 con 0x7f6540035020 2024-05-08T18:31:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.310+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538029030 con 0x7f6540035020 2024-05-08T18:31:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.310+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93883063375920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4b970 con 0x7f6540035020 2024-05-08T18:31:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.310+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4c1c0 con 0x5562daa3fe50 2024-05-08T18:31:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.311+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93883063375920] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538029030 con 0x7f6540035020 2024-05-08T18:31:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.311+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.311+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93883063385360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4c5e0 con 0x5562daa3fe50 2024-05-08T18:31:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.311+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4cfa0 con 0x5562daa46060 2024-05-08T18:31:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.312+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93883063385360] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.312+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6540029070 con 0x5562daa46060 2024-05-08T18:31:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.312+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93883063386416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4cfa0 con 0x5562daa46060 2024-05-08T18:31:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.312+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4d9d0 con 0x7f6540035020 2024-05-08T18:31:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.313+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538029030 con 0x7f6540035020 2024-05-08T18:31:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.313+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93883063391456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4e2a0 con 0x7f6540035020 2024-05-08T18:31:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.313+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4eda0 con 0x5562daa3fe50 2024-05-08T18:31:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.313+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93883063386416] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6540029070 con 0x5562daa46060 2024-05-08T18:31:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.314+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.314+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93883063396496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4ed60 con 0x5562daa3fe50 2024-05-08T18:31:19.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.314+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4f7d0 con 0x7f653802c060 2024-05-08T18:31:19.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.314+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93883063391456] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538029030 con 0x7f6540035020 2024-05-08T18:31:19.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.315+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.315+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93883063396496] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.315+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93883063399168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4f7d0 con 0x7f653802c060 2024-05-08T18:31:19.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.315+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4caf0 con 0x7f653802c060 2024-05-08T18:31:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.316+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93883063399168] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.316+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.316+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93883063388912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4fd30 con 0x7f653802c060 2024-05-08T18:31:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.316+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa50600 con 0x7f653802c060 2024-05-08T18:31:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.317+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93883063388912] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.317+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.317+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93883063393776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa507e0 con 0x7f653802c060 2024-05-08T18:31:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.317+0000 7f654a91f800 20 add_watcher() i=0 2024-05-08T18:31:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.317+0000 7f654a91f800 20 add_watcher() i=1 2024-05-08T18:31:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.317+0000 7f654a91f800 20 add_watcher() i=2 2024-05-08T18:31:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.317+0000 7f654a91f800 20 add_watcher() i=3 2024-05-08T18:31:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.317+0000 7f654a91f800 20 add_watcher() i=4 2024-05-08T18:31:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.317+0000 7f654a91f800 20 add_watcher() i=5 2024-05-08T18:31:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.317+0000 7f654a91f800 20 add_watcher() i=6 2024-05-08T18:31:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.318+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93883063393776] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.318+0000 7f654a91f800 20 add_watcher() i=7 2024-05-08T18:31:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.318+0000 7f654a91f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.318+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa53bb0 con 0x5562daa3fe50 2024-05-08T18:31:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.318+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.318+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93883063404240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa50fa0 con 0x5562daa3fe50 2024-05-08T18:31:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.319+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93883063404240] v27'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.319+0000 7f63fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.319+0000 7f654a91f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:19.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.319+0000 7f654a91f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:19.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.319+0000 7f654a91f800 5 note: GC not initialized 2024-05-08T18:31:19.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.320+0000 7f63777fe640 20 reqs_thread_entry: start 2024-05-08T18:31:19.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.320+0000 7f654a91f800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:19.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.320+0000 7f654a91f800 20 Filter name: none 2024-05-08T18:31:19.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.320+0000 7f63757fa640 20 reqs_thread_entry: start 2024-05-08T18:31:19.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.320+0000 7f654a91f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:19.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.320+0000 7f654a91f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.320+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa86e80 con 0x5562daa3fe50 2024-05-08T18:31:19.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.320+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.320+0000 7f654a91f800 20 rados_obj.operate() r=0 bl.length=673 2024-05-08T18:31:19.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.320+0000 7f654a91f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:19.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.320+0000 7f654a91f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:19.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.320+0000 7f654a91f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:19.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.320+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa8d9c0 con 0x5562daa3fe50 2024-05-08T18:31:19.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.322+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v27'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.322+0000 7f654a91f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:19.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.322+0000 7f654a91f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:19.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.322+0000 7f654a91f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:31:19.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.322+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93883063653248 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa89020 con 0x5562daa3fe50 2024-05-08T18:31:19.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.322+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== watch-notify(notify (1) cookie 93883063396496 notify 115964117000 ret 0) ==== 800+0+0 (crc 0 0 0) 0x5562da87cf60 con 0x5562daa3fe50 2024-05-08T18:31:19.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.322+0000 7f6429ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117000 cookie 93883063396496 notifier 4396 bl.length()=758 2024-05-08T18:31:19.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.322+0000 7f6429ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:19.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.322+0000 7f6429ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:19.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.322+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(64 notify.4 [notify cookie 93883063653248 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.322+0000 7f6429ffb640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f640c003ea0 con 0x5562daa3fe50 2024-05-08T18:31:19.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.322+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.322+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== watch-notify(notify_complete (2) cookie 93883063653248 notify 115964117000 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f653c091430 con 0x5562daa3fe50 2024-05-08T18:31:19.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.322+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa8d380 con 0x5562daa3fe50 2024-05-08T18:31:19.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.323+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(66 foo:foo1 [delete] v27'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.323+0000 7f654a91f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-05-08T18:31:19.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.323+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93883063653248 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562daa87e60 con 0x7f6540035020 2024-05-08T18:31:19.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.323+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== watch-notify(notify (1) cookie 93883063375920 notify 115964116996 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f6538058040 con 0x7f6540035020 2024-05-08T18:31:19.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.323+0000 7f64297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 93883063375920 notifier 4396 bl.length()=159 2024-05-08T18:31:19.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.323+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(67 notify.0 [notify cookie 93883063653248 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6538029030 con 0x7f6540035020 2024-05-08T18:31:19.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.323+0000 7f64297fa640 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f637c0032c0 con 0x7f6540035020 2024-05-08T18:31:19.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.324+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538029030 con 0x7f6540035020 2024-05-08T18:31:19.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.324+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== watch-notify(notify_complete (2) cookie 93883063653248 notify 115964116996 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5562daa07810 con 0x7f6540035020 2024-05-08T18:31:19.335 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-08T18:31:19.069601Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.325+0000 7f63fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.325+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93883063404240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa88700 con 0x5562daa3fe50 2024-05-08T18:31:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.325+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93883063404240] v27'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.325+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93883063375920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa506d0 con 0x7f6540035020 2024-05-08T18:31:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.326+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93883063375920] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538029030 con 0x7f6540035020 2024-05-08T18:31:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.326+0000 7f654a91f800 20 remove_watcher() i=0 2024-05-08T18:31:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.326+0000 7f654a91f800 2 removed watcher, disabling cache 2024-05-08T18:31:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.326+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93883063385360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa506d0 con 0x5562daa3fe50 2024-05-08T18:31:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.328+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93883063385360] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.328+0000 7f654a91f800 20 remove_watcher() i=1 2024-05-08T18:31:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.328+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93883063386416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4bd10 con 0x5562daa46060 2024-05-08T18:31:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.329+0000 7f6546dbd640 1 -- 172.21.15.87:0/3608912187 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93883063386416] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6540029070 con 0x5562daa46060 2024-05-08T18:31:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.329+0000 7f654a91f800 20 remove_watcher() i=2 2024-05-08T18:31:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.329+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93883063391456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa506d0 con 0x7f6540035020 2024-05-08T18:31:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.329+0000 7f65465bc640 1 -- 172.21.15.87:0/3608912187 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93883063391456] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538029030 con 0x7f6540035020 2024-05-08T18:31:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.330+0000 7f654a91f800 20 remove_watcher() i=3 2024-05-08T18:31:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.330+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93883063396496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa506d0 con 0x5562daa3fe50 2024-05-08T18:31:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.331+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93883063396496] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x5562daa3fe50 2024-05-08T18:31:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.331+0000 7f654a91f800 20 remove_watcher() i=4 2024-05-08T18:31:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.331+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93883063399168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4e890 con 0x7f653802c060 2024-05-08T18:31:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.332+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93883063399168] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.332+0000 7f654a91f800 20 remove_watcher() i=5 2024-05-08T18:31:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.332+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93883063388912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa506d0 con 0x7f653802c060 2024-05-08T18:31:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.333+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93883063388912] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.333+0000 7f654a91f800 20 remove_watcher() i=6 2024-05-08T18:31:19.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.333+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93883063393776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562daa4e890 con 0x7f653802c060 2024-05-08T18:31:19.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.333+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93883063393776] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653c05a040 con 0x7f653802c060 2024-05-08T18:31:19.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.333+0000 7f654a91f800 20 remove_watcher() i=7 2024-05-08T18:31:19.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f653802c060 msgr2=0x7f653802b580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f653802c060 0x7f653802b580 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5562daa3fe50 msgr2=0x5562daa42310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5562daa3fe50 0x5562daa42310 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6540035020 msgr2=0x7f6540013a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6540035020 0x7f6540013a60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5562daa46060 msgr2=0x5562daa48450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5562daa46060 0x5562daa48450 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f641003bb50 msgr2=0x7f641003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f641003bb50 0x7f641003e010 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6538050f80 tx=0x7f6538032000 comp rx=0 tx=0).stop 2024-05-08T18:31:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa2cc00 msgr2=0x5562daa341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa2cc00 0x5562daa341d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f654004d010 tx=0x7f6540052900 comp rx=0 tx=0).stop 2024-05-08T18:31:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f6545dbb640 1 -- 172.21.15.87:0/3608912187 reap_dead start 2024-05-08T18:31:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 shutdown_connections 2024-05-08T18:31:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 --2- 172.21.15.87:0/3608912187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa2cc00 0x5562daa341d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 >> 172.21.15.87:0/3608912187 conn(0x5562daa28ec0 msgr2=0x5562daa26570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 shutdown_connections 2024-05-08T18:31:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 -- 172.21.15.87:0/3608912187 wait complete. 2024-05-08T18:31:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 -- 172.21.15.87:0/249844678 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f642003bb50 msgr2=0x7f642003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 --2- 172.21.15.87:0/249844678 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f642003bb50 0x7f642003e010 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6538001520 tx=0x7f6538050e50 comp rx=0 tx=0).stop 2024-05-08T18:31:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 -- 172.21.15.87:0/249844678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa1f890 msgr2=0x5562daa1fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 --2- 172.21.15.87:0/249844678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa1f890 0x5562daa1fcb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x5562daa05790 tx=0x7f65400178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 -- 172.21.15.87:0/249844678 shutdown_connections 2024-05-08T18:31:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 --2- 172.21.15.87:0/249844678 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f642003bb50 0x7f642003e010 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 --2- 172.21.15.87:0/249844678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562daa1f890 0x5562daa1fcb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 -- 172.21.15.87:0/249844678 >> 172.21.15.87:0/249844678 conn(0x5562daa13930 msgr2=0x5562daa13d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 -- 172.21.15.87:0/249844678 shutdown_connections 2024-05-08T18:31:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.334+0000 7f654a91f800 1 -- 172.21.15.87:0/249844678 wait complete. 2024-05-08T18:31:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.335+0000 7f654a91f800 1 -- 172.21.15.87:0/4214404286 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5562daa0ed20 msgr2=0x5562daa11110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.335+0000 7f654a91f800 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5562daa0ed20 0x5562daa11110 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.335+0000 7f654a91f800 1 -- 172.21.15.87:0/4214404286 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5562da9096d0 msgr2=0x5562daa0b5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.335+0000 7f654a91f800 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5562da9096d0 0x5562daa0b5d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.335+0000 7f654a91f800 1 -- 172.21.15.87:0/4214404286 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f642c03bb50 msgr2=0x7f642c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.335+0000 7f654a91f800 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f642c03bb50 0x7f642c03e010 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f653c054000 tx=0x7f653c04e000 comp rx=0 tx=0).stop 2024-05-08T18:31:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.335+0000 7f654a91f800 1 -- 172.21.15.87:0/4214404286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da907b90 msgr2=0x5562daa04390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.335+0000 7f654a91f800 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da907b90 0x5562daa04390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x5562da9fd580 tx=0x7f6538000bc0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.335+0000 7f654a91f800 1 -- 172.21.15.87:0/4214404286 shutdown_connections 2024-05-08T18:31:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.335+0000 7f654a91f800 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5562da9096d0 0x5562daa0b5d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.335+0000 7f654a91f800 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5562daa0ed20 0x5562daa11110 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.335+0000 7f654a91f800 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f642c03bb50 0x7f642c03e010 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.335+0000 7f654a91f800 1 --2- 172.21.15.87:0/4214404286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562da907b90 0x5562daa04390 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.335+0000 7f654a91f800 1 -- 172.21.15.87:0/4214404286 >> 172.21.15.87:0/4214404286 conn(0x5562da9036b0 msgr2=0x5562da9f6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.335+0000 7f654a91f800 1 -- 172.21.15.87:0/4214404286 shutdown_connections 2024-05-08T18:31:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.335+0000 7f654a91f800 1 -- 172.21.15.87:0/4214404286 wait complete. 2024-05-08T18:31:19.346 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-08T18:31:19.069601Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:19.346 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-05-08T18:31:19.346 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-05-08T18:31:19.346 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-05-08T18:31:19.390 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:19.390 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:19.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.393+0000 7f2f24931800 1 Processor -- start 2024-05-08T18:31:19.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.393+0000 7f2f24931800 1 -- start start 2024-05-08T18:31:19.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.393+0000 7f2f24931800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b8432ca140 0x55b8432ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.393+0000 7f2f24931800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b8432cabe0 con 0x55b8432cb3a0 2024-05-08T18:31:19.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.393+0000 7f2f24931800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b84316be20 con 0x55b8432ca140 2024-05-08T18:31:19.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.393+0000 7f2f20628640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b8432ca140 0x55b8432ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.393+0000 7f2f17e27640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55b8432cb3a0 0x55b8432cb820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42010/0 (socket says 172.21.15.87:42010) 2024-05-08T18:31:19.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.393+0000 7f2f17e27640 1 -- 172.21.15.87:0/1792310247 learned_addr learned my addr 172.21.15.87:0/1792310247 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:19.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.393+0000 7f2f20628640 1 -- 172.21.15.87:0/1792310247 >> v1:172.21.15.53:6789/0 conn(0x55b8432cb3a0 legacy=0x55b8432cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.393+0000 7f2f20628640 1 -- 172.21.15.87:0/1792310247 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8432cbf60 con 0x55b8432ca140 2024-05-08T18:31:19.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.395+0000 7f2f20628640 1 --2- 172.21.15.87:0/1792310247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 0x55b8432ca560 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2f10005fd0 tx=0x7f2f1001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa1cf59b1e4d65e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.395+0000 7f2f1fe27640 1 -- 172.21.15.87:0/1792310247 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f10052560 con 0x55b8432ca140 2024-05-08T18:31:19.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.395+0000 7f2f1fe27640 1 -- 172.21.15.87:0/1792310247 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f10052700 con 0x55b8432ca140 2024-05-08T18:31:19.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.395+0000 7f2f1fe27640 1 -- 172.21.15.87:0/1792310247 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f10052a60 con 0x55b8432ca140 2024-05-08T18:31:19.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.396+0000 7f2f24931800 1 -- 172.21.15.87:0/1792310247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 msgr2=0x55b8432ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.396+0000 7f2f24931800 1 --2- 172.21.15.87:0/1792310247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 0x55b8432ca560 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2f10005fd0 tx=0x7f2f1001ccc0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.396+0000 7f2f24931800 1 -- 172.21.15.87:0/1792310247 shutdown_connections 2024-05-08T18:31:19.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.396+0000 7f2f24931800 1 --2- 172.21.15.87:0/1792310247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 0x55b8432ca560 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.396+0000 7f2f24931800 1 -- 172.21.15.87:0/1792310247 >> 172.21.15.87:0/1792310247 conn(0x55b8432c5720 msgr2=0x55b8432c7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.396+0000 7f2f24931800 1 -- 172.21.15.87:0/1792310247 shutdown_connections 2024-05-08T18:31:19.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.396+0000 7f2f24931800 1 -- 172.21.15.87:0/1792310247 wait complete. 2024-05-08T18:31:19.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.410+0000 7f2f24931800 1 Processor -- start 2024-05-08T18:31:19.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.410+0000 7f2f24931800 1 -- start start 2024-05-08T18:31:19.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.410+0000 7f2f24931800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 0x55b84323e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.410+0000 7f2f24931800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b8432165b0 con 0x55b8432ca140 2024-05-08T18:31:19.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.410+0000 7f2f20628640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 0x55b84323e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.410+0000 7f2f20628640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 0x55b84323e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33402/0 (socket says 172.21.15.87:33402) 2024-05-08T18:31:19.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.410+0000 7f2f20628640 1 -- 172.21.15.87:0/315001374 learned_addr learned my addr 172.21.15.87:0/315001374 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.411+0000 7f2f20628640 1 -- 172.21.15.87:0/315001374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8433bf440 con 0x55b8432ca140 2024-05-08T18:31:19.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.411+0000 7f2f20628640 1 --2- 172.21.15.87:0/315001374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 0x55b84323e2c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2f10007000 tx=0x7f2f1004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47376b7b720693d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.411+0000 7f2e0e60c640 1 -- 172.21.15.87:0/315001374 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f10052cd0 con 0x55b8432ca140 2024-05-08T18:31:19.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.411+0000 7f2e0e60c640 1 -- 172.21.15.87:0/315001374 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f100528b0 con 0x55b8432ca140 2024-05-08T18:31:19.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.411+0000 7f2e0e60c640 1 -- 172.21.15.87:0/315001374 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1005c430 con 0x55b8432ca140 2024-05-08T18:31:19.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.412+0000 7f2f24931800 1 -- 172.21.15.87:0/315001374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 msgr2=0x55b84323e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.412+0000 7f2f24931800 1 --2- 172.21.15.87:0/315001374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 0x55b84323e2c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2f10007000 tx=0x7f2f1004c000 comp rx=0 tx=0).stop 2024-05-08T18:31:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.412+0000 7f2f24931800 1 -- 172.21.15.87:0/315001374 shutdown_connections 2024-05-08T18:31:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.412+0000 7f2f24931800 1 --2- 172.21.15.87:0/315001374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 0x55b84323e2c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.412+0000 7f2f24931800 1 -- 172.21.15.87:0/315001374 >> 172.21.15.87:0/315001374 conn(0x55b8432c5720 msgr2=0x55b8433b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.412+0000 7f2f24931800 1 -- 172.21.15.87:0/315001374 shutdown_connections 2024-05-08T18:31:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.412+0000 7f2f24931800 1 -- 172.21.15.87:0/315001374 wait complete. 2024-05-08T18:31:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.412+0000 7f2f24931800 1 Processor -- start 2024-05-08T18:31:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.412+0000 7f2f24931800 1 -- start start 2024-05-08T18:31:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.412+0000 7f2f24931800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 0x55b8433bcd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.412+0000 7f2f24931800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b8432d3870 con 0x55b8432ca140 2024-05-08T18:31:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.413+0000 7f2f20628640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 0x55b8433bcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.413+0000 7f2f20628640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 0x55b8433bcd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33414/0 (socket says 172.21.15.87:33414) 2024-05-08T18:31:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.413+0000 7f2f20628640 1 -- 172.21.15.87:0/2173494778 learned_addr learned my addr 172.21.15.87:0/2173494778 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.413+0000 7f2f20628640 1 -- 172.21.15.87:0/2173494778 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8433bb460 con 0x55b8432ca140 2024-05-08T18:31:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.413+0000 7f2f20628640 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 0x55b8433bcd70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2f1001b9b0 tx=0x7f2f10003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.413+0000 7f2e0ce09640 1 -- 172.21.15.87:0/2173494778 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f10074070 con 0x55b8432ca140 2024-05-08T18:31:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.413+0000 7f2e0ce09640 1 -- 172.21.15.87:0/2173494778 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f1006f430 con 0x55b8432ca140 2024-05-08T18:31:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.413+0000 7f2e0ce09640 1 -- 172.21.15.87:0/2173494778 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1006f710 con 0x55b8432ca140 2024-05-08T18:31:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.413+0000 7f2f24931800 1 -- 172.21.15.87:0/2173494778 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8433bb6f0 con 0x55b8432ca140 2024-05-08T18:31:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.413+0000 7f2f24931800 1 -- 172.21.15.87:0/2173494778 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8433bbc70 con 0x55b8432ca140 2024-05-08T18:31:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.414+0000 7f2e0ce09640 1 -- 172.21.15.87:0/2173494778 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2f10077070 con 0x55b8432ca140 2024-05-08T18:31:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.414+0000 7f2e0ce09640 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2e0803bb50 0x7f2e0803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.414+0000 7f2e0ce09640 1 -- 172.21.15.87:0/2173494778 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f2f1006c050 con 0x55b8432ca140 2024-05-08T18:31:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.414+0000 7f2f17e27640 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2e0803bb50 0x7f2e0803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.414+0000 7f2f24931800 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b8432cb3a0 0x55b8433cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.414+0000 7f2f24931800 1 -- 172.21.15.87:0/2173494778 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8433cdc00 con 0x55b8432cb3a0 2024-05-08T18:31:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.415+0000 7f2f20e29640 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b8432cb3a0 0x55b8433cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.415+0000 7f2f17e27640 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2e0803bb50 0x7f2e0803e010 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2f08000f60 tx=0x7f2f080012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.415+0000 7f2f20e29640 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b8432cb3a0 0x55b8433cd6c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.415+0000 7f2f20e29640 1 -- 172.21.15.87:0/2173494778 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f180083e0 con 0x55b8432cb3a0 2024-05-08T18:31:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.415+0000 7f2f24931800 1 -- 172.21.15.87:0/2173494778 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8433ce450 con 0x55b8432cb3a0 2024-05-08T18:31:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.415+0000 7f2f20e29640 1 -- 172.21.15.87:0/2173494778 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f180083e0 con 0x55b8432cb3a0 2024-05-08T18:31:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.415+0000 7f2f24931800 1 -- 172.21.15.87:0/2173494778 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8433cf800 con 0x55b8432cb3a0 2024-05-08T18:31:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.416+0000 7f2f20e29640 1 -- 172.21.15.87:0/2173494778 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2f180083e0 con 0x55b8432cb3a0 2024-05-08T18:31:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.416+0000 7f2f24931800 1 -- 172.21.15.87:0/2173494778 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8433ceca0 con 0x55b8432cb3a0 2024-05-08T18:31:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.416+0000 7f2f20e29640 1 -- 172.21.15.87:0/2173494778 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f180083e0 con 0x55b8432cb3a0 2024-05-08T18:31:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.416+0000 7f2f24931800 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b8433d0c60 0x55b8433d3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.416+0000 7f2f24931800 1 -- 172.21.15.87:0/2173494778 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8433d36f0 con 0x55b8433d0c60 2024-05-08T18:31:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.416+0000 7f2f20628640 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b8433d0c60 0x55b8433d3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.417+0000 7f2f20628640 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b8433d0c60 0x55b8433d3050 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.417+0000 7f2f20628640 1 -- 172.21.15.87:0/2173494778 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2f10076030 con 0x55b8433d0c60 2024-05-08T18:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.417+0000 7f2f24931800 1 Processor -- start 2024-05-08T18:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.417+0000 7f2f24931800 1 -- start start 2024-05-08T18:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.417+0000 7f2f24931800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433e1a20 0x55b8433e1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.417+0000 7f2f24931800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b8433bd2b0 con 0x55b8433e1a20 2024-05-08T18:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.418+0000 7f2f20e29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433e1a20 0x55b8433e1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.418+0000 7f2f20e29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433e1a20 0x55b8433e1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33422/0 (socket says 172.21.15.87:33422) 2024-05-08T18:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.418+0000 7f2f20e29640 1 -- 172.21.15.87:0/996129611 learned_addr learned my addr 172.21.15.87:0/996129611 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.418+0000 7f2f20e29640 1 -- 172.21.15.87:0/996129611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8433e2380 con 0x55b8433e1a20 2024-05-08T18:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.418+0000 7f2f20e29640 1 --2- 172.21.15.87:0/996129611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433e1a20 0x55b8433e1e40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55b8433bc8d0 tx=0x7f2f1800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.418+0000 7f2e05ffb640 1 -- 172.21.15.87:0/996129611 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1801c070 con 0x55b8433e1a20 2024-05-08T18:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.418+0000 7f2e05ffb640 1 -- 172.21.15.87:0/996129611 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f18018410 con 0x55b8433e1a20 2024-05-08T18:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.418+0000 7f2f24931800 1 -- 172.21.15.87:0/996129611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8433e2df0 con 0x55b8433e1a20 2024-05-08T18:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.418+0000 7f2e05ffb640 1 -- 172.21.15.87:0/996129611 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f18018730 con 0x55b8433e1a20 2024-05-08T18:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.418+0000 7f2f24931800 1 -- 172.21.15.87:0/996129611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8433e32f0 con 0x55b8433e1a20 2024-05-08T18:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.419+0000 7f2e05ffb640 1 -- 172.21.15.87:0/996129611 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2f1801f070 con 0x55b8433e1a20 2024-05-08T18:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.419+0000 7f2e05ffb640 1 --2- 172.21.15.87:0/996129611 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2df803bb50 0x7f2df803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.419+0000 7f2e05ffb640 1 -- 172.21.15.87:0/996129611 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f2f18054670 con 0x55b8433e1a20 2024-05-08T18:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.419+0000 7f2f20628640 1 --2- 172.21.15.87:0/996129611 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2df803bb50 0x7f2df803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.420+0000 7f2f24931800 1 Processor -- start 2024-05-08T18:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.420+0000 7f2f20628640 1 --2- 172.21.15.87:0/996129611 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2df803bb50 0x7f2df803e010 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55b8433cfba0 tx=0x7f2f10051480 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.420+0000 7f2f24931800 1 -- start start 2024-05-08T18:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.420+0000 7f2f24931800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433eee30 0x55b8433ef250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.420+0000 7f2f24931800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b8431bcfc0 con 0x55b8433eee30 2024-05-08T18:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.420+0000 7f2f20e29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433eee30 0x55b8433ef250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.420+0000 7f2f20e29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433eee30 0x55b8433ef250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33424/0 (socket says 172.21.15.87:33424) 2024-05-08T18:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.420+0000 7f2f20e29640 1 -- 172.21.15.87:0/4057974238 learned_addr learned my addr 172.21.15.87:0/4057974238 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.420+0000 7f2f20e29640 1 -- 172.21.15.87:0/4057974238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8433ef820 con 0x55b8433eee30 2024-05-08T18:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.420+0000 7f2f20e29640 1 --2- 172.21.15.87:0/4057974238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433eee30 0x55b8433ef250 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2f18014fd0 tx=0x7f2f18016f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d414d141f8a2d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.420+0000 7f2df77fe640 1 -- 172.21.15.87:0/4057974238 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f18014bb0 con 0x55b8433eee30 2024-05-08T18:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.421+0000 7f2df77fe640 1 -- 172.21.15.87:0/4057974238 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f18007c20 con 0x55b8433eee30 2024-05-08T18:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.421+0000 7f2df77fe640 1 -- 172.21.15.87:0/4057974238 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f18017720 con 0x55b8433eee30 2024-05-08T18:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.421+0000 7f2f24931800 1 -- 172.21.15.87:0/4057974238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433eee30 msgr2=0x55b8433ef250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.421+0000 7f2f24931800 1 --2- 172.21.15.87:0/4057974238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433eee30 0x55b8433ef250 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2f18014fd0 tx=0x7f2f18016f60 comp rx=0 tx=0).stop 2024-05-08T18:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.421+0000 7f2f24931800 1 -- 172.21.15.87:0/4057974238 shutdown_connections 2024-05-08T18:31:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.421+0000 7f2f24931800 1 --2- 172.21.15.87:0/4057974238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433eee30 0x55b8433ef250 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.421+0000 7f2f24931800 1 -- 172.21.15.87:0/4057974238 >> 172.21.15.87:0/4057974238 conn(0x55b8433eb100 msgr2=0x55b8433e9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.421+0000 7f2f24931800 1 -- 172.21.15.87:0/4057974238 shutdown_connections 2024-05-08T18:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.421+0000 7f2f24931800 1 -- 172.21.15.87:0/4057974238 wait complete. 2024-05-08T18:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.421+0000 7f2f24931800 1 Processor -- start 2024-05-08T18:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.421+0000 7f2f24931800 1 -- start start 2024-05-08T18:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.421+0000 7f2f24931800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433eee30 0x55b8433f6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.421+0000 7f2f24931800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b8433efe30 con 0x55b8433eee30 2024-05-08T18:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.422+0000 7f2f20e29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433eee30 0x55b8433f6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.422+0000 7f2f20e29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433eee30 0x55b8433f6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33434/0 (socket says 172.21.15.87:33434) 2024-05-08T18:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.422+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 learned_addr learned my addr 172.21.15.87:0/2162690465 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.422+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8433f66d0 con 0x55b8433eee30 2024-05-08T18:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.422+0000 7f2f20e29640 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433eee30 0x55b8433f6190 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2f18014fd0 tx=0x7f2f18052970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.422+0000 7f2df5ffb640 1 -- 172.21.15.87:0/2162690465 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1802f030 con 0x55b8433eee30 2024-05-08T18:31:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.422+0000 7f2df5ffb640 1 -- 172.21.15.87:0/2162690465 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f180514e0 con 0x55b8433eee30 2024-05-08T18:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.422+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8433f6960 con 0x55b8433eee30 2024-05-08T18:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.422+0000 7f2df5ffb640 1 -- 172.21.15.87:0/2162690465 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f180541a0 con 0x55b8433eee30 2024-05-08T18:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.422+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8433f9610 con 0x55b8433eee30 2024-05-08T18:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.423+0000 7f2df5ffb640 1 -- 172.21.15.87:0/2162690465 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2f18032030 con 0x55b8433eee30 2024-05-08T18:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.423+0000 7f2df5ffb640 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2de803bb50 0x7f2de803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.423+0000 7f2df5ffb640 1 -- 172.21.15.87:0/2162690465 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f2f18030070 con 0x55b8433eee30 2024-05-08T18:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.423+0000 7f2f20628640 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2de803bb50 0x7f2de803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.424+0000 7f2f20628640 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2de803bb50 0x7f2de803e010 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2f10070f90 tx=0x7f2f1008a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.424+0000 7f2f24931800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.424+0000 7f2f24931800 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b843401d50 0x55b843404210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.424+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b843404960 con 0x55b843401d50 2024-05-08T18:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.424+0000 7f2f17e27640 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b843401d50 0x55b843404210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.424+0000 7f2f17e27640 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b843401d50 0x55b843404210 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.424+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f08009050 con 0x55b843401d50 2024-05-08T18:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.424+0000 7f2f24931800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.424+0000 7f2f24931800 20 realm 2024-05-08T18:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.424+0000 7f2f24931800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8434011a0 con 0x55b843401d50 2024-05-08T18:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f08009050 con 0x55b843401d50 2024-05-08T18:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f24931800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f24931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f24931800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b843405450 con 0x55b843401d50 2024-05-08T18:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f08009050 con 0x55b843401d50 2024-05-08T18:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f24931800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f24931800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b843405d20 con 0x55b843401d50 2024-05-08T18:31:19.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f08009050 con 0x55b843401d50 2024-05-08T18:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f24931800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f24931800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8434060c0 con 0x55b843401d50 2024-05-08T18:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2f08009050 con 0x55b843401d50 2024-05-08T18:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f24931800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f24931800 20 searching for the correct realm 2024-05-08T18:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f24931800 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b843407fa0 0x55b84340a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.425+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x55b843407fa0 2024-05-08T18:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.426+0000 7f2f20e29640 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b843407fa0 0x55b84340a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.426+0000 7f2f20e29640 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b843407fa0 0x55b84340a390 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.426+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1804c040 con 0x55b843407fa0 2024-05-08T18:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.426+0000 7f2f20e29640 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f2f18021070 0x7f2f18054990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.426+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x7f2f18021070 2024-05-08T18:31:19.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.426+0000 7f2f20628640 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f2f18021070 0x7f2f18054990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.427+0000 7f2f20628640 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f2f18021070 0x7f2f18054990 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.427+0000 7f2f20628640 1 -- 172.21.15.87:0/2162690465 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f10076030 con 0x7f2f18021070 2024-05-08T18:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.427+0000 7f2f20628640 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2f10079060 0x7f2f1006e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.427+0000 7f2f20628640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x7f2f10079060 2024-05-08T18:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.427+0000 7f2f17e27640 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2f10079060 0x7f2f1006e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.427+0000 7f2f17e27640 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2f10079060 0x7f2f1006e7d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.428+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f08009050 con 0x7f2f10079060 2024-05-08T18:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.428+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x55b843401d50 2024-05-08T18:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.428+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f08009050 con 0x55b843401d50 2024-05-08T18:31:19.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.428+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x55b843401d50 2024-05-08T18:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.428+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.428+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x7f2f10079060 2024-05-08T18:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.428+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.428+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x7f2f10079060 2024-05-08T18:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.429+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.429+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x7f2f18021070 2024-05-08T18:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.429+0000 7f2f20628640 1 -- 172.21.15.87:0/2162690465 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f10076030 con 0x7f2f18021070 2024-05-08T18:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.429+0000 7f2f20628640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x55b843407fa0 2024-05-08T18:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.429+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1804c040 con 0x55b843407fa0 2024-05-08T18:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.429+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x55b843401d50 2024-05-08T18:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.429+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.429+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x7f2f10079060 2024-05-08T18:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.430+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.430+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x55b843401d50 2024-05-08T18:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.430+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.430+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x7f2f18021070 2024-05-08T18:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.430+0000 7f2f20628640 1 -- 172.21.15.87:0/2162690465 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2f10076030 con 0x7f2f18021070 2024-05-08T18:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.430+0000 7f2f20628640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x55b843407fa0 2024-05-08T18:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.430+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1804c040 con 0x55b843407fa0 2024-05-08T18:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.430+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x55b843407fa0 2024-05-08T18:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.430+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1804c040 con 0x55b843407fa0 2024-05-08T18:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.430+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x7f2f10079060 2024-05-08T18:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.431+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.431+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x55b843407fa0 2024-05-08T18:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.431+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1804c040 con 0x55b843407fa0 2024-05-08T18:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.431+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x55b843407fa0 2024-05-08T18:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.431+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1804c040 con 0x55b843407fa0 2024-05-08T18:31:19.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.431+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x55b843401d50 2024-05-08T18:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.432+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.432+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x55b843401d50 2024-05-08T18:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.432+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.432+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x7f2f10079060 2024-05-08T18:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.432+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.432+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x55b843407fa0 2024-05-08T18:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.432+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1804c040 con 0x55b843407fa0 2024-05-08T18:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.432+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x7f2f18021070 2024-05-08T18:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.432+0000 7f2f20628640 1 -- 172.21.15.87:0/2162690465 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f10076030 con 0x7f2f18021070 2024-05-08T18:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.433+0000 7f2f20628640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x55b843401d50 2024-05-08T18:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.433+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.433+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x7f2f10079060 2024-05-08T18:31:19.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.433+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.433+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x55b843407fa0 2024-05-08T18:31:19.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.433+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1804c040 con 0x55b843407fa0 2024-05-08T18:31:19.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.434+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x7f2f10079060 2024-05-08T18:31:19.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.434+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.434+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x7f2f18021070 2024-05-08T18:31:19.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.434+0000 7f2f20628640 1 -- 172.21.15.87:0/2162690465 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f10076030 con 0x7f2f18021070 2024-05-08T18:31:19.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.434+0000 7f2f20628640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x55b843407fa0 2024-05-08T18:31:19.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.434+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1804c040 con 0x55b843407fa0 2024-05-08T18:31:19.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.434+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x7f2f10079060 2024-05-08T18:31:19.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.434+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.434+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x55b843401d50 2024-05-08T18:31:19.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.435+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.435+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aa40 con 0x7f2f18021070 2024-05-08T18:31:19.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.435+0000 7f2f20628640 1 -- 172.21.15.87:0/2162690465 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f10076030 con 0x7f2f18021070 2024-05-08T18:31:19.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.435+0000 7f2f24931800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:19.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.435+0000 7f2f24931800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:19.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.435+0000 7f2f24931800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:19.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.435+0000 7f2f24931800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:19.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.435+0000 7f2f24931800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:19.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.435+0000 7f2f24931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:19.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.435+0000 7f2f24931800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.435+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b843406a40 con 0x55b843401d50 2024-05-08T18:31:19.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.435+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.435+0000 7f2f24931800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.435+0000 7f2f24931800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.435+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8434072e0 con 0x55b843401d50 2024-05-08T18:31:19.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.435+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.435+0000 7f2f24931800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:19.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.436+0000 7f2f24931800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.436+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b84340aec0 con 0x7f2f10079060 2024-05-08T18:31:19.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.436+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.436+0000 7f2f24931800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:19.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.436+0000 7f2f24931800 20 zone default found 2024-05-08T18:31:19.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.436+0000 7f2f24931800 4 Realm: () 2024-05-08T18:31:19.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.436+0000 7f2f24931800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:19.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.436+0000 7f2f24931800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:19.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.436+0000 7f2f24931800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:19.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.436+0000 7f2f24931800 20 zonegroup default 2024-05-08T18:31:19.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.436+0000 7f2f24931800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.436+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b84340b370 con 0x7f2f10079060 2024-05-08T18:31:19.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.436+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.436+0000 7f2f24931800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.436+0000 7f2f24931800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.436+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b84340cd50 con 0x55b843407fa0 2024-05-08T18:31:19.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.437+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f1804c040 con 0x55b843407fa0 2024-05-08T18:31:19.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.437+0000 7f2f24931800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.437+0000 7f2f24931800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.437+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b84340d170 con 0x55b843407fa0 2024-05-08T18:31:19.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.437+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f1804c040 con 0x55b843407fa0 2024-05-08T18:31:19.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.437+0000 7f2f24931800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.437+0000 7f2f24931800 20 started sync module instance, tier type = 2024-05-08T18:31:19.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.437+0000 7f2f24931800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:19.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.437+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84340c190 con 0x7f2f18021070 2024-05-08T18:31:19.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.438+0000 7f2f20628640 1 -- 172.21.15.87:0/2162690465 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f10076030 con 0x7f2f18021070 2024-05-08T18:31:19.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.438+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94249890659552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84340d5d0 con 0x7f2f18021070 2024-05-08T18:31:19.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.438+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84340de20 con 0x55b843401d50 2024-05-08T18:31:19.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.439+0000 7f2f20628640 1 -- 172.21.15.87:0/2162690465 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94249890659552] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f10076030 con 0x7f2f18021070 2024-05-08T18:31:19.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.439+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.439+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94249890666864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84340e240 con 0x55b843401d50 2024-05-08T18:31:19.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.439+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84340ea90 con 0x55b843407fa0 2024-05-08T18:31:19.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.440+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94249890666864] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.440+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1804c040 con 0x55b843407fa0 2024-05-08T18:31:19.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.440+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94249890668432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84340e9c0 con 0x55b843407fa0 2024-05-08T18:31:19.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.440+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84340f510 con 0x7f2f18021070 2024-05-08T18:31:19.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.441+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94249890668432] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1804c040 con 0x55b843407fa0 2024-05-08T18:31:19.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.441+0000 7f2f20628640 1 -- 172.21.15.87:0/2162690465 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f10076030 con 0x7f2f18021070 2024-05-08T18:31:19.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.441+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94249890669584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84340f8b0 con 0x7f2f18021070 2024-05-08T18:31:19.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.441+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8434103d0 con 0x55b843401d50 2024-05-08T18:31:19.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.442+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.442+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94249890676384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b843410c70 con 0x55b843401d50 2024-05-08T18:31:19.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.442+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b843411730 con 0x7f2f10079060 2024-05-08T18:31:19.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.442+0000 7f2f20628640 1 -- 172.21.15.87:0/2162690465 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94249890669584] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f10076030 con 0x7f2f18021070 2024-05-08T18:31:19.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.443+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.443+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94249890681344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8434116f0 con 0x7f2f10079060 2024-05-08T18:31:19.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.443+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b843412140 con 0x7f2f10079060 2024-05-08T18:31:19.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.443+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94249890676384] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.444+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94249890681344] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.444+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.444+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94249890672672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b843411c90 con 0x7f2f10079060 2024-05-08T18:31:19.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.445+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b843412650 con 0x7f2f10079060 2024-05-08T18:31:19.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.445+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94249890672672] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.445+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.445+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94249890678608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b843412650 con 0x7f2f10079060 2024-05-08T18:31:19.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.445+0000 7f2f24931800 20 add_watcher() i=0 2024-05-08T18:31:19.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.445+0000 7f2f24931800 20 add_watcher() i=1 2024-05-08T18:31:19.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.445+0000 7f2f24931800 20 add_watcher() i=2 2024-05-08T18:31:19.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.445+0000 7f2f24931800 20 add_watcher() i=3 2024-05-08T18:31:19.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.445+0000 7f2f24931800 20 add_watcher() i=4 2024-05-08T18:31:19.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.445+0000 7f2f24931800 20 add_watcher() i=5 2024-05-08T18:31:19.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.445+0000 7f2f24931800 20 add_watcher() i=6 2024-05-08T18:31:19.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.446+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94249890678608] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.446+0000 7f2f24931800 20 add_watcher() i=7 2024-05-08T18:31:19.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.446+0000 7f2f24931800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:19.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.446+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b843415940 con 0x55b843401d50 2024-05-08T18:31:19.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.447+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.447+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94249890685712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b843412be0 con 0x55b843401d50 2024-05-08T18:31:19.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.448+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94249890685712] v27'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.448+0000 7f2dd67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:19.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.448+0000 7f2f24931800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:19.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.448+0000 7f2f24931800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:19.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.448+0000 7f2f24931800 5 note: GC not initialized 2024-05-08T18:31:19.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.448+0000 7f2dd57e2640 20 reqs_thread_entry: start 2024-05-08T18:31:19.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.448+0000 7f2f24931800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:19.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.448+0000 7f2f24931800 20 Filter name: none 2024-05-08T18:31:19.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.448+0000 7f2d46ffd640 20 reqs_thread_entry: start 2024-05-08T18:31:19.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.448+0000 7f2f24931800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:19.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.448+0000 7f2f24931800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.448+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b843448eb0 con 0x55b843401d50 2024-05-08T18:31:19.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.449+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.449+0000 7f2f24931800 20 rados_obj.operate() r=0 bl.length=582 2024-05-08T18:31:19.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.449+0000 7f2f24931800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:19.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.449+0000 7f2f24931800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:19.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.449+0000 7f2f24931800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:19.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.449+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84344f4b0 con 0x55b843401d50 2024-05-08T18:31:19.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.450+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v27'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.450+0000 7f2f24931800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:19.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.450+0000 7f2f24931800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:19.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.450+0000 7f2f24931800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:31:19.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.450+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94249890934384 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b84344ad60 con 0x55b843401d50 2024-05-08T18:31:19.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.450+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== watch-notify(notify (1) cookie 94249890676384 notify 115964117001 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55b8432cabe0 con 0x55b843401d50 2024-05-08T18:31:19.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.450+0000 7f2df77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117001 cookie 94249890676384 notifier 4403 bl.length()=732 2024-05-08T18:31:19.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.450+0000 7f2df77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:19.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.450+0000 7f2df77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:19.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.451+0000 7f2df77fe640 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f2de4003ea0 con 0x55b843401d50 2024-05-08T18:31:19.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.451+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(64 notify.4 [notify cookie 94249890934384 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.451+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.451+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== watch-notify(notify_complete (2) cookie 94249890934384 notify 115964117001 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2f0802e720 con 0x55b843401d50 2024-05-08T18:31:19.461 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-08T18:31:19.069601Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:19.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.452+0000 7f2dd67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:19.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.452+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94249890685712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84344a380 con 0x55b843401d50 2024-05-08T18:31:19.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.453+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94249890685712] v27'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.453+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94249890659552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84344a380 con 0x7f2f18021070 2024-05-08T18:31:19.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.454+0000 7f2f20628640 1 -- 172.21.15.87:0/2162690465 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94249890659552] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f10076030 con 0x7f2f18021070 2024-05-08T18:31:19.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.454+0000 7f2f24931800 20 remove_watcher() i=0 2024-05-08T18:31:19.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.454+0000 7f2f24931800 2 removed watcher, disabling cache 2024-05-08T18:31:19.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.454+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94249890666864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84344a380 con 0x55b843401d50 2024-05-08T18:31:19.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.455+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94249890666864] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.455+0000 7f2f24931800 20 remove_watcher() i=1 2024-05-08T18:31:19.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.455+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94249890668432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84344a380 con 0x55b843407fa0 2024-05-08T18:31:19.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.456+0000 7f2f20e29640 1 -- 172.21.15.87:0/2162690465 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94249890668432] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1804c040 con 0x55b843407fa0 2024-05-08T18:31:19.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.456+0000 7f2f24931800 20 remove_watcher() i=2 2024-05-08T18:31:19.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.456+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94249890669584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84344a380 con 0x7f2f18021070 2024-05-08T18:31:19.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.457+0000 7f2f20628640 1 -- 172.21.15.87:0/2162690465 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94249890669584] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f10076030 con 0x7f2f18021070 2024-05-08T18:31:19.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.457+0000 7f2f24931800 20 remove_watcher() i=3 2024-05-08T18:31:19.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.457+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94249890676384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84344a380 con 0x55b843401d50 2024-05-08T18:31:19.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.458+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94249890676384] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x55b843401d50 2024-05-08T18:31:19.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.458+0000 7f2f24931800 20 remove_watcher() i=4 2024-05-08T18:31:19.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.458+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94249890681344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84344a380 con 0x7f2f10079060 2024-05-08T18:31:19.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.459+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94249890681344] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.459+0000 7f2f24931800 20 remove_watcher() i=5 2024-05-08T18:31:19.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.459+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94249890672672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84344a380 con 0x7f2f10079060 2024-05-08T18:31:19.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.460+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94249890672672] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.460+0000 7f2f24931800 20 remove_watcher() i=6 2024-05-08T18:31:19.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.460+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94249890678608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b84344a380 con 0x7f2f10079060 2024-05-08T18:31:19.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.460+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94249890678608] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0802a040 con 0x7f2f10079060 2024-05-08T18:31:19.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.460+0000 7f2f24931800 20 remove_watcher() i=7 2024-05-08T18:31:19.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2f10079060 msgr2=0x7f2f1006e7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2f10079060 0x7f2f1006e7d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b843401d50 msgr2=0x55b843404210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b843401d50 0x55b843404210 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f2f18021070 msgr2=0x7f2f18054990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f2f18021070 0x7f2f18054990 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b843407fa0 msgr2=0x55b84340a390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b843407fa0 0x55b84340a390 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2de803bb50 msgr2=0x7f2de803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2de803bb50 0x7f2de803e010 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2f10070f90 tx=0x7f2f1008a000 comp rx=0 tx=0).stop 2024-05-08T18:31:19.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433eee30 msgr2=0x55b8433f6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 --2- 172.21.15.87:0/2162690465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433eee30 0x55b8433f6190 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2f18014fd0 tx=0x7f2f18052970 comp rx=0 tx=0).stop 2024-05-08T18:31:19.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 reap_dead start 2024-05-08T18:31:19.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f17e27640 1 -- 172.21.15.87:0/2162690465 reap_dead start 2024-05-08T18:31:19.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 shutdown_connections 2024-05-08T18:31:19.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 >> 172.21.15.87:0/2162690465 conn(0x55b8433eb100 msgr2=0x55b8433e8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 shutdown_connections 2024-05-08T18:31:19.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 -- 172.21.15.87:0/2162690465 wait complete. 2024-05-08T18:31:19.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 -- 172.21.15.87:0/996129611 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2df803bb50 msgr2=0x7f2df803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 --2- 172.21.15.87:0/996129611 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2df803bb50 0x7f2df803e010 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55b8433cfba0 tx=0x7f2f10051480 comp rx=0 tx=0).stop 2024-05-08T18:31:19.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 -- 172.21.15.87:0/996129611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433e1a20 msgr2=0x55b8433e1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 --2- 172.21.15.87:0/996129611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433e1a20 0x55b8433e1e40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55b8433bc8d0 tx=0x7f2f1800ef30 comp rx=0 tx=0).stop 2024-05-08T18:31:19.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 -- 172.21.15.87:0/996129611 shutdown_connections 2024-05-08T18:31:19.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 --2- 172.21.15.87:0/996129611 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2df803bb50 0x7f2df803e010 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 --2- 172.21.15.87:0/996129611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8433e1a20 0x55b8433e1e40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 -- 172.21.15.87:0/996129611 >> 172.21.15.87:0/996129611 conn(0x55b8433d5ac0 msgr2=0x55b8433d5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 -- 172.21.15.87:0/996129611 shutdown_connections 2024-05-08T18:31:19.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.461+0000 7f2f24931800 1 -- 172.21.15.87:0/996129611 wait complete. 2024-05-08T18:31:19.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.462+0000 7f2f24931800 1 -- 172.21.15.87:0/2173494778 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b8433d0c60 msgr2=0x55b8433d3050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.462+0000 7f2f24931800 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b8433d0c60 0x55b8433d3050 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.462+0000 7f2f24931800 1 -- 172.21.15.87:0/2173494778 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b8432cb3a0 msgr2=0x55b8433cd6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.462+0000 7f2f24931800 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b8432cb3a0 0x55b8433cd6c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.462+0000 7f2f24931800 1 -- 172.21.15.87:0/2173494778 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2e0803bb50 msgr2=0x7f2e0803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.462+0000 7f2f24931800 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2e0803bb50 0x7f2e0803e010 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2f08000f60 tx=0x7f2f080012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.462+0000 7f2f24931800 1 -- 172.21.15.87:0/2173494778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 msgr2=0x55b8433bcd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.462+0000 7f2f24931800 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 0x55b8433bcd70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2f1001b9b0 tx=0x7f2f10003330 comp rx=0 tx=0).stop 2024-05-08T18:31:19.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.462+0000 7f2f24931800 1 -- 172.21.15.87:0/2173494778 shutdown_connections 2024-05-08T18:31:19.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.462+0000 7f2f24931800 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b8432cb3a0 0x55b8433cd6c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.462+0000 7f2f24931800 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b8433d0c60 0x55b8433d3050 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.462+0000 7f2f24931800 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2e0803bb50 0x7f2e0803e010 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.462+0000 7f2f24931800 1 --2- 172.21.15.87:0/2173494778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8432ca140 0x55b8433bcd70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.462+0000 7f2f24931800 1 -- 172.21.15.87:0/2173494778 >> 172.21.15.87:0/2173494778 conn(0x55b8432c5720 msgr2=0x55b8433b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.462+0000 7f2f24931800 1 -- 172.21.15.87:0/2173494778 shutdown_connections 2024-05-08T18:31:19.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.462+0000 7f2f24931800 1 -- 172.21.15.87:0/2173494778 wait complete. 2024-05-08T18:31:19.472 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-08T18:31:19.069601Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:19.472 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-05-08T18:31:19.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-05-08T18:31:19.473 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-05-08T18:31:19.520 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:19.520 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:19.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.522+0000 7f68a4810800 1 Processor -- start 2024-05-08T18:31:19.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.522+0000 7f68a4810800 1 -- start start 2024-05-08T18:31:19.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.523+0000 7f68a4810800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55558826e660 0x55558826ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.523+0000 7f68a4810800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55558826f100 con 0x55558826f3e0 2024-05-08T18:31:19.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.523+0000 7f68a4810800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55558810fe20 con 0x55558826e660 2024-05-08T18:31:19.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.523+0000 7f689fe76640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55558826e660 0x55558826ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.523+0000 7f6897fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55558826f3e0 0x55558826f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42024/0 (socket says 172.21.15.87:42024) 2024-05-08T18:31:19.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.523+0000 7f6897fff640 1 -- 172.21.15.87:0/3342138353 learned_addr learned my addr 172.21.15.87:0/3342138353 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:19.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.523+0000 7f689f675640 1 -- 172.21.15.87:0/3342138353 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 234365417 0 0) 0x55558826f100 con 0x55558826f3e0 2024-05-08T18:31:19.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.523+0000 7f689f675640 1 -- 172.21.15.87:0/3342138353 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f688c001e10 con 0x55558826f3e0 2024-05-08T18:31:19.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.523+0000 7f689fe76640 1 -- 172.21.15.87:0/3342138353 >> v1:172.21.15.53:6789/0 conn(0x55558826f3e0 legacy=0x55558826f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.523+0000 7f689fe76640 1 -- 172.21.15.87:0/3342138353 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55558826ffa0 con 0x55558826e660 2024-05-08T18:31:19.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.525+0000 7f689fe76640 1 --2- 172.21.15.87:0/3342138353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826e660 0x55558826ea80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f689000a470 tx=0x7f689001cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73efe8f147b7b14 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.526+0000 7f689f675640 1 -- 172.21.15.87:0/3342138353 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6890057070 con 0x55558826e660 2024-05-08T18:31:19.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.526+0000 7f689f675640 1 -- 172.21.15.87:0/3342138353 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689004acd0 con 0x55558826e660 2024-05-08T18:31:19.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.526+0000 7f689f675640 1 -- 172.21.15.87:0/3342138353 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6890052440 con 0x55558826e660 2024-05-08T18:31:19.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.526+0000 7f68a4810800 1 -- 172.21.15.87:0/3342138353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826e660 msgr2=0x55558826ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.526+0000 7f68a4810800 1 --2- 172.21.15.87:0/3342138353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826e660 0x55558826ea80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f689000a470 tx=0x7f689001cdb0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.526+0000 7f68a4810800 1 -- 172.21.15.87:0/3342138353 shutdown_connections 2024-05-08T18:31:19.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.526+0000 7f68a4810800 1 --2- 172.21.15.87:0/3342138353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826e660 0x55558826ea80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.526+0000 7f68a4810800 1 -- 172.21.15.87:0/3342138353 >> 172.21.15.87:0/3342138353 conn(0x555588268ec0 msgr2=0x55558826b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.526+0000 7f68a4810800 1 -- 172.21.15.87:0/3342138353 shutdown_connections 2024-05-08T18:31:19.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.526+0000 7f68a4810800 1 -- 172.21.15.87:0/3342138353 wait complete. 2024-05-08T18:31:19.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.540+0000 7f68a4810800 1 Processor -- start 2024-05-08T18:31:19.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.540+0000 7f68a4810800 1 -- start start 2024-05-08T18:31:19.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.540+0000 7f68a4810800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826e660 0x55558826dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.540+0000 7f68a4810800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5555881ba5d0 con 0x55558826e660 2024-05-08T18:31:19.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.540+0000 7f689fe76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826e660 0x55558826dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.540+0000 7f689fe76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826e660 0x55558826dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33448/0 (socket says 172.21.15.87:33448) 2024-05-08T18:31:19.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.540+0000 7f689fe76640 1 -- 172.21.15.87:0/2182963103 learned_addr learned my addr 172.21.15.87:0/2182963103 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.541+0000 7f689fe76640 1 -- 172.21.15.87:0/2182963103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555588363210 con 0x55558826e660 2024-05-08T18:31:19.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.541+0000 7f689fe76640 1 --2- 172.21.15.87:0/2182963103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826e660 0x55558826dd60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6890055040 tx=0x7f689004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e10cd5509efe4c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.541+0000 7f678de0b640 1 -- 172.21.15.87:0/2182963103 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6890057040 con 0x55558826e660 2024-05-08T18:31:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.541+0000 7f678de0b640 1 -- 172.21.15.87:0/2182963103 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6890063070 con 0x55558826e660 2024-05-08T18:31:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.541+0000 7f678de0b640 1 -- 172.21.15.87:0/2182963103 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68900527e0 con 0x55558826e660 2024-05-08T18:31:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.542+0000 7f68a4810800 1 -- 172.21.15.87:0/2182963103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826e660 msgr2=0x55558826dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.542+0000 7f68a4810800 1 --2- 172.21.15.87:0/2182963103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826e660 0x55558826dd60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6890055040 tx=0x7f689004c000 comp rx=0 tx=0).stop 2024-05-08T18:31:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.542+0000 7f68a4810800 1 -- 172.21.15.87:0/2182963103 shutdown_connections 2024-05-08T18:31:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.542+0000 7f68a4810800 1 --2- 172.21.15.87:0/2182963103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826e660 0x55558826dd60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.542+0000 7f68a4810800 1 -- 172.21.15.87:0/2182963103 >> 172.21.15.87:0/2182963103 conn(0x555588268ec0 msgr2=0x55558835ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.542+0000 7f68a4810800 1 -- 172.21.15.87:0/2182963103 shutdown_connections 2024-05-08T18:31:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.542+0000 7f68a4810800 1 -- 172.21.15.87:0/2182963103 wait complete. 2024-05-08T18:31:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.542+0000 7f68a4810800 1 Processor -- start 2024-05-08T18:31:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.542+0000 7f68a4810800 1 -- start start 2024-05-08T18:31:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.542+0000 7f68a4810800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826f3e0 0x555588360b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.542+0000 7f68a4810800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5555882778b0 con 0x55558826f3e0 2024-05-08T18:31:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.542+0000 7f689fe76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826f3e0 0x555588360b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.542+0000 7f689fe76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826f3e0 0x555588360b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33450/0 (socket says 172.21.15.87:33450) 2024-05-08T18:31:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.542+0000 7f689fe76640 1 -- 172.21.15.87:0/3206079807 learned_addr learned my addr 172.21.15.87:0/3206079807 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.543+0000 7f689fe76640 1 -- 172.21.15.87:0/3206079807 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55558835f230 con 0x55558826f3e0 2024-05-08T18:31:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.543+0000 7f689fe76640 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826f3e0 0x555588360b40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f689004aca0 tx=0x7f6890002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.543+0000 7f6787fff640 1 -- 172.21.15.87:0/3206079807 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f689006d070 con 0x55558826f3e0 2024-05-08T18:31:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.543+0000 7f6787fff640 1 -- 172.21.15.87:0/3206079807 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6890052ca0 con 0x55558826f3e0 2024-05-08T18:31:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.543+0000 7f68a4810800 1 -- 172.21.15.87:0/3206079807 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55558835f4c0 con 0x55558826f3e0 2024-05-08T18:31:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.543+0000 7f6787fff640 1 -- 172.21.15.87:0/3206079807 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6890057050 con 0x55558826f3e0 2024-05-08T18:31:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.543+0000 7f68a4810800 1 -- 172.21.15.87:0/3206079807 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55558835fa40 con 0x55558826f3e0 2024-05-08T18:31:19.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.544+0000 7f6787fff640 1 -- 172.21.15.87:0/3206079807 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f689005d470 con 0x55558826f3e0 2024-05-08T18:31:19.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.544+0000 7f6787fff640 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f678803bb50 0x7f678803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.544+0000 7f6787fff640 1 -- 172.21.15.87:0/3206079807 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6890093a40 con 0x55558826f3e0 2024-05-08T18:31:19.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.544+0000 7f6897fff640 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f678803bb50 0x7f678803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.544+0000 7f68a4810800 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55558836f690 0x555588371a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.544+0000 7f68a4810800 1 -- 172.21.15.87:0/3206079807 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555588371fc0 con 0x55558836f690 2024-05-08T18:31:19.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.544+0000 7f68a0677640 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55558836f690 0x555588371a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.545+0000 7f6897fff640 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f678803bb50 0x7f678803e010 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6888000f60 tx=0x7f68880010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.545+0000 7f68a0677640 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55558836f690 0x555588371a80 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.545+0000 7f68a0677640 1 -- 172.21.15.87:0/3206079807 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f689800a4a0 con 0x55558836f690 2024-05-08T18:31:19.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.545+0000 7f68a4810800 1 -- 172.21.15.87:0/3206079807 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555588372810 con 0x55558836f690 2024-05-08T18:31:19.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.545+0000 7f68a0677640 1 -- 172.21.15.87:0/3206079807 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f689800a4a0 con 0x55558836f690 2024-05-08T18:31:19.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.545+0000 7f68a4810800 1 -- 172.21.15.87:0/3206079807 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555588373bc0 con 0x55558836f690 2024-05-08T18:31:19.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.546+0000 7f68a0677640 1 -- 172.21.15.87:0/3206079807 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f689800a4a0 con 0x55558836f690 2024-05-08T18:31:19.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.546+0000 7f68a4810800 1 -- 172.21.15.87:0/3206079807 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555588373060 con 0x55558836f690 2024-05-08T18:31:19.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.546+0000 7f68a0677640 1 -- 172.21.15.87:0/3206079807 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f689800a4a0 con 0x55558836f690 2024-05-08T18:31:19.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.546+0000 7f68a4810800 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555588375010 0x555588377400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.546+0000 7f68a4810800 1 -- 172.21.15.87:0/3206079807 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555588377a20 con 0x555588375010 2024-05-08T18:31:19.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.546+0000 7f689fe76640 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555588375010 0x555588377400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.547+0000 7f689fe76640 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555588375010 0x555588377400 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.547+0000 7f689fe76640 1 -- 172.21.15.87:0/3206079807 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f689005a040 con 0x555588375010 2024-05-08T18:31:19.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.547+0000 7f68a4810800 1 Processor -- start 2024-05-08T18:31:19.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.547+0000 7f68a4810800 1 -- start start 2024-05-08T18:31:19.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.547+0000 7f68a4810800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588385d70 0x555588386190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.547+0000 7f68a4810800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555588361080 con 0x555588385d70 2024-05-08T18:31:19.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.547+0000 7f68a0677640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588385d70 0x555588386190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.547+0000 7f68a0677640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588385d70 0x555588386190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33458/0 (socket says 172.21.15.87:33458) 2024-05-08T18:31:19.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.547+0000 7f68a0677640 1 -- 172.21.15.87:0/610763637 learned_addr learned my addr 172.21.15.87:0/610763637 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.548+0000 7f68a0677640 1 -- 172.21.15.87:0/610763637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555883866d0 con 0x555588385d70 2024-05-08T18:31:19.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.548+0000 7f68a0677640 1 --2- 172.21.15.87:0/610763637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588385d70 0x555588386190 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x5555883604a0 tx=0x7f68980178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.548+0000 7f67857fa640 1 -- 172.21.15.87:0/610763637 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6898013440 con 0x555588385d70 2024-05-08T18:31:19.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.548+0000 7f67857fa640 1 -- 172.21.15.87:0/610763637 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68980135e0 con 0x555588385d70 2024-05-08T18:31:19.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.548+0000 7f67857fa640 1 -- 172.21.15.87:0/610763637 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68980138c0 con 0x555588385d70 2024-05-08T18:31:19.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.548+0000 7f68a4810800 1 -- 172.21.15.87:0/610763637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555588387140 con 0x555588385d70 2024-05-08T18:31:19.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.548+0000 7f68a4810800 1 -- 172.21.15.87:0/610763637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555588387640 con 0x555588385d70 2024-05-08T18:31:19.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.549+0000 7f67857fa640 1 -- 172.21.15.87:0/610763637 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6898011040 con 0x555588385d70 2024-05-08T18:31:19.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.549+0000 7f67857fa640 1 --2- 172.21.15.87:0/610763637 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f677803bba0 0x7f677803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.549+0000 7f67857fa640 1 -- 172.21.15.87:0/610763637 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f689801d070 con 0x555588385d70 2024-05-08T18:31:19.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.549+0000 7f689fe76640 1 --2- 172.21.15.87:0/610763637 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f677803bba0 0x7f677803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.549+0000 7f68a4810800 1 Processor -- start 2024-05-08T18:31:19.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.550+0000 7f689fe76640 1 --2- 172.21.15.87:0/610763637 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f677803bba0 0x7f677803e060 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x555588373400 tx=0x7f6890091d00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.550+0000 7f68a4810800 1 -- start start 2024-05-08T18:31:19.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.550+0000 7f68a4810800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588393030 0x555588393450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.550+0000 7f68a4810800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555588160fc0 con 0x555588393030 2024-05-08T18:31:19.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.550+0000 7f68a0677640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588393030 0x555588393450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.550+0000 7f68a0677640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588393030 0x555588393450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33472/0 (socket says 172.21.15.87:33472) 2024-05-08T18:31:19.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.550+0000 7f68a0677640 1 -- 172.21.15.87:0/2548554975 learned_addr learned my addr 172.21.15.87:0/2548554975 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.550+0000 7f68a0677640 1 -- 172.21.15.87:0/2548554975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555588393a20 con 0x555588393030 2024-05-08T18:31:19.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.550+0000 7f68a0677640 1 --2- 172.21.15.87:0/2548554975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588393030 0x555588393450 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6898052970 tx=0x7f6898001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8938df15c4d6d6c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.550+0000 7f677effd640 1 -- 172.21.15.87:0/2548554975 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6898021da0 con 0x555588393030 2024-05-08T18:31:19.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.550+0000 7f677effd640 1 -- 172.21.15.87:0/2548554975 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689802ac50 con 0x555588393030 2024-05-08T18:31:19.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.550+0000 7f677effd640 1 -- 172.21.15.87:0/2548554975 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68980512b0 con 0x555588393030 2024-05-08T18:31:19.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.551+0000 7f68a4810800 1 -- 172.21.15.87:0/2548554975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588393030 msgr2=0x555588393450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.551+0000 7f68a4810800 1 --2- 172.21.15.87:0/2548554975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588393030 0x555588393450 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6898052970 tx=0x7f6898001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:19.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.551+0000 7f68a4810800 1 -- 172.21.15.87:0/2548554975 shutdown_connections 2024-05-08T18:31:19.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.551+0000 7f68a4810800 1 --2- 172.21.15.87:0/2548554975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588393030 0x555588393450 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.551+0000 7f68a4810800 1 -- 172.21.15.87:0/2548554975 >> 172.21.15.87:0/2548554975 conn(0x55558838f390 msgr2=0x55558838d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.551+0000 7f68a4810800 1 -- 172.21.15.87:0/2548554975 shutdown_connections 2024-05-08T18:31:19.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.551+0000 7f68a4810800 1 -- 172.21.15.87:0/2548554975 wait complete. 2024-05-08T18:31:19.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.551+0000 7f68a4810800 1 Processor -- start 2024-05-08T18:31:19.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.551+0000 7f68a4810800 1 -- start start 2024-05-08T18:31:19.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.551+0000 7f68a4810800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588393030 0x55558839a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.551+0000 7f68a4810800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555588394010 con 0x555588393030 2024-05-08T18:31:19.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.552+0000 7f68a0677640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588393030 0x55558839a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.552+0000 7f68a0677640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588393030 0x55558839a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33474/0 (socket says 172.21.15.87:33474) 2024-05-08T18:31:19.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.552+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 learned_addr learned my addr 172.21.15.87:0/3613248661 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.552+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55558839a9f0 con 0x555588393030 2024-05-08T18:31:19.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.552+0000 7f68a0677640 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588393030 0x55558839a4b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6898001990 tx=0x7f6898052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.552+0000 7f677d7fa640 1 -- 172.21.15.87:0/3613248661 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6898030020 con 0x555588393030 2024-05-08T18:31:19.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.552+0000 7f677d7fa640 1 -- 172.21.15.87:0/3613248661 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689802ae00 con 0x555588393030 2024-05-08T18:31:19.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.552+0000 7f677d7fa640 1 -- 172.21.15.87:0/3613248661 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6898013a60 con 0x555588393030 2024-05-08T18:31:19.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.552+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55558839ac80 con 0x555588393030 2024-05-08T18:31:19.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.552+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55558839d930 con 0x555588393030 2024-05-08T18:31:19.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.553+0000 7f677d7fa640 1 -- 172.21.15.87:0/3613248661 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6898033020 con 0x555588393030 2024-05-08T18:31:19.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.553+0000 7f677d7fa640 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f676803bb50 0x7f676803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.553+0000 7f677d7fa640 1 -- 172.21.15.87:0/3613248661 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f689800e040 con 0x555588393030 2024-05-08T18:31:19.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.553+0000 7f689fe76640 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f676803bb50 0x7f676803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.554+0000 7f689fe76640 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f676803bb50 0x7f676803e010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6890091e30 tx=0x7f6890084000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.554+0000 7f68a4810800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.554+0000 7f68a4810800 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5555883a6120 0x5555883a85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.554+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5555883a8d30 con 0x5555883a6120 2024-05-08T18:31:19.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.554+0000 7f6897fff640 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5555883a6120 0x5555883a85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.554+0000 7f6897fff640 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5555883a6120 0x5555883a85e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.554+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6888009050 con 0x5555883a6120 2024-05-08T18:31:19.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.554+0000 7f68a4810800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.554+0000 7f68a4810800 20 realm 2024-05-08T18:31:19.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.554+0000 7f68a4810800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.554+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5555883a5570 con 0x5555883a6120 2024-05-08T18:31:19.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.554+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6888009050 con 0x5555883a6120 2024-05-08T18:31:19.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.554+0000 7f68a4810800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.554+0000 7f68a4810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:19.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.554+0000 7f68a4810800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.554+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5555883a9820 con 0x5555883a6120 2024-05-08T18:31:19.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.555+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6888009050 con 0x5555883a6120 2024-05-08T18:31:19.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.555+0000 7f68a4810800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.555+0000 7f68a4810800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.555+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5555883aa0f0 con 0x5555883a6120 2024-05-08T18:31:19.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.555+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6888009050 con 0x5555883a6120 2024-05-08T18:31:19.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.555+0000 7f68a4810800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:19.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.555+0000 7f68a4810800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.555+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5555883aa490 con 0x5555883a6120 2024-05-08T18:31:19.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.555+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6888009050 con 0x5555883a6120 2024-05-08T18:31:19.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.555+0000 7f68a4810800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:19.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.555+0000 7f68a4810800 20 searching for the correct realm 2024-05-08T18:31:19.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.555+0000 7f68a4810800 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5555883ac370 0x5555883ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.555+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x5555883ac370 2024-05-08T18:31:19.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.555+0000 7f68a0677640 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5555883ac370 0x5555883ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.556+0000 7f68a0677640 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5555883ac370 0x5555883ae7c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.556+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6898051020 con 0x5555883ac370 2024-05-08T18:31:19.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.556+0000 7f68a0677640 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6898035020 0x7f6898037980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.556+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x7f6898035020 2024-05-08T18:31:19.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.556+0000 7f689fe76640 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6898035020 0x7f6898037980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.557+0000 7f689fe76640 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6898035020 0x7f6898037980 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.557+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689005a040 con 0x7f6898035020 2024-05-08T18:31:19.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.557+0000 7f689fe76640 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f68900a0040 0x7f689005f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.557+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x7f68900a0040 2024-05-08T18:31:19.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.557+0000 7f6897fff640 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f68900a0040 0x7f689005f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.557+0000 7f6897fff640 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f68900a0040 0x7f689005f8a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.558+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6888009050 con 0x7f68900a0040 2024-05-08T18:31:19.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.558+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x5555883a6120 2024-05-08T18:31:19.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.558+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6888009050 con 0x5555883a6120 2024-05-08T18:31:19.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.558+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x5555883a6120 2024-05-08T18:31:19.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.558+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.558+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x7f68900a0040 2024-05-08T18:31:19.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.558+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.558+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x7f68900a0040 2024-05-08T18:31:19.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.558+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.558+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x7f6898035020 2024-05-08T18:31:19.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.559+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689005a040 con 0x7f6898035020 2024-05-08T18:31:19.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.559+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x5555883ac370 2024-05-08T18:31:19.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.559+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6898051020 con 0x5555883ac370 2024-05-08T18:31:19.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.559+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x5555883a6120 2024-05-08T18:31:19.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.559+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.559+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x7f68900a0040 2024-05-08T18:31:19.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.559+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.559+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x5555883a6120 2024-05-08T18:31:19.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.560+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.560+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x7f6898035020 2024-05-08T18:31:19.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.560+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f689005a040 con 0x7f6898035020 2024-05-08T18:31:19.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.560+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x5555883ac370 2024-05-08T18:31:19.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.560+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6898051020 con 0x5555883ac370 2024-05-08T18:31:19.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.560+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x5555883ac370 2024-05-08T18:31:19.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.560+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6898051020 con 0x5555883ac370 2024-05-08T18:31:19.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.560+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x7f68900a0040 2024-05-08T18:31:19.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.561+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.561+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x5555883ac370 2024-05-08T18:31:19.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.561+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6898051020 con 0x5555883ac370 2024-05-08T18:31:19.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.561+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x5555883ac370 2024-05-08T18:31:19.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.561+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6898051020 con 0x5555883ac370 2024-05-08T18:31:19.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.561+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x5555883a6120 2024-05-08T18:31:19.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.561+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.561+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x5555883a6120 2024-05-08T18:31:19.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.562+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.562+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x7f68900a0040 2024-05-08T18:31:19.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.562+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.562+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x5555883ac370 2024-05-08T18:31:19.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.562+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6898051020 con 0x5555883ac370 2024-05-08T18:31:19.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.562+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x7f6898035020 2024-05-08T18:31:19.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.562+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689005a040 con 0x7f6898035020 2024-05-08T18:31:19.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.562+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x5555883a6120 2024-05-08T18:31:19.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.563+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.563+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x7f68900a0040 2024-05-08T18:31:19.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.563+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.563+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x5555883ac370 2024-05-08T18:31:19.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.563+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6898051020 con 0x5555883ac370 2024-05-08T18:31:19.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.563+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x7f68900a0040 2024-05-08T18:31:19.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.564+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.564+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x7f6898035020 2024-05-08T18:31:19.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.564+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689005a040 con 0x7f6898035020 2024-05-08T18:31:19.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.564+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x5555883ac370 2024-05-08T18:31:19.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.564+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6898051020 con 0x5555883ac370 2024-05-08T18:31:19.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.564+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x7f68900a0040 2024-05-08T18:31:19.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.565+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.565+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x5555883a6120 2024-05-08T18:31:19.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.565+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.565+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5555883aee90 con 0x7f6898035020 2024-05-08T18:31:19.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.565+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689005a040 con 0x7f6898035020 2024-05-08T18:31:19.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.565+0000 7f68a4810800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.565+0000 7f68a4810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.565+0000 7f68a4810800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.565+0000 7f68a4810800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.565+0000 7f68a4810800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.565+0000 7f68a4810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.565+0000 7f68a4810800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.565+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5555883aae10 con 0x5555883a6120 2024-05-08T18:31:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.565+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5555883ab6b0 con 0x5555883a6120 2024-05-08T18:31:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:19.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5555883af310 con 0x7f68900a0040 2024-05-08T18:31:19.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:19.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 20 zone default found 2024-05-08T18:31:19.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 4 Realm: () 2024-05-08T18:31:19.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:19.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:19.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:19.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 20 zonegroup default 2024-05-08T18:31:19.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5555883af7c0 con 0x7f68900a0040 2024-05-08T18:31:19.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.566+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5555883b11a0 con 0x5555883ac370 2024-05-08T18:31:19.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.567+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6898051020 con 0x5555883ac370 2024-05-08T18:31:19.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.567+0000 7f68a4810800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.567+0000 7f68a4810800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.567+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5555883b1610 con 0x5555883ac370 2024-05-08T18:31:19.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.567+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6898051020 con 0x5555883ac370 2024-05-08T18:31:19.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.567+0000 7f68a4810800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.567+0000 7f68a4810800 20 started sync module instance, tier type = 2024-05-08T18:31:19.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.567+0000 7f68a4810800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:19.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.567+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b0630 con 0x7f6898035020 2024-05-08T18:31:19.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.568+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689005a040 con 0x7f6898035020 2024-05-08T18:31:19.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.568+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93825846151712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b1f20 con 0x7f6898035020 2024-05-08T18:31:19.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.568+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b2770 con 0x5555883a6120 2024-05-08T18:31:19.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.569+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93825846151712] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689005a040 con 0x7f6898035020 2024-05-08T18:31:19.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.569+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.569+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93825846155888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b27f0 con 0x5555883a6120 2024-05-08T18:31:19.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.569+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b3310 con 0x5555883ac370 2024-05-08T18:31:19.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.570+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93825846155888] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.570+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6898051020 con 0x5555883ac370 2024-05-08T18:31:19.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.570+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93825846160864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b3700 con 0x5555883ac370 2024-05-08T18:31:19.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.570+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b4140 con 0x7f6898035020 2024-05-08T18:31:19.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.571+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93825846160864] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6898051020 con 0x5555883ac370 2024-05-08T18:31:19.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.571+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689005a040 con 0x7f6898035020 2024-05-08T18:31:19.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.571+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93825846164496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b4530 con 0x7f6898035020 2024-05-08T18:31:19.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.571+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b4f70 con 0x5555883a6120 2024-05-08T18:31:19.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.572+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93825846164496] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689005a040 con 0x7f6898035020 2024-05-08T18:31:19.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.572+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.572+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93825846168128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b5360 con 0x5555883a6120 2024-05-08T18:31:19.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.572+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b5d60 con 0x7f68900a0040 2024-05-08T18:31:19.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.573+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.573+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93825846171760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b5cd0 con 0x7f68900a0040 2024-05-08T18:31:19.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.573+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b6d30 con 0x7f68900a0040 2024-05-08T18:31:19.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.573+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93825846168128] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.574+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93825846171760] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.574+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.574+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93825846174032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b22c0 con 0x7f68900a0040 2024-05-08T18:31:19.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.575+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b71a0 con 0x7f68900a0040 2024-05-08T18:31:19.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.576+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.576+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93825846174032] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.576+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93825846177008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b75c0 con 0x7f68900a0040 2024-05-08T18:31:19.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.576+0000 7f68a4810800 20 add_watcher() i=0 2024-05-08T18:31:19.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.576+0000 7f68a4810800 20 add_watcher() i=1 2024-05-08T18:31:19.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.576+0000 7f68a4810800 20 add_watcher() i=2 2024-05-08T18:31:19.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.576+0000 7f68a4810800 20 add_watcher() i=3 2024-05-08T18:31:19.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.576+0000 7f68a4810800 20 add_watcher() i=4 2024-05-08T18:31:19.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.576+0000 7f68a4810800 20 add_watcher() i=5 2024-05-08T18:31:19.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.576+0000 7f68a4810800 20 add_watcher() i=6 2024-05-08T18:31:19.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.576+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93825846177008] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.576+0000 7f68a4810800 20 add_watcher() i=7 2024-05-08T18:31:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.576+0000 7f68a4810800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.576+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5555883b75c0 con 0x5555883a6120 2024-05-08T18:31:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.577+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.577+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93825846178064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b7560 con 0x5555883a6120 2024-05-08T18:31:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.578+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93825846178064] v27'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.578+0000 7f6755fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.578+0000 7f68a4810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.578+0000 7f68a4810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.578+0000 7f68a4810800 5 note: GC not initialized 2024-05-08T18:31:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.578+0000 7f6754fe1640 20 reqs_thread_entry: start 2024-05-08T18:31:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.578+0000 7f68a4810800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.578+0000 7f68a4810800 20 Filter name: none 2024-05-08T18:31:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.579+0000 7f66ce7fc640 20 reqs_thread_entry: start 2024-05-08T18:31:19.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.579+0000 7f68a4810800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:19.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.579+0000 7f68a4810800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.579+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5555883edad0 con 0x5555883a6120 2024-05-08T18:31:19.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.579+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.579+0000 7f68a4810800 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T18:31:19.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.579+0000 7f68a4810800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:19.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.579+0000 7f68a4810800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:19.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.579+0000 7f68a4810800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:19.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.579+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883f4150 con 0x5555883a6120 2024-05-08T18:31:19.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.580+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v27'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.580+0000 7f68a4810800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:19.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.580+0000 7f68a4810800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:19.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.580+0000 7f68a4810800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:31:19.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.580+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93825846426384 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5555883ef7d0 con 0x5555883a6120 2024-05-08T18:31:19.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.581+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== watch-notify(notify (1) cookie 93825846168128 notify 115964117002 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f688c001e10 con 0x5555883a6120 2024-05-08T18:31:19.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.581+0000 7f677effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117002 cookie 93825846168128 notifier 4410 bl.length()=567 2024-05-08T18:31:19.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.581+0000 7f677effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:19.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.581+0000 7f677effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:19.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.581+0000 7f677effd640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f6764003ea0 con 0x5555883a6120 2024-05-08T18:31:19.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.581+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(64 notify.4 [notify cookie 93825846426384 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.581+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.581+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== watch-notify(notify_complete (2) cookie 93825846426384 notify 115964117002 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f688802e9f0 con 0x5555883a6120 2024-05-08T18:31:19.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.581+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883f3b10 con 0x7f6898035020 2024-05-08T18:31:19.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.582+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 foo:foo2 [delete] v27'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689005a040 con 0x7f6898035020 2024-05-08T18:31:19.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.582+0000 7f68a4810800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-05-08T18:31:19.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.582+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93825846426384 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5555883ef320 con 0x7f6898035020 2024-05-08T18:31:19.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.582+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== watch-notify(notify (1) cookie 93825846151712 notify 115964116997 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f68900a7040 con 0x7f6898035020 2024-05-08T18:31:19.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.582+0000 7f677e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 93825846151712 notifier 4410 bl.length()=159 2024-05-08T18:31:19.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.582+0000 7f677e7fc640 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f66d40032c0 con 0x7f6898035020 2024-05-08T18:31:19.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.583+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(67 notify.0 [notify cookie 93825846426384 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f689005a040 con 0x7f6898035020 2024-05-08T18:31:19.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.583+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689005a040 con 0x7f6898035020 2024-05-08T18:31:19.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.583+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== watch-notify(notify_complete (2) cookie 93825846426384 notify 115964116997 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55558835fa40 con 0x7f6898035020 2024-05-08T18:31:19.593 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:19.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.584+0000 7f6755fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:19.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.584+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93825846178064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883efc00 con 0x5555883a6120 2024-05-08T18:31:19.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.585+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93825846178064] v27'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.585+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93825846151712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b7110 con 0x7f6898035020 2024-05-08T18:31:19.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.586+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93825846151712] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689005a040 con 0x7f6898035020 2024-05-08T18:31:19.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.586+0000 7f68a4810800 20 remove_watcher() i=0 2024-05-08T18:31:19.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.586+0000 7f68a4810800 2 removed watcher, disabling cache 2024-05-08T18:31:19.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.586+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93825846155888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b7110 con 0x5555883a6120 2024-05-08T18:31:19.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.587+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93825846155888] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.587+0000 7f68a4810800 20 remove_watcher() i=1 2024-05-08T18:31:19.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.587+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93825846160864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b1a70 con 0x5555883ac370 2024-05-08T18:31:19.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.588+0000 7f68a0677640 1 -- 172.21.15.87:0/3613248661 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93825846160864] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6898051020 con 0x5555883ac370 2024-05-08T18:31:19.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.588+0000 7f68a4810800 20 remove_watcher() i=2 2024-05-08T18:31:19.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.588+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93825846164496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b7110 con 0x7f6898035020 2024-05-08T18:31:19.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.588+0000 7f689fe76640 1 -- 172.21.15.87:0/3613248661 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93825846164496] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689005a040 con 0x7f6898035020 2024-05-08T18:31:19.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.589+0000 7f68a4810800 20 remove_watcher() i=3 2024-05-08T18:31:19.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.589+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93825846168128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b2de0 con 0x5555883a6120 2024-05-08T18:31:19.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.589+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93825846168128] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688802a040 con 0x5555883a6120 2024-05-08T18:31:19.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.589+0000 7f68a4810800 20 remove_watcher() i=4 2024-05-08T18:31:19.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.589+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93825846171760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b1a70 con 0x7f68900a0040 2024-05-08T18:31:19.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.590+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93825846171760] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.590+0000 7f68a4810800 20 remove_watcher() i=5 2024-05-08T18:31:19.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.590+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93825846174032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b2de0 con 0x7f68900a0040 2024-05-08T18:31:19.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.591+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93825846174032] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.591+0000 7f68a4810800 20 remove_watcher() i=6 2024-05-08T18:31:19.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.591+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93825846177008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5555883b5870 con 0x7f68900a0040 2024-05-08T18:31:19.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.592+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93825846177008] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688802a040 con 0x7f68900a0040 2024-05-08T18:31:19.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.592+0000 7f68a4810800 20 remove_watcher() i=7 2024-05-08T18:31:19.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.592+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f68900a0040 msgr2=0x7f689005f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.592+0000 7f68a4810800 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f68900a0040 0x7f689005f8a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.592+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5555883a6120 msgr2=0x5555883a85e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.592+0000 7f68a4810800 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5555883a6120 0x5555883a85e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.592+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6898035020 msgr2=0x7f6898037980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.592+0000 7f68a4810800 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6898035020 0x7f6898037980 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.592+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5555883ac370 msgr2=0x5555883ae7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.592+0000 7f68a4810800 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5555883ac370 0x5555883ae7c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.592+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f676803bb50 msgr2=0x7f676803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.592+0000 7f68a4810800 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f676803bb50 0x7f676803e010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6890091e30 tx=0x7f6890084000 comp rx=0 tx=0).stop 2024-05-08T18:31:19.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.592+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588393030 msgr2=0x55558839a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.592+0000 7f68a4810800 1 --2- 172.21.15.87:0/3613248661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588393030 0x55558839a4b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6898001990 tx=0x7f6898052900 comp rx=0 tx=0).stop 2024-05-08T18:31:19.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.592+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 reap_dead start 2024-05-08T18:31:19.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.592+0000 7f6897fff640 1 -- 172.21.15.87:0/3613248661 reap_dead start 2024-05-08T18:31:19.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 shutdown_connections 2024-05-08T18:31:19.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 >> 172.21.15.87:0/3613248661 conn(0x55558838f390 msgr2=0x55558838c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 shutdown_connections 2024-05-08T18:31:19.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 -- 172.21.15.87:0/3613248661 wait complete. 2024-05-08T18:31:19.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 -- 172.21.15.87:0/610763637 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f677803bba0 msgr2=0x7f677803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 --2- 172.21.15.87:0/610763637 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f677803bba0 0x7f677803e060 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x555588373400 tx=0x7f6890091d00 comp rx=0 tx=0).stop 2024-05-08T18:31:19.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 -- 172.21.15.87:0/610763637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588385d70 msgr2=0x555588386190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 --2- 172.21.15.87:0/610763637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588385d70 0x555588386190 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x5555883604a0 tx=0x7f68980178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 -- 172.21.15.87:0/610763637 shutdown_connections 2024-05-08T18:31:19.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 --2- 172.21.15.87:0/610763637 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f677803bba0 0x7f677803e060 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 --2- 172.21.15.87:0/610763637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555588385d70 0x555588386190 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 -- 172.21.15.87:0/610763637 >> 172.21.15.87:0/610763637 conn(0x555588379e10 msgr2=0x55558837a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 -- 172.21.15.87:0/610763637 shutdown_connections 2024-05-08T18:31:19.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 -- 172.21.15.87:0/610763637 wait complete. 2024-05-08T18:31:19.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 -- 172.21.15.87:0/3206079807 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555588375010 msgr2=0x555588377400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555588375010 0x555588377400 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 -- 172.21.15.87:0/3206079807 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55558836f690 msgr2=0x555588371a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55558836f690 0x555588371a80 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 -- 172.21.15.87:0/3206079807 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f678803bb50 msgr2=0x7f678803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f678803bb50 0x7f678803e010 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6888000f60 tx=0x7f68880010a0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 -- 172.21.15.87:0/3206079807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826f3e0 msgr2=0x555588360b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826f3e0 0x555588360b40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f689004aca0 tx=0x7f6890002fb0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 -- 172.21.15.87:0/3206079807 shutdown_connections 2024-05-08T18:31:19.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55558836f690 0x555588371a80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555588375010 0x555588377400 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f678803bb50 0x7f678803e010 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 --2- 172.21.15.87:0/3206079807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55558826f3e0 0x555588360b40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.593+0000 7f68a4810800 1 -- 172.21.15.87:0/3206079807 >> 172.21.15.87:0/3206079807 conn(0x555588268ec0 msgr2=0x555588359500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.594+0000 7f68a4810800 1 -- 172.21.15.87:0/3206079807 shutdown_connections 2024-05-08T18:31:19.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.594+0000 7f68a4810800 1 -- 172.21.15.87:0/3206079807 wait complete. 2024-05-08T18:31:19.605 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:19.605 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-05-08T18:31:19.605 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-05-08T18:31:19.605 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-05-08T18:31:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.652+0000 7f60a501b800 1 Processor -- start 2024-05-08T18:31:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.652+0000 7f60a501b800 1 -- start start 2024-05-08T18:31:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.652+0000 7f60a501b800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56148983fde0 0x56148983e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.652+0000 7f60a501b800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56148983edc0 con 0x56148983e880 2024-05-08T18:31:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.652+0000 7f60a501b800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56148976ae20 con 0x56148983fde0 2024-05-08T18:31:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.652+0000 7f60a2b13640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56148983fde0 0x56148983e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.652+0000 7f609bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56148983e880 0x5614898d2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42040/0 (socket says 172.21.15.87:42040) 2024-05-08T18:31:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.652+0000 7f60a2b13640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56148983fde0 0x56148983e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33488/0 (socket says 172.21.15.87:33488) 2024-05-08T18:31:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.652+0000 7f609bfff640 1 -- 172.21.15.87:0/629203780 learned_addr learned my addr 172.21.15.87:0/629203780 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.653+0000 7f60a2b13640 1 -- 172.21.15.87:0/629203780 >> v1:172.21.15.53:6789/0 conn(0x56148983e880 legacy=0x5614898d2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.653+0000 7f60a2b13640 1 -- 172.21.15.87:0/629203780 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56148983ef90 con 0x56148983fde0 2024-05-08T18:31:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.655+0000 7f60a2b13640 1 --2- 172.21.15.87:0/629203780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983fde0 0x56148983e340 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f609400a470 tx=0x7f609401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94748ac88ce129a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.655+0000 7f60a2312640 1 -- 172.21.15.87:0/629203780 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6094057070 con 0x56148983fde0 2024-05-08T18:31:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.655+0000 7f60a2312640 1 -- 172.21.15.87:0/629203780 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609404adc0 con 0x56148983fde0 2024-05-08T18:31:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.655+0000 7f60a2312640 1 -- 172.21.15.87:0/629203780 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6094052590 con 0x56148983fde0 2024-05-08T18:31:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.655+0000 7f60a501b800 1 -- 172.21.15.87:0/629203780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983fde0 msgr2=0x56148983e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.655+0000 7f60a501b800 1 --2- 172.21.15.87:0/629203780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983fde0 0x56148983e340 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f609400a470 tx=0x7f609401ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.655+0000 7f60a501b800 1 -- 172.21.15.87:0/629203780 shutdown_connections 2024-05-08T18:31:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.655+0000 7f60a501b800 1 --2- 172.21.15.87:0/629203780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983fde0 0x56148983e340 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.655+0000 7f60a501b800 1 -- 172.21.15.87:0/629203780 >> 172.21.15.87:0/629203780 conn(0x5614898c5830 msgr2=0x5614898c7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.655+0000 7f60a501b800 1 -- 172.21.15.87:0/629203780 shutdown_connections 2024-05-08T18:31:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.655+0000 7f60a501b800 1 -- 172.21.15.87:0/629203780 wait complete. 2024-05-08T18:31:19.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.669+0000 7f60a501b800 1 Processor -- start 2024-05-08T18:31:19.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.669+0000 7f60a501b800 1 -- start start 2024-05-08T18:31:19.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.669+0000 7f60a501b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983e880 0x5614899bd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.669+0000 7f60a501b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5614898155b0 con 0x56148983e880 2024-05-08T18:31:19.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.669+0000 7f60a2b13640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983e880 0x5614899bd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.669+0000 7f60a2b13640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983e880 0x5614899bd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33498/0 (socket says 172.21.15.87:33498) 2024-05-08T18:31:19.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.669+0000 7f60a2b13640 1 -- 172.21.15.87:0/718887970 learned_addr learned my addr 172.21.15.87:0/718887970 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.670+0000 7f60a2b13640 1 -- 172.21.15.87:0/718887970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614899bde90 con 0x56148983e880 2024-05-08T18:31:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.670+0000 7f60a2b13640 1 --2- 172.21.15.87:0/718887970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983e880 0x5614899bd8c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f609401ced0 tx=0x7f609404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1534e35c31caea2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.670+0000 7f5f90e09640 1 -- 172.21.15.87:0/718887970 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6094057040 con 0x56148983e880 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.670+0000 7f5f90e09640 1 -- 172.21.15.87:0/718887970 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6094063070 con 0x56148983e880 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.670+0000 7f5f90e09640 1 -- 172.21.15.87:0/718887970 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6094052800 con 0x56148983e880 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.671+0000 7f60a501b800 1 -- 172.21.15.87:0/718887970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983e880 msgr2=0x5614899bd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.671+0000 7f60a501b800 1 --2- 172.21.15.87:0/718887970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983e880 0x5614899bd8c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f609401ced0 tx=0x7f609404c000 comp rx=0 tx=0).stop 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.671+0000 7f60a501b800 1 -- 172.21.15.87:0/718887970 shutdown_connections 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.671+0000 7f60a501b800 1 --2- 172.21.15.87:0/718887970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983e880 0x5614899bd8c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.671+0000 7f60a501b800 1 -- 172.21.15.87:0/718887970 >> 172.21.15.87:0/718887970 conn(0x5614898c5830 msgr2=0x5614899b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.671+0000 7f60a501b800 1 -- 172.21.15.87:0/718887970 shutdown_connections 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.671+0000 7f60a501b800 1 -- 172.21.15.87:0/718887970 wait complete. 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.671+0000 7f60a501b800 1 Processor -- start 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.671+0000 7f60a501b800 1 -- start start 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.671+0000 7f60a501b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983e880 0x5614899c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.671+0000 7f60a501b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5614898d5b40 con 0x56148983e880 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.672+0000 7f60a2b13640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983e880 0x5614899c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.672+0000 7f60a2b13640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983e880 0x5614899c5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33502/0 (socket says 172.21.15.87:33502) 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.672+0000 7f60a2b13640 1 -- 172.21.15.87:0/3131181519 learned_addr learned my addr 172.21.15.87:0/3131181519 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.672+0000 7f60a2b13640 1 -- 172.21.15.87:0/3131181519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614899c58c0 con 0x56148983e880 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.672+0000 7f60a2b13640 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983e880 0x5614899c5380 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f609401ced0 tx=0x7f6094002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.672+0000 7f5f8f606640 1 -- 172.21.15.87:0/3131181519 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f609406d070 con 0x56148983e880 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.672+0000 7f5f8f606640 1 -- 172.21.15.87:0/3131181519 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6094052d20 con 0x56148983e880 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.672+0000 7f60a501b800 1 -- 172.21.15.87:0/3131181519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614899c5b50 con 0x56148983e880 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.672+0000 7f5f8f606640 1 -- 172.21.15.87:0/3131181519 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6094057050 con 0x56148983e880 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.672+0000 7f60a501b800 1 -- 172.21.15.87:0/3131181519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614899c8760 con 0x56148983e880 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.673+0000 7f5f8f606640 1 -- 172.21.15.87:0/3131181519 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f609405d470 con 0x56148983e880 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.673+0000 7f5f8f606640 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5f8803bba0 0x7f5f8803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.673+0000 7f5f8f606640 1 -- 172.21.15.87:0/3131181519 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6094094160 con 0x56148983e880 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.673+0000 7f609bfff640 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5f8803bba0 0x7f5f8803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.674+0000 7f60a501b800 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56148983fde0 0x5614899cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.674+0000 7f60a501b800 1 -- 172.21.15.87:0/3131181519 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5614899ccaa0 con 0x56148983fde0 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.674+0000 7f60a3314640 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56148983fde0 0x5614899cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.674+0000 7f609bfff640 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5f8803bba0 0x7f5f8803e060 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f608c000f60 tx=0x7f608c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.674+0000 7f60a3314640 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56148983fde0 0x5614899cc520 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.674+0000 7f60a3314640 1 -- 172.21.15.87:0/3131181519 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x56148983fde0 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.674+0000 7f60a501b800 1 -- 172.21.15.87:0/3131181519 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5614899c9af0 con 0x56148983fde0 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.675+0000 7f60a3314640 1 -- 172.21.15.87:0/3131181519 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f609c00a4a0 con 0x56148983fde0 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.675+0000 7f60a501b800 1 -- 172.21.15.87:0/3131181519 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5614899ce930 con 0x56148983fde0 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.675+0000 7f60a3314640 1 -- 172.21.15.87:0/3131181519 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f609c00a4a0 con 0x56148983fde0 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.675+0000 7f60a501b800 1 -- 172.21.15.87:0/3131181519 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5614899cda70 con 0x56148983fde0 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.675+0000 7f60a3314640 1 -- 172.21.15.87:0/3131181519 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f609c00a4a0 con 0x56148983fde0 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.675+0000 7f60a501b800 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5614899ce540 0x5614899d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.675+0000 7f60a501b800 1 -- 172.21.15.87:0/3131181519 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5614899d2510 con 0x5614899ce540 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.675+0000 7f60a2b13640 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5614899ce540 0x5614899d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.676+0000 7f60a2b13640 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5614899ce540 0x5614899d1d80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.676+0000 7f60a2b13640 1 -- 172.21.15.87:0/3131181519 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6094078070 con 0x5614899ce540 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.676+0000 7f60a501b800 1 Processor -- start 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.676+0000 7f60a501b800 1 -- start start 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.677+0000 7f60a501b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899e0860 0x5614899e0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.677+0000 7f60a501b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5614897bbfc0 con 0x5614899e0860 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.677+0000 7f60a3314640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899e0860 0x5614899e0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.677+0000 7f60a3314640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899e0860 0x5614899e0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33512/0 (socket says 172.21.15.87:33512) 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.677+0000 7f60a3314640 1 -- 172.21.15.87:0/3061116398 learned_addr learned my addr 172.21.15.87:0/3061116398 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.677+0000 7f60a3314640 1 -- 172.21.15.87:0/3061116398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614899e11c0 con 0x5614899e0860 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.677+0000 7f60a3314640 1 --2- 172.21.15.87:0/3061116398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899e0860 0x5614899e0c80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5614899ccea0 tx=0x7f609c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.677+0000 7f5f8ce01640 1 -- 172.21.15.87:0/3061116398 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f609c013440 con 0x5614899e0860 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.677+0000 7f5f8ce01640 1 -- 172.21.15.87:0/3061116398 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609c0135e0 con 0x5614899e0860 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.677+0000 7f5f8ce01640 1 -- 172.21.15.87:0/3061116398 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f609c0138c0 con 0x5614899e0860 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.677+0000 7f60a501b800 1 -- 172.21.15.87:0/3061116398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614899e1c30 con 0x5614899e0860 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.677+0000 7f60a501b800 1 -- 172.21.15.87:0/3061116398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614899e2130 con 0x5614899e0860 2024-05-08T18:31:19.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.678+0000 7f5f8ce01640 1 -- 172.21.15.87:0/3061116398 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f609c011040 con 0x5614899e0860 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.678+0000 7f5f8ce01640 1 --2- 172.21.15.87:0/3061116398 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5f7c03bb50 0x7f5f7c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.678+0000 7f5f8ce01640 1 -- 172.21.15.87:0/3061116398 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f609c01d070 con 0x5614899e0860 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.678+0000 7f60a2b13640 1 --2- 172.21.15.87:0/3061116398 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5f7c03bb50 0x7f5f7c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.679+0000 7f60a501b800 1 Processor -- start 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.679+0000 7f60a501b800 1 -- start start 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.679+0000 7f60a2b13640 1 --2- 172.21.15.87:0/3061116398 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5f7c03bb50 0x7f5f7c03e010 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f609405ca50 tx=0x7f609405c9e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.679+0000 7f60a501b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899edbd0 0x5614899edff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.679+0000 7f60a501b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5614899be150 con 0x5614899edbd0 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.679+0000 7f60a3314640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899edbd0 0x5614899edff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.679+0000 7f60a3314640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899edbd0 0x5614899edff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33520/0 (socket says 172.21.15.87:33520) 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.679+0000 7f60a3314640 1 -- 172.21.15.87:0/305902579 learned_addr learned my addr 172.21.15.87:0/305902579 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.679+0000 7f60a3314640 1 -- 172.21.15.87:0/305902579 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614899ee5c0 con 0x5614899edbd0 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.679+0000 7f60a3314640 1 --2- 172.21.15.87:0/305902579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899edbd0 0x5614899edff0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f609c0529e0 tx=0x7f609c052bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abb87a0709e1c08 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.679+0000 7f5f867fc640 1 -- 172.21.15.87:0/305902579 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f609c015950 con 0x5614899edbd0 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.680+0000 7f5f867fc640 1 -- 172.21.15.87:0/305902579 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609c015430 con 0x5614899edbd0 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.680+0000 7f5f867fc640 1 -- 172.21.15.87:0/305902579 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f609c015af0 con 0x5614899edbd0 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.680+0000 7f60a501b800 1 -- 172.21.15.87:0/305902579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899edbd0 msgr2=0x5614899edff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.680+0000 7f60a501b800 1 --2- 172.21.15.87:0/305902579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899edbd0 0x5614899edff0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f609c0529e0 tx=0x7f609c052bb0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.680+0000 7f60a501b800 1 -- 172.21.15.87:0/305902579 shutdown_connections 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.680+0000 7f60a501b800 1 --2- 172.21.15.87:0/305902579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899edbd0 0x5614899edff0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.680+0000 7f60a501b800 1 -- 172.21.15.87:0/305902579 >> 172.21.15.87:0/305902579 conn(0x5614899e9ee0 msgr2=0x5614899e7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.680+0000 7f60a501b800 1 -- 172.21.15.87:0/305902579 shutdown_connections 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.680+0000 7f60a501b800 1 -- 172.21.15.87:0/305902579 wait complete. 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.680+0000 7f60a501b800 1 Processor -- start 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.680+0000 7f60a501b800 1 -- start start 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.680+0000 7f60a501b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899edbd0 0x5614899f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.680+0000 7f60a501b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5614899eed10 con 0x5614899edbd0 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.681+0000 7f60a3314640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899edbd0 0x5614899f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.681+0000 7f60a3314640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899edbd0 0x5614899f50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33532/0 (socket says 172.21.15.87:33532) 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.681+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 learned_addr learned my addr 172.21.15.87:0/370449057 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.681+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614899f5620 con 0x5614899edbd0 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.681+0000 7f60a3314640 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899edbd0 0x5614899f50e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f609c052910 tx=0x7f609c052940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.681+0000 7f5f84ff9640 1 -- 172.21.15.87:0/370449057 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f609c030020 con 0x5614899edbd0 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.681+0000 7f5f84ff9640 1 -- 172.21.15.87:0/370449057 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609c0514c0 con 0x5614899edbd0 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.681+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614899f58b0 con 0x5614899edbd0 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.681+0000 7f5f84ff9640 1 -- 172.21.15.87:0/370449057 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f609c013af0 con 0x5614899edbd0 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.681+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614899f8560 con 0x5614899edbd0 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.682+0000 7f5f84ff9640 1 -- 172.21.15.87:0/370449057 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f609c033020 con 0x5614899edbd0 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.682+0000 7f5f84ff9640 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5f6c03bb50 0x7f5f6c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.682+0000 7f5f84ff9640 1 -- 172.21.15.87:0/370449057 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f609c00e040 con 0x5614899edbd0 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.682+0000 7f60a2b13640 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5f6c03bb50 0x7f5f6c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.683+0000 7f60a501b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.683+0000 7f60a501b800 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561489a00d50 0x561489a03210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.683+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561489a03960 con 0x561489a00d50 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.683+0000 7f609bfff640 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561489a00d50 0x561489a03210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.683+0000 7f60a2b13640 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5f6c03bb50 0x7f5f6c03e010 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6094091270 tx=0x7f6094081000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.683+0000 7f609bfff640 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561489a00d50 0x561489a03210 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.683+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f608c009050 con 0x561489a00d50 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.683+0000 7f60a501b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.683+0000 7f60a501b800 20 realm 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.683+0000 7f60a501b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.683+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561489a001a0 con 0x561489a00d50 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.683+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f608c009050 con 0x561489a00d50 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.683+0000 7f60a501b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.683+0000 7f60a501b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.683+0000 7f60a501b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.683+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561489a04440 con 0x561489a00d50 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.684+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f608c009050 con 0x561489a00d50 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.684+0000 7f60a501b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.684+0000 7f60a501b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.684+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561489a04d10 con 0x561489a00d50 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.684+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f608c009050 con 0x561489a00d50 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.684+0000 7f60a501b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.684+0000 7f60a501b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.684+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561489a050b0 con 0x561489a00d50 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.684+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f608c009050 con 0x561489a00d50 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.684+0000 7f60a501b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.684+0000 7f60a501b800 20 searching for the correct realm 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.684+0000 7f60a501b800 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561489a06f90 0x561489a09380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.684+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x561489a06f90 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.684+0000 7f60a3314640 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561489a06f90 0x561489a09380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.685+0000 7f60a3314640 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561489a06f90 0x561489a09380 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.685+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c051020 con 0x561489a06f90 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.685+0000 7f60a3314640 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f609c035020 0x7f609c052170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.685+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x7f609c035020 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.685+0000 7f60a2b13640 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f609c035020 0x7f609c052170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.686+0000 7f60a2b13640 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f609c035020 0x7f609c052170 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.686+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6094078070 con 0x7f609c035020 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.686+0000 7f60a2b13640 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6094087040 0x7f609405b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.686+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x7f6094087040 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.686+0000 7f609bfff640 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6094087040 0x7f609405b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.687+0000 7f609bfff640 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6094087040 0x7f609405b370 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.687+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f608c009050 con 0x7f6094087040 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.687+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x561489a00d50 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.687+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f608c009050 con 0x561489a00d50 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.687+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x561489a00d50 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.687+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.687+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x7f6094087040 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.688+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.688+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x7f6094087040 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.688+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.688+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x7f609c035020 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.688+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6094078070 con 0x7f609c035020 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.688+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x561489a06f90 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.688+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c051020 con 0x561489a06f90 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.688+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x561489a00d50 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.688+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.689+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x7f6094087040 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.689+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.689+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x561489a00d50 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.689+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.689+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x7f609c035020 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.689+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6094078070 con 0x7f609c035020 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.689+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x561489a06f90 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.689+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c051020 con 0x561489a06f90 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.689+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x561489a06f90 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.690+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c051020 con 0x561489a06f90 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.690+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x7f6094087040 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.690+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.690+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x561489a06f90 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.690+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c051020 con 0x561489a06f90 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.690+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x561489a06f90 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.690+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c051020 con 0x561489a06f90 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.690+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x561489a00d50 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.691+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.691+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x561489a00d50 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.691+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.691+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x7f6094087040 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.691+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.691+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x561489a06f90 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.692+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c051020 con 0x561489a06f90 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.692+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x7f609c035020 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.692+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6094078070 con 0x7f609c035020 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.692+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x561489a00d50 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.692+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.692+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x7f6094087040 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.692+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.692+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x561489a06f90 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.693+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c051020 con 0x561489a06f90 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.693+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x7f6094087040 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.693+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.693+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x7f609c035020 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.693+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6094078070 con 0x7f609c035020 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.693+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x561489a06f90 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.693+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c051020 con 0x561489a06f90 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.693+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x7f6094087040 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.694+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.694+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x561489a00d50 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.694+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.694+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561489a09a30 con 0x7f609c035020 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6094078070 con 0x7f609c035020 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561489a05a60 con 0x561489a00d50 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561489a06300 con 0x561489a00d50 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561489a056a0 con 0x7f6094087040 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 20 zone default found 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 4 Realm: () 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 20 zonegroup default 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.695+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561489a09e90 con 0x7f6094087040 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.696+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.696+0000 7f60a501b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.696+0000 7f60a501b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.696+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561489a0bd20 con 0x561489a06f90 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.696+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f609c051020 con 0x561489a06f90 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.696+0000 7f60a501b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.696+0000 7f60a501b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.696+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561489a0c0c0 con 0x561489a06f90 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.696+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f609c051020 con 0x561489a06f90 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.696+0000 7f60a501b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.696+0000 7f60a501b800 20 started sync module instance, tier type = 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.696+0000 7f60a501b800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.696+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a0b160 con 0x7f609c035020 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.697+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6094078070 con 0x7f609c035020 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.697+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94646208345424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a0b970 con 0x7f609c035020 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.697+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a0cf30 con 0x561489a00d50 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.698+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.698+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94646208351328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a0d6f0 con 0x561489a00d50 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.698+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94646208345424] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6094078070 con 0x7f609c035020 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.698+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a0c4a0 con 0x561489a06f90 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.699+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94646208351328] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.699+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c051020 con 0x561489a06f90 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.700+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94646208352576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a0e160 con 0x561489a06f90 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.700+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a0eb20 con 0x7f609c035020 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.700+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6094078070 con 0x7f609c035020 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.700+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94646208358000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a0f3c0 con 0x7f609c035020 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.701+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a0fee0 con 0x561489a00d50 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.701+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94646208352576] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c051020 con 0x561489a06f90 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.701+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.702+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94646208358000] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6094078070 con 0x7f609c035020 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.702+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94646208362928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a0dcb0 con 0x561489a00d50 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.702+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a107c0 con 0x7f6094087040 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.702+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.702+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94646208365136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a10bb0 con 0x7f6094087040 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.703+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a116b0 con 0x7f6094087040 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.703+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94646208362928] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.704+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(56 notify.6 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.704+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94646208369056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a11670 con 0x7f6094087040 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.704+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a12090 con 0x7f6094087040 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.704+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94646208365136] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.705+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94646208369056] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.705+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.705+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94646208360208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a10670 con 0x7f6094087040 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.705+0000 7f60a501b800 20 add_watcher() i=0 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.705+0000 7f60a501b800 20 add_watcher() i=1 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.705+0000 7f60a501b800 20 add_watcher() i=2 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.705+0000 7f60a501b800 20 add_watcher() i=3 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.705+0000 7f60a501b800 20 add_watcher() i=4 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.705+0000 7f60a501b800 20 add_watcher() i=5 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.705+0000 7f60a501b800 20 add_watcher() i=6 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.706+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94646208360208] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.706+0000 7f60a501b800 20 add_watcher() i=7 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.706+0000 7f60a501b800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.706+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561489a15080 con 0x561489a00d50 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.706+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.706+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94646208371584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a12500 con 0x561489a00d50 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.707+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94646208371584] v27'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.707+0000 7f5f597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.708+0000 7f60a501b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.708+0000 7f60a501b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.708+0000 7f60a501b800 5 note: GC not initialized 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.708+0000 7f5ed3fff640 20 reqs_thread_entry: start 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.708+0000 7f60a501b800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.708+0000 7f60a501b800 20 Filter name: none 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.708+0000 7f5ed1ffb640 20 reqs_thread_entry: start 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.708+0000 7f60a501b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.708+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561489a47fb0 con 0x561489a00d50 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.709+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.709+0000 7f60a501b800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.709+0000 7f60a501b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.709+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561489a48840 con 0x561489a00d50 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.709+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.709+0000 7f60a501b800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.709+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561489a49850 con 0x7f609c035020 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.709+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f6094078070 con 0x7f609c035020 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.710+0000 7f5f597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.710+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94646208371584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a12da0 con 0x561489a00d50 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.711+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94646208371584] v27'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.711+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94646208345424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a11b80 con 0x7f609c035020 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.712+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94646208345424] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6094078070 con 0x7f609c035020 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.712+0000 7f60a501b800 20 remove_watcher() i=0 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.712+0000 7f60a501b800 2 removed watcher, disabling cache 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.712+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94646208351328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a0b550 con 0x561489a00d50 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.713+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94646208351328] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.713+0000 7f60a501b800 20 remove_watcher() i=1 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.713+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94646208352576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a0b550 con 0x561489a06f90 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.714+0000 7f60a3314640 1 -- 172.21.15.87:0/370449057 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94646208352576] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c051020 con 0x561489a06f90 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.714+0000 7f60a501b800 20 remove_watcher() i=2 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.714+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94646208358000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a0b550 con 0x7f609c035020 2024-05-08T18:31:19.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.715+0000 7f60a2b13640 1 -- 172.21.15.87:0/370449057 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94646208358000] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6094078070 con 0x7f609c035020 2024-05-08T18:31:19.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.715+0000 7f60a501b800 20 remove_watcher() i=3 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.715+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94646208362928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a0b550 con 0x561489a00d50 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.716+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94646208362928] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x561489a00d50 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.716+0000 7f60a501b800 20 remove_watcher() i=4 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.716+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94646208365136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a0f9b0 con 0x7f6094087040 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.717+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94646208365136] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.717+0000 7f60a501b800 20 remove_watcher() i=5 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.717+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94646208369056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a0b550 con 0x7f6094087040 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.718+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94646208369056] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.718+0000 7f60a501b800 20 remove_watcher() i=6 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.718+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94646208360208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561489a10250 con 0x7f6094087040 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94646208360208] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f608c02a040 con 0x7f6094087040 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 20 remove_watcher() i=7 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6094087040 msgr2=0x7f609405b370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6094087040 0x7f609405b370 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561489a00d50 msgr2=0x561489a03210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561489a00d50 0x561489a03210 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f609c035020 msgr2=0x7f609c052170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f609c035020 0x7f609c052170 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561489a06f90 msgr2=0x561489a09380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561489a06f90 0x561489a09380 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5f6c03bb50 msgr2=0x7f5f6c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5f6c03bb50 0x7f5f6c03e010 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6094091270 tx=0x7f6094081000 comp rx=0 tx=0).stop 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899edbd0 msgr2=0x5614899f50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899edbd0 0x5614899f50e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f609c052910 tx=0x7f609c052940 comp rx=0 tx=0).stop 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f609bfff640 1 -- 172.21.15.87:0/370449057 reap_dead start 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 shutdown_connections 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 1 --2- 172.21.15.87:0/370449057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899edbd0 0x5614899f50e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 >> 172.21.15.87:0/370449057 conn(0x5614899e9ee0 msgr2=0x5614899e7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 shutdown_connections 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.719+0000 7f60a501b800 1 -- 172.21.15.87:0/370449057 wait complete. 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 -- 172.21.15.87:0/3061116398 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5f7c03bb50 msgr2=0x7f5f7c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 --2- 172.21.15.87:0/3061116398 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5f7c03bb50 0x7f5f7c03e010 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f609405ca50 tx=0x7f609405c9e0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 -- 172.21.15.87:0/3061116398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899e0860 msgr2=0x5614899e0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 --2- 172.21.15.87:0/3061116398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899e0860 0x5614899e0c80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5614899ccea0 tx=0x7f609c0178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 -- 172.21.15.87:0/3061116398 shutdown_connections 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 --2- 172.21.15.87:0/3061116398 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5f7c03bb50 0x7f5f7c03e010 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 --2- 172.21.15.87:0/3061116398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614899e0860 0x5614899e0c80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 -- 172.21.15.87:0/3061116398 >> 172.21.15.87:0/3061116398 conn(0x5614899d4900 msgr2=0x5614899d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 -- 172.21.15.87:0/3061116398 shutdown_connections 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 -- 172.21.15.87:0/3061116398 wait complete. 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 -- 172.21.15.87:0/3131181519 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5614899ce540 msgr2=0x5614899d1d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5614899ce540 0x5614899d1d80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 -- 172.21.15.87:0/3131181519 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56148983fde0 msgr2=0x5614899cc520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56148983fde0 0x5614899cc520 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 -- 172.21.15.87:0/3131181519 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5f8803bba0 msgr2=0x7f5f8803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5f8803bba0 0x7f5f8803e060 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f608c000f60 tx=0x7f608c0012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 -- 172.21.15.87:0/3131181519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983e880 msgr2=0x5614899c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983e880 0x5614899c5380 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f609401ced0 tx=0x7f6094002fb0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 -- 172.21.15.87:0/3131181519 shutdown_connections 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56148983fde0 0x5614899cc520 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5614899ce540 0x5614899d1d80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5f8803bba0 0x7f5f8803e060 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 --2- 172.21.15.87:0/3131181519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56148983e880 0x5614899c5380 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 -- 172.21.15.87:0/3131181519 >> 172.21.15.87:0/3131181519 conn(0x5614898c5830 msgr2=0x5614899b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 -- 172.21.15.87:0/3131181519 shutdown_connections 2024-05-08T18:31:19.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.720+0000 7f60a501b800 1 -- 172.21.15.87:0/3131181519 wait complete. 2024-05-08T18:31:19.731 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T18:31:19.731 DEBUG:tasks.util.rgw: json result: [] 2024-05-08T18:31:19.731 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-05-08T18:31:19.731 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-05-08T18:31:19.731 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-05-08T18:31:19.776 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:19.776 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:19.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.778+0000 7f5351e98800 1 Processor -- start 2024-05-08T18:31:19.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.779+0000 7f5351e98800 1 -- start start 2024-05-08T18:31:19.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.779+0000 7f5351e98800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5566764b42b0 0x5566764b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.779+0000 7f5351e98800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5566764b4d50 con 0x5566764b5470 2024-05-08T18:31:19.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.779+0000 7f5351e98800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x556676354e20 con 0x5566764b42b0 2024-05-08T18:31:19.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.779+0000 7f534f997640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5566764b42b0 0x5566764b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.779+0000 7f5347fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5566764b5470 0x5566764b58f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42042/0 (socket says 172.21.15.87:42042) 2024-05-08T18:31:19.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.779+0000 7f5347fff640 1 -- 172.21.15.87:0/2216177359 learned_addr learned my addr 172.21.15.87:0/2216177359 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:19.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.779+0000 7f534f997640 1 -- 172.21.15.87:0/2216177359 >> v1:172.21.15.53:6789/0 conn(0x5566764b5470 legacy=0x5566764b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.779+0000 7f534f997640 1 -- 172.21.15.87:0/2216177359 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566764b6030 con 0x5566764b42b0 2024-05-08T18:31:19.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.781+0000 7f534f997640 1 --2- 172.21.15.87:0/2216177359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 0x5566764b46d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f534000a470 tx=0x7f534001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355141c9fe281c61 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.781+0000 7f534f196640 1 -- 172.21.15.87:0/2216177359 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5340057070 con 0x5566764b42b0 2024-05-08T18:31:19.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.781+0000 7f534f196640 1 -- 172.21.15.87:0/2216177359 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f534004adc0 con 0x5566764b42b0 2024-05-08T18:31:19.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.781+0000 7f534f196640 1 -- 172.21.15.87:0/2216177359 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5340052590 con 0x5566764b42b0 2024-05-08T18:31:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.782+0000 7f5351e98800 1 -- 172.21.15.87:0/2216177359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 msgr2=0x5566764b46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.782+0000 7f5351e98800 1 --2- 172.21.15.87:0/2216177359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 0x5566764b46d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f534000a470 tx=0x7f534001ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.782+0000 7f5351e98800 1 -- 172.21.15.87:0/2216177359 shutdown_connections 2024-05-08T18:31:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.782+0000 7f5351e98800 1 --2- 172.21.15.87:0/2216177359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 0x5566764b46d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.782+0000 7f5351e98800 1 -- 172.21.15.87:0/2216177359 >> 172.21.15.87:0/2216177359 conn(0x5566764af830 msgr2=0x5566764b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.782+0000 7f5351e98800 1 -- 172.21.15.87:0/2216177359 shutdown_connections 2024-05-08T18:31:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.782+0000 7f5351e98800 1 -- 172.21.15.87:0/2216177359 wait complete. 2024-05-08T18:31:19.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.796+0000 7f5351e98800 1 Processor -- start 2024-05-08T18:31:19.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.796+0000 7f5351e98800 1 -- start start 2024-05-08T18:31:19.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.796+0000 7f5351e98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 0x5566765a5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.796+0000 7f5351e98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5566763ff5b0 con 0x5566764b42b0 2024-05-08T18:31:19.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.796+0000 7f534f997640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 0x5566765a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.796+0000 7f534f997640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 0x5566765a5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33560/0 (socket says 172.21.15.87:33560) 2024-05-08T18:31:19.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.796+0000 7f534f997640 1 -- 172.21.15.87:0/1884035040 learned_addr learned my addr 172.21.15.87:0/1884035040 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.796+0000 7f534f997640 1 -- 172.21.15.87:0/1884035040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566765a5ce0 con 0x5566764b42b0 2024-05-08T18:31:19.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.797+0000 7f534f997640 1 --2- 172.21.15.87:0/1884035040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 0x5566765a5710 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f534001ced0 tx=0x7f534004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f0e5ec294ae262 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.797+0000 7f523de0b640 1 -- 172.21.15.87:0/1884035040 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5340057040 con 0x5566764b42b0 2024-05-08T18:31:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.797+0000 7f523de0b640 1 -- 172.21.15.87:0/1884035040 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5340063070 con 0x5566764b42b0 2024-05-08T18:31:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.797+0000 7f523de0b640 1 -- 172.21.15.87:0/1884035040 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5340052800 con 0x5566764b42b0 2024-05-08T18:31:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.798+0000 7f5351e98800 1 -- 172.21.15.87:0/1884035040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 msgr2=0x5566765a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.798+0000 7f5351e98800 1 --2- 172.21.15.87:0/1884035040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 0x5566765a5710 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f534001ced0 tx=0x7f534004c000 comp rx=0 tx=0).stop 2024-05-08T18:31:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.798+0000 7f5351e98800 1 -- 172.21.15.87:0/1884035040 shutdown_connections 2024-05-08T18:31:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.798+0000 7f5351e98800 1 --2- 172.21.15.87:0/1884035040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 0x5566765a5710 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.798+0000 7f5351e98800 1 -- 172.21.15.87:0/1884035040 >> 172.21.15.87:0/1884035040 conn(0x5566764af830 msgr2=0x5566765a1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.798+0000 7f5351e98800 1 -- 172.21.15.87:0/1884035040 shutdown_connections 2024-05-08T18:31:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.798+0000 7f5351e98800 1 -- 172.21.15.87:0/1884035040 wait complete. 2024-05-08T18:31:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.798+0000 7f5351e98800 1 Processor -- start 2024-05-08T18:31:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.798+0000 7f5351e98800 1 -- start start 2024-05-08T18:31:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.798+0000 7f5351e98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 0x5566765ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.798+0000 7f5351e98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5566764bd940 con 0x5566764b42b0 2024-05-08T18:31:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.798+0000 7f534f997640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 0x5566765ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.798+0000 7f534f997640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 0x5566765ad1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33566/0 (socket says 172.21.15.87:33566) 2024-05-08T18:31:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.798+0000 7f534f997640 1 -- 172.21.15.87:0/3967385429 learned_addr learned my addr 172.21.15.87:0/3967385429 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.799+0000 7f534f997640 1 -- 172.21.15.87:0/3967385429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566765ad710 con 0x5566764b42b0 2024-05-08T18:31:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.799+0000 7f534f997640 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 0x5566765ad1d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f534001ced0 tx=0x7f5340002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.799+0000 7f5237fff640 1 -- 172.21.15.87:0/3967385429 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f534006d070 con 0x5566764b42b0 2024-05-08T18:31:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.799+0000 7f5237fff640 1 -- 172.21.15.87:0/3967385429 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5340052d20 con 0x5566764b42b0 2024-05-08T18:31:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.799+0000 7f5237fff640 1 -- 172.21.15.87:0/3967385429 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5340057050 con 0x5566764b42b0 2024-05-08T18:31:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.799+0000 7f5351e98800 1 -- 172.21.15.87:0/3967385429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566765ad9a0 con 0x5566764b42b0 2024-05-08T18:31:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.799+0000 7f5351e98800 1 -- 172.21.15.87:0/3967385429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566765b05b0 con 0x5566764b42b0 2024-05-08T18:31:19.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.800+0000 7f5237fff640 1 -- 172.21.15.87:0/3967385429 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f534005d470 con 0x5566764b42b0 2024-05-08T18:31:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.800+0000 7f5237fff640 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f523803bb50 0x7f523803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.800+0000 7f5237fff640 1 -- 172.21.15.87:0/3967385429 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5340094160 con 0x5566764b42b0 2024-05-08T18:31:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.800+0000 7f5347fff640 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f523803bb50 0x7f523803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.800+0000 7f5351e98800 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5566764b5470 0x5566765b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.800+0000 7f5351e98800 1 -- 172.21.15.87:0/3967385429 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566765b48f0 con 0x5566764b5470 2024-05-08T18:31:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.800+0000 7f5350198640 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5566764b5470 0x5566765b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.801+0000 7f5347fff640 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f523803bb50 0x7f523803e010 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5338000f60 tx=0x7f53380012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.801+0000 7f5350198640 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5566764b5470 0x5566765b4370 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.801+0000 7f5350198640 1 -- 172.21.15.87:0/3967385429 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f534800a4a0 con 0x5566764b5470 2024-05-08T18:31:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.801+0000 7f5351e98800 1 -- 172.21.15.87:0/3967385429 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566765b1940 con 0x5566764b5470 2024-05-08T18:31:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.801+0000 7f5350198640 1 -- 172.21.15.87:0/3967385429 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f534800a4a0 con 0x5566764b5470 2024-05-08T18:31:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.801+0000 7f5351e98800 1 -- 172.21.15.87:0/3967385429 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566765b6710 con 0x5566764b5470 2024-05-08T18:31:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.802+0000 7f5350198640 1 -- 172.21.15.87:0/3967385429 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f534800a4a0 con 0x5566764b5470 2024-05-08T18:31:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.802+0000 7f5351e98800 1 -- 172.21.15.87:0/3967385429 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566765b5940 con 0x5566764b5470 2024-05-08T18:31:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.802+0000 7f5350198640 1 -- 172.21.15.87:0/3967385429 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f534800a4a0 con 0x5566764b5470 2024-05-08T18:31:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.802+0000 7f5351e98800 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5566765b7ac0 0x5566765b9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.802+0000 7f5351e98800 1 -- 172.21.15.87:0/3967385429 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566765ba3f0 con 0x5566765b7ac0 2024-05-08T18:31:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.802+0000 7f534f997640 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5566765b7ac0 0x5566765b9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.802+0000 7f534f997640 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5566765b7ac0 0x5566765b9eb0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.803+0000 7f534f997640 1 -- 172.21.15.87:0/3967385429 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5340078070 con 0x5566765b7ac0 2024-05-08T18:31:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.803+0000 7f5351e98800 1 Processor -- start 2024-05-08T18:31:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.803+0000 7f5351e98800 1 -- start start 2024-05-08T18:31:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.803+0000 7f5351e98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566765c8630 0x5566765c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.803+0000 7f5351e98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5566763a5fc0 con 0x5566765c8630 2024-05-08T18:31:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.803+0000 7f5350198640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566765c8630 0x5566765c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.803+0000 7f5350198640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566765c8630 0x5566765c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33568/0 (socket says 172.21.15.87:33568) 2024-05-08T18:31:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.803+0000 7f5350198640 1 -- 172.21.15.87:0/658381006 learned_addr learned my addr 172.21.15.87:0/658381006 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.803+0000 7f5350198640 1 -- 172.21.15.87:0/658381006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566765c8f90 con 0x5566765c8630 2024-05-08T18:31:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.804+0000 7f5350198640 1 --2- 172.21.15.87:0/658381006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566765c8630 0x5566765c8a50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5566765ae530 tx=0x7f53480178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.804+0000 7f52357fa640 1 -- 172.21.15.87:0/658381006 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5348013440 con 0x5566765c8630 2024-05-08T18:31:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.804+0000 7f52357fa640 1 -- 172.21.15.87:0/658381006 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53480135e0 con 0x5566765c8630 2024-05-08T18:31:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.804+0000 7f5351e98800 1 -- 172.21.15.87:0/658381006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566765c9a00 con 0x5566765c8630 2024-05-08T18:31:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.804+0000 7f52357fa640 1 -- 172.21.15.87:0/658381006 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53480138c0 con 0x5566765c8630 2024-05-08T18:31:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.804+0000 7f5351e98800 1 -- 172.21.15.87:0/658381006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566765c9f00 con 0x5566765c8630 2024-05-08T18:31:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.805+0000 7f52357fa640 1 -- 172.21.15.87:0/658381006 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5348011040 con 0x5566765c8630 2024-05-08T18:31:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.805+0000 7f52357fa640 1 --2- 172.21.15.87:0/658381006 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f522803bb50 0x7f522803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.805+0000 7f52357fa640 1 -- 172.21.15.87:0/658381006 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f534801d070 con 0x5566765c8630 2024-05-08T18:31:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.805+0000 7f534f997640 1 --2- 172.21.15.87:0/658381006 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f522803bb50 0x7f522803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.805+0000 7f5351e98800 1 Processor -- start 2024-05-08T18:31:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.805+0000 7f534f997640 1 --2- 172.21.15.87:0/658381006 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f522803bb50 0x7f522803e010 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f534005d000 tx=0x7f534005cf10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.805+0000 7f5351e98800 1 -- start start 2024-05-08T18:31:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.805+0000 7f5351e98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556676429910 0x556676429d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.805+0000 7f5351e98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5566765a5fa0 con 0x556676429910 2024-05-08T18:31:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.806+0000 7f5350198640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556676429910 0x556676429d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.806+0000 7f5350198640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556676429910 0x556676429d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33576/0 (socket says 172.21.15.87:33576) 2024-05-08T18:31:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.806+0000 7f5350198640 1 -- 172.21.15.87:0/3504882665 learned_addr learned my addr 172.21.15.87:0/3504882665 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.806+0000 7f5350198640 1 -- 172.21.15.87:0/3504882665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556676428120 con 0x556676429910 2024-05-08T18:31:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.806+0000 7f5350198640 1 --2- 172.21.15.87:0/3504882665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556676429910 0x556676429d30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f53480529a0 tx=0x7f5348001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4ac85406235231 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.806+0000 7f522effd640 1 -- 172.21.15.87:0/3504882665 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f534802ad80 con 0x556676429910 2024-05-08T18:31:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.806+0000 7f522effd640 1 -- 172.21.15.87:0/3504882665 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53480014f0 con 0x556676429910 2024-05-08T18:31:19.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.806+0000 7f522effd640 1 -- 172.21.15.87:0/3504882665 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5348001810 con 0x556676429910 2024-05-08T18:31:19.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.807+0000 7f5351e98800 1 -- 172.21.15.87:0/3504882665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556676429910 msgr2=0x556676429d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.807+0000 7f5351e98800 1 --2- 172.21.15.87:0/3504882665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556676429910 0x556676429d30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f53480529a0 tx=0x7f5348001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:19.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.807+0000 7f5351e98800 1 -- 172.21.15.87:0/3504882665 shutdown_connections 2024-05-08T18:31:19.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.807+0000 7f5351e98800 1 --2- 172.21.15.87:0/3504882665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556676429910 0x556676429d30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.807+0000 7f5351e98800 1 -- 172.21.15.87:0/3504882665 >> 172.21.15.87:0/3504882665 conn(0x5566765d1c80 msgr2=0x5566765cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.807+0000 7f5351e98800 1 -- 172.21.15.87:0/3504882665 shutdown_connections 2024-05-08T18:31:19.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.807+0000 7f5351e98800 1 -- 172.21.15.87:0/3504882665 wait complete. 2024-05-08T18:31:19.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.807+0000 7f5351e98800 1 Processor -- start 2024-05-08T18:31:19.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.807+0000 7f5351e98800 1 -- start start 2024-05-08T18:31:19.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.807+0000 7f5351e98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556676429910 0x5566765df0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.807+0000 7f5351e98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5566764285f0 con 0x556676429910 2024-05-08T18:31:19.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.807+0000 7f5350198640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556676429910 0x5566765df0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.807+0000 7f5350198640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556676429910 0x5566765df0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33578/0 (socket says 172.21.15.87:33578) 2024-05-08T18:31:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.807+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 learned_addr learned my addr 172.21.15.87:0/2263178162 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.807+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566765df610 con 0x556676429910 2024-05-08T18:31:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.808+0000 7f5350198640 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556676429910 0x5566765df0d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5348001ea0 tx=0x7f5348052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.808+0000 7f522d7fa640 1 -- 172.21.15.87:0/2263178162 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5348030020 con 0x556676429910 2024-05-08T18:31:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.808+0000 7f522d7fa640 1 -- 172.21.15.87:0/2263178162 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5348051330 con 0x556676429910 2024-05-08T18:31:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.808+0000 7f522d7fa640 1 -- 172.21.15.87:0/2263178162 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5348013a60 con 0x556676429910 2024-05-08T18:31:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.808+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566765df8a0 con 0x556676429910 2024-05-08T18:31:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.808+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566765e2550 con 0x556676429910 2024-05-08T18:31:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.808+0000 7f522d7fa640 1 -- 172.21.15.87:0/2263178162 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5348033020 con 0x556676429910 2024-05-08T18:31:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.809+0000 7f522d7fa640 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f521803bb50 0x7f521803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.809+0000 7f522d7fa640 1 -- 172.21.15.87:0/2263178162 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f534800e040 con 0x556676429910 2024-05-08T18:31:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.809+0000 7f534f997640 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f521803bb50 0x7f521803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.809+0000 7f5351e98800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.809+0000 7f5351e98800 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5566765ead00 0x5566765ed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.809+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566765ed910 con 0x5566765ead00 2024-05-08T18:31:19.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.809+0000 7f5347fff640 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5566765ead00 0x5566765ed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.809+0000 7f534f997640 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f521803bb50 0x7f521803e010 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5340091270 tx=0x7f5340081000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.809+0000 7f5347fff640 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5566765ead00 0x5566765ed1c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5338009050 con 0x5566765ead00 2024-05-08T18:31:19.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5351e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5351e98800 20 realm 2024-05-08T18:31:19.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5351e98800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566765ea150 con 0x5566765ead00 2024-05-08T18:31:19.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5338009050 con 0x5566765ead00 2024-05-08T18:31:19.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5351e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5351e98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:19.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5351e98800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566765ee3f0 con 0x5566765ead00 2024-05-08T18:31:19.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5338009050 con 0x5566765ead00 2024-05-08T18:31:19.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5351e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5351e98800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566765eecc0 con 0x5566765ead00 2024-05-08T18:31:19.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5338009050 con 0x5566765ead00 2024-05-08T18:31:19.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5351e98800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:19.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5351e98800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.810+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566765ef060 con 0x5566765ead00 2024-05-08T18:31:19.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.811+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5338009050 con 0x5566765ead00 2024-05-08T18:31:19.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.811+0000 7f5351e98800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:19.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.811+0000 7f5351e98800 20 searching for the correct realm 2024-05-08T18:31:19.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.811+0000 7f5351e98800 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5566765f0f40 0x5566765f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.811+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x5566765f0f40 2024-05-08T18:31:19.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.811+0000 7f5350198640 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5566765f0f40 0x5566765f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.811+0000 7f5350198640 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5566765f0f40 0x5566765f3330 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.812+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5348029070 con 0x5566765f0f40 2024-05-08T18:31:19.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.812+0000 7f5350198640 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5348035020 0x7f534802b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.812+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x7f5348035020 2024-05-08T18:31:19.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.812+0000 7f534f997640 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5348035020 0x7f534802b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.812+0000 7f534f997640 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5348035020 0x7f534802b3e0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.812+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5340078070 con 0x7f5348035020 2024-05-08T18:31:19.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.812+0000 7f534f997640 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f534005b370 0x7f534008b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.812+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x7f534005b370 2024-05-08T18:31:19.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.813+0000 7f5347fff640 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f534005b370 0x7f534008b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.813+0000 7f5347fff640 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f534005b370 0x7f534008b360 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.813+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5338009050 con 0x7f534005b370 2024-05-08T18:31:19.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.813+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x5566765ead00 2024-05-08T18:31:19.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.813+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5338009050 con 0x5566765ead00 2024-05-08T18:31:19.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.813+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x5566765ead00 2024-05-08T18:31:19.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.814+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.814+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x7f534005b370 2024-05-08T18:31:19.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.814+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.814+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x7f534005b370 2024-05-08T18:31:19.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.814+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.814+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x7f5348035020 2024-05-08T18:31:19.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.814+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5340078070 con 0x7f5348035020 2024-05-08T18:31:19.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.814+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x5566765f0f40 2024-05-08T18:31:19.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.815+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5348029070 con 0x5566765f0f40 2024-05-08T18:31:19.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.815+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x5566765ead00 2024-05-08T18:31:19.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.815+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.815+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x7f534005b370 2024-05-08T18:31:19.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.815+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.815+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x5566765ead00 2024-05-08T18:31:19.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.816+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.816+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x7f5348035020 2024-05-08T18:31:19.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.816+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5340078070 con 0x7f5348035020 2024-05-08T18:31:19.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.816+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x5566765f0f40 2024-05-08T18:31:19.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.816+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5348029070 con 0x5566765f0f40 2024-05-08T18:31:19.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.816+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x5566765f0f40 2024-05-08T18:31:19.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.816+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5348029070 con 0x5566765f0f40 2024-05-08T18:31:19.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.817+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x7f534005b370 2024-05-08T18:31:19.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.817+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.817+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x5566765f0f40 2024-05-08T18:31:19.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.817+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5348029070 con 0x5566765f0f40 2024-05-08T18:31:19.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.817+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x5566765f0f40 2024-05-08T18:31:19.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.817+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5348029070 con 0x5566765f0f40 2024-05-08T18:31:19.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.817+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x5566765ead00 2024-05-08T18:31:19.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.817+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.817+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x5566765ead00 2024-05-08T18:31:19.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.818+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.818+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x7f534005b370 2024-05-08T18:31:19.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.818+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.818+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x5566765f0f40 2024-05-08T18:31:19.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.819+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5348029070 con 0x5566765f0f40 2024-05-08T18:31:19.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.819+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x7f5348035020 2024-05-08T18:31:19.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.819+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5340078070 con 0x7f5348035020 2024-05-08T18:31:19.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.819+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x5566765ead00 2024-05-08T18:31:19.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.819+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.819+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x7f534005b370 2024-05-08T18:31:19.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.820+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.820+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x5566765f0f40 2024-05-08T18:31:19.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.820+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5348029070 con 0x5566765f0f40 2024-05-08T18:31:19.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.820+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x7f534005b370 2024-05-08T18:31:19.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.820+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.820+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x7f5348035020 2024-05-08T18:31:19.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.820+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5340078070 con 0x7f5348035020 2024-05-08T18:31:19.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.820+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x5566765f0f40 2024-05-08T18:31:19.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.821+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5348029070 con 0x5566765f0f40 2024-05-08T18:31:19.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.821+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x7f534005b370 2024-05-08T18:31:19.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.821+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.821+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x5566765ead00 2024-05-08T18:31:19.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.821+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.821+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3a00 con 0x7f5348035020 2024-05-08T18:31:19.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.822+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5340078070 con 0x7f5348035020 2024-05-08T18:31:19.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.822+0000 7f5351e98800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:19.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.822+0000 7f5351e98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:19.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.822+0000 7f5351e98800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:19.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.822+0000 7f5351e98800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:19.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.822+0000 7f5351e98800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:19.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.822+0000 7f5351e98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:19.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.822+0000 7f5351e98800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.822+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566765efa10 con 0x5566765ead00 2024-05-08T18:31:19.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.822+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.822+0000 7f5351e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.822+0000 7f5351e98800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.822+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566765f02b0 con 0x5566765ead00 2024-05-08T18:31:19.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.822+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.822+0000 7f5351e98800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:19.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.822+0000 7f5351e98800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.822+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566765ef650 con 0x7f534005b370 2024-05-08T18:31:19.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5351e98800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:19.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5351e98800 20 zone default found 2024-05-08T18:31:19.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5351e98800 4 Realm: () 2024-05-08T18:31:19.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5351e98800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:19.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5351e98800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:19.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5351e98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:19.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5351e98800 20 zonegroup default 2024-05-08T18:31:19.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5351e98800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566765f3e80 con 0x7f534005b370 2024-05-08T18:31:19.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5351e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5351e98800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566765f5d10 con 0x5566765f0f40 2024-05-08T18:31:19.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5348029070 con 0x5566765f0f40 2024-05-08T18:31:19.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5351e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5351e98800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566765f60b0 con 0x5566765f0f40 2024-05-08T18:31:19.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5348029070 con 0x5566765f0f40 2024-05-08T18:31:19.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5351e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.823+0000 7f5351e98800 20 started sync module instance, tier type = 2024-05-08T18:31:19.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.824+0000 7f5351e98800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:19.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.824+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f5150 con 0x7f5348035020 2024-05-08T18:31:19.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.824+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5340078070 con 0x7f5348035020 2024-05-08T18:31:19.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.825+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93898560984432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f6900 con 0x7f5348035020 2024-05-08T18:31:19.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.825+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f7150 con 0x5566765ead00 2024-05-08T18:31:19.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.825+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93898560984432] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5340078070 con 0x7f5348035020 2024-05-08T18:31:19.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.826+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.826+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93898560988240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f7150 con 0x5566765ead00 2024-05-08T18:31:19.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.826+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f7c70 con 0x5566765f0f40 2024-05-08T18:31:19.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.827+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93898560988240] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.827+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5348029070 con 0x5566765f0f40 2024-05-08T18:31:19.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.827+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93898560990368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f70c0 con 0x5566765f0f40 2024-05-08T18:31:19.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.827+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f8b30 con 0x7f5348035020 2024-05-08T18:31:19.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.828+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93898560990368] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5348029070 con 0x5566765f0f40 2024-05-08T18:31:19.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.828+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5340078070 con 0x7f5348035020 2024-05-08T18:31:19.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.828+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93898560996992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f8ed0 con 0x7f5348035020 2024-05-08T18:31:19.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.828+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f9890 con 0x5566765ead00 2024-05-08T18:31:19.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.829+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.829+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93898561000416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f9800 con 0x5566765ead00 2024-05-08T18:31:19.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.829+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93898560996992] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5340078070 con 0x7f5348035020 2024-05-08T18:31:19.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.829+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765fa860 con 0x7f534005b370 2024-05-08T18:31:19.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.830+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93898561000416] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.830+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.830+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93898561004368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765fa820 con 0x7f534005b370 2024-05-08T18:31:19.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.830+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765fb100 con 0x7f534005b370 2024-05-08T18:31:19.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.831+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(56 notify.6 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.831+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93898561006672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765fa820 con 0x7f534005b370 2024-05-08T18:31:19.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.831+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765fbc40 con 0x7f534005b370 2024-05-08T18:31:19.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.831+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93898561004368] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.832+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93898561006672] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.832+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.832+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93898561007728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f8060 con 0x7f534005b370 2024-05-08T18:31:19.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.832+0000 7f5351e98800 20 add_watcher() i=0 2024-05-08T18:31:19.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.832+0000 7f5351e98800 20 add_watcher() i=1 2024-05-08T18:31:19.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.832+0000 7f5351e98800 20 add_watcher() i=2 2024-05-08T18:31:19.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.832+0000 7f5351e98800 20 add_watcher() i=3 2024-05-08T18:31:19.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.832+0000 7f5351e98800 20 add_watcher() i=4 2024-05-08T18:31:19.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.832+0000 7f5351e98800 20 add_watcher() i=5 2024-05-08T18:31:19.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.832+0000 7f5351e98800 20 add_watcher() i=6 2024-05-08T18:31:19.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.833+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93898561007728] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.833+0000 7f5351e98800 20 add_watcher() i=7 2024-05-08T18:31:19.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.833+0000 7f5351e98800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:19.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.833+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566765fec70 con 0x5566765ead00 2024-05-08T18:31:19.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.833+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.833+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93898561009520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765fc0f0 con 0x5566765ead00 2024-05-08T18:31:19.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.834+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93898561009520] v27'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.834+0000 7f5205fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:19.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.834+0000 7f5351e98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:19.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.834+0000 7f5351e98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:19.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.834+0000 7f5351e98800 5 note: GC not initialized 2024-05-08T18:31:19.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.835+0000 7f5204fe1640 20 reqs_thread_entry: start 2024-05-08T18:31:19.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.835+0000 7f5351e98800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:19.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.835+0000 7f5351e98800 20 Filter name: none 2024-05-08T18:31:19.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.835+0000 7f517e7fc640 20 reqs_thread_entry: start 2024-05-08T18:31:19.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.835+0000 7f5351e98800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.835+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556676631b40 con 0x5566765ead00 2024-05-08T18:31:19.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.835+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.835+0000 7f5351e98800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:19.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.835+0000 7f5351e98800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.835+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566766323d0 con 0x5566765ead00 2024-05-08T18:31:19.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.836+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.836+0000 7f5351e98800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:19.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.836+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5566766333e0 con 0x7f5348035020 2024-05-08T18:31:19.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.836+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f5340078070 con 0x7f5348035020 2024-05-08T18:31:19.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.837+0000 7f5205fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:19.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.837+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93898561009520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765fc0f0 con 0x5566765ead00 2024-05-08T18:31:19.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.837+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93898561009520] v27'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.838+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93898560984432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765fb770 con 0x7f5348035020 2024-05-08T18:31:19.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.838+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93898560984432] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5340078070 con 0x7f5348035020 2024-05-08T18:31:19.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.838+0000 7f5351e98800 20 remove_watcher() i=0 2024-05-08T18:31:19.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.838+0000 7f5351e98800 2 removed watcher, disabling cache 2024-05-08T18:31:19.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.839+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93898560988240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f5570 con 0x5566765ead00 2024-05-08T18:31:19.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.840+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93898560988240] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.840+0000 7f5351e98800 20 remove_watcher() i=1 2024-05-08T18:31:19.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.840+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93898560990368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f5570 con 0x5566765f0f40 2024-05-08T18:31:19.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.841+0000 7f5350198640 1 -- 172.21.15.87:0/2263178162 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93898560990368] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5348029070 con 0x5566765f0f40 2024-05-08T18:31:19.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.841+0000 7f5351e98800 20 remove_watcher() i=2 2024-05-08T18:31:19.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.841+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93898560996992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f6ca0 con 0x7f5348035020 2024-05-08T18:31:19.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.842+0000 7f534f997640 1 -- 172.21.15.87:0/2263178162 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93898560996992] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5340078070 con 0x7f5348035020 2024-05-08T18:31:19.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.842+0000 7f5351e98800 20 remove_watcher() i=3 2024-05-08T18:31:19.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.842+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93898561000416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f5570 con 0x5566765ead00 2024-05-08T18:31:19.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.843+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93898561000416] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533802a040 con 0x5566765ead00 2024-05-08T18:31:19.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.843+0000 7f5351e98800 20 remove_watcher() i=4 2024-05-08T18:31:19.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.843+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93898561004368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f8680 con 0x7f534005b370 2024-05-08T18:31:19.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.844+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93898561004368] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.844+0000 7f5351e98800 20 remove_watcher() i=5 2024-05-08T18:31:19.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.844+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93898561006672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f6ca0 con 0x7f534005b370 2024-05-08T18:31:19.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.845+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93898561006672] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.845+0000 7f5351e98800 20 remove_watcher() i=6 2024-05-08T18:31:19.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.845+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93898561007728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5566765f93e0 con 0x7f534005b370 2024-05-08T18:31:19.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93898561007728] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533802a040 con 0x7f534005b370 2024-05-08T18:31:19.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 20 remove_watcher() i=7 2024-05-08T18:31:19.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f534005b370 msgr2=0x7f534008b360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f534005b370 0x7f534008b360 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5566765ead00 msgr2=0x5566765ed1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5566765ead00 0x5566765ed1c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5348035020 msgr2=0x7f534802b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5348035020 0x7f534802b3e0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5566765f0f40 msgr2=0x5566765f3330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5566765f0f40 0x5566765f3330 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f521803bb50 msgr2=0x7f521803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f521803bb50 0x7f521803e010 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5340091270 tx=0x7f5340081000 comp rx=0 tx=0).stop 2024-05-08T18:31:19.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556676429910 msgr2=0x5566765df0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5347fff640 1 -- 172.21.15.87:0/2263178162 reap_dead start 2024-05-08T18:31:19.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556676429910 0x5566765df0d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5348001ea0 tx=0x7f5348052900 comp rx=0 tx=0).stop 2024-05-08T18:31:19.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 shutdown_connections 2024-05-08T18:31:19.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 --2- 172.21.15.87:0/2263178162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556676429910 0x5566765df0d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 >> 172.21.15.87:0/2263178162 conn(0x5566765d1c80 msgr2=0x5566765cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 shutdown_connections 2024-05-08T18:31:19.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 -- 172.21.15.87:0/2263178162 wait complete. 2024-05-08T18:31:19.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 -- 172.21.15.87:0/658381006 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f522803bb50 msgr2=0x7f522803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 --2- 172.21.15.87:0/658381006 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f522803bb50 0x7f522803e010 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f534005d000 tx=0x7f534005cf10 comp rx=0 tx=0).stop 2024-05-08T18:31:19.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 -- 172.21.15.87:0/658381006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566765c8630 msgr2=0x5566765c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 --2- 172.21.15.87:0/658381006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566765c8630 0x5566765c8a50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5566765ae530 tx=0x7f53480178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 -- 172.21.15.87:0/658381006 shutdown_connections 2024-05-08T18:31:19.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 --2- 172.21.15.87:0/658381006 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f522803bb50 0x7f522803e010 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 --2- 172.21.15.87:0/658381006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566765c8630 0x5566765c8a50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 -- 172.21.15.87:0/658381006 >> 172.21.15.87:0/658381006 conn(0x5566765bc6d0 msgr2=0x5566765bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 -- 172.21.15.87:0/658381006 shutdown_connections 2024-05-08T18:31:19.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.846+0000 7f5351e98800 1 -- 172.21.15.87:0/658381006 wait complete. 2024-05-08T18:31:19.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.847+0000 7f5351e98800 1 -- 172.21.15.87:0/3967385429 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5566765b7ac0 msgr2=0x5566765b9eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.847+0000 7f5351e98800 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5566765b7ac0 0x5566765b9eb0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.847+0000 7f5351e98800 1 -- 172.21.15.87:0/3967385429 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5566764b5470 msgr2=0x5566765b4370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.847+0000 7f5351e98800 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5566764b5470 0x5566765b4370 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.847+0000 7f5351e98800 1 -- 172.21.15.87:0/3967385429 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f523803bb50 msgr2=0x7f523803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.847+0000 7f5351e98800 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f523803bb50 0x7f523803e010 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5338000f60 tx=0x7f53380012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.847+0000 7f5351e98800 1 -- 172.21.15.87:0/3967385429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 msgr2=0x5566765ad1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.847+0000 7f5351e98800 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 0x5566765ad1d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f534001ced0 tx=0x7f5340002fb0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.847+0000 7f5351e98800 1 -- 172.21.15.87:0/3967385429 shutdown_connections 2024-05-08T18:31:19.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.847+0000 7f5351e98800 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5566764b5470 0x5566765b4370 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.847+0000 7f5351e98800 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5566765b7ac0 0x5566765b9eb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.847+0000 7f5351e98800 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f523803bb50 0x7f523803e010 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.847+0000 7f5351e98800 1 --2- 172.21.15.87:0/3967385429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566764b42b0 0x5566765ad1d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.847+0000 7f5351e98800 1 -- 172.21.15.87:0/3967385429 >> 172.21.15.87:0/3967385429 conn(0x5566764af830 msgr2=0x55667659f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.847+0000 7f5351e98800 1 -- 172.21.15.87:0/3967385429 shutdown_connections 2024-05-08T18:31:19.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.847+0000 7f5351e98800 1 -- 172.21.15.87:0/3967385429 wait complete. 2024-05-08T18:31:19.858 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T18:31:19.858 DEBUG:tasks.util.rgw: json result: [] 2024-05-08T18:31:19.871 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:19.872 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-05-08T18:31:19.872 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-05-08T18:31:19.872 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-05-08T18:31:19.917 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:19.917 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:19.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.920+0000 7fcb5c12b800 1 Processor -- start 2024-05-08T18:31:19.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.920+0000 7fcb5c12b800 1 -- start start 2024-05-08T18:31:19.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.920+0000 7fcb5c12b800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55638fd276a0 0x55638fd29a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.920+0000 7fcb5c12b800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55638fd2a060 con 0x55638fd232b0 2024-05-08T18:31:19.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.920+0000 7fcb5c12b800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55638fbc3e20 con 0x55638fd276a0 2024-05-08T18:31:19.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.920+0000 7fcb4ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55638fd276a0 0x55638fd29a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.920+0000 7fcb57ee8640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55638fd232b0 0x55638fd236d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42058/0 (socket says 172.21.15.87:42058) 2024-05-08T18:31:19.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.920+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2016918925 learned_addr learned my addr 172.21.15.87:0/2016918925 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:19.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.920+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2016918925 >> v1:172.21.15.53:6789/0 conn(0x55638fd232b0 legacy=0x55638fd236d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.920+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2016918925 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55638fd2b290 con 0x55638fd276a0 2024-05-08T18:31:19.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.922+0000 7fcb4ffff640 1 --2- 172.21.15.87:0/2016918925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd276a0 0x55638fd29a90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000a470 tx=0x7fcb4001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43f8c8b1f4d4c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.922+0000 7fcb576e7640 1 -- 172.21.15.87:0/2016918925 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb40057070 con 0x55638fd276a0 2024-05-08T18:31:19.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.923+0000 7fcb576e7640 1 -- 172.21.15.87:0/2016918925 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb40052570 con 0x55638fd276a0 2024-05-08T18:31:19.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.923+0000 7fcb576e7640 1 -- 172.21.15.87:0/2016918925 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb40052870 con 0x55638fd276a0 2024-05-08T18:31:19.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.923+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2016918925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd276a0 msgr2=0x55638fd29a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.923+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2016918925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd276a0 0x55638fd29a90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000a470 tx=0x7fcb4001ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:19.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.923+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2016918925 shutdown_connections 2024-05-08T18:31:19.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.923+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2016918925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd276a0 0x55638fd29a90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.923+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2016918925 >> 172.21.15.87:0/2016918925 conn(0x55638fd1e830 msgr2=0x55638fd20c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.923+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2016918925 shutdown_connections 2024-05-08T18:31:19.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.923+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2016918925 wait complete. 2024-05-08T18:31:19.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.937+0000 7fcb5c12b800 1 Processor -- start 2024-05-08T18:31:19.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.937+0000 7fcb5c12b800 1 -- start start 2024-05-08T18:31:19.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.937+0000 7fcb5c12b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd232b0 0x55638fe145e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.937+0000 7fcb5c12b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55638fc6e5b0 con 0x55638fd232b0 2024-05-08T18:31:19.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.937+0000 7fcb57ee8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd232b0 0x55638fe145e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.937+0000 7fcb57ee8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd232b0 0x55638fe145e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33594/0 (socket says 172.21.15.87:33594) 2024-05-08T18:31:19.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.937+0000 7fcb57ee8640 1 -- 172.21.15.87:0/1357753249 learned_addr learned my addr 172.21.15.87:0/1357753249 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.937+0000 7fcb57ee8640 1 -- 172.21.15.87:0/1357753249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55638fe14bb0 con 0x55638fd232b0 2024-05-08T18:31:19.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.938+0000 7fcb57ee8640 1 --2- 172.21.15.87:0/1357753249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd232b0 0x55638fe145e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcb48001d80 tx=0x7fcb48001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4c47b48ce4fe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.938+0000 7fca45e0b640 1 -- 172.21.15.87:0/1357753249 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb48013030 con 0x55638fd232b0 2024-05-08T18:31:19.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.938+0000 7fca45e0b640 1 -- 172.21.15.87:0/1357753249 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4800e470 con 0x55638fd232b0 2024-05-08T18:31:19.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.938+0000 7fca45e0b640 1 -- 172.21.15.87:0/1357753249 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4800e810 con 0x55638fd232b0 2024-05-08T18:31:19.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.938+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1357753249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd232b0 msgr2=0x55638fe145e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.938+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/1357753249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd232b0 0x55638fe145e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcb48001d80 tx=0x7fcb48001e70 comp rx=0 tx=0).stop 2024-05-08T18:31:19.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.939+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1357753249 shutdown_connections 2024-05-08T18:31:19.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.939+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/1357753249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd232b0 0x55638fe145e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.939+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1357753249 >> 172.21.15.87:0/1357753249 conn(0x55638fd1e830 msgr2=0x55638fe0ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.939+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1357753249 shutdown_connections 2024-05-08T18:31:19.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.939+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1357753249 wait complete. 2024-05-08T18:31:19.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.939+0000 7fcb5c12b800 1 Processor -- start 2024-05-08T18:31:19.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.939+0000 7fcb5c12b800 1 -- start start 2024-05-08T18:31:19.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.939+0000 7fcb5c12b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd232b0 0x55638fe1c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.939+0000 7fcb5c12b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55638fd2a530 con 0x55638fd232b0 2024-05-08T18:31:19.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.939+0000 7fcb57ee8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd232b0 0x55638fe1c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.939+0000 7fcb57ee8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd232b0 0x55638fe1c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33604/0 (socket says 172.21.15.87:33604) 2024-05-08T18:31:19.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.939+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2993531144 learned_addr learned my addr 172.21.15.87:0/2993531144 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.940+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2993531144 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55638fe1c6c0 con 0x55638fd232b0 2024-05-08T18:31:19.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.940+0000 7fcb57ee8640 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd232b0 0x55638fe1c180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcb48004000 tx=0x7fcb48000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.940+0000 7fca3ffff640 1 -- 172.21.15.87:0/2993531144 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb48027070 con 0x55638fd232b0 2024-05-08T18:31:19.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.940+0000 7fca3ffff640 1 -- 172.21.15.87:0/2993531144 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb48019900 con 0x55638fd232b0 2024-05-08T18:31:19.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.940+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2993531144 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55638fe1c950 con 0x55638fd232b0 2024-05-08T18:31:19.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.940+0000 7fca3ffff640 1 -- 172.21.15.87:0/2993531144 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb48019c60 con 0x55638fd232b0 2024-05-08T18:31:19.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.940+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2993531144 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55638fe1f600 con 0x55638fd232b0 2024-05-08T18:31:19.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.941+0000 7fca3ffff640 1 -- 172.21.15.87:0/2993531144 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fcb4802a070 con 0x55638fd232b0 2024-05-08T18:31:19.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.941+0000 7fca3ffff640 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fca4003bba0 0x7fca4003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.941+0000 7fca3ffff640 1 -- 172.21.15.87:0/2993531144 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcb4801f070 con 0x55638fd232b0 2024-05-08T18:31:19.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.941+0000 7fcb4ffff640 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fca4003bba0 0x7fca4003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.941+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55638fd276a0 0x55638fe233c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.941+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2993531144 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe23940 con 0x55638fd276a0 2024-05-08T18:31:19.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.941+0000 7fcb586e9640 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55638fd276a0 0x55638fe233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.942+0000 7fcb4ffff640 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fca4003bba0 0x7fca4003e060 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcb40054000 tx=0x7fcb4004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.942+0000 7fcb586e9640 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55638fd276a0 0x55638fe233c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.942+0000 7fcb586e9640 1 -- 172.21.15.87:0/2993531144 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb5000a4a0 con 0x55638fd276a0 2024-05-08T18:31:19.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.942+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2993531144 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe20990 con 0x55638fd276a0 2024-05-08T18:31:19.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.942+0000 7fcb586e9640 1 -- 172.21.15.87:0/2993531144 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb5000a4a0 con 0x55638fd276a0 2024-05-08T18:31:19.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.942+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2993531144 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe25760 con 0x55638fd276a0 2024-05-08T18:31:19.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.943+0000 7fcb586e9640 1 -- 172.21.15.87:0/2993531144 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcb5000a4a0 con 0x55638fd276a0 2024-05-08T18:31:19.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.943+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2993531144 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe24990 con 0x55638fd276a0 2024-05-08T18:31:19.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.943+0000 7fcb586e9640 1 -- 172.21.15.87:0/2993531144 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb5000a4a0 con 0x55638fd276a0 2024-05-08T18:31:19.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.943+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55638fe26b10 0x55638fe28f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.943+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2993531144 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe29440 con 0x55638fe26b10 2024-05-08T18:31:19.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.943+0000 7fcb57ee8640 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55638fe26b10 0x55638fe28f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.943+0000 7fcb57ee8640 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55638fe26b10 0x55638fe28f00 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.944+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2993531144 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcb48029030 con 0x55638fe26b10 2024-05-08T18:31:19.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.944+0000 7fcb5c12b800 1 Processor -- start 2024-05-08T18:31:19.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.944+0000 7fcb5c12b800 1 -- start start 2024-05-08T18:31:19.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.944+0000 7fcb5c12b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe37680 0x55638fe37aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.944+0000 7fcb5c12b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55638fc14fc0 con 0x55638fe37680 2024-05-08T18:31:19.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.944+0000 7fcb586e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe37680 0x55638fe37aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.944+0000 7fcb586e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe37680 0x55638fe37aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33616/0 (socket says 172.21.15.87:33616) 2024-05-08T18:31:19.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.944+0000 7fcb586e9640 1 -- 172.21.15.87:0/1160854767 learned_addr learned my addr 172.21.15.87:0/1160854767 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.945+0000 7fcb586e9640 1 -- 172.21.15.87:0/1160854767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55638fe37fe0 con 0x55638fe37680 2024-05-08T18:31:19.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.945+0000 7fcb586e9640 1 --2- 172.21.15.87:0/1160854767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe37680 0x55638fe37aa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55638fe1d580 tx=0x7fcb500178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.945+0000 7fca3d7fa640 1 -- 172.21.15.87:0/1160854767 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb50013440 con 0x55638fe37680 2024-05-08T18:31:19.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.945+0000 7fca3d7fa640 1 -- 172.21.15.87:0/1160854767 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb500135e0 con 0x55638fe37680 2024-05-08T18:31:19.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.945+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1160854767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55638fe38a50 con 0x55638fe37680 2024-05-08T18:31:19.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.945+0000 7fca3d7fa640 1 -- 172.21.15.87:0/1160854767 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb500138c0 con 0x55638fe37680 2024-05-08T18:31:19.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.945+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1160854767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55638fe38f50 con 0x55638fe37680 2024-05-08T18:31:19.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.946+0000 7fca3d7fa640 1 -- 172.21.15.87:0/1160854767 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fcb50011040 con 0x55638fe37680 2024-05-08T18:31:19.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.946+0000 7fca3d7fa640 1 --2- 172.21.15.87:0/1160854767 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fca3003bb50 0x7fca3003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.946+0000 7fca3d7fa640 1 -- 172.21.15.87:0/1160854767 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcb5001d070 con 0x55638fe37680 2024-05-08T18:31:19.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.946+0000 7fcb57ee8640 1 --2- 172.21.15.87:0/1160854767 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fca3003bb50 0x7fca3003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.946+0000 7fcb5c12b800 1 Processor -- start 2024-05-08T18:31:19.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.946+0000 7fcb57ee8640 1 --2- 172.21.15.87:0/1160854767 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fca3003bb50 0x7fca3003e010 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcb4801dfd0 tx=0x7fcb4800ef30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.946+0000 7fcb5c12b800 1 -- start start 2024-05-08T18:31:19.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.946+0000 7fcb5c12b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe44970 0x55638fe44d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.946+0000 7fcb5c12b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55638fe14f30 con 0x55638fe44970 2024-05-08T18:31:19.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.947+0000 7fcb586e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe44970 0x55638fe44d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.947+0000 7fcb586e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe44970 0x55638fe44d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33622/0 (socket says 172.21.15.87:33622) 2024-05-08T18:31:19.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.947+0000 7fcb586e9640 1 -- 172.21.15.87:0/1422065216 learned_addr learned my addr 172.21.15.87:0/1422065216 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.947+0000 7fcb586e9640 1 -- 172.21.15.87:0/1422065216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55638fe45360 con 0x55638fe44970 2024-05-08T18:31:19.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.947+0000 7fcb586e9640 1 --2- 172.21.15.87:0/1422065216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe44970 0x55638fe44d90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcb500529a0 tx=0x7fcb50001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11be15e5662718b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.947+0000 7fca36ffd640 1 -- 172.21.15.87:0/1422065216 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb5002ad80 con 0x55638fe44970 2024-05-08T18:31:19.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.947+0000 7fca36ffd640 1 -- 172.21.15.87:0/1422065216 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb500540d0 con 0x55638fe44970 2024-05-08T18:31:19.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.947+0000 7fca36ffd640 1 -- 172.21.15.87:0/1422065216 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb500543f0 con 0x55638fe44970 2024-05-08T18:31:19.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.948+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1422065216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe44970 msgr2=0x55638fe44d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.948+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/1422065216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe44970 0x55638fe44d90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcb500529a0 tx=0x7fcb50001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:19.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.948+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1422065216 shutdown_connections 2024-05-08T18:31:19.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.948+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/1422065216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe44970 0x55638fe44d90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.948+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1422065216 >> 172.21.15.87:0/1422065216 conn(0x55638fe40d20 msgr2=0x55638fe3ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.948+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1422065216 shutdown_connections 2024-05-08T18:31:19.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.948+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1422065216 wait complete. 2024-05-08T18:31:19.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.948+0000 7fcb5c12b800 1 Processor -- start 2024-05-08T18:31:19.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.948+0000 7fcb5c12b800 1 -- start start 2024-05-08T18:31:19.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.948+0000 7fcb5c12b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe44970 0x55638fe4bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.948+0000 7fcb5c12b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55638fe45ac0 con 0x55638fe44970 2024-05-08T18:31:19.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.948+0000 7fcb586e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe44970 0x55638fe4bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.948+0000 7fcb586e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe44970 0x55638fe4bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33636/0 (socket says 172.21.15.87:33636) 2024-05-08T18:31:19.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.948+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 learned_addr learned my addr 172.21.15.87:0/2495325102 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:19.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.949+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55638fe4c460 con 0x55638fe44970 2024-05-08T18:31:19.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.949+0000 7fcb586e9640 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe44970 0x55638fe4bf20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcb50015fd0 tx=0x7fcb50052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.949+0000 7fca357fa640 1 -- 172.21.15.87:0/2495325102 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb50030020 con 0x55638fe44970 2024-05-08T18:31:19.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.949+0000 7fca357fa640 1 -- 172.21.15.87:0/2495325102 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb50051310 con 0x55638fe44970 2024-05-08T18:31:19.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.949+0000 7fca357fa640 1 -- 172.21.15.87:0/2495325102 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb50013a60 con 0x55638fe44970 2024-05-08T18:31:19.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.949+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55638fe4c6f0 con 0x55638fe44970 2024-05-08T18:31:19.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.949+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55638fe4f3a0 con 0x55638fe44970 2024-05-08T18:31:19.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.950+0000 7fca357fa640 1 -- 172.21.15.87:0/2495325102 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fcb50033020 con 0x55638fe44970 2024-05-08T18:31:19.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.950+0000 7fca357fa640 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fca2003bb50 0x7fca2003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.950+0000 7fca357fa640 1 -- 172.21.15.87:0/2495325102 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcb5000e040 con 0x55638fe44970 2024-05-08T18:31:19.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.950+0000 7fcb57ee8640 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fca2003bb50 0x7fca2003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.950+0000 7fcb5c12b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.950+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55638fe57b80 0x55638fe5a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.950+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe5a790 con 0x55638fe57b80 2024-05-08T18:31:19.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.950+0000 7fcb57ee8640 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fca2003bb50 0x7fca2003e010 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800c860 tx=0x7fcb48035000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.950+0000 7fcb4ffff640 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55638fe57b80 0x55638fe5a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.951+0000 7fcb4ffff640 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55638fe57b80 0x55638fe5a040 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.951+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.951+0000 7fcb5c12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.951+0000 7fcb5c12b800 20 realm 2024-05-08T18:31:19.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.951+0000 7fcb5c12b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.951+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe5ab60 con 0x55638fe57b80 2024-05-08T18:31:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.951+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.951+0000 7fcb5c12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.951+0000 7fcb5c12b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.951+0000 7fcb5c12b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.951+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe5b430 con 0x55638fe57b80 2024-05-08T18:31:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.951+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.951+0000 7fcb5c12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.951+0000 7fcb5c12b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.951+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe5b7d0 con 0x55638fe57b80 2024-05-08T18:31:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.951+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.952+0000 7fcb5c12b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.952+0000 7fcb5c12b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.952+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe5bbf0 con 0x55638fe57b80 2024-05-08T18:31:19.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.952+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.952+0000 7fcb5c12b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:19.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.952+0000 7fcb5c12b800 20 searching for the correct realm 2024-05-08T18:31:19.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.952+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55638fe5dbf0 0x55638fe60040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.952+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x55638fe5dbf0 2024-05-08T18:31:19.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.952+0000 7fcb586e9640 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55638fe5dbf0 0x55638fe60040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.952+0000 7fcb586e9640 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55638fe5dbf0 0x55638fe60040 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.953+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb50029070 con 0x55638fe5dbf0 2024-05-08T18:31:19.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.953+0000 7fcb586e9640 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fcb50035020 0x7fcb50008970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.953+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x7fcb50035020 2024-05-08T18:31:19.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.953+0000 7fcb57ee8640 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fcb50035020 0x7fcb50008970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.953+0000 7fcb57ee8640 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fcb50035020 0x7fcb50008970 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.953+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb48029030 con 0x7fcb50035020 2024-05-08T18:31:19.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.953+0000 7fcb57ee8640 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fcb4802c060 0x7fcb4802ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:19.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.953+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x7fcb4802c060 2024-05-08T18:31:19.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.954+0000 7fcb4ffff640 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fcb4802c060 0x7fcb4802ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:19.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.954+0000 7fcb4ffff640 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fcb4802c060 0x7fcb4802ba90 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:19.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.954+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.954+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x55638fe57b80 2024-05-08T18:31:19.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.954+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.954+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x55638fe57b80 2024-05-08T18:31:19.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.955+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.955+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x7fcb4802c060 2024-05-08T18:31:19.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.955+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.955+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x7fcb4802c060 2024-05-08T18:31:19.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.955+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.955+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x7fcb50035020 2024-05-08T18:31:19.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.956+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb48029030 con 0x7fcb50035020 2024-05-08T18:31:19.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.956+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x55638fe5dbf0 2024-05-08T18:31:19.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.956+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb50029070 con 0x55638fe5dbf0 2024-05-08T18:31:19.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.956+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x55638fe57b80 2024-05-08T18:31:19.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.956+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.956+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x7fcb4802c060 2024-05-08T18:31:19.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.956+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.956+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x55638fe57b80 2024-05-08T18:31:19.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.956+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.956+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x7fcb50035020 2024-05-08T18:31:19.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.957+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcb48029030 con 0x7fcb50035020 2024-05-08T18:31:19.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.957+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x55638fe5dbf0 2024-05-08T18:31:19.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.957+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb50029070 con 0x55638fe5dbf0 2024-05-08T18:31:19.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.957+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x55638fe5dbf0 2024-05-08T18:31:19.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.957+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb50029070 con 0x55638fe5dbf0 2024-05-08T18:31:19.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.957+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x7fcb4802c060 2024-05-08T18:31:19.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.957+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.957+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x55638fe5dbf0 2024-05-08T18:31:19.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.958+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb50029070 con 0x55638fe5dbf0 2024-05-08T18:31:19.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.958+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x55638fe5dbf0 2024-05-08T18:31:19.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.958+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb50029070 con 0x55638fe5dbf0 2024-05-08T18:31:19.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.958+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x55638fe57b80 2024-05-08T18:31:19.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.958+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.958+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x55638fe57b80 2024-05-08T18:31:19.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.958+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.958+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x7fcb4802c060 2024-05-08T18:31:19.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.959+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.959+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x55638fe5dbf0 2024-05-08T18:31:19.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.959+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb50029070 con 0x55638fe5dbf0 2024-05-08T18:31:19.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.959+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x7fcb50035020 2024-05-08T18:31:19.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.959+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb48029030 con 0x7fcb50035020 2024-05-08T18:31:19.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.959+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x55638fe57b80 2024-05-08T18:31:19.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.959+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.959+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x7fcb4802c060 2024-05-08T18:31:19.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.960+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.960+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x55638fe5dbf0 2024-05-08T18:31:19.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.960+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb50029070 con 0x55638fe5dbf0 2024-05-08T18:31:19.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.960+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x7fcb4802c060 2024-05-08T18:31:19.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.960+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.960+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x7fcb50035020 2024-05-08T18:31:19.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.960+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb48029030 con 0x7fcb50035020 2024-05-08T18:31:19.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.961+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x55638fe5dbf0 2024-05-08T18:31:19.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.961+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb50029070 con 0x55638fe5dbf0 2024-05-08T18:31:19.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.961+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x7fcb4802c060 2024-05-08T18:31:19.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.961+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.961+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x55638fe57b80 2024-05-08T18:31:19.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60710 con 0x7fcb50035020 2024-05-08T18:31:19.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb48029030 con 0x7fcb50035020 2024-05-08T18:31:19.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb5c12b800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:19.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb5c12b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:19.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb5c12b800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:19.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb5c12b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:19.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb5c12b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:19.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb5c12b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:19.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb5c12b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe5c690 con 0x55638fe57b80 2024-05-08T18:31:19.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb5c12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb5c12b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe5cf30 con 0x55638fe57b80 2024-05-08T18:31:19.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb5c12b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:19.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb5c12b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.962+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe5c2d0 con 0x7fcb4802c060 2024-05-08T18:31:19.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:19.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 20 zone default found 2024-05-08T18:31:19.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 4 Realm: () 2024-05-08T18:31:19.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:19.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:19.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:19.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 20 zonegroup default 2024-05-08T18:31:19.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe60be0 con 0x7fcb4802c060 2024-05-08T18:31:19.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe62a70 con 0x55638fe5dbf0 2024-05-08T18:31:19.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb50029070 con 0x55638fe5dbf0 2024-05-08T18:31:19.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe62e10 con 0x55638fe5dbf0 2024-05-08T18:31:19.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb50029070 con 0x55638fe5dbf0 2024-05-08T18:31:19.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:19.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 20 started sync module instance, tier type = 2024-05-08T18:31:19.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:19.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.963+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe61eb0 con 0x7fcb50035020 2024-05-08T18:31:19.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.964+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb48029030 con 0x7fcb50035020 2024-05-08T18:31:19.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.964+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93886104347344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe63660 con 0x7fcb50035020 2024-05-08T18:31:19.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.964+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe63eb0 con 0x55638fe57b80 2024-05-08T18:31:19.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.965+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93886104347344] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb48029030 con 0x7fcb50035020 2024-05-08T18:31:19.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.966+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.966+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93886104351152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe63eb0 con 0x55638fe57b80 2024-05-08T18:31:19.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.966+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe64980 con 0x55638fe5dbf0 2024-05-08T18:31:19.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.967+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93886104351152] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.967+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb50029070 con 0x55638fe5dbf0 2024-05-08T18:31:19.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.967+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93886104353280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe63e20 con 0x55638fe5dbf0 2024-05-08T18:31:19.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.967+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe65870 con 0x7fcb50035020 2024-05-08T18:31:19.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.968+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93886104353280] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb50029070 con 0x55638fe5dbf0 2024-05-08T18:31:19.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.968+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb48029030 con 0x7fcb50035020 2024-05-08T18:31:19.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.968+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93886104359872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe65c60 con 0x7fcb50035020 2024-05-08T18:31:19.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.968+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe66680 con 0x55638fe57b80 2024-05-08T18:31:19.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.969+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.969+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93886104363376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe66640 con 0x55638fe57b80 2024-05-08T18:31:19.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.969+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe67610 con 0x7fcb4802c060 2024-05-08T18:31:19.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.969+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93886104359872] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb48029030 con 0x7fcb50035020 2024-05-08T18:31:19.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.970+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.970+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93886104367424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe67610 con 0x7fcb4802c060 2024-05-08T18:31:19.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.970+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe68050 con 0x7fcb4802c060 2024-05-08T18:31:19.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.970+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93886104363376] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.971+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93886104367424] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.971+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.971+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93886104358304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe67ba0 con 0x7fcb4802c060 2024-05-08T18:31:19.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.971+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe68560 con 0x7fcb4802c060 2024-05-08T18:31:19.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.972+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93886104358304] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.972+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.972+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93886104365616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe68560 con 0x7fcb4802c060 2024-05-08T18:31:19.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.972+0000 7fcb5c12b800 20 add_watcher() i=0 2024-05-08T18:31:19.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.972+0000 7fcb5c12b800 20 add_watcher() i=1 2024-05-08T18:31:19.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.972+0000 7fcb5c12b800 20 add_watcher() i=2 2024-05-08T18:31:19.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.972+0000 7fcb5c12b800 20 add_watcher() i=3 2024-05-08T18:31:19.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.972+0000 7fcb5c12b800 20 add_watcher() i=4 2024-05-08T18:31:19.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.972+0000 7fcb5c12b800 20 add_watcher() i=5 2024-05-08T18:31:19.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.972+0000 7fcb5c12b800 20 add_watcher() i=6 2024-05-08T18:31:19.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.973+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93886104365616] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.973+0000 7fcb5c12b800 20 add_watcher() i=7 2024-05-08T18:31:19.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.973+0000 7fcb5c12b800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:19.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.973+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe6b850 con 0x55638fe57b80 2024-05-08T18:31:19.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.973+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.973+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93886104371744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe68af0 con 0x55638fe57b80 2024-05-08T18:31:19.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.974+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93886104371744] v27'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.974+0000 7fca0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:19.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.974+0000 7fcb5c12b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:19.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.974+0000 7fcb5c12b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:19.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.974+0000 7fcb5c12b800 5 note: GC not initialized 2024-05-08T18:31:19.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.975+0000 7fca0cfe1640 20 reqs_thread_entry: start 2024-05-08T18:31:19.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.975+0000 7fcb5c12b800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:19.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.975+0000 7fcb5c12b800 20 Filter name: none 2024-05-08T18:31:19.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.975+0000 7fc9867fc640 20 reqs_thread_entry: start 2024-05-08T18:31:19.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.975+0000 7fcb5c12b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.975+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe9e7e0 con 0x55638fe57b80 2024-05-08T18:31:19.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.975+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.975+0000 7fcb5c12b800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:19.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.975+0000 7fcb5c12b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:19.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.975+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fe9f070 con 0x55638fe57b80 2024-05-08T18:31:19.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.976+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.976+0000 7fcb5c12b800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:19.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.976+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55638fea0080 con 0x7fcb50035020 2024-05-08T18:31:19.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.976+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fcb48029030 con 0x7fcb50035020 2024-05-08T18:31:19.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.977+0000 7fca0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:19.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.977+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93886104371744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe551d0 con 0x55638fe57b80 2024-05-08T18:31:19.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.978+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93886104371744] v27'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.978+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93886104347344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe68220 con 0x7fcb50035020 2024-05-08T18:31:19.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.979+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93886104347344] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb48029030 con 0x7fcb50035020 2024-05-08T18:31:19.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.979+0000 7fcb5c12b800 20 remove_watcher() i=0 2024-05-08T18:31:19.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.979+0000 7fcb5c12b800 2 removed watcher, disabling cache 2024-05-08T18:31:19.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.979+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93886104351152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe68220 con 0x55638fe57b80 2024-05-08T18:31:19.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.980+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93886104351152] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.980+0000 7fcb5c12b800 20 remove_watcher() i=1 2024-05-08T18:31:19.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.980+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93886104353280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe68220 con 0x55638fe5dbf0 2024-05-08T18:31:19.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.981+0000 7fcb586e9640 1 -- 172.21.15.87:0/2495325102 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93886104353280] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb50029070 con 0x55638fe5dbf0 2024-05-08T18:31:19.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.981+0000 7fcb5c12b800 20 remove_watcher() i=2 2024-05-08T18:31:19.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.981+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93886104359872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe63a00 con 0x7fcb50035020 2024-05-08T18:31:19.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.982+0000 7fcb57ee8640 1 -- 172.21.15.87:0/2495325102 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93886104359872] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb48029030 con 0x7fcb50035020 2024-05-08T18:31:19.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.982+0000 7fcb5c12b800 20 remove_watcher() i=3 2024-05-08T18:31:19.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.982+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93886104363376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe68220 con 0x55638fe57b80 2024-05-08T18:31:19.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.983+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93886104363376] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x55638fe57b80 2024-05-08T18:31:19.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.983+0000 7fcb5c12b800 20 remove_watcher() i=4 2024-05-08T18:31:19.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.983+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93886104367424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe653c0 con 0x7fcb4802c060 2024-05-08T18:31:19.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.984+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93886104367424] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.984+0000 7fcb5c12b800 20 remove_watcher() i=5 2024-05-08T18:31:19.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.984+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93886104358304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe63a00 con 0x7fcb4802c060 2024-05-08T18:31:19.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.985+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93886104358304] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.985+0000 7fcb5c12b800 20 remove_watcher() i=6 2024-05-08T18:31:19.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.985+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93886104365616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55638fe63a00 con 0x7fcb4802c060 2024-05-08T18:31:19.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93886104365616] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4005a040 con 0x7fcb4802c060 2024-05-08T18:31:19.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb5c12b800 20 remove_watcher() i=7 2024-05-08T18:31:19.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fcb4802c060 msgr2=0x7fcb4802ba90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fcb4802c060 0x7fcb4802ba90 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55638fe57b80 msgr2=0x55638fe5a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55638fe57b80 0x55638fe5a040 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fcb50035020 msgr2=0x7fcb50008970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fcb50035020 0x7fcb50008970 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55638fe5dbf0 msgr2=0x55638fe60040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55638fe5dbf0 0x55638fe60040 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fca2003bb50 msgr2=0x7fca2003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fca2003bb50 0x7fca2003e010 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800c860 tx=0x7fcb48035000 comp rx=0 tx=0).stop 2024-05-08T18:31:19.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe44970 msgr2=0x55638fe4bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2495325102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe44970 0x55638fe4bf20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcb50015fd0 tx=0x7fcb50052900 comp rx=0 tx=0).stop 2024-05-08T18:31:19.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 reap_dead start 2024-05-08T18:31:19.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb4ffff640 1 -- 172.21.15.87:0/2495325102 reap_dead start 2024-05-08T18:31:19.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 shutdown_connections 2024-05-08T18:31:19.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 >> 172.21.15.87:0/2495325102 conn(0x55638fe40d20 msgr2=0x55638fe461e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 shutdown_connections 2024-05-08T18:31:19.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.986+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2495325102 wait complete. 2024-05-08T18:31:19.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1160854767 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fca3003bb50 msgr2=0x7fca3003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/1160854767 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fca3003bb50 0x7fca3003e010 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcb4801dfd0 tx=0x7fcb4800ef30 comp rx=0 tx=0).stop 2024-05-08T18:31:19.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1160854767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe37680 msgr2=0x55638fe37aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/1160854767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe37680 0x55638fe37aa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55638fe1d580 tx=0x7fcb500178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1160854767 shutdown_connections 2024-05-08T18:31:19.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/1160854767 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fca3003bb50 0x7fca3003e010 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/1160854767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fe37680 0x55638fe37aa0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1160854767 >> 172.21.15.87:0/1160854767 conn(0x55638fe2b720 msgr2=0x55638fe2bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1160854767 shutdown_connections 2024-05-08T18:31:19.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 -- 172.21.15.87:0/1160854767 wait complete. 2024-05-08T18:31:19.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2993531144 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55638fe26b10 msgr2=0x55638fe28f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55638fe26b10 0x55638fe28f00 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2993531144 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55638fd276a0 msgr2=0x55638fe233c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55638fd276a0 0x55638fe233c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2993531144 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fca4003bba0 msgr2=0x7fca4003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fca4003bba0 0x7fca4003e060 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcb40054000 tx=0x7fcb4004e000 comp rx=0 tx=0).stop 2024-05-08T18:31:19.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2993531144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd232b0 msgr2=0x55638fe1c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:19.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd232b0 0x55638fe1c180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcb48004000 tx=0x7fcb48000bc0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2993531144 shutdown_connections 2024-05-08T18:31:19.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55638fd276a0 0x55638fe233c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55638fe26b10 0x55638fe28f00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fca4003bba0 0x7fca4003e060 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 --2- 172.21.15.87:0/2993531144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55638fd232b0 0x55638fe1c180 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:19.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2993531144 >> 172.21.15.87:0/2993531144 conn(0x55638fd1e830 msgr2=0x55638fe0e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:19.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2993531144 shutdown_connections 2024-05-08T18:31:19.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:19.987+0000 7fcb5c12b800 1 -- 172.21.15.87:0/2993531144 wait complete. 2024-05-08T18:31:20.000 INFO:teuthology.orchestra.run.smithi087.stdout:["myfoo"] 2024-05-08T18:31:20.000 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-05-08T18:31:20.004 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:20.005 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-05-08T18:31:20.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-05-08T18:31:20.005 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-05-08T18:31:20.047 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:20.047 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:20.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.049+0000 7f3800723800 1 Processor -- start 2024-05-08T18:31:20.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.049+0000 7f3800723800 1 -- start start 2024-05-08T18:31:20.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.050+0000 7f3800723800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563d4436ba30 0x563d4436de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.050+0000 7f3800723800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563d4436e360 con 0x563d443657e0 2024-05-08T18:31:20.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.050+0000 7f3800723800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x563d44205e20 con 0x563d4436ba30 2024-05-08T18:31:20.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.050+0000 7f37f3c51640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563d4436ba30 0x563d4436de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.050+0000 7f37fc452640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x563d443657e0 0x563d44365c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42060/0 (socket says 172.21.15.87:42060) 2024-05-08T18:31:20.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.050+0000 7f37fc452640 1 -- 172.21.15.87:0/846726320 learned_addr learned my addr 172.21.15.87:0/846726320 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:20.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.050+0000 7f37f3c51640 1 -- 172.21.15.87:0/846726320 >> v1:172.21.15.53:6789/0 conn(0x563d443657e0 legacy=0x563d44365c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.050+0000 7f37f3c51640 1 -- 172.21.15.87:0/846726320 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d4436f540 con 0x563d4436ba30 2024-05-08T18:31:20.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.052+0000 7f37f3c51640 1 --2- 172.21.15.87:0/846726320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d4436ba30 0x563d4436de20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f37e400a470 tx=0x7f37e401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74091de034ee43aa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.052+0000 7f37fbc51640 1 -- 172.21.15.87:0/846726320 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37e4057070 con 0x563d4436ba30 2024-05-08T18:31:20.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.052+0000 7f37fbc51640 1 -- 172.21.15.87:0/846726320 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e4052570 con 0x563d4436ba30 2024-05-08T18:31:20.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.052+0000 7f37fbc51640 1 -- 172.21.15.87:0/846726320 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37e4052870 con 0x563d4436ba30 2024-05-08T18:31:20.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.053+0000 7f3800723800 1 -- 172.21.15.87:0/846726320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d4436ba30 msgr2=0x563d4436de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.053+0000 7f3800723800 1 --2- 172.21.15.87:0/846726320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d4436ba30 0x563d4436de20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f37e400a470 tx=0x7f37e401ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:20.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.053+0000 7f3800723800 1 -- 172.21.15.87:0/846726320 shutdown_connections 2024-05-08T18:31:20.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.053+0000 7f3800723800 1 --2- 172.21.15.87:0/846726320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d4436ba30 0x563d4436de20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.053+0000 7f3800723800 1 -- 172.21.15.87:0/846726320 >> 172.21.15.87:0/846726320 conn(0x563d4435ee90 msgr2=0x563d443612b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.053+0000 7f3800723800 1 -- 172.21.15.87:0/846726320 shutdown_connections 2024-05-08T18:31:20.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.053+0000 7f3800723800 1 -- 172.21.15.87:0/846726320 wait complete. 2024-05-08T18:31:20.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.066+0000 7f3800723800 1 Processor -- start 2024-05-08T18:31:20.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.066+0000 7f3800723800 1 -- start start 2024-05-08T18:31:20.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.066+0000 7f3800723800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d443657e0 0x563d44458770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.066+0000 7f3800723800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563d442b05a0 con 0x563d443657e0 2024-05-08T18:31:20.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.067+0000 7f37fc452640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d443657e0 0x563d44458770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.067+0000 7f37fc452640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d443657e0 0x563d44458770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33640/0 (socket says 172.21.15.87:33640) 2024-05-08T18:31:20.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.067+0000 7f37fc452640 1 -- 172.21.15.87:0/598206461 learned_addr learned my addr 172.21.15.87:0/598206461 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.067+0000 7f37fc452640 1 -- 172.21.15.87:0/598206461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d44458d40 con 0x563d443657e0 2024-05-08T18:31:20.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.067+0000 7f37fc452640 1 --2- 172.21.15.87:0/598206461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d443657e0 0x563d44458770 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f37ec001d80 tx=0x7f37ec001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3a76053d4d08da server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.067+0000 7f36ea60c640 1 -- 172.21.15.87:0/598206461 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37ec013030 con 0x563d443657e0 2024-05-08T18:31:20.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.067+0000 7f36ea60c640 1 -- 172.21.15.87:0/598206461 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ec00e470 con 0x563d443657e0 2024-05-08T18:31:20.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.067+0000 7f36ea60c640 1 -- 172.21.15.87:0/598206461 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37ec00e810 con 0x563d443657e0 2024-05-08T18:31:20.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.068+0000 7f3800723800 1 -- 172.21.15.87:0/598206461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d443657e0 msgr2=0x563d44458770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.068+0000 7f3800723800 1 --2- 172.21.15.87:0/598206461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d443657e0 0x563d44458770 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f37ec001d80 tx=0x7f37ec001e70 comp rx=0 tx=0).stop 2024-05-08T18:31:20.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.068+0000 7f3800723800 1 -- 172.21.15.87:0/598206461 shutdown_connections 2024-05-08T18:31:20.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.068+0000 7f3800723800 1 --2- 172.21.15.87:0/598206461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d443657e0 0x563d44458770 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.068+0000 7f3800723800 1 -- 172.21.15.87:0/598206461 >> 172.21.15.87:0/598206461 conn(0x563d4435ee90 msgr2=0x563d44454090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.068+0000 7f3800723800 1 -- 172.21.15.87:0/598206461 shutdown_connections 2024-05-08T18:31:20.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.068+0000 7f3800723800 1 -- 172.21.15.87:0/598206461 wait complete. 2024-05-08T18:31:20.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.068+0000 7f3800723800 1 Processor -- start 2024-05-08T18:31:20.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.068+0000 7f3800723800 1 -- start start 2024-05-08T18:31:20.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.069+0000 7f3800723800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d443657e0 0x563d444602e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.069+0000 7f3800723800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563d4436e800 con 0x563d443657e0 2024-05-08T18:31:20.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.069+0000 7f37fc452640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d443657e0 0x563d444602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.069+0000 7f37fc452640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d443657e0 0x563d444602e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33644/0 (socket says 172.21.15.87:33644) 2024-05-08T18:31:20.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.069+0000 7f37fc452640 1 -- 172.21.15.87:0/4037669529 learned_addr learned my addr 172.21.15.87:0/4037669529 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.069+0000 7f37fc452640 1 -- 172.21.15.87:0/4037669529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d44460820 con 0x563d443657e0 2024-05-08T18:31:20.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.069+0000 7f37fc452640 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d443657e0 0x563d444602e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f37ec004000 tx=0x7f37ec000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.069+0000 7f36e8e09640 1 -- 172.21.15.87:0/4037669529 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37ec027070 con 0x563d443657e0 2024-05-08T18:31:20.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.069+0000 7f36e8e09640 1 -- 172.21.15.87:0/4037669529 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ec019900 con 0x563d443657e0 2024-05-08T18:31:20.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.069+0000 7f3800723800 1 -- 172.21.15.87:0/4037669529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d44460ab0 con 0x563d443657e0 2024-05-08T18:31:20.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.069+0000 7f36e8e09640 1 -- 172.21.15.87:0/4037669529 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37ec019c60 con 0x563d443657e0 2024-05-08T18:31:20.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.069+0000 7f3800723800 1 -- 172.21.15.87:0/4037669529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d44463760 con 0x563d443657e0 2024-05-08T18:31:20.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.070+0000 7f36e8e09640 1 -- 172.21.15.87:0/4037669529 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f37ec02a070 con 0x563d443657e0 2024-05-08T18:31:20.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.070+0000 7f36e8e09640 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f36e403bb50 0x7f36e403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.070+0000 7f36e8e09640 1 -- 172.21.15.87:0/4037669529 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f37ec01f070 con 0x563d443657e0 2024-05-08T18:31:20.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.071+0000 7f37f3c51640 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f36e403bb50 0x7f36e403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.071+0000 7f3800723800 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563d4436ba30 0x563d44467520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.071+0000 7f3800723800 1 -- 172.21.15.87:0/4037669529 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d44467aa0 con 0x563d4436ba30 2024-05-08T18:31:20.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.071+0000 7f37fcc53640 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563d4436ba30 0x563d44467520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.071+0000 7f37f3c51640 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f36e403bb50 0x7f36e403e010 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f37e4054000 tx=0x7f37e404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.071+0000 7f37fcc53640 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563d4436ba30 0x563d44467520 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.071+0000 7f37fcc53640 1 -- 172.21.15.87:0/4037669529 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37f400a4a0 con 0x563d4436ba30 2024-05-08T18:31:20.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.071+0000 7f3800723800 1 -- 172.21.15.87:0/4037669529 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d44464af0 con 0x563d4436ba30 2024-05-08T18:31:20.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.072+0000 7f37fcc53640 1 -- 172.21.15.87:0/4037669529 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37f400a4a0 con 0x563d4436ba30 2024-05-08T18:31:20.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.072+0000 7f3800723800 1 -- 172.21.15.87:0/4037669529 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d444698c0 con 0x563d4436ba30 2024-05-08T18:31:20.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.072+0000 7f37fcc53640 1 -- 172.21.15.87:0/4037669529 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f37f400a4a0 con 0x563d4436ba30 2024-05-08T18:31:20.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.072+0000 7f3800723800 1 -- 172.21.15.87:0/4037669529 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d44468af0 con 0x563d4436ba30 2024-05-08T18:31:20.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.072+0000 7f37fcc53640 1 -- 172.21.15.87:0/4037669529 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37f400a4a0 con 0x563d4436ba30 2024-05-08T18:31:20.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.072+0000 7f3800723800 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563d4446ac70 0x563d4446d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.072+0000 7f3800723800 1 -- 172.21.15.87:0/4037669529 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d4446d5a0 con 0x563d4446ac70 2024-05-08T18:31:20.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.072+0000 7f37fc452640 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563d4446ac70 0x563d4446d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.073+0000 7f37fc452640 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563d4446ac70 0x563d4446d060 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.073+0000 7f37fc452640 1 -- 172.21.15.87:0/4037669529 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f37ec029030 con 0x563d4446ac70 2024-05-08T18:31:20.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.073+0000 7f3800723800 1 Processor -- start 2024-05-08T18:31:20.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.073+0000 7f3800723800 1 -- start start 2024-05-08T18:31:20.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.074+0000 7f3800723800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d4447b7e0 0x563d4447bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.074+0000 7f3800723800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563d44256fc0 con 0x563d4447b7e0 2024-05-08T18:31:20.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.074+0000 7f37fcc53640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d4447b7e0 0x563d4447bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.074+0000 7f37fcc53640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d4447b7e0 0x563d4447bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33656/0 (socket says 172.21.15.87:33656) 2024-05-08T18:31:20.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.074+0000 7f37fcc53640 1 -- 172.21.15.87:0/2384344858 learned_addr learned my addr 172.21.15.87:0/2384344858 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.074+0000 7f37fcc53640 1 -- 172.21.15.87:0/2384344858 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d4447c140 con 0x563d4447b7e0 2024-05-08T18:31:20.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.074+0000 7f37fcc53640 1 --2- 172.21.15.87:0/2384344858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d4447b7e0 0x563d4447bc00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x563d444616e0 tx=0x7f37f40178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.074+0000 7f36e1ffb640 1 -- 172.21.15.87:0/2384344858 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f4013440 con 0x563d4447b7e0 2024-05-08T18:31:20.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.074+0000 7f36e1ffb640 1 -- 172.21.15.87:0/2384344858 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f40135e0 con 0x563d4447b7e0 2024-05-08T18:31:20.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.074+0000 7f3800723800 1 -- 172.21.15.87:0/2384344858 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d4447cbb0 con 0x563d4447b7e0 2024-05-08T18:31:20.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.074+0000 7f36e1ffb640 1 -- 172.21.15.87:0/2384344858 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f40138c0 con 0x563d4447b7e0 2024-05-08T18:31:20.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.074+0000 7f3800723800 1 -- 172.21.15.87:0/2384344858 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d4447d0b0 con 0x563d4447b7e0 2024-05-08T18:31:20.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.075+0000 7f36e1ffb640 1 -- 172.21.15.87:0/2384344858 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f37f4011040 con 0x563d4447b7e0 2024-05-08T18:31:20.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.075+0000 7f36e1ffb640 1 --2- 172.21.15.87:0/2384344858 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f36d403bb50 0x7f36d403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.075+0000 7f36e1ffb640 1 -- 172.21.15.87:0/2384344858 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f37f401d070 con 0x563d4447b7e0 2024-05-08T18:31:20.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.075+0000 7f37fc452640 1 --2- 172.21.15.87:0/2384344858 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f36d403bb50 0x7f36d403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.076+0000 7f3800723800 1 Processor -- start 2024-05-08T18:31:20.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.076+0000 7f37fc452640 1 --2- 172.21.15.87:0/2384344858 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f36d403bb50 0x7f36d403e010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f37ec01dfd0 tx=0x7f37ec00ef30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.076+0000 7f3800723800 1 -- start start 2024-05-08T18:31:20.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.076+0000 7f3800723800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d44488ad0 0x563d44488ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.076+0000 7f3800723800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563d444590c0 con 0x563d44488ad0 2024-05-08T18:31:20.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.076+0000 7f37fcc53640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d44488ad0 0x563d44488ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.076+0000 7f37fcc53640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d44488ad0 0x563d44488ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33662/0 (socket says 172.21.15.87:33662) 2024-05-08T18:31:20.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.076+0000 7f37fcc53640 1 -- 172.21.15.87:0/1236584629 learned_addr learned my addr 172.21.15.87:0/1236584629 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.076+0000 7f37fcc53640 1 -- 172.21.15.87:0/1236584629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d444894c0 con 0x563d44488ad0 2024-05-08T18:31:20.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.077+0000 7f37fcc53640 1 --2- 172.21.15.87:0/1236584629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d44488ad0 0x563d44488ef0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f37f40529a0 tx=0x7f37f4001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875eea20b340a54b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.077+0000 7f36db7fe640 1 -- 172.21.15.87:0/1236584629 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f40540d0 con 0x563d44488ad0 2024-05-08T18:31:20.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.077+0000 7f36db7fe640 1 -- 172.21.15.87:0/1236584629 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f4054270 con 0x563d44488ad0 2024-05-08T18:31:20.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.077+0000 7f36db7fe640 1 -- 172.21.15.87:0/1236584629 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f4001660 con 0x563d44488ad0 2024-05-08T18:31:20.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.077+0000 7f3800723800 1 -- 172.21.15.87:0/1236584629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d44488ad0 msgr2=0x563d44488ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.077+0000 7f3800723800 1 --2- 172.21.15.87:0/1236584629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d44488ad0 0x563d44488ef0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f37f40529a0 tx=0x7f37f4001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:20.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.077+0000 7f3800723800 1 -- 172.21.15.87:0/1236584629 shutdown_connections 2024-05-08T18:31:20.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.077+0000 7f3800723800 1 --2- 172.21.15.87:0/1236584629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d44488ad0 0x563d44488ef0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.077+0000 7f3800723800 1 -- 172.21.15.87:0/1236584629 >> 172.21.15.87:0/1236584629 conn(0x563d44484e80 msgr2=0x563d44482ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.077+0000 7f3800723800 1 -- 172.21.15.87:0/1236584629 shutdown_connections 2024-05-08T18:31:20.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.077+0000 7f3800723800 1 -- 172.21.15.87:0/1236584629 wait complete. 2024-05-08T18:31:20.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.077+0000 7f3800723800 1 Processor -- start 2024-05-08T18:31:20.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.078+0000 7f3800723800 1 -- start start 2024-05-08T18:31:20.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.078+0000 7f3800723800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d44488ad0 0x563d44490070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.078+0000 7f3800723800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563d44489c20 con 0x563d44488ad0 2024-05-08T18:31:20.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.078+0000 7f37fcc53640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d44488ad0 0x563d44490070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.078+0000 7f37fcc53640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d44488ad0 0x563d44490070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33670/0 (socket says 172.21.15.87:33670) 2024-05-08T18:31:20.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.078+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 learned_addr learned my addr 172.21.15.87:0/941663245 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.078+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d444905b0 con 0x563d44488ad0 2024-05-08T18:31:20.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.078+0000 7f37fcc53640 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d44488ad0 0x563d44490070 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f37f40517f0 tx=0x7f37f4052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.078+0000 7f36d9ffb640 1 -- 172.21.15.87:0/941663245 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f4030020 con 0x563d44488ad0 2024-05-08T18:31:20.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.078+0000 7f36d9ffb640 1 -- 172.21.15.87:0/941663245 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f4015ad0 con 0x563d44488ad0 2024-05-08T18:31:20.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.078+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d44490840 con 0x563d44488ad0 2024-05-08T18:31:20.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.078+0000 7f36d9ffb640 1 -- 172.21.15.87:0/941663245 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f4015430 con 0x563d44488ad0 2024-05-08T18:31:20.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.078+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d444934f0 con 0x563d44488ad0 2024-05-08T18:31:20.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.079+0000 7f36d9ffb640 1 -- 172.21.15.87:0/941663245 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f37f4033020 con 0x563d44488ad0 2024-05-08T18:31:20.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.079+0000 7f36d9ffb640 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f36cc03bb00 0x7f36cc03dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.079+0000 7f36d9ffb640 1 -- 172.21.15.87:0/941663245 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f37f400e040 con 0x563d44488ad0 2024-05-08T18:31:20.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.079+0000 7f37fc452640 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f36cc03bb00 0x7f36cc03dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.080+0000 7f3800723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.080+0000 7f3800723800 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563d4449bc30 0x563d4449e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.080+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d4449e840 con 0x563d4449bc30 2024-05-08T18:31:20.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.080+0000 7f37f3c51640 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563d4449bc30 0x563d4449e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.080+0000 7f37fc452640 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f36cc03bb00 0x7f36cc03dfc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00c860 tx=0x7f37ec035000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.080+0000 7f37f3c51640 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563d4449bc30 0x563d4449e0f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.080+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.080+0000 7f3800723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.080+0000 7f3800723800 20 realm 2024-05-08T18:31:20.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.080+0000 7f3800723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.080+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d4449ec10 con 0x563d4449bc30 2024-05-08T18:31:20.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f3800723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f3800723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:20.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f3800723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d4449f4e0 con 0x563d4449bc30 2024-05-08T18:31:20.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f3800723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f3800723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d4449f880 con 0x563d4449bc30 2024-05-08T18:31:20.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f3800723800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:20.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f3800723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d4449fce0 con 0x563d4449bc30 2024-05-08T18:31:20.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f3800723800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:20.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f3800723800 20 searching for the correct realm 2024-05-08T18:31:20.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f3800723800 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563d444a1ce0 0x563d444a40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x563d444a1ce0 2024-05-08T18:31:20.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.081+0000 7f37fcc53640 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563d444a1ce0 0x563d444a40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.082+0000 7f37fcc53640 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563d444a1ce0 0x563d444a40f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.082+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4029070 con 0x563d444a1ce0 2024-05-08T18:31:20.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.082+0000 7f37fcc53640 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f37f4035020 0x7f37f40408a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.082+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x7f37f4035020 2024-05-08T18:31:20.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.082+0000 7f37fc452640 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f37f4035020 0x7f37f40408a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.083+0000 7f37fc452640 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f37f4035020 0x7f37f40408a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.083+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.083+0000 7f37fc452640 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f37ec02c060 0x7f37ec02b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.083+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x7f37ec02c060 2024-05-08T18:31:20.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.083+0000 7f37f3c51640 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f37ec02c060 0x7f37ec02b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.084+0000 7f37f3c51640 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f37ec02c060 0x7f37ec02b580 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.084+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.084+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x563d4449bc30 2024-05-08T18:31:20.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.084+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.084+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x563d4449bc30 2024-05-08T18:31:20.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.084+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.084+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x7f37ec02c060 2024-05-08T18:31:20.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.085+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.085+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x7f37ec02c060 2024-05-08T18:31:20.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.085+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.085+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x7f37f4035020 2024-05-08T18:31:20.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.085+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.085+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x563d444a1ce0 2024-05-08T18:31:20.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.085+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4029070 con 0x563d444a1ce0 2024-05-08T18:31:20.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.085+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x563d4449bc30 2024-05-08T18:31:20.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.086+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.086+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x7f37ec02c060 2024-05-08T18:31:20.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.086+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.086+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x563d4449bc30 2024-05-08T18:31:20.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.086+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.086+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x7f37f4035020 2024-05-08T18:31:20.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.086+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.086+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x563d444a1ce0 2024-05-08T18:31:20.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.087+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.087+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x563d444a1ce0 2024-05-08T18:31:20.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.087+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.087+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x7f37ec02c060 2024-05-08T18:31:20.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.087+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.087+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x563d444a1ce0 2024-05-08T18:31:20.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.087+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.087+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x563d444a1ce0 2024-05-08T18:31:20.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.088+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.088+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x563d4449bc30 2024-05-08T18:31:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.088+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.088+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x563d4449bc30 2024-05-08T18:31:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.088+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.088+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x7f37ec02c060 2024-05-08T18:31:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.088+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.088+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x563d444a1ce0 2024-05-08T18:31:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.089+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.089+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x7f37f4035020 2024-05-08T18:31:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.089+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.089+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x563d4449bc30 2024-05-08T18:31:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.089+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.089+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x7f37ec02c060 2024-05-08T18:31:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.089+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.089+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x563d444a1ce0 2024-05-08T18:31:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.090+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.090+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x7f37ec02c060 2024-05-08T18:31:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.090+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.090+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x7f37f4035020 2024-05-08T18:31:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.090+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.090+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x563d444a1ce0 2024-05-08T18:31:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.090+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.090+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x7f37ec02c060 2024-05-08T18:31:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.091+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.091+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x563d4449bc30 2024-05-08T18:31:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a47c0 con 0x7f37f4035020 2024-05-08T18:31:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f3800723800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:20.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f3800723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:20.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f3800723800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:20.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f3800723800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:20.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f3800723800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:20.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f3800723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:20.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f3800723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d444a07b0 con 0x563d4449bc30 2024-05-08T18:31:20.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f3800723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f3800723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d444a1050 con 0x563d4449bc30 2024-05-08T18:31:20.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f3800723800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:20.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f3800723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.092+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d444a03f0 con 0x7f37ec02c060 2024-05-08T18:31:20.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:20.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 20 zone default found 2024-05-08T18:31:20.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 4 Realm: () 2024-05-08T18:31:20.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:20.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:20.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:20.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 20 zonegroup default 2024-05-08T18:31:20.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d444a4c90 con 0x7f37ec02c060 2024-05-08T18:31:20.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d444a6b20 con 0x563d444a1ce0 2024-05-08T18:31:20.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d444a6ec0 con 0x563d444a1ce0 2024-05-08T18:31:20.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 20 started sync module instance, tier type = 2024-05-08T18:31:20.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:20.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.093+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444a5f60 con 0x7f37f4035020 2024-05-08T18:31:20.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.094+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.094+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94821138719568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444a6770 con 0x7f37f4035020 2024-05-08T18:31:20.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.094+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444a7d30 con 0x563d4449bc30 2024-05-08T18:31:20.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.095+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94821138719568] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.095+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.095+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94821138724992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444a8150 con 0x563d4449bc30 2024-05-08T18:31:20.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.096+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444a8b10 con 0x563d444a1ce0 2024-05-08T18:31:20.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.097+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94821138724992] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.097+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.097+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94821138726048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444a80c0 con 0x563d444a1ce0 2024-05-08T18:31:20.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.097+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444a9980 con 0x7f37f4035020 2024-05-08T18:31:20.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.098+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.098+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94821138732240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444aa220 con 0x7f37f4035020 2024-05-08T18:31:20.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.098+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94821138726048] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.098+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444aacd0 con 0x563d4449bc30 2024-05-08T18:31:20.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.099+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.099+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94821138737072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444ab180 con 0x563d4449bc30 2024-05-08T18:31:20.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.099+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444abb40 con 0x7f37ec02c060 2024-05-08T18:31:20.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.099+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94821138732240] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.100+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94821138737072] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.100+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.100+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94821138738384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444ab0f0 con 0x7f37ec02c060 2024-05-08T18:31:20.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.100+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444abff0 con 0x7f37ec02c060 2024-05-08T18:31:20.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.101+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94821138738384] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.101+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.101+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94821138740880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444abf60 con 0x7f37ec02c060 2024-05-08T18:31:20.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.101+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444ac920 con 0x7f37ec02c060 2024-05-08T18:31:20.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.102+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94821138740880] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.102+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.102+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94821138741936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444acb00 con 0x7f37ec02c060 2024-05-08T18:31:20.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.102+0000 7f3800723800 20 add_watcher() i=0 2024-05-08T18:31:20.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.102+0000 7f3800723800 20 add_watcher() i=1 2024-05-08T18:31:20.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.102+0000 7f3800723800 20 add_watcher() i=2 2024-05-08T18:31:20.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.102+0000 7f3800723800 20 add_watcher() i=3 2024-05-08T18:31:20.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.102+0000 7f3800723800 20 add_watcher() i=4 2024-05-08T18:31:20.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.102+0000 7f3800723800 20 add_watcher() i=5 2024-05-08T18:31:20.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.102+0000 7f3800723800 20 add_watcher() i=6 2024-05-08T18:31:20.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.103+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94821138741936] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.103+0000 7f3800723800 20 add_watcher() i=7 2024-05-08T18:31:20.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.103+0000 7f3800723800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:20.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.103+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d444afcb0 con 0x563d4449bc30 2024-05-08T18:31:20.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.103+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.103+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94821138757184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444aca50 con 0x563d4449bc30 2024-05-08T18:31:20.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.104+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94821138757184] v27'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.104+0000 7f36b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:20.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.104+0000 7f3800723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:20.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.104+0000 7f3800723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:20.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.105+0000 7f3800723800 5 note: GC not initialized 2024-05-08T18:31:20.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.105+0000 7f36b17e2640 20 reqs_thread_entry: start 2024-05-08T18:31:20.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.105+0000 7f3800723800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:20.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.105+0000 7f3800723800 20 Filter name: none 2024-05-08T18:31:20.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.105+0000 7f3622ffd640 20 reqs_thread_entry: start 2024-05-08T18:31:20.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.105+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444e2940 con 0x563d444a1ce0 2024-05-08T18:31:20.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.106+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(62 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.106+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a8b10 con 0x563d444a1ce0 2024-05-08T18:31:20.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.106+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(63 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.106+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a8b10 con 0x563d4449bc30 2024-05-08T18:31:20.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.106+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(64 [pgnls start_epoch 27 out=49b] v27'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.106+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a1050 con 0x563d4449bc30 2024-05-08T18:31:20.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.106+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 [pgnls start_epoch 27 out=49b] v27'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.106+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444a1050 con 0x7f37f4035020 2024-05-08T18:31:20.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.107+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.107+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444aa220 con 0x563d444a1ce0 2024-05-08T18:31:20.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.107+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(67 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.107+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444aa220 con 0x563d4449bc30 2024-05-08T18:31:20.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.107+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.107+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d444aa220 con 0x563d444a1ce0 2024-05-08T18:31:20.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.107+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(69 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.107+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x7f37f4035020 2024-05-08T18:31:20.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.107+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 [pgnls start_epoch 27 out=49b] v27'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.107+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x563d444a1ce0 2024-05-08T18:31:20.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.108+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(71 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.108+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x563d4449bc30 2024-05-08T18:31:20.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.108+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(72 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.108+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x7f37ec02c060 2024-05-08T18:31:20.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.109+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(73 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.109+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x7f37ec02c060 2024-05-08T18:31:20.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.109+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(74 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.109+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x563d444a1ce0 2024-05-08T18:31:20.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.109+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(75 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.109+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x7f37ec02c060 2024-05-08T18:31:20.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.109+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(76 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.109+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x7f37ec02c060 2024-05-08T18:31:20.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.109+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(77 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.109+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x7f37ec02c060 2024-05-08T18:31:20.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.110+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(78 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.110+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x563d444a1ce0 2024-05-08T18:31:20.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.110+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(79 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.110+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x7f37f4035020 2024-05-08T18:31:20.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.110+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(80 [pgnls start_epoch 27 out=70b] v27'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.110+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x563d4449bc30 2024-05-08T18:31:20.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.110+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(81 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.110+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x563d4449bc30 2024-05-08T18:31:20.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.111+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(82 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.111+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x563d444a1ce0 2024-05-08T18:31:20.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.111+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(83 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.111+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x7f37f4035020 2024-05-08T18:31:20.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.111+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(84 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.111+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x7f37ec02c060 2024-05-08T18:31:20.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.111+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(85 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.111+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x563d4449bc30 2024-05-08T18:31:20.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.111+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(86 [pgnls start_epoch 27 out=49b] v27'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.112+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x7f37ec02c060 2024-05-08T18:31:20.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.112+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(87 [pgnls start_epoch 27 out=49b] v27'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.112+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x563d444a1ce0 2024-05-08T18:31:20.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.112+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(88 [pgnls start_epoch 27 out=127b] v27'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.112+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x7f37f4035020 2024-05-08T18:31:20.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.112+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(89 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.112+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x7f37ec02c060 2024-05-08T18:31:20.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.113+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(90 [pgnls start_epoch 27 out=49b] v27'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.113+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x563d4449bc30 2024-05-08T18:31:20.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.113+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(91 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.113+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x563d444a1ce0 2024-05-08T18:31:20.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.113+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(92 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.113+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f37f4071040 con 0x7f37f4035020 2024-05-08T18:31:20.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.113+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(93 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.113+0000 7f3800723800 20 RGWRados::pool_iterate: got myfoo 2024-05-08T18:31:20.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.113+0000 7f3800723800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 2024-05-08T18:31:20.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.114+0000 7f36b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:20.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.114+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94821138757184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444a8b10 con 0x563d4449bc30 2024-05-08T18:31:20.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.115+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94821138757184] v27'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.115+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94821138719568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444aa220 con 0x7f37f4035020 2024-05-08T18:31:20.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.116+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94821138719568] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.116+0000 7f3800723800 20 remove_watcher() i=0 2024-05-08T18:31:20.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.116+0000 7f3800723800 2 removed watcher, disabling cache 2024-05-08T18:31:20.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.116+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94821138724992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444a1050 con 0x563d4449bc30 2024-05-08T18:31:20.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.117+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94821138724992] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.117+0000 7f3800723800 20 remove_watcher() i=1 2024-05-08T18:31:20.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.117+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94821138726048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444aa220 con 0x563d444a1ce0 2024-05-08T18:31:20.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.118+0000 7f37fcc53640 1 -- 172.21.15.87:0/941663245 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94821138726048] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37f4061040 con 0x563d444a1ce0 2024-05-08T18:31:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.118+0000 7f3800723800 20 remove_watcher() i=2 2024-05-08T18:31:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.118+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94821138732240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444a1010 con 0x7f37f4035020 2024-05-08T18:31:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.119+0000 7f37fc452640 1 -- 172.21.15.87:0/941663245 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94821138732240] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37ec029030 con 0x7f37f4035020 2024-05-08T18:31:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.119+0000 7f3800723800 20 remove_watcher() i=3 2024-05-08T18:31:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.119+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94821138737072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444a1010 con 0x563d4449bc30 2024-05-08T18:31:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.120+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94821138737072] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x563d4449bc30 2024-05-08T18:31:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.120+0000 7f3800723800 20 remove_watcher() i=4 2024-05-08T18:31:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.120+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94821138738384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444a1010 con 0x7f37ec02c060 2024-05-08T18:31:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.121+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94821138738384] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.121+0000 7f3800723800 20 remove_watcher() i=5 2024-05-08T18:31:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.121+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94821138740880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444a1010 con 0x7f37ec02c060 2024-05-08T18:31:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.122+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94821138740880] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.122+0000 7f3800723800 20 remove_watcher() i=6 2024-05-08T18:31:20.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.122+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94821138741936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d444a1010 con 0x7f37ec02c060 2024-05-08T18:31:20.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.122+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94821138741936] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e405a040 con 0x7f37ec02c060 2024-05-08T18:31:20.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.122+0000 7f3800723800 20 remove_watcher() i=7 2024-05-08T18:31:20.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f37ec02c060 msgr2=0x7f37ec02b580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f37ec02c060 0x7f37ec02b580 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563d4449bc30 msgr2=0x563d4449e0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563d4449bc30 0x563d4449e0f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f37f4035020 msgr2=0x7f37f40408a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f37f4035020 0x7f37f40408a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563d444a1ce0 msgr2=0x563d444a40f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563d444a1ce0 0x563d444a40f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f36cc03bb00 msgr2=0x7f36cc03dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f36cc03bb00 0x7f36cc03dfc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00c860 tx=0x7f37ec035000 comp rx=0 tx=0).stop 2024-05-08T18:31:20.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d44488ad0 msgr2=0x563d44490070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d44488ad0 0x563d44490070 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f37f40517f0 tx=0x7f37f4052900 comp rx=0 tx=0).stop 2024-05-08T18:31:20.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f37f3c51640 1 -- 172.21.15.87:0/941663245 reap_dead start 2024-05-08T18:31:20.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 shutdown_connections 2024-05-08T18:31:20.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 --2- 172.21.15.87:0/941663245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d44488ad0 0x563d44490070 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 >> 172.21.15.87:0/941663245 conn(0x563d44484e80 msgr2=0x563d4448a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 shutdown_connections 2024-05-08T18:31:20.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 -- 172.21.15.87:0/941663245 wait complete. 2024-05-08T18:31:20.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 -- 172.21.15.87:0/2384344858 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f36d403bb50 msgr2=0x7f36d403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 --2- 172.21.15.87:0/2384344858 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f36d403bb50 0x7f36d403e010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f37ec01dfd0 tx=0x7f37ec00ef30 comp rx=0 tx=0).stop 2024-05-08T18:31:20.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 -- 172.21.15.87:0/2384344858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d4447b7e0 msgr2=0x563d4447bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 --2- 172.21.15.87:0/2384344858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d4447b7e0 0x563d4447bc00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x563d444616e0 tx=0x7f37f40178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 -- 172.21.15.87:0/2384344858 shutdown_connections 2024-05-08T18:31:20.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 --2- 172.21.15.87:0/2384344858 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f36d403bb50 0x7f36d403e010 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 --2- 172.21.15.87:0/2384344858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d4447b7e0 0x563d4447bc00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 -- 172.21.15.87:0/2384344858 >> 172.21.15.87:0/2384344858 conn(0x563d4446f880 msgr2=0x563d4446fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 -- 172.21.15.87:0/2384344858 shutdown_connections 2024-05-08T18:31:20.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.123+0000 7f3800723800 1 -- 172.21.15.87:0/2384344858 wait complete. 2024-05-08T18:31:20.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.124+0000 7f3800723800 1 -- 172.21.15.87:0/4037669529 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563d4446ac70 msgr2=0x563d4446d060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.124+0000 7f3800723800 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563d4446ac70 0x563d4446d060 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.124+0000 7f3800723800 1 -- 172.21.15.87:0/4037669529 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563d4436ba30 msgr2=0x563d44467520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.124+0000 7f3800723800 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563d4436ba30 0x563d44467520 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.124+0000 7f3800723800 1 -- 172.21.15.87:0/4037669529 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f36e403bb50 msgr2=0x7f36e403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.124+0000 7f3800723800 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f36e403bb50 0x7f36e403e010 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f37e4054000 tx=0x7f37e404e000 comp rx=0 tx=0).stop 2024-05-08T18:31:20.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.124+0000 7f3800723800 1 -- 172.21.15.87:0/4037669529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d443657e0 msgr2=0x563d444602e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.124+0000 7f3800723800 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d443657e0 0x563d444602e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f37ec004000 tx=0x7f37ec000bc0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.124+0000 7f3800723800 1 -- 172.21.15.87:0/4037669529 shutdown_connections 2024-05-08T18:31:20.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.124+0000 7f3800723800 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563d4436ba30 0x563d44467520 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.124+0000 7f3800723800 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563d4446ac70 0x563d4446d060 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.124+0000 7f3800723800 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f36e403bb50 0x7f36e403e010 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.124+0000 7f3800723800 1 --2- 172.21.15.87:0/4037669529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d443657e0 0x563d444602e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.124+0000 7f3800723800 1 -- 172.21.15.87:0/4037669529 >> 172.21.15.87:0/4037669529 conn(0x563d4435ee90 msgr2=0x563d44452890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.124+0000 7f3800723800 1 -- 172.21.15.87:0/4037669529 shutdown_connections 2024-05-08T18:31:20.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.124+0000 7f3800723800 1 -- 172.21.15.87:0/4037669529 wait complete. 2024-05-08T18:31:20.137 INFO:teuthology.orchestra.run.smithi087.stdout:["myfoo"] 2024-05-08T18:31:20.137 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-05-08T18:31:20.147 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:20.157 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:20.166 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:20.215 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-05-08T18:31:20.240 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:20.266 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:20.292 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:20.293 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:31:20.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:31:20.293 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-08T18:31:20.337 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:20.337 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:20.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.340+0000 7f2bae487800 1 Processor -- start 2024-05-08T18:31:20.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.340+0000 7f2bae487800 1 -- start start 2024-05-08T18:31:20.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.340+0000 7f2bae487800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b379d91b80 0x55b379d91fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.340+0000 7f2bae487800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b379d06ec0 con 0x55b379d924e0 2024-05-08T18:31:20.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.340+0000 7f2bae487800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b379c33e20 con 0x55b379d91b80 2024-05-08T18:31:20.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.340+0000 7f2babf7f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b379d91b80 0x55b379d91fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.340+0000 7f2babf7f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b379d91b80 0x55b379d91fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33686/0 (socket says 172.21.15.87:33686) 2024-05-08T18:31:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.340+0000 7f2bab77e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55b379d924e0 0x55b379d92990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42064/0 (socket says 172.21.15.87:42064) 2024-05-08T18:31:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.340+0000 7f2babf7f640 1 -- 172.21.15.87:0/3609828951 learned_addr learned my addr 172.21.15.87:0/3609828951 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.341+0000 7f2babf7f640 1 -- 172.21.15.87:0/3609828951 >> v1:172.21.15.53:6789/0 conn(0x55b379d924e0 legacy=0x55b379d92990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.341+0000 7f2babf7f640 1 -- 172.21.15.87:0/3609828951 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b379d930a0 con 0x55b379d91b80 2024-05-08T18:31:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.342+0000 7f2babf7f640 1 --2- 172.21.15.87:0/3609828951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 0x55b379d91fa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4005fd0 tx=0x7f2ba401cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b3456da05c2672 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.343+0000 7f2baaf7d640 1 -- 172.21.15.87:0/3609828951 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ba4052540 con 0x55b379d91b80 2024-05-08T18:31:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.343+0000 7f2baaf7d640 1 -- 172.21.15.87:0/3609828951 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba404e070 con 0x55b379d91b80 2024-05-08T18:31:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.343+0000 7f2baaf7d640 1 -- 172.21.15.87:0/3609828951 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ba4052890 con 0x55b379d91b80 2024-05-08T18:31:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.343+0000 7f2bae487800 1 -- 172.21.15.87:0/3609828951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 msgr2=0x55b379d91fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.343+0000 7f2bae487800 1 --2- 172.21.15.87:0/3609828951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 0x55b379d91fa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4005fd0 tx=0x7f2ba401cd80 comp rx=0 tx=0).stop 2024-05-08T18:31:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.343+0000 7f2bae487800 1 -- 172.21.15.87:0/3609828951 shutdown_connections 2024-05-08T18:31:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.343+0000 7f2bae487800 1 --2- 172.21.15.87:0/3609828951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 0x55b379d91fa0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.343+0000 7f2bae487800 1 -- 172.21.15.87:0/3609828951 >> 172.21.15.87:0/3609828951 conn(0x55b379d8d6a0 msgr2=0x55b379d8fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.343+0000 7f2bae487800 1 -- 172.21.15.87:0/3609828951 shutdown_connections 2024-05-08T18:31:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.343+0000 7f2bae487800 1 -- 172.21.15.87:0/3609828951 wait complete. 2024-05-08T18:31:20.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.357+0000 7f2bae487800 1 Processor -- start 2024-05-08T18:31:20.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.357+0000 7f2bae487800 1 -- start start 2024-05-08T18:31:20.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.357+0000 7f2bae487800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 0x55b379e86a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.357+0000 7f2bae487800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b379cde5b0 con 0x55b379d91b80 2024-05-08T18:31:20.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.357+0000 7f2babf7f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 0x55b379e86a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.358+0000 7f2babf7f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 0x55b379e86a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33700/0 (socket says 172.21.15.87:33700) 2024-05-08T18:31:20.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.358+0000 7f2babf7f640 1 -- 172.21.15.87:0/596260149 learned_addr learned my addr 172.21.15.87:0/596260149 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.358+0000 7f2babf7f640 1 -- 172.21.15.87:0/596260149 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b379e86fe0 con 0x55b379d91b80 2024-05-08T18:31:20.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.358+0000 7f2babf7f640 1 --2- 172.21.15.87:0/596260149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 0x55b379e86a10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400a190 tx=0x7f2ba404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64e7052d62abfc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.358+0000 7f2a99e0b640 1 -- 172.21.15.87:0/596260149 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ba4052410 con 0x55b379d91b80 2024-05-08T18:31:20.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.358+0000 7f2a99e0b640 1 -- 172.21.15.87:0/596260149 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba4062070 con 0x55b379d91b80 2024-05-08T18:31:20.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.358+0000 7f2a99e0b640 1 -- 172.21.15.87:0/596260149 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ba4052700 con 0x55b379d91b80 2024-05-08T18:31:20.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.359+0000 7f2bae487800 1 -- 172.21.15.87:0/596260149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 msgr2=0x55b379e86a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.359+0000 7f2bae487800 1 --2- 172.21.15.87:0/596260149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 0x55b379e86a10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400a190 tx=0x7f2ba404c000 comp rx=0 tx=0).stop 2024-05-08T18:31:20.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.359+0000 7f2bae487800 1 -- 172.21.15.87:0/596260149 shutdown_connections 2024-05-08T18:31:20.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.359+0000 7f2bae487800 1 --2- 172.21.15.87:0/596260149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 0x55b379e86a10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.359+0000 7f2bae487800 1 -- 172.21.15.87:0/596260149 >> 172.21.15.87:0/596260149 conn(0x55b379d8d6a0 msgr2=0x55b379e82330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.359+0000 7f2bae487800 1 -- 172.21.15.87:0/596260149 shutdown_connections 2024-05-08T18:31:20.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.359+0000 7f2bae487800 1 -- 172.21.15.87:0/596260149 wait complete. 2024-05-08T18:31:20.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.359+0000 7f2bae487800 1 Processor -- start 2024-05-08T18:31:20.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.359+0000 7f2bae487800 1 -- start start 2024-05-08T18:31:20.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.359+0000 7f2bae487800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 0x55b379e8e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.359+0000 7f2bae487800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b379d935d0 con 0x55b379d91b80 2024-05-08T18:31:20.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.360+0000 7f2babf7f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 0x55b379e8e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.360+0000 7f2babf7f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 0x55b379e8e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33710/0 (socket says 172.21.15.87:33710) 2024-05-08T18:31:20.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.360+0000 7f2babf7f640 1 -- 172.21.15.87:0/1043661764 learned_addr learned my addr 172.21.15.87:0/1043661764 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.360+0000 7f2babf7f640 1 -- 172.21.15.87:0/1043661764 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b379e8ea10 con 0x55b379d91b80 2024-05-08T18:31:20.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.360+0000 7f2babf7f640 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 0x55b379e8e4d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4000f80 tx=0x7f2ba4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.360+0000 7f2a93fff640 1 -- 172.21.15.87:0/1043661764 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ba405d630 con 0x55b379d91b80 2024-05-08T18:31:20.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.360+0000 7f2bae487800 1 -- 172.21.15.87:0/1043661764 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b379e8eca0 con 0x55b379d91b80 2024-05-08T18:31:20.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.360+0000 7f2a93fff640 1 -- 172.21.15.87:0/1043661764 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba4058040 con 0x55b379d91b80 2024-05-08T18:31:20.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.360+0000 7f2a93fff640 1 -- 172.21.15.87:0/1043661764 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ba405d900 con 0x55b379d91b80 2024-05-08T18:31:20.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.360+0000 7f2bae487800 1 -- 172.21.15.87:0/1043661764 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b379e918b0 con 0x55b379d91b80 2024-05-08T18:31:20.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.361+0000 7f2a93fff640 1 -- 172.21.15.87:0/1043661764 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2ba4050070 con 0x55b379d91b80 2024-05-08T18:31:20.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.361+0000 7f2a93fff640 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2a9403bb50 0x7f2a9403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.361+0000 7f2a93fff640 1 -- 172.21.15.87:0/1043661764 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f2ba4094be0 con 0x55b379d91b80 2024-05-08T18:31:20.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.361+0000 7f2bab77e640 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2a9403bb50 0x7f2a9403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.361+0000 7f2bae487800 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b379d924e0 0x55b379e95670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.361+0000 7f2bae487800 1 -- 172.21.15.87:0/1043661764 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379e95bf0 con 0x55b379d924e0 2024-05-08T18:31:20.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.362+0000 7f2bac780640 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b379d924e0 0x55b379e95670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.362+0000 7f2bab77e640 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2a9403bb50 0x7f2a9403e010 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2b94000f60 tx=0x7f2b94001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.362+0000 7f2bac780640 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b379d924e0 0x55b379e95670 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.362+0000 7f2bac780640 1 -- 172.21.15.87:0/1043661764 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b9c0083e0 con 0x55b379d924e0 2024-05-08T18:31:20.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.362+0000 7f2bae487800 1 -- 172.21.15.87:0/1043661764 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379e92c20 con 0x55b379d924e0 2024-05-08T18:31:20.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.362+0000 7f2bac780640 1 -- 172.21.15.87:0/1043661764 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b9c0083e0 con 0x55b379d924e0 2024-05-08T18:31:20.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.363+0000 7f2bae487800 1 -- 172.21.15.87:0/1043661764 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379e97a60 con 0x55b379d924e0 2024-05-08T18:31:20.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.363+0000 7f2bac780640 1 -- 172.21.15.87:0/1043661764 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2b9c0083e0 con 0x55b379d924e0 2024-05-08T18:31:20.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.363+0000 7f2bae487800 1 -- 172.21.15.87:0/1043661764 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379e96c90 con 0x55b379d924e0 2024-05-08T18:31:20.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.363+0000 7f2bac780640 1 -- 172.21.15.87:0/1043661764 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b9c0083e0 con 0x55b379d924e0 2024-05-08T18:31:20.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.363+0000 7f2bae487800 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b379e98e10 0x55b379e9b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.363+0000 7f2bae487800 1 -- 172.21.15.87:0/1043661764 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379e9b740 con 0x55b379e98e10 2024-05-08T18:31:20.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.363+0000 7f2babf7f640 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b379e98e10 0x55b379e9b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.364+0000 7f2babf7f640 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b379e98e10 0x55b379e9b200 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.364+0000 7f2babf7f640 1 -- 172.21.15.87:0/1043661764 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2ba4077020 con 0x55b379e98e10 2024-05-08T18:31:20.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.364+0000 7f2bae487800 1 Processor -- start 2024-05-08T18:31:20.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.364+0000 7f2bae487800 1 -- start start 2024-05-08T18:31:20.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.364+0000 7f2bae487800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379ea99c0 0x55b379ea9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.364+0000 7f2bae487800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b379c84fc0 con 0x55b379ea99c0 2024-05-08T18:31:20.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.364+0000 7f2bac780640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379ea99c0 0x55b379ea9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.364+0000 7f2bac780640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379ea99c0 0x55b379ea9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33714/0 (socket says 172.21.15.87:33714) 2024-05-08T18:31:20.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.364+0000 7f2bac780640 1 -- 172.21.15.87:0/3493929142 learned_addr learned my addr 172.21.15.87:0/3493929142 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.365+0000 7f2bac780640 1 -- 172.21.15.87:0/3493929142 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b379eaa320 con 0x55b379ea99c0 2024-05-08T18:31:20.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.365+0000 7f2bac780640 1 --2- 172.21.15.87:0/3493929142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379ea99c0 0x55b379ea9de0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55b379e8f650 tx=0x7f2b9c00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.365+0000 7f2a917fa640 1 -- 172.21.15.87:0/3493929142 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c01c070 con 0x55b379ea99c0 2024-05-08T18:31:20.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.365+0000 7f2a917fa640 1 -- 172.21.15.87:0/3493929142 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b9c018410 con 0x55b379ea99c0 2024-05-08T18:31:20.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.365+0000 7f2bae487800 1 -- 172.21.15.87:0/3493929142 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b379eaad90 con 0x55b379ea99c0 2024-05-08T18:31:20.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.365+0000 7f2a917fa640 1 -- 172.21.15.87:0/3493929142 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c018730 con 0x55b379ea99c0 2024-05-08T18:31:20.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.365+0000 7f2bae487800 1 -- 172.21.15.87:0/3493929142 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b379eab290 con 0x55b379ea99c0 2024-05-08T18:31:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.366+0000 7f2a917fa640 1 -- 172.21.15.87:0/3493929142 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2b9c01f070 con 0x55b379ea99c0 2024-05-08T18:31:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.366+0000 7f2a917fa640 1 --2- 172.21.15.87:0/3493929142 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2a8403bb50 0x7f2a8403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.366+0000 7f2a917fa640 1 -- 172.21.15.87:0/3493929142 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f2b9c0545f0 con 0x55b379ea99c0 2024-05-08T18:31:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.366+0000 7f2babf7f640 1 --2- 172.21.15.87:0/3493929142 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2a8403bb50 0x7f2a8403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.366+0000 7f2bae487800 1 Processor -- start 2024-05-08T18:31:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.367+0000 7f2babf7f640 1 --2- 172.21.15.87:0/3493929142 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2a8403bb50 0x7f2a8403e010 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4052c60 tx=0x7f2ba4065400 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.367+0000 7f2bae487800 1 -- start start 2024-05-08T18:31:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.367+0000 7f2bae487800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379eb6d10 0x55b379eb7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.367+0000 7f2bae487800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b379e872a0 con 0x55b379eb6d10 2024-05-08T18:31:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.367+0000 7f2bac780640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379eb6d10 0x55b379eb7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.367+0000 7f2bac780640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379eb6d10 0x55b379eb7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33730/0 (socket says 172.21.15.87:33730) 2024-05-08T18:31:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.367+0000 7f2bac780640 1 -- 172.21.15.87:0/3866995362 learned_addr learned my addr 172.21.15.87:0/3866995362 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.367+0000 7f2bac780640 1 -- 172.21.15.87:0/3866995362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b379eb7700 con 0x55b379eb6d10 2024-05-08T18:31:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.367+0000 7f2bac780640 1 --2- 172.21.15.87:0/3866995362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379eb6d10 0x55b379eb7130 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c014fd0 tx=0x7f2b9c016f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1517233e6fb982da server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.367+0000 7f2a8affd640 1 -- 172.21.15.87:0/3866995362 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c007c20 con 0x55b379eb6d10 2024-05-08T18:31:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.367+0000 7f2a8affd640 1 -- 172.21.15.87:0/3866995362 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b9c007dc0 con 0x55b379eb6d10 2024-05-08T18:31:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.367+0000 7f2a8affd640 1 -- 172.21.15.87:0/3866995362 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c052c50 con 0x55b379eb6d10 2024-05-08T18:31:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.368+0000 7f2bae487800 1 -- 172.21.15.87:0/3866995362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379eb6d10 msgr2=0x55b379eb7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.368+0000 7f2bae487800 1 --2- 172.21.15.87:0/3866995362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379eb6d10 0x55b379eb7130 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c014fd0 tx=0x7f2b9c016f60 comp rx=0 tx=0).stop 2024-05-08T18:31:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.368+0000 7f2bae487800 1 -- 172.21.15.87:0/3866995362 shutdown_connections 2024-05-08T18:31:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.368+0000 7f2bae487800 1 --2- 172.21.15.87:0/3866995362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379eb6d10 0x55b379eb7130 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.368+0000 7f2bae487800 1 -- 172.21.15.87:0/3866995362 >> 172.21.15.87:0/3866995362 conn(0x55b379eb30c0 msgr2=0x55b379eb1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.368+0000 7f2bae487800 1 -- 172.21.15.87:0/3866995362 shutdown_connections 2024-05-08T18:31:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.368+0000 7f2bae487800 1 -- 172.21.15.87:0/3866995362 wait complete. 2024-05-08T18:31:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.368+0000 7f2bae487800 1 Processor -- start 2024-05-08T18:31:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.368+0000 7f2bae487800 1 -- start start 2024-05-08T18:31:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.368+0000 7f2bae487800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379eb6d10 0x55b379ebe2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.368+0000 7f2bae487800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b379eb7e60 con 0x55b379eb6d10 2024-05-08T18:31:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.368+0000 7f2bac780640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379eb6d10 0x55b379ebe2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.369+0000 7f2bac780640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379eb6d10 0x55b379ebe2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33742/0 (socket says 172.21.15.87:33742) 2024-05-08T18:31:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.369+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 learned_addr learned my addr 172.21.15.87:0/780492815 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.369+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b379ebe830 con 0x55b379eb6d10 2024-05-08T18:31:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.369+0000 7f2bac780640 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379eb6d10 0x55b379ebe2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c007fb0 tx=0x7f2b9c052970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.369+0000 7f2a897fa640 1 -- 172.21.15.87:0/780492815 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c017a00 con 0x55b379eb6d10 2024-05-08T18:31:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.369+0000 7f2a897fa640 1 -- 172.21.15.87:0/780492815 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b9c0512d0 con 0x55b379eb6d10 2024-05-08T18:31:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.369+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b379ebeac0 con 0x55b379eb6d10 2024-05-08T18:31:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.369+0000 7f2a897fa640 1 -- 172.21.15.87:0/780492815 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c0515f0 con 0x55b379eb6d10 2024-05-08T18:31:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.369+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b379ec1770 con 0x55b379eb6d10 2024-05-08T18:31:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.370+0000 7f2a897fa640 1 -- 172.21.15.87:0/780492815 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2b9c0189a0 con 0x55b379eb6d10 2024-05-08T18:31:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.370+0000 7f2a897fa640 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2a7403bb50 0x7f2a7403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.370+0000 7f2a897fa640 1 -- 172.21.15.87:0/780492815 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f2b9c049030 con 0x55b379eb6d10 2024-05-08T18:31:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.370+0000 7f2babf7f640 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2a7403bb50 0x7f2a7403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.370+0000 7f2bae487800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.371+0000 7f2bae487800 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b379ec9d70 0x55b379ecc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.371+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379ecc980 con 0x55b379ec9d70 2024-05-08T18:31:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.371+0000 7f2bab77e640 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b379ec9d70 0x55b379ecc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.371+0000 7f2babf7f640 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2a7403bb50 0x7f2a7403e010 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55b379e979f0 tx=0x7f2ba4089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.371+0000 7f2bab77e640 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b379ec9d70 0x55b379ecc230 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.371+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.371+0000 7f2bae487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.371+0000 7f2bae487800 20 realm 2024-05-08T18:31:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.371+0000 7f2bae487800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.371+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379ec9200 con 0x55b379ec9d70 2024-05-08T18:31:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.371+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.371+0000 7f2bae487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.371+0000 7f2bae487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.371+0000 7f2bae487800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.372+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379ecd480 con 0x55b379ec9d70 2024-05-08T18:31:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.372+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.372+0000 7f2bae487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.372+0000 7f2bae487800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.372+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379ecdd50 con 0x55b379ec9d70 2024-05-08T18:31:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.372+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.372+0000 7f2bae487800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.372+0000 7f2bae487800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.372+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379ece0f0 con 0x55b379ec9d70 2024-05-08T18:31:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.372+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.372+0000 7f2bae487800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.372+0000 7f2bae487800 20 searching for the correct realm 2024-05-08T18:31:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.372+0000 7f2bae487800 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b379ecffd0 0x55b379ed23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.372+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x55b379ecffd0 2024-05-08T18:31:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.372+0000 7f2bac780640 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b379ecffd0 0x55b379ed23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.373+0000 7f2bac780640 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b379ecffd0 0x55b379ed23c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.373+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.373+0000 7f2bac780640 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f2b9c021070 0x7f2b9c054990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.373+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x7f2b9c021070 2024-05-08T18:31:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.373+0000 7f2babf7f640 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f2b9c021070 0x7f2b9c054990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.373+0000 7f2babf7f640 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f2b9c021070 0x7f2b9c054990 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.374+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ba4077020 con 0x7f2b9c021070 2024-05-08T18:31:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.374+0000 7f2babf7f640 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2ba40a1040 0x7f2ba408c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.374+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x7f2ba40a1040 2024-05-08T18:31:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.374+0000 7f2bab77e640 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2ba40a1040 0x7f2ba408c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.374+0000 7f2bab77e640 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2ba40a1040 0x7f2ba408c530 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.375+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.375+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x55b379ec9d70 2024-05-08T18:31:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.375+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.375+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x55b379ec9d70 2024-05-08T18:31:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.375+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.375+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x7f2ba40a1040 2024-05-08T18:31:20.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.375+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.375+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x7f2ba40a1040 2024-05-08T18:31:20.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.376+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.376+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x7f2b9c021070 2024-05-08T18:31:20.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.376+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ba4077020 con 0x7f2b9c021070 2024-05-08T18:31:20.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.376+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x55b379ecffd0 2024-05-08T18:31:20.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.376+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.376+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x55b379ec9d70 2024-05-08T18:31:20.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.376+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.376+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x7f2ba40a1040 2024-05-08T18:31:20.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.377+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.377+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x55b379ec9d70 2024-05-08T18:31:20.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.377+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.377+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x7f2b9c021070 2024-05-08T18:31:20.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.377+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2ba4077020 con 0x7f2b9c021070 2024-05-08T18:31:20.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.377+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x55b379ecffd0 2024-05-08T18:31:20.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.377+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.377+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x55b379ecffd0 2024-05-08T18:31:20.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.378+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.378+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x7f2ba40a1040 2024-05-08T18:31:20.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.378+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.378+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x55b379ecffd0 2024-05-08T18:31:20.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.379+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.379+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x55b379ecffd0 2024-05-08T18:31:20.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.379+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.379+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x55b379ec9d70 2024-05-08T18:31:20.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.379+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.379+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x55b379ec9d70 2024-05-08T18:31:20.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.379+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.379+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x7f2ba40a1040 2024-05-08T18:31:20.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.379+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.380+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x55b379ecffd0 2024-05-08T18:31:20.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.380+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.380+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x7f2b9c021070 2024-05-08T18:31:20.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.380+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ba4077020 con 0x7f2b9c021070 2024-05-08T18:31:20.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.380+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x55b379ec9d70 2024-05-08T18:31:20.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.380+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.380+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x7f2ba40a1040 2024-05-08T18:31:20.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.380+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.380+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x55b379ecffd0 2024-05-08T18:31:20.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.381+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.381+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x7f2ba40a1040 2024-05-08T18:31:20.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.381+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.381+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x7f2b9c021070 2024-05-08T18:31:20.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.381+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ba4077020 con 0x7f2b9c021070 2024-05-08T18:31:20.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.381+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x55b379ecffd0 2024-05-08T18:31:20.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.381+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.381+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x7f2ba40a1040 2024-05-08T18:31:20.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.382+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.382+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x55b379ec9d70 2024-05-08T18:31:20.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.382+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.382+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2a70 con 0x7f2b9c021070 2024-05-08T18:31:20.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.382+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ba4077020 con 0x7f2b9c021070 2024-05-08T18:31:20.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.382+0000 7f2bae487800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:20.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.382+0000 7f2bae487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:20.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.382+0000 7f2bae487800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:20.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.382+0000 7f2bae487800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:20.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.382+0000 7f2bae487800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:20.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.382+0000 7f2bae487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:20.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.382+0000 7f2bae487800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.382+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379ecea70 con 0x55b379ec9d70 2024-05-08T18:31:20.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.382+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.382+0000 7f2bae487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.382+0000 7f2bae487800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.382+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379ecf310 con 0x55b379ec9d70 2024-05-08T18:31:20.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bae487800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:20.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bae487800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379ece6b0 con 0x7f2ba40a1040 2024-05-08T18:31:20.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bae487800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:20.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bae487800 20 zone default found 2024-05-08T18:31:20.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bae487800 4 Realm: () 2024-05-08T18:31:20.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bae487800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:20.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bae487800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:20.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bae487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bae487800 20 zonegroup default 2024-05-08T18:31:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bae487800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed2ed0 con 0x7f2ba40a1040 2024-05-08T18:31:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bae487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bae487800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.383+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed4d60 con 0x55b379ecffd0 2024-05-08T18:31:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.384+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.384+0000 7f2bae487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.384+0000 7f2bae487800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.384+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed5100 con 0x55b379ecffd0 2024-05-08T18:31:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.384+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.384+0000 7f2bae487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.384+0000 7f2bae487800 20 started sync module instance, tier type = 2024-05-08T18:31:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.384+0000 7f2bae487800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.384+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed41a0 con 0x7f2b9c021070 2024-05-08T18:31:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.385+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ba4077020 con 0x7f2b9c021070 2024-05-08T18:31:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.385+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94229333099968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed3e00 con 0x7f2b9c021070 2024-05-08T18:31:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.385+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed5e80 con 0x55b379ec9d70 2024-05-08T18:31:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.386+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94229333099968] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ba4077020 con 0x7f2b9c021070 2024-05-08T18:31:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.386+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.386+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94229333103776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed6270 con 0x55b379ec9d70 2024-05-08T18:31:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.386+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed6cd0 con 0x55b379ecffd0 2024-05-08T18:31:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.387+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94229333103776] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.387+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.387+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94229333108608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed6c90 con 0x55b379ecffd0 2024-05-08T18:31:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.387+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed7780 con 0x7f2b9c021070 2024-05-08T18:31:20.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.388+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94229333108608] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.388+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ba4077020 con 0x7f2b9c021070 2024-05-08T18:31:20.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.388+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94229333111440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed7b70 con 0x7f2b9c021070 2024-05-08T18:31:20.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.389+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed8570 con 0x55b379ec9d70 2024-05-08T18:31:20.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.390+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.390+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94229333115008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed8e40 con 0x55b379ec9d70 2024-05-08T18:31:20.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.390+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed9930 con 0x7f2ba40a1040 2024-05-08T18:31:20.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.390+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94229333111440] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ba4077020 con 0x7f2b9c021070 2024-05-08T18:31:20.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.391+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.391+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94229333115008] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.391+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94229333120000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed98f0 con 0x7f2ba40a1040 2024-05-08T18:31:20.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.391+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed8990 con 0x7f2ba40a1040 2024-05-08T18:31:20.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.392+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94229333120000] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.392+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.392+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94229333117328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379ed9e90 con 0x7f2ba40a1040 2024-05-08T18:31:20.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.392+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379eda850 con 0x7f2ba40a1040 2024-05-08T18:31:20.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.393+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.393+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94229333124000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379edac70 con 0x7f2ba40a1040 2024-05-08T18:31:20.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.393+0000 7f2bae487800 20 add_watcher() i=0 2024-05-08T18:31:20.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.393+0000 7f2bae487800 20 add_watcher() i=1 2024-05-08T18:31:20.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.393+0000 7f2bae487800 20 add_watcher() i=2 2024-05-08T18:31:20.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.393+0000 7f2bae487800 20 add_watcher() i=3 2024-05-08T18:31:20.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.393+0000 7f2bae487800 20 add_watcher() i=4 2024-05-08T18:31:20.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.393+0000 7f2bae487800 20 add_watcher() i=5 2024-05-08T18:31:20.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.393+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94229333117328] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.393+0000 7f2bae487800 20 add_watcher() i=6 2024-05-08T18:31:20.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.394+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94229333124000] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.394+0000 7f2bae487800 20 add_watcher() i=7 2024-05-08T18:31:20.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.394+0000 7f2bae487800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:20.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.394+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379edac70 con 0x55b379ec9d70 2024-05-08T18:31:20.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.394+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.394+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94229333125056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379edabe0 con 0x55b379ec9d70 2024-05-08T18:31:20.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.395+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94229333125056] v27'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.395+0000 7f2a61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:20.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.395+0000 7f2bae487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:20.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.395+0000 7f2bae487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:20.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.395+0000 7f2bae487800 5 note: GC not initialized 2024-05-08T18:31:20.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.395+0000 7f2a60fe1640 20 reqs_thread_entry: start 2024-05-08T18:31:20.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.395+0000 7f2bae487800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:20.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.395+0000 7f2bae487800 20 Filter name: none 2024-05-08T18:31:20.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.396+0000 7f29da7fc640 20 reqs_thread_entry: start 2024-05-08T18:31:20.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.396+0000 7f2bae487800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.396+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379f11100 con 0x7f2b9c021070 2024-05-08T18:31:20.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.396+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2ba4077020 con 0x7f2b9c021070 2024-05-08T18:31:20.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.396+0000 7f2bae487800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:20.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.396+0000 7f2bae487800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.396+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:63 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379f11ce0 con 0x55b379ecffd0 2024-05-08T18:31:20.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(63 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2bae487800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:20.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2bae487800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:31:20.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2bae487800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379f11c90 con 0x7f2b9c021070 2024-05-08T18:31:20.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2ba4077020 con 0x7f2b9c021070 2024-05-08T18:31:20.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2bae487800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:20.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2bae487800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:65 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379f11c90 con 0x55b379ecffd0 2024-05-08T18:31:20.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(65 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2bae487800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:20.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2bae487800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:31:20.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 4.3c 4:3e5af247:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379f148e0 con 0x55b379ec9d70 2024-05-08T18:31:20.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 4.13 4:c87a77a1:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379f17390 con 0x7f2b9c021070 2024-05-08T18:31:20.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:68 4.2d 4:b6c641c8:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379f19fd0 con 0x7f2ba40a1040 2024-05-08T18:31:20.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 4.8 4:106dbb9b:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379f148e0 con 0x55b379ecffd0 2024-05-08T18:31:20.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 4.28 4:146af900:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379f19fd0 con 0x55b379ec9d70 2024-05-08T18:31:20.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.397+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 4.6 4:613ec2f8:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379f148e0 con 0x55b379ecffd0 2024-05-08T18:31:20.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.398+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 4.32 4:4ef39ee1:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379f19fd0 con 0x55b379ec9d70 2024-05-08T18:31:20.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.398+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 4.1c 4:38258a38:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379f26bc0 con 0x7f2ba40a1040 2024-05-08T18:31:20.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.398+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:74 4.38 4:1e0d588e:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379f29a80 con 0x55b379ec9d70 2024-05-08T18:31:20.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.398+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 4.f 4:f0da020c:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379f2c940 con 0x55b379ec9d70 2024-05-08T18:31:20.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.398+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:76 4.1d 4:baf32667:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b379f2f7b0 con 0x55b379ecffd0 2024-05-08T18:31:20.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.398+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(67 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2ba4077020 con 0x7f2b9c021070 2024-05-08T18:31:20.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.398+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(69 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.398+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(68 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.398+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(66 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.398+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(70 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.398+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(71 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.398+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(76 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.398+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(74 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.398+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(72 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.398+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(75 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.398+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(73 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.399+0000 7f2a61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:20.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.399+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94229333125056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379f19fd0 con 0x55b379ec9d70 2024-05-08T18:31:20.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.400+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94229333125056] v27'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.400+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94229333099968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379f19fd0 con 0x7f2b9c021070 2024-05-08T18:31:20.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.401+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94229333099968] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ba4077020 con 0x7f2b9c021070 2024-05-08T18:31:20.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.401+0000 7f2bae487800 20 remove_watcher() i=0 2024-05-08T18:31:20.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.401+0000 7f2bae487800 2 removed watcher, disabling cache 2024-05-08T18:31:20.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.401+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94229333103776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379f19fd0 con 0x55b379ec9d70 2024-05-08T18:31:20.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.403+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94229333103776] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.403+0000 7f2bae487800 20 remove_watcher() i=1 2024-05-08T18:31:20.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.403+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94229333108608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379f19fd0 con 0x55b379ecffd0 2024-05-08T18:31:20.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.403+0000 7f2bac780640 1 -- 172.21.15.87:0/780492815 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94229333108608] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9c04c050 con 0x55b379ecffd0 2024-05-08T18:31:20.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.404+0000 7f2bae487800 20 remove_watcher() i=2 2024-05-08T18:31:20.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.404+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94229333111440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379f19fd0 con 0x7f2b9c021070 2024-05-08T18:31:20.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.405+0000 7f2babf7f640 1 -- 172.21.15.87:0/780492815 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94229333111440] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ba4077020 con 0x7f2b9c021070 2024-05-08T18:31:20.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.405+0000 7f2bae487800 20 remove_watcher() i=3 2024-05-08T18:31:20.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.405+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94229333115008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379f19fd0 con 0x55b379ec9d70 2024-05-08T18:31:20.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.406+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94229333115008] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x55b379ec9d70 2024-05-08T18:31:20.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.406+0000 7f2bae487800 20 remove_watcher() i=4 2024-05-08T18:31:20.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.406+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94229333120000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379f19fd0 con 0x7f2ba40a1040 2024-05-08T18:31:20.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.406+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94229333120000] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.406+0000 7f2bae487800 20 remove_watcher() i=5 2024-05-08T18:31:20.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.406+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94229333117328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379f19fd0 con 0x7f2ba40a1040 2024-05-08T18:31:20.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.407+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94229333117328] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.407+0000 7f2bae487800 20 remove_watcher() i=6 2024-05-08T18:31:20.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.407+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94229333124000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b379f19fd0 con 0x7f2ba40a1040 2024-05-08T18:31:20.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.408+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94229333124000] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b9400f610 con 0x7f2ba40a1040 2024-05-08T18:31:20.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.408+0000 7f2bae487800 20 remove_watcher() i=7 2024-05-08T18:31:20.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.408+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2ba40a1040 msgr2=0x7f2ba408c530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.408+0000 7f2bae487800 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2ba40a1040 0x7f2ba408c530 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.408+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b379ec9d70 msgr2=0x55b379ecc230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.408+0000 7f2bae487800 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b379ec9d70 0x55b379ecc230 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f2b9c021070 msgr2=0x7f2b9c054990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f2b9c021070 0x7f2b9c054990 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b379ecffd0 msgr2=0x55b379ed23c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b379ecffd0 0x55b379ed23c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2a7403bb50 msgr2=0x7f2a7403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2a7403bb50 0x7f2a7403e010 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55b379e979f0 tx=0x7f2ba4089000 comp rx=0 tx=0).stop 2024-05-08T18:31:20.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379eb6d10 msgr2=0x55b379ebe2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bab77e640 1 -- 172.21.15.87:0/780492815 reap_dead start 2024-05-08T18:31:20.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379eb6d10 0x55b379ebe2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c007fb0 tx=0x7f2b9c052970 comp rx=0 tx=0).stop 2024-05-08T18:31:20.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 shutdown_connections 2024-05-08T18:31:20.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 --2- 172.21.15.87:0/780492815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379eb6d10 0x55b379ebe2f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 >> 172.21.15.87:0/780492815 conn(0x55b379eb30c0 msgr2=0x55b379eb8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 shutdown_connections 2024-05-08T18:31:20.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 -- 172.21.15.87:0/780492815 wait complete. 2024-05-08T18:31:20.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 -- 172.21.15.87:0/3493929142 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2a8403bb50 msgr2=0x7f2a8403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 --2- 172.21.15.87:0/3493929142 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2a8403bb50 0x7f2a8403e010 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4052c60 tx=0x7f2ba4065400 comp rx=0 tx=0).stop 2024-05-08T18:31:20.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 -- 172.21.15.87:0/3493929142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379ea99c0 msgr2=0x55b379ea9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 --2- 172.21.15.87:0/3493929142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379ea99c0 0x55b379ea9de0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55b379e8f650 tx=0x7f2b9c00ef30 comp rx=0 tx=0).stop 2024-05-08T18:31:20.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 -- 172.21.15.87:0/3493929142 shutdown_connections 2024-05-08T18:31:20.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 --2- 172.21.15.87:0/3493929142 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2a8403bb50 0x7f2a8403e010 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 --2- 172.21.15.87:0/3493929142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379ea99c0 0x55b379ea9de0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 -- 172.21.15.87:0/3493929142 >> 172.21.15.87:0/3493929142 conn(0x55b379e9da60 msgr2=0x55b379e9de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 -- 172.21.15.87:0/3493929142 shutdown_connections 2024-05-08T18:31:20.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.409+0000 7f2bae487800 1 -- 172.21.15.87:0/3493929142 wait complete. 2024-05-08T18:31:20.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.410+0000 7f2bae487800 1 -- 172.21.15.87:0/1043661764 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b379e98e10 msgr2=0x55b379e9b200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.410+0000 7f2bae487800 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b379e98e10 0x55b379e9b200 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.410+0000 7f2bae487800 1 -- 172.21.15.87:0/1043661764 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b379d924e0 msgr2=0x55b379e95670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.410+0000 7f2bae487800 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b379d924e0 0x55b379e95670 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.410+0000 7f2bae487800 1 -- 172.21.15.87:0/1043661764 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2a9403bb50 msgr2=0x7f2a9403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.410+0000 7f2bae487800 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2a9403bb50 0x7f2a9403e010 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2b94000f60 tx=0x7f2b94001370 comp rx=0 tx=0).stop 2024-05-08T18:31:20.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.410+0000 7f2bae487800 1 -- 172.21.15.87:0/1043661764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 msgr2=0x55b379e8e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.410+0000 7f2bae487800 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 0x55b379e8e4d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4000f80 tx=0x7f2ba4003330 comp rx=0 tx=0).stop 2024-05-08T18:31:20.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.410+0000 7f2bae487800 1 -- 172.21.15.87:0/1043661764 shutdown_connections 2024-05-08T18:31:20.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.410+0000 7f2bae487800 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b379d924e0 0x55b379e95670 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.410+0000 7f2bae487800 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b379e98e10 0x55b379e9b200 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.410+0000 7f2bae487800 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2a9403bb50 0x7f2a9403e010 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.410+0000 7f2bae487800 1 --2- 172.21.15.87:0/1043661764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b379d91b80 0x55b379e8e4d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.410+0000 7f2bae487800 1 -- 172.21.15.87:0/1043661764 >> 172.21.15.87:0/1043661764 conn(0x55b379d8d6a0 msgr2=0x55b379e80b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.410+0000 7f2bae487800 1 -- 172.21.15.87:0/1043661764 shutdown_connections 2024-05-08T18:31:20.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.410+0000 7f2bae487800 1 -- 172.21.15.87:0/1043661764 wait complete. 2024-05-08T18:31:20.426 INFO:teuthology.orchestra.run.smithi087.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"603f2301-f6d0-4df6-aa57-6b1659110044","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1","marker":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-08T18:31:19.870084Z","creation_time":"2024-05-08T18:31:19.867262Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-08T18:31:20.426 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '603f2301-f6d0-4df6-aa57-6b1659110044', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1', 'marker': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:31:19.870084Z', 'creation_time': '2024-05-08T18:31:19.867262Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:31:20.426 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-05-08T18:31:20.426 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-05-08T18:31:20.426 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-05-08T18:31:20.470 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:20.471 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:20.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.473+0000 7f1724f2e800 1 Processor -- start 2024-05-08T18:31:20.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.473+0000 7f1724f2e800 1 -- start start 2024-05-08T18:31:20.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.473+0000 7f1724f2e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5562167d46e0 0x5562167dd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.473+0000 7f1724f2e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5562167474d0 con 0x5562167d2ba0 2024-05-08T18:31:20.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.473+0000 7f1724f2e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x556216674e20 con 0x5562167d46e0 2024-05-08T18:31:20.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.474+0000 7f172045f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5562167d46e0 0x5562167dd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.474+0000 7f1720c60640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5562167d2ba0 0x5562167d2fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42074/0 (socket says 172.21.15.87:42074) 2024-05-08T18:31:20.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.474+0000 7f1720c60640 1 -- 172.21.15.87:0/1621360611 learned_addr learned my addr 172.21.15.87:0/1621360611 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:20.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.474+0000 7f172045f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5562167d46e0 0x5562167dd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33744/0 (socket says 172.21.15.87:33744) 2024-05-08T18:31:20.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.474+0000 7f172045f640 1 -- 172.21.15.87:0/1621360611 >> v1:172.21.15.53:6789/0 conn(0x5562167d2ba0 legacy=0x5562167d2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.474+0000 7f172045f640 1 -- 172.21.15.87:0/1621360611 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562167476a0 con 0x5562167d46e0 2024-05-08T18:31:20.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.476+0000 7f172045f640 1 --2- 172.21.15.87:0/1621360611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d46e0 0x5562167dd1e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f170800a470 tx=0x7f170801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58a198be50171ff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.476+0000 7f171fc5e640 1 -- 172.21.15.87:0/1621360611 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1708057070 con 0x5562167d46e0 2024-05-08T18:31:20.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.476+0000 7f171fc5e640 1 -- 172.21.15.87:0/1621360611 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1708052570 con 0x5562167d46e0 2024-05-08T18:31:20.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.476+0000 7f171fc5e640 1 -- 172.21.15.87:0/1621360611 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1708052870 con 0x5562167d46e0 2024-05-08T18:31:20.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.476+0000 7f1724f2e800 1 -- 172.21.15.87:0/1621360611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d46e0 msgr2=0x5562167dd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.476+0000 7f1724f2e800 1 --2- 172.21.15.87:0/1621360611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d46e0 0x5562167dd1e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f170800a470 tx=0x7f170801ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:20.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.476+0000 7f1724f2e800 1 -- 172.21.15.87:0/1621360611 shutdown_connections 2024-05-08T18:31:20.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.476+0000 7f1724f2e800 1 --2- 172.21.15.87:0/1621360611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d46e0 0x5562167dd1e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.476+0000 7f1724f2e800 1 -- 172.21.15.87:0/1621360611 >> 172.21.15.87:0/1621360611 conn(0x5562167ce720 msgr2=0x5562167d0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.477+0000 7f1724f2e800 1 -- 172.21.15.87:0/1621360611 shutdown_connections 2024-05-08T18:31:20.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.477+0000 7f1724f2e800 1 -- 172.21.15.87:0/1621360611 wait complete. 2024-05-08T18:31:20.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.490+0000 7f1724f2e800 1 Processor -- start 2024-05-08T18:31:20.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.491+0000 7f1724f2e800 1 -- start start 2024-05-08T18:31:20.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.491+0000 7f1724f2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d2ba0 0x5562168c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.491+0000 7f1724f2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55621671f5b0 con 0x5562167d2ba0 2024-05-08T18:31:20.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.491+0000 7f1720c60640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d2ba0 0x5562168c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.491+0000 7f1720c60640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d2ba0 0x5562168c77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33758/0 (socket says 172.21.15.87:33758) 2024-05-08T18:31:20.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.491+0000 7f1720c60640 1 -- 172.21.15.87:0/2342828046 learned_addr learned my addr 172.21.15.87:0/2342828046 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.491+0000 7f1720c60640 1 -- 172.21.15.87:0/2342828046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562168c7da0 con 0x5562167d2ba0 2024-05-08T18:31:20.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.492+0000 7f1720c60640 1 --2- 172.21.15.87:0/2342828046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d2ba0 0x5562168c77d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1710001610 tx=0x7f1710006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ccf12274a61d6e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.492+0000 7f160ee0d640 1 -- 172.21.15.87:0/2342828046 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1710004520 con 0x5562167d2ba0 2024-05-08T18:31:20.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.492+0000 7f160ee0d640 1 -- 172.21.15.87:0/2342828046 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17100046e0 con 0x5562167d2ba0 2024-05-08T18:31:20.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.492+0000 7f160ee0d640 1 -- 172.21.15.87:0/2342828046 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1710004a80 con 0x5562167d2ba0 2024-05-08T18:31:20.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.492+0000 7f1724f2e800 1 -- 172.21.15.87:0/2342828046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d2ba0 msgr2=0x5562168c77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.492+0000 7f1724f2e800 1 --2- 172.21.15.87:0/2342828046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d2ba0 0x5562168c77d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1710001610 tx=0x7f1710006f90 comp rx=0 tx=0).stop 2024-05-08T18:31:20.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.492+0000 7f1724f2e800 1 -- 172.21.15.87:0/2342828046 shutdown_connections 2024-05-08T18:31:20.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.492+0000 7f1724f2e800 1 --2- 172.21.15.87:0/2342828046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d2ba0 0x5562168c77d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.492+0000 7f1724f2e800 1 -- 172.21.15.87:0/2342828046 >> 172.21.15.87:0/2342828046 conn(0x5562167ce720 msgr2=0x5562168c30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.492+0000 7f1724f2e800 1 -- 172.21.15.87:0/2342828046 shutdown_connections 2024-05-08T18:31:20.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.492+0000 7f1724f2e800 1 -- 172.21.15.87:0/2342828046 wait complete. 2024-05-08T18:31:20.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.493+0000 7f1724f2e800 1 Processor -- start 2024-05-08T18:31:20.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.493+0000 7f1724f2e800 1 -- start start 2024-05-08T18:31:20.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.493+0000 7f1724f2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d2ba0 0x5562168cf350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.493+0000 7f1724f2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5562167dd9f0 con 0x5562167d2ba0 2024-05-08T18:31:20.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.493+0000 7f1720c60640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d2ba0 0x5562168cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.493+0000 7f1720c60640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d2ba0 0x5562168cf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33768/0 (socket says 172.21.15.87:33768) 2024-05-08T18:31:20.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.493+0000 7f1720c60640 1 -- 172.21.15.87:0/2220883533 learned_addr learned my addr 172.21.15.87:0/2220883533 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.493+0000 7f1720c60640 1 -- 172.21.15.87:0/2220883533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562168cf890 con 0x5562167d2ba0 2024-05-08T18:31:20.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.494+0000 7f1720c60640 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d2ba0 0x5562168cf350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x5562168c8560 tx=0x7f1710000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.494+0000 7f160d60a640 1 -- 172.21.15.87:0/2220883533 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1710024070 con 0x5562167d2ba0 2024-05-08T18:31:20.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.494+0000 7f160d60a640 1 -- 172.21.15.87:0/2220883533 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1710019040 con 0x5562167d2ba0 2024-05-08T18:31:20.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.494+0000 7f1724f2e800 1 -- 172.21.15.87:0/2220883533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562168cfb20 con 0x5562167d2ba0 2024-05-08T18:31:20.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.494+0000 7f160d60a640 1 -- 172.21.15.87:0/2220883533 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17100138b0 con 0x5562167d2ba0 2024-05-08T18:31:20.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.494+0000 7f1724f2e800 1 -- 172.21.15.87:0/2220883533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562168d27d0 con 0x5562167d2ba0 2024-05-08T18:31:20.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.495+0000 7f160d60a640 1 -- 172.21.15.87:0/2220883533 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1710027070 con 0x5562167d2ba0 2024-05-08T18:31:20.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.495+0000 7f160d60a640 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f160803bb50 0x7f160803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.495+0000 7f160d60a640 1 -- 172.21.15.87:0/2220883533 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1710052020 con 0x5562167d2ba0 2024-05-08T18:31:20.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.495+0000 7f172045f640 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f160803bb50 0x7f160803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.495+0000 7f1724f2e800 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5562167d46e0 0x5562168d6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.495+0000 7f1724f2e800 1 -- 172.21.15.87:0/2220883533 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562168d6b60 con 0x5562167d46e0 2024-05-08T18:31:20.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.495+0000 7f1721461640 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5562167d46e0 0x5562168d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.495+0000 7f172045f640 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f160803bb50 0x7f160803e010 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1708054000 tx=0x7f170804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.496+0000 7f1721461640 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5562167d46e0 0x5562168d6590 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.496+0000 7f1721461640 1 -- 172.21.15.87:0/2220883533 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17180083e0 con 0x5562167d46e0 2024-05-08T18:31:20.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.496+0000 7f1724f2e800 1 -- 172.21.15.87:0/2220883533 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562168d3b40 con 0x5562167d46e0 2024-05-08T18:31:20.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.496+0000 7f1721461640 1 -- 172.21.15.87:0/2220883533 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f17180083e0 con 0x5562167d46e0 2024-05-08T18:31:20.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.496+0000 7f1724f2e800 1 -- 172.21.15.87:0/2220883533 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562168d89b0 con 0x5562167d46e0 2024-05-08T18:31:20.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.497+0000 7f1721461640 1 -- 172.21.15.87:0/2220883533 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f17180083e0 con 0x5562167d46e0 2024-05-08T18:31:20.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.497+0000 7f1724f2e800 1 -- 172.21.15.87:0/2220883533 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562168d7be0 con 0x5562167d46e0 2024-05-08T18:31:20.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.497+0000 7f1721461640 1 -- 172.21.15.87:0/2220883533 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f17180083e0 con 0x5562167d46e0 2024-05-08T18:31:20.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.497+0000 7f1724f2e800 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5562168d9d60 0x5562168dc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.497+0000 7f1724f2e800 1 -- 172.21.15.87:0/2220883533 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562168dc690 con 0x5562168d9d60 2024-05-08T18:31:20.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.497+0000 7f1720c60640 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5562168d9d60 0x5562168dc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.497+0000 7f1720c60640 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5562168d9d60 0x5562168dc150 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.498+0000 7f1720c60640 1 -- 172.21.15.87:0/2220883533 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1710026030 con 0x5562168d9d60 2024-05-08T18:31:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.498+0000 7f1724f2e800 1 Processor -- start 2024-05-08T18:31:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.498+0000 7f1724f2e800 1 -- start start 2024-05-08T18:31:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.498+0000 7f1724f2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168ea910 0x5562168ead30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.498+0000 7f1724f2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5562166c5fc0 con 0x5562168ea910 2024-05-08T18:31:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.499+0000 7f1721461640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168ea910 0x5562168ead30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.499+0000 7f1721461640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168ea910 0x5562168ead30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33774/0 (socket says 172.21.15.87:33774) 2024-05-08T18:31:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.499+0000 7f1721461640 1 -- 172.21.15.87:0/474317836 learned_addr learned my addr 172.21.15.87:0/474317836 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.499+0000 7f1721461640 1 -- 172.21.15.87:0/474317836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562168eb270 con 0x5562168ea910 2024-05-08T18:31:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.499+0000 7f1721461640 1 --2- 172.21.15.87:0/474317836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168ea910 0x5562168ead30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x5562168d0060 tx=0x7f171800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.499+0000 7f16067fc640 1 -- 172.21.15.87:0/474317836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f171801c070 con 0x5562168ea910 2024-05-08T18:31:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.499+0000 7f16067fc640 1 -- 172.21.15.87:0/474317836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171800bdc0 con 0x5562168ea910 2024-05-08T18:31:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.499+0000 7f1724f2e800 1 -- 172.21.15.87:0/474317836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562168ebce0 con 0x5562168ea910 2024-05-08T18:31:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.499+0000 7f16067fc640 1 -- 172.21.15.87:0/474317836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1718018540 con 0x5562168ea910 2024-05-08T18:31:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.499+0000 7f1724f2e800 1 -- 172.21.15.87:0/474317836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562168ec1e0 con 0x5562168ea910 2024-05-08T18:31:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.500+0000 7f16067fc640 1 -- 172.21.15.87:0/474317836 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f171801f070 con 0x5562168ea910 2024-05-08T18:31:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.500+0000 7f16067fc640 1 --2- 172.21.15.87:0/474317836 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f15f803bb50 0x7f15f803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.500+0000 7f16067fc640 1 -- 172.21.15.87:0/474317836 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1718054730 con 0x5562168ea910 2024-05-08T18:31:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.500+0000 7f1720c60640 1 --2- 172.21.15.87:0/474317836 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f15f803bb50 0x7f15f803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.500+0000 7f1724f2e800 1 Processor -- start 2024-05-08T18:31:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.501+0000 7f1720c60640 1 --2- 172.21.15.87:0/474317836 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f15f803bb50 0x7f15f803e010 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f171000f000 tx=0x7f171001d380 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.501+0000 7f1724f2e800 1 -- start start 2024-05-08T18:31:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.501+0000 7f1724f2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168f7c70 0x5562168f8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.501+0000 7f1724f2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5562168c8120 con 0x5562168f7c70 2024-05-08T18:31:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.501+0000 7f1721461640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168f7c70 0x5562168f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.501+0000 7f1721461640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168f7c70 0x5562168f8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33788/0 (socket says 172.21.15.87:33788) 2024-05-08T18:31:20.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.501+0000 7f1721461640 1 -- 172.21.15.87:0/3827718420 learned_addr learned my addr 172.21.15.87:0/3827718420 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.501+0000 7f1721461640 1 -- 172.21.15.87:0/3827718420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562168f8660 con 0x5562168f7c70 2024-05-08T18:31:20.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.501+0000 7f1721461640 1 --2- 172.21.15.87:0/3827718420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168f7c70 0x5562168f8090 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1718052ce0 tx=0x7f1718052d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80a3e1bd0c1c699 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.501+0000 7f15f7fff640 1 -- 172.21.15.87:0/3827718420 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f171804f070 con 0x5562168f7c70 2024-05-08T18:31:20.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.501+0000 7f15f7fff640 1 -- 172.21.15.87:0/3827718420 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17180173a0 con 0x5562168f7c70 2024-05-08T18:31:20.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.501+0000 7f15f7fff640 1 -- 172.21.15.87:0/3827718420 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1718017680 con 0x5562168f7c70 2024-05-08T18:31:20.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.502+0000 7f1724f2e800 1 -- 172.21.15.87:0/3827718420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168f7c70 msgr2=0x5562168f8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.502+0000 7f1724f2e800 1 --2- 172.21.15.87:0/3827718420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168f7c70 0x5562168f8090 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1718052ce0 tx=0x7f1718052d10 comp rx=0 tx=0).stop 2024-05-08T18:31:20.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.502+0000 7f1724f2e800 1 -- 172.21.15.87:0/3827718420 shutdown_connections 2024-05-08T18:31:20.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.502+0000 7f1724f2e800 1 --2- 172.21.15.87:0/3827718420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168f7c70 0x5562168f8090 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.502+0000 7f1724f2e800 1 -- 172.21.15.87:0/3827718420 >> 172.21.15.87:0/3827718420 conn(0x5562168f3fd0 msgr2=0x5562168f2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.502+0000 7f1724f2e800 1 -- 172.21.15.87:0/3827718420 shutdown_connections 2024-05-08T18:31:20.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.502+0000 7f1724f2e800 1 -- 172.21.15.87:0/3827718420 wait complete. 2024-05-08T18:31:20.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.502+0000 7f1724f2e800 1 Processor -- start 2024-05-08T18:31:20.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.502+0000 7f1724f2e800 1 -- start start 2024-05-08T18:31:20.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.502+0000 7f1724f2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168f7c70 0x5562168ff210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.502+0000 7f1724f2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5562168f8dd0 con 0x5562168f7c70 2024-05-08T18:31:20.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.503+0000 7f1721461640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168f7c70 0x5562168ff210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.503+0000 7f1721461640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168f7c70 0x5562168ff210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33794/0 (socket says 172.21.15.87:33794) 2024-05-08T18:31:20.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.503+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 learned_addr learned my addr 172.21.15.87:0/4281099344 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.503+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562168ff750 con 0x5562168f7c70 2024-05-08T18:31:20.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.503+0000 7f1721461640 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168f7c70 0x5562168ff210 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f17180076b0 tx=0x7f17180529f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.503+0000 7f15f67fc640 1 -- 172.21.15.87:0/4281099344 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1718014ea0 con 0x5562168f7c70 2024-05-08T18:31:20.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.503+0000 7f15f67fc640 1 -- 172.21.15.87:0/4281099344 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171804a040 con 0x5562168f7c70 2024-05-08T18:31:20.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.503+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562168ff9e0 con 0x5562168f7c70 2024-05-08T18:31:20.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.503+0000 7f15f67fc640 1 -- 172.21.15.87:0/4281099344 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1718054070 con 0x5562168f7c70 2024-05-08T18:31:20.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.503+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556216902690 con 0x5562168f7c70 2024-05-08T18:31:20.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.504+0000 7f15f67fc640 1 -- 172.21.15.87:0/4281099344 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1718054210 con 0x5562168f7c70 2024-05-08T18:31:20.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.504+0000 7f15f67fc640 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f15ec03bb50 0x7f15ec03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.504+0000 7f15f67fc640 1 -- 172.21.15.87:0/4281099344 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1718001040 con 0x5562168f7c70 2024-05-08T18:31:20.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.504+0000 7f1720c60640 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f15ec03bb50 0x7f15ec03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.504+0000 7f1724f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.504+0000 7f1724f2e800 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55621690acc0 0x55621690d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.504+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621690d8d0 con 0x55621690acc0 2024-05-08T18:31:20.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.505+0000 7f172045f640 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55621690acc0 0x55621690d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.505+0000 7f1720c60640 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f15ec03bb50 0x7f15ec03e010 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1710010750 tx=0x7f1710047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.505+0000 7f172045f640 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55621690acc0 0x55621690d180 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.505+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.505+0000 7f1724f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.505+0000 7f1724f2e800 20 realm 2024-05-08T18:31:20.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.505+0000 7f1724f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.505+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621690dca0 con 0x55621690acc0 2024-05-08T18:31:20.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.505+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.505+0000 7f1724f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.505+0000 7f1724f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:20.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.505+0000 7f1724f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.505+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621690e570 con 0x55621690acc0 2024-05-08T18:31:20.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.506+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.506+0000 7f1724f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.506+0000 7f1724f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.506+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621690e910 con 0x55621690acc0 2024-05-08T18:31:20.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.506+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.506+0000 7f1724f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:20.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.506+0000 7f1724f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.506+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621690ed30 con 0x55621690acc0 2024-05-08T18:31:20.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.506+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.506+0000 7f1724f2e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:20.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.506+0000 7f1724f2e800 20 searching for the correct realm 2024-05-08T18:31:20.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.506+0000 7f1724f2e800 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556216910d30 0x556216913180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.506+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556216913850 con 0x556216910d30 2024-05-08T18:31:20.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.506+0000 7f1721461640 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556216910d30 0x556216913180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.507+0000 7f1721461640 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556216910d30 0x556216913180 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.507+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.507+0000 7f1721461640 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f1718021070 0x7f1718054a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.507+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556216913850 con 0x7f1718021070 2024-05-08T18:31:20.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.507+0000 7f1720c60640 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f1718021070 0x7f1718054a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.507+0000 7f1720c60640 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f1718021070 0x7f1718054a50 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.508+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1710026030 con 0x7f1718021070 2024-05-08T18:31:20.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.508+0000 7f1720c60640 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f1710033030 0x7f17100107c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.508+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556216913850 con 0x7f1710033030 2024-05-08T18:31:20.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.508+0000 7f172045f640 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f1710033030 0x7f17100107c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.508+0000 7f172045f640 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f1710033030 0x7f17100107c0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.509+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.509+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556216913850 con 0x55621690acc0 2024-05-08T18:31:20.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.509+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.509+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556216913850 con 0x55621690acc0 2024-05-08T18:31:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.509+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.509+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556216913850 con 0x7f1710033030 2024-05-08T18:31:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.509+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.509+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556216913850 con 0x7f1710033030 2024-05-08T18:31:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.510+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.510+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556216913850 con 0x7f1718021070 2024-05-08T18:31:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.510+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1710026030 con 0x7f1718021070 2024-05-08T18:31:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.510+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556216913850 con 0x556216910d30 2024-05-08T18:31:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.510+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.510+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556216913850 con 0x55621690acc0 2024-05-08T18:31:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.510+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.510+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556216913850 con 0x7f1710033030 2024-05-08T18:31:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.511+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.511+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556216913850 con 0x55621690acc0 2024-05-08T18:31:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.511+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.511+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556216913850 con 0x7f1718021070 2024-05-08T18:31:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.511+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1710026030 con 0x7f1718021070 2024-05-08T18:31:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.511+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556216913850 con 0x556216910d30 2024-05-08T18:31:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.511+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.511+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556216913850 con 0x556216910d30 2024-05-08T18:31:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.512+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.512+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1718061040 con 0x7f1710033030 2024-05-08T18:31:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.512+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.512+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1718061040 con 0x556216910d30 2024-05-08T18:31:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.512+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.512+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1718061040 con 0x556216910d30 2024-05-08T18:31:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.512+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.512+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1718061040 con 0x55621690acc0 2024-05-08T18:31:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.512+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.512+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1718061040 con 0x55621690acc0 2024-05-08T18:31:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.513+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.513+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1718061040 con 0x7f1710033030 2024-05-08T18:31:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.513+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.513+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1718061040 con 0x556216910d30 2024-05-08T18:31:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.513+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.513+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1718061040 con 0x7f1718021070 2024-05-08T18:31:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.514+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1710026030 con 0x7f1718021070 2024-05-08T18:31:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.514+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1718061040 con 0x55621690acc0 2024-05-08T18:31:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.514+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.514+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1718061040 con 0x7f1710033030 2024-05-08T18:31:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.514+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.514+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1718061040 con 0x556216910d30 2024-05-08T18:31:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.514+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.515+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1718061040 con 0x7f1710033030 2024-05-08T18:31:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.515+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.515+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1718061040 con 0x7f1718021070 2024-05-08T18:31:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.515+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1710026030 con 0x7f1718021070 2024-05-08T18:31:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.515+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1718061040 con 0x556216910d30 2024-05-08T18:31:20.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.515+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.515+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1718061040 con 0x7f1710033030 2024-05-08T18:31:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.516+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.516+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1718061040 con 0x55621690acc0 2024-05-08T18:31:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.516+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.516+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1718061040 con 0x7f1718021070 2024-05-08T18:31:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.516+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1710026030 con 0x7f1718021070 2024-05-08T18:31:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.516+0000 7f1724f2e800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.516+0000 7f1724f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.516+0000 7f1724f2e800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.516+0000 7f1724f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.516+0000 7f1724f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.516+0000 7f1724f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f1724f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621690f800 con 0x55621690acc0 2024-05-08T18:31:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f1724f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f1724f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562169100a0 con 0x55621690acc0 2024-05-08T18:31:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f1724f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:20.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f1724f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621690f440 con 0x7f1710033030 2024-05-08T18:31:20.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f1724f2e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:20.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f1724f2e800 20 zone default found 2024-05-08T18:31:20.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f1724f2e800 4 Realm: () 2024-05-08T18:31:20.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f1724f2e800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:20.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f1724f2e800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:20.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f1724f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:20.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f1724f2e800 20 zonegroup default 2024-05-08T18:31:20.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f1724f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.517+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556216913d20 con 0x7f1710033030 2024-05-08T18:31:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.518+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.518+0000 7f1724f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.518+0000 7f1724f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.518+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556216915bb0 con 0x556216910d30 2024-05-08T18:31:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.518+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.518+0000 7f1724f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.518+0000 7f1724f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.518+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556216915f50 con 0x556216910d30 2024-05-08T18:31:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.518+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.519+0000 7f1724f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.519+0000 7f1724f2e800 20 started sync module instance, tier type = 2024-05-08T18:31:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.519+0000 7f1724f2e800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.519+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216914ff0 con 0x7f1718021070 2024-05-08T18:31:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.520+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1710026030 con 0x7f1718021070 2024-05-08T18:31:20.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.520+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93879773778912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216915800 con 0x7f1718021070 2024-05-08T18:31:20.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.520+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216916a20 con 0x55621690acc0 2024-05-08T18:31:20.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.521+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93879773778912] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1710026030 con 0x7f1718021070 2024-05-08T18:31:20.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.521+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.521+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93879773783408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216916e40 con 0x55621690acc0 2024-05-08T18:31:20.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.521+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216917800 con 0x556216910d30 2024-05-08T18:31:20.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.522+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93879773783408] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.522+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.522+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93879773787440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216916e40 con 0x556216910d30 2024-05-08T18:31:20.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.522+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216918210 con 0x7f1718021070 2024-05-08T18:31:20.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.523+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93879773787440] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.523+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1710026030 con 0x7f1718021070 2024-05-08T18:31:20.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.523+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93879773789536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562169185b0 con 0x7f1718021070 2024-05-08T18:31:20.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.523+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216919080 con 0x55621690acc0 2024-05-08T18:31:20.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.524+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.524+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93879773789536] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1710026030 con 0x7f1718021070 2024-05-08T18:31:20.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.524+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93879773784464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216919470 con 0x55621690acc0 2024-05-08T18:31:20.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.524+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216919e70 con 0x7f1710033030 2024-05-08T18:31:20.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.525+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.525+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93879773796736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216919da0 con 0x7f1710033030 2024-05-08T18:31:20.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.525+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621691ada0 con 0x7f1710033030 2024-05-08T18:31:20.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.525+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93879773784464] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.526+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93879773796736] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.528+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.528+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93879773799008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621691a8b0 con 0x7f1710033030 2024-05-08T18:31:20.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.528+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621691b270 con 0x7f1710033030 2024-05-08T18:31:20.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.529+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.529+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93879773799008] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.529+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93879773801920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621691b1e0 con 0x7f1710033030 2024-05-08T18:31:20.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.529+0000 7f1724f2e800 20 add_watcher() i=0 2024-05-08T18:31:20.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.529+0000 7f1724f2e800 20 add_watcher() i=1 2024-05-08T18:31:20.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.529+0000 7f1724f2e800 20 add_watcher() i=2 2024-05-08T18:31:20.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.529+0000 7f1724f2e800 20 add_watcher() i=3 2024-05-08T18:31:20.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.529+0000 7f1724f2e800 20 add_watcher() i=4 2024-05-08T18:31:20.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.529+0000 7f1724f2e800 20 add_watcher() i=5 2024-05-08T18:31:20.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.529+0000 7f1724f2e800 20 add_watcher() i=6 2024-05-08T18:31:20.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.530+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93879773801920] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.530+0000 7f1724f2e800 20 add_watcher() i=7 2024-05-08T18:31:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.530+0000 7f1724f2e800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.530+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621691e670 con 0x55621690acc0 2024-05-08T18:31:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.530+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.531+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93879773793136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621691bb30 con 0x55621690acc0 2024-05-08T18:31:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.532+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93879773793136] v27'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.532+0000 7f15d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.532+0000 7f1724f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.532+0000 7f1724f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.532+0000 7f1724f2e800 5 note: GC not initialized 2024-05-08T18:31:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.532+0000 7f15d67e4640 20 reqs_thread_entry: start 2024-05-08T18:31:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.532+0000 7f1724f2e800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.532+0000 7f1724f2e800 20 Filter name: none 2024-05-08T18:31:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.532+0000 7f15cf7fe640 20 reqs_thread_entry: start 2024-05-08T18:31:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.532+0000 7f1724f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.532+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556216951570 con 0x55621690acc0 2024-05-08T18:31:20.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.533+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.533+0000 7f1724f2e800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:20.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.533+0000 7f1724f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.533+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556216951e00 con 0x55621690acc0 2024-05-08T18:31:20.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.533+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.533+0000 7f1724f2e800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:20.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.533+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556216952e10 con 0x7f1718021070 2024-05-08T18:31:20.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.533+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f1710026030 con 0x7f1718021070 2024-05-08T18:31:20.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.533+0000 7f1724f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.533+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562169503b0 con 0x7f1718021070 2024-05-08T18:31:20.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.534+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1710026030 con 0x7f1718021070 2024-05-08T18:31:20.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.534+0000 7f1724f2e800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:20.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.534+0000 7f1724f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.534+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562169531b0 con 0x556216910d30 2024-05-08T18:31:20.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.534+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(66 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.534+0000 7f1724f2e800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:20.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.534+0000 7f1724f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:31:20.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.534+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:67 4.3c 4:3e5af247:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556216952240 con 0x55621690acc0 2024-05-08T18:31:20.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.534+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 4.13 4:c87a77a1:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562169576a0 con 0x7f1718021070 2024-05-08T18:31:20.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.534+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 4.2d 4:b6c641c8:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556216959fe0 con 0x7f1710033030 2024-05-08T18:31:20.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.534+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:70 4.8 4:106dbb9b:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621695c850 con 0x556216910d30 2024-05-08T18:31:20.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.534+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 4.28 4:146af900:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621695f0c0 con 0x55621690acc0 2024-05-08T18:31:20.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.534+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:72 4.6 4:613ec2f8:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556216961a40 con 0x556216910d30 2024-05-08T18:31:20.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.534+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:73 4.32 4:4ef39ee1:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556216964750 con 0x55621690acc0 2024-05-08T18:31:20.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.534+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 4.1c 4:38258a38:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556216967490 con 0x7f1710033030 2024-05-08T18:31:20.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.534+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 4.38 4:1e0d588e:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621696a020 con 0x55621690acc0 2024-05-08T18:31:20.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.535+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 4.f 4:f0da020c:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556216964750 con 0x55621690acc0 2024-05-08T18:31:20.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.535+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(69 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.535+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(68 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1710026030 con 0x7f1718021070 2024-05-08T18:31:20.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.535+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 4.1d 4:baf32667:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556216967490 con 0x556216910d30 2024-05-08T18:31:20.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.535+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(70 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.535+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(74 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.535+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(67 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.535+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(72 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.535+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(71 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.535+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(73 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.535+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(75 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.535+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(76 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.535+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.536+0000 7f15d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.536+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93879773793136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621696a020 con 0x55621690acc0 2024-05-08T18:31:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.537+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 93879773793136] v27'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.537+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93879773778912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216918b70 con 0x7f1718021070 2024-05-08T18:31:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.538+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 93879773778912] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1710026030 con 0x7f1718021070 2024-05-08T18:31:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.538+0000 7f1724f2e800 20 remove_watcher() i=0 2024-05-08T18:31:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.538+0000 7f1724f2e800 2 removed watcher, disabling cache 2024-05-08T18:31:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.538+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93879773783408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216918b70 con 0x55621690acc0 2024-05-08T18:31:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.539+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 93879773783408] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.539+0000 7f1724f2e800 20 remove_watcher() i=1 2024-05-08T18:31:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.539+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93879773787440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216916570 con 0x556216910d30 2024-05-08T18:31:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.541+0000 7f1721461640 1 -- 172.21.15.87:0/4281099344 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 93879773787440] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1718028070 con 0x556216910d30 2024-05-08T18:31:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.541+0000 7f1724f2e800 20 remove_watcher() i=2 2024-05-08T18:31:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.541+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93879773789536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216918b70 con 0x7f1718021070 2024-05-08T18:31:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.542+0000 7f1720c60640 1 -- 172.21.15.87:0/4281099344 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 93879773789536] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1710026030 con 0x7f1718021070 2024-05-08T18:31:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.542+0000 7f1724f2e800 20 remove_watcher() i=3 2024-05-08T18:31:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.542+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93879773784464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216916570 con 0x55621690acc0 2024-05-08T18:31:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.543+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 93879773784464] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170805a040 con 0x55621690acc0 2024-05-08T18:31:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.543+0000 7f1724f2e800 20 remove_watcher() i=4 2024-05-08T18:31:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.543+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93879773796736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216917d60 con 0x7f1710033030 2024-05-08T18:31:20.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.544+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 93879773796736] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.544+0000 7f1724f2e800 20 remove_watcher() i=5 2024-05-08T18:31:20.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.544+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93879773799008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216918b70 con 0x7f1710033030 2024-05-08T18:31:20.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.544+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 93879773799008] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.544+0000 7f1724f2e800 20 remove_watcher() i=6 2024-05-08T18:31:20.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.544+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93879773801920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556216919980 con 0x7f1710033030 2024-05-08T18:31:20.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 93879773801920] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170805a040 con 0x7f1710033030 2024-05-08T18:31:20.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 20 remove_watcher() i=7 2024-05-08T18:31:20.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f1710033030 msgr2=0x7f17100107c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f1710033030 0x7f17100107c0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55621690acc0 msgr2=0x55621690d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55621690acc0 0x55621690d180 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f1718021070 msgr2=0x7f1718054a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f1718021070 0x7f1718054a50 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556216910d30 msgr2=0x556216913180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556216910d30 0x556216913180 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f15ec03bb50 msgr2=0x7f15ec03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f15ec03bb50 0x7f15ec03e010 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1710010750 tx=0x7f1710047000 comp rx=0 tx=0).stop 2024-05-08T18:31:20.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168f7c70 msgr2=0x5562168ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f172045f640 1 -- 172.21.15.87:0/4281099344 reap_dead start 2024-05-08T18:31:20.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168f7c70 0x5562168ff210 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f17180076b0 tx=0x7f17180529f0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 shutdown_connections 2024-05-08T18:31:20.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 --2- 172.21.15.87:0/4281099344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168f7c70 0x5562168ff210 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 >> 172.21.15.87:0/4281099344 conn(0x5562168f3fd0 msgr2=0x5562168f1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 shutdown_connections 2024-05-08T18:31:20.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 -- 172.21.15.87:0/4281099344 wait complete. 2024-05-08T18:31:20.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 -- 172.21.15.87:0/474317836 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f15f803bb50 msgr2=0x7f15f803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 --2- 172.21.15.87:0/474317836 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f15f803bb50 0x7f15f803e010 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f171000f000 tx=0x7f171001d380 comp rx=0 tx=0).stop 2024-05-08T18:31:20.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 -- 172.21.15.87:0/474317836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168ea910 msgr2=0x5562168ead30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 --2- 172.21.15.87:0/474317836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168ea910 0x5562168ead30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x5562168d0060 tx=0x7f171800ef30 comp rx=0 tx=0).stop 2024-05-08T18:31:20.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 -- 172.21.15.87:0/474317836 shutdown_connections 2024-05-08T18:31:20.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 --2- 172.21.15.87:0/474317836 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f15f803bb50 0x7f15f803e010 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 --2- 172.21.15.87:0/474317836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562168ea910 0x5562168ead30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 -- 172.21.15.87:0/474317836 >> 172.21.15.87:0/474317836 conn(0x5562168de9b0 msgr2=0x5562168dedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 -- 172.21.15.87:0/474317836 shutdown_connections 2024-05-08T18:31:20.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.546+0000 7f1724f2e800 1 -- 172.21.15.87:0/474317836 wait complete. 2024-05-08T18:31:20.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.547+0000 7f1724f2e800 1 -- 172.21.15.87:0/2220883533 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5562168d9d60 msgr2=0x5562168dc150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.547+0000 7f1724f2e800 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5562168d9d60 0x5562168dc150 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.547+0000 7f1724f2e800 1 -- 172.21.15.87:0/2220883533 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5562167d46e0 msgr2=0x5562168d6590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.547+0000 7f1724f2e800 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5562167d46e0 0x5562168d6590 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.547+0000 7f1724f2e800 1 -- 172.21.15.87:0/2220883533 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f160803bb50 msgr2=0x7f160803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.547+0000 7f1724f2e800 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f160803bb50 0x7f160803e010 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1708054000 tx=0x7f170804e000 comp rx=0 tx=0).stop 2024-05-08T18:31:20.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.547+0000 7f1724f2e800 1 -- 172.21.15.87:0/2220883533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d2ba0 msgr2=0x5562168cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.547+0000 7f1724f2e800 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d2ba0 0x5562168cf350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x5562168c8560 tx=0x7f1710000f40 comp rx=0 tx=0).stop 2024-05-08T18:31:20.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.547+0000 7f1724f2e800 1 -- 172.21.15.87:0/2220883533 shutdown_connections 2024-05-08T18:31:20.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.547+0000 7f1724f2e800 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5562167d46e0 0x5562168d6590 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.547+0000 7f1724f2e800 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5562168d9d60 0x5562168dc150 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.547+0000 7f1724f2e800 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f160803bb50 0x7f160803e010 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.547+0000 7f1724f2e800 1 --2- 172.21.15.87:0/2220883533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562167d2ba0 0x5562168cf350 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.547+0000 7f1724f2e800 1 -- 172.21.15.87:0/2220883533 >> 172.21.15.87:0/2220883533 conn(0x5562167ce720 msgr2=0x5562168c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.547+0000 7f1724f2e800 1 -- 172.21.15.87:0/2220883533 shutdown_connections 2024-05-08T18:31:20.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.547+0000 7f1724f2e800 1 -- 172.21.15.87:0/2220883533 wait complete. 2024-05-08T18:31:20.562 INFO:teuthology.orchestra.run.smithi087.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"603f2301-f6d0-4df6-aa57-6b1659110044","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1","marker":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-08T18:31:19.870084Z","creation_time":"2024-05-08T18:31:19.867262Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-05-08T18:31:20.563 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '603f2301-f6d0-4df6-aa57-6b1659110044', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1', 'marker': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:31:19.870084Z', 'creation_time': '2024-05-08T18:31:19.867262Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-05-08T18:31:20.569 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-08T18:31:20.569 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:31:20.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:31:20.570 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-08T18:31:20.613 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:20.613 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:20.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.616+0000 7f6156a0f800 1 Processor -- start 2024-05-08T18:31:20.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.616+0000 7f6156a0f800 1 -- start start 2024-05-08T18:31:20.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.616+0000 7f6156a0f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557c0d303a10 0x557c0d398190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.616+0000 7f6156a0f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557c0d303ec0 con 0x557c0d304da0 2024-05-08T18:31:20.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.616+0000 7f6156a0f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x557c0d22fe20 con 0x557c0d303a10 2024-05-08T18:31:20.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.616+0000 7f614980c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557c0d303a10 0x557c0d398190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.616+0000 7f614980c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557c0d303a10 0x557c0d398190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33808/0 (socket says 172.21.15.87:33808) 2024-05-08T18:31:20.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.616+0000 7f614980c640 1 -- 172.21.15.87:0/2478896240 learned_addr learned my addr 172.21.15.87:0/2478896240 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.616+0000 7f615200d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x557c0d304da0 0x557c0d303300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42090/0 (socket says 172.21.15.87:42090) 2024-05-08T18:31:20.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.617+0000 7f614980c640 1 -- 172.21.15.87:0/2478896240 >> v1:172.21.15.53:6789/0 conn(0x557c0d304da0 legacy=0x557c0d303300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.617+0000 7f614980c640 1 -- 172.21.15.87:0/2478896240 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c0d304090 con 0x557c0d303a10 2024-05-08T18:31:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.618+0000 7f614980c640 1 --2- 172.21.15.87:0/2478896240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 0x557c0d398190 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f613c00a520 tx=0x7f613c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e9310b0b84997b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.619+0000 7f615180c640 1 -- 172.21.15.87:0/2478896240 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f613c057070 con 0x557c0d303a10 2024-05-08T18:31:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.619+0000 7f615180c640 1 -- 172.21.15.87:0/2478896240 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f613c052570 con 0x557c0d303a10 2024-05-08T18:31:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.619+0000 7f615180c640 1 -- 172.21.15.87:0/2478896240 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f613c04ae60 con 0x557c0d303a10 2024-05-08T18:31:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.619+0000 7f6156a0f800 1 -- 172.21.15.87:0/2478896240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 msgr2=0x557c0d398190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.619+0000 7f6156a0f800 1 --2- 172.21.15.87:0/2478896240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 0x557c0d398190 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f613c00a520 tx=0x7f613c01d010 comp rx=0 tx=0).stop 2024-05-08T18:31:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.619+0000 7f6156a0f800 1 -- 172.21.15.87:0/2478896240 shutdown_connections 2024-05-08T18:31:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.619+0000 7f6156a0f800 1 --2- 172.21.15.87:0/2478896240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 0x557c0d398190 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.619+0000 7f6156a0f800 1 -- 172.21.15.87:0/2478896240 >> 172.21.15.87:0/2478896240 conn(0x557c0d38a830 msgr2=0x557c0d38cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.619+0000 7f6156a0f800 1 -- 172.21.15.87:0/2478896240 shutdown_connections 2024-05-08T18:31:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.619+0000 7f6156a0f800 1 -- 172.21.15.87:0/2478896240 wait complete. 2024-05-08T18:31:20.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.633+0000 7f6156a0f800 1 Processor -- start 2024-05-08T18:31:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.633+0000 7f6156a0f800 1 -- start start 2024-05-08T18:31:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.633+0000 7f6156a0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 0x557c0d4827c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.633+0000 7f6156a0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557c0d2da5b0 con 0x557c0d303a10 2024-05-08T18:31:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.633+0000 7f615200d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 0x557c0d4827c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.633+0000 7f615200d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 0x557c0d4827c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33822/0 (socket says 172.21.15.87:33822) 2024-05-08T18:31:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.633+0000 7f615200d640 1 -- 172.21.15.87:0/1244734099 learned_addr learned my addr 172.21.15.87:0/1244734099 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.634+0000 7f615200d640 1 -- 172.21.15.87:0/1244734099 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c0d482d90 con 0x557c0d303a10 2024-05-08T18:31:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.634+0000 7f615200d640 1 --2- 172.21.15.87:0/1244734099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 0x557c0d4827c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6144001e60 tx=0x7f614400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f0a1c47058107f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.634+0000 7f6040608640 1 -- 172.21.15.87:0/1244734099 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614400e5c0 con 0x557c0d303a10 2024-05-08T18:31:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.634+0000 7f6040608640 1 -- 172.21.15.87:0/1244734099 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6144006070 con 0x557c0d303a10 2024-05-08T18:31:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.634+0000 7f6040608640 1 -- 172.21.15.87:0/1244734099 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614400e910 con 0x557c0d303a10 2024-05-08T18:31:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.635+0000 7f6156a0f800 1 -- 172.21.15.87:0/1244734099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 msgr2=0x557c0d4827c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.635+0000 7f6156a0f800 1 --2- 172.21.15.87:0/1244734099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 0x557c0d4827c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6144001e60 tx=0x7f614400b6c0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.635+0000 7f6156a0f800 1 -- 172.21.15.87:0/1244734099 shutdown_connections 2024-05-08T18:31:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.635+0000 7f6156a0f800 1 --2- 172.21.15.87:0/1244734099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 0x557c0d4827c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.635+0000 7f6156a0f800 1 -- 172.21.15.87:0/1244734099 >> 172.21.15.87:0/1244734099 conn(0x557c0d38a830 msgr2=0x557c0d47e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.635+0000 7f6156a0f800 1 -- 172.21.15.87:0/1244734099 shutdown_connections 2024-05-08T18:31:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.635+0000 7f6156a0f800 1 -- 172.21.15.87:0/1244734099 wait complete. 2024-05-08T18:31:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.635+0000 7f6156a0f800 1 Processor -- start 2024-05-08T18:31:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.635+0000 7f6156a0f800 1 -- start start 2024-05-08T18:31:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.635+0000 7f6156a0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 0x557c0d48a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.635+0000 7f6156a0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557c0d3989a0 con 0x557c0d303a10 2024-05-08T18:31:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.635+0000 7f615200d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 0x557c0d48a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.635+0000 7f615200d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 0x557c0d48a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33834/0 (socket says 172.21.15.87:33834) 2024-05-08T18:31:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.635+0000 7f615200d640 1 -- 172.21.15.87:0/2234139171 learned_addr learned my addr 172.21.15.87:0/2234139171 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.635+0000 7f615200d640 1 -- 172.21.15.87:0/2234139171 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c0d48a8a0 con 0x557c0d303a10 2024-05-08T18:31:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.636+0000 7f615200d640 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 0x557c0d48a360 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x557c0d483550 tx=0x7f6144000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.636+0000 7f603ee05640 1 -- 172.21.15.87:0/2234139171 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614400f8d0 con 0x557c0d303a10 2024-05-08T18:31:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.636+0000 7f603ee05640 1 -- 172.21.15.87:0/2234139171 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614400fa70 con 0x557c0d303a10 2024-05-08T18:31:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.636+0000 7f6156a0f800 1 -- 172.21.15.87:0/2234139171 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c0d48ab30 con 0x557c0d303a10 2024-05-08T18:31:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.636+0000 7f603ee05640 1 -- 172.21.15.87:0/2234139171 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614400fdf0 con 0x557c0d303a10 2024-05-08T18:31:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.636+0000 7f6156a0f800 1 -- 172.21.15.87:0/2234139171 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c0d48d790 con 0x557c0d303a10 2024-05-08T18:31:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.637+0000 7f603ee05640 1 -- 172.21.15.87:0/2234139171 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6144017070 con 0x557c0d303a10 2024-05-08T18:31:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.637+0000 7f603ee05640 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f603803bb50 0x7f603803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.637+0000 7f603ee05640 1 -- 172.21.15.87:0/2234139171 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6144015020 con 0x557c0d303a10 2024-05-08T18:31:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.637+0000 7f614980c640 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f603803bb50 0x7f603803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.637+0000 7f6156a0f800 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557c0d304da0 0x557c0d491550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.637+0000 7f6156a0f800 1 -- 172.21.15.87:0/2234139171 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d491ae0 con 0x557c0d304da0 2024-05-08T18:31:20.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.637+0000 7f615280e640 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557c0d304da0 0x557c0d491550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.637+0000 7f614980c640 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f603803bb50 0x7f603803e010 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f613c054000 tx=0x7f613c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.638+0000 7f615280e640 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557c0d304da0 0x557c0d491550 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.638+0000 7f615280e640 1 -- 172.21.15.87:0/2234139171 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f614c00a4a0 con 0x557c0d304da0 2024-05-08T18:31:20.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.638+0000 7f6156a0f800 1 -- 172.21.15.87:0/2234139171 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d48eb20 con 0x557c0d304da0 2024-05-08T18:31:20.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.638+0000 7f615280e640 1 -- 172.21.15.87:0/2234139171 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f614c00a4a0 con 0x557c0d304da0 2024-05-08T18:31:20.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.638+0000 7f6156a0f800 1 -- 172.21.15.87:0/2234139171 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d493920 con 0x557c0d304da0 2024-05-08T18:31:20.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.638+0000 7f615280e640 1 -- 172.21.15.87:0/2234139171 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f614c00a4a0 con 0x557c0d304da0 2024-05-08T18:31:20.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.638+0000 7f6156a0f800 1 -- 172.21.15.87:0/2234139171 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d492a60 con 0x557c0d304da0 2024-05-08T18:31:20.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.639+0000 7f615280e640 1 -- 172.21.15.87:0/2234139171 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f614c00a4a0 con 0x557c0d304da0 2024-05-08T18:31:20.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.639+0000 7f6156a0f800 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x557c0d493530 0x557c0d496d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.639+0000 7f6156a0f800 1 -- 172.21.15.87:0/2234139171 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d497500 con 0x557c0d493530 2024-05-08T18:31:20.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.639+0000 7f615200d640 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x557c0d493530 0x557c0d496d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.639+0000 7f615200d640 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x557c0d493530 0x557c0d496d70 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.639+0000 7f615200d640 1 -- 172.21.15.87:0/2234139171 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f614402e070 con 0x557c0d493530 2024-05-08T18:31:20.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.640+0000 7f6156a0f800 1 Processor -- start 2024-05-08T18:31:20.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.640+0000 7f6156a0f800 1 -- start start 2024-05-08T18:31:20.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.640+0000 7f6156a0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4a5850 0x557c0d4a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.640+0000 7f6156a0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557c0d280fc0 con 0x557c0d4a5850 2024-05-08T18:31:20.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.640+0000 7f615280e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4a5850 0x557c0d4a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.640+0000 7f615280e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4a5850 0x557c0d4a5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33850/0 (socket says 172.21.15.87:33850) 2024-05-08T18:31:20.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.640+0000 7f615280e640 1 -- 172.21.15.87:0/134109184 learned_addr learned my addr 172.21.15.87:0/134109184 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.641+0000 7f615280e640 1 -- 172.21.15.87:0/134109184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c0d4a61b0 con 0x557c0d4a5850 2024-05-08T18:31:20.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.641+0000 7f615280e640 1 --2- 172.21.15.87:0/134109184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4a5850 0x557c0d4a5c70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x557c0d491ee0 tx=0x7f614c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.641+0000 7f6037fff640 1 -- 172.21.15.87:0/134109184 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c013440 con 0x557c0d4a5850 2024-05-08T18:31:20.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.641+0000 7f6037fff640 1 -- 172.21.15.87:0/134109184 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c0135e0 con 0x557c0d4a5850 2024-05-08T18:31:20.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.641+0000 7f6156a0f800 1 -- 172.21.15.87:0/134109184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c0d4a6c20 con 0x557c0d4a5850 2024-05-08T18:31:20.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.641+0000 7f6037fff640 1 -- 172.21.15.87:0/134109184 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c0138c0 con 0x557c0d4a5850 2024-05-08T18:31:20.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.641+0000 7f6156a0f800 1 -- 172.21.15.87:0/134109184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c0d4a7120 con 0x557c0d4a5850 2024-05-08T18:31:20.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.642+0000 7f6037fff640 1 -- 172.21.15.87:0/134109184 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f614c011040 con 0x557c0d4a5850 2024-05-08T18:31:20.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.642+0000 7f6037fff640 1 --2- 172.21.15.87:0/134109184 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f602c03bba0 0x7f602c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.642+0000 7f6037fff640 1 -- 172.21.15.87:0/134109184 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f614c01d070 con 0x557c0d4a5850 2024-05-08T18:31:20.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.642+0000 7f615200d640 1 --2- 172.21.15.87:0/134109184 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f602c03bba0 0x7f602c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.642+0000 7f6156a0f800 1 Processor -- start 2024-05-08T18:31:20.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.642+0000 7f615200d640 1 --2- 172.21.15.87:0/134109184 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f602c03bba0 0x7f602c03e060 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f614401cfd0 tx=0x7f6144051800 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.642+0000 7f6156a0f800 1 -- start start 2024-05-08T18:31:20.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.643+0000 7f6156a0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4b2b50 0x557c0d4b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.643+0000 7f6156a0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557c0d483110 con 0x557c0d4b2b50 2024-05-08T18:31:20.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.643+0000 7f615280e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4b2b50 0x557c0d4b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.643+0000 7f615280e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4b2b50 0x557c0d4b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33854/0 (socket says 172.21.15.87:33854) 2024-05-08T18:31:20.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.643+0000 7f615280e640 1 -- 172.21.15.87:0/875328047 learned_addr learned my addr 172.21.15.87:0/875328047 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.643+0000 7f615280e640 1 -- 172.21.15.87:0/875328047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c0d4b3540 con 0x557c0d4b2b50 2024-05-08T18:31:20.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.643+0000 7f615280e640 1 --2- 172.21.15.87:0/875328047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4b2b50 0x557c0d4b2f70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f614c0529e0 tx=0x7f614c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e098369ad00b21c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.643+0000 7f6035ffb640 1 -- 172.21.15.87:0/875328047 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c015560 con 0x557c0d4b2b50 2024-05-08T18:31:20.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.643+0000 7f6035ffb640 1 -- 172.21.15.87:0/875328047 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c001310 con 0x557c0d4b2b50 2024-05-08T18:31:20.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.643+0000 7f6035ffb640 1 -- 172.21.15.87:0/875328047 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c015950 con 0x557c0d4b2b50 2024-05-08T18:31:20.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.644+0000 7f6156a0f800 1 -- 172.21.15.87:0/875328047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4b2b50 msgr2=0x557c0d4b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.644+0000 7f6156a0f800 1 --2- 172.21.15.87:0/875328047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4b2b50 0x557c0d4b2f70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f614c0529e0 tx=0x7f614c001d80 comp rx=0 tx=0).stop 2024-05-08T18:31:20.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.644+0000 7f6156a0f800 1 -- 172.21.15.87:0/875328047 shutdown_connections 2024-05-08T18:31:20.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.644+0000 7f6156a0f800 1 --2- 172.21.15.87:0/875328047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4b2b50 0x557c0d4b2f70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.644+0000 7f6156a0f800 1 -- 172.21.15.87:0/875328047 >> 172.21.15.87:0/875328047 conn(0x557c0d4aeeb0 msgr2=0x557c0d4acf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.644+0000 7f6156a0f800 1 -- 172.21.15.87:0/875328047 shutdown_connections 2024-05-08T18:31:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.644+0000 7f6156a0f800 1 -- 172.21.15.87:0/875328047 wait complete. 2024-05-08T18:31:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.644+0000 7f6156a0f800 1 Processor -- start 2024-05-08T18:31:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.644+0000 7f6156a0f800 1 -- start start 2024-05-08T18:31:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.644+0000 7f6156a0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4b2b50 0x557c0d4ba0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.644+0000 7f6156a0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557c0d4b3cb0 con 0x557c0d4b2b50 2024-05-08T18:31:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.644+0000 7f615280e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4b2b50 0x557c0d4ba0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.645+0000 7f615280e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4b2b50 0x557c0d4ba0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33862/0 (socket says 172.21.15.87:33862) 2024-05-08T18:31:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.645+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 learned_addr learned my addr 172.21.15.87:0/1531087610 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.645+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c0d4ba610 con 0x557c0d4b2b50 2024-05-08T18:31:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.645+0000 7f615280e640 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4b2b50 0x557c0d4ba0d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f614c02a500 tx=0x7f614c052940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.645+0000 7f6023fff640 1 -- 172.21.15.87:0/1531087610 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c030020 con 0x557c0d4b2b50 2024-05-08T18:31:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.645+0000 7f6023fff640 1 -- 172.21.15.87:0/1531087610 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c013e30 con 0x557c0d4b2b50 2024-05-08T18:31:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.645+0000 7f6023fff640 1 -- 172.21.15.87:0/1531087610 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c054200 con 0x557c0d4b2b50 2024-05-08T18:31:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.645+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c0d4ba8a0 con 0x557c0d4b2b50 2024-05-08T18:31:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.645+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c0d4bd550 con 0x557c0d4b2b50 2024-05-08T18:31:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.646+0000 7f6023fff640 1 -- 172.21.15.87:0/1531087610 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f614c033020 con 0x557c0d4b2b50 2024-05-08T18:31:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.646+0000 7f6023fff640 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f601c03bb50 0x7f601c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.646+0000 7f6023fff640 1 -- 172.21.15.87:0/1531087610 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f614c00e040 con 0x557c0d4b2b50 2024-05-08T18:31:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.646+0000 7f615200d640 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f601c03bb50 0x7f601c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.646+0000 7f6156a0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.646+0000 7f6156a0f800 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557c0d4c5db0 0x557c0d4c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.646+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4c89c0 con 0x557c0d4c5db0 2024-05-08T18:31:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.647+0000 7f615200d640 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f601c03bb50 0x7f601c03e010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f614403f470 tx=0x7f6144047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.647+0000 7f614980c640 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557c0d4c5db0 0x557c0d4c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.647+0000 7f614980c640 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557c0d4c5db0 0x557c0d4c8270 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.647+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.647+0000 7f6156a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.647+0000 7f6156a0f800 20 realm 2024-05-08T18:31:20.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.647+0000 7f6156a0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.647+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4c8d90 con 0x557c0d4c5db0 2024-05-08T18:31:20.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.647+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.647+0000 7f6156a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.647+0000 7f6156a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:20.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.647+0000 7f6156a0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.647+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4c9660 con 0x557c0d4c5db0 2024-05-08T18:31:20.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.647+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.647+0000 7f6156a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.647+0000 7f6156a0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.647+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4c9a00 con 0x557c0d4c5db0 2024-05-08T18:31:20.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.648+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.648+0000 7f6156a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:20.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.648+0000 7f6156a0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.648+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4c9e20 con 0x557c0d4c5db0 2024-05-08T18:31:20.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.648+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.648+0000 7f6156a0f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:20.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.648+0000 7f6156a0f800 20 searching for the correct realm 2024-05-08T18:31:20.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.648+0000 7f6156a0f800 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x557c0d4cbe20 0x557c0d4ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.648+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x557c0d4cbe20 2024-05-08T18:31:20.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.648+0000 7f615280e640 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x557c0d4cbe20 0x557c0d4ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.648+0000 7f615280e640 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x557c0d4cbe20 0x557c0d4ce270 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.649+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.649+0000 7f615280e640 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f614c035020 0x7f614c02baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.649+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x7f614c035020 2024-05-08T18:31:20.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.649+0000 7f615200d640 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f614c035020 0x7f614c02baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.649+0000 7f615200d640 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f614c035020 0x7f614c02baa0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.649+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614402e070 con 0x7f614c035020 2024-05-08T18:31:20.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.649+0000 7f615200d640 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f614400f070 0x7f614401d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.649+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x7f614400f070 2024-05-08T18:31:20.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.650+0000 7f614980c640 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f614400f070 0x7f614401d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.650+0000 7f614980c640 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f614400f070 0x7f614401d7f0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.650+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.650+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x557c0d4c5db0 2024-05-08T18:31:20.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.651+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.651+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x557c0d4c5db0 2024-05-08T18:31:20.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.651+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.651+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x7f614400f070 2024-05-08T18:31:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.651+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.651+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x7f614400f070 2024-05-08T18:31:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.651+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.651+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x7f614c035020 2024-05-08T18:31:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.651+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614402e070 con 0x7f614c035020 2024-05-08T18:31:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.651+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x557c0d4cbe20 2024-05-08T18:31:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.652+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.652+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x557c0d4c5db0 2024-05-08T18:31:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.652+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.652+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x7f614400f070 2024-05-08T18:31:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.652+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.652+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x557c0d4c5db0 2024-05-08T18:31:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.652+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.652+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x7f614c035020 2024-05-08T18:31:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.653+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f614402e070 con 0x7f614c035020 2024-05-08T18:31:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.653+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x557c0d4cbe20 2024-05-08T18:31:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.653+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.653+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x557c0d4cbe20 2024-05-08T18:31:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.653+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.653+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x7f614400f070 2024-05-08T18:31:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.653+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.653+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x557c0d4cbe20 2024-05-08T18:31:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.654+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.654+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x557c0d4cbe20 2024-05-08T18:31:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.654+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.654+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x557c0d4c5db0 2024-05-08T18:31:20.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.654+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.654+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x557c0d4c5db0 2024-05-08T18:31:20.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.654+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.654+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x7f614400f070 2024-05-08T18:31:20.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.655+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.655+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x557c0d4cbe20 2024-05-08T18:31:20.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.655+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.655+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x7f614c035020 2024-05-08T18:31:20.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.655+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614402e070 con 0x7f614c035020 2024-05-08T18:31:20.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.655+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x557c0d4c5db0 2024-05-08T18:31:20.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.655+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.655+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x7f614400f070 2024-05-08T18:31:20.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.656+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.656+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x557c0d4cbe20 2024-05-08T18:31:20.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.656+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.656+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x7f614400f070 2024-05-08T18:31:20.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.656+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.656+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x7f614c035020 2024-05-08T18:31:20.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.657+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614402e070 con 0x7f614c035020 2024-05-08T18:31:20.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.657+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x557c0d4cbe20 2024-05-08T18:31:20.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.657+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.657+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x7f614400f070 2024-05-08T18:31:20.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.657+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.657+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x557c0d4c5db0 2024-05-08T18:31:20.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.657+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.657+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ce940 con 0x7f614c035020 2024-05-08T18:31:20.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614402e070 con 0x7f614c035020 2024-05-08T18:31:20.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:20.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:20.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:20.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:20.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:20.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:20.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ca8c0 con 0x557c0d4c5db0 2024-05-08T18:31:20.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4cb160 con 0x557c0d4c5db0 2024-05-08T18:31:20.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:20.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4ca500 con 0x7f614400f070 2024-05-08T18:31:20.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:20.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 20 zone default found 2024-05-08T18:31:20.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 4 Realm: () 2024-05-08T18:31:20.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:20.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:20.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:20.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 20 zonegroup default 2024-05-08T18:31:20.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.658+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4cee10 con 0x7f614400f070 2024-05-08T18:31:20.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.659+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.659+0000 7f6156a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.659+0000 7f6156a0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.659+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d0ca0 con 0x557c0d4cbe20 2024-05-08T18:31:20.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.659+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.659+0000 7f6156a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.659+0000 7f6156a0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.659+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d1040 con 0x557c0d4cbe20 2024-05-08T18:31:20.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.659+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.659+0000 7f6156a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.659+0000 7f6156a0f800 20 started sync module instance, tier type = 2024-05-08T18:31:20.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.659+0000 7f6156a0f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:20.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.659+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d00e0 con 0x7f614c035020 2024-05-08T18:31:20.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.660+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614402e070 con 0x7f614c035020 2024-05-08T18:31:20.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.660+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93991287457024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d1890 con 0x7f614c035020 2024-05-08T18:31:20.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.660+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d20e0 con 0x557c0d4c5db0 2024-05-08T18:31:20.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.661+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93991287457024] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614402e070 con 0x7f614c035020 2024-05-08T18:31:20.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.661+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.661+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93991287460832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d2120 con 0x557c0d4c5db0 2024-05-08T18:31:20.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.661+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d2c30 con 0x557c0d4cbe20 2024-05-08T18:31:20.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.662+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.662+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93991287465696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d34d0 con 0x557c0d4cbe20 2024-05-08T18:31:20.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.662+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d3fd0 con 0x7f614c035020 2024-05-08T18:31:20.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.663+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93991287460832] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.663+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93991287465696] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.663+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614402e070 con 0x7f614c035020 2024-05-08T18:31:20.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.663+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93991287462960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d34d0 con 0x7f614c035020 2024-05-08T18:31:20.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.663+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d48d0 con 0x557c0d4c5db0 2024-05-08T18:31:20.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.664+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.664+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93991287473088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d5170 con 0x557c0d4c5db0 2024-05-08T18:31:20.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.664+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d5c10 con 0x7f614400f070 2024-05-08T18:31:20.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.664+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93991287462960] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614402e070 con 0x7f614c035020 2024-05-08T18:31:20.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.665+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93991287473088] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.666+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.666+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93991287477984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d4c70 con 0x7f614400f070 2024-05-08T18:31:20.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.666+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d64b0 con 0x7f614400f070 2024-05-08T18:31:20.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.667+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93991287477984] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.667+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.667+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93991287475088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d5f10 con 0x7f614400f070 2024-05-08T18:31:20.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.667+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d6a10 con 0x7f614400f070 2024-05-08T18:31:20.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.668+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93991287475088] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.668+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.668+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93991287481600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d69d0 con 0x7f614400f070 2024-05-08T18:31:20.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.668+0000 7f6156a0f800 20 add_watcher() i=0 2024-05-08T18:31:20.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.668+0000 7f6156a0f800 20 add_watcher() i=1 2024-05-08T18:31:20.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.668+0000 7f6156a0f800 20 add_watcher() i=2 2024-05-08T18:31:20.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.668+0000 7f6156a0f800 20 add_watcher() i=3 2024-05-08T18:31:20.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.668+0000 7f6156a0f800 20 add_watcher() i=4 2024-05-08T18:31:20.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.668+0000 7f6156a0f800 20 add_watcher() i=5 2024-05-08T18:31:20.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.668+0000 7f6156a0f800 20 add_watcher() i=6 2024-05-08T18:31:20.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.669+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93991287481600] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.669+0000 7f6156a0f800 20 add_watcher() i=7 2024-05-08T18:31:20.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.669+0000 7f6156a0f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:20.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.669+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d9e60 con 0x557c0d4c5db0 2024-05-08T18:31:20.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.669+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.669+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93991287468064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d4d7380 con 0x557c0d4c5db0 2024-05-08T18:31:20.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.670+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93991287468064] v27'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.670+0000 7f6008fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:20.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.670+0000 7f6156a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:20.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.670+0000 7f6156a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:20.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.670+0000 7f6156a0f800 5 note: GC not initialized 2024-05-08T18:31:20.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.670+0000 7f5f837fe640 20 reqs_thread_entry: start 2024-05-08T18:31:20.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.671+0000 7f6156a0f800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:20.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.671+0000 7f6156a0f800 20 Filter name: none 2024-05-08T18:31:20.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.671+0000 7f5f817fa640 20 reqs_thread_entry: start 2024-05-08T18:31:20.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.671+0000 7f6156a0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.671+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d50d2d0 con 0x7f614c035020 2024-05-08T18:31:20.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.671+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f614402e070 con 0x7f614c035020 2024-05-08T18:31:20.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.671+0000 7f6156a0f800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:20.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.671+0000 7f6156a0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.671+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:63 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d50deb0 con 0x557c0d4cbe20 2024-05-08T18:31:20.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.671+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(63 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f6156a0f800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:20.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f6156a0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:31:20.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f6156a0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d50de60 con 0x7f614c035020 2024-05-08T18:31:20.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f614402e070 con 0x7f614c035020 2024-05-08T18:31:20.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f6156a0f800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:20.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f6156a0f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:65 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d50de60 con 0x557c0d4cbe20 2024-05-08T18:31:20.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(65 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f6156a0f800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:20.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f6156a0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:31:20.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 4.3c 4:3e5af247:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d510a90 con 0x557c0d4c5db0 2024-05-08T18:31:20.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 4.13 4:c87a77a1:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d5134a0 con 0x7f614c035020 2024-05-08T18:31:20.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:68 4.2d 4:b6c641c8:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d515e00 con 0x7f614400f070 2024-05-08T18:31:20.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 4.8 4:106dbb9b:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d518a10 con 0x557c0d4cbe20 2024-05-08T18:31:20.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 4.28 4:146af900:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d515e00 con 0x557c0d4c5db0 2024-05-08T18:31:20.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 4.6 4:613ec2f8:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d51d9e0 con 0x557c0d4cbe20 2024-05-08T18:31:20.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 4.32 4:4ef39ee1:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d5203c0 con 0x557c0d4c5db0 2024-05-08T18:31:20.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.672+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 4.1c 4:38258a38:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d523260 con 0x7f614400f070 2024-05-08T18:31:20.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.673+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:74 4.38 4:1e0d588e:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d526120 con 0x557c0d4c5db0 2024-05-08T18:31:20.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.673+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 4.f 4:f0da020c:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d528fe0 con 0x557c0d4c5db0 2024-05-08T18:31:20.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.673+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:76 4.1d 4:baf32667:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557c0d52bdd0 con 0x557c0d4cbe20 2024-05-08T18:31:20.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.673+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(67 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f614402e070 con 0x7f614c035020 2024-05-08T18:31:20.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.673+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(69 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.673+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(71 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.673+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(76 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.673+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(68 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.673+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(66 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.673+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(70 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.673+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(72 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.673+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(75 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.673+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(74 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.673+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(73 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.674+0000 7f6008fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.674+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93991287468064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d5203c0 con 0x557c0d4c5db0 2024-05-08T18:31:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.675+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93991287468064] v27'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.675+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93991287457024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d5203c0 con 0x7f614c035020 2024-05-08T18:31:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.676+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93991287457024] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614402e070 con 0x7f614c035020 2024-05-08T18:31:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.676+0000 7f6156a0f800 20 remove_watcher() i=0 2024-05-08T18:31:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.676+0000 7f6156a0f800 2 removed watcher, disabling cache 2024-05-08T18:31:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.676+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93991287460832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d5203c0 con 0x557c0d4c5db0 2024-05-08T18:31:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.677+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93991287460832] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.677+0000 7f6156a0f800 20 remove_watcher() i=1 2024-05-08T18:31:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.677+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93991287465696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d5203c0 con 0x557c0d4cbe20 2024-05-08T18:31:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.678+0000 7f615280e640 1 -- 172.21.15.87:0/1531087610 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93991287465696] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c051020 con 0x557c0d4cbe20 2024-05-08T18:31:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.678+0000 7f6156a0f800 20 remove_watcher() i=2 2024-05-08T18:31:20.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.678+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93991287462960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d5203c0 con 0x7f614c035020 2024-05-08T18:31:20.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.679+0000 7f615200d640 1 -- 172.21.15.87:0/1531087610 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93991287462960] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614402e070 con 0x7f614c035020 2024-05-08T18:31:20.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.679+0000 7f6156a0f800 20 remove_watcher() i=3 2024-05-08T18:31:20.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.679+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93991287473088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d5203c0 con 0x557c0d4c5db0 2024-05-08T18:31:20.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.680+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93991287473088] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x557c0d4c5db0 2024-05-08T18:31:20.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.680+0000 7f6156a0f800 20 remove_watcher() i=4 2024-05-08T18:31:20.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.680+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93991287477984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d5203c0 con 0x7f614400f070 2024-05-08T18:31:20.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.681+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93991287477984] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.681+0000 7f6156a0f800 20 remove_watcher() i=5 2024-05-08T18:31:20.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.681+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93991287475088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d5203c0 con 0x7f614400f070 2024-05-08T18:31:20.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.682+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93991287475088] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.682+0000 7f6156a0f800 20 remove_watcher() i=6 2024-05-08T18:31:20.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.682+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93991287481600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557c0d5203c0 con 0x7f614400f070 2024-05-08T18:31:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93991287481600] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f613c05a040 con 0x7f614400f070 2024-05-08T18:31:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 20 remove_watcher() i=7 2024-05-08T18:31:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f614400f070 msgr2=0x7f614401d7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f614400f070 0x7f614401d7f0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557c0d4c5db0 msgr2=0x557c0d4c8270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557c0d4c5db0 0x557c0d4c8270 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f614c035020 msgr2=0x7f614c02baa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f614c035020 0x7f614c02baa0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x557c0d4cbe20 msgr2=0x557c0d4ce270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x557c0d4cbe20 0x557c0d4ce270 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f601c03bb50 msgr2=0x7f601c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f601c03bb50 0x7f601c03e010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f614403f470 tx=0x7f6144047000 comp rx=0 tx=0).stop 2024-05-08T18:31:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4b2b50 msgr2=0x557c0d4ba0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4b2b50 0x557c0d4ba0d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f614c02a500 tx=0x7f614c052940 comp rx=0 tx=0).stop 2024-05-08T18:31:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f614980c640 1 -- 172.21.15.87:0/1531087610 reap_dead start 2024-05-08T18:31:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 shutdown_connections 2024-05-08T18:31:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 --2- 172.21.15.87:0/1531087610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4b2b50 0x557c0d4ba0d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 >> 172.21.15.87:0/1531087610 conn(0x557c0d4aeeb0 msgr2=0x557c0d4ac510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 shutdown_connections 2024-05-08T18:31:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 -- 172.21.15.87:0/1531087610 wait complete. 2024-05-08T18:31:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 -- 172.21.15.87:0/134109184 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f602c03bba0 msgr2=0x7f602c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 --2- 172.21.15.87:0/134109184 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f602c03bba0 0x7f602c03e060 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f614401cfd0 tx=0x7f6144051800 comp rx=0 tx=0).stop 2024-05-08T18:31:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 -- 172.21.15.87:0/134109184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4a5850 msgr2=0x557c0d4a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 --2- 172.21.15.87:0/134109184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4a5850 0x557c0d4a5c70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x557c0d491ee0 tx=0x7f614c0178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.683+0000 7f6156a0f800 1 -- 172.21.15.87:0/134109184 shutdown_connections 2024-05-08T18:31:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 --2- 172.21.15.87:0/134109184 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f602c03bba0 0x7f602c03e060 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 --2- 172.21.15.87:0/134109184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d4a5850 0x557c0d4a5c70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 -- 172.21.15.87:0/134109184 >> 172.21.15.87:0/134109184 conn(0x557c0d4998f0 msgr2=0x557c0d499cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 -- 172.21.15.87:0/134109184 shutdown_connections 2024-05-08T18:31:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 -- 172.21.15.87:0/134109184 wait complete. 2024-05-08T18:31:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 -- 172.21.15.87:0/2234139171 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x557c0d493530 msgr2=0x557c0d496d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x557c0d493530 0x557c0d496d70 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 -- 172.21.15.87:0/2234139171 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557c0d304da0 msgr2=0x557c0d491550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557c0d304da0 0x557c0d491550 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 -- 172.21.15.87:0/2234139171 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f603803bb50 msgr2=0x7f603803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f603803bb50 0x7f603803e010 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f613c054000 tx=0x7f613c04e000 comp rx=0 tx=0).stop 2024-05-08T18:31:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 -- 172.21.15.87:0/2234139171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 msgr2=0x557c0d48a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 0x557c0d48a360 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x557c0d483550 tx=0x7f6144000bc0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 -- 172.21.15.87:0/2234139171 shutdown_connections 2024-05-08T18:31:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557c0d304da0 0x557c0d491550 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x557c0d493530 0x557c0d496d70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f603803bb50 0x7f603803e010 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 --2- 172.21.15.87:0/2234139171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c0d303a10 0x557c0d48a360 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 -- 172.21.15.87:0/2234139171 >> 172.21.15.87:0/2234139171 conn(0x557c0d38a830 msgr2=0x557c0d47c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 -- 172.21.15.87:0/2234139171 shutdown_connections 2024-05-08T18:31:20.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.684+0000 7f6156a0f800 1 -- 172.21.15.87:0/2234139171 wait complete. 2024-05-08T18:31:20.701 INFO:teuthology.orchestra.run.smithi087.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"603f2301-f6d0-4df6-aa57-6b1659110044","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1","marker":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-08T18:31:19.870084Z","creation_time":"2024-05-08T18:31:19.867262Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-08T18:31:20.701 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '603f2301-f6d0-4df6-aa57-6b1659110044', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1', 'marker': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:31:19.870084Z', 'creation_time': '2024-05-08T18:31:19.867262Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:31:20.701 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-05-08T18:31:20.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-05-08T18:31:20.701 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-05-08T18:31:20.746 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:20.747 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:20.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.749+0000 7fbb2d10a800 1 Processor -- start 2024-05-08T18:31:20.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.749+0000 7fbb2d10a800 1 -- start start 2024-05-08T18:31:20.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.749+0000 7fbb2d10a800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f91a0f12c0 0x55f91a0f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.749+0000 7fbb2d10a800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f91a0f1d60 con 0x55f91a0f2480 2024-05-08T18:31:20.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.749+0000 7fbb2d10a800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f919f91e20 con 0x55f91a0f12c0 2024-05-08T18:31:20.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.750+0000 7fbb2ac02640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f91a0f12c0 0x55f91a0f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.750+0000 7fbb2a401640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55f91a0f2480 0x55f91a0f2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42098/0 (socket says 172.21.15.87:42098) 2024-05-08T18:31:20.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.750+0000 7fbb2a401640 1 -- 172.21.15.87:0/763055375 learned_addr learned my addr 172.21.15.87:0/763055375 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:20.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.750+0000 7fbb2ac02640 1 -- 172.21.15.87:0/763055375 >> v1:172.21.15.53:6789/0 conn(0x55f91a0f2480 legacy=0x55f91a0f2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.750+0000 7fbb2ac02640 1 -- 172.21.15.87:0/763055375 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f91a0f3040 con 0x55f91a0f12c0 2024-05-08T18:31:20.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.752+0000 7fbb2ac02640 1 --2- 172.21.15.87:0/763055375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 0x55f91a0f16e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00a470 tx=0x7fbb1c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700e50d4b781d61c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.752+0000 7fbb29c00640 1 -- 172.21.15.87:0/763055375 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb1c057070 con 0x55f91a0f12c0 2024-05-08T18:31:20.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.752+0000 7fbb29c00640 1 -- 172.21.15.87:0/763055375 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb1c04adc0 con 0x55f91a0f12c0 2024-05-08T18:31:20.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.752+0000 7fbb29c00640 1 -- 172.21.15.87:0/763055375 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb1c052590 con 0x55f91a0f12c0 2024-05-08T18:31:20.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.753+0000 7fbb2d10a800 1 -- 172.21.15.87:0/763055375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 msgr2=0x55f91a0f16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.753+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/763055375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 0x55f91a0f16e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00a470 tx=0x7fbb1c01ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:20.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.753+0000 7fbb2d10a800 1 -- 172.21.15.87:0/763055375 shutdown_connections 2024-05-08T18:31:20.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.753+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/763055375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 0x55f91a0f16e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.753+0000 7fbb2d10a800 1 -- 172.21.15.87:0/763055375 >> 172.21.15.87:0/763055375 conn(0x55f91a0ec840 msgr2=0x55f91a0eec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.753+0000 7fbb2d10a800 1 -- 172.21.15.87:0/763055375 shutdown_connections 2024-05-08T18:31:20.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.753+0000 7fbb2d10a800 1 -- 172.21.15.87:0/763055375 wait complete. 2024-05-08T18:31:20.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.766+0000 7fbb2d10a800 1 Processor -- start 2024-05-08T18:31:20.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.766+0000 7fbb2d10a800 1 -- start start 2024-05-08T18:31:20.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.767+0000 7fbb2d10a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 0x55f91a1e26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.767+0000 7fbb2d10a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f91a03c5c0 con 0x55f91a0f12c0 2024-05-08T18:31:20.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.767+0000 7fbb2ac02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 0x55f91a1e26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.767+0000 7fbb2ac02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 0x55f91a1e26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33876/0 (socket says 172.21.15.87:33876) 2024-05-08T18:31:20.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.767+0000 7fbb2ac02640 1 -- 172.21.15.87:0/1934995279 learned_addr learned my addr 172.21.15.87:0/1934995279 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.767+0000 7fbb2ac02640 1 -- 172.21.15.87:0/1934995279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f91a1e2c80 con 0x55f91a0f12c0 2024-05-08T18:31:20.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.767+0000 7fbb2ac02640 1 --2- 172.21.15.87:0/1934995279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 0x55f91a1e26b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c01ced0 tx=0x7fbb1c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8570e4fad7d0b454 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.768+0000 7fba18e09640 1 -- 172.21.15.87:0/1934995279 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb1c057040 con 0x55f91a0f12c0 2024-05-08T18:31:20.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.768+0000 7fba18e09640 1 -- 172.21.15.87:0/1934995279 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb1c063070 con 0x55f91a0f12c0 2024-05-08T18:31:20.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.768+0000 7fba18e09640 1 -- 172.21.15.87:0/1934995279 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb1c052800 con 0x55f91a0f12c0 2024-05-08T18:31:20.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.768+0000 7fbb2d10a800 1 -- 172.21.15.87:0/1934995279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 msgr2=0x55f91a1e26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.768+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/1934995279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 0x55f91a1e26b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c01ced0 tx=0x7fbb1c04c000 comp rx=0 tx=0).stop 2024-05-08T18:31:20.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.768+0000 7fbb2d10a800 1 -- 172.21.15.87:0/1934995279 shutdown_connections 2024-05-08T18:31:20.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.768+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/1934995279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 0x55f91a1e26b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.768+0000 7fbb2d10a800 1 -- 172.21.15.87:0/1934995279 >> 172.21.15.87:0/1934995279 conn(0x55f91a0ec840 msgr2=0x55f91a1ddfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.768+0000 7fbb2d10a800 1 -- 172.21.15.87:0/1934995279 shutdown_connections 2024-05-08T18:31:20.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.768+0000 7fbb2d10a800 1 -- 172.21.15.87:0/1934995279 wait complete. 2024-05-08T18:31:20.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.769+0000 7fbb2d10a800 1 Processor -- start 2024-05-08T18:31:20.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.769+0000 7fbb2d10a800 1 -- start start 2024-05-08T18:31:20.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.769+0000 7fbb2d10a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 0x55f91a1ea170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.769+0000 7fbb2d10a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f91a0fa950 con 0x55f91a0f12c0 2024-05-08T18:31:20.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.769+0000 7fbb2ac02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 0x55f91a1ea170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.769+0000 7fbb2ac02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 0x55f91a1ea170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33888/0 (socket says 172.21.15.87:33888) 2024-05-08T18:31:20.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.769+0000 7fbb2ac02640 1 -- 172.21.15.87:0/2078436147 learned_addr learned my addr 172.21.15.87:0/2078436147 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.769+0000 7fbb2ac02640 1 -- 172.21.15.87:0/2078436147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f91a1ea6b0 con 0x55f91a0f12c0 2024-05-08T18:31:20.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.770+0000 7fbb2ac02640 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 0x55f91a1ea170 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c01ced0 tx=0x7fbb1c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.770+0000 7fba17606640 1 -- 172.21.15.87:0/2078436147 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb1c06d070 con 0x55f91a0f12c0 2024-05-08T18:31:20.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.770+0000 7fba17606640 1 -- 172.21.15.87:0/2078436147 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb1c052d20 con 0x55f91a0f12c0 2024-05-08T18:31:20.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.770+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2078436147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f91a1ea940 con 0x55f91a0f12c0 2024-05-08T18:31:20.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.770+0000 7fba17606640 1 -- 172.21.15.87:0/2078436147 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb1c057050 con 0x55f91a0f12c0 2024-05-08T18:31:20.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.770+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2078436147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f91a1ed550 con 0x55f91a0f12c0 2024-05-08T18:31:20.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.771+0000 7fba17606640 1 -- 172.21.15.87:0/2078436147 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbb1c05d470 con 0x55f91a0f12c0 2024-05-08T18:31:20.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.771+0000 7fba17606640 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fba1003bb50 0x7fba1003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.771+0000 7fba17606640 1 -- 172.21.15.87:0/2078436147 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fbb1c094120 con 0x55f91a0f12c0 2024-05-08T18:31:20.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.771+0000 7fbb2a401640 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fba1003bb50 0x7fba1003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.771+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f91a0f2480 0x55f91a1f1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.771+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2078436147 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a1f1890 con 0x55f91a0f2480 2024-05-08T18:31:20.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.771+0000 7fbb2b403640 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f91a0f2480 0x55f91a1f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.771+0000 7fbb2a401640 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fba1003bb50 0x7fba1003e010 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbb20001d90 tx=0x7fbb200012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.771+0000 7fbb2b403640 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f91a0f2480 0x55f91a1f1310 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.772+0000 7fbb2b403640 1 -- 172.21.15.87:0/2078436147 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb2400a4a0 con 0x55f91a0f2480 2024-05-08T18:31:20.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.772+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2078436147 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a1f2130 con 0x55f91a0f2480 2024-05-08T18:31:20.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.772+0000 7fbb2b403640 1 -- 172.21.15.87:0/2078436147 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb2400a4a0 con 0x55f91a0f2480 2024-05-08T18:31:20.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.772+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2078436147 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a1f34e0 con 0x55f91a0f2480 2024-05-08T18:31:20.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.772+0000 7fbb2b403640 1 -- 172.21.15.87:0/2078436147 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbb2400a4a0 con 0x55f91a0f2480 2024-05-08T18:31:20.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.772+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2078436147 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a1f2980 con 0x55f91a0f2480 2024-05-08T18:31:20.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.773+0000 7fbb2b403640 1 -- 172.21.15.87:0/2078436147 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb2400a4a0 con 0x55f91a0f2480 2024-05-08T18:31:20.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.773+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f91a1f4890 0x55f91a1f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.773+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2078436147 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a1f7290 con 0x55f91a1f4890 2024-05-08T18:31:20.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.773+0000 7fbb2ac02640 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f91a1f4890 0x55f91a1f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.773+0000 7fbb2ac02640 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f91a1f4890 0x55f91a1f6c80 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.773+0000 7fbb2ac02640 1 -- 172.21.15.87:0/2078436147 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbb1c078070 con 0x55f91a1f4890 2024-05-08T18:31:20.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.774+0000 7fbb2d10a800 1 Processor -- start 2024-05-08T18:31:20.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.774+0000 7fbb2d10a800 1 -- start start 2024-05-08T18:31:20.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.774+0000 7fbb2d10a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a205600 0x55f91a205a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.774+0000 7fbb2d10a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f919fe2fc0 con 0x55f91a205600 2024-05-08T18:31:20.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.774+0000 7fbb2b403640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a205600 0x55f91a205a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.774+0000 7fbb2b403640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a205600 0x55f91a205a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33900/0 (socket says 172.21.15.87:33900) 2024-05-08T18:31:20.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.774+0000 7fbb2b403640 1 -- 172.21.15.87:0/2537592545 learned_addr learned my addr 172.21.15.87:0/2537592545 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.774+0000 7fbb2b403640 1 -- 172.21.15.87:0/2537592545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f91a205f60 con 0x55f91a205600 2024-05-08T18:31:20.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.774+0000 7fbb2b403640 1 --2- 172.21.15.87:0/2537592545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a205600 0x55f91a205a20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x55f91a1eaf90 tx=0x7fbb240178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.775+0000 7fba14e01640 1 -- 172.21.15.87:0/2537592545 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb24013440 con 0x55f91a205600 2024-05-08T18:31:20.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.775+0000 7fba14e01640 1 -- 172.21.15.87:0/2537592545 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb240135e0 con 0x55f91a205600 2024-05-08T18:31:20.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.775+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2537592545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f91a2069d0 con 0x55f91a205600 2024-05-08T18:31:20.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.775+0000 7fba14e01640 1 -- 172.21.15.87:0/2537592545 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb240138c0 con 0x55f91a205600 2024-05-08T18:31:20.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.775+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2537592545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f91a206ed0 con 0x55f91a205600 2024-05-08T18:31:20.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.775+0000 7fba14e01640 1 -- 172.21.15.87:0/2537592545 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbb24011040 con 0x55f91a205600 2024-05-08T18:31:20.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.776+0000 7fba14e01640 1 --2- 172.21.15.87:0/2537592545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fba0403bba0 0x7fba0403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.776+0000 7fba14e01640 1 -- 172.21.15.87:0/2537592545 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fbb2401d070 con 0x55f91a205600 2024-05-08T18:31:20.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.776+0000 7fbb2ac02640 1 --2- 172.21.15.87:0/2537592545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fba0403bba0 0x7fba0403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.776+0000 7fbb2d10a800 1 Processor -- start 2024-05-08T18:31:20.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.776+0000 7fbb2ac02640 1 --2- 172.21.15.87:0/2537592545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fba0403bba0 0x7fba0403e060 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55f91a1f2d20 tx=0x7fbb1c092630 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.776+0000 7fbb2d10a800 1 -- start start 2024-05-08T18:31:20.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.776+0000 7fbb2d10a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a2128b0 0x55f91a212cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.776+0000 7fbb2d10a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f91a1e2f40 con 0x55f91a2128b0 2024-05-08T18:31:20.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.776+0000 7fbb2b403640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a2128b0 0x55f91a212cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.776+0000 7fbb2b403640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a2128b0 0x55f91a212cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33904/0 (socket says 172.21.15.87:33904) 2024-05-08T18:31:20.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.776+0000 7fbb2b403640 1 -- 172.21.15.87:0/2786625011 learned_addr learned my addr 172.21.15.87:0/2786625011 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.777+0000 7fbb2b403640 1 -- 172.21.15.87:0/2786625011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f91a2132a0 con 0x55f91a2128b0 2024-05-08T18:31:20.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.777+0000 7fbb2b403640 1 --2- 172.21.15.87:0/2786625011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a2128b0 0x55f91a212cd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400b010 tx=0x7fbb24001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448562338fd00a45 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.777+0000 7fba0e7fc640 1 -- 172.21.15.87:0/2786625011 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb24021d70 con 0x55f91a2128b0 2024-05-08T18:31:20.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.777+0000 7fba0e7fc640 1 -- 172.21.15.87:0/2786625011 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb2402ac50 con 0x55f91a2128b0 2024-05-08T18:31:20.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.777+0000 7fba0e7fc640 1 -- 172.21.15.87:0/2786625011 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb240540d0 con 0x55f91a2128b0 2024-05-08T18:31:20.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.777+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2786625011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a2128b0 msgr2=0x55f91a212cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.777+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/2786625011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a2128b0 0x55f91a212cd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400b010 tx=0x7fbb24001b30 comp rx=0 tx=0).stop 2024-05-08T18:31:20.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.777+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2786625011 shutdown_connections 2024-05-08T18:31:20.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.777+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/2786625011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a2128b0 0x55f91a212cd0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.777+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2786625011 >> 172.21.15.87:0/2786625011 conn(0x55f91a20ec60 msgr2=0x55f91a20ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.777+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2786625011 shutdown_connections 2024-05-08T18:31:20.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.777+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2786625011 wait complete. 2024-05-08T18:31:20.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.778+0000 7fbb2d10a800 1 Processor -- start 2024-05-08T18:31:20.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.778+0000 7fbb2d10a800 1 -- start start 2024-05-08T18:31:20.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.778+0000 7fbb2d10a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a2128b0 0x55f91a219ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.778+0000 7fbb2d10a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f91a213a00 con 0x55f91a2128b0 2024-05-08T18:31:20.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.778+0000 7fbb2b403640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a2128b0 0x55f91a219ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.778+0000 7fbb2b403640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a2128b0 0x55f91a219ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33916/0 (socket says 172.21.15.87:33916) 2024-05-08T18:31:20.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.778+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 learned_addr learned my addr 172.21.15.87:0/490808324 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.778+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f91a21a410 con 0x55f91a2128b0 2024-05-08T18:31:20.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.778+0000 7fbb2b403640 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a2128b0 0x55f91a219ed0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbb24051810 tx=0x7fbb2400a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.779+0000 7fba0cff9640 1 -- 172.21.15.87:0/490808324 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb24015ab0 con 0x55f91a2128b0 2024-05-08T18:31:20.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.779+0000 7fba0cff9640 1 -- 172.21.15.87:0/490808324 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb2402ae00 con 0x55f91a2128b0 2024-05-08T18:31:20.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.779+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f91a21a6a0 con 0x55f91a2128b0 2024-05-08T18:31:20.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.779+0000 7fba0cff9640 1 -- 172.21.15.87:0/490808324 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb24013a60 con 0x55f91a2128b0 2024-05-08T18:31:20.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.779+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f91a21d350 con 0x55f91a2128b0 2024-05-08T18:31:20.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.779+0000 7fba0cff9640 1 -- 172.21.15.87:0/490808324 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbb24033030 con 0x55f91a2128b0 2024-05-08T18:31:20.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.780+0000 7fba0cff9640 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb9f403bba0 0x7fb9f403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.780+0000 7fba0cff9640 1 -- 172.21.15.87:0/490808324 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fbb24031070 con 0x55f91a2128b0 2024-05-08T18:31:20.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.780+0000 7fbb2d10a800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.780+0000 7fbb2ac02640 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb9f403bba0 0x7fb9f403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.780+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f91a225b20 0x55f91a227fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.780+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a228710 con 0x55f91a225b20 2024-05-08T18:31:20.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.780+0000 7fbb2a401640 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f91a225b20 0x55f91a227fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.780+0000 7fbb2ac02640 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb9f403bba0 0x7fb9f403e060 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55f91a1f7690 tx=0x7fbb1c081000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.780+0000 7fbb2a401640 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f91a225b20 0x55f91a227fc0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb20009050 con 0x55f91a225b20 2024-05-08T18:31:20.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2d10a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2d10a800 20 realm 2024-05-08T18:31:20.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2d10a800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a225030 con 0x55f91a225b20 2024-05-08T18:31:20.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb20009050 con 0x55f91a225b20 2024-05-08T18:31:20.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2d10a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2d10a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:20.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2d10a800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a2291e0 con 0x55f91a225b20 2024-05-08T18:31:20.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb20009050 con 0x55f91a225b20 2024-05-08T18:31:20.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2d10a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2d10a800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a229730 con 0x55f91a225b20 2024-05-08T18:31:20.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb20009050 con 0x55f91a225b20 2024-05-08T18:31:20.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2d10a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:20.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2d10a800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.781+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22a020 con 0x55f91a225b20 2024-05-08T18:31:20.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.782+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbb20009050 con 0x55f91a225b20 2024-05-08T18:31:20.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.782+0000 7fbb2d10a800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:20.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.782+0000 7fbb2d10a800 20 searching for the correct realm 2024-05-08T18:31:20.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.782+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f91a22bd90 0x55f91a22e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.782+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x55f91a22bd90 2024-05-08T18:31:20.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.782+0000 7fbb2b403640 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f91a22bd90 0x55f91a22e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.782+0000 7fbb2b403640 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f91a22bd90 0x55f91a22e180 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.782+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.782+0000 7fbb2b403640 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fbb2402cb90 0x7fbb240298f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.783+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x7fbb2402cb90 2024-05-08T18:31:20.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.783+0000 7fbb2ac02640 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fbb2402cb90 0x7fbb240298f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.783+0000 7fbb2ac02640 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fbb2402cb90 0x7fbb240298f0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.783+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb1c078070 con 0x7fbb2402cb90 2024-05-08T18:31:20.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.783+0000 7fbb2ac02640 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fbb1c087040 0x7fbb1c05b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.783+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x7fbb1c087040 2024-05-08T18:31:20.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.783+0000 7fbb2a401640 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fbb1c087040 0x7fbb1c05b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.784+0000 7fbb2a401640 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fbb1c087040 0x7fbb1c05b370 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.784+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb20009050 con 0x7fbb1c087040 2024-05-08T18:31:20.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.784+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x55f91a225b20 2024-05-08T18:31:20.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.784+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb20009050 con 0x55f91a225b20 2024-05-08T18:31:20.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.784+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x55f91a225b20 2024-05-08T18:31:20.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.785+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.785+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x7fbb1c087040 2024-05-08T18:31:20.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.785+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.785+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x7fbb1c087040 2024-05-08T18:31:20.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.785+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.785+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x7fbb2402cb90 2024-05-08T18:31:20.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.785+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb1c078070 con 0x7fbb2402cb90 2024-05-08T18:31:20.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.785+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x55f91a22bd90 2024-05-08T18:31:20.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.786+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.786+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x55f91a225b20 2024-05-08T18:31:20.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.786+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.786+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x7fbb1c087040 2024-05-08T18:31:20.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.786+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.786+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x55f91a225b20 2024-05-08T18:31:20.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.786+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.787+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x7fbb2402cb90 2024-05-08T18:31:20.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.787+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbb1c078070 con 0x7fbb2402cb90 2024-05-08T18:31:20.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.787+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x55f91a22bd90 2024-05-08T18:31:20.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.787+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.787+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x55f91a22bd90 2024-05-08T18:31:20.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.787+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.787+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x7fbb1c087040 2024-05-08T18:31:20.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.787+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.787+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x55f91a22bd90 2024-05-08T18:31:20.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.788+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.788+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x55f91a22bd90 2024-05-08T18:31:20.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.788+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.788+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x55f91a225b20 2024-05-08T18:31:20.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.788+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.788+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x55f91a225b20 2024-05-08T18:31:20.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.788+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.788+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x7fbb1c087040 2024-05-08T18:31:20.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.789+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.789+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x55f91a22bd90 2024-05-08T18:31:20.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.789+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.789+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x7fbb2402cb90 2024-05-08T18:31:20.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.789+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb1c078070 con 0x7fbb2402cb90 2024-05-08T18:31:20.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.789+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x55f91a225b20 2024-05-08T18:31:20.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.789+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.789+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x7fbb1c087040 2024-05-08T18:31:20.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.789+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.789+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x55f91a22bd90 2024-05-08T18:31:20.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.790+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.790+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x7fbb1c087040 2024-05-08T18:31:20.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.790+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.790+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x7fbb2402cb90 2024-05-08T18:31:20.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.790+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb1c078070 con 0x7fbb2402cb90 2024-05-08T18:31:20.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.790+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x55f91a22bd90 2024-05-08T18:31:20.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.790+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.790+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x7fbb1c087040 2024-05-08T18:31:20.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.791+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.791+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x55f91a225b20 2024-05-08T18:31:20.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.791+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.791+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22e800 con 0x7fbb2402cb90 2024-05-08T18:31:20.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.791+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb1c078070 con 0x7fbb2402cb90 2024-05-08T18:31:20.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.791+0000 7fbb2d10a800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:20.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.791+0000 7fbb2d10a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:20.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.791+0000 7fbb2d10a800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:20.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.791+0000 7fbb2d10a800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:20.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.791+0000 7fbb2d10a800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:20.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.791+0000 7fbb2d10a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:20.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.791+0000 7fbb2d10a800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.791+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22a9a0 con 0x55f91a225b20 2024-05-08T18:31:20.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.791+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2d10a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2d10a800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22b240 con 0x55f91a225b20 2024-05-08T18:31:20.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2d10a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:20.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2d10a800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22a5e0 con 0x7fbb1c087040 2024-05-08T18:31:20.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2d10a800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:20.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2d10a800 20 zone default found 2024-05-08T18:31:20.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2d10a800 4 Realm: () 2024-05-08T18:31:20.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2d10a800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:20.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2d10a800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:20.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2d10a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:20.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2d10a800 20 zonegroup default 2024-05-08T18:31:20.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2d10a800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22ec60 con 0x7fbb1c087040 2024-05-08T18:31:20.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.792+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.793+0000 7fbb2d10a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.793+0000 7fbb2d10a800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.793+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a230af0 con 0x55f91a22bd90 2024-05-08T18:31:20.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.793+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.793+0000 7fbb2d10a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.793+0000 7fbb2d10a800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.793+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a230e90 con 0x55f91a22bd90 2024-05-08T18:31:20.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.793+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.793+0000 7fbb2d10a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.793+0000 7fbb2d10a800 20 started sync module instance, tier type = 2024-05-08T18:31:20.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.793+0000 7fbb2d10a800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:20.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.793+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a22ff30 con 0x7fbb2402cb90 2024-05-08T18:31:20.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.794+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb1c078070 con 0x7fbb2402cb90 2024-05-08T18:31:20.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.794+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94528373719840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a230740 con 0x7fbb2402cb90 2024-05-08T18:31:20.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.794+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a231bd0 con 0x55f91a225b20 2024-05-08T18:31:20.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.795+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94528373719840] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb1c078070 con 0x7fbb2402cb90 2024-05-08T18:31:20.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.795+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.795+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94528373723696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a231fc0 con 0x55f91a225b20 2024-05-08T18:31:20.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.795+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a2329f0 con 0x55f91a22bd90 2024-05-08T18:31:20.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.796+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.796+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94528373728512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a233290 con 0x55f91a22bd90 2024-05-08T18:31:20.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.796+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a233d70 con 0x7fbb2402cb90 2024-05-08T18:31:20.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.796+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94528373723696] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.797+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94528373728512] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.797+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb1c078070 con 0x7fbb2402cb90 2024-05-08T18:31:20.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.797+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94528373724752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a233290 con 0x7fbb2402cb90 2024-05-08T18:31:20.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.797+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a234640 con 0x55f91a225b20 2024-05-08T18:31:20.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.798+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94528373724752] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb1c078070 con 0x7fbb2402cb90 2024-05-08T18:31:20.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.798+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.798+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94528373735824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a2345b0 con 0x55f91a225b20 2024-05-08T18:31:20.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.798+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a235500 con 0x7fbb1c087040 2024-05-08T18:31:20.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.799+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94528373735824] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.799+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.799+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94528373737952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a235500 con 0x7fbb1c087040 2024-05-08T18:31:20.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.799+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a235ec0 con 0x7fbb1c087040 2024-05-08T18:31:20.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.800+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94528373737952] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.800+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.801+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94528373742576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a235500 con 0x7fbb1c087040 2024-05-08T18:31:20.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.801+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a2368d0 con 0x7fbb1c087040 2024-05-08T18:31:20.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.801+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94528373742576] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.802+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.802+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94528373739600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a236ab0 con 0x7fbb1c087040 2024-05-08T18:31:20.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.802+0000 7fbb2d10a800 20 add_watcher() i=0 2024-05-08T18:31:20.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.802+0000 7fbb2d10a800 20 add_watcher() i=1 2024-05-08T18:31:20.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.802+0000 7fbb2d10a800 20 add_watcher() i=2 2024-05-08T18:31:20.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.802+0000 7fbb2d10a800 20 add_watcher() i=3 2024-05-08T18:31:20.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.802+0000 7fbb2d10a800 20 add_watcher() i=4 2024-05-08T18:31:20.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.802+0000 7fbb2d10a800 20 add_watcher() i=5 2024-05-08T18:31:20.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.802+0000 7fbb2d10a800 20 add_watcher() i=6 2024-05-08T18:31:20.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.802+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94528373739600] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.802+0000 7fbb2d10a800 20 add_watcher() i=7 2024-05-08T18:31:20.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.802+0000 7fbb2d10a800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:20.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.802+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a239c40 con 0x55f91a225b20 2024-05-08T18:31:20.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.803+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.803+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94528373757424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a236a00 con 0x55f91a225b20 2024-05-08T18:31:20.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.804+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94528373757424] v27'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.804+0000 7fb9e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:20.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.804+0000 7fbb2d10a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:20.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.804+0000 7fbb2d10a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:20.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.804+0000 7fbb2d10a800 5 note: GC not initialized 2024-05-08T18:31:20.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.804+0000 7fb95bfff640 20 reqs_thread_entry: start 2024-05-08T18:31:20.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.804+0000 7fbb2d10a800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:20.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.804+0000 7fbb2d10a800 20 Filter name: none 2024-05-08T18:31:20.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.804+0000 7fb959ffb640 20 reqs_thread_entry: start 2024-05-08T18:31:20.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.804+0000 7fbb2d10a800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.804+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a26cd00 con 0x55f91a225b20 2024-05-08T18:31:20.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.805+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.805+0000 7fbb2d10a800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:20.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.805+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a26e0f0 con 0x7fbb2402cb90 2024-05-08T18:31:20.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.805+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fbb1c078070 con 0x7fbb2402cb90 2024-05-08T18:31:20.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.805+0000 7fbb2d10a800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.805+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a26e0f0 con 0x55f91a22bd90 2024-05-08T18:31:20.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2d10a800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:20.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2d10a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:31:20.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 4.3c 4:3e5af247:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a26fbb0 con 0x55f91a225b20 2024-05-08T18:31:20.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 4.13 4:c87a77a1:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a2724e0 con 0x7fbb2402cb90 2024-05-08T18:31:20.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:67 4.2d 4:b6c641c8:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a274ee0 con 0x7fbb1c087040 2024-05-08T18:31:20.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:68 4.8 4:106dbb9b:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a277ab0 con 0x55f91a22bd90 2024-05-08T18:31:20.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 4.28 4:146af900:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a274ee0 con 0x55f91a225b20 2024-05-08T18:31:20.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:70 4.6 4:613ec2f8:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a27c900 con 0x55f91a22bd90 2024-05-08T18:31:20.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 4.32 4:4ef39ee1:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a27f600 con 0x55f91a225b20 2024-05-08T18:31:20.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 4.1c 4:38258a38:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a2823b0 con 0x7fbb1c087040 2024-05-08T18:31:20.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:73 4.38 4:1e0d588e:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a27f600 con 0x55f91a225b20 2024-05-08T18:31:20.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:74 4.f 4:f0da020c:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a27c900 con 0x55f91a225b20 2024-05-08T18:31:20.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:75 4.1d 4:baf32667:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a2823b0 con 0x55f91a22bd90 2024-05-08T18:31:20.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(68 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(66 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbb1c078070 con 0x7fbb2402cb90 2024-05-08T18:31:20.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(67 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(72 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(70 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(69 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(71 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(73 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(74 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.806+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(75 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.807+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a26bd80 con 0x7fbb2402cb90 2024-05-08T18:31:20.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.807+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(76 foo.buckets [call] v27'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbb1c078070 con 0x7fbb2402cb90 2024-05-08T18:31:20.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.807+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a281d20 con 0x7fbb2402cb90 2024-05-08T18:31:20.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.808+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(77 foo.buckets [call] v27'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbb1c078070 con 0x7fbb2402cb90 2024-05-08T18:31:20.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.808+0000 7fbb2d10a800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.808+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a281d20 con 0x55f91a225b20 2024-05-08T18:31:20.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.809+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.809+0000 7fbb2d10a800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:20.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.809+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f91a277420 con 0x7fbb2402cb90 2024-05-08T18:31:20.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.809+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7fbb1c078070 con 0x7fbb2402cb90 2024-05-08T18:31:20.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.810+0000 7fb9e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:20.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.810+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94528373757424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a281d20 con 0x55f91a225b20 2024-05-08T18:31:20.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.811+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94528373757424] v27'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.811+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94528373719840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a2395f0 con 0x7fbb2402cb90 2024-05-08T18:31:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.812+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94528373719840] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb1c078070 con 0x7fbb2402cb90 2024-05-08T18:31:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.812+0000 7fbb2d10a800 20 remove_watcher() i=0 2024-05-08T18:31:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.812+0000 7fbb2d10a800 2 removed watcher, disabling cache 2024-05-08T18:31:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.812+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94528373723696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a2395f0 con 0x55f91a225b20 2024-05-08T18:31:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.813+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94528373723696] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.813+0000 7fbb2d10a800 20 remove_watcher() i=1 2024-05-08T18:31:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.813+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94528373728512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a231230 con 0x55f91a22bd90 2024-05-08T18:31:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.814+0000 7fbb2b403640 1 -- 172.21.15.87:0/490808324 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94528373728512] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb24029070 con 0x55f91a22bd90 2024-05-08T18:31:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.814+0000 7fbb2d10a800 20 remove_watcher() i=2 2024-05-08T18:31:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.814+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94528373724752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a2395f0 con 0x7fbb2402cb90 2024-05-08T18:31:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.815+0000 7fbb2ac02640 1 -- 172.21.15.87:0/490808324 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94528373724752] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb1c078070 con 0x7fbb2402cb90 2024-05-08T18:31:20.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.815+0000 7fbb2d10a800 20 remove_watcher() i=3 2024-05-08T18:31:20.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.815+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94528373735824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a2395f0 con 0x55f91a225b20 2024-05-08T18:31:20.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.816+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94528373735824] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x55f91a225b20 2024-05-08T18:31:20.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.816+0000 7fbb2d10a800 20 remove_watcher() i=4 2024-05-08T18:31:20.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.816+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94528373737952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a234190 con 0x7fbb1c087040 2024-05-08T18:31:20.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.817+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94528373737952] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.817+0000 7fbb2d10a800 20 remove_watcher() i=5 2024-05-08T18:31:20.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.817+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94528373742576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a2395f0 con 0x7fbb1c087040 2024-05-08T18:31:20.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.818+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94528373742576] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.818+0000 7fbb2d10a800 20 remove_watcher() i=6 2024-05-08T18:31:20.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.818+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94528373739600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f91a234190 con 0x7fbb1c087040 2024-05-08T18:31:20.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94528373739600] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2002a040 con 0x7fbb1c087040 2024-05-08T18:31:20.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 20 remove_watcher() i=7 2024-05-08T18:31:20.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fbb1c087040 msgr2=0x7fbb1c05b370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fbb1c087040 0x7fbb1c05b370 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f91a225b20 msgr2=0x55f91a227fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f91a225b20 0x55f91a227fc0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fbb2402cb90 msgr2=0x7fbb240298f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fbb2402cb90 0x7fbb240298f0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f91a22bd90 msgr2=0x55f91a22e180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f91a22bd90 0x55f91a22e180 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb9f403bba0 msgr2=0x7fb9f403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb9f403bba0 0x7fb9f403e060 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55f91a1f7690 tx=0x7fbb1c081000 comp rx=0 tx=0).stop 2024-05-08T18:31:20.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a2128b0 msgr2=0x55f91a219ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/490808324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a2128b0 0x55f91a219ed0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbb24051810 tx=0x7fbb2400a0e0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 reap_dead start 2024-05-08T18:31:20.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2a401640 1 -- 172.21.15.87:0/490808324 reap_dead start 2024-05-08T18:31:20.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 shutdown_connections 2024-05-08T18:31:20.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 >> 172.21.15.87:0/490808324 conn(0x55f91a20ec60 msgr2=0x55f91a214120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 shutdown_connections 2024-05-08T18:31:20.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 -- 172.21.15.87:0/490808324 wait complete. 2024-05-08T18:31:20.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2537592545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fba0403bba0 msgr2=0x7fba0403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/2537592545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fba0403bba0 0x7fba0403e060 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55f91a1f2d20 tx=0x7fbb1c092630 comp rx=0 tx=0).stop 2024-05-08T18:31:20.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2537592545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a205600 msgr2=0x55f91a205a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/2537592545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a205600 0x55f91a205a20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x55f91a1eaf90 tx=0x7fbb240178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2537592545 shutdown_connections 2024-05-08T18:31:20.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/2537592545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fba0403bba0 0x7fba0403e060 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/2537592545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a205600 0x55f91a205a20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2537592545 >> 172.21.15.87:0/2537592545 conn(0x55f91a1f96a0 msgr2=0x55f91a1f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2537592545 shutdown_connections 2024-05-08T18:31:20.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.819+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2537592545 wait complete. 2024-05-08T18:31:20.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.820+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2078436147 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f91a1f4890 msgr2=0x55f91a1f6c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.820+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f91a1f4890 0x55f91a1f6c80 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.820+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2078436147 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f91a0f2480 msgr2=0x55f91a1f1310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.820+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f91a0f2480 0x55f91a1f1310 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.820+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2078436147 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fba1003bb50 msgr2=0x7fba1003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.820+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fba1003bb50 0x7fba1003e010 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbb20001d90 tx=0x7fbb200012f0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.820+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2078436147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 msgr2=0x55f91a1ea170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.820+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 0x55f91a1ea170 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c01ced0 tx=0x7fbb1c002fb0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.820+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2078436147 shutdown_connections 2024-05-08T18:31:20.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.820+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f91a0f2480 0x55f91a1f1310 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.820+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f91a1f4890 0x55f91a1f6c80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.820+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fba1003bb50 0x7fba1003e010 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.820+0000 7fbb2d10a800 1 --2- 172.21.15.87:0/2078436147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f91a0f12c0 0x55f91a1ea170 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.820+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2078436147 >> 172.21.15.87:0/2078436147 conn(0x55f91a0ec840 msgr2=0x55f91a1dc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.820+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2078436147 shutdown_connections 2024-05-08T18:31:20.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.820+0000 7fbb2d10a800 1 -- 172.21.15.87:0/2078436147 wait complete. 2024-05-08T18:31:20.841 INFO:teuthology.orchestra.run.smithi087.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-05-08T18:31:20.808641Z","last_stats_update":"2024-05-08T18:31:20.807702Z"} 2024-05-08T18:31:20.841 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-05-08T18:31:20.808641Z', 'last_stats_update': '2024-05-08T18:31:20.807702Z'} 2024-05-08T18:31:20.846 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:20.846 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-05-08T18:31:20.846 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-05-08T18:31:20.847 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-05-08T18:31:20.892 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:20.892 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:20.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.895+0000 7f9a3b333800 1 Processor -- start 2024-05-08T18:31:20.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.895+0000 7f9a3b333800 1 -- start start 2024-05-08T18:31:20.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.895+0000 7f9a3b333800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560e0ec445e0 0x560e0ec469d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.895+0000 7f9a3b333800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560e0ec46fa0 con 0x560e0ec40150 2024-05-08T18:31:20.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.895+0000 7f9a3b333800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x560e0eae1e20 con 0x560e0ec445e0 2024-05-08T18:31:20.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.895+0000 7f9a368ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560e0ec445e0 0x560e0ec469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.895+0000 7f9a368ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560e0ec445e0 0x560e0ec469d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33922/0 (socket says 172.21.15.87:33922) 2024-05-08T18:31:20.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.895+0000 7f9a370eb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x560e0ec40150 0x560e0ec40570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42114/0 (socket says 172.21.15.87:42114) 2024-05-08T18:31:20.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.895+0000 7f9a368ea640 1 -- 172.21.15.87:0/769050826 learned_addr learned my addr 172.21.15.87:0/769050826 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.895+0000 7f9a368ea640 1 -- 172.21.15.87:0/769050826 >> v1:172.21.15.53:6789/0 conn(0x560e0ec40150 legacy=0x560e0ec40570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.895+0000 7f9a368ea640 1 -- 172.21.15.87:0/769050826 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e0ec481d0 con 0x560e0ec445e0 2024-05-08T18:31:20.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.897+0000 7f9a368ea640 1 --2- 172.21.15.87:0/769050826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec445e0 0x560e0ec469d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000a520 tx=0x7f9a2001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db3d9883e4e2b7d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.897+0000 7f9a360e9640 1 -- 172.21.15.87:0/769050826 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a20057070 con 0x560e0ec445e0 2024-05-08T18:31:20.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.898+0000 7f9a360e9640 1 -- 172.21.15.87:0/769050826 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a20052570 con 0x560e0ec445e0 2024-05-08T18:31:20.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.898+0000 7f9a360e9640 1 -- 172.21.15.87:0/769050826 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a2004ae60 con 0x560e0ec445e0 2024-05-08T18:31:20.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.898+0000 7f9a3b333800 1 -- 172.21.15.87:0/769050826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec445e0 msgr2=0x560e0ec469d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.898+0000 7f9a3b333800 1 --2- 172.21.15.87:0/769050826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec445e0 0x560e0ec469d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000a520 tx=0x7f9a2001d010 comp rx=0 tx=0).stop 2024-05-08T18:31:20.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.898+0000 7f9a3b333800 1 -- 172.21.15.87:0/769050826 shutdown_connections 2024-05-08T18:31:20.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.898+0000 7f9a3b333800 1 --2- 172.21.15.87:0/769050826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec445e0 0x560e0ec469d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.898+0000 7f9a3b333800 1 -- 172.21.15.87:0/769050826 >> 172.21.15.87:0/769050826 conn(0x560e0ec3b730 msgr2=0x560e0ec3db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.898+0000 7f9a3b333800 1 -- 172.21.15.87:0/769050826 shutdown_connections 2024-05-08T18:31:20.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.898+0000 7f9a3b333800 1 -- 172.21.15.87:0/769050826 wait complete. 2024-05-08T18:31:20.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.912+0000 7f9a3b333800 1 Processor -- start 2024-05-08T18:31:20.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.912+0000 7f9a3b333800 1 -- start start 2024-05-08T18:31:20.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.912+0000 7f9a3b333800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec40150 0x560e0ed347f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.912+0000 7f9a3b333800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560e0eb8c5c0 con 0x560e0ec40150 2024-05-08T18:31:20.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.912+0000 7f9a370eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec40150 0x560e0ed347f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.912+0000 7f9a370eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec40150 0x560e0ed347f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33926/0 (socket says 172.21.15.87:33926) 2024-05-08T18:31:20.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.913+0000 7f9a370eb640 1 -- 172.21.15.87:0/1257592048 learned_addr learned my addr 172.21.15.87:0/1257592048 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.913+0000 7f9a370eb640 1 -- 172.21.15.87:0/1257592048 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e0ed34dc0 con 0x560e0ec40150 2024-05-08T18:31:20.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.913+0000 7f9a370eb640 1 --2- 172.21.15.87:0/1257592048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec40150 0x560e0ed347f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9a28001610 tx=0x7f9a28001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4503e0a3ef1428cc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.913+0000 7f992560a640 1 -- 172.21.15.87:0/1257592048 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a28013420 con 0x560e0ec40150 2024-05-08T18:31:20.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.913+0000 7f992560a640 1 -- 172.21.15.87:0/1257592048 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a280135c0 con 0x560e0ec40150 2024-05-08T18:31:20.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.913+0000 7f992560a640 1 -- 172.21.15.87:0/1257592048 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a280138e0 con 0x560e0ec40150 2024-05-08T18:31:20.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.914+0000 7f9a3b333800 1 -- 172.21.15.87:0/1257592048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec40150 msgr2=0x560e0ed347f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.914+0000 7f9a3b333800 1 --2- 172.21.15.87:0/1257592048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec40150 0x560e0ed347f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9a28001610 tx=0x7f9a28001ad0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.914+0000 7f9a3b333800 1 -- 172.21.15.87:0/1257592048 shutdown_connections 2024-05-08T18:31:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.914+0000 7f9a3b333800 1 --2- 172.21.15.87:0/1257592048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec40150 0x560e0ed347f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.914+0000 7f9a3b333800 1 -- 172.21.15.87:0/1257592048 >> 172.21.15.87:0/1257592048 conn(0x560e0ec3b730 msgr2=0x560e0ed2bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.914+0000 7f9a3b333800 1 -- 172.21.15.87:0/1257592048 shutdown_connections 2024-05-08T18:31:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.914+0000 7f9a3b333800 1 -- 172.21.15.87:0/1257592048 wait complete. 2024-05-08T18:31:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.914+0000 7f9a3b333800 1 Processor -- start 2024-05-08T18:31:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.914+0000 7f9a3b333800 1 -- start start 2024-05-08T18:31:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.914+0000 7f9a3b333800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec40150 0x560e0ed3c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.914+0000 7f9a3b333800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560e0ec47470 con 0x560e0ec40150 2024-05-08T18:31:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.914+0000 7f9a370eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec40150 0x560e0ed3c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.914+0000 7f9a370eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec40150 0x560e0ed3c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33934/0 (socket says 172.21.15.87:33934) 2024-05-08T18:31:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.915+0000 7f9a370eb640 1 -- 172.21.15.87:0/2234407746 learned_addr learned my addr 172.21.15.87:0/2234407746 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.915+0000 7f9a370eb640 1 -- 172.21.15.87:0/2234407746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e0ed3c8b0 con 0x560e0ec40150 2024-05-08T18:31:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.915+0000 7f9a370eb640 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec40150 0x560e0ed3c370 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9a28007fd0 tx=0x7f9a28000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.915+0000 7f9923e07640 1 -- 172.21.15.87:0/2234407746 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a28022020 con 0x560e0ec40150 2024-05-08T18:31:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.915+0000 7f9923e07640 1 -- 172.21.15.87:0/2234407746 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a28019040 con 0x560e0ec40150 2024-05-08T18:31:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.915+0000 7f9a3b333800 1 -- 172.21.15.87:0/2234407746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e0ed3cb40 con 0x560e0ec40150 2024-05-08T18:31:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.915+0000 7f9923e07640 1 -- 172.21.15.87:0/2234407746 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a28004a40 con 0x560e0ec40150 2024-05-08T18:31:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.915+0000 7f9a3b333800 1 -- 172.21.15.87:0/2234407746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e0ed3f7f0 con 0x560e0ec40150 2024-05-08T18:31:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.916+0000 7f9923e07640 1 -- 172.21.15.87:0/2234407746 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9a28025020 con 0x560e0ec40150 2024-05-08T18:31:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.916+0000 7f9923e07640 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f991c03bb50 0x7f991c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.916+0000 7f9923e07640 1 -- 172.21.15.87:0/2234407746 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f9a28052a30 con 0x560e0ec40150 2024-05-08T18:31:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.916+0000 7f9a368ea640 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f991c03bb50 0x7f991c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.916+0000 7f9a3b333800 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560e0ec445e0 0x560e0ed435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.916+0000 7f9a3b333800 1 -- 172.21.15.87:0/2234407746 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed43b30 con 0x560e0ec445e0 2024-05-08T18:31:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.917+0000 7f9a378ec640 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560e0ec445e0 0x560e0ed435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.917+0000 7f9a368ea640 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f991c03bb50 0x7f991c03e010 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9a20054000 tx=0x7f9a2004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.917+0000 7f9a378ec640 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560e0ec445e0 0x560e0ed435b0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.917+0000 7f9a378ec640 1 -- 172.21.15.87:0/2234407746 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a300083e0 con 0x560e0ec445e0 2024-05-08T18:31:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.917+0000 7f9a3b333800 1 -- 172.21.15.87:0/2234407746 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed40b60 con 0x560e0ec445e0 2024-05-08T18:31:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.917+0000 7f9a378ec640 1 -- 172.21.15.87:0/2234407746 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a300083e0 con 0x560e0ec445e0 2024-05-08T18:31:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.917+0000 7f9a3b333800 1 -- 172.21.15.87:0/2234407746 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed45930 con 0x560e0ec445e0 2024-05-08T18:31:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.918+0000 7f9a378ec640 1 -- 172.21.15.87:0/2234407746 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9a300083e0 con 0x560e0ec445e0 2024-05-08T18:31:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.918+0000 7f9a3b333800 1 -- 172.21.15.87:0/2234407746 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed44b60 con 0x560e0ec445e0 2024-05-08T18:31:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.918+0000 7f9a378ec640 1 -- 172.21.15.87:0/2234407746 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a300083e0 con 0x560e0ec445e0 2024-05-08T18:31:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.918+0000 7f9a3b333800 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560e0ed46ce0 0x560e0ed490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.918+0000 7f9a3b333800 1 -- 172.21.15.87:0/2234407746 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed49610 con 0x560e0ed46ce0 2024-05-08T18:31:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.918+0000 7f9a370eb640 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560e0ed46ce0 0x560e0ed490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.918+0000 7f9a370eb640 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560e0ed46ce0 0x560e0ed490d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.919+0000 7f9a370eb640 1 -- 172.21.15.87:0/2234407746 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9a2800f030 con 0x560e0ed46ce0 2024-05-08T18:31:20.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.919+0000 7f9a3b333800 1 Processor -- start 2024-05-08T18:31:20.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.919+0000 7f9a3b333800 1 -- start start 2024-05-08T18:31:20.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.919+0000 7f9a3b333800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed57890 0x560e0ed57cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.919+0000 7f9a3b333800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560e0eb32fc0 con 0x560e0ed57890 2024-05-08T18:31:20.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.919+0000 7f9a378ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed57890 0x560e0ed57cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.919+0000 7f9a378ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed57890 0x560e0ed57cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33950/0 (socket says 172.21.15.87:33950) 2024-05-08T18:31:20.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.919+0000 7f9a378ec640 1 -- 172.21.15.87:0/1068004038 learned_addr learned my addr 172.21.15.87:0/1068004038 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.920+0000 7f9a378ec640 1 -- 172.21.15.87:0/1068004038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e0ed581f0 con 0x560e0ed57890 2024-05-08T18:31:20.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.920+0000 7f9a378ec640 1 --2- 172.21.15.87:0/1068004038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed57890 0x560e0ed57cb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x560e0ed3d770 tx=0x7f9a3000ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.920+0000 7f9921602640 1 -- 172.21.15.87:0/1068004038 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a3001c070 con 0x560e0ed57890 2024-05-08T18:31:20.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.920+0000 7f9921602640 1 -- 172.21.15.87:0/1068004038 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a3000bdc0 con 0x560e0ed57890 2024-05-08T18:31:20.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.920+0000 7f9921602640 1 -- 172.21.15.87:0/1068004038 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a30018540 con 0x560e0ed57890 2024-05-08T18:31:20.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.920+0000 7f9a3b333800 1 -- 172.21.15.87:0/1068004038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e0ed58c60 con 0x560e0ed57890 2024-05-08T18:31:20.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.920+0000 7f9a3b333800 1 -- 172.21.15.87:0/1068004038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e0ed59160 con 0x560e0ed57890 2024-05-08T18:31:20.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.921+0000 7f9921602640 1 -- 172.21.15.87:0/1068004038 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9a3001f070 con 0x560e0ed57890 2024-05-08T18:31:20.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.921+0000 7f9921602640 1 --2- 172.21.15.87:0/1068004038 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f991003bb50 0x7f991003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.921+0000 7f9921602640 1 -- 172.21.15.87:0/1068004038 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f9a30054670 con 0x560e0ed57890 2024-05-08T18:31:20.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.921+0000 7f9a370eb640 1 --2- 172.21.15.87:0/1068004038 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f991003bb50 0x7f991003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.921+0000 7f9a3b333800 1 Processor -- start 2024-05-08T18:31:20.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.921+0000 7f9a370eb640 1 --2- 172.21.15.87:0/1068004038 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f991003bb50 0x7f991003e010 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9a28050ee0 tx=0x7f9a280124a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.921+0000 7f9a3b333800 1 -- start start 2024-05-08T18:31:20.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.922+0000 7f9a3b333800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed64c60 0x560e0ed65080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.922+0000 7f9a3b333800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560e0ed35140 con 0x560e0ed64c60 2024-05-08T18:31:20.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.922+0000 7f9a378ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed64c60 0x560e0ed65080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.922+0000 7f9a378ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed64c60 0x560e0ed65080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33960/0 (socket says 172.21.15.87:33960) 2024-05-08T18:31:20.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.922+0000 7f9a378ec640 1 -- 172.21.15.87:0/3661362088 learned_addr learned my addr 172.21.15.87:0/3661362088 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.922+0000 7f9a378ec640 1 -- 172.21.15.87:0/3661362088 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e0ed65650 con 0x560e0ed64c60 2024-05-08T18:31:20.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.922+0000 7f9a378ec640 1 --2- 172.21.15.87:0/3661362088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed64c60 0x560e0ed65080 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9a30052a60 tx=0x7f9a300405b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6abce6ff8506910 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.922+0000 7f991affd640 1 -- 172.21.15.87:0/3661362088 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a3004f070 con 0x560e0ed64c60 2024-05-08T18:31:20.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.922+0000 7f991affd640 1 -- 172.21.15.87:0/3661362088 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a30052db0 con 0x560e0ed64c60 2024-05-08T18:31:20.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.922+0000 7f991affd640 1 -- 172.21.15.87:0/3661362088 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a30017510 con 0x560e0ed64c60 2024-05-08T18:31:20.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.923+0000 7f9a3b333800 1 -- 172.21.15.87:0/3661362088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed64c60 msgr2=0x560e0ed65080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.923+0000 7f9a3b333800 1 --2- 172.21.15.87:0/3661362088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed64c60 0x560e0ed65080 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9a30052a60 tx=0x7f9a300405b0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.923+0000 7f9a3b333800 1 -- 172.21.15.87:0/3661362088 shutdown_connections 2024-05-08T18:31:20.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.923+0000 7f9a3b333800 1 --2- 172.21.15.87:0/3661362088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed64c60 0x560e0ed65080 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.923+0000 7f9a3b333800 1 -- 172.21.15.87:0/3661362088 >> 172.21.15.87:0/3661362088 conn(0x560e0ed60f30 msgr2=0x560e0ed5ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.923+0000 7f9a3b333800 1 -- 172.21.15.87:0/3661362088 shutdown_connections 2024-05-08T18:31:20.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.923+0000 7f9a3b333800 1 -- 172.21.15.87:0/3661362088 wait complete. 2024-05-08T18:31:20.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.923+0000 7f9a3b333800 1 Processor -- start 2024-05-08T18:31:20.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.923+0000 7f9a3b333800 1 -- start start 2024-05-08T18:31:20.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.923+0000 7f9a3b333800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed64c60 0x560e0ed6c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.923+0000 7f9a3b333800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560e0ed65e10 con 0x560e0ed64c60 2024-05-08T18:31:20.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.923+0000 7f9a378ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed64c60 0x560e0ed6c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.923+0000 7f9a378ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed64c60 0x560e0ed6c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33972/0 (socket says 172.21.15.87:33972) 2024-05-08T18:31:20.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.923+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 learned_addr learned my addr 172.21.15.87:0/3860967417 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:20.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.924+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e0ed6c6b0 con 0x560e0ed64c60 2024-05-08T18:31:20.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.924+0000 7f9a378ec640 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed64c60 0x560e0ed6c170 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9a30014830 tx=0x7f9a300529f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.924+0000 7f99197fa640 1 -- 172.21.15.87:0/3860967417 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a30029c70 con 0x560e0ed64c60 2024-05-08T18:31:20.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.924+0000 7f99197fa640 1 -- 172.21.15.87:0/3860967417 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a3004a040 con 0x560e0ed64c60 2024-05-08T18:31:20.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.924+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e0ed6c940 con 0x560e0ed64c60 2024-05-08T18:31:20.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.924+0000 7f99197fa640 1 -- 172.21.15.87:0/3860967417 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a30051350 con 0x560e0ed64c60 2024-05-08T18:31:20.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.924+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e0ed6f5f0 con 0x560e0ed64c60 2024-05-08T18:31:20.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.925+0000 7f99197fa640 1 -- 172.21.15.87:0/3860967417 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9a300514f0 con 0x560e0ed64c60 2024-05-08T18:31:20.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.925+0000 7f99197fa640 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f990003bb50 0x7f990003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.925+0000 7f99197fa640 1 -- 172.21.15.87:0/3860967417 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f9a30034c60 con 0x560e0ed64c60 2024-05-08T18:31:20.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.925+0000 7f9a370eb640 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f990003bb50 0x7f990003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.925+0000 7f9a370eb640 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f990003bb50 0x7f990003e010 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9a2801ffd0 tx=0x7f9a28046000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.926+0000 7f9a3b333800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.926+0000 7f9a3b333800 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560e0ed77c80 0x560e0ed7a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.926+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed7a890 con 0x560e0ed77c80 2024-05-08T18:31:20.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.926+0000 7f9a368ea640 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560e0ed77c80 0x560e0ed7a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.926+0000 7f9a368ea640 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560e0ed77c80 0x560e0ed7a140 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.926+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.926+0000 7f9a3b333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.926+0000 7f9a3b333800 20 realm 2024-05-08T18:31:20.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.926+0000 7f9a3b333800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.926+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed7ac60 con 0x560e0ed77c80 2024-05-08T18:31:20.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.926+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.926+0000 7f9a3b333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.926+0000 7f9a3b333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:20.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.926+0000 7f9a3b333800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.926+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed7b530 con 0x560e0ed77c80 2024-05-08T18:31:20.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.927+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.927+0000 7f9a3b333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.927+0000 7f9a3b333800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.927+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed7b8d0 con 0x560e0ed77c80 2024-05-08T18:31:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.927+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.927+0000 7f9a3b333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.927+0000 7f9a3b333800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.927+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed7c120 con 0x560e0ed77c80 2024-05-08T18:31:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.927+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.927+0000 7f9a3b333800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.927+0000 7f9a3b333800 20 searching for the correct realm 2024-05-08T18:31:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.927+0000 7f9a3b333800 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560e0ed7de90 0x560e0ed80280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.927+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x560e0ed7de90 2024-05-08T18:31:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.927+0000 7f9a378ec640 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560e0ed7de90 0x560e0ed80280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.928+0000 7f9a378ec640 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560e0ed7de90 0x560e0ed80280 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.928+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a30028070 con 0x560e0ed7de90 2024-05-08T18:31:20.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.928+0000 7f9a378ec640 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9a30021070 0x7f9a30055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.928+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x7f9a30021070 2024-05-08T18:31:20.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.928+0000 7f9a370eb640 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9a30021070 0x7f9a30055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.928+0000 7f9a370eb640 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9a30021070 0x7f9a30055a20 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.929+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2800f030 con 0x7f9a30021070 2024-05-08T18:31:20.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.929+0000 7f9a370eb640 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f9a28027020 0x7f9a28011730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:20.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.929+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x7f9a28027020 2024-05-08T18:31:20.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.929+0000 7f9a368ea640 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f9a28027020 0x7f9a28011730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:20.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.929+0000 7f9a368ea640 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f9a28027020 0x7f9a28011730 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:20.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.929+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.929+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x560e0ed77c80 2024-05-08T18:31:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.930+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.930+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x560e0ed77c80 2024-05-08T18:31:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.930+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.930+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x7f9a28027020 2024-05-08T18:31:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.930+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.930+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x7f9a28027020 2024-05-08T18:31:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.930+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.930+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x7f9a30021070 2024-05-08T18:31:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.931+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2800f030 con 0x7f9a30021070 2024-05-08T18:31:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.931+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x560e0ed7de90 2024-05-08T18:31:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.931+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a30028070 con 0x560e0ed7de90 2024-05-08T18:31:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.931+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x560e0ed77c80 2024-05-08T18:31:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.931+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.931+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x7f9a28027020 2024-05-08T18:31:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.931+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.931+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x560e0ed77c80 2024-05-08T18:31:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.932+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.932+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x7f9a30021070 2024-05-08T18:31:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.932+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9a2800f030 con 0x7f9a30021070 2024-05-08T18:31:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.932+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x560e0ed7de90 2024-05-08T18:31:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.932+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a30028070 con 0x560e0ed7de90 2024-05-08T18:31:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.932+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x560e0ed7de90 2024-05-08T18:31:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.932+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a30028070 con 0x560e0ed7de90 2024-05-08T18:31:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.932+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x7f9a28027020 2024-05-08T18:31:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.933+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.933+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x560e0ed7de90 2024-05-08T18:31:20.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.933+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a30028070 con 0x560e0ed7de90 2024-05-08T18:31:20.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.933+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x560e0ed7de90 2024-05-08T18:31:20.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.933+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a30028070 con 0x560e0ed7de90 2024-05-08T18:31:20.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.933+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x560e0ed77c80 2024-05-08T18:31:20.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.933+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.933+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x560e0ed77c80 2024-05-08T18:31:20.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.934+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.934+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x7f9a28027020 2024-05-08T18:31:20.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.934+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.934+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x560e0ed7de90 2024-05-08T18:31:20.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.934+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a30028070 con 0x560e0ed7de90 2024-05-08T18:31:20.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.934+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x7f9a30021070 2024-05-08T18:31:20.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.934+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2800f030 con 0x7f9a30021070 2024-05-08T18:31:20.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.935+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x560e0ed77c80 2024-05-08T18:31:20.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.935+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.935+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x7f9a28027020 2024-05-08T18:31:20.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.935+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.935+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x560e0ed7de90 2024-05-08T18:31:20.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.935+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a30028070 con 0x560e0ed7de90 2024-05-08T18:31:20.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.935+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x7f9a28027020 2024-05-08T18:31:20.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.936+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.936+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x7f9a30021070 2024-05-08T18:31:20.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.936+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2800f030 con 0x7f9a30021070 2024-05-08T18:31:20.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.936+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x560e0ed7de90 2024-05-08T18:31:20.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.936+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a30028070 con 0x560e0ed7de90 2024-05-08T18:31:20.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.936+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x7f9a28027020 2024-05-08T18:31:20.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.937+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.937+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x560e0ed77c80 2024-05-08T18:31:20.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.937+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.937+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80810 con 0x7f9a30021070 2024-05-08T18:31:20.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.937+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a2800f030 con 0x7f9a30021070 2024-05-08T18:31:20.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.937+0000 7f9a3b333800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:20.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.937+0000 7f9a3b333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:20.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.937+0000 7f9a3b333800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:20.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.937+0000 7f9a3b333800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:20.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.937+0000 7f9a3b333800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:20.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.937+0000 7f9a3b333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:20.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.937+0000 7f9a3b333800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.937+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed7cad0 con 0x560e0ed77c80 2024-05-08T18:31:20.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.937+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.937+0000 7f9a3b333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.937+0000 7f9a3b333800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.937+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed7d370 con 0x560e0ed77c80 2024-05-08T18:31:20.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.938+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.938+0000 7f9a3b333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:20.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.938+0000 7f9a3b333800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.938+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed80c90 con 0x7f9a28027020 2024-05-08T18:31:20.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.938+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.938+0000 7f9a3b333800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:20.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.938+0000 7f9a3b333800 20 zone default found 2024-05-08T18:31:20.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.938+0000 7f9a3b333800 4 Realm: () 2024-05-08T18:31:20.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.938+0000 7f9a3b333800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:20.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.938+0000 7f9a3b333800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:20.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.938+0000 7f9a3b333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:20.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.938+0000 7f9a3b333800 20 zonegroup default 2024-05-08T18:31:20.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.938+0000 7f9a3b333800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.938+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed81140 con 0x7f9a28027020 2024-05-08T18:31:20.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.939+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.939+0000 7f9a3b333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.939+0000 7f9a3b333800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.939+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed82b20 con 0x560e0ed7de90 2024-05-08T18:31:20.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.939+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a30028070 con 0x560e0ed7de90 2024-05-08T18:31:20.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.939+0000 7f9a3b333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.939+0000 7f9a3b333800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.939+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed830c0 con 0x560e0ed7de90 2024-05-08T18:31:20.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.939+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a30028070 con 0x560e0ed7de90 2024-05-08T18:31:20.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.939+0000 7f9a3b333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:20.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.939+0000 7f9a3b333800 20 started sync module instance, tier type = 2024-05-08T18:31:20.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.939+0000 7f9a3b333800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:20.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.939+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed81fb0 con 0x7f9a30021070 2024-05-08T18:31:20.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.940+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2800f030 con 0x7f9a30021070 2024-05-08T18:31:20.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.940+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94618378576800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed839d0 con 0x7f9a30021070 2024-05-08T18:31:20.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.940+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed84220 con 0x560e0ed77c80 2024-05-08T18:31:20.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.941+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.941+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94618378583408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed84760 con 0x560e0ed77c80 2024-05-08T18:31:20.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.941+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed85280 con 0x560e0ed7de90 2024-05-08T18:31:20.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.941+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94618378576800] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2800f030 con 0x7f9a30021070 2024-05-08T18:31:20.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.942+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94618378583408] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.942+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a30028070 con 0x560e0ed7de90 2024-05-08T18:31:20.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.943+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94618378587472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed85240 con 0x560e0ed7de90 2024-05-08T18:31:20.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.943+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed85b20 con 0x7f9a30021070 2024-05-08T18:31:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.943+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2800f030 con 0x7f9a30021070 2024-05-08T18:31:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.944+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94618378589808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed86370 con 0x7f9a30021070 2024-05-08T18:31:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.944+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94618378587472] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a30028070 con 0x560e0ed7de90 2024-05-08T18:31:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.944+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed86bc0 con 0x560e0ed77c80 2024-05-08T18:31:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.944+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94618378589808] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2800f030 con 0x7f9a30021070 2024-05-08T18:31:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.945+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.945+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94618378581280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed86870 con 0x560e0ed77c80 2024-05-08T18:31:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.945+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed870c0 con 0x7f9a28027020 2024-05-08T18:31:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.946+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.946+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94618378594688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed87490 con 0x7f9a28027020 2024-05-08T18:31:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.946+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94618378581280] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.946+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed87fb0 con 0x7f9a28027020 2024-05-08T18:31:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.946+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94618378594688] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.947+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.947+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94618378593296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed86ee0 con 0x7f9a28027020 2024-05-08T18:31:20.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.947+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed88590 con 0x7f9a28027020 2024-05-08T18:31:20.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.948+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94618378593296] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.948+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.948+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94618378599040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed88590 con 0x7f9a28027020 2024-05-08T18:31:20.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.948+0000 7f9a3b333800 20 add_watcher() i=0 2024-05-08T18:31:20.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.948+0000 7f9a3b333800 20 add_watcher() i=1 2024-05-08T18:31:20.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.948+0000 7f9a3b333800 20 add_watcher() i=2 2024-05-08T18:31:20.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.948+0000 7f9a3b333800 20 add_watcher() i=3 2024-05-08T18:31:20.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.948+0000 7f9a3b333800 20 add_watcher() i=4 2024-05-08T18:31:20.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.948+0000 7f9a3b333800 20 add_watcher() i=5 2024-05-08T18:31:20.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.948+0000 7f9a3b333800 20 add_watcher() i=6 2024-05-08T18:31:20.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.948+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94618378599040] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.949+0000 7f9a3b333800 20 add_watcher() i=7 2024-05-08T18:31:20.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.949+0000 7f9a3b333800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:20.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.949+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed8b850 con 0x560e0ed77c80 2024-05-08T18:31:20.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.949+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.949+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94618378601040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed88b20 con 0x560e0ed77c80 2024-05-08T18:31:20.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.950+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94618378601040] v27'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.950+0000 7f98edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:20.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.950+0000 7f9a3b333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:20.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.950+0000 7f9a3b333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:20.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.950+0000 7f9a3b333800 5 note: GC not initialized 2024-05-08T18:31:20.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.950+0000 7f98ecfe1640 20 reqs_thread_entry: start 2024-05-08T18:31:20.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.950+0000 7f9a3b333800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.950+0000 7f9a3b333800 20 Filter name: none 2024-05-08T18:31:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f98667fc640 20 reqs_thread_entry: start 2024-05-08T18:31:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a3b333800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a3b333800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0edbeca0 con 0x560e0ed77c80 2024-05-08T18:31:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a3b333800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a3b333800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a3b333800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a3b333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a3b333800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:31:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a3b333800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0edc0c20 con 0x7f9a30021070 2024-05-08T18:31:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f9a2800f030 con 0x7f9a30021070 2024-05-08T18:31:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a3b333800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a3b333800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:31:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a3b333800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a3b333800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 : miss 2024-05-08T18:31:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a3b333800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.951+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0edc2490 con 0x560e0ed7de90 2024-05-08T18:31:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.952+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f9a30028070 con 0x560e0ed7de90 2024-05-08T18:31:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.952+0000 7f9a3b333800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.952+0000 7f9a3b333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x17 2024-05-08T18:31:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.952+0000 7f9a3b333800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.952+0000 7f9a3b333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:20.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.952+0000 7f9a3b333800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:20.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.952+0000 7f9a3b333800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 2024-05-08T18:31:20.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.952+0000 7f9a3b333800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-08T18:31:20.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.952+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0edc37e0 con 0x7f9a30021070 2024-05-08T18:31:20.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.953+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(65 foo.buckets [call] v27'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9a2800f030 con 0x7f9a30021070 2024-05-08T18:31:20.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.953+0000 7f9a3b333800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-05-08T18:31:20.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.953+0000 7f9a3b333800 20 rados->read ofs=0 len=0 2024-05-08T18:31:20.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.953+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0edc3330 con 0x7f9a30021070 2024-05-08T18:31:20.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.953+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f9a2800f030 con 0x7f9a30021070 2024-05-08T18:31:20.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.953+0000 7f9a3b333800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:20.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.953+0000 7f9a3b333800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-05-08T18:31:20.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.953+0000 7f9a3b333800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:20.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.953+0000 7f9a3b333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:20.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.953+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0edc97f0 con 0x7f9a30021070 2024-05-08T18:31:20.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.955+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v27'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f9a2800f030 con 0x7f9a30021070 2024-05-08T18:31:20.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.955+0000 7f9a3b333800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-08T18:31:20.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.955+0000 7f9a3b333800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:20.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.955+0000 7f9a3b333800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:31:20.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.955+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94618378851072 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e0edc6de0 con 0x7f9a28027020 2024-05-08T18:31:20.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.955+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== watch-notify(notify (1) cookie 94618378593296 notify 115964116993 ret 0) ==== 380+0+0 (crc 0 0 0) 0x560e0ec481d0 con 0x7f9a28027020 2024-05-08T18:31:20.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.955+0000 7f991affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 94618378593296 notifier 4473 bl.length()=338 2024-05-08T18:31:20.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.955+0000 7f991affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-08T18:31:20.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.955+0000 7f991affd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:20.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.955+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(68 notify.6 [notify cookie 94618378851072 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.955+0000 7f991affd640 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f98fc003ea0 con 0x7f9a28027020 2024-05-08T18:31:20.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.955+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.955+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== watch-notify(notify_complete (2) cookie 94618378851072 notify 115964116993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9a2005dac0 con 0x7f9a28027020 2024-05-08T18:31:20.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.956+0000 7f98edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:20.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.956+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94618378601040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0edbf5b0 con 0x560e0ed77c80 2024-05-08T18:31:20.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.957+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94618378601040] v27'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.957+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94618378576800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0edbf5b0 con 0x7f9a30021070 2024-05-08T18:31:20.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.958+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94618378576800] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2800f030 con 0x7f9a30021070 2024-05-08T18:31:20.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.958+0000 7f9a3b333800 20 remove_watcher() i=0 2024-05-08T18:31:20.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.958+0000 7f9a3b333800 2 removed watcher, disabling cache 2024-05-08T18:31:20.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.958+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94618378583408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed823a0 con 0x560e0ed77c80 2024-05-08T18:31:20.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.959+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94618378583408] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.959+0000 7f9a3b333800 20 remove_watcher() i=1 2024-05-08T18:31:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.959+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94618378587472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed823a0 con 0x560e0ed7de90 2024-05-08T18:31:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.960+0000 7f9a378ec640 1 -- 172.21.15.87:0/3860967417 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94618378587472] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a30028070 con 0x560e0ed7de90 2024-05-08T18:31:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.960+0000 7f9a3b333800 20 remove_watcher() i=2 2024-05-08T18:31:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.960+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94618378589808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed823a0 con 0x7f9a30021070 2024-05-08T18:31:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.961+0000 7f9a370eb640 1 -- 172.21.15.87:0/3860967417 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94618378589808] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2800f030 con 0x7f9a30021070 2024-05-08T18:31:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.961+0000 7f9a3b333800 20 remove_watcher() i=3 2024-05-08T18:31:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.961+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94618378581280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed85670 con 0x560e0ed77c80 2024-05-08T18:31:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.962+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94618378581280] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x560e0ed77c80 2024-05-08T18:31:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.962+0000 7f9a3b333800 20 remove_watcher() i=4 2024-05-08T18:31:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.962+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94618378594688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed823a0 con 0x7f9a28027020 2024-05-08T18:31:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.963+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94618378594688] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.963+0000 7f9a3b333800 20 remove_watcher() i=5 2024-05-08T18:31:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.963+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94618378593296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed83520 con 0x7f9a28027020 2024-05-08T18:31:20.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.964+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94618378593296] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.964+0000 7f9a3b333800 20 remove_watcher() i=6 2024-05-08T18:31:20.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.964+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94618378599040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e0ed85670 con 0x7f9a28027020 2024-05-08T18:31:20.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94618378599040] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a2005a040 con 0x7f9a28027020 2024-05-08T18:31:20.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 20 remove_watcher() i=7 2024-05-08T18:31:20.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f9a28027020 msgr2=0x7f9a28011730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f9a28027020 0x7f9a28011730 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560e0ed77c80 msgr2=0x560e0ed7a140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560e0ed77c80 0x560e0ed7a140 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9a30021070 msgr2=0x7f9a30055a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9a30021070 0x7f9a30055a20 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560e0ed7de90 msgr2=0x560e0ed80280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560e0ed7de90 0x560e0ed80280 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f990003bb50 msgr2=0x7f990003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f990003bb50 0x7f990003e010 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9a2801ffd0 tx=0x7f9a28046000 comp rx=0 tx=0).stop 2024-05-08T18:31:20.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed64c60 msgr2=0x560e0ed6c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a368ea640 1 -- 172.21.15.87:0/3860967417 reap_dead start 2024-05-08T18:31:20.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed64c60 0x560e0ed6c170 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9a30014830 tx=0x7f9a300529f0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 shutdown_connections 2024-05-08T18:31:20.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 --2- 172.21.15.87:0/3860967417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed64c60 0x560e0ed6c170 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 >> 172.21.15.87:0/3860967417 conn(0x560e0ed60f30 msgr2=0x560e0ed5e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 shutdown_connections 2024-05-08T18:31:20.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 -- 172.21.15.87:0/3860967417 wait complete. 2024-05-08T18:31:20.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.965+0000 7f9a3b333800 1 -- 172.21.15.87:0/1068004038 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f991003bb50 msgr2=0x7f991003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 --2- 172.21.15.87:0/1068004038 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f991003bb50 0x7f991003e010 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9a28050ee0 tx=0x7f9a280124a0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 -- 172.21.15.87:0/1068004038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed57890 msgr2=0x560e0ed57cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 --2- 172.21.15.87:0/1068004038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed57890 0x560e0ed57cb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x560e0ed3d770 tx=0x7f9a3000ef30 comp rx=0 tx=0).stop 2024-05-08T18:31:20.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 -- 172.21.15.87:0/1068004038 shutdown_connections 2024-05-08T18:31:20.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 --2- 172.21.15.87:0/1068004038 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f991003bb50 0x7f991003e010 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 --2- 172.21.15.87:0/1068004038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ed57890 0x560e0ed57cb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 -- 172.21.15.87:0/1068004038 >> 172.21.15.87:0/1068004038 conn(0x560e0ed4b930 msgr2=0x560e0ed4bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 -- 172.21.15.87:0/1068004038 shutdown_connections 2024-05-08T18:31:20.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 -- 172.21.15.87:0/1068004038 wait complete. 2024-05-08T18:31:20.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 -- 172.21.15.87:0/2234407746 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560e0ed46ce0 msgr2=0x560e0ed490d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560e0ed46ce0 0x560e0ed490d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 -- 172.21.15.87:0/2234407746 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560e0ec445e0 msgr2=0x560e0ed435b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560e0ec445e0 0x560e0ed435b0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 -- 172.21.15.87:0/2234407746 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f991c03bb50 msgr2=0x7f991c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f991c03bb50 0x7f991c03e010 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9a20054000 tx=0x7f9a2004e000 comp rx=0 tx=0).stop 2024-05-08T18:31:20.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 -- 172.21.15.87:0/2234407746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec40150 msgr2=0x560e0ed3c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:20.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec40150 0x560e0ed3c370 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9a28007fd0 tx=0x7f9a28000f40 comp rx=0 tx=0).stop 2024-05-08T18:31:20.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 -- 172.21.15.87:0/2234407746 shutdown_connections 2024-05-08T18:31:20.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560e0ec445e0 0x560e0ed435b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560e0ed46ce0 0x560e0ed490d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f991c03bb50 0x7f991c03e010 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 --2- 172.21.15.87:0/2234407746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e0ec40150 0x560e0ed3c370 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:20.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 -- 172.21.15.87:0/2234407746 >> 172.21.15.87:0/2234407746 conn(0x560e0ec3b730 msgr2=0x560e0ed2a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:20.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 -- 172.21.15.87:0/2234407746 shutdown_connections 2024-05-08T18:31:20.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:20.966+0000 7f9a3b333800 1 -- 172.21.15.87:0/2234407746 wait complete. 2024-05-08T18:31:20.982 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-08T18:31:20.982 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-08T18:31:20.983 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-05-08T18:31:21.035 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:21.035 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:21.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.038+0000 7fea4f127800 1 Processor -- start 2024-05-08T18:31:21.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.038+0000 7fea4f127800 1 -- start start 2024-05-08T18:31:21.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.038+0000 7fea4f127800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561c83ce6e20 0x561c83ce5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.038+0000 7fea4f127800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561c83ce5e00 con 0x561c83ce58c0 2024-05-08T18:31:21.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.038+0000 7fea4f127800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x561c83c11e20 con 0x561c83ce6e20 2024-05-08T18:31:21.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.038+0000 7fea4ae59640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561c83ce6e20 0x561c83ce5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.038+0000 7fea4a658640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x561c83ce58c0 0x561c83d79180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42118/0 (socket says 172.21.15.87:42118) 2024-05-08T18:31:21.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.038+0000 7fea4a658640 1 -- 172.21.15.87:0/642919790 learned_addr learned my addr 172.21.15.87:0/642919790 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:21.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.038+0000 7fea4ae59640 1 -- 172.21.15.87:0/642919790 >> v1:172.21.15.53:6789/0 conn(0x561c83ce58c0 legacy=0x561c83d79180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.038+0000 7fea4ae59640 1 -- 172.21.15.87:0/642919790 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c83ce5fd0 con 0x561c83ce6e20 2024-05-08T18:31:21.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.040+0000 7fea4ae59640 1 --2- 172.21.15.87:0/642919790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce6e20 0x561c83ce5380 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00a470 tx=0x7fea3c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1f157b26fb2c3f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.041+0000 7fea49e57640 1 -- 172.21.15.87:0/642919790 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea3c057070 con 0x561c83ce6e20 2024-05-08T18:31:21.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.041+0000 7fea49e57640 1 -- 172.21.15.87:0/642919790 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c04adc0 con 0x561c83ce6e20 2024-05-08T18:31:21.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.041+0000 7fea49e57640 1 -- 172.21.15.87:0/642919790 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea3c052590 con 0x561c83ce6e20 2024-05-08T18:31:21.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.041+0000 7fea4f127800 1 -- 172.21.15.87:0/642919790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce6e20 msgr2=0x561c83ce5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.041+0000 7fea4f127800 1 --2- 172.21.15.87:0/642919790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce6e20 0x561c83ce5380 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00a470 tx=0x7fea3c01ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:21.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.041+0000 7fea4f127800 1 -- 172.21.15.87:0/642919790 shutdown_connections 2024-05-08T18:31:21.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.041+0000 7fea4f127800 1 --2- 172.21.15.87:0/642919790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce6e20 0x561c83ce5380 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.041+0000 7fea4f127800 1 -- 172.21.15.87:0/642919790 >> 172.21.15.87:0/642919790 conn(0x561c83d6c870 msgr2=0x561c83d6ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.041+0000 7fea4f127800 1 -- 172.21.15.87:0/642919790 shutdown_connections 2024-05-08T18:31:21.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.041+0000 7fea4f127800 1 -- 172.21.15.87:0/642919790 wait complete. 2024-05-08T18:31:21.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.055+0000 7fea4f127800 1 Processor -- start 2024-05-08T18:31:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.055+0000 7fea4f127800 1 -- start start 2024-05-08T18:31:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.055+0000 7fea4f127800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce58c0 0x561c83e649c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.055+0000 7fea4f127800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561c83cbc5f0 con 0x561c83ce58c0 2024-05-08T18:31:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.055+0000 7fea4ae59640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce58c0 0x561c83e649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.055+0000 7fea4ae59640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce58c0 0x561c83e649c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:33994/0 (socket says 172.21.15.87:33994) 2024-05-08T18:31:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.055+0000 7fea4ae59640 1 -- 172.21.15.87:0/527516295 learned_addr learned my addr 172.21.15.87:0/527516295 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.056+0000 7fea4ae59640 1 -- 172.21.15.87:0/527516295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c83e64f90 con 0x561c83ce58c0 2024-05-08T18:31:21.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.056+0000 7fea4ae59640 1 --2- 172.21.15.87:0/527516295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce58c0 0x561c83e649c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fea3c01ced0 tx=0x7fea3c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed106fd7f0177b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.056+0000 7fe938e09640 1 -- 172.21.15.87:0/527516295 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea3c057040 con 0x561c83ce58c0 2024-05-08T18:31:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.056+0000 7fe938e09640 1 -- 172.21.15.87:0/527516295 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c063070 con 0x561c83ce58c0 2024-05-08T18:31:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.056+0000 7fe938e09640 1 -- 172.21.15.87:0/527516295 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea3c052800 con 0x561c83ce58c0 2024-05-08T18:31:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.057+0000 7fea4f127800 1 -- 172.21.15.87:0/527516295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce58c0 msgr2=0x561c83e649c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.057+0000 7fea4f127800 1 --2- 172.21.15.87:0/527516295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce58c0 0x561c83e649c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fea3c01ced0 tx=0x7fea3c04c000 comp rx=0 tx=0).stop 2024-05-08T18:31:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.057+0000 7fea4f127800 1 -- 172.21.15.87:0/527516295 shutdown_connections 2024-05-08T18:31:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.057+0000 7fea4f127800 1 --2- 172.21.15.87:0/527516295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce58c0 0x561c83e649c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.057+0000 7fea4f127800 1 -- 172.21.15.87:0/527516295 >> 172.21.15.87:0/527516295 conn(0x561c83d6c870 msgr2=0x561c83e602e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.057+0000 7fea4f127800 1 -- 172.21.15.87:0/527516295 shutdown_connections 2024-05-08T18:31:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.057+0000 7fea4f127800 1 -- 172.21.15.87:0/527516295 wait complete. 2024-05-08T18:31:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.057+0000 7fea4f127800 1 Processor -- start 2024-05-08T18:31:21.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.057+0000 7fea4f127800 1 -- start start 2024-05-08T18:31:21.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.057+0000 7fea4f127800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce58c0 0x561c83e6c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.057+0000 7fea4f127800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561c83d7cb80 con 0x561c83ce58c0 2024-05-08T18:31:21.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.057+0000 7fea4ae59640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce58c0 0x561c83e6c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.057+0000 7fea4ae59640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce58c0 0x561c83e6c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34002/0 (socket says 172.21.15.87:34002) 2024-05-08T18:31:21.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.057+0000 7fea4ae59640 1 -- 172.21.15.87:0/2968139711 learned_addr learned my addr 172.21.15.87:0/2968139711 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.058+0000 7fea4ae59640 1 -- 172.21.15.87:0/2968139711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c83e6c9c0 con 0x561c83ce58c0 2024-05-08T18:31:21.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.058+0000 7fea4ae59640 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce58c0 0x561c83e6c480 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fea3c01ced0 tx=0x7fea3c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.058+0000 7fe937606640 1 -- 172.21.15.87:0/2968139711 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea3c06d070 con 0x561c83ce58c0 2024-05-08T18:31:21.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.058+0000 7fe937606640 1 -- 172.21.15.87:0/2968139711 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c052d20 con 0x561c83ce58c0 2024-05-08T18:31:21.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.058+0000 7fea4f127800 1 -- 172.21.15.87:0/2968139711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c83e6cc50 con 0x561c83ce58c0 2024-05-08T18:31:21.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.058+0000 7fe937606640 1 -- 172.21.15.87:0/2968139711 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea3c057050 con 0x561c83ce58c0 2024-05-08T18:31:21.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.058+0000 7fea4f127800 1 -- 172.21.15.87:0/2968139711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c83e6f860 con 0x561c83ce58c0 2024-05-08T18:31:21.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.059+0000 7fe937606640 1 -- 172.21.15.87:0/2968139711 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fea3c05d470 con 0x561c83ce58c0 2024-05-08T18:31:21.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.059+0000 7fe937606640 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe93003bb50 0x7fe93003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.059+0000 7fe937606640 1 -- 172.21.15.87:0/2968139711 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fea3c094160 con 0x561c83ce58c0 2024-05-08T18:31:21.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.059+0000 7fea4a658640 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe93003bb50 0x7fe93003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.059+0000 7fea4f127800 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561c83ce6e20 0x561c83e73620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.059+0000 7fea4f127800 1 -- 172.21.15.87:0/2968139711 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83e73ba0 con 0x561c83ce6e20 2024-05-08T18:31:21.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.059+0000 7fea4b65a640 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561c83ce6e20 0x561c83e73620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.060+0000 7fea4a658640 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe93003bb50 0x7fe93003e010 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fea40000f60 tx=0x7fea400012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.060+0000 7fea4b65a640 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561c83ce6e20 0x561c83e73620 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.060+0000 7fea4b65a640 1 -- 172.21.15.87:0/2968139711 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea4400a4a0 con 0x561c83ce6e20 2024-05-08T18:31:21.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.060+0000 7fea4f127800 1 -- 172.21.15.87:0/2968139711 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83e70bf0 con 0x561c83ce6e20 2024-05-08T18:31:21.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.060+0000 7fea4b65a640 1 -- 172.21.15.87:0/2968139711 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea4400a4a0 con 0x561c83ce6e20 2024-05-08T18:31:21.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.060+0000 7fea4f127800 1 -- 172.21.15.87:0/2968139711 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83e759c0 con 0x561c83ce6e20 2024-05-08T18:31:21.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.061+0000 7fea4b65a640 1 -- 172.21.15.87:0/2968139711 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fea4400a4a0 con 0x561c83ce6e20 2024-05-08T18:31:21.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.061+0000 7fea4f127800 1 -- 172.21.15.87:0/2968139711 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83e74bf0 con 0x561c83ce6e20 2024-05-08T18:31:21.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.061+0000 7fea4b65a640 1 -- 172.21.15.87:0/2968139711 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fea4400a4a0 con 0x561c83ce6e20 2024-05-08T18:31:21.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.061+0000 7fea4f127800 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561c83e76d70 0x561c83e79160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.061+0000 7fea4f127800 1 -- 172.21.15.87:0/2968139711 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83e796a0 con 0x561c83e76d70 2024-05-08T18:31:21.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.061+0000 7fea4ae59640 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561c83e76d70 0x561c83e79160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.061+0000 7fea4ae59640 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561c83e76d70 0x561c83e79160 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.062+0000 7fea4ae59640 1 -- 172.21.15.87:0/2968139711 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fea3c078070 con 0x561c83e76d70 2024-05-08T18:31:21.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.062+0000 7fea4f127800 1 Processor -- start 2024-05-08T18:31:21.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.062+0000 7fea4f127800 1 -- start start 2024-05-08T18:31:21.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.062+0000 7fea4f127800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e878e0 0x561c83e87d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.062+0000 7fea4f127800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561c83c62fc0 con 0x561c83e878e0 2024-05-08T18:31:21.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.062+0000 7fea4b65a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e878e0 0x561c83e87d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.062+0000 7fea4b65a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e878e0 0x561c83e87d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34018/0 (socket says 172.21.15.87:34018) 2024-05-08T18:31:21.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.063+0000 7fea4b65a640 1 -- 172.21.15.87:0/2445591244 learned_addr learned my addr 172.21.15.87:0/2445591244 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.063+0000 7fea4b65a640 1 -- 172.21.15.87:0/2445591244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c83e88240 con 0x561c83e878e0 2024-05-08T18:31:21.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.063+0000 7fea4b65a640 1 --2- 172.21.15.87:0/2445591244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e878e0 0x561c83e87d00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x561c83e6d7e0 tx=0x7fea440178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.063+0000 7fe934e01640 1 -- 172.21.15.87:0/2445591244 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea44013440 con 0x561c83e878e0 2024-05-08T18:31:21.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.063+0000 7fe934e01640 1 -- 172.21.15.87:0/2445591244 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea440135e0 con 0x561c83e878e0 2024-05-08T18:31:21.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.063+0000 7fea4f127800 1 -- 172.21.15.87:0/2445591244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c83e88cb0 con 0x561c83e878e0 2024-05-08T18:31:21.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.063+0000 7fe934e01640 1 -- 172.21.15.87:0/2445591244 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea440138c0 con 0x561c83e878e0 2024-05-08T18:31:21.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.063+0000 7fea4f127800 1 -- 172.21.15.87:0/2445591244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c83e891b0 con 0x561c83e878e0 2024-05-08T18:31:21.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.064+0000 7fe934e01640 1 -- 172.21.15.87:0/2445591244 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fea44011040 con 0x561c83e878e0 2024-05-08T18:31:21.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.064+0000 7fe934e01640 1 --2- 172.21.15.87:0/2445591244 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe92403bb50 0x7fe92403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.064+0000 7fe934e01640 1 -- 172.21.15.87:0/2445591244 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fea4401d070 con 0x561c83e878e0 2024-05-08T18:31:21.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.064+0000 7fea4ae59640 1 --2- 172.21.15.87:0/2445591244 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe92403bb50 0x7fe92403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.064+0000 7fea4f127800 1 Processor -- start 2024-05-08T18:31:21.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.064+0000 7fea4ae59640 1 --2- 172.21.15.87:0/2445591244 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe92403bb50 0x7fe92403e010 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fea3c05d000 tx=0x7fea3c05cf10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.065+0000 7fea4f127800 1 -- start start 2024-05-08T18:31:21.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.065+0000 7fea4f127800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e94c70 0x561c83e95090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.065+0000 7fea4f127800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561c83e65250 con 0x561c83e94c70 2024-05-08T18:31:21.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.065+0000 7fea4b65a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e94c70 0x561c83e95090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.065+0000 7fea4b65a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e94c70 0x561c83e95090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34032/0 (socket says 172.21.15.87:34032) 2024-05-08T18:31:21.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.065+0000 7fea4b65a640 1 -- 172.21.15.87:0/1268593474 learned_addr learned my addr 172.21.15.87:0/1268593474 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.065+0000 7fea4b65a640 1 -- 172.21.15.87:0/1268593474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c83e95660 con 0x561c83e94c70 2024-05-08T18:31:21.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.065+0000 7fea4b65a640 1 --2- 172.21.15.87:0/1268593474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e94c70 0x561c83e95090 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fea440529a0 tx=0x7fea44001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c828d476c0d596 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.065+0000 7fe92e7fc640 1 -- 172.21.15.87:0/1268593474 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea4402ad80 con 0x561c83e94c70 2024-05-08T18:31:21.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.065+0000 7fe92e7fc640 1 -- 172.21.15.87:0/1268593474 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea440014f0 con 0x561c83e94c70 2024-05-08T18:31:21.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.065+0000 7fe92e7fc640 1 -- 172.21.15.87:0/1268593474 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea440017f0 con 0x561c83e94c70 2024-05-08T18:31:21.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.066+0000 7fea4f127800 1 -- 172.21.15.87:0/1268593474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e94c70 msgr2=0x561c83e95090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.066+0000 7fea4f127800 1 --2- 172.21.15.87:0/1268593474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e94c70 0x561c83e95090 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fea440529a0 tx=0x7fea44001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:21.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.066+0000 7fea4f127800 1 -- 172.21.15.87:0/1268593474 shutdown_connections 2024-05-08T18:31:21.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.066+0000 7fea4f127800 1 --2- 172.21.15.87:0/1268593474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e94c70 0x561c83e95090 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.066+0000 7fea4f127800 1 -- 172.21.15.87:0/1268593474 >> 172.21.15.87:0/1268593474 conn(0x561c83e90f30 msgr2=0x561c83e8efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.066+0000 7fea4f127800 1 -- 172.21.15.87:0/1268593474 shutdown_connections 2024-05-08T18:31:21.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.066+0000 7fea4f127800 1 -- 172.21.15.87:0/1268593474 wait complete. 2024-05-08T18:31:21.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.066+0000 7fea4f127800 1 Processor -- start 2024-05-08T18:31:21.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.066+0000 7fea4f127800 1 -- start start 2024-05-08T18:31:21.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.066+0000 7fea4f127800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e94c70 0x561c83e9c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.066+0000 7fea4f127800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561c83e95da0 con 0x561c83e94c70 2024-05-08T18:31:21.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.066+0000 7fea4b65a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e94c70 0x561c83e9c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.066+0000 7fea4b65a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e94c70 0x561c83e9c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34048/0 (socket says 172.21.15.87:34048) 2024-05-08T18:31:21.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.066+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 learned_addr learned my addr 172.21.15.87:0/2887566565 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.067+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c83e9c6c0 con 0x561c83e94c70 2024-05-08T18:31:21.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.067+0000 7fea4b65a640 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e94c70 0x561c83e9c180 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fea4404d010 tx=0x7fea44052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.067+0000 7fe92cff9640 1 -- 172.21.15.87:0/2887566565 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea44030020 con 0x561c83e94c70 2024-05-08T18:31:21.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.067+0000 7fe92cff9640 1 -- 172.21.15.87:0/2887566565 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea440511e0 con 0x561c83e94c70 2024-05-08T18:31:21.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.067+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c83e9c950 con 0x561c83e94c70 2024-05-08T18:31:21.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.067+0000 7fe92cff9640 1 -- 172.21.15.87:0/2887566565 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea4404b070 con 0x561c83e94c70 2024-05-08T18:31:21.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.067+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c83e9f600 con 0x561c83e94c70 2024-05-08T18:31:21.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.068+0000 7fe92cff9640 1 -- 172.21.15.87:0/2887566565 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fea44033020 con 0x561c83e94c70 2024-05-08T18:31:21.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.068+0000 7fe92cff9640 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe91403bb50 0x7fe91403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.068+0000 7fe92cff9640 1 -- 172.21.15.87:0/2887566565 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fea4400e040 con 0x561c83e94c70 2024-05-08T18:31:21.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.068+0000 7fea4ae59640 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe91403bb50 0x7fe91403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.068+0000 7fea4ae59640 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe91403bb50 0x7fe91403e010 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fea3c091270 tx=0x7fea3c081000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.069+0000 7fea4f127800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.069+0000 7fea4f127800 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561c83ea7e70 0x561c83eaa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.069+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83eaaa80 con 0x561c83ea7e70 2024-05-08T18:31:21.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.069+0000 7fea4a658640 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561c83ea7e70 0x561c83eaa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.069+0000 7fea4a658640 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561c83ea7e70 0x561c83eaa330 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.069+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea40009050 con 0x561c83ea7e70 2024-05-08T18:31:21.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.069+0000 7fea4f127800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.069+0000 7fea4f127800 20 realm 2024-05-08T18:31:21.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.069+0000 7fea4f127800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.069+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83ea72c0 con 0x561c83ea7e70 2024-05-08T18:31:21.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.069+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea40009050 con 0x561c83ea7e70 2024-05-08T18:31:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.069+0000 7fea4f127800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.069+0000 7fea4f127800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.069+0000 7fea4f127800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.069+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83eab570 con 0x561c83ea7e70 2024-05-08T18:31:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.070+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea40009050 con 0x561c83ea7e70 2024-05-08T18:31:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.070+0000 7fea4f127800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.070+0000 7fea4f127800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.070+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83eabe40 con 0x561c83ea7e70 2024-05-08T18:31:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.070+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea40009050 con 0x561c83ea7e70 2024-05-08T18:31:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.070+0000 7fea4f127800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.070+0000 7fea4f127800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.070+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83eac1e0 con 0x561c83ea7e70 2024-05-08T18:31:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.070+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fea40009050 con 0x561c83ea7e70 2024-05-08T18:31:21.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.070+0000 7fea4f127800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:21.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.070+0000 7fea4f127800 20 searching for the correct realm 2024-05-08T18:31:21.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.070+0000 7fea4f127800 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561c83eae0c0 0x561c83eb04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.070+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x561c83eae0c0 2024-05-08T18:31:21.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.070+0000 7fea4b65a640 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561c83eae0c0 0x561c83eb04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.070+0000 7fea4b65a640 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561c83eae0c0 0x561c83eb04d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.071+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea44029070 con 0x561c83eae0c0 2024-05-08T18:31:21.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.071+0000 7fea4b65a640 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fea44035020 0x7fea44013a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.071+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x7fea44035020 2024-05-08T18:31:21.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.071+0000 7fea4ae59640 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fea44035020 0x7fea44013a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.071+0000 7fea4ae59640 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fea44035020 0x7fea44013a60 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.072+0000 7fea4ae59640 1 -- 172.21.15.87:0/2887566565 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c078070 con 0x7fea44035020 2024-05-08T18:31:21.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.072+0000 7fea4ae59640 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fea3c05b370 0x7fea3c08b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.072+0000 7fea4ae59640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x7fea3c05b370 2024-05-08T18:31:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.072+0000 7fea4a658640 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fea3c05b370 0x7fea3c08b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.072+0000 7fea4a658640 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fea3c05b370 0x7fea3c08b360 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.073+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea40009050 con 0x7fea3c05b370 2024-05-08T18:31:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.073+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x561c83ea7e70 2024-05-08T18:31:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.073+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea40009050 con 0x561c83ea7e70 2024-05-08T18:31:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.073+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x561c83ea7e70 2024-05-08T18:31:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.073+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.073+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x7fea3c05b370 2024-05-08T18:31:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.073+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.073+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x7fea3c05b370 2024-05-08T18:31:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.074+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.074+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x7fea44035020 2024-05-08T18:31:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.074+0000 7fea4ae59640 1 -- 172.21.15.87:0/2887566565 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c078070 con 0x7fea44035020 2024-05-08T18:31:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.074+0000 7fea4ae59640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x561c83eae0c0 2024-05-08T18:31:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.074+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea44029070 con 0x561c83eae0c0 2024-05-08T18:31:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.074+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x561c83ea7e70 2024-05-08T18:31:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.074+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.074+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x7fea3c05b370 2024-05-08T18:31:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.075+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.075+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x561c83ea7e70 2024-05-08T18:31:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.075+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.075+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x7fea44035020 2024-05-08T18:31:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.075+0000 7fea4ae59640 1 -- 172.21.15.87:0/2887566565 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fea3c078070 con 0x7fea44035020 2024-05-08T18:31:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.075+0000 7fea4ae59640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x561c83eae0c0 2024-05-08T18:31:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.075+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea44029070 con 0x561c83eae0c0 2024-05-08T18:31:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.075+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x561c83eae0c0 2024-05-08T18:31:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.075+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea44029070 con 0x561c83eae0c0 2024-05-08T18:31:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.075+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x7fea3c05b370 2024-05-08T18:31:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.076+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.076+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x561c83eae0c0 2024-05-08T18:31:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.076+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea44029070 con 0x561c83eae0c0 2024-05-08T18:31:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.076+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x561c83eae0c0 2024-05-08T18:31:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.076+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea44029070 con 0x561c83eae0c0 2024-05-08T18:31:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.076+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x561c83ea7e70 2024-05-08T18:31:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.076+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.076+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x561c83ea7e70 2024-05-08T18:31:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.077+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.077+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x7fea3c05b370 2024-05-08T18:31:21.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.077+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.077+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x561c83eae0c0 2024-05-08T18:31:21.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.077+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea44029070 con 0x561c83eae0c0 2024-05-08T18:31:21.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.077+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x7fea44035020 2024-05-08T18:31:21.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.078+0000 7fea4ae59640 1 -- 172.21.15.87:0/2887566565 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c078070 con 0x7fea44035020 2024-05-08T18:31:21.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.078+0000 7fea4ae59640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x561c83ea7e70 2024-05-08T18:31:21.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.078+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.078+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x7fea3c05b370 2024-05-08T18:31:21.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.078+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.078+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x561c83eae0c0 2024-05-08T18:31:21.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.079+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea44029070 con 0x561c83eae0c0 2024-05-08T18:31:21.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.079+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x7fea3c05b370 2024-05-08T18:31:21.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.079+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.079+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x7fea44035020 2024-05-08T18:31:21.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.079+0000 7fea4ae59640 1 -- 172.21.15.87:0/2887566565 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c078070 con 0x7fea44035020 2024-05-08T18:31:21.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.079+0000 7fea4ae59640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x561c83eae0c0 2024-05-08T18:31:21.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.079+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea44029070 con 0x561c83eae0c0 2024-05-08T18:31:21.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.079+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x7fea3c05b370 2024-05-08T18:31:21.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.080+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.080+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x561c83ea7e70 2024-05-08T18:31:21.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.080+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.080+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb0ba0 con 0x7fea44035020 2024-05-08T18:31:21.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.080+0000 7fea4ae59640 1 -- 172.21.15.87:0/2887566565 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c078070 con 0x7fea44035020 2024-05-08T18:31:21.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.080+0000 7fea4f127800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:21.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.080+0000 7fea4f127800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:21.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.080+0000 7fea4f127800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:21.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.080+0000 7fea4f127800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:21.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.080+0000 7fea4f127800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:21.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.080+0000 7fea4f127800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:21.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.080+0000 7fea4f127800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.080+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83eacb30 con 0x561c83ea7e70 2024-05-08T18:31:21.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.080+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.080+0000 7fea4f127800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.080+0000 7fea4f127800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.081+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83ead3d0 con 0x561c83ea7e70 2024-05-08T18:31:21.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.081+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.081+0000 7fea4f127800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:21.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.081+0000 7fea4f127800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.081+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb1020 con 0x7fea3c05b370 2024-05-08T18:31:21.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.081+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.081+0000 7fea4f127800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:21.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.081+0000 7fea4f127800 20 zone default found 2024-05-08T18:31:21.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.081+0000 7fea4f127800 4 Realm: () 2024-05-08T18:31:21.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.081+0000 7fea4f127800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:21.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.081+0000 7fea4f127800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:21.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.081+0000 7fea4f127800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:21.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.081+0000 7fea4f127800 20 zonegroup default 2024-05-08T18:31:21.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.082+0000 7fea4f127800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.082+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb14d0 con 0x7fea3c05b370 2024-05-08T18:31:21.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.082+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.082+0000 7fea4f127800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.082+0000 7fea4f127800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.082+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb2eb0 con 0x561c83eae0c0 2024-05-08T18:31:21.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.082+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea44029070 con 0x561c83eae0c0 2024-05-08T18:31:21.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.082+0000 7fea4f127800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.082+0000 7fea4f127800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.082+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb3340 con 0x561c83eae0c0 2024-05-08T18:31:21.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.082+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea44029070 con 0x561c83eae0c0 2024-05-08T18:31:21.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.082+0000 7fea4f127800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.082+0000 7fea4f127800 20 started sync module instance, tier type = 2024-05-08T18:31:21.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.082+0000 7fea4f127800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:21.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.082+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb2340 con 0x7fea44035020 2024-05-08T18:31:21.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.083+0000 7fea4ae59640 1 -- 172.21.15.87:0/2887566565 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea3c078070 con 0x7fea44035020 2024-05-08T18:31:21.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.083+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94680472299312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb1fa0 con 0x7fea44035020 2024-05-08T18:31:21.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.083+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb4270 con 0x561c83ea7e70 2024-05-08T18:31:21.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.084+0000 7fea4ae59640 1 -- 172.21.15.87:0/2887566565 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94680472299312] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea3c078070 con 0x7fea44035020 2024-05-08T18:31:21.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.085+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.085+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94680472305088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb4690 con 0x561c83ea7e70 2024-05-08T18:31:21.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.085+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb5050 con 0x561c83eae0c0 2024-05-08T18:31:21.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.087+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94680472305088] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.087+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea44029070 con 0x561c83eae0c0 2024-05-08T18:31:21.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.087+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94680472306144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb4600 con 0x561c83eae0c0 2024-05-08T18:31:21.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.087+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb5f10 con 0x7fea44035020 2024-05-08T18:31:21.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.088+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94680472306144] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea44029070 con 0x561c83eae0c0 2024-05-08T18:31:21.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.088+0000 7fea4ae59640 1 -- 172.21.15.87:0/2887566565 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea3c078070 con 0x7fea44035020 2024-05-08T18:31:21.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.088+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94680472312416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb62b0 con 0x7fea44035020 2024-05-08T18:31:21.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.088+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb6cd0 con 0x561c83ea7e70 2024-05-08T18:31:21.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.089+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.089+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94680472315840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb6c90 con 0x561c83ea7e70 2024-05-08T18:31:21.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.089+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb7c80 con 0x7fea3c05b370 2024-05-08T18:31:21.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.090+0000 7fea4ae59640 1 -- 172.21.15.87:0/2887566565 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94680472312416] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea3c078070 con 0x7fea44035020 2024-05-08T18:31:21.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.090+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94680472315840] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.091+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.091+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94680472319888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb6e70 con 0x7fea3c05b370 2024-05-08T18:31:21.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.091+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb8550 con 0x7fea3c05b370 2024-05-08T18:31:21.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.091+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(56 notify.6 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.092+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94680472322208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb6e70 con 0x7fea3c05b370 2024-05-08T18:31:21.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.092+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb9020 con 0x7fea3c05b370 2024-05-08T18:31:21.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.092+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94680472319888] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.093+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.093+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94680472322208] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.093+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94680472324880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb8fe0 con 0x7fea3c05b370 2024-05-08T18:31:21.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.093+0000 7fea4f127800 20 add_watcher() i=0 2024-05-08T18:31:21.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.093+0000 7fea4f127800 20 add_watcher() i=1 2024-05-08T18:31:21.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.093+0000 7fea4f127800 20 add_watcher() i=2 2024-05-08T18:31:21.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.093+0000 7fea4f127800 20 add_watcher() i=3 2024-05-08T18:31:21.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.093+0000 7fea4f127800 20 add_watcher() i=4 2024-05-08T18:31:21.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.093+0000 7fea4f127800 20 add_watcher() i=5 2024-05-08T18:31:21.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.093+0000 7fea4f127800 20 add_watcher() i=6 2024-05-08T18:31:21.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.093+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94680472324880] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.093+0000 7fea4f127800 20 add_watcher() i=7 2024-05-08T18:31:21.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.093+0000 7fea4f127800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:21.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.094+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83ebc010 con 0x561c83ea7e70 2024-05-08T18:31:21.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.094+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.094+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94680472310848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb9490 con 0x561c83ea7e70 2024-05-08T18:31:21.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.095+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94680472310848] v27'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.095+0000 7fe9017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:21.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.095+0000 7fea4f127800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:21.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.095+0000 7fea4f127800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:21.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.095+0000 7fea4f127800 5 note: GC not initialized 2024-05-08T18:31:21.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.095+0000 7fe87bfff640 20 reqs_thread_entry: start 2024-05-08T18:31:21.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.095+0000 7fea4f127800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:21.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.095+0000 7fea4f127800 20 Filter name: none 2024-05-08T18:31:21.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.095+0000 7fe879ffb640 20 reqs_thread_entry: start 2024-05-08T18:31:21.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.095+0000 7fea4f127800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:31:21.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.095+0000 7fea4f127800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.096+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83eef460 con 0x7fea3c05b370 2024-05-08T18:31:21.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.096+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.096+0000 7fea4f127800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.096+0000 7fea4f127800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-08T18:31:21.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.096+0000 7fea4f127800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:31:21.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.096+0000 7fea4f127800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-08T18:31:21.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.096+0000 7fea4f127800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.096+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83eedc00 con 0x7fea3c05b370 2024-05-08T18:31:21.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.096+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.096+0000 7fea4f127800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.096+0000 7fea4f127800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-08T18:31:21.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.096+0000 7fea4f127800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:31:21.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.096+0000 7fea4f127800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:31:21.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.096+0000 7fea4f127800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:31:21.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.096+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eee4c0 con 0x7fea3c05b370 2024-05-08T18:31:21.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.097+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v27'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.097+0000 7fea4f127800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-08T18:31:21.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.097+0000 7fea4f127800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:31:21.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.097+0000 7fea4f127800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-08T18:31:21.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.097+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94680472543248 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83ef2da0 con 0x7fea3c05b370 2024-05-08T18:31:21.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.098+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== watch-notify(notify (1) cookie 94680472319888 notify 115964116994 ret 0) ==== 598+0+0 (crc 0 0 0) 0x561c83eee860 con 0x7fea3c05b370 2024-05-08T18:31:21.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.098+0000 7fe92e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116994 cookie 94680472319888 notifier 4480 bl.length()=556 2024-05-08T18:31:21.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.098+0000 7fe92e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-08T18:31:21.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.098+0000 7fe92e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:31:21.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.098+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(65 notify.5 [notify cookie 94680472543248 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.098+0000 7fe92e7fc640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fe910003ea0 con 0x7fea3c05b370 2024-05-08T18:31:21.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.098+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.098+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== watch-notify(notify_complete (2) cookie 94680472543248 notify 115964116994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561c83eeeeb0 con 0x7fea3c05b370 2024-05-08T18:31:21.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.098+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eedfc0 con 0x7fea3c05b370 2024-05-08T18:31:21.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.099+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v27'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.099+0000 7fea4f127800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:31:21.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.099+0000 7fea4f127800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:31:21.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.099+0000 7fea4f127800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:31:21.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.099+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94680472543168 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561c83ef2da0 con 0x561c83eae0c0 2024-05-08T18:31:21.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.100+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== watch-notify(notify (1) cookie 94680472306144 notify 115964116994 ret 0) ==== 219+0+0 (crc 0 0 0) 0x561c83e9f600 con 0x561c83eae0c0 2024-05-08T18:31:21.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.100+0000 7fe92dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116994 cookie 94680472306144 notifier 4480 bl.length()=177 2024-05-08T18:31:21.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.100+0000 7fe92dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:31:21.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.100+0000 7fe92dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:31:21.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.100+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(68 notify.2 [notify cookie 94680472543168 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fea44029070 con 0x561c83eae0c0 2024-05-08T18:31:21.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.100+0000 7fe92dffb640 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fe880003400 con 0x561c83eae0c0 2024-05-08T18:31:21.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.100+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea44029070 con 0x561c83eae0c0 2024-05-08T18:31:21.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.100+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== watch-notify(notify_complete (2) cookie 94680472543168 notify 115964116994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561c83e9c950 con 0x561c83eae0c0 2024-05-08T18:31:21.112 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T18:31:21.097391Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:21.097378Z","tags":[],"group_ids":[]} 2024-05-08T18:31:21.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.101+0000 7fe9017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:21.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.101+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94680472310848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83ea1830 con 0x561c83ea7e70 2024-05-08T18:31:21.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.102+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94680472310848] v27'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.102+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94680472299312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb5440 con 0x7fea44035020 2024-05-08T18:31:21.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.103+0000 7fea4ae59640 1 -- 172.21.15.87:0/2887566565 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94680472299312] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea3c078070 con 0x7fea44035020 2024-05-08T18:31:21.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.103+0000 7fea4f127800 20 remove_watcher() i=0 2024-05-08T18:31:21.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.103+0000 7fea4f127800 2 removed watcher, disabling cache 2024-05-08T18:31:21.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.103+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94680472305088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb5440 con 0x561c83ea7e70 2024-05-08T18:31:21.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.104+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94680472305088] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.104+0000 7fea4f127800 20 remove_watcher() i=1 2024-05-08T18:31:21.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.104+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94680472306144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb3dc0 con 0x561c83eae0c0 2024-05-08T18:31:21.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.105+0000 7fea4b65a640 1 -- 172.21.15.87:0/2887566565 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94680472306144] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea44029070 con 0x561c83eae0c0 2024-05-08T18:31:21.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.105+0000 7fea4f127800 20 remove_watcher() i=2 2024-05-08T18:31:21.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.105+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94680472312416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb5440 con 0x7fea44035020 2024-05-08T18:31:21.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.106+0000 7fea4ae59640 1 -- 172.21.15.87:0/2887566565 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94680472312416] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea3c078070 con 0x7fea44035020 2024-05-08T18:31:21.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.106+0000 7fea4f127800 20 remove_watcher() i=3 2024-05-08T18:31:21.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.106+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94680472315840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb5a60 con 0x561c83ea7e70 2024-05-08T18:31:21.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.107+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94680472315840] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x561c83ea7e70 2024-05-08T18:31:21.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.107+0000 7fea4f127800 20 remove_watcher() i=4 2024-05-08T18:31:21.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.107+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94680472319888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb5440 con 0x7fea3c05b370 2024-05-08T18:31:21.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.108+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94680472319888] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.108+0000 7fea4f127800 20 remove_watcher() i=5 2024-05-08T18:31:21.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.108+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94680472322208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb7790 con 0x7fea3c05b370 2024-05-08T18:31:21.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.109+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94680472322208] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.109+0000 7fea4f127800 20 remove_watcher() i=6 2024-05-08T18:31:21.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.109+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94680472324880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561c83eb5440 con 0x7fea3c05b370 2024-05-08T18:31:21.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94680472324880] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4002a040 con 0x7fea3c05b370 2024-05-08T18:31:21.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 20 remove_watcher() i=7 2024-05-08T18:31:21.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fea3c05b370 msgr2=0x7fea3c08b360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fea3c05b370 0x7fea3c08b360 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561c83ea7e70 msgr2=0x561c83eaa330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561c83ea7e70 0x561c83eaa330 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fea44035020 msgr2=0x7fea44013a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fea44035020 0x7fea44013a60 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561c83eae0c0 msgr2=0x561c83eb04d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561c83eae0c0 0x561c83eb04d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe91403bb50 msgr2=0x7fe91403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe91403bb50 0x7fe91403e010 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fea3c091270 tx=0x7fea3c081000 comp rx=0 tx=0).stop 2024-05-08T18:31:21.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e94c70 msgr2=0x561c83e9c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 --2- 172.21.15.87:0/2887566565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e94c70 0x561c83e9c180 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fea4404d010 tx=0x7fea44052900 comp rx=0 tx=0).stop 2024-05-08T18:31:21.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 reap_dead start 2024-05-08T18:31:21.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4a658640 1 -- 172.21.15.87:0/2887566565 reap_dead start 2024-05-08T18:31:21.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 shutdown_connections 2024-05-08T18:31:21.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 >> 172.21.15.87:0/2887566565 conn(0x561c83e90f30 msgr2=0x561c83e8e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 shutdown_connections 2024-05-08T18:31:21.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 -- 172.21.15.87:0/2887566565 wait complete. 2024-05-08T18:31:21.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 -- 172.21.15.87:0/2445591244 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe92403bb50 msgr2=0x7fe92403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 --2- 172.21.15.87:0/2445591244 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe92403bb50 0x7fe92403e010 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fea3c05d000 tx=0x7fea3c05cf10 comp rx=0 tx=0).stop 2024-05-08T18:31:21.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 -- 172.21.15.87:0/2445591244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e878e0 msgr2=0x561c83e87d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 --2- 172.21.15.87:0/2445591244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e878e0 0x561c83e87d00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x561c83e6d7e0 tx=0x7fea440178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 -- 172.21.15.87:0/2445591244 shutdown_connections 2024-05-08T18:31:21.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 --2- 172.21.15.87:0/2445591244 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe92403bb50 0x7fe92403e010 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 --2- 172.21.15.87:0/2445591244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83e878e0 0x561c83e87d00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 -- 172.21.15.87:0/2445591244 >> 172.21.15.87:0/2445591244 conn(0x561c83e7b980 msgr2=0x561c83e7bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 -- 172.21.15.87:0/2445591244 shutdown_connections 2024-05-08T18:31:21.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.110+0000 7fea4f127800 1 -- 172.21.15.87:0/2445591244 wait complete. 2024-05-08T18:31:21.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.111+0000 7fea4f127800 1 -- 172.21.15.87:0/2968139711 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561c83e76d70 msgr2=0x561c83e79160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.111+0000 7fea4f127800 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561c83e76d70 0x561c83e79160 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.111+0000 7fea4f127800 1 -- 172.21.15.87:0/2968139711 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561c83ce6e20 msgr2=0x561c83e73620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.111+0000 7fea4f127800 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561c83ce6e20 0x561c83e73620 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.111+0000 7fea4f127800 1 -- 172.21.15.87:0/2968139711 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe93003bb50 msgr2=0x7fe93003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.111+0000 7fea4f127800 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe93003bb50 0x7fe93003e010 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fea40000f60 tx=0x7fea400012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.111+0000 7fea4f127800 1 -- 172.21.15.87:0/2968139711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce58c0 msgr2=0x561c83e6c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.111+0000 7fea4f127800 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce58c0 0x561c83e6c480 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fea3c01ced0 tx=0x7fea3c002fb0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.111+0000 7fea4f127800 1 -- 172.21.15.87:0/2968139711 shutdown_connections 2024-05-08T18:31:21.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.111+0000 7fea4f127800 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561c83ce6e20 0x561c83e73620 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.111+0000 7fea4f127800 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561c83e76d70 0x561c83e79160 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.111+0000 7fea4f127800 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe93003bb50 0x7fe93003e010 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.111+0000 7fea4f127800 1 --2- 172.21.15.87:0/2968139711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c83ce58c0 0x561c83e6c480 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.111+0000 7fea4f127800 1 -- 172.21.15.87:0/2968139711 >> 172.21.15.87:0/2968139711 conn(0x561c83d6c870 msgr2=0x561c83e5eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.111+0000 7fea4f127800 1 -- 172.21.15.87:0/2968139711 shutdown_connections 2024-05-08T18:31:21.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.111+0000 7fea4f127800 1 -- 172.21.15.87:0/2968139711 wait complete. 2024-05-08T18:31:21.124 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T18:31:21.097391Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:21.097378Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:21.129 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-08T18:31:21.133 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:21.134 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-05-08T18:31:21.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-05-08T18:31:21.134 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-05-08T18:31:21.176 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:21.177 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:21.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.179+0000 7f3ec3298800 1 Processor -- start 2024-05-08T18:31:21.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.179+0000 7f3ec3298800 1 -- start start 2024-05-08T18:31:21.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.179+0000 7f3ec3298800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55bded62c2b0 0x55bded62c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.179+0000 7f3ec3298800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bded62cd50 con 0x55bded62d470 2024-05-08T18:31:21.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.179+0000 7f3ec3298800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55bded4cce20 con 0x55bded62c2b0 2024-05-08T18:31:21.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.180+0000 7f3ec0d90640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55bded62c2b0 0x55bded62c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.180+0000 7f3eb858f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55bded62d470 0x55bded62d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42132/0 (socket says 172.21.15.87:42132) 2024-05-08T18:31:21.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.180+0000 7f3eb858f640 1 -- 172.21.15.87:0/2811119924 learned_addr learned my addr 172.21.15.87:0/2811119924 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:21.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.180+0000 7f3ebbfff640 1 -- 172.21.15.87:0/2811119924 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4379045 0 0) 0x55bded62cd50 con 0x55bded62d470 2024-05-08T18:31:21.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.180+0000 7f3ebbfff640 1 -- 172.21.15.87:0/2811119924 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3eac001e10 con 0x55bded62d470 2024-05-08T18:31:21.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.180+0000 7f3ec0d90640 1 -- 172.21.15.87:0/2811119924 >> v1:172.21.15.53:6789/0 conn(0x55bded62d470 legacy=0x55bded62d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.180+0000 7f3ec0d90640 1 -- 172.21.15.87:0/2811119924 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bded62e030 con 0x55bded62c2b0 2024-05-08T18:31:21.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.182+0000 7f3ec0d90640 1 --2- 172.21.15.87:0/2811119924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 0x55bded62c6d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000a470 tx=0x7f3eb001cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45c81c71929b26e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.182+0000 7f3ebbfff640 1 -- 172.21.15.87:0/2811119924 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb0057070 con 0x55bded62c2b0 2024-05-08T18:31:21.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.182+0000 7f3ebbfff640 1 -- 172.21.15.87:0/2811119924 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb004acd0 con 0x55bded62c2b0 2024-05-08T18:31:21.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.182+0000 7f3ebbfff640 1 -- 172.21.15.87:0/2811119924 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb0052440 con 0x55bded62c2b0 2024-05-08T18:31:21.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.183+0000 7f3ec3298800 1 -- 172.21.15.87:0/2811119924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 msgr2=0x55bded62c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.183+0000 7f3ec3298800 1 --2- 172.21.15.87:0/2811119924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 0x55bded62c6d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000a470 tx=0x7f3eb001cdb0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.183+0000 7f3ec3298800 1 -- 172.21.15.87:0/2811119924 shutdown_connections 2024-05-08T18:31:21.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.183+0000 7f3ec3298800 1 --2- 172.21.15.87:0/2811119924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 0x55bded62c6d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.183+0000 7f3ec3298800 1 -- 172.21.15.87:0/2811119924 >> 172.21.15.87:0/2811119924 conn(0x55bded627830 msgr2=0x55bded629c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.183+0000 7f3ec3298800 1 -- 172.21.15.87:0/2811119924 shutdown_connections 2024-05-08T18:31:21.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.183+0000 7f3ec3298800 1 -- 172.21.15.87:0/2811119924 wait complete. 2024-05-08T18:31:21.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.196+0000 7f3ec3298800 1 Processor -- start 2024-05-08T18:31:21.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.196+0000 7f3ec3298800 1 -- start start 2024-05-08T18:31:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.197+0000 7f3ec3298800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 0x55bded71d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.197+0000 7f3ec3298800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bded5775b0 con 0x55bded62c2b0 2024-05-08T18:31:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.197+0000 7f3ec0d90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 0x55bded71d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.197+0000 7f3ec0d90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 0x55bded71d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34068/0 (socket says 172.21.15.87:34068) 2024-05-08T18:31:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.197+0000 7f3ec0d90640 1 -- 172.21.15.87:0/1794509180 learned_addr learned my addr 172.21.15.87:0/1794509180 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.197+0000 7f3ec0d90640 1 -- 172.21.15.87:0/1794509180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bded71dae0 con 0x55bded62c2b0 2024-05-08T18:31:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.197+0000 7f3ec0d90640 1 --2- 172.21.15.87:0/1794509180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 0x55bded71d510 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0055040 tx=0x7f3eb004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3493dfb9de3b92ff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.197+0000 7f3daee0d640 1 -- 172.21.15.87:0/1794509180 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb0057040 con 0x55bded62c2b0 2024-05-08T18:31:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.197+0000 7f3daee0d640 1 -- 172.21.15.87:0/1794509180 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb0063070 con 0x55bded62c2b0 2024-05-08T18:31:21.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.197+0000 7f3daee0d640 1 -- 172.21.15.87:0/1794509180 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb00527e0 con 0x55bded62c2b0 2024-05-08T18:31:21.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.198+0000 7f3ec3298800 1 -- 172.21.15.87:0/1794509180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 msgr2=0x55bded71d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.198+0000 7f3ec3298800 1 --2- 172.21.15.87:0/1794509180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 0x55bded71d510 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0055040 tx=0x7f3eb004c000 comp rx=0 tx=0).stop 2024-05-08T18:31:21.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.198+0000 7f3ec3298800 1 -- 172.21.15.87:0/1794509180 shutdown_connections 2024-05-08T18:31:21.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.198+0000 7f3ec3298800 1 --2- 172.21.15.87:0/1794509180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 0x55bded71d510 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.198+0000 7f3ec3298800 1 -- 172.21.15.87:0/1794509180 >> 172.21.15.87:0/1794509180 conn(0x55bded627830 msgr2=0x55bded718e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.198+0000 7f3ec3298800 1 -- 172.21.15.87:0/1794509180 shutdown_connections 2024-05-08T18:31:21.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.198+0000 7f3ec3298800 1 -- 172.21.15.87:0/1794509180 wait complete. 2024-05-08T18:31:21.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.198+0000 7f3ec3298800 1 Processor -- start 2024-05-08T18:31:21.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.199+0000 7f3ec3298800 1 -- start start 2024-05-08T18:31:21.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.199+0000 7f3ec3298800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 0x55bded724fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.199+0000 7f3ec3298800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bded635940 con 0x55bded62c2b0 2024-05-08T18:31:21.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.199+0000 7f3ec0d90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 0x55bded724fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.199+0000 7f3ec0d90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 0x55bded724fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34072/0 (socket says 172.21.15.87:34072) 2024-05-08T18:31:21.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.199+0000 7f3ec0d90640 1 -- 172.21.15.87:0/1293242461 learned_addr learned my addr 172.21.15.87:0/1293242461 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.199+0000 7f3ec0d90640 1 -- 172.21.15.87:0/1293242461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bded725500 con 0x55bded62c2b0 2024-05-08T18:31:21.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.199+0000 7f3ec0d90640 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 0x55bded724fc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0005870 tx=0x7f3eb0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.199+0000 7f3dad60a640 1 -- 172.21.15.87:0/1293242461 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb006d070 con 0x55bded62c2b0 2024-05-08T18:31:21.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.199+0000 7f3dad60a640 1 -- 172.21.15.87:0/1293242461 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb0052ca0 con 0x55bded62c2b0 2024-05-08T18:31:21.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.199+0000 7f3ec3298800 1 -- 172.21.15.87:0/1293242461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bded725790 con 0x55bded62c2b0 2024-05-08T18:31:21.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.199+0000 7f3dad60a640 1 -- 172.21.15.87:0/1293242461 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb0057050 con 0x55bded62c2b0 2024-05-08T18:31:21.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.200+0000 7f3ec3298800 1 -- 172.21.15.87:0/1293242461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bded728440 con 0x55bded62c2b0 2024-05-08T18:31:21.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.200+0000 7f3dad60a640 1 -- 172.21.15.87:0/1293242461 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3eb005d470 con 0x55bded62c2b0 2024-05-08T18:31:21.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.200+0000 7f3dad60a640 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3da803bba0 0x7f3da803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.200+0000 7f3dad60a640 1 -- 172.21.15.87:0/1293242461 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f3eb0093ae0 con 0x55bded62c2b0 2024-05-08T18:31:21.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.201+0000 7f3eb858f640 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3da803bba0 0x7f3da803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.201+0000 7f3ec3298800 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bded62d470 0x55bded72c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.201+0000 7f3ec3298800 1 -- 172.21.15.87:0/1293242461 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded72c7d0 con 0x55bded62d470 2024-05-08T18:31:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.201+0000 7f3ec1591640 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bded62d470 0x55bded72c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.201+0000 7f3eb858f640 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3da803bba0 0x7f3da803e060 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8000f60 tx=0x7f3ea80010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.201+0000 7f3ec1591640 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bded62d470 0x55bded72c200 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.201+0000 7f3ec1591640 1 -- 172.21.15.87:0/1293242461 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ebc00a4a0 con 0x55bded62d470 2024-05-08T18:31:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.201+0000 7f3ec3298800 1 -- 172.21.15.87:0/1293242461 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded7297b0 con 0x55bded62d470 2024-05-08T18:31:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.202+0000 7f3ec1591640 1 -- 172.21.15.87:0/1293242461 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ebc00a4a0 con 0x55bded62d470 2024-05-08T18:31:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.202+0000 7f3ec3298800 1 -- 172.21.15.87:0/1293242461 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded72e620 con 0x55bded62d470 2024-05-08T18:31:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.202+0000 7f3ec1591640 1 -- 172.21.15.87:0/1293242461 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3ebc00a4a0 con 0x55bded62d470 2024-05-08T18:31:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.202+0000 7f3ec3298800 1 -- 172.21.15.87:0/1293242461 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded72d760 con 0x55bded62d470 2024-05-08T18:31:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.202+0000 7f3ec1591640 1 -- 172.21.15.87:0/1293242461 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ebc00a4a0 con 0x55bded62d470 2024-05-08T18:31:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.202+0000 7f3ec3298800 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55bded72e200 0x55bded731a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.202+0000 7f3ec3298800 1 -- 172.21.15.87:0/1293242461 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded7321f0 con 0x55bded72e200 2024-05-08T18:31:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.202+0000 7f3ec0d90640 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55bded72e200 0x55bded731a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.203+0000 7f3ec0d90640 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55bded72e200 0x55bded731a60 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.203+0000 7f3ec0d90640 1 -- 172.21.15.87:0/1293242461 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3eb005a040 con 0x55bded72e200 2024-05-08T18:31:21.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.203+0000 7f3ec3298800 1 Processor -- start 2024-05-08T18:31:21.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.203+0000 7f3ec3298800 1 -- start start 2024-05-08T18:31:21.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.203+0000 7f3ec3298800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded5a1ed0 0x55bded5a0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.203+0000 7f3ec3298800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bded51dfc0 con 0x55bded5a1ed0 2024-05-08T18:31:21.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.204+0000 7f3ec1591640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded5a1ed0 0x55bded5a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.204+0000 7f3ec1591640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded5a1ed0 0x55bded5a0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34082/0 (socket says 172.21.15.87:34082) 2024-05-08T18:31:21.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.204+0000 7f3ec1591640 1 -- 172.21.15.87:0/698170365 learned_addr learned my addr 172.21.15.87:0/698170365 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.204+0000 7f3ec1591640 1 -- 172.21.15.87:0/698170365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bded5a0880 con 0x55bded5a1ed0 2024-05-08T18:31:21.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.204+0000 7f3ec1591640 1 --2- 172.21.15.87:0/698170365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded5a1ed0 0x55bded5a0340 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x55bded72cbb0 tx=0x7f3ebc0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.204+0000 7f3da67fc640 1 -- 172.21.15.87:0/698170365 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc013440 con 0x55bded5a1ed0 2024-05-08T18:31:21.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.204+0000 7f3da67fc640 1 -- 172.21.15.87:0/698170365 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ebc0135e0 con 0x55bded5a1ed0 2024-05-08T18:31:21.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.204+0000 7f3ec3298800 1 -- 172.21.15.87:0/698170365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bded5a0b10 con 0x55bded5a1ed0 2024-05-08T18:31:21.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.204+0000 7f3da67fc640 1 -- 172.21.15.87:0/698170365 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc0138c0 con 0x55bded5a1ed0 2024-05-08T18:31:21.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.204+0000 7f3ec3298800 1 -- 172.21.15.87:0/698170365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bded5a1010 con 0x55bded5a1ed0 2024-05-08T18:31:21.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.205+0000 7f3da67fc640 1 -- 172.21.15.87:0/698170365 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3ebc011040 con 0x55bded5a1ed0 2024-05-08T18:31:21.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.205+0000 7f3da67fc640 1 --2- 172.21.15.87:0/698170365 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d9803bba0 0x7f3d9803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.205+0000 7f3da67fc640 1 -- 172.21.15.87:0/698170365 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f3ebc01d070 con 0x55bded5a1ed0 2024-05-08T18:31:21.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.205+0000 7f3ec0d90640 1 --2- 172.21.15.87:0/698170365 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d9803bba0 0x7f3d9803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.206+0000 7f3ec3298800 1 Processor -- start 2024-05-08T18:31:21.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.206+0000 7f3ec0d90640 1 --2- 172.21.15.87:0/698170365 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d9803bba0 0x7f3d9803e060 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3eb005ce20 tx=0x7f3eb0091da0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.206+0000 7f3ec3298800 1 -- start start 2024-05-08T18:31:21.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.206+0000 7f3ec3298800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded74fa70 0x55bded74fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.206+0000 7f3ec3298800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bded71dda0 con 0x55bded74fa70 2024-05-08T18:31:21.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.206+0000 7f3ec1591640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded74fa70 0x55bded74fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.206+0000 7f3ec1591640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded74fa70 0x55bded74fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34092/0 (socket says 172.21.15.87:34092) 2024-05-08T18:31:21.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.206+0000 7f3ec1591640 1 -- 172.21.15.87:0/652001153 learned_addr learned my addr 172.21.15.87:0/652001153 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.206+0000 7f3ec1591640 1 -- 172.21.15.87:0/652001153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bded750460 con 0x55bded74fa70 2024-05-08T18:31:21.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.206+0000 7f3ec1591640 1 --2- 172.21.15.87:0/652001153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded74fa70 0x55bded74fe90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc052980 tx=0x7f3ebc001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f75770b33e865d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.206+0000 7f3d97fff640 1 -- 172.21.15.87:0/652001153 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc02ad80 con 0x55bded74fa70 2024-05-08T18:31:21.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.206+0000 7f3d97fff640 1 -- 172.21.15.87:0/652001153 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ebc021c40 con 0x55bded74fa70 2024-05-08T18:31:21.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.206+0000 7f3d97fff640 1 -- 172.21.15.87:0/652001153 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc0512b0 con 0x55bded74fa70 2024-05-08T18:31:21.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.207+0000 7f3ec3298800 1 -- 172.21.15.87:0/652001153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded74fa70 msgr2=0x55bded74fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.207+0000 7f3ec3298800 1 --2- 172.21.15.87:0/652001153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded74fa70 0x55bded74fe90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc052980 tx=0x7f3ebc001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:21.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.207+0000 7f3ec3298800 1 -- 172.21.15.87:0/652001153 shutdown_connections 2024-05-08T18:31:21.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.207+0000 7f3ec3298800 1 --2- 172.21.15.87:0/652001153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded74fa70 0x55bded74fe90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.207+0000 7f3ec3298800 1 -- 172.21.15.87:0/652001153 >> 172.21.15.87:0/652001153 conn(0x55bded74bd40 msgr2=0x55bded749da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.207+0000 7f3ec3298800 1 -- 172.21.15.87:0/652001153 shutdown_connections 2024-05-08T18:31:21.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.207+0000 7f3ec3298800 1 -- 172.21.15.87:0/652001153 wait complete. 2024-05-08T18:31:21.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.207+0000 7f3ec3298800 1 Processor -- start 2024-05-08T18:31:21.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.207+0000 7f3ec3298800 1 -- start start 2024-05-08T18:31:21.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.207+0000 7f3ec3298800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded74fa70 0x55bded756fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.207+0000 7f3ec3298800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bded750c20 con 0x55bded74fa70 2024-05-08T18:31:21.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.208+0000 7f3ec1591640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded74fa70 0x55bded756fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.208+0000 7f3ec1591640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded74fa70 0x55bded756fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34094/0 (socket says 172.21.15.87:34094) 2024-05-08T18:31:21.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.208+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 learned_addr learned my addr 172.21.15.87:0/3234264019 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.208+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bded7574f0 con 0x55bded74fa70 2024-05-08T18:31:21.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.208+0000 7f3ec1591640 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded74fa70 0x55bded756fb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0294c0 tx=0x7f3ebc0528e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.208+0000 7f3d967fc640 1 -- 172.21.15.87:0/3234264019 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc030070 con 0x55bded74fa70 2024-05-08T18:31:21.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.208+0000 7f3d967fc640 1 -- 172.21.15.87:0/3234264019 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ebc0540d0 con 0x55bded74fa70 2024-05-08T18:31:21.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.208+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bded7577e0 con 0x55bded74fa70 2024-05-08T18:31:21.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.208+0000 7f3d967fc640 1 -- 172.21.15.87:0/3234264019 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc0543f0 con 0x55bded74fa70 2024-05-08T18:31:21.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.208+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bded75a430 con 0x55bded74fa70 2024-05-08T18:31:21.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.209+0000 7f3d967fc640 1 -- 172.21.15.87:0/3234264019 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3ebc033070 con 0x55bded74fa70 2024-05-08T18:31:21.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.209+0000 7f3d967fc640 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d8c03bba0 0x7f3d8c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.209+0000 7f3d967fc640 1 -- 172.21.15.87:0/3234264019 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f3ebc049040 con 0x55bded74fa70 2024-05-08T18:31:21.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.209+0000 7f3ec0d90640 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d8c03bba0 0x7f3d8c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.209+0000 7f3ec3298800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.209+0000 7f3ec3298800 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bded762cb0 0x55bded765170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.209+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded7658c0 con 0x55bded762cb0 2024-05-08T18:31:21.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.210+0000 7f3ec0d90640 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d8c03bba0 0x7f3d8c03e060 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0092130 tx=0x7f3eb007e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.210+0000 7f3eb858f640 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bded762cb0 0x55bded765170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.210+0000 7f3eb858f640 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bded762cb0 0x55bded765170 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.210+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ea8009050 con 0x55bded762cb0 2024-05-08T18:31:21.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.210+0000 7f3ec3298800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.210+0000 7f3ec3298800 20 realm 2024-05-08T18:31:21.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.210+0000 7f3ec3298800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.210+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded762100 con 0x55bded762cb0 2024-05-08T18:31:21.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.210+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ea8009050 con 0x55bded762cb0 2024-05-08T18:31:21.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.210+0000 7f3ec3298800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.210+0000 7f3ec3298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:21.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.210+0000 7f3ec3298800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.210+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded7663a0 con 0x55bded762cb0 2024-05-08T18:31:21.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.211+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ea8009050 con 0x55bded762cb0 2024-05-08T18:31:21.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.211+0000 7f3ec3298800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.211+0000 7f3ec3298800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.211+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded766c70 con 0x55bded762cb0 2024-05-08T18:31:21.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.211+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ea8009050 con 0x55bded762cb0 2024-05-08T18:31:21.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.211+0000 7f3ec3298800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:21.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.211+0000 7f3ec3298800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.211+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded767010 con 0x55bded762cb0 2024-05-08T18:31:21.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.211+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3ea8009050 con 0x55bded762cb0 2024-05-08T18:31:21.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.211+0000 7f3ec3298800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:21.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.211+0000 7f3ec3298800 20 searching for the correct realm 2024-05-08T18:31:21.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.211+0000 7f3ec3298800 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55bded768ef0 0x55bded76b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.211+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x55bded768ef0 2024-05-08T18:31:21.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.211+0000 7f3ec1591640 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55bded768ef0 0x55bded76b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.212+0000 7f3ec1591640 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55bded768ef0 0x55bded76b2e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.212+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc035d70 con 0x55bded768ef0 2024-05-08T18:31:21.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.212+0000 7f3ec1591640 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f3ebc035070 0x7f3ebc02a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.212+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x7f3ebc035070 2024-05-08T18:31:21.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.212+0000 7f3ec0d90640 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f3ebc035070 0x7f3ebc02a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.212+0000 7f3ec0d90640 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f3ebc035070 0x7f3ebc02a6d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.213+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb005a040 con 0x7f3ebc035070 2024-05-08T18:31:21.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.213+0000 7f3ec0d90640 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f3eb005d9c0 0x7f3eb0066380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.213+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x7f3eb005d9c0 2024-05-08T18:31:21.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.213+0000 7f3eb858f640 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f3eb005d9c0 0x7f3eb0066380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.213+0000 7f3eb858f640 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f3eb005d9c0 0x7f3eb0066380 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.214+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea8009050 con 0x7f3eb005d9c0 2024-05-08T18:31:21.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.214+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x55bded762cb0 2024-05-08T18:31:21.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.214+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea8009050 con 0x55bded762cb0 2024-05-08T18:31:21.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.214+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x55bded762cb0 2024-05-08T18:31:21.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.214+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.214+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x7f3eb005d9c0 2024-05-08T18:31:21.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.214+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.214+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x7f3eb005d9c0 2024-05-08T18:31:21.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.215+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.215+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x7f3ebc035070 2024-05-08T18:31:21.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.215+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb009e040 con 0x7f3ebc035070 2024-05-08T18:31:21.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.215+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x55bded768ef0 2024-05-08T18:31:21.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.215+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc035d70 con 0x55bded768ef0 2024-05-08T18:31:21.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.215+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x55bded762cb0 2024-05-08T18:31:21.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.215+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.215+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x7f3eb005d9c0 2024-05-08T18:31:21.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.216+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.216+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x55bded762cb0 2024-05-08T18:31:21.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.216+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.216+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x7f3ebc035070 2024-05-08T18:31:21.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.216+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3eb009e040 con 0x7f3ebc035070 2024-05-08T18:31:21.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.216+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x55bded768ef0 2024-05-08T18:31:21.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.216+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc035d70 con 0x55bded768ef0 2024-05-08T18:31:21.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.216+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x55bded768ef0 2024-05-08T18:31:21.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.217+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc035d70 con 0x55bded768ef0 2024-05-08T18:31:21.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.217+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x7f3eb005d9c0 2024-05-08T18:31:21.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.217+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.217+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x55bded768ef0 2024-05-08T18:31:21.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.217+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc035d70 con 0x55bded768ef0 2024-05-08T18:31:21.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.217+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x55bded768ef0 2024-05-08T18:31:21.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.217+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc035d70 con 0x55bded768ef0 2024-05-08T18:31:21.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.217+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x55bded762cb0 2024-05-08T18:31:21.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.218+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.218+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x55bded762cb0 2024-05-08T18:31:21.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.218+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.218+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x7f3eb005d9c0 2024-05-08T18:31:21.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.218+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.218+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x55bded768ef0 2024-05-08T18:31:21.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.218+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc035d70 con 0x55bded768ef0 2024-05-08T18:31:21.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.218+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x7f3ebc035070 2024-05-08T18:31:21.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.219+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb009e040 con 0x7f3ebc035070 2024-05-08T18:31:21.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.219+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x55bded762cb0 2024-05-08T18:31:21.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.219+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.219+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x7f3eb005d9c0 2024-05-08T18:31:21.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.219+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.219+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x55bded768ef0 2024-05-08T18:31:21.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.220+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc035d70 con 0x55bded768ef0 2024-05-08T18:31:21.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.220+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x7f3eb005d9c0 2024-05-08T18:31:21.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.220+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.220+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x7f3ebc035070 2024-05-08T18:31:21.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.220+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb009e040 con 0x7f3ebc035070 2024-05-08T18:31:21.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.220+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x55bded768ef0 2024-05-08T18:31:21.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.220+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc035d70 con 0x55bded768ef0 2024-05-08T18:31:21.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.220+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x7f3eb005d9c0 2024-05-08T18:31:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.221+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.221+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x55bded762cb0 2024-05-08T18:31:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.221+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.221+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bded76b9b0 con 0x7f3ebc035070 2024-05-08T18:31:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.221+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb009e040 con 0x7f3ebc035070 2024-05-08T18:31:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.221+0000 7f3ec3298800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.221+0000 7f3ec3298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.221+0000 7f3ec3298800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.221+0000 7f3ec3298800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.221+0000 7f3ec3298800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.221+0000 7f3ec3298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.221+0000 7f3ec3298800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.221+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded7679c0 con 0x55bded762cb0 2024-05-08T18:31:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3ec3298800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3ec3298800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded768260 con 0x55bded762cb0 2024-05-08T18:31:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3ec3298800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3ec3298800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded767600 con 0x7f3eb005d9c0 2024-05-08T18:31:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3ec3298800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3ec3298800 20 zone default found 2024-05-08T18:31:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3ec3298800 4 Realm: () 2024-05-08T18:31:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3ec3298800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3ec3298800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3ec3298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3ec3298800 20 zonegroup default 2024-05-08T18:31:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3ec3298800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.222+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded76be30 con 0x7f3eb005d9c0 2024-05-08T18:31:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.223+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.223+0000 7f3ec3298800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.223+0000 7f3ec3298800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.223+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded76dcc0 con 0x55bded768ef0 2024-05-08T18:31:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.223+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3ebc035d70 con 0x55bded768ef0 2024-05-08T18:31:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.223+0000 7f3ec3298800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.223+0000 7f3ec3298800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.223+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded76e060 con 0x55bded768ef0 2024-05-08T18:31:21.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.223+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3ebc035d70 con 0x55bded768ef0 2024-05-08T18:31:21.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.223+0000 7f3ec3298800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.223+0000 7f3ec3298800 20 started sync module instance, tier type = 2024-05-08T18:31:21.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.223+0000 7f3ec3298800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:21.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.223+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded76d100 con 0x7f3ebc035070 2024-05-08T18:31:21.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.224+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb009e040 con 0x7f3ebc035070 2024-05-08T18:31:21.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.224+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94274221167904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded76cd60 con 0x7f3ebc035070 2024-05-08T18:31:21.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.224+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded76ede0 con 0x55bded762cb0 2024-05-08T18:31:21.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.225+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94274221167904] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb009e040 con 0x7f3ebc035070 2024-05-08T18:31:21.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.225+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.225+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94274221171712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded76f1d0 con 0x55bded762cb0 2024-05-08T18:31:21.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.225+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded76fc30 con 0x55bded768ef0 2024-05-08T18:31:21.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.226+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94274221171712] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.227+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc035d70 con 0x55bded768ef0 2024-05-08T18:31:21.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.227+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94274221176544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded770020 con 0x55bded768ef0 2024-05-08T18:31:21.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.227+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded770a80 con 0x7f3ebc035070 2024-05-08T18:31:21.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.227+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94274221176544] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc035d70 con 0x55bded768ef0 2024-05-08T18:31:21.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.228+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb009e040 con 0x7f3ebc035070 2024-05-08T18:31:21.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.228+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94274221172768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded770e70 con 0x7f3ebc035070 2024-05-08T18:31:21.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.228+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded771890 con 0x55bded762cb0 2024-05-08T18:31:21.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.229+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.229+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94274221183872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded772160 con 0x55bded762cb0 2024-05-08T18:31:21.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.229+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded772c50 con 0x7f3eb005d9c0 2024-05-08T18:31:21.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.229+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94274221172768] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb009e040 con 0x7f3ebc035070 2024-05-08T18:31:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.230+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94274221183872] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.230+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.230+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94274221188896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded771c60 con 0x7f3eb005d9c0 2024-05-08T18:31:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.230+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded7734f0 con 0x7f3eb005d9c0 2024-05-08T18:31:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.231+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(56 notify.6 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.231+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94274221191232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded771c60 con 0x7f3eb005d9c0 2024-05-08T18:31:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.231+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded774030 con 0x7f3eb005d9c0 2024-05-08T18:31:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.231+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94274221188896] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.232+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94274221191232] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.232+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.232+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94274221192288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded773ff0 con 0x7f3eb005d9c0 2024-05-08T18:31:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.232+0000 7f3ec3298800 20 add_watcher() i=0 2024-05-08T18:31:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.232+0000 7f3ec3298800 20 add_watcher() i=1 2024-05-08T18:31:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.232+0000 7f3ec3298800 20 add_watcher() i=2 2024-05-08T18:31:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.232+0000 7f3ec3298800 20 add_watcher() i=3 2024-05-08T18:31:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.232+0000 7f3ec3298800 20 add_watcher() i=4 2024-05-08T18:31:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.232+0000 7f3ec3298800 20 add_watcher() i=5 2024-05-08T18:31:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.232+0000 7f3ec3298800 20 add_watcher() i=6 2024-05-08T18:31:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.233+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94274221192288] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.233+0000 7f3ec3298800 20 add_watcher() i=7 2024-05-08T18:31:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.233+0000 7f3ec3298800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.233+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded770560 con 0x55bded762cb0 2024-05-08T18:31:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.233+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.233+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94274221193984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded770560 con 0x55bded762cb0 2024-05-08T18:31:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.234+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94274221193984] v27'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.234+0000 7f3d76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.234+0000 7f3ec3298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:21.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.234+0000 7f3ec3298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:21.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.234+0000 7f3ec3298800 5 note: GC not initialized 2024-05-08T18:31:21.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.235+0000 7f3d75fe3640 20 reqs_thread_entry: start 2024-05-08T18:31:21.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.235+0000 7f3ec3298800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:21.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.235+0000 7f3ec3298800 20 Filter name: none 2024-05-08T18:31:21.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.235+0000 7f3ce77fe640 20 reqs_thread_entry: start 2024-05-08T18:31:21.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.235+0000 7f3ec3298800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.235+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bded7a9e50 con 0x7f3ebc035070 2024-05-08T18:31:21.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.235+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f3eb009e040 con 0x7f3ebc035070 2024-05-08T18:31:21.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.235+0000 7f3ec3298800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:21.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.236+0000 7f3d76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:21.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.236+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94274221193984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded7a7dd0 con 0x55bded762cb0 2024-05-08T18:31:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.237+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94274221193984] v27'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.237+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94274221167904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded7a7dd0 con 0x7f3ebc035070 2024-05-08T18:31:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.238+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94274221167904] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb009e040 con 0x7f3ebc035070 2024-05-08T18:31:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.238+0000 7f3ec3298800 20 remove_watcher() i=0 2024-05-08T18:31:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.238+0000 7f3ec3298800 2 removed watcher, disabling cache 2024-05-08T18:31:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.238+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94274221171712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded7a7dd0 con 0x55bded762cb0 2024-05-08T18:31:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.239+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94274221171712] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.239+0000 7f3ec3298800 20 remove_watcher() i=1 2024-05-08T18:31:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.239+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94274221176544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded76e400 con 0x55bded768ef0 2024-05-08T18:31:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.240+0000 7f3ec1591640 1 -- 172.21.15.87:0/3234264019 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94274221176544] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc035d70 con 0x55bded768ef0 2024-05-08T18:31:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.240+0000 7f3ec3298800 20 remove_watcher() i=2 2024-05-08T18:31:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.240+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94274221172768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded7a7dd0 con 0x7f3ebc035070 2024-05-08T18:31:21.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.242+0000 7f3ec0d90640 1 -- 172.21.15.87:0/3234264019 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94274221172768] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb009e040 con 0x7f3ebc035070 2024-05-08T18:31:21.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.242+0000 7f3ec3298800 20 remove_watcher() i=3 2024-05-08T18:31:21.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.242+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94274221183872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded76f6e0 con 0x55bded762cb0 2024-05-08T18:31:21.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.242+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94274221183872] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x55bded762cb0 2024-05-08T18:31:21.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.243+0000 7f3ec3298800 20 remove_watcher() i=4 2024-05-08T18:31:21.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.243+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94274221188896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded7a7dd0 con 0x7f3eb005d9c0 2024-05-08T18:31:21.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.244+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94274221188896] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.244+0000 7f3ec3298800 20 remove_watcher() i=5 2024-05-08T18:31:21.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.244+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94274221191232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded771380 con 0x7f3eb005d9c0 2024-05-08T18:31:21.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.244+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94274221191232] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.244+0000 7f3ec3298800 20 remove_watcher() i=6 2024-05-08T18:31:21.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.244+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94274221192288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bded76f6e0 con 0x7f3eb005d9c0 2024-05-08T18:31:21.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.245+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94274221192288] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea802a040 con 0x7f3eb005d9c0 2024-05-08T18:31:21.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 20 remove_watcher() i=7 2024-05-08T18:31:21.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f3eb005d9c0 msgr2=0x7f3eb0066380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f3eb005d9c0 0x7f3eb0066380 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bded762cb0 msgr2=0x55bded765170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bded762cb0 0x55bded765170 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f3ebc035070 msgr2=0x7f3ebc02a6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f3ebc035070 0x7f3ebc02a6d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55bded768ef0 msgr2=0x55bded76b2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55bded768ef0 0x55bded76b2e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d8c03bba0 msgr2=0x7f3d8c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d8c03bba0 0x7f3d8c03e060 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0092130 tx=0x7f3eb007e000 comp rx=0 tx=0).stop 2024-05-08T18:31:21.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded74fa70 msgr2=0x55bded756fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3eb858f640 1 -- 172.21.15.87:0/3234264019 reap_dead start 2024-05-08T18:31:21.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded74fa70 0x55bded756fb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0294c0 tx=0x7f3ebc0528e0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 shutdown_connections 2024-05-08T18:31:21.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 --2- 172.21.15.87:0/3234264019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded74fa70 0x55bded756fb0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 >> 172.21.15.87:0/3234264019 conn(0x55bded74bd40 msgr2=0x55bded749d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 shutdown_connections 2024-05-08T18:31:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 -- 172.21.15.87:0/3234264019 wait complete. 2024-05-08T18:31:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 -- 172.21.15.87:0/698170365 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d9803bba0 msgr2=0x7f3d9803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 --2- 172.21.15.87:0/698170365 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d9803bba0 0x7f3d9803e060 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3eb005ce20 tx=0x7f3eb0091da0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 -- 172.21.15.87:0/698170365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded5a1ed0 msgr2=0x55bded5a0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 --2- 172.21.15.87:0/698170365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded5a1ed0 0x55bded5a0340 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x55bded72cbb0 tx=0x7f3ebc0178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 -- 172.21.15.87:0/698170365 shutdown_connections 2024-05-08T18:31:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 --2- 172.21.15.87:0/698170365 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d9803bba0 0x7f3d9803e060 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 --2- 172.21.15.87:0/698170365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded5a1ed0 0x55bded5a0340 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 -- 172.21.15.87:0/698170365 >> 172.21.15.87:0/698170365 conn(0x55bded734600 msgr2=0x55bded734a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 -- 172.21.15.87:0/698170365 shutdown_connections 2024-05-08T18:31:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.246+0000 7f3ec3298800 1 -- 172.21.15.87:0/698170365 wait complete. 2024-05-08T18:31:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.247+0000 7f3ec3298800 1 -- 172.21.15.87:0/1293242461 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55bded72e200 msgr2=0x55bded731a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.247+0000 7f3ec3298800 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55bded72e200 0x55bded731a60 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.247+0000 7f3ec3298800 1 -- 172.21.15.87:0/1293242461 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bded62d470 msgr2=0x55bded72c200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.247+0000 7f3ec3298800 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bded62d470 0x55bded72c200 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.247+0000 7f3ec3298800 1 -- 172.21.15.87:0/1293242461 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3da803bba0 msgr2=0x7f3da803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.247+0000 7f3ec3298800 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3da803bba0 0x7f3da803e060 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8000f60 tx=0x7f3ea80010a0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.247+0000 7f3ec3298800 1 -- 172.21.15.87:0/1293242461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 msgr2=0x55bded724fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.247+0000 7f3ec3298800 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 0x55bded724fc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0005870 tx=0x7f3eb0002fb0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.247+0000 7f3ec3298800 1 -- 172.21.15.87:0/1293242461 shutdown_connections 2024-05-08T18:31:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.247+0000 7f3ec3298800 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bded62d470 0x55bded72c200 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.247+0000 7f3ec3298800 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55bded72e200 0x55bded731a60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.247+0000 7f3ec3298800 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3da803bba0 0x7f3da803e060 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.247+0000 7f3ec3298800 1 --2- 172.21.15.87:0/1293242461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bded62c2b0 0x55bded724fc0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.247+0000 7f3ec3298800 1 -- 172.21.15.87:0/1293242461 >> 172.21.15.87:0/1293242461 conn(0x55bded627830 msgr2=0x55bded717630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.247+0000 7f3ec3298800 1 -- 172.21.15.87:0/1293242461 shutdown_connections 2024-05-08T18:31:21.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.247+0000 7f3ec3298800 1 -- 172.21.15.87:0/1293242461 wait complete. 2024-05-08T18:31:21.257 INFO:teuthology.orchestra.run.smithi087.stdout:{"key":"bucket:myfoo","ver":{"tag":"_7_sysLSYJIxHNeDlNGwfAjV","ver":2},"mtime":"2024-05-08T18:31:20.954529Z","data":{"bucket":{"name":"myfoo","marker":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1","bucket_id":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-05-08T18:31:19.867262Z","linked":false,"has_bucket_info":false}} 2024-05-08T18:31:21.258 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_7_sysLSYJIxHNeDlNGwfAjV', 'ver': 2}, 'mtime': '2024-05-08T18:31:20.954529Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1', 'bucket_id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-05-08T18:31:19.867262Z', 'linked': False, 'has_bucket_info': False}} 2024-05-08T18:31:21.258 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1'] 2024-05-08T18:31:21.258 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1'] 2024-05-08T18:31:21.258 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 2024-05-08T18:31:21.346 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:21.346 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:21.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.349+0000 7f331f41f800 1 Processor -- start 2024-05-08T18:31:21.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.349+0000 7f331f41f800 1 -- start start 2024-05-08T18:31:21.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.349+0000 7f331f41f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5571ff875cf0 0x5571ff8780e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.349+0000 7f331f41f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5571ff87c130 con 0x5571ff878620 2024-05-08T18:31:21.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.349+0000 7f331f41f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5571ff715e20 con 0x5571ff875cf0 2024-05-08T18:31:21.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.349+0000 7f331cf17640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5571ff875cf0 0x5571ff8780e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.349+0000 7f3317fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5571ff878620 0x5571ff87aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42134/0 (socket says 172.21.15.87:42134) 2024-05-08T18:31:21.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.349+0000 7f331cf17640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5571ff875cf0 0x5571ff8780e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34096/0 (socket says 172.21.15.87:34096) 2024-05-08T18:31:21.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.349+0000 7f3317fff640 1 -- 172.21.15.87:0/1308687641 learned_addr learned my addr 172.21.15.87:0/1308687641 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:21.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.350+0000 7f331cf17640 1 -- 172.21.15.87:0/1308687641 >> v1:172.21.15.53:6789/0 conn(0x5571ff878620 legacy=0x5571ff87aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.350+0000 7f331cf17640 1 -- 172.21.15.87:0/1308687641 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ff87d310 con 0x5571ff875cf0 2024-05-08T18:31:21.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.351+0000 7f331cf17640 1 --2- 172.21.15.87:0/1308687641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 0x5571ff8780e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f331000a470 tx=0x7f331001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52cdbb5936584fe8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.352+0000 7f33177fe640 1 -- 172.21.15.87:0/1308687641 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3310057070 con 0x5571ff875cf0 2024-05-08T18:31:21.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.352+0000 7f33177fe640 1 -- 172.21.15.87:0/1308687641 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3310052570 con 0x5571ff875cf0 2024-05-08T18:31:21.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.352+0000 7f33177fe640 1 -- 172.21.15.87:0/1308687641 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3310052870 con 0x5571ff875cf0 2024-05-08T18:31:21.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.352+0000 7f331f41f800 1 -- 172.21.15.87:0/1308687641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 msgr2=0x5571ff8780e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.352+0000 7f331f41f800 1 --2- 172.21.15.87:0/1308687641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 0x5571ff8780e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f331000a470 tx=0x7f331001ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:21.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.352+0000 7f331f41f800 1 -- 172.21.15.87:0/1308687641 shutdown_connections 2024-05-08T18:31:21.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.352+0000 7f331f41f800 1 --2- 172.21.15.87:0/1308687641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 0x5571ff8780e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.352+0000 7f331f41f800 1 -- 172.21.15.87:0/1308687641 >> 172.21.15.87:0/1308687641 conn(0x5571ff86f740 msgr2=0x5571ff871b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.352+0000 7f331f41f800 1 -- 172.21.15.87:0/1308687641 shutdown_connections 2024-05-08T18:31:21.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.352+0000 7f331f41f800 1 -- 172.21.15.87:0/1308687641 wait complete. 2024-05-08T18:31:21.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.366+0000 7f331f41f800 1 Processor -- start 2024-05-08T18:31:21.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.366+0000 7f331f41f800 1 -- start start 2024-05-08T18:31:21.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.366+0000 7f331f41f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 0x5571ff966700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.366+0000 7f331f41f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5571ff7c05d0 con 0x5571ff875cf0 2024-05-08T18:31:21.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.366+0000 7f331cf17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 0x5571ff966700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.367+0000 7f331cf17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 0x5571ff966700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34100/0 (socket says 172.21.15.87:34100) 2024-05-08T18:31:21.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.367+0000 7f331cf17640 1 -- 172.21.15.87:0/2307277384 learned_addr learned my addr 172.21.15.87:0/2307277384 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.367+0000 7f331cf17640 1 -- 172.21.15.87:0/2307277384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ff966cd0 con 0x5571ff875cf0 2024-05-08T18:31:21.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.367+0000 7f331cf17640 1 --2- 172.21.15.87:0/2307277384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 0x5571ff966700 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3310055040 tx=0x7f331004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c600afb597be2d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.367+0000 7f320ae05640 1 -- 172.21.15.87:0/2307277384 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3310057040 con 0x5571ff875cf0 2024-05-08T18:31:21.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.367+0000 7f320ae05640 1 -- 172.21.15.87:0/2307277384 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3310052990 con 0x5571ff875cf0 2024-05-08T18:31:21.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.367+0000 7f320ae05640 1 -- 172.21.15.87:0/2307277384 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3310052c70 con 0x5571ff875cf0 2024-05-08T18:31:21.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.368+0000 7f331f41f800 1 -- 172.21.15.87:0/2307277384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 msgr2=0x5571ff966700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.368+0000 7f331f41f800 1 --2- 172.21.15.87:0/2307277384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 0x5571ff966700 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3310055040 tx=0x7f331004c000 comp rx=0 tx=0).stop 2024-05-08T18:31:21.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.368+0000 7f331f41f800 1 -- 172.21.15.87:0/2307277384 shutdown_connections 2024-05-08T18:31:21.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.368+0000 7f331f41f800 1 --2- 172.21.15.87:0/2307277384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 0x5571ff966700 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.368+0000 7f331f41f800 1 -- 172.21.15.87:0/2307277384 >> 172.21.15.87:0/2307277384 conn(0x5571ff86f740 msgr2=0x5571ff962020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.368+0000 7f331f41f800 1 -- 172.21.15.87:0/2307277384 shutdown_connections 2024-05-08T18:31:21.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.368+0000 7f331f41f800 1 -- 172.21.15.87:0/2307277384 wait complete. 2024-05-08T18:31:21.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.368+0000 7f331f41f800 1 Processor -- start 2024-05-08T18:31:21.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.368+0000 7f331f41f800 1 -- start start 2024-05-08T18:31:21.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.368+0000 7f331f41f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 0x5571ff96e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.368+0000 7f331f41f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5571ff87c5a0 con 0x5571ff875cf0 2024-05-08T18:31:21.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.369+0000 7f331cf17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 0x5571ff96e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.369+0000 7f331cf17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 0x5571ff96e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34110/0 (socket says 172.21.15.87:34110) 2024-05-08T18:31:21.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.369+0000 7f331cf17640 1 -- 172.21.15.87:0/188733906 learned_addr learned my addr 172.21.15.87:0/188733906 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.369+0000 7f331cf17640 1 -- 172.21.15.87:0/188733906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ff96e6f0 con 0x5571ff875cf0 2024-05-08T18:31:21.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.369+0000 7f331cf17640 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 0x5571ff96e1b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f331000a470 tx=0x7f3310003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.369+0000 7f3209602640 1 -- 172.21.15.87:0/188733906 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3310073070 con 0x5571ff875cf0 2024-05-08T18:31:21.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.369+0000 7f3209602640 1 -- 172.21.15.87:0/188733906 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f331005d650 con 0x5571ff875cf0 2024-05-08T18:31:21.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.369+0000 7f3209602640 1 -- 172.21.15.87:0/188733906 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3310057070 con 0x5571ff875cf0 2024-05-08T18:31:21.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.370+0000 7f331f41f800 1 -- 172.21.15.87:0/188733906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571ff96e980 con 0x5571ff875cf0 2024-05-08T18:31:21.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.370+0000 7f331f41f800 1 -- 172.21.15.87:0/188733906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571ff971630 con 0x5571ff875cf0 2024-05-08T18:31:21.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.371+0000 7f3209602640 1 -- 172.21.15.87:0/188733906 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3310076070 con 0x5571ff875cf0 2024-05-08T18:31:21.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.371+0000 7f3209602640 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f320403bba0 0x7f320403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.371+0000 7f3209602640 1 -- 172.21.15.87:0/188733906 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f33100942f0 con 0x5571ff875cf0 2024-05-08T18:31:21.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.371+0000 7f3317fff640 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f320403bba0 0x7f320403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.371+0000 7f331f41f800 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5571ff878620 0x5571ff9753f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.371+0000 7f331f41f800 1 -- 172.21.15.87:0/188733906 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff975930 con 0x5571ff878620 2024-05-08T18:31:21.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.371+0000 7f331d718640 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5571ff878620 0x5571ff9753f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.371+0000 7f3317fff640 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f320403bba0 0x7f320403e060 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3308000f60 tx=0x7f33080012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.372+0000 7f331d718640 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5571ff878620 0x5571ff9753f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.372+0000 7f331d718640 1 -- 172.21.15.87:0/188733906 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f331800a4a0 con 0x5571ff878620 2024-05-08T18:31:21.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.372+0000 7f331f41f800 1 -- 172.21.15.87:0/188733906 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9729c0 con 0x5571ff878620 2024-05-08T18:31:21.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.372+0000 7f331d718640 1 -- 172.21.15.87:0/188733906 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f331800a4a0 con 0x5571ff878620 2024-05-08T18:31:21.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.372+0000 7f331f41f800 1 -- 172.21.15.87:0/188733906 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff977770 con 0x5571ff878620 2024-05-08T18:31:21.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.372+0000 7f331d718640 1 -- 172.21.15.87:0/188733906 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f331800a4a0 con 0x5571ff878620 2024-05-08T18:31:21.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.372+0000 7f331f41f800 1 -- 172.21.15.87:0/188733906 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9769a0 con 0x5571ff878620 2024-05-08T18:31:21.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.373+0000 7f331d718640 1 -- 172.21.15.87:0/188733906 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f331800a4a0 con 0x5571ff878620 2024-05-08T18:31:21.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.373+0000 7f331f41f800 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5571ff978b20 0x5571ff97af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.373+0000 7f331f41f800 1 -- 172.21.15.87:0/188733906 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff97b450 con 0x5571ff978b20 2024-05-08T18:31:21.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.373+0000 7f331cf17640 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5571ff978b20 0x5571ff97af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.373+0000 7f331cf17640 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5571ff978b20 0x5571ff97af10 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.374+0000 7f331cf17640 1 -- 172.21.15.87:0/188733906 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3310075030 con 0x5571ff978b20 2024-05-08T18:31:21.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.374+0000 7f331f41f800 1 Processor -- start 2024-05-08T18:31:21.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.374+0000 7f331f41f800 1 -- start start 2024-05-08T18:31:21.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.374+0000 7f331f41f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff989720 0x5571ff989b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.374+0000 7f331f41f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5571ff766fc0 con 0x5571ff989720 2024-05-08T18:31:21.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.374+0000 7f331d718640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff989720 0x5571ff989b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.374+0000 7f331d718640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff989720 0x5571ff989b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34118/0 (socket says 172.21.15.87:34118) 2024-05-08T18:31:21.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.374+0000 7f331d718640 1 -- 172.21.15.87:0/2735427319 learned_addr learned my addr 172.21.15.87:0/2735427319 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.374+0000 7f331d718640 1 -- 172.21.15.87:0/2735427319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ff98a080 con 0x5571ff989720 2024-05-08T18:31:21.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.375+0000 7f331d718640 1 --2- 172.21.15.87:0/2735427319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff989720 0x5571ff989b40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x5571ff96f5b0 tx=0x7f33180178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.375+0000 7f32027fc640 1 -- 172.21.15.87:0/2735427319 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3318013440 con 0x5571ff989720 2024-05-08T18:31:21.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.375+0000 7f32027fc640 1 -- 172.21.15.87:0/2735427319 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33180135e0 con 0x5571ff989720 2024-05-08T18:31:21.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.375+0000 7f32027fc640 1 -- 172.21.15.87:0/2735427319 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33180138c0 con 0x5571ff989720 2024-05-08T18:31:21.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.375+0000 7f331f41f800 1 -- 172.21.15.87:0/2735427319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571ff98aaf0 con 0x5571ff989720 2024-05-08T18:31:21.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.375+0000 7f331f41f800 1 -- 172.21.15.87:0/2735427319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571ff98aff0 con 0x5571ff989720 2024-05-08T18:31:21.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.376+0000 7f32027fc640 1 -- 172.21.15.87:0/2735427319 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3318011040 con 0x5571ff989720 2024-05-08T18:31:21.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.376+0000 7f32027fc640 1 --2- 172.21.15.87:0/2735427319 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31f403bba0 0x7f31f403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.376+0000 7f32027fc640 1 -- 172.21.15.87:0/2735427319 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f331801d070 con 0x5571ff989720 2024-05-08T18:31:21.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.376+0000 7f331cf17640 1 --2- 172.21.15.87:0/2735427319 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31f403bba0 0x7f31f403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.376+0000 7f331f41f800 1 Processor -- start 2024-05-08T18:31:21.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.376+0000 7f331cf17640 1 --2- 172.21.15.87:0/2735427319 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31f403bba0 0x7f31f403e060 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f331005b730 tx=0x7f3310053f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.376+0000 7f331f41f800 1 -- start start 2024-05-08T18:31:21.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.376+0000 7f331f41f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875310 0x5571ff875730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.376+0000 7f331f41f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5571ff966f90 con 0x5571ff875310 2024-05-08T18:31:21.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.377+0000 7f331d718640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875310 0x5571ff875730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.377+0000 7f331d718640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875310 0x5571ff875730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34124/0 (socket says 172.21.15.87:34124) 2024-05-08T18:31:21.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.377+0000 7f331d718640 1 -- 172.21.15.87:0/3059849989 learned_addr learned my addr 172.21.15.87:0/3059849989 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.377+0000 7f331d718640 1 -- 172.21.15.87:0/3059849989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ff873b70 con 0x5571ff875310 2024-05-08T18:31:21.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.377+0000 7f331d718640 1 --2- 172.21.15.87:0/3059849989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875310 0x5571ff875730 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f33180103f0 tx=0x7f3318001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22505445068052a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.377+0000 7f31f3fff640 1 -- 172.21.15.87:0/3059849989 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f331802ad80 con 0x5571ff875310 2024-05-08T18:31:21.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.377+0000 7f31f3fff640 1 -- 172.21.15.87:0/3059849989 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33180540d0 con 0x5571ff875310 2024-05-08T18:31:21.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.377+0000 7f31f3fff640 1 -- 172.21.15.87:0/3059849989 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33180014f0 con 0x5571ff875310 2024-05-08T18:31:21.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.378+0000 7f331f41f800 1 -- 172.21.15.87:0/3059849989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875310 msgr2=0x5571ff875730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.378+0000 7f331f41f800 1 --2- 172.21.15.87:0/3059849989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875310 0x5571ff875730 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f33180103f0 tx=0x7f3318001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:21.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.378+0000 7f331f41f800 1 -- 172.21.15.87:0/3059849989 shutdown_connections 2024-05-08T18:31:21.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.378+0000 7f331f41f800 1 --2- 172.21.15.87:0/3059849989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875310 0x5571ff875730 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.378+0000 7f331f41f800 1 -- 172.21.15.87:0/3059849989 >> 172.21.15.87:0/3059849989 conn(0x5571ff992cc0 msgr2=0x5571ff990d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.378+0000 7f331f41f800 1 -- 172.21.15.87:0/3059849989 shutdown_connections 2024-05-08T18:31:21.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.378+0000 7f331f41f800 1 -- 172.21.15.87:0/3059849989 wait complete. 2024-05-08T18:31:21.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.378+0000 7f331f41f800 1 Processor -- start 2024-05-08T18:31:21.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.378+0000 7f331f41f800 1 -- start start 2024-05-08T18:31:21.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.378+0000 7f331f41f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875310 0x5571ff9a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.378+0000 7f331f41f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5571ff874010 con 0x5571ff875310 2024-05-08T18:31:21.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.378+0000 7f331d718640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875310 0x5571ff9a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.378+0000 7f331d718640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875310 0x5571ff9a0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34138/0 (socket says 172.21.15.87:34138) 2024-05-08T18:31:21.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.378+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 learned_addr learned my addr 172.21.15.87:0/3210821627 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.378+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ff9a0790 con 0x5571ff875310 2024-05-08T18:31:21.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.379+0000 7f331d718640 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875310 0x5571ff9a0250 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f331804d010 tx=0x7f3318052890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.379+0000 7f31f27fc640 1 -- 172.21.15.87:0/3210821627 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3318030020 con 0x5571ff875310 2024-05-08T18:31:21.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.379+0000 7f31f27fc640 1 -- 172.21.15.87:0/3210821627 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3318051310 con 0x5571ff875310 2024-05-08T18:31:21.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.379+0000 7f31f27fc640 1 -- 172.21.15.87:0/3210821627 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3318013a60 con 0x5571ff875310 2024-05-08T18:31:21.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.379+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571ff9a0a20 con 0x5571ff875310 2024-05-08T18:31:21.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.379+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571ff9a36d0 con 0x5571ff875310 2024-05-08T18:31:21.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.379+0000 7f31f27fc640 1 -- 172.21.15.87:0/3210821627 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3318033020 con 0x5571ff875310 2024-05-08T18:31:21.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.380+0000 7f31f27fc640 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31e803bba0 0x7f31e803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.380+0000 7f31f27fc640 1 -- 172.21.15.87:0/3210821627 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f331800e040 con 0x5571ff875310 2024-05-08T18:31:21.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.380+0000 7f331cf17640 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31e803bba0 0x7f31e803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.380+0000 7f331cf17640 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31e803bba0 0x7f31e803e060 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3310044810 tx=0x7f3310087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.380+0000 7f331f41f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.380+0000 7f331f41f800 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5571ff9abe70 0x5571ff9ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.380+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9aea80 con 0x5571ff9abe70 2024-05-08T18:31:21.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.381+0000 7f3317fff640 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5571ff9abe70 0x5571ff9ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.381+0000 7f3317fff640 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5571ff9abe70 0x5571ff9ae330 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.381+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3308009050 con 0x5571ff9abe70 2024-05-08T18:31:21.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.381+0000 7f331f41f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.381+0000 7f331f41f800 20 realm 2024-05-08T18:31:21.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.381+0000 7f331f41f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.381+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9ab2c0 con 0x5571ff9abe70 2024-05-08T18:31:21.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.381+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3308009050 con 0x5571ff9abe70 2024-05-08T18:31:21.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.381+0000 7f331f41f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.381+0000 7f331f41f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:21.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.381+0000 7f331f41f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.381+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9af570 con 0x5571ff9abe70 2024-05-08T18:31:21.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.381+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3308009050 con 0x5571ff9abe70 2024-05-08T18:31:21.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.381+0000 7f331f41f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.381+0000 7f331f41f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.381+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9afe40 con 0x5571ff9abe70 2024-05-08T18:31:21.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.382+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3308009050 con 0x5571ff9abe70 2024-05-08T18:31:21.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.382+0000 7f331f41f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:21.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.382+0000 7f331f41f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.382+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b01e0 con 0x5571ff9abe70 2024-05-08T18:31:21.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.382+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3308009050 con 0x5571ff9abe70 2024-05-08T18:31:21.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.382+0000 7f331f41f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:21.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.382+0000 7f331f41f800 20 searching for the correct realm 2024-05-08T18:31:21.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.382+0000 7f331f41f800 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5571ff9b20c0 0x5571ff9b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.382+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x5571ff9b20c0 2024-05-08T18:31:21.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.382+0000 7f331d718640 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5571ff9b20c0 0x5571ff9b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.382+0000 7f331d718640 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5571ff9b20c0 0x5571ff9b44d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.383+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3318029070 con 0x5571ff9b20c0 2024-05-08T18:31:21.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.383+0000 7f331d718640 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f3318035020 0x7f331802b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.383+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x7f3318035020 2024-05-08T18:31:21.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.383+0000 7f331cf17640 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f3318035020 0x7f331802b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.383+0000 7f331cf17640 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f3318035020 0x7f331802b3e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.383+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310075030 con 0x7f3318035020 2024-05-08T18:31:21.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.383+0000 7f331cf17640 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f33100a2040 0x7f331008b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.383+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x7f33100a2040 2024-05-08T18:31:21.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.384+0000 7f3317fff640 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f33100a2040 0x7f331008b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.384+0000 7f3317fff640 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f33100a2040 0x7f331008b530 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.384+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3308009050 con 0x7f33100a2040 2024-05-08T18:31:21.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.384+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x5571ff9abe70 2024-05-08T18:31:21.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.384+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3308009050 con 0x5571ff9abe70 2024-05-08T18:31:21.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.384+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x5571ff9abe70 2024-05-08T18:31:21.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.385+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.385+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x7f33100a2040 2024-05-08T18:31:21.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.385+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.385+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x7f33100a2040 2024-05-08T18:31:21.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.385+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.385+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x7f3318035020 2024-05-08T18:31:21.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.385+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310075030 con 0x7f3318035020 2024-05-08T18:31:21.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.385+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x5571ff9b20c0 2024-05-08T18:31:21.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.386+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3318029070 con 0x5571ff9b20c0 2024-05-08T18:31:21.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.386+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x5571ff9abe70 2024-05-08T18:31:21.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.386+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.386+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x7f33100a2040 2024-05-08T18:31:21.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.386+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.386+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x5571ff9abe70 2024-05-08T18:31:21.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.386+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.386+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x7f3318035020 2024-05-08T18:31:21.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.387+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3310075030 con 0x7f3318035020 2024-05-08T18:31:21.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.387+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x5571ff9b20c0 2024-05-08T18:31:21.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.387+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3318029070 con 0x5571ff9b20c0 2024-05-08T18:31:21.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.387+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x5571ff9b20c0 2024-05-08T18:31:21.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.387+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3318029070 con 0x5571ff9b20c0 2024-05-08T18:31:21.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.387+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x7f33100a2040 2024-05-08T18:31:21.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.387+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.387+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x5571ff9b20c0 2024-05-08T18:31:21.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.388+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3318029070 con 0x5571ff9b20c0 2024-05-08T18:31:21.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.388+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x5571ff9b20c0 2024-05-08T18:31:21.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.388+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3318029070 con 0x5571ff9b20c0 2024-05-08T18:31:21.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.388+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x5571ff9abe70 2024-05-08T18:31:21.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.388+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.388+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x5571ff9abe70 2024-05-08T18:31:21.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.388+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.388+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x7f33100a2040 2024-05-08T18:31:21.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.388+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.389+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x5571ff9b20c0 2024-05-08T18:31:21.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.389+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3318029070 con 0x5571ff9b20c0 2024-05-08T18:31:21.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.389+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x7f3318035020 2024-05-08T18:31:21.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.389+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310075030 con 0x7f3318035020 2024-05-08T18:31:21.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.389+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x5571ff9abe70 2024-05-08T18:31:21.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.389+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.389+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x7f33100a2040 2024-05-08T18:31:21.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.390+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.390+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x5571ff9b20c0 2024-05-08T18:31:21.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.390+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3318029070 con 0x5571ff9b20c0 2024-05-08T18:31:21.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.390+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x7f33100a2040 2024-05-08T18:31:21.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.390+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.390+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x7f3318035020 2024-05-08T18:31:21.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.390+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310075030 con 0x7f3318035020 2024-05-08T18:31:21.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.390+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x5571ff9b20c0 2024-05-08T18:31:21.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.391+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3318029070 con 0x5571ff9b20c0 2024-05-08T18:31:21.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.391+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x7f33100a2040 2024-05-08T18:31:21.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.391+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.391+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x5571ff9abe70 2024-05-08T18:31:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.391+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.391+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b4ba0 con 0x7f3318035020 2024-05-08T18:31:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.392+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310075030 con 0x7f3318035020 2024-05-08T18:31:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.392+0000 7f331f41f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.392+0000 7f331f41f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.392+0000 7f331f41f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.392+0000 7f331f41f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.392+0000 7f331f41f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.392+0000 7f331f41f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.392+0000 7f331f41f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.392+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b0b30 con 0x5571ff9abe70 2024-05-08T18:31:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.392+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.392+0000 7f331f41f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.392+0000 7f331f41f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.392+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b13d0 con 0x5571ff9abe70 2024-05-08T18:31:21.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.392+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.392+0000 7f331f41f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:21.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.392+0000 7f331f41f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.392+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b5020 con 0x7f33100a2040 2024-05-08T18:31:21.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331f41f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:21.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331f41f800 20 zone default found 2024-05-08T18:31:21.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331f41f800 4 Realm: () 2024-05-08T18:31:21.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331f41f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:21.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331f41f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:21.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331f41f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:21.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331f41f800 20 zonegroup default 2024-05-08T18:31:21.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331f41f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b54d0 con 0x7f33100a2040 2024-05-08T18:31:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331f41f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331f41f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b6eb0 con 0x5571ff9b20c0 2024-05-08T18:31:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3318029070 con 0x5571ff9b20c0 2024-05-08T18:31:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331f41f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331f41f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b7340 con 0x5571ff9b20c0 2024-05-08T18:31:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3318029070 con 0x5571ff9b20c0 2024-05-08T18:31:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.393+0000 7f331f41f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.394+0000 7f331f41f800 20 started sync module instance, tier type = 2024-05-08T18:31:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.394+0000 7f331f41f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.394+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b6340 con 0x7f3318035020 2024-05-08T18:31:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.394+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310075030 con 0x7f3318035020 2024-05-08T18:31:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.394+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93948108039984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b7c50 con 0x7f3318035020 2024-05-08T18:31:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.395+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b84a0 con 0x5571ff9abe70 2024-05-08T18:31:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.395+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.395+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93948108046320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b8a00 con 0x5571ff9abe70 2024-05-08T18:31:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.396+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b9520 con 0x5571ff9b20c0 2024-05-08T18:31:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.396+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93948108039984] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310075030 con 0x7f3318035020 2024-05-08T18:31:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.396+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3318029070 con 0x5571ff9b20c0 2024-05-08T18:31:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.397+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93948108050416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b9910 con 0x5571ff9b20c0 2024-05-08T18:31:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.397+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9ba360 con 0x7f3318035020 2024-05-08T18:31:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.397+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93948108046320] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.397+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93948108050416] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3318029070 con 0x5571ff9b20c0 2024-05-08T18:31:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.398+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310075030 con 0x7f3318035020 2024-05-08T18:31:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.398+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93948108044192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b8450 con 0x7f3318035020 2024-05-08T18:31:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.398+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9bad70 con 0x5571ff9abe70 2024-05-08T18:31:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.399+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93948108044192] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310075030 con 0x7f3318035020 2024-05-08T18:31:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.399+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.399+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93948108056768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9bb190 con 0x5571ff9abe70 2024-05-08T18:31:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.399+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9bba40 con 0x7f33100a2040 2024-05-08T18:31:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.400+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.400+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93948108059024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9bb5b0 con 0x7f33100a2040 2024-05-08T18:31:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.400+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9bc9f0 con 0x7f33100a2040 2024-05-08T18:31:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.400+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93948108056768] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.401+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93948108059024] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.401+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.401+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93948108057824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9bc9f0 con 0x7f33100a2040 2024-05-08T18:31:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.401+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9bbed0 con 0x7f33100a2040 2024-05-08T18:31:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.402+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93948108057824] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.402+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.402+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93948108063952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9bd080 con 0x7f33100a2040 2024-05-08T18:31:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.402+0000 7f331f41f800 20 add_watcher() i=0 2024-05-08T18:31:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.402+0000 7f331f41f800 20 add_watcher() i=1 2024-05-08T18:31:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.402+0000 7f331f41f800 20 add_watcher() i=2 2024-05-08T18:31:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.402+0000 7f331f41f800 20 add_watcher() i=3 2024-05-08T18:31:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.402+0000 7f331f41f800 20 add_watcher() i=4 2024-05-08T18:31:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.402+0000 7f331f41f800 20 add_watcher() i=5 2024-05-08T18:31:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.402+0000 7f331f41f800 20 add_watcher() i=6 2024-05-08T18:31:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.403+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93948108063952] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.403+0000 7f331f41f800 20 add_watcher() i=7 2024-05-08T18:31:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.403+0000 7f331f41f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.403+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9c0210 con 0x5571ff9abe70 2024-05-08T18:31:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.403+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.403+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93948108078016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9bcfd0 con 0x5571ff9abe70 2024-05-08T18:31:21.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.404+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93948108078016] v27'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.404+0000 7f31d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:21.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.404+0000 7f331f41f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:21.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.404+0000 7f331f41f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:21.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.404+0000 7f331f41f800 5 note: GC not initialized 2024-05-08T18:31:21.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.405+0000 7f31d1fe3640 20 reqs_thread_entry: start 2024-05-08T18:31:21.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.405+0000 7f331f41f800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:21.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.405+0000 7f331f41f800 20 Filter name: none 2024-05-08T18:31:21.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.405+0000 7f31437fe640 20 reqs_thread_entry: start 2024-05-08T18:31:21.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.405+0000 7f331f41f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:31:21.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.405+0000 7f331f41f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.405+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9f3840 con 0x7f33100a2040 2024-05-08T18:31:21.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.405+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:31:21.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T18:31:21.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:31:21.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:21.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:31:21.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9f57c0 con 0x7f3318035020 2024-05-08T18:31:21.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3310075030 con 0x7f3318035020 2024-05-08T18:31:21.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:21.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:31:21.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:21.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 : miss 2024-05-08T18:31:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9f75a0 con 0x5571ff9b20c0 2024-05-08T18:31:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f3318029070 con 0x5571ff9b20c0 2024-05-08T18:31:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x17 2024-05-08T18:31:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 2024-05-08T18:31:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-05-08T18:31:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.406+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9fb860 con 0x7f3318035020 2024-05-08T18:31:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.407+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(65 foo.buckets [call] v27'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3310075030 con 0x7f3318035020 2024-05-08T18:31:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.407+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ffa01780 con 0x5571ff9b20c0 2024-05-08T18:31:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.408+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(66 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v27'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f3318029070 con 0x5571ff9b20c0 2024-05-08T18:31:21.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.408+0000 7f331f41f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x17 2024-05-08T18:31:21.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.408+0000 7f331f41f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:21.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.408+0000 7f331f41f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:21.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.408+0000 7f331f41f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1, ofs0, ns] 2024-05-08T18:31:21.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.408+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93948108305680 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9fbc90 con 0x7f3318035020 2024-05-08T18:31:21.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.409+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== watch-notify(notify (1) cookie 93948108039984 notify 115964117011 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f3310091040 con 0x7f3318035020 2024-05-08T18:31:21.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.409+0000 7f31f3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117011 cookie 93948108039984 notifier 4494 bl.length()=752 2024-05-08T18:31:21.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.409+0000 7f31f3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x17 2024-05-08T18:31:21.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.409+0000 7f31f3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:21.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.409+0000 7f31f3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:21.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.409+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(67 notify.0 [notify cookie 93948108305680 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3310075030 con 0x7f3318035020 2024-05-08T18:31:21.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.409+0000 7f31f3fff640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f31e0003ea0 con 0x7f3318035020 2024-05-08T18:31:21.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.409+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310075030 con 0x7f3318035020 2024-05-08T18:31:21.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.409+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== watch-notify(notify_complete (2) cookie 93948108305680 notify 115964117011 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5571ff971630 con 0x7f3318035020 2024-05-08T18:31:21.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.409+0000 7f331f41f800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): orig_sources= new_sources= 2024-05-08T18:31:21.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.409+0000 7f331f41f800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): potential sources added=[] removed=[] 2024-05-08T18:31:21.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.409+0000 7f331f41f800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): orig_dests= new_dests= 2024-05-08T18:31:21.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.409+0000 7f331f41f800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): potential dests added=[] removed=[] 2024-05-08T18:31:21.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.409+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9fff80 con 0x7f33100a2040 2024-05-08T18:31:21.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.411+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(69 fud.buckets [call] v27'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.411+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ffa00f90 con 0x7f3318035020 2024-05-08T18:31:21.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.412+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v27'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f3310075030 con 0x7f3318035020 2024-05-08T18:31:21.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.412+0000 7f331f41f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:31:21.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.412+0000 7f331f41f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:21.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.412+0000 7f331f41f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:31:21.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.412+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93948108305680 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571ffa00430 con 0x7f33100a2040 2024-05-08T18:31:21.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.412+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== watch-notify(notify (1) cookie 93948108057824 notify 115964116995 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f330802e740 con 0x7f33100a2040 2024-05-08T18:31:21.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.412+0000 7f31f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 93948108057824 notifier 4494 bl.length()=314 2024-05-08T18:31:21.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.412+0000 7f31f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:31:21.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.412+0000 7f31f37fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:21.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.412+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(71 notify.6 [notify cookie 93948108305680 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.412+0000 7f31f37fe640 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f3150003400 con 0x7f33100a2040 2024-05-08T18:31:21.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.412+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.412+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== watch-notify(notify_complete (2) cookie 93948108305680 notify 115964116995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f330802ea00 con 0x7f33100a2040 2024-05-08T18:31:21.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.413+0000 7f31d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:21.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.413+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93948108078016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9f82c0 con 0x5571ff9abe70 2024-05-08T18:31:21.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.414+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 93948108078016] v27'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.414+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93948108039984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9bfbc0 con 0x7f3318035020 2024-05-08T18:31:21.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.415+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 93948108039984] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310075030 con 0x7f3318035020 2024-05-08T18:31:21.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.415+0000 7f331f41f800 20 remove_watcher() i=0 2024-05-08T18:31:21.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.415+0000 7f331f41f800 2 removed watcher, disabling cache 2024-05-08T18:31:21.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.415+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93948108046320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b6730 con 0x5571ff9abe70 2024-05-08T18:31:21.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.416+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 93948108046320] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.416+0000 7f331f41f800 20 remove_watcher() i=1 2024-05-08T18:31:21.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.416+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93948108050416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b6730 con 0x5571ff9b20c0 2024-05-08T18:31:21.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.417+0000 7f331d718640 1 -- 172.21.15.87:0/3210821627 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 93948108050416] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3318029070 con 0x5571ff9b20c0 2024-05-08T18:31:21.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.417+0000 7f331f41f800 20 remove_watcher() i=2 2024-05-08T18:31:21.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.417+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93948108044192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b6730 con 0x7f3318035020 2024-05-08T18:31:21.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.418+0000 7f331cf17640 1 -- 172.21.15.87:0/3210821627 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 93948108044192] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310075030 con 0x7f3318035020 2024-05-08T18:31:21.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.418+0000 7f331f41f800 20 remove_watcher() i=3 2024-05-08T18:31:21.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.418+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93948108056768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b77a0 con 0x5571ff9abe70 2024-05-08T18:31:21.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.419+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 93948108056768] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330802a040 con 0x5571ff9abe70 2024-05-08T18:31:21.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.419+0000 7f331f41f800 20 remove_watcher() i=4 2024-05-08T18:31:21.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.419+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93948108059024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b6730 con 0x7f33100a2040 2024-05-08T18:31:21.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.420+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 93948108059024] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.420+0000 7f331f41f800 20 remove_watcher() i=5 2024-05-08T18:31:21.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.420+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93948108057824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9ba8c0 con 0x7f33100a2040 2024-05-08T18:31:21.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.421+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 93948108057824] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.421+0000 7f331f41f800 20 remove_watcher() i=6 2024-05-08T18:31:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.421+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93948108063952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571ff9b6730 con 0x7f33100a2040 2024-05-08T18:31:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 93948108063952] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330802a040 con 0x7f33100a2040 2024-05-08T18:31:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 20 remove_watcher() i=7 2024-05-08T18:31:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f33100a2040 msgr2=0x7f331008b530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f33100a2040 0x7f331008b530 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5571ff9abe70 msgr2=0x5571ff9ae330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5571ff9abe70 0x5571ff9ae330 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f3318035020 msgr2=0x7f331802b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f3318035020 0x7f331802b3e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5571ff9b20c0 msgr2=0x5571ff9b44d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5571ff9b20c0 0x5571ff9b44d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31e803bba0 msgr2=0x7f31e803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31e803bba0 0x7f31e803e060 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3310044810 tx=0x7f3310087000 comp rx=0 tx=0).stop 2024-05-08T18:31:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875310 msgr2=0x5571ff9a0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f3317fff640 1 -- 172.21.15.87:0/3210821627 reap_dead start 2024-05-08T18:31:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875310 0x5571ff9a0250 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f331804d010 tx=0x7f3318052890 comp rx=0 tx=0).stop 2024-05-08T18:31:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 shutdown_connections 2024-05-08T18:31:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 1 --2- 172.21.15.87:0/3210821627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875310 0x5571ff9a0250 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 >> 172.21.15.87:0/3210821627 conn(0x5571ff992cc0 msgr2=0x5571ff990370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 shutdown_connections 2024-05-08T18:31:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.422+0000 7f331f41f800 1 -- 172.21.15.87:0/3210821627 wait complete. 2024-05-08T18:31:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 -- 172.21.15.87:0/2735427319 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31f403bba0 msgr2=0x7f31f403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 --2- 172.21.15.87:0/2735427319 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31f403bba0 0x7f31f403e060 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f331005b730 tx=0x7f3310053f50 comp rx=0 tx=0).stop 2024-05-08T18:31:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 -- 172.21.15.87:0/2735427319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff989720 msgr2=0x5571ff989b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 --2- 172.21.15.87:0/2735427319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff989720 0x5571ff989b40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x5571ff96f5b0 tx=0x7f33180178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 -- 172.21.15.87:0/2735427319 shutdown_connections 2024-05-08T18:31:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 --2- 172.21.15.87:0/2735427319 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f31f403bba0 0x7f31f403e060 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 --2- 172.21.15.87:0/2735427319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff989720 0x5571ff989b40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 -- 172.21.15.87:0/2735427319 >> 172.21.15.87:0/2735427319 conn(0x5571ff97d7c0 msgr2=0x5571ff97dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 -- 172.21.15.87:0/2735427319 shutdown_connections 2024-05-08T18:31:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 -- 172.21.15.87:0/2735427319 wait complete. 2024-05-08T18:31:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 -- 172.21.15.87:0/188733906 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5571ff978b20 msgr2=0x5571ff97af10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5571ff978b20 0x5571ff97af10 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 -- 172.21.15.87:0/188733906 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5571ff878620 msgr2=0x5571ff9753f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5571ff878620 0x5571ff9753f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 -- 172.21.15.87:0/188733906 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f320403bba0 msgr2=0x7f320403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f320403bba0 0x7f320403e060 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3308000f60 tx=0x7f33080012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 -- 172.21.15.87:0/188733906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 msgr2=0x5571ff96e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 0x5571ff96e1b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f331000a470 tx=0x7f3310003020 comp rx=0 tx=0).stop 2024-05-08T18:31:21.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 -- 172.21.15.87:0/188733906 shutdown_connections 2024-05-08T18:31:21.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5571ff878620 0x5571ff9753f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5571ff978b20 0x5571ff97af10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f320403bba0 0x7f320403e060 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 --2- 172.21.15.87:0/188733906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571ff875cf0 0x5571ff96e1b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 -- 172.21.15.87:0/188733906 >> 172.21.15.87:0/188733906 conn(0x5571ff86f740 msgr2=0x5571ff960820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 -- 172.21.15.87:0/188733906 shutdown_connections 2024-05-08T18:31:21.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.423+0000 7f331f41f800 1 -- 172.21.15.87:0/188733906 wait complete. 2024-05-08T18:31:21.436 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-08T18:31:21.436 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-08T18:31:21.436 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-08T18:31:21.480 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:21.480 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:21.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.483+0000 7fd1f6230800 1 Processor -- start 2024-05-08T18:31:21.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.483+0000 7fd1f6230800 1 -- start start 2024-05-08T18:31:21.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.483+0000 7fd1f6230800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d586440140 0x55d586440560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.483+0000 7fd1f6230800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d586440be0 con 0x55d5864413a0 2024-05-08T18:31:21.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.483+0000 7fd1f6230800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55d5862e1e20 con 0x55d586440140 2024-05-08T18:31:21.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.483+0000 7fd1f1527640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d586440140 0x55d586440560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.483+0000 7fd1e8d26640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55d5864413a0 0x55d586441820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42138/0 (socket says 172.21.15.87:42138) 2024-05-08T18:31:21.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.483+0000 7fd1e8d26640 1 -- 172.21.15.87:0/3750201232 learned_addr learned my addr 172.21.15.87:0/3750201232 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:21.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.483+0000 7fd1f1527640 1 -- 172.21.15.87:0/3750201232 >> v1:172.21.15.53:6789/0 conn(0x55d5864413a0 legacy=0x55d586441820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.483+0000 7fd1f1527640 1 -- 172.21.15.87:0/3750201232 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d586441f60 con 0x55d586440140 2024-05-08T18:31:21.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.485+0000 7fd1f1527640 1 --2- 172.21.15.87:0/3750201232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586440140 0x55d586440560 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400a470 tx=0x7fd1e401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4663b5f8def21221 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.485+0000 7fd1f0d26640 1 -- 172.21.15.87:0/3750201232 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1e4057070 con 0x55d586440140 2024-05-08T18:31:21.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.485+0000 7fd1f0d26640 1 -- 172.21.15.87:0/3750201232 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1e404adc0 con 0x55d586440140 2024-05-08T18:31:21.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.485+0000 7fd1f0d26640 1 -- 172.21.15.87:0/3750201232 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1e4052590 con 0x55d586440140 2024-05-08T18:31:21.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.486+0000 7fd1f6230800 1 -- 172.21.15.87:0/3750201232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586440140 msgr2=0x55d586440560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.486+0000 7fd1f6230800 1 --2- 172.21.15.87:0/3750201232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586440140 0x55d586440560 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400a470 tx=0x7fd1e401ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:21.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.486+0000 7fd1f6230800 1 -- 172.21.15.87:0/3750201232 shutdown_connections 2024-05-08T18:31:21.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.486+0000 7fd1f6230800 1 --2- 172.21.15.87:0/3750201232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586440140 0x55d586440560 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.486+0000 7fd1f6230800 1 -- 172.21.15.87:0/3750201232 >> 172.21.15.87:0/3750201232 conn(0x55d58643b720 msgr2=0x55d58643db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.486+0000 7fd1f6230800 1 -- 172.21.15.87:0/3750201232 shutdown_connections 2024-05-08T18:31:21.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.486+0000 7fd1f6230800 1 -- 172.21.15.87:0/3750201232 wait complete. 2024-05-08T18:31:21.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.499+0000 7fd1f6230800 1 Processor -- start 2024-05-08T18:31:21.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.500+0000 7fd1f6230800 1 -- start start 2024-05-08T18:31:21.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.500+0000 7fd1f6230800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586440140 0x55d5863b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.500+0000 7fd1f6230800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d58638c5b0 con 0x55d586440140 2024-05-08T18:31:21.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.500+0000 7fd1f1527640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586440140 0x55d5863b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.500+0000 7fd1f1527640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586440140 0x55d5863b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34152/0 (socket says 172.21.15.87:34152) 2024-05-08T18:31:21.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.500+0000 7fd1f1527640 1 -- 172.21.15.87:0/4106704487 learned_addr learned my addr 172.21.15.87:0/4106704487 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.500+0000 7fd1f1527640 1 -- 172.21.15.87:0/4106704487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5865332a0 con 0x55d586440140 2024-05-08T18:31:21.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.500+0000 7fd1f1527640 1 --2- 172.21.15.87:0/4106704487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586440140 0x55d5863b42c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4055040 tx=0x7fd1e404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2026117e45f52cb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.501+0000 7fd0df606640 1 -- 172.21.15.87:0/4106704487 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1e4057040 con 0x55d586440140 2024-05-08T18:31:21.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.501+0000 7fd0df606640 1 -- 172.21.15.87:0/4106704487 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1e4063070 con 0x55d586440140 2024-05-08T18:31:21.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.501+0000 7fd0df606640 1 -- 172.21.15.87:0/4106704487 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1e405d790 con 0x55d586440140 2024-05-08T18:31:21.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.501+0000 7fd1f6230800 1 -- 172.21.15.87:0/4106704487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586440140 msgr2=0x55d5863b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.501+0000 7fd1f6230800 1 --2- 172.21.15.87:0/4106704487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586440140 0x55d5863b42c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4055040 tx=0x7fd1e404c000 comp rx=0 tx=0).stop 2024-05-08T18:31:21.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.501+0000 7fd1f6230800 1 -- 172.21.15.87:0/4106704487 shutdown_connections 2024-05-08T18:31:21.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.501+0000 7fd1f6230800 1 --2- 172.21.15.87:0/4106704487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586440140 0x55d5863b42c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.501+0000 7fd1f6230800 1 -- 172.21.15.87:0/4106704487 >> 172.21.15.87:0/4106704487 conn(0x55d58643b720 msgr2=0x55d58652cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.501+0000 7fd1f6230800 1 -- 172.21.15.87:0/4106704487 shutdown_connections 2024-05-08T18:31:21.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.501+0000 7fd1f6230800 1 -- 172.21.15.87:0/4106704487 wait complete. 2024-05-08T18:31:21.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.502+0000 7fd1f6230800 1 Processor -- start 2024-05-08T18:31:21.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.502+0000 7fd1f6230800 1 -- start start 2024-05-08T18:31:21.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.502+0000 7fd1f6230800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5864413a0 0x55d58653c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.502+0000 7fd1f6230800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d586449870 con 0x55d5864413a0 2024-05-08T18:31:21.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.502+0000 7fd1f1527640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5864413a0 0x55d58653c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.502+0000 7fd1f1527640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5864413a0 0x55d58653c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34168/0 (socket says 172.21.15.87:34168) 2024-05-08T18:31:21.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.502+0000 7fd1f1527640 1 -- 172.21.15.87:0/3849595682 learned_addr learned my addr 172.21.15.87:0/3849595682 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.502+0000 7fd1f1527640 1 -- 172.21.15.87:0/3849595682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d58653cb40 con 0x55d5864413a0 2024-05-08T18:31:21.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.503+0000 7fd1f1527640 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5864413a0 0x55d58653c600 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400a470 tx=0x7fd1e4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.503+0000 7fd0dde03640 1 -- 172.21.15.87:0/3849595682 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1e4057050 con 0x55d5864413a0 2024-05-08T18:31:21.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.503+0000 7fd0dde03640 1 -- 172.21.15.87:0/3849595682 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1e405dc40 con 0x55d5864413a0 2024-05-08T18:31:21.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.503+0000 7fd1f6230800 1 -- 172.21.15.87:0/3849595682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d58653cdd0 con 0x55d5864413a0 2024-05-08T18:31:21.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.503+0000 7fd0dde03640 1 -- 172.21.15.87:0/3849595682 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1e4052440 con 0x55d5864413a0 2024-05-08T18:31:21.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.503+0000 7fd1f6230800 1 -- 172.21.15.87:0/3849595682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d58653fa80 con 0x55d5864413a0 2024-05-08T18:31:21.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.503+0000 7fd0dde03640 1 -- 172.21.15.87:0/3849595682 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd1e40525e0 con 0x55d5864413a0 2024-05-08T18:31:21.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.504+0000 7fd0dde03640 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd0d803bb50 0x7fd0d803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.504+0000 7fd0dde03640 1 -- 172.21.15.87:0/3849595682 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd1e4093ef0 con 0x55d5864413a0 2024-05-08T18:31:21.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.504+0000 7fd1e8d26640 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd0d803bb50 0x7fd0d803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.504+0000 7fd1f6230800 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d586541830 0x55d586543c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.504+0000 7fd1f6230800 1 -- 172.21.15.87:0/3849595682 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d586544160 con 0x55d586541830 2024-05-08T18:31:21.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.504+0000 7fd1f1d28640 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d586541830 0x55d586543c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.504+0000 7fd1e8d26640 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd0d803bb50 0x7fd0d803e010 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc001d90 tx=0x7fd1dc0012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.504+0000 7fd1f1d28640 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d586541830 0x55d586543c20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.505+0000 7fd1f1d28640 1 -- 172.21.15.87:0/3849595682 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1ec00a4a0 con 0x55d586541830 2024-05-08T18:31:21.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.505+0000 7fd1f6230800 1 -- 172.21.15.87:0/3849595682 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d586540e10 con 0x55d586541830 2024-05-08T18:31:21.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.505+0000 7fd1f1d28640 1 -- 172.21.15.87:0/3849595682 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd1ec00a4a0 con 0x55d586541830 2024-05-08T18:31:21.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.505+0000 7fd1f6230800 1 -- 172.21.15.87:0/3849595682 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d586545f40 con 0x55d586541830 2024-05-08T18:31:21.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.505+0000 7fd1f1d28640 1 -- 172.21.15.87:0/3849595682 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd1ec00a4a0 con 0x55d586541830 2024-05-08T18:31:21.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.505+0000 7fd1f6230800 1 -- 172.21.15.87:0/3849595682 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d586545080 con 0x55d586541830 2024-05-08T18:31:21.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.505+0000 7fd1f1d28640 1 -- 172.21.15.87:0/3849595682 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd1ec00a4a0 con 0x55d586541830 2024-05-08T18:31:21.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.505+0000 7fd1f6230800 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d586545b50 0x55d586549390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.505+0000 7fd1f6230800 1 -- 172.21.15.87:0/3849595682 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d586549b20 con 0x55d586545b50 2024-05-08T18:31:21.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.506+0000 7fd1f1527640 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d586545b50 0x55d586549390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.506+0000 7fd1f1527640 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d586545b50 0x55d586549390 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.506+0000 7fd1f1527640 1 -- 172.21.15.87:0/3849595682 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd1e4078070 con 0x55d586545b50 2024-05-08T18:31:21.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.507+0000 7fd1f6230800 1 Processor -- start 2024-05-08T18:31:21.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.507+0000 7fd1f6230800 1 -- start start 2024-05-08T18:31:21.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.507+0000 7fd1f6230800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586557e70 0x55d586558290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.507+0000 7fd1f6230800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d586332fc0 con 0x55d586557e70 2024-05-08T18:31:21.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.507+0000 7fd1f1d28640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586557e70 0x55d586558290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.507+0000 7fd1f1d28640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586557e70 0x55d586558290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34172/0 (socket says 172.21.15.87:34172) 2024-05-08T18:31:21.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.507+0000 7fd1f1d28640 1 -- 172.21.15.87:0/658332875 learned_addr learned my addr 172.21.15.87:0/658332875 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.507+0000 7fd1f1d28640 1 -- 172.21.15.87:0/658332875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5865587d0 con 0x55d586557e70 2024-05-08T18:31:21.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.508+0000 7fd1f1d28640 1 --2- 172.21.15.87:0/658332875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586557e70 0x55d586558290 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x55d586544500 tx=0x7fd1ec0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.508+0000 7fd0d6ffd640 1 -- 172.21.15.87:0/658332875 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1ec013440 con 0x55d586557e70 2024-05-08T18:31:21.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.508+0000 7fd0d6ffd640 1 -- 172.21.15.87:0/658332875 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1ec0135e0 con 0x55d586557e70 2024-05-08T18:31:21.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.508+0000 7fd1f6230800 1 -- 172.21.15.87:0/658332875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d586559240 con 0x55d586557e70 2024-05-08T18:31:21.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.508+0000 7fd0d6ffd640 1 -- 172.21.15.87:0/658332875 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1ec0138c0 con 0x55d586557e70 2024-05-08T18:31:21.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.508+0000 7fd1f6230800 1 -- 172.21.15.87:0/658332875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d586559740 con 0x55d586557e70 2024-05-08T18:31:21.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.509+0000 7fd0d6ffd640 1 -- 172.21.15.87:0/658332875 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd1ec011040 con 0x55d586557e70 2024-05-08T18:31:21.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.509+0000 7fd0d6ffd640 1 --2- 172.21.15.87:0/658332875 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd0c803bb50 0x7fd0c803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.509+0000 7fd0d6ffd640 1 -- 172.21.15.87:0/658332875 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd1ec01d070 con 0x55d586557e70 2024-05-08T18:31:21.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.509+0000 7fd1f1527640 1 --2- 172.21.15.87:0/658332875 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd0c803bb50 0x7fd0c803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.509+0000 7fd1f6230800 1 Processor -- start 2024-05-08T18:31:21.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.509+0000 7fd1f1527640 1 --2- 172.21.15.87:0/658332875 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd0c803bb50 0x7fd0c803e010 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4079cd0 tx=0x7fd1e4052cf0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.509+0000 7fd1f6230800 1 -- start start 2024-05-08T18:31:21.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.509+0000 7fd1f6230800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586565170 0x55d586565590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.509+0000 7fd1f6230800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d586537970 con 0x55d586565170 2024-05-08T18:31:21.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.509+0000 7fd1f1d28640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586565170 0x55d586565590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.509+0000 7fd1f1d28640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586565170 0x55d586565590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34184/0 (socket says 172.21.15.87:34184) 2024-05-08T18:31:21.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.510+0000 7fd1f1d28640 1 -- 172.21.15.87:0/1748693781 learned_addr learned my addr 172.21.15.87:0/1748693781 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.510+0000 7fd1f1d28640 1 -- 172.21.15.87:0/1748693781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d586565b60 con 0x55d586565170 2024-05-08T18:31:21.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.510+0000 7fd1f1d28640 1 --2- 172.21.15.87:0/1748693781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586565170 0x55d586565590 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec0529e0 tx=0x7fd1ec052bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be17f1a7339ab69 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.510+0000 7fd0d4ff9640 1 -- 172.21.15.87:0/1748693781 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1ec015950 con 0x55d586565170 2024-05-08T18:31:21.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.510+0000 7fd0d4ff9640 1 -- 172.21.15.87:0/1748693781 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1ec015430 con 0x55d586565170 2024-05-08T18:31:21.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.510+0000 7fd0d4ff9640 1 -- 172.21.15.87:0/1748693781 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1ec015af0 con 0x55d586565170 2024-05-08T18:31:21.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.510+0000 7fd1f6230800 1 -- 172.21.15.87:0/1748693781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586565170 msgr2=0x55d586565590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.510+0000 7fd1f6230800 1 --2- 172.21.15.87:0/1748693781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586565170 0x55d586565590 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec0529e0 tx=0x7fd1ec052bb0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.510+0000 7fd1f6230800 1 -- 172.21.15.87:0/1748693781 shutdown_connections 2024-05-08T18:31:21.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.510+0000 7fd1f6230800 1 --2- 172.21.15.87:0/1748693781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586565170 0x55d586565590 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.510+0000 7fd1f6230800 1 -- 172.21.15.87:0/1748693781 >> 172.21.15.87:0/1748693781 conn(0x55d5865614d0 msgr2=0x55d58655f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.511+0000 7fd1f6230800 1 -- 172.21.15.87:0/1748693781 shutdown_connections 2024-05-08T18:31:21.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.511+0000 7fd1f6230800 1 -- 172.21.15.87:0/1748693781 wait complete. 2024-05-08T18:31:21.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.511+0000 7fd1f6230800 1 Processor -- start 2024-05-08T18:31:21.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.511+0000 7fd1f6230800 1 -- start start 2024-05-08T18:31:21.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.511+0000 7fd1f6230800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586565170 0x55d58656c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.511+0000 7fd1f6230800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d5865662d0 con 0x55d586565170 2024-05-08T18:31:21.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.511+0000 7fd1f1d28640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586565170 0x55d58656c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.511+0000 7fd1f1d28640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586565170 0x55d58656c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34192/0 (socket says 172.21.15.87:34192) 2024-05-08T18:31:21.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.511+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 learned_addr learned my addr 172.21.15.87:0/2651028549 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.511+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d58656cc40 con 0x55d586565170 2024-05-08T18:31:21.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.512+0000 7fd1f1d28640 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586565170 0x55d58656c700 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec052910 tx=0x7fd1ec052940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.512+0000 7fd0c6ffd640 1 -- 172.21.15.87:0/2651028549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1ec030020 con 0x55d586565170 2024-05-08T18:31:21.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.512+0000 7fd0c6ffd640 1 -- 172.21.15.87:0/2651028549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1ec0514c0 con 0x55d586565170 2024-05-08T18:31:21.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.512+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d58656ced0 con 0x55d586565170 2024-05-08T18:31:21.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.512+0000 7fd0c6ffd640 1 -- 172.21.15.87:0/2651028549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1ec013af0 con 0x55d586565170 2024-05-08T18:31:21.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.512+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d58656fb80 con 0x55d586565170 2024-05-08T18:31:21.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.512+0000 7fd0c6ffd640 1 -- 172.21.15.87:0/2651028549 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd1ec033020 con 0x55d586565170 2024-05-08T18:31:21.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.513+0000 7fd0c6ffd640 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd0bc03bb50 0x7fd0bc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.513+0000 7fd0c6ffd640 1 -- 172.21.15.87:0/2651028549 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd1ec00e040 con 0x55d586565170 2024-05-08T18:31:21.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.513+0000 7fd1f1527640 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd0bc03bb50 0x7fd0bc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.513+0000 7fd1f1527640 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd0bc03bb50 0x7fd0bc03e010 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4079aa0 tx=0x7fd1e4086000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.513+0000 7fd1f6230800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.513+0000 7fd1f6230800 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d5865783c0 0x55d58657a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.513+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d58657afd0 con 0x55d5865783c0 2024-05-08T18:31:21.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.513+0000 7fd1e8d26640 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d5865783c0 0x55d58657a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.514+0000 7fd1e8d26640 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d5865783c0 0x55d58657a880 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.514+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1dc009050 con 0x55d5865783c0 2024-05-08T18:31:21.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.514+0000 7fd1f6230800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.514+0000 7fd1f6230800 20 realm 2024-05-08T18:31:21.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.514+0000 7fd1f6230800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.514+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d586577810 con 0x55d5865783c0 2024-05-08T18:31:21.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.514+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1dc009050 con 0x55d5865783c0 2024-05-08T18:31:21.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.514+0000 7fd1f6230800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.514+0000 7fd1f6230800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:21.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.514+0000 7fd1f6230800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.514+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d58657bac0 con 0x55d5865783c0 2024-05-08T18:31:21.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.514+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1dc009050 con 0x55d5865783c0 2024-05-08T18:31:21.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.514+0000 7fd1f6230800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.514+0000 7fd1f6230800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.514+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d58657c390 con 0x55d5865783c0 2024-05-08T18:31:21.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.515+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd1dc009050 con 0x55d5865783c0 2024-05-08T18:31:21.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.515+0000 7fd1f6230800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:21.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.515+0000 7fd1f6230800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.515+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d58657c730 con 0x55d5865783c0 2024-05-08T18:31:21.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.515+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd1dc009050 con 0x55d5865783c0 2024-05-08T18:31:21.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.515+0000 7fd1f6230800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:21.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.515+0000 7fd1f6230800 20 searching for the correct realm 2024-05-08T18:31:21.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.515+0000 7fd1f6230800 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55d58657e610 0x55d586580a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.515+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x55d58657e610 2024-05-08T18:31:21.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.515+0000 7fd1f1d28640 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55d58657e610 0x55d586580a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.515+0000 7fd1f1d28640 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55d58657e610 0x55d586580a00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.516+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.516+0000 7fd1f1d28640 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd1ec035020 0x7fd1ec052130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.516+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x7fd1ec035020 2024-05-08T18:31:21.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.516+0000 7fd1f1527640 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd1ec035020 0x7fd1ec052130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.516+0000 7fd1f1527640 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd1ec035020 0x7fd1ec052130 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.517+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.517+0000 7fd1f1527640 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd1e4099040 0x7fd1e4054090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.517+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x7fd1e4099040 2024-05-08T18:31:21.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.517+0000 7fd1e8d26640 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd1e4099040 0x7fd1e4054090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.517+0000 7fd1e8d26640 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd1e4099040 0x7fd1e4054090 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.517+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1dc009050 con 0x7fd1e4099040 2024-05-08T18:31:21.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.517+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x55d5865783c0 2024-05-08T18:31:21.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.518+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1dc009050 con 0x55d5865783c0 2024-05-08T18:31:21.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.518+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x55d5865783c0 2024-05-08T18:31:21.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.518+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.518+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x7fd1e4099040 2024-05-08T18:31:21.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.518+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.518+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x7fd1e4099040 2024-05-08T18:31:21.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.518+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.518+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x7fd1ec035020 2024-05-08T18:31:21.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.519+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.519+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x55d58657e610 2024-05-08T18:31:21.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.519+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.519+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x55d5865783c0 2024-05-08T18:31:21.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.519+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.519+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x7fd1e4099040 2024-05-08T18:31:21.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.519+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.519+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x55d5865783c0 2024-05-08T18:31:21.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.519+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.520+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x7fd1ec035020 2024-05-08T18:31:21.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.520+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.520+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x55d58657e610 2024-05-08T18:31:21.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.520+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.520+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x55d58657e610 2024-05-08T18:31:21.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.520+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.520+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x7fd1e4099040 2024-05-08T18:31:21.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.520+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.520+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x55d58657e610 2024-05-08T18:31:21.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.521+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.521+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x55d58657e610 2024-05-08T18:31:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.521+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.521+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x55d5865783c0 2024-05-08T18:31:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.521+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.521+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x55d5865783c0 2024-05-08T18:31:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.521+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.521+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x7fd1e4099040 2024-05-08T18:31:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.522+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.522+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x55d58657e610 2024-05-08T18:31:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.522+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.522+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x7fd1ec035020 2024-05-08T18:31:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.522+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.522+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x55d5865783c0 2024-05-08T18:31:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.522+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.522+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x7fd1e4099040 2024-05-08T18:31:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.523+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.523+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x55d58657e610 2024-05-08T18:31:21.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.523+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.523+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x7fd1e4099040 2024-05-08T18:31:21.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.523+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.523+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x7fd1ec035020 2024-05-08T18:31:21.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.524+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.524+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x55d58657e610 2024-05-08T18:31:21.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.524+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.524+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x7fd1e4099040 2024-05-08T18:31:21.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.524+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.524+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x55d5865783c0 2024-05-08T18:31:21.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d5865810b0 con 0x7fd1ec035020 2024-05-08T18:31:21.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1f6230800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:21.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1f6230800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:21.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1f6230800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:21.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1f6230800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:21.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1f6230800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:21.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1f6230800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:21.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1f6230800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d58657d0e0 con 0x55d5865783c0 2024-05-08T18:31:21.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1f6230800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1f6230800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d58657d980 con 0x55d5865783c0 2024-05-08T18:31:21.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1f6230800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:21.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1f6230800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.525+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d586581530 con 0x7fd1e4099040 2024-05-08T18:31:21.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:21.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 20 zone default found 2024-05-08T18:31:21.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 4 Realm: () 2024-05-08T18:31:21.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:21.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:21.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:21.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 20 zonegroup default 2024-05-08T18:31:21.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d5865819e0 con 0x7fd1e4099040 2024-05-08T18:31:21.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d5865833c0 con 0x55d58657e610 2024-05-08T18:31:21.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d586583860 con 0x55d58657e610 2024-05-08T18:31:21.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 20 started sync module instance, tier type = 2024-05-08T18:31:21.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:21.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.526+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586582850 con 0x7fd1ec035020 2024-05-08T18:31:21.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.527+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.527+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94375570320448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586584170 con 0x7fd1ec035020 2024-05-08T18:31:21.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.527+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865849c0 con 0x55d5865783c0 2024-05-08T18:31:21.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.528+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.528+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94375570326800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586584f00 con 0x55d5865783c0 2024-05-08T18:31:21.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.528+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94375570320448] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.528+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865854f0 con 0x55d58657e610 2024-05-08T18:31:21.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.529+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94375570326800] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.529+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.529+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94375570324672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586585910 con 0x55d58657e610 2024-05-08T18:31:21.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.529+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865862d0 con 0x7fd1ec035020 2024-05-08T18:31:21.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.530+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94375570324672] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.530+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.531+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94375570333216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865866c0 con 0x7fd1ec035020 2024-05-08T18:31:21.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.531+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586587160 con 0x55d5865783c0 2024-05-08T18:31:21.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.532+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94375570333216] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.532+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.532+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94375570336816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586587550 con 0x55d5865783c0 2024-05-08T18:31:21.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.532+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586587f50 con 0x7fd1e4099040 2024-05-08T18:31:21.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.533+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94375570336816] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.533+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.533+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94375570327920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586587f10 con 0x7fd1e4099040 2024-05-08T18:31:21.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.533+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586588960 con 0x7fd1e4099040 2024-05-08T18:31:21.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.534+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94375570327920] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.534+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.534+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94375570340448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586588b40 con 0x7fd1e4099040 2024-05-08T18:31:21.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.534+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586589390 con 0x7fd1e4099040 2024-05-08T18:31:21.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.535+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94375570340448] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.535+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.535+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94375570344048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865891e0 con 0x7fd1e4099040 2024-05-08T18:31:21.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.535+0000 7fd1f6230800 20 add_watcher() i=0 2024-05-08T18:31:21.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.535+0000 7fd1f6230800 20 add_watcher() i=1 2024-05-08T18:31:21.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.535+0000 7fd1f6230800 20 add_watcher() i=2 2024-05-08T18:31:21.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.535+0000 7fd1f6230800 20 add_watcher() i=3 2024-05-08T18:31:21.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.535+0000 7fd1f6230800 20 add_watcher() i=4 2024-05-08T18:31:21.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.535+0000 7fd1f6230800 20 add_watcher() i=5 2024-05-08T18:31:21.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.535+0000 7fd1f6230800 20 add_watcher() i=6 2024-05-08T18:31:21.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.536+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94375570344048] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.536+0000 7fd1f6230800 20 add_watcher() i=7 2024-05-08T18:31:21.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.536+0000 7fd1f6230800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:21.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.536+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d58658c750 con 0x55d5865783c0 2024-05-08T18:31:21.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.536+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.536+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94375570345104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586589c00 con 0x55d5865783c0 2024-05-08T18:31:21.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.537+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94375570345104] v27'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.537+0000 7fd0a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:21.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.537+0000 7fd1f6230800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:21.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.537+0000 7fd1f6230800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:21.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.537+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d58658c450 con 0x55d5865783c0 2024-05-08T18:31:21.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.539+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.539+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865957c0 con 0x7fd1e4099040 2024-05-08T18:31:21.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.540+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.540+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865957c0 con 0x55d58657e610 2024-05-08T18:31:21.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.541+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.541+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586595c70 con 0x55d5865783c0 2024-05-08T18:31:21.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.542+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'113 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.542+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865961e0 con 0x7fd1ec035020 2024-05-08T18:31:21.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.542+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.543+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865961e0 con 0x55d58657e610 2024-05-08T18:31:21.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.543+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'22 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.543+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586596280 con 0x55d5865783c0 2024-05-08T18:31:21.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.545+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.545+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865967d0 con 0x7fd1e4099040 2024-05-08T18:31:21.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.546+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.546+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865967d0 con 0x7fd1ec035020 2024-05-08T18:31:21.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.546+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.547+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865967d0 con 0x55d58657e610 2024-05-08T18:31:21.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.547+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.547+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865957c0 con 0x7fd1ec035020 2024-05-08T18:31:21.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.550+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.550+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865957c0 con 0x7fd1e4099040 2024-05-08T18:31:21.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.551+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.551+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865957c0 con 0x7fd1ec035020 2024-05-08T18:31:21.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.552+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.552+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865957c0 con 0x7fd1e4099040 2024-05-08T18:31:21.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.553+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'27 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.553+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865957c0 con 0x55d5865783c0 2024-05-08T18:31:21.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.554+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'114 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.554+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865957c0 con 0x55d58657e610 2024-05-08T18:31:21.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.555+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.555+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865957c0 con 0x7fd1ec035020 2024-05-08T18:31:21.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.556+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.556+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865957c0 con 0x55d58657e610 2024-05-08T18:31:21.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.557+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.557+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586596d10 con 0x55d5865783c0 2024-05-08T18:31:21.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.559+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.559+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586596d10 con 0x55d5865783c0 2024-05-08T18:31:21.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.559+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'115 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.560+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586596d10 con 0x55d58657e610 2024-05-08T18:31:21.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.561+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.561+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586596d10 con 0x7fd1ec035020 2024-05-08T18:31:21.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.562+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.562+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586595c70 con 0x55d58657e610 2024-05-08T18:31:21.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.563+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.563+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586595c70 con 0x55d58657e610 2024-05-08T18:31:21.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.564+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.564+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586595c70 con 0x55d58657e610 2024-05-08T18:31:21.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.565+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.565+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586595c70 con 0x55d58657e610 2024-05-08T18:31:21.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.566+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.566+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586595c70 con 0x7fd1e4099040 2024-05-08T18:31:21.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.567+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.567+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586595c70 con 0x55d58657e610 2024-05-08T18:31:21.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.568+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.568+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586595c70 con 0x7fd1e4099040 2024-05-08T18:31:21.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.569+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.569+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586595c70 con 0x55d58657e610 2024-05-08T18:31:21.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.570+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'28 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.570+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586595c70 con 0x7fd1e4099040 2024-05-08T18:31:21.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.571+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.571+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586595c70 con 0x7fd1ec035020 2024-05-08T18:31:21.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.572+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.573+0000 7fd0a67e4640 20 reqs_thread_entry: start 2024-05-08T18:31:21.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.573+0000 7fd1f6230800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:21.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.573+0000 7fd1f6230800 20 Filter name: none 2024-05-08T18:31:21.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.573+0000 7fd017fff640 20 reqs_thread_entry: start 2024-05-08T18:31:21.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.573+0000 7fd1f6230800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:31:21.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.573+0000 7fd1f6230800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.573+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d5865c1900 con 0x7fd1e4099040 2024-05-08T18:31:21.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.574+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.574+0000 7fd1f6230800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:31:21.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.574+0000 7fd1f6230800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T18:31:21.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.574+0000 7fd1f6230800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:31:21.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.574+0000 7fd1f6230800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:21.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.574+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d5865c41e0 con 0x7fd1e4099040 2024-05-08T18:31:21.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.574+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.573 INFO:teuthology.orchestra.run.smithi087.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-08T18:31:21.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.575+0000 7fd0a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:21.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.575+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94375570345104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586574560 con 0x55d5865783c0 2024-05-08T18:31:21.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.576+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94375570345104] v27'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.576+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94375570320448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586588c90 con 0x7fd1ec035020 2024-05-08T18:31:21.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.577+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94375570320448] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.577+0000 7fd1f6230800 20 remove_watcher() i=0 2024-05-08T18:31:21.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.577+0000 7fd1f6230800 2 removed watcher, disabling cache 2024-05-08T18:31:21.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.577+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94375570326800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586588c90 con 0x55d5865783c0 2024-05-08T18:31:21.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.578+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94375570326800] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.578+0000 7fd1f6230800 20 remove_watcher() i=1 2024-05-08T18:31:21.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.578+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94375570324672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586584510 con 0x55d58657e610 2024-05-08T18:31:21.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.579+0000 7fd1f1d28640 1 -- 172.21.15.87:0/2651028549 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94375570324672] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1ec051020 con 0x55d58657e610 2024-05-08T18:31:21.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.579+0000 7fd1f6230800 20 remove_watcher() i=2 2024-05-08T18:31:21.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.579+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94375570333216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586588c90 con 0x7fd1ec035020 2024-05-08T18:31:21.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.580+0000 7fd1f1527640 1 -- 172.21.15.87:0/2651028549 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94375570333216] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1e407e050 con 0x7fd1ec035020 2024-05-08T18:31:21.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.580+0000 7fd1f6230800 20 remove_watcher() i=3 2024-05-08T18:31:21.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.580+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94375570336816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586583cc0 con 0x55d5865783c0 2024-05-08T18:31:21.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.581+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94375570336816] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x55d5865783c0 2024-05-08T18:31:21.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.581+0000 7fd1f6230800 20 remove_watcher() i=4 2024-05-08T18:31:21.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.581+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94375570327920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586585e20 con 0x7fd1e4099040 2024-05-08T18:31:21.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.582+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94375570327920] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.582+0000 7fd1f6230800 20 remove_watcher() i=5 2024-05-08T18:31:21.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.582+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94375570340448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d5865849c0 con 0x7fd1e4099040 2024-05-08T18:31:21.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.583+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94375570340448] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.583+0000 7fd1f6230800 20 remove_watcher() i=6 2024-05-08T18:31:21.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.583+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94375570344048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d586588c90 con 0x7fd1e4099040 2024-05-08T18:31:21.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 <== osd.0 v2:172.21.15.53:6800/443747735 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94375570344048] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1dc02a040 con 0x7fd1e4099040 2024-05-08T18:31:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 20 remove_watcher() i=7 2024-05-08T18:31:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd1e4099040 msgr2=0x7fd1e4054090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd1e4099040 0x7fd1e4054090 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d5865783c0 msgr2=0x55d58657a880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d5865783c0 0x55d58657a880 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd1ec035020 msgr2=0x7fd1ec052130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd1ec035020 0x7fd1ec052130 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55d58657e610 msgr2=0x55d586580a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55d58657e610 0x55d586580a00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd0bc03bb50 msgr2=0x7fd0bc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd0bc03bb50 0x7fd0bc03e010 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4079aa0 tx=0x7fd1e4086000 comp rx=0 tx=0).stop 2024-05-08T18:31:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586565170 msgr2=0x55d58656c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586565170 0x55d58656c700 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec052910 tx=0x7fd1ec052940 comp rx=0 tx=0).stop 2024-05-08T18:31:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1e8d26640 1 -- 172.21.15.87:0/2651028549 reap_dead start 2024-05-08T18:31:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 shutdown_connections 2024-05-08T18:31:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 --2- 172.21.15.87:0/2651028549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586565170 0x55d58656c700 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 >> 172.21.15.87:0/2651028549 conn(0x55d5865614d0 msgr2=0x55d58655eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 shutdown_connections 2024-05-08T18:31:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 -- 172.21.15.87:0/2651028549 wait complete. 2024-05-08T18:31:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 -- 172.21.15.87:0/658332875 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd0c803bb50 msgr2=0x7fd0c803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 --2- 172.21.15.87:0/658332875 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd0c803bb50 0x7fd0c803e010 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4079cd0 tx=0x7fd1e4052cf0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 -- 172.21.15.87:0/658332875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586557e70 msgr2=0x55d586558290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 --2- 172.21.15.87:0/658332875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586557e70 0x55d586558290 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x55d586544500 tx=0x7fd1ec0178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 -- 172.21.15.87:0/658332875 shutdown_connections 2024-05-08T18:31:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 --2- 172.21.15.87:0/658332875 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd0c803bb50 0x7fd0c803e010 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 --2- 172.21.15.87:0/658332875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d586557e70 0x55d586558290 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.584+0000 7fd1f6230800 1 -- 172.21.15.87:0/658332875 >> 172.21.15.87:0/658332875 conn(0x55d58654bf10 msgr2=0x55d58654c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 -- 172.21.15.87:0/658332875 shutdown_connections 2024-05-08T18:31:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 -- 172.21.15.87:0/658332875 wait complete. 2024-05-08T18:31:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 -- 172.21.15.87:0/3849595682 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d586545b50 msgr2=0x55d586549390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d586545b50 0x55d586549390 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 -- 172.21.15.87:0/3849595682 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d586541830 msgr2=0x55d586543c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d586541830 0x55d586543c20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 -- 172.21.15.87:0/3849595682 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd0d803bb50 msgr2=0x7fd0d803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd0d803bb50 0x7fd0d803e010 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc001d90 tx=0x7fd1dc0012f0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 -- 172.21.15.87:0/3849595682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5864413a0 msgr2=0x55d58653c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5864413a0 0x55d58653c600 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400a470 tx=0x7fd1e4002fb0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 -- 172.21.15.87:0/3849595682 shutdown_connections 2024-05-08T18:31:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d586541830 0x55d586543c20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d586545b50 0x55d586549390 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd0d803bb50 0x7fd0d803e010 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 --2- 172.21.15.87:0/3849595682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5864413a0 0x55d58653c600 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 -- 172.21.15.87:0/3849595682 >> 172.21.15.87:0/3849595682 conn(0x55d58643b720 msgr2=0x55d58652b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 -- 172.21.15.87:0/3849595682 shutdown_connections 2024-05-08T18:31:21.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.585+0000 7fd1f6230800 1 -- 172.21.15.87:0/3849595682 wait complete. 2024-05-08T18:31:21.592 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-08T18:31:21.592 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-05-08T18:31:21.592 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-05-08T18:31:21.592 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-05-08T18:31:21.638 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:21.638 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:21.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.641+0000 7fd17412d800 1 Processor -- start 2024-05-08T18:31:21.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.641+0000 7fd17412d800 1 -- start start 2024-05-08T18:31:21.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.641+0000 7fd17412d800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5612a8f5ed80 0x5612a8f61170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.641+0000 7fd17412d800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5612a8f651c0 con 0x5612a8f616b0 2024-05-08T18:31:21.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.641+0000 7fd17412d800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5612a8dfee20 con 0x5612a8f5ed80 2024-05-08T18:31:21.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.642+0000 7fd16fd78640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5612a8f5ed80 0x5612a8f61170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.642+0000 7fd167fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5612a8f616b0 0x5612a8f63aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42140/0 (socket says 172.21.15.87:42140) 2024-05-08T18:31:21.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.642+0000 7fd167fff640 1 -- 172.21.15.87:0/4211161583 learned_addr learned my addr 172.21.15.87:0/4211161583 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:21.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.642+0000 7fd16fd78640 1 -- 172.21.15.87:0/4211161583 >> v1:172.21.15.53:6789/0 conn(0x5612a8f616b0 legacy=0x5612a8f63aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.642+0000 7fd16fd78640 1 -- 172.21.15.87:0/4211161583 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612a8f663a0 con 0x5612a8f5ed80 2024-05-08T18:31:21.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.644+0000 7fd16fd78640 1 --2- 172.21.15.87:0/4211161583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 0x5612a8f61170 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd16000a470 tx=0x7fd16001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61b764af17bfeca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.644+0000 7fd16f577640 1 -- 172.21.15.87:0/4211161583 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd160057070 con 0x5612a8f5ed80 2024-05-08T18:31:21.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.644+0000 7fd16f577640 1 -- 172.21.15.87:0/4211161583 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd160052570 con 0x5612a8f5ed80 2024-05-08T18:31:21.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.644+0000 7fd16f577640 1 -- 172.21.15.87:0/4211161583 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd160052870 con 0x5612a8f5ed80 2024-05-08T18:31:21.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.644+0000 7fd17412d800 1 -- 172.21.15.87:0/4211161583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 msgr2=0x5612a8f61170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.644+0000 7fd17412d800 1 --2- 172.21.15.87:0/4211161583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 0x5612a8f61170 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd16000a470 tx=0x7fd16001ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:21.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.644+0000 7fd17412d800 1 -- 172.21.15.87:0/4211161583 shutdown_connections 2024-05-08T18:31:21.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.644+0000 7fd17412d800 1 --2- 172.21.15.87:0/4211161583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 0x5612a8f61170 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.644+0000 7fd17412d800 1 -- 172.21.15.87:0/4211161583 >> 172.21.15.87:0/4211161583 conn(0x5612a8f586b0 msgr2=0x5612a8f5ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.644+0000 7fd17412d800 1 -- 172.21.15.87:0/4211161583 shutdown_connections 2024-05-08T18:31:21.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.644+0000 7fd17412d800 1 -- 172.21.15.87:0/4211161583 wait complete. 2024-05-08T18:31:21.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.658+0000 7fd17412d800 1 Processor -- start 2024-05-08T18:31:21.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.658+0000 7fd17412d800 1 -- start start 2024-05-08T18:31:21.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.658+0000 7fd17412d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 0x5612a904f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.658+0000 7fd17412d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5612a8ea95c0 con 0x5612a8f5ed80 2024-05-08T18:31:21.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.658+0000 7fd16fd78640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 0x5612a904f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.658+0000 7fd16fd78640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 0x5612a904f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34208/0 (socket says 172.21.15.87:34208) 2024-05-08T18:31:21.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.658+0000 7fd16fd78640 1 -- 172.21.15.87:0/915692649 learned_addr learned my addr 172.21.15.87:0/915692649 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.658+0000 7fd16fd78640 1 -- 172.21.15.87:0/915692649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612a904fc00 con 0x5612a8f5ed80 2024-05-08T18:31:21.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.659+0000 7fd16fd78640 1 --2- 172.21.15.87:0/915692649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 0x5612a904f630 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd160055040 tx=0x7fd16004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf60799c50573a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.659+0000 7fd05de0b640 1 -- 172.21.15.87:0/915692649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd160057040 con 0x5612a8f5ed80 2024-05-08T18:31:21.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.659+0000 7fd05de0b640 1 -- 172.21.15.87:0/915692649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd160052990 con 0x5612a8f5ed80 2024-05-08T18:31:21.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.659+0000 7fd05de0b640 1 -- 172.21.15.87:0/915692649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd160052c70 con 0x5612a8f5ed80 2024-05-08T18:31:21.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.659+0000 7fd17412d800 1 -- 172.21.15.87:0/915692649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 msgr2=0x5612a904f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.659+0000 7fd17412d800 1 --2- 172.21.15.87:0/915692649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 0x5612a904f630 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd160055040 tx=0x7fd16004c000 comp rx=0 tx=0).stop 2024-05-08T18:31:21.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.660+0000 7fd17412d800 1 -- 172.21.15.87:0/915692649 shutdown_connections 2024-05-08T18:31:21.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.660+0000 7fd17412d800 1 --2- 172.21.15.87:0/915692649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 0x5612a904f630 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.660+0000 7fd17412d800 1 -- 172.21.15.87:0/915692649 >> 172.21.15.87:0/915692649 conn(0x5612a8f586b0 msgr2=0x5612a904af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.660+0000 7fd17412d800 1 -- 172.21.15.87:0/915692649 shutdown_connections 2024-05-08T18:31:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.660+0000 7fd17412d800 1 -- 172.21.15.87:0/915692649 wait complete. 2024-05-08T18:31:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.660+0000 7fd17412d800 1 Processor -- start 2024-05-08T18:31:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.660+0000 7fd17412d800 1 -- start start 2024-05-08T18:31:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.660+0000 7fd17412d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 0x5612a90570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.660+0000 7fd17412d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5612a8f65630 con 0x5612a8f5ed80 2024-05-08T18:31:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.660+0000 7fd16fd78640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 0x5612a90570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.660+0000 7fd16fd78640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 0x5612a90570e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34214/0 (socket says 172.21.15.87:34214) 2024-05-08T18:31:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.660+0000 7fd16fd78640 1 -- 172.21.15.87:0/646911978 learned_addr learned my addr 172.21.15.87:0/646911978 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.660+0000 7fd16fd78640 1 -- 172.21.15.87:0/646911978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612a9057620 con 0x5612a8f5ed80 2024-05-08T18:31:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.661+0000 7fd16fd78640 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 0x5612a90570e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd16000a470 tx=0x7fd160003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.661+0000 7fd057fff640 1 -- 172.21.15.87:0/646911978 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd160073070 con 0x5612a8f5ed80 2024-05-08T18:31:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.661+0000 7fd057fff640 1 -- 172.21.15.87:0/646911978 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd16005d650 con 0x5612a8f5ed80 2024-05-08T18:31:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.661+0000 7fd17412d800 1 -- 172.21.15.87:0/646911978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612a90578b0 con 0x5612a8f5ed80 2024-05-08T18:31:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.661+0000 7fd057fff640 1 -- 172.21.15.87:0/646911978 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd160057070 con 0x5612a8f5ed80 2024-05-08T18:31:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.661+0000 7fd17412d800 1 -- 172.21.15.87:0/646911978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612a905a560 con 0x5612a8f5ed80 2024-05-08T18:31:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.662+0000 7fd057fff640 1 -- 172.21.15.87:0/646911978 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd160076070 con 0x5612a8f5ed80 2024-05-08T18:31:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.662+0000 7fd057fff640 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd05803bba0 0x7fd05803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.662+0000 7fd057fff640 1 -- 172.21.15.87:0/646911978 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd160094270 con 0x5612a8f5ed80 2024-05-08T18:31:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.662+0000 7fd167fff640 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd05803bba0 0x7fd05803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.662+0000 7fd17412d800 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5612a8f616b0 0x5612a905e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.662+0000 7fd17412d800 1 -- 172.21.15.87:0/646911978 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a905e860 con 0x5612a8f616b0 2024-05-08T18:31:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.662+0000 7fd170579640 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5612a8f616b0 0x5612a905e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.662+0000 7fd167fff640 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd05803bba0 0x7fd05803e060 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd158000f60 tx=0x7fd1580012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.663+0000 7fd170579640 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5612a8f616b0 0x5612a905e320 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.663+0000 7fd170579640 1 -- 172.21.15.87:0/646911978 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd16800a4a0 con 0x5612a8f616b0 2024-05-08T18:31:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.663+0000 7fd17412d800 1 -- 172.21.15.87:0/646911978 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a905b8f0 con 0x5612a8f616b0 2024-05-08T18:31:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.663+0000 7fd170579640 1 -- 172.21.15.87:0/646911978 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd16800a4a0 con 0x5612a8f616b0 2024-05-08T18:31:21.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.663+0000 7fd17412d800 1 -- 172.21.15.87:0/646911978 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a90606a0 con 0x5612a8f616b0 2024-05-08T18:31:21.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.663+0000 7fd170579640 1 -- 172.21.15.87:0/646911978 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd16800a4a0 con 0x5612a8f616b0 2024-05-08T18:31:21.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.663+0000 7fd17412d800 1 -- 172.21.15.87:0/646911978 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a905f8d0 con 0x5612a8f616b0 2024-05-08T18:31:21.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.664+0000 7fd170579640 1 -- 172.21.15.87:0/646911978 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd16800a4a0 con 0x5612a8f616b0 2024-05-08T18:31:21.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.664+0000 7fd17412d800 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5612a9061a50 0x5612a9063e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.664+0000 7fd17412d800 1 -- 172.21.15.87:0/646911978 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a9064380 con 0x5612a9061a50 2024-05-08T18:31:21.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.664+0000 7fd16fd78640 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5612a9061a50 0x5612a9063e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.664+0000 7fd16fd78640 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5612a9061a50 0x5612a9063e40 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.664+0000 7fd16fd78640 1 -- 172.21.15.87:0/646911978 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd160075030 con 0x5612a9061a50 2024-05-08T18:31:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.665+0000 7fd17412d800 1 Processor -- start 2024-05-08T18:31:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.665+0000 7fd17412d800 1 -- start start 2024-05-08T18:31:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.665+0000 7fd17412d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a9072650 0x5612a9072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.665+0000 7fd17412d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5612a8e4ffc0 con 0x5612a9072650 2024-05-08T18:31:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.665+0000 7fd170579640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a9072650 0x5612a9072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.665+0000 7fd170579640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a9072650 0x5612a9072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34222/0 (socket says 172.21.15.87:34222) 2024-05-08T18:31:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.665+0000 7fd170579640 1 -- 172.21.15.87:0/551597718 learned_addr learned my addr 172.21.15.87:0/551597718 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.665+0000 7fd170579640 1 -- 172.21.15.87:0/551597718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612a9072fb0 con 0x5612a9072650 2024-05-08T18:31:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.666+0000 7fd170579640 1 --2- 172.21.15.87:0/551597718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a9072650 0x5612a9072a70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x5612a90584e0 tx=0x7fd1680178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.666+0000 7fd0557fa640 1 -- 172.21.15.87:0/551597718 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd168013440 con 0x5612a9072650 2024-05-08T18:31:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.666+0000 7fd0557fa640 1 -- 172.21.15.87:0/551597718 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1680135e0 con 0x5612a9072650 2024-05-08T18:31:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.666+0000 7fd17412d800 1 -- 172.21.15.87:0/551597718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612a9073a20 con 0x5612a9072650 2024-05-08T18:31:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.666+0000 7fd0557fa640 1 -- 172.21.15.87:0/551597718 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1680138c0 con 0x5612a9072650 2024-05-08T18:31:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.666+0000 7fd17412d800 1 -- 172.21.15.87:0/551597718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612a9073f20 con 0x5612a9072650 2024-05-08T18:31:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.667+0000 7fd0557fa640 1 -- 172.21.15.87:0/551597718 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd168011040 con 0x5612a9072650 2024-05-08T18:31:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.667+0000 7fd0557fa640 1 --2- 172.21.15.87:0/551597718 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd04803bba0 0x7fd04803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.667+0000 7fd0557fa640 1 -- 172.21.15.87:0/551597718 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd16801d070 con 0x5612a9072650 2024-05-08T18:31:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.667+0000 7fd16fd78640 1 --2- 172.21.15.87:0/551597718 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd04803bba0 0x7fd04803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.667+0000 7fd17412d800 1 Processor -- start 2024-05-08T18:31:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.667+0000 7fd16fd78640 1 --2- 172.21.15.87:0/551597718 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd04803bba0 0x7fd04803e060 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd16005b730 tx=0x7fd160053f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.667+0000 7fd17412d800 1 -- start start 2024-05-08T18:31:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.667+0000 7fd17412d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a907f8e0 0x5612a907fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.667+0000 7fd17412d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5612a904fec0 con 0x5612a907f8e0 2024-05-08T18:31:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.668+0000 7fd170579640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a907f8e0 0x5612a907fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.668+0000 7fd170579640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a907f8e0 0x5612a907fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34232/0 (socket says 172.21.15.87:34232) 2024-05-08T18:31:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.668+0000 7fd170579640 1 -- 172.21.15.87:0/4123650584 learned_addr learned my addr 172.21.15.87:0/4123650584 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.668+0000 7fd170579640 1 -- 172.21.15.87:0/4123650584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612a90802d0 con 0x5612a907f8e0 2024-05-08T18:31:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.668+0000 7fd170579640 1 --2- 172.21.15.87:0/4123650584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a907f8e0 0x5612a907fd00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd1680103f0 tx=0x7fd168001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1e727e75649508 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.668+0000 7fd04effd640 1 -- 172.21.15.87:0/4123650584 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd16802ad80 con 0x5612a907f8e0 2024-05-08T18:31:21.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.668+0000 7fd04effd640 1 -- 172.21.15.87:0/4123650584 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1680540d0 con 0x5612a907f8e0 2024-05-08T18:31:21.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.668+0000 7fd04effd640 1 -- 172.21.15.87:0/4123650584 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1680014f0 con 0x5612a907f8e0 2024-05-08T18:31:21.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.669+0000 7fd17412d800 1 -- 172.21.15.87:0/4123650584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a907f8e0 msgr2=0x5612a907fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.669+0000 7fd17412d800 1 --2- 172.21.15.87:0/4123650584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a907f8e0 0x5612a907fd00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd1680103f0 tx=0x7fd168001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:21.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.669+0000 7fd17412d800 1 -- 172.21.15.87:0/4123650584 shutdown_connections 2024-05-08T18:31:21.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.669+0000 7fd17412d800 1 --2- 172.21.15.87:0/4123650584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a907f8e0 0x5612a907fd00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.669+0000 7fd17412d800 1 -- 172.21.15.87:0/4123650584 >> 172.21.15.87:0/4123650584 conn(0x5612a907bbf0 msgr2=0x5612a9079ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.669+0000 7fd17412d800 1 -- 172.21.15.87:0/4123650584 shutdown_connections 2024-05-08T18:31:21.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.669+0000 7fd17412d800 1 -- 172.21.15.87:0/4123650584 wait complete. 2024-05-08T18:31:21.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.669+0000 7fd17412d800 1 Processor -- start 2024-05-08T18:31:21.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.669+0000 7fd17412d800 1 -- start start 2024-05-08T18:31:21.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.669+0000 7fd17412d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a907f8e0 0x5612a9086e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.669+0000 7fd17412d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5612a9080aa0 con 0x5612a907f8e0 2024-05-08T18:31:21.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.669+0000 7fd170579640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a907f8e0 0x5612a9086e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.669+0000 7fd170579640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a907f8e0 0x5612a9086e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34240/0 (socket says 172.21.15.87:34240) 2024-05-08T18:31:21.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.669+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 learned_addr learned my addr 172.21.15.87:0/2310248017 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.669+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612a9087390 con 0x5612a907f8e0 2024-05-08T18:31:21.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.670+0000 7fd170579640 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a907f8e0 0x5612a9086e50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd16804d010 tx=0x7fd168052890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.670+0000 7fd04d7fa640 1 -- 172.21.15.87:0/2310248017 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd168030020 con 0x5612a907f8e0 2024-05-08T18:31:21.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.670+0000 7fd04d7fa640 1 -- 172.21.15.87:0/2310248017 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1680513f0 con 0x5612a907f8e0 2024-05-08T18:31:21.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.670+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612a9087620 con 0x5612a907f8e0 2024-05-08T18:31:21.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.670+0000 7fd04d7fa640 1 -- 172.21.15.87:0/2310248017 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd168013a60 con 0x5612a907f8e0 2024-05-08T18:31:21.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.670+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612a908a2d0 con 0x5612a907f8e0 2024-05-08T18:31:21.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.671+0000 7fd04d7fa640 1 -- 172.21.15.87:0/2310248017 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd168033020 con 0x5612a907f8e0 2024-05-08T18:31:21.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.671+0000 7fd04d7fa640 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd03803bba0 0x7fd03803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.671+0000 7fd04d7fa640 1 -- 172.21.15.87:0/2310248017 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd16800e040 con 0x5612a907f8e0 2024-05-08T18:31:21.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.671+0000 7fd16fd78640 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd03803bba0 0x7fd03803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.671+0000 7fd16fd78640 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd03803bba0 0x7fd03803e060 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd160044810 tx=0x7fd160087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.671+0000 7fd17412d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.671+0000 7fd17412d800 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5612a9092b00 0x5612a9094fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.671+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a9095710 con 0x5612a9092b00 2024-05-08T18:31:21.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.672+0000 7fd167fff640 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5612a9092b00 0x5612a9094fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.672+0000 7fd167fff640 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5612a9092b00 0x5612a9094fc0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.672+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd158009050 con 0x5612a9092b00 2024-05-08T18:31:21.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.672+0000 7fd17412d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.672+0000 7fd17412d800 20 realm 2024-05-08T18:31:21.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.672+0000 7fd17412d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.672+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a9091f50 con 0x5612a9092b00 2024-05-08T18:31:21.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.672+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd158009050 con 0x5612a9092b00 2024-05-08T18:31:21.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.672+0000 7fd17412d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.672+0000 7fd17412d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:21.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.672+0000 7fd17412d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.672+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a9096200 con 0x5612a9092b00 2024-05-08T18:31:21.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.673+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd158009050 con 0x5612a9092b00 2024-05-08T18:31:21.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.673+0000 7fd17412d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.673+0000 7fd17412d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.673+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a9096ad0 con 0x5612a9092b00 2024-05-08T18:31:21.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.673+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd158009050 con 0x5612a9092b00 2024-05-08T18:31:21.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.673+0000 7fd17412d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:21.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.673+0000 7fd17412d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.673+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a9096e70 con 0x5612a9092b00 2024-05-08T18:31:21.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.673+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd158009050 con 0x5612a9092b00 2024-05-08T18:31:21.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.673+0000 7fd17412d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:21.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.673+0000 7fd17412d800 20 searching for the correct realm 2024-05-08T18:31:21.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.673+0000 7fd17412d800 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5612a9098d50 0x5612a909b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.673+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x5612a9098d50 2024-05-08T18:31:21.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.673+0000 7fd170579640 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5612a9098d50 0x5612a909b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.674+0000 7fd170579640 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5612a9098d50 0x5612a909b160 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.674+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd168029070 con 0x5612a9098d50 2024-05-08T18:31:21.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.674+0000 7fd170579640 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd168035020 0x7fd1680298f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.674+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x7fd168035020 2024-05-08T18:31:21.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.674+0000 7fd16fd78640 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd168035020 0x7fd1680298f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.674+0000 7fd16fd78640 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd168035020 0x7fd1680298f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.675+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd160075030 con 0x7fd168035020 2024-05-08T18:31:21.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.675+0000 7fd16fd78640 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd1600a2040 0x7fd16005b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.675+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x7fd1600a2040 2024-05-08T18:31:21.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.675+0000 7fd167fff640 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd1600a2040 0x7fd16005b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.675+0000 7fd167fff640 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd1600a2040 0x7fd16005b7a0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.676+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd158009050 con 0x7fd1600a2040 2024-05-08T18:31:21.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.676+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x5612a9092b00 2024-05-08T18:31:21.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.676+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd158009050 con 0x5612a9092b00 2024-05-08T18:31:21.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.676+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x5612a9092b00 2024-05-08T18:31:21.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.676+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.676+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x7fd1600a2040 2024-05-08T18:31:21.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.676+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.676+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x7fd1600a2040 2024-05-08T18:31:21.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.676+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.676+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x7fd168035020 2024-05-08T18:31:21.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.677+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd160075030 con 0x7fd168035020 2024-05-08T18:31:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.677+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x5612a9098d50 2024-05-08T18:31:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.677+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd168029070 con 0x5612a9098d50 2024-05-08T18:31:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.677+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x5612a9092b00 2024-05-08T18:31:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.677+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.677+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x7fd1600a2040 2024-05-08T18:31:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.677+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.677+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x5612a9092b00 2024-05-08T18:31:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.678+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.678+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x7fd168035020 2024-05-08T18:31:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.678+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd160075030 con 0x7fd168035020 2024-05-08T18:31:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.678+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x5612a9098d50 2024-05-08T18:31:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.678+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd168029070 con 0x5612a9098d50 2024-05-08T18:31:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.678+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x5612a9098d50 2024-05-08T18:31:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.678+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd168029070 con 0x5612a9098d50 2024-05-08T18:31:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.678+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x7fd1600a2040 2024-05-08T18:31:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.678+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.678+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x5612a9098d50 2024-05-08T18:31:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.679+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd168029070 con 0x5612a9098d50 2024-05-08T18:31:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.679+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x5612a9098d50 2024-05-08T18:31:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.679+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd168029070 con 0x5612a9098d50 2024-05-08T18:31:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.679+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x5612a9092b00 2024-05-08T18:31:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.679+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.679+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x5612a9092b00 2024-05-08T18:31:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.679+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.679+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x7fd1600a2040 2024-05-08T18:31:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.680+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.680+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x5612a9098d50 2024-05-08T18:31:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.680+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd168029070 con 0x5612a9098d50 2024-05-08T18:31:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.680+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x7fd168035020 2024-05-08T18:31:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.680+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd160075030 con 0x7fd168035020 2024-05-08T18:31:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.680+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x5612a9092b00 2024-05-08T18:31:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.680+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.680+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x7fd1600a2040 2024-05-08T18:31:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.681+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.681+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x5612a9098d50 2024-05-08T18:31:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.681+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd168029070 con 0x5612a9098d50 2024-05-08T18:31:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.681+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x7fd1600a2040 2024-05-08T18:31:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.681+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.681+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x7fd168035020 2024-05-08T18:31:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.681+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd160075030 con 0x7fd168035020 2024-05-08T18:31:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.681+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x5612a9098d50 2024-05-08T18:31:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.682+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd168029070 con 0x5612a9098d50 2024-05-08T18:31:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.682+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x7fd1600a2040 2024-05-08T18:31:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.682+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.682+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x5612a9092b00 2024-05-08T18:31:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.682+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.682+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5612a909b830 con 0x7fd168035020 2024-05-08T18:31:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.683+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd160075030 con 0x7fd168035020 2024-05-08T18:31:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.683+0000 7fd17412d800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.683+0000 7fd17412d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.683+0000 7fd17412d800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.683+0000 7fd17412d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.683+0000 7fd17412d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.683+0000 7fd17412d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.683+0000 7fd17412d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.683+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a90977c0 con 0x5612a9092b00 2024-05-08T18:31:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.683+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.683+0000 7fd17412d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.683+0000 7fd17412d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.683+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a9098060 con 0x5612a9092b00 2024-05-08T18:31:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.683+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.683+0000 7fd17412d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.683+0000 7fd17412d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.683+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a909bcb0 con 0x7fd1600a2040 2024-05-08T18:31:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 20 zone default found 2024-05-08T18:31:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 4 Realm: () 2024-05-08T18:31:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 20 zonegroup default 2024-05-08T18:31:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a909c160 con 0x7fd1600a2040 2024-05-08T18:31:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a909db40 con 0x5612a9098d50 2024-05-08T18:31:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd168029070 con 0x5612a9098d50 2024-05-08T18:31:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a909e000 con 0x5612a9098d50 2024-05-08T18:31:21.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd168029070 con 0x5612a9098d50 2024-05-08T18:31:21.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 20 started sync module instance, tier type = 2024-05-08T18:31:21.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:21.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.684+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a909cfd0 con 0x7fd168035020 2024-05-08T18:31:21.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.685+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd160075030 con 0x7fd168035020 2024-05-08T18:31:21.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.685+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94638145393600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a909cc30 con 0x7fd168035020 2024-05-08T18:31:21.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.685+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a909ef30 con 0x5612a9092b00 2024-05-08T18:31:21.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.686+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94638145393600] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd160075030 con 0x7fd168035020 2024-05-08T18:31:21.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.687+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.687+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94638145399424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a909f350 con 0x5612a9092b00 2024-05-08T18:31:21.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.687+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a909fd10 con 0x5612a9098d50 2024-05-08T18:31:21.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.688+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94638145399424] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.688+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd168029070 con 0x5612a9098d50 2024-05-08T18:31:21.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.688+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94638145400480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a909f2c0 con 0x5612a9098d50 2024-05-08T18:31:21.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.688+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a0bd0 con 0x7fd168035020 2024-05-08T18:31:21.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.689+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94638145400480] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd168029070 con 0x5612a9098d50 2024-05-08T18:31:21.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.689+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd160075030 con 0x7fd168035020 2024-05-08T18:31:21.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.689+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94638145406752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a0fc0 con 0x7fd168035020 2024-05-08T18:31:21.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.689+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a1a00 con 0x5612a9092b00 2024-05-08T18:31:21.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.690+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.690+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94638145410256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a22a0 con 0x5612a9092b00 2024-05-08T18:31:21.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.690+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a2d60 con 0x7fd1600a2040 2024-05-08T18:31:21.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.690+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94638145406752] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd160075030 con 0x7fd168035020 2024-05-08T18:31:21.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.691+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94638145410256] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.691+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.691+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94638145415216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a1d00 con 0x7fd1600a2040 2024-05-08T18:31:21.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.691+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a3600 con 0x7fd1600a2040 2024-05-08T18:31:21.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.692+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(56 notify.6 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.692+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94638145417552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a1d00 con 0x7fd1600a2040 2024-05-08T18:31:21.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.692+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a4130 con 0x7fd1600a2040 2024-05-08T18:31:21.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.692+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94638145415216] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.693+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94638145417552] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.693+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.693+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94638145418608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a3c40 con 0x7fd1600a2040 2024-05-08T18:31:21.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.693+0000 7fd17412d800 20 add_watcher() i=0 2024-05-08T18:31:21.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.693+0000 7fd17412d800 20 add_watcher() i=1 2024-05-08T18:31:21.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.693+0000 7fd17412d800 20 add_watcher() i=2 2024-05-08T18:31:21.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.693+0000 7fd17412d800 20 add_watcher() i=3 2024-05-08T18:31:21.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.693+0000 7fd17412d800 20 add_watcher() i=4 2024-05-08T18:31:21.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.693+0000 7fd17412d800 20 add_watcher() i=5 2024-05-08T18:31:21.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.693+0000 7fd17412d800 20 add_watcher() i=6 2024-05-08T18:31:21.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.694+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94638145418608] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.694+0000 7fd17412d800 20 add_watcher() i=7 2024-05-08T18:31:21.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.694+0000 7fd17412d800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:21.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.694+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a7120 con 0x5612a9092b00 2024-05-08T18:31:21.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.694+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.694+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94638145420352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a4510 con 0x5612a9092b00 2024-05-08T18:31:21.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.695+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94638145420352] v27'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.695+0000 7fd025fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:21.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.695+0000 7fd17412d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:21.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.695+0000 7fd17412d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:21.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.695+0000 7fd17412d800 5 note: GC not initialized 2024-05-08T18:31:21.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.696+0000 7fd024fe1640 20 reqs_thread_entry: start 2024-05-08T18:31:21.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.696+0000 7fd17412d800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:21.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.696+0000 7fd17412d800 20 Filter name: none 2024-05-08T18:31:21.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.696+0000 7fcf9e7fc640 20 reqs_thread_entry: start 2024-05-08T18:31:21.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.696+0000 7fd17412d800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:31:21.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.696+0000 7fd17412d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.696+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a90da480 con 0x7fd1600a2040 2024-05-08T18:31:21.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.697+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.697+0000 7fd17412d800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:31:21.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.697+0000 7fd17412d800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T18:31:21.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.697+0000 7fd17412d800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:31:21.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.697+0000 7fd17412d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:21.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.697+0000 7fd17412d800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:31:21.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.697+0000 7fd17412d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.697+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a90dc400 con 0x7fd168035020 2024-05-08T18:31:21.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.697+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd160075030 con 0x7fd168035020 2024-05-08T18:31:21.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.697+0000 7fd17412d800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:21.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.697+0000 7fd17412d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:31:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.697+0000 7fd17412d800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.697+0000 7fd17412d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 : miss 2024-05-08T18:31:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.697+0000 7fd17412d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.697+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a90de200 con 0x5612a9098d50 2024-05-08T18:31:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.698+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd168029070 con 0x5612a9098d50 2024-05-08T18:31:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.698+0000 7fd17412d800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.698+0000 7fd17412d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x17 2024-05-08T18:31:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.698+0000 7fd17412d800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.698+0000 7fd17412d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.698+0000 7fd17412d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.698+0000 7fd17412d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 2024-05-08T18:31:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.698+0000 7fd17412d800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-05-08T18:31:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.698+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90e1430 con 0x7fd1600a2040 2024-05-08T18:31:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.699+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(65 fud.buckets [call] v27'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.699+0000 7fd17412d800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-05-08T18:31:21.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.699+0000 7fd17412d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.699+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a90e03e0 con 0x7fd168035020 2024-05-08T18:31:21.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.699+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fd160075030 con 0x7fd168035020 2024-05-08T18:31:21.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.699+0000 7fd17412d800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:21.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.699+0000 7fd17412d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-05-08T18:31:21.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.699+0000 7fd17412d800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:21.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.699+0000 7fd17412d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:21.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.699+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90e0dd0 con 0x7fd168035020 2024-05-08T18:31:21.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.700+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v27'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fd160075030 con 0x7fd168035020 2024-05-08T18:31:21.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.700+0000 7fd17412d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-08T18:31:21.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.700+0000 7fd17412d800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:21.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.700+0000 7fd17412d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:31:21.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.700+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94638145669376 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5612a90e2cf0 con 0x7fd1600a2040 2024-05-08T18:31:21.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.701+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== watch-notify(notify (1) cookie 94638145417552 notify 115964116996 ret 0) ==== 380+0+0 (crc 0 0 0) 0x5612a8f651c0 con 0x7fd1600a2040 2024-05-08T18:31:21.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.701+0000 7fd04effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 94638145417552 notifier 4508 bl.length()=338 2024-05-08T18:31:21.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.701+0000 7fd04effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-08T18:31:21.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.701+0000 7fd04effd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:21.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.701+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(68 notify.6 [notify cookie 94638145669376 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.701+0000 7fd04effd640 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fd034003ea0 con 0x7fd1600a2040 2024-05-08T18:31:21.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.701+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.701+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== watch-notify(notify_complete (2) cookie 94638145669376 notify 115964116996 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd15802e720 con 0x7fd1600a2040 2024-05-08T18:31:21.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.702+0000 7fd025fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:21.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.702+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94638145420352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90e0900 con 0x5612a9092b00 2024-05-08T18:31:21.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.703+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94638145420352] v27'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.703+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94638145393600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a3c40 con 0x7fd168035020 2024-05-08T18:31:21.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.704+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94638145393600] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd160075030 con 0x7fd168035020 2024-05-08T18:31:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.704+0000 7fd17412d800 20 remove_watcher() i=0 2024-05-08T18:31:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.704+0000 7fd17412d800 2 removed watcher, disabling cache 2024-05-08T18:31:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.704+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94638145399424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a3c40 con 0x5612a9092b00 2024-05-08T18:31:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.705+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94638145399424] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.705+0000 7fd17412d800 20 remove_watcher() i=1 2024-05-08T18:31:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.705+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94638145400480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a909ea80 con 0x5612a9098d50 2024-05-08T18:31:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.706+0000 7fd170579640 1 -- 172.21.15.87:0/2310248017 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94638145400480] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd168029070 con 0x5612a9098d50 2024-05-08T18:31:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.706+0000 7fd17412d800 20 remove_watcher() i=2 2024-05-08T18:31:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.706+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94638145406752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a3c40 con 0x7fd168035020 2024-05-08T18:31:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.707+0000 7fd16fd78640 1 -- 172.21.15.87:0/2310248017 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94638145406752] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd160075030 con 0x7fd168035020 2024-05-08T18:31:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.707+0000 7fd17412d800 20 remove_watcher() i=3 2024-05-08T18:31:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.707+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94638145410256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a3c40 con 0x5612a9092b00 2024-05-08T18:31:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.708+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94638145410256] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x5612a9092b00 2024-05-08T18:31:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.708+0000 7fd17412d800 20 remove_watcher() i=4 2024-05-08T18:31:21.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.708+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94638145415216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a14d0 con 0x7fd1600a2040 2024-05-08T18:31:21.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.709+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94638145415216] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.709+0000 7fd17412d800 20 remove_watcher() i=5 2024-05-08T18:31:21.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.709+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94638145417552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a3c40 con 0x7fd1600a2040 2024-05-08T18:31:21.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.710+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94638145417552] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.710+0000 7fd17412d800 20 remove_watcher() i=6 2024-05-08T18:31:21.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.710+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94638145418608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5612a90a3c40 con 0x7fd1600a2040 2024-05-08T18:31:21.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94638145418608] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd15802a040 con 0x7fd1600a2040 2024-05-08T18:31:21.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 20 remove_watcher() i=7 2024-05-08T18:31:21.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd1600a2040 msgr2=0x7fd16005b7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd1600a2040 0x7fd16005b7a0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5612a9092b00 msgr2=0x5612a9094fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5612a9092b00 0x5612a9094fc0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd168035020 msgr2=0x7fd1680298f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd168035020 0x7fd1680298f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5612a9098d50 msgr2=0x5612a909b160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5612a9098d50 0x5612a909b160 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd03803bba0 msgr2=0x7fd03803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd03803bba0 0x7fd03803e060 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd160044810 tx=0x7fd160087000 comp rx=0 tx=0).stop 2024-05-08T18:31:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd167fff640 1 -- 172.21.15.87:0/2310248017 reap_dead start 2024-05-08T18:31:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a907f8e0 msgr2=0x5612a9086e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a907f8e0 0x5612a9086e50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd16804d010 tx=0x7fd168052890 comp rx=0 tx=0).stop 2024-05-08T18:31:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 shutdown_connections 2024-05-08T18:31:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 --2- 172.21.15.87:0/2310248017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a907f8e0 0x5612a9086e50 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 >> 172.21.15.87:0/2310248017 conn(0x5612a907bbf0 msgr2=0x5612a90792a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 shutdown_connections 2024-05-08T18:31:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 -- 172.21.15.87:0/2310248017 wait complete. 2024-05-08T18:31:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 -- 172.21.15.87:0/551597718 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd04803bba0 msgr2=0x7fd04803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 --2- 172.21.15.87:0/551597718 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd04803bba0 0x7fd04803e060 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd16005b730 tx=0x7fd160053f50 comp rx=0 tx=0).stop 2024-05-08T18:31:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 -- 172.21.15.87:0/551597718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a9072650 msgr2=0x5612a9072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 --2- 172.21.15.87:0/551597718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a9072650 0x5612a9072a70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x5612a90584e0 tx=0x7fd1680178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 -- 172.21.15.87:0/551597718 shutdown_connections 2024-05-08T18:31:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 --2- 172.21.15.87:0/551597718 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd04803bba0 0x7fd04803e060 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 --2- 172.21.15.87:0/551597718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a9072650 0x5612a9072a70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.711+0000 7fd17412d800 1 -- 172.21.15.87:0/551597718 >> 172.21.15.87:0/551597718 conn(0x5612a90666f0 msgr2=0x5612a9066af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 -- 172.21.15.87:0/551597718 shutdown_connections 2024-05-08T18:31:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 -- 172.21.15.87:0/551597718 wait complete. 2024-05-08T18:31:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 -- 172.21.15.87:0/646911978 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5612a9061a50 msgr2=0x5612a9063e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5612a9061a50 0x5612a9063e40 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 -- 172.21.15.87:0/646911978 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5612a8f616b0 msgr2=0x5612a905e320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5612a8f616b0 0x5612a905e320 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 -- 172.21.15.87:0/646911978 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd05803bba0 msgr2=0x7fd05803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd05803bba0 0x7fd05803e060 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd158000f60 tx=0x7fd1580012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 -- 172.21.15.87:0/646911978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 msgr2=0x5612a90570e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 0x5612a90570e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd16000a470 tx=0x7fd160003020 comp rx=0 tx=0).stop 2024-05-08T18:31:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 -- 172.21.15.87:0/646911978 shutdown_connections 2024-05-08T18:31:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5612a8f616b0 0x5612a905e320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5612a9061a50 0x5612a9063e40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd05803bba0 0x7fd05803e060 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 --2- 172.21.15.87:0/646911978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612a8f5ed80 0x5612a90570e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 -- 172.21.15.87:0/646911978 >> 172.21.15.87:0/646911978 conn(0x5612a8f586b0 msgr2=0x5612a9049750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 -- 172.21.15.87:0/646911978 shutdown_connections 2024-05-08T18:31:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.712+0000 7fd17412d800 1 -- 172.21.15.87:0/646911978 wait complete. 2024-05-08T18:31:21.724 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1'] 2024-05-08T18:31:21.724 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1'] 2024-05-08T18:31:21.724 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 2024-05-08T18:31:21.772 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:21.772 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:21.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.775+0000 7f8fdd43d800 1 Processor -- start 2024-05-08T18:31:21.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.775+0000 7f8fdd43d800 1 -- start start 2024-05-08T18:31:21.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.775+0000 7f8fdd43d800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5633921036c0 0x563392105ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.775+0000 7f8fdd43d800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563392106080 con 0x5633920ff2d0 2024-05-08T18:31:21.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.775+0000 7f8fdd43d800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x563391f9fe20 con 0x5633921036c0 2024-05-08T18:31:21.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.776+0000 7f8fda734640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5633921036c0 0x563392105ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.776+0000 7f8fdaf35640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5633920ff2d0 0x5633920ff6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42154/0 (socket says 172.21.15.87:42154) 2024-05-08T18:31:21.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.776+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1253192318 learned_addr learned my addr 172.21.15.87:0/1253192318 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:21.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.776+0000 7f8fda734640 1 -- 172.21.15.87:0/1253192318 >> v1:172.21.15.53:6789/0 conn(0x5633920ff2d0 legacy=0x5633920ff6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.776+0000 7f8fda734640 1 -- 172.21.15.87:0/1253192318 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633921072b0 con 0x5633921036c0 2024-05-08T18:31:21.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.778+0000 7f8fda734640 1 --2- 172.21.15.87:0/1253192318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633921036c0 0x563392105ab0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400a470 tx=0x7f8fc401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e701a97ea39509 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.778+0000 7f8fd9f33640 1 -- 172.21.15.87:0/1253192318 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc4057070 con 0x5633921036c0 2024-05-08T18:31:21.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.778+0000 7f8fd9f33640 1 -- 172.21.15.87:0/1253192318 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc4052570 con 0x5633921036c0 2024-05-08T18:31:21.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.778+0000 7f8fd9f33640 1 -- 172.21.15.87:0/1253192318 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc4052870 con 0x5633921036c0 2024-05-08T18:31:21.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.778+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1253192318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633921036c0 msgr2=0x563392105ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.778+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1253192318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633921036c0 0x563392105ab0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400a470 tx=0x7f8fc401ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:21.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.778+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1253192318 shutdown_connections 2024-05-08T18:31:21.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.778+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1253192318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633921036c0 0x563392105ab0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.778+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1253192318 >> 172.21.15.87:0/1253192318 conn(0x5633920fa850 msgr2=0x5633920fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.778+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1253192318 shutdown_connections 2024-05-08T18:31:21.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.778+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1253192318 wait complete. 2024-05-08T18:31:21.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.792+0000 7f8fdd43d800 1 Processor -- start 2024-05-08T18:31:21.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.792+0000 7f8fdd43d800 1 -- start start 2024-05-08T18:31:21.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.792+0000 7f8fdd43d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633920ff2d0 0x5633921f0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.792+0000 7f8fdd43d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56339204a5d0 con 0x5633920ff2d0 2024-05-08T18:31:21.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.792+0000 7f8fdaf35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633920ff2d0 0x5633921f0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.793+0000 7f8fdaf35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633920ff2d0 0x5633921f0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34266/0 (socket says 172.21.15.87:34266) 2024-05-08T18:31:21.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.793+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1939332346 learned_addr learned my addr 172.21.15.87:0/1939332346 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.793+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1939332346 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633921f0cd0 con 0x5633920ff2d0 2024-05-08T18:31:21.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.793+0000 7f8fdaf35640 1 --2- 172.21.15.87:0/1939332346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633920ff2d0 0x5633921f0700 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40017a0 tx=0x7f8fd4001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe915883f652f96a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.793+0000 7f8ec8e09640 1 -- 172.21.15.87:0/1939332346 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fd4016070 con 0x5633920ff2d0 2024-05-08T18:31:21.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.793+0000 7f8ec8e09640 1 -- 172.21.15.87:0/1939332346 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd4004520 con 0x5633920ff2d0 2024-05-08T18:31:21.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.793+0000 7f8ec8e09640 1 -- 172.21.15.87:0/1939332346 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fd4004820 con 0x5633920ff2d0 2024-05-08T18:31:21.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.794+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1939332346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633920ff2d0 msgr2=0x5633921f0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.794+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1939332346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633920ff2d0 0x5633921f0700 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40017a0 tx=0x7f8fd4001c60 comp rx=0 tx=0).stop 2024-05-08T18:31:21.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.794+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1939332346 shutdown_connections 2024-05-08T18:31:21.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.794+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1939332346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633920ff2d0 0x5633921f0700 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.794+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1939332346 >> 172.21.15.87:0/1939332346 conn(0x5633920fa850 msgr2=0x5633921ec020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.794+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1939332346 shutdown_connections 2024-05-08T18:31:21.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.794+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1939332346 wait complete. 2024-05-08T18:31:21.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.794+0000 7f8fdd43d800 1 Processor -- start 2024-05-08T18:31:21.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.794+0000 7f8fdd43d800 1 -- start start 2024-05-08T18:31:21.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.794+0000 7f8fdd43d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633920ff2d0 0x5633921f82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.794+0000 7f8fdd43d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563392106550 con 0x5633920ff2d0 2024-05-08T18:31:21.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.794+0000 7f8fdaf35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633920ff2d0 0x5633921f82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.794+0000 7f8fdaf35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633920ff2d0 0x5633921f82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34274/0 (socket says 172.21.15.87:34274) 2024-05-08T18:31:21.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.794+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1832538861 learned_addr learned my addr 172.21.15.87:0/1832538861 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.795+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1832538861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633921f8810 con 0x5633920ff2d0 2024-05-08T18:31:21.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.795+0000 7f8fdaf35640 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633920ff2d0 0x5633921f82d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4000f80 tx=0x7f8fd4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.795+0000 7f8ec7606640 1 -- 172.21.15.87:0/1832538861 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fd4016040 con 0x5633920ff2d0 2024-05-08T18:31:21.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.795+0000 7f8ec7606640 1 -- 172.21.15.87:0/1832538861 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd4011530 con 0x5633920ff2d0 2024-05-08T18:31:21.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.795+0000 7f8ec7606640 1 -- 172.21.15.87:0/1832538861 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fd4011890 con 0x5633920ff2d0 2024-05-08T18:31:21.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.795+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1832538861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633921f8aa0 con 0x5633920ff2d0 2024-05-08T18:31:21.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.795+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1832538861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633921fb750 con 0x5633920ff2d0 2024-05-08T18:31:21.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.796+0000 7f8ec7606640 1 -- 172.21.15.87:0/1832538861 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8fd401c3f0 con 0x5633920ff2d0 2024-05-08T18:31:21.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.796+0000 7f8ec7606640 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8ec003bba0 0x7f8ec003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.796+0000 7f8ec7606640 1 -- 172.21.15.87:0/1832538861 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8fd4051c60 con 0x5633920ff2d0 2024-05-08T18:31:21.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.796+0000 7f8fda734640 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8ec003bba0 0x7f8ec003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.796+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5633921036c0 0x5633921ff510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.796+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1832538861 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633921ffaa0 con 0x5633921036c0 2024-05-08T18:31:21.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.796+0000 7f8fdb736640 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5633921036c0 0x5633921ff510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.797+0000 7f8fda734640 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8ec003bba0 0x7f8ec003e060 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4054000 tx=0x7f8fc404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.797+0000 7f8fdb736640 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5633921036c0 0x5633921ff510 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.797+0000 7f8fdb736640 1 -- 172.21.15.87:0/1832538861 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fcc0083e0 con 0x5633921036c0 2024-05-08T18:31:21.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.797+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1832538861 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633921fcac0 con 0x5633921036c0 2024-05-08T18:31:21.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.797+0000 7f8fdb736640 1 -- 172.21.15.87:0/1832538861 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fcc0083e0 con 0x5633921036c0 2024-05-08T18:31:21.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.797+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1832538861 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633922018c0 con 0x5633921036c0 2024-05-08T18:31:21.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.798+0000 7f8fdb736640 1 -- 172.21.15.87:0/1832538861 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8fcc0083e0 con 0x5633921036c0 2024-05-08T18:31:21.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.798+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1832538861 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563392200af0 con 0x5633921036c0 2024-05-08T18:31:21.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.798+0000 7f8fdb736640 1 -- 172.21.15.87:0/1832538861 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fcc0083e0 con 0x5633921036c0 2024-05-08T18:31:21.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.798+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563392202c70 0x563392205060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.798+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1832538861 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633922055a0 con 0x563392202c70 2024-05-08T18:31:21.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.798+0000 7f8fdaf35640 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563392202c70 0x563392205060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.798+0000 7f8fdaf35640 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563392202c70 0x563392205060 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.799+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1832538861 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8fd4019050 con 0x563392202c70 2024-05-08T18:31:21.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.799+0000 7f8fdd43d800 1 Processor -- start 2024-05-08T18:31:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.799+0000 7f8fdd43d800 1 -- start start 2024-05-08T18:31:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.799+0000 7f8fdd43d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392213820 0x563392213c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.799+0000 7f8fdd43d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563391ff0fc0 con 0x563392213820 2024-05-08T18:31:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.799+0000 7f8fdb736640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392213820 0x563392213c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.799+0000 7f8fdb736640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392213820 0x563392213c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34282/0 (socket says 172.21.15.87:34282) 2024-05-08T18:31:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.799+0000 7f8fdb736640 1 -- 172.21.15.87:0/4224513249 learned_addr learned my addr 172.21.15.87:0/4224513249 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.800+0000 7f8fdb736640 1 -- 172.21.15.87:0/4224513249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563392214180 con 0x563392213820 2024-05-08T18:31:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.800+0000 7f8fdb736640 1 --2- 172.21.15.87:0/4224513249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392213820 0x563392213c40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x5633921f96d0 tx=0x7f8fcc00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.800+0000 7f8ec4e01640 1 -- 172.21.15.87:0/4224513249 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc01c070 con 0x563392213820 2024-05-08T18:31:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.800+0000 7f8ec4e01640 1 -- 172.21.15.87:0/4224513249 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc00bdc0 con 0x563392213820 2024-05-08T18:31:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.800+0000 7f8fdd43d800 1 -- 172.21.15.87:0/4224513249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563392214bf0 con 0x563392213820 2024-05-08T18:31:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.800+0000 7f8ec4e01640 1 -- 172.21.15.87:0/4224513249 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc018540 con 0x563392213820 2024-05-08T18:31:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.800+0000 7f8fdd43d800 1 -- 172.21.15.87:0/4224513249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633922150f0 con 0x563392213820 2024-05-08T18:31:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.801+0000 7f8ec4e01640 1 -- 172.21.15.87:0/4224513249 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8fcc01f070 con 0x563392213820 2024-05-08T18:31:21.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.801+0000 7f8ec4e01640 1 --2- 172.21.15.87:0/4224513249 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8eb403bba0 0x7f8eb403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.801+0000 7f8ec4e01640 1 -- 172.21.15.87:0/4224513249 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8fcc0546e0 con 0x563392213820 2024-05-08T18:31:21.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.801+0000 7f8fdaf35640 1 --2- 172.21.15.87:0/4224513249 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8eb403bba0 0x7f8eb403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.801+0000 7f8fdd43d800 1 Processor -- start 2024-05-08T18:31:21.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.801+0000 7f8fdd43d800 1 -- start start 2024-05-08T18:31:21.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.801+0000 7f8fdaf35640 1 --2- 172.21.15.87:0/4224513249 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8eb403bba0 0x7f8eb403e060 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40017a0 tx=0x7f8fd4019ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.802+0000 7f8fdd43d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392220b20 0x563392220f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.802+0000 7f8fdd43d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5633921f1050 con 0x563392220b20 2024-05-08T18:31:21.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.802+0000 7f8fdb736640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392220b20 0x563392220f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.802+0000 7f8fdb736640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392220b20 0x563392220f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34294/0 (socket says 172.21.15.87:34294) 2024-05-08T18:31:21.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.802+0000 7f8fdb736640 1 -- 172.21.15.87:0/1300108815 learned_addr learned my addr 172.21.15.87:0/1300108815 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.802+0000 7f8fdb736640 1 -- 172.21.15.87:0/1300108815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563392221510 con 0x563392220b20 2024-05-08T18:31:21.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.802+0000 7f8fdb736640 1 --2- 172.21.15.87:0/1300108815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392220b20 0x563392220f40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc052a40 tx=0x7f8fcc014bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215faceb9b25241b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.802+0000 7f8ebe7fc640 1 -- 172.21.15.87:0/1300108815 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc0173a0 con 0x563392220b20 2024-05-08T18:31:21.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.802+0000 7f8ebe7fc640 1 -- 172.21.15.87:0/1300108815 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc017540 con 0x563392220b20 2024-05-08T18:31:21.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.802+0000 7f8ebe7fc640 1 -- 172.21.15.87:0/1300108815 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc051300 con 0x563392220b20 2024-05-08T18:31:21.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.803+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1300108815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392220b20 msgr2=0x563392220f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.803+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1300108815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392220b20 0x563392220f40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc052a40 tx=0x7f8fcc014bb0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.803+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1300108815 shutdown_connections 2024-05-08T18:31:21.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.803+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1300108815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392220b20 0x563392220f40 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.803+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1300108815 >> 172.21.15.87:0/1300108815 conn(0x56339221ce80 msgr2=0x56339221aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.803+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1300108815 shutdown_connections 2024-05-08T18:31:21.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.803+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1300108815 wait complete. 2024-05-08T18:31:21.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.803+0000 7f8fdd43d800 1 Processor -- start 2024-05-08T18:31:21.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.803+0000 7f8fdd43d800 1 -- start start 2024-05-08T18:31:21.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.803+0000 7f8fdd43d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392220b20 0x563392228140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.803+0000 7f8fdd43d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563392221c80 con 0x563392220b20 2024-05-08T18:31:21.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.803+0000 7f8fdb736640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392220b20 0x563392228140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.803+0000 7f8fdb736640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392220b20 0x563392228140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34300/0 (socket says 172.21.15.87:34300) 2024-05-08T18:31:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.803+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 learned_addr learned my addr 172.21.15.87:0/1626591300 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.804+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563392228680 con 0x563392220b20 2024-05-08T18:31:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.804+0000 7f8fdb736640 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392220b20 0x563392228140 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0076e0 tx=0x7f8fcc0529a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.804+0000 7f8ebcff9640 1 -- 172.21.15.87:0/1626591300 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc049040 con 0x563392220b20 2024-05-08T18:31:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.804+0000 7f8ebcff9640 1 -- 172.21.15.87:0/1626591300 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc054070 con 0x563392220b20 2024-05-08T18:31:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.804+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563392228910 con 0x563392220b20 2024-05-08T18:31:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.804+0000 7f8ebcff9640 1 -- 172.21.15.87:0/1626591300 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc0173a0 con 0x563392220b20 2024-05-08T18:31:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.804+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56339222b5c0 con 0x563392220b20 2024-05-08T18:31:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.805+0000 7f8ebcff9640 1 -- 172.21.15.87:0/1626591300 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8fcc054350 con 0x563392220b20 2024-05-08T18:31:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.805+0000 7f8ebcff9640 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8ea403bb50 0x7f8ea403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.805+0000 7f8ebcff9640 1 -- 172.21.15.87:0/1626591300 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8fcc035ca0 con 0x563392220b20 2024-05-08T18:31:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.805+0000 7f8fdaf35640 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8ea403bb50 0x7f8ea403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.805+0000 7f8fdaf35640 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8ea403bb50 0x7f8ea403e010 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40021b0 tx=0x7f8fd4045000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.805+0000 7f8fdd43d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.805+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563392233bd0 0x563392236090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.805+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633922367e0 con 0x563392233bd0 2024-05-08T18:31:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.806+0000 7f8fda734640 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563392233bd0 0x563392236090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.806+0000 7f8fda734640 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563392233bd0 0x563392236090 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.806+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.806+0000 7f8fdd43d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.806+0000 7f8fdd43d800 20 realm 2024-05-08T18:31:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.806+0000 7f8fdd43d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.806+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563392236bb0 con 0x563392233bd0 2024-05-08T18:31:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.806+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.806+0000 7f8fdd43d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.806+0000 7f8fdd43d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.806+0000 7f8fdd43d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.806+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563392237480 con 0x563392233bd0 2024-05-08T18:31:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.807+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.807+0000 7f8fdd43d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.807+0000 7f8fdd43d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.807+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563392237820 con 0x563392233bd0 2024-05-08T18:31:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.807+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.807+0000 7f8fdd43d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.807+0000 7f8fdd43d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.807+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563392238070 con 0x563392233bd0 2024-05-08T18:31:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.807+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.807+0000 7f8fdd43d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.807+0000 7f8fdd43d800 20 searching for the correct realm 2024-05-08T18:31:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.807+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563392239de0 0x56339223c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.807+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x563392239de0 2024-05-08T18:31:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.807+0000 7f8fdb736640 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563392239de0 0x56339223c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.807+0000 7f8fdb736640 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563392239de0 0x56339223c1d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.808+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc051070 con 0x563392239de0 2024-05-08T18:31:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.808+0000 7f8fdb736640 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8fcc021070 0x7f8fcc03da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.808+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x7f8fcc021070 2024-05-08T18:31:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.808+0000 7f8fdaf35640 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8fcc021070 0x7f8fcc03da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.808+0000 7f8fdaf35640 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8fcc021070 0x7f8fcc03da00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.809+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd4038040 con 0x7f8fcc021070 2024-05-08T18:31:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.809+0000 7f8fdaf35640 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8fd403b040 0x7f8fd403c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.809+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x7f8fd403b040 2024-05-08T18:31:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.809+0000 7f8fda734640 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8fd403b040 0x7f8fd403c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.809+0000 7f8fda734640 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8fd403b040 0x7f8fd403c8c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.810+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.810+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x563392233bd0 2024-05-08T18:31:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.810+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.810+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x563392233bd0 2024-05-08T18:31:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.810+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.810+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x7f8fd403b040 2024-05-08T18:31:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.810+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.810+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x7f8fd403b040 2024-05-08T18:31:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.810+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.810+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x7f8fcc021070 2024-05-08T18:31:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.811+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd4038040 con 0x7f8fcc021070 2024-05-08T18:31:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.811+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x563392239de0 2024-05-08T18:31:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.811+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc051070 con 0x563392239de0 2024-05-08T18:31:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.811+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x563392233bd0 2024-05-08T18:31:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.811+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.811+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x7f8fd403b040 2024-05-08T18:31:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.811+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.811+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x563392233bd0 2024-05-08T18:31:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.812+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.812+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x7f8fcc021070 2024-05-08T18:31:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.812+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8fd4038040 con 0x7f8fcc021070 2024-05-08T18:31:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.812+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x563392239de0 2024-05-08T18:31:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.812+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc051070 con 0x563392239de0 2024-05-08T18:31:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.812+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x563392239de0 2024-05-08T18:31:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.812+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc051070 con 0x563392239de0 2024-05-08T18:31:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.812+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x7f8fd403b040 2024-05-08T18:31:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.813+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.813+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x563392239de0 2024-05-08T18:31:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.813+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc051070 con 0x563392239de0 2024-05-08T18:31:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.813+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x563392239de0 2024-05-08T18:31:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.813+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc051070 con 0x563392239de0 2024-05-08T18:31:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.813+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x563392233bd0 2024-05-08T18:31:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.813+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.813+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x563392233bd0 2024-05-08T18:31:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.814+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.814+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x7f8fd403b040 2024-05-08T18:31:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.814+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.814+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x563392239de0 2024-05-08T18:31:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.814+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc051070 con 0x563392239de0 2024-05-08T18:31:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.814+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x7f8fcc021070 2024-05-08T18:31:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.814+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd4038040 con 0x7f8fcc021070 2024-05-08T18:31:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.814+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x563392233bd0 2024-05-08T18:31:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.815+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.815+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x7f8fd403b040 2024-05-08T18:31:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.815+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.815+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x563392239de0 2024-05-08T18:31:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.815+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc051070 con 0x563392239de0 2024-05-08T18:31:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.815+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x7f8fd403b040 2024-05-08T18:31:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.815+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.815+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x7f8fcc021070 2024-05-08T18:31:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.816+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd4038040 con 0x7f8fcc021070 2024-05-08T18:31:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.816+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x563392239de0 2024-05-08T18:31:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.816+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc051070 con 0x563392239de0 2024-05-08T18:31:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.816+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x7f8fd403b040 2024-05-08T18:31:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.816+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.816+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x563392233bd0 2024-05-08T18:31:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56339223c760 con 0x7f8fcc021070 2024-05-08T18:31:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd4038040 con 0x7f8fcc021070 2024-05-08T18:31:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fdd43d800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fdd43d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fdd43d800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fdd43d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fdd43d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fdd43d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fdd43d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633922389f0 con 0x563392233bd0 2024-05-08T18:31:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fdd43d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fdd43d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563392239290 con 0x563392233bd0 2024-05-08T18:31:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fdd43d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fdd43d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.817+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56339223cbe0 con 0x7f8fd403b040 2024-05-08T18:31:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.818+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.818+0000 7f8fdd43d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.818+0000 7f8fdd43d800 20 zone default found 2024-05-08T18:31:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.818+0000 7f8fdd43d800 4 Realm: () 2024-05-08T18:31:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.818+0000 7f8fdd43d800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.818+0000 7f8fdd43d800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.818+0000 7f8fdd43d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.818+0000 7f8fdd43d800 20 zonegroup default 2024-05-08T18:31:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.818+0000 7f8fdd43d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.818+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56339223d090 con 0x7f8fd403b040 2024-05-08T18:31:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.818+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.818+0000 7f8fdd43d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.818+0000 7f8fdd43d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.818+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56339223ea70 con 0x563392239de0 2024-05-08T18:31:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.818+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8fcc051070 con 0x563392239de0 2024-05-08T18:31:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.819+0000 7f8fdd43d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.819+0000 7f8fdd43d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.819+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56339223eef0 con 0x563392239de0 2024-05-08T18:31:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.819+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8fcc051070 con 0x563392239de0 2024-05-08T18:31:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.819+0000 7f8fdd43d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.819+0000 7f8fdd43d800 20 started sync module instance, tier type = 2024-05-08T18:31:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.819+0000 7f8fdd43d800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.819+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56339223df00 con 0x7f8fcc021070 2024-05-08T18:31:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.820+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd4038040 con 0x7f8fcc021070 2024-05-08T18:31:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.820+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94779495146224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56339223db60 con 0x7f8fcc021070 2024-05-08T18:31:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.820+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56339223fe20 con 0x563392233bd0 2024-05-08T18:31:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.821+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.821+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94779495146224] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd4038040 con 0x7f8fcc021070 2024-05-08T18:31:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.821+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94779495150416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5633922400e0 con 0x563392233bd0 2024-05-08T18:31:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.821+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563392240be0 con 0x563392239de0 2024-05-08T18:31:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.822+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94779495150416] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.822+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc051070 con 0x563392239de0 2024-05-08T18:31:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.822+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94779495155408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563392240ba0 con 0x563392239de0 2024-05-08T18:31:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.822+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563392241630 con 0x7f8fcc021070 2024-05-08T18:31:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.823+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94779495155408] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc051070 con 0x563392239de0 2024-05-08T18:31:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.823+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd4038040 con 0x7f8fcc021070 2024-05-08T18:31:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.823+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94779495152528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563392241a50 con 0x7f8fcc021070 2024-05-08T18:31:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.823+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563392242450 con 0x563392233bd0 2024-05-08T18:31:21.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.824+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.824+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94779495161696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563392242cf0 con 0x563392233bd0 2024-05-08T18:31:21.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.824+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563392243760 con 0x7f8fd403b040 2024-05-08T18:31:21.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.824+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94779495152528] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd4038040 con 0x7f8fcc021070 2024-05-08T18:31:21.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.825+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94779495161696] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.825+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.825+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94779495166512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5633922427c0 con 0x7f8fd403b040 2024-05-08T18:31:21.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.825+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563392244000 con 0x7f8fd403b040 2024-05-08T18:31:21.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.826+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(56 notify.6 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.826+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94779495168592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563392244320 con 0x7f8fd403b040 2024-05-08T18:31:21.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.826+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563392244b70 con 0x7f8fd403b040 2024-05-08T18:31:21.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.826+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94779495166512] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.827+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94779495168592] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.827+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.827+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94779495169648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563392244740 con 0x7f8fd403b040 2024-05-08T18:31:21.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.827+0000 7f8fdd43d800 20 add_watcher() i=0 2024-05-08T18:31:21.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.827+0000 7f8fdd43d800 20 add_watcher() i=1 2024-05-08T18:31:21.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.827+0000 7f8fdd43d800 20 add_watcher() i=2 2024-05-08T18:31:21.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.827+0000 7f8fdd43d800 20 add_watcher() i=3 2024-05-08T18:31:21.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.827+0000 7f8fdd43d800 20 add_watcher() i=4 2024-05-08T18:31:21.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.827+0000 7f8fdd43d800 20 add_watcher() i=5 2024-05-08T18:31:21.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.827+0000 7f8fdd43d800 20 add_watcher() i=6 2024-05-08T18:31:21.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.828+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94779495169648] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.828+0000 7f8fdd43d800 20 add_watcher() i=7 2024-05-08T18:31:21.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.828+0000 7f8fdd43d800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:21.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.828+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563392247900 con 0x563392233bd0 2024-05-08T18:31:21.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.828+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.828+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94779495170704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563392244b60 con 0x563392233bd0 2024-05-08T18:31:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.829+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94779495170704] v27'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.829+0000 7f8e917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.829+0000 7f8fdd43d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.829+0000 7f8fdd43d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.830+0000 7f8fdd43d800 5 note: GC not initialized 2024-05-08T18:31:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.830+0000 7f8e0bfff640 20 reqs_thread_entry: start 2024-05-08T18:31:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.830+0000 7f8fdd43d800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.830+0000 7f8fdd43d800 20 Filter name: none 2024-05-08T18:31:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.830+0000 7f8e09ffb640 20 reqs_thread_entry: start 2024-05-08T18:31:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.830+0000 7f8fdd43d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.830+0000 7f8fdd43d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.830+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56339227ae10 con 0x563392233bd0 2024-05-08T18:31:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.831+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.831+0000 7f8fdd43d800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:21.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.831+0000 7f8fdd43d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:21.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.831+0000 7f8fdd43d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:21.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.831+0000 7f8fdd43d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:21.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.831+0000 7f8fdd43d800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:31:21.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.831+0000 7f8fdd43d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.831+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56339227cd90 con 0x7f8fcc021070 2024-05-08T18:31:21.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.831+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8fd4038040 con 0x7f8fcc021070 2024-05-08T18:31:21.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.831+0000 7f8fdd43d800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:21.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.831+0000 7f8fdd43d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:31:21.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.831+0000 7f8fdd43d800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:21.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.831+0000 7f8fdd43d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 : miss 2024-05-08T18:31:21.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.831+0000 7f8fdd43d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.831+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56339227e680 con 0x563392239de0 2024-05-08T18:31:21.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.832+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f8fcc051070 con 0x563392239de0 2024-05-08T18:31:21.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.832+0000 7f8fdd43d800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:21.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.832+0000 7f8fdd43d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x17 2024-05-08T18:31:21.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.832+0000 7f8fdd43d800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:21.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.832+0000 7f8fdd43d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:21.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.832+0000 7f8fdd43d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:21.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.832+0000 7f8fdd43d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 2024-05-08T18:31:21.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.832+0000 7f8fdd43d800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-08T18:31:21.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.832+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563392282b60 con 0x7f8fd403b040 2024-05-08T18:31:21.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.833+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(65 fud.buckets [call] v27'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.833+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5633922889d0 con 0x563392239de0 2024-05-08T18:31:21.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.834+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(66 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v27'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f8fcc051070 con 0x563392239de0 2024-05-08T18:31:21.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.834+0000 7f8fdd43d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x17 2024-05-08T18:31:21.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.834+0000 7f8fdd43d800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:21.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.834+0000 7f8fdd43d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:21.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.834+0000 7f8fdd43d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1, ofs0, ns] 2024-05-08T18:31:21.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.834+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94779495407408 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563392282f90 con 0x7f8fcc021070 2024-05-08T18:31:21.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.834+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== watch-notify(notify (1) cookie 94779495146224 notify 115964117012 ret 0) ==== 794+0+0 (crc 0 0 0) 0x5633921fb750 con 0x7f8fcc021070 2024-05-08T18:31:21.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.834+0000 7f8ebe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117012 cookie 94779495146224 notifier 4515 bl.length()=752 2024-05-08T18:31:21.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.834+0000 7f8ebe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x17 2024-05-08T18:31:21.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.834+0000 7f8ebe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:21.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.834+0000 7f8ebe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:21.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.834+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(67 notify.0 [notify cookie 94779495407408 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8fd4038040 con 0x7f8fcc021070 2024-05-08T18:31:21.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.834+0000 7f8ebe7fc640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f8ea0003ea0 con 0x7f8fcc021070 2024-05-08T18:31:21.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.835+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== watch-notify(notify_complete (2) cookie 94779495407408 notify 115964117012 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8fd4061040 con 0x7f8fcc021070 2024-05-08T18:31:21.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.835+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd4038040 con 0x7f8fcc021070 2024-05-08T18:31:21.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.835+0000 7f8fdd43d800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): orig_sources= new_sources= 2024-05-08T18:31:21.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.835+0000 7f8fdd43d800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): potential sources added=[] removed=[] 2024-05-08T18:31:21.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.835+0000 7f8fdd43d800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): orig_dests= new_dests= 2024-05-08T18:31:21.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.835+0000 7f8fdd43d800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): potential dests added=[] removed=[] 2024-05-08T18:31:21.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.835+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56339227df30 con 0x7f8fcc021070 2024-05-08T18:31:21.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.836+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(69 foo.buckets [call] v27'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8fd4038040 con 0x7f8fcc021070 2024-05-08T18:31:21.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.836+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56339227df30 con 0x7f8fcc021070 2024-05-08T18:31:21.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.837+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v27'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f8fd4038040 con 0x7f8fcc021070 2024-05-08T18:31:21.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.837+0000 7f8fdd43d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:31:21.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.837+0000 7f8fdd43d800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:21.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.837+0000 7f8fdd43d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:31:21.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.837+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94779495407408 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563392287730 con 0x7f8fd403b040 2024-05-08T18:31:21.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.838+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== watch-notify(notify (1) cookie 94779495168592 notify 115964116997 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f8fc405dc70 con 0x7f8fd403b040 2024-05-08T18:31:21.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.838+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(71 notify.6 [notify cookie 94779495407408 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.838+0000 7f8ebdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 94779495168592 notifier 4515 bl.length()=314 2024-05-08T18:31:21.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.838+0000 7f8ebdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:31:21.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.838+0000 7f8ebdffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:21.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.838+0000 7f8ebdffb640 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f8e10003400 con 0x7f8fd403b040 2024-05-08T18:31:21.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.838+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== watch-notify(notify_complete (2) cookie 94779495407408 notify 115964116997 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8fc4091430 con 0x7f8fd403b040 2024-05-08T18:31:21.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.838+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.839+0000 7f8e917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:21.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.839+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94779495170704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56339227df30 con 0x563392233bd0 2024-05-08T18:31:21.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.840+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94779495170704] v27'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.840+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94779495146224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56339227df30 con 0x7f8fcc021070 2024-05-08T18:31:21.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.841+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94779495146224] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd4038040 con 0x7f8fcc021070 2024-05-08T18:31:21.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.841+0000 7f8fdd43d800 20 remove_watcher() i=0 2024-05-08T18:31:21.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.841+0000 7f8fdd43d800 2 removed watcher, disabling cache 2024-05-08T18:31:21.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.841+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94779495150416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56339223e2f0 con 0x563392233bd0 2024-05-08T18:31:21.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.842+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94779495150416] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.842+0000 7f8fdd43d800 20 remove_watcher() i=1 2024-05-08T18:31:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.842+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94779495155408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56339227df30 con 0x563392239de0 2024-05-08T18:31:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.843+0000 7f8fdb736640 1 -- 172.21.15.87:0/1626591300 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94779495155408] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc051070 con 0x563392239de0 2024-05-08T18:31:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.843+0000 7f8fdd43d800 20 remove_watcher() i=2 2024-05-08T18:31:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.843+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94779495152528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56339223f350 con 0x7f8fcc021070 2024-05-08T18:31:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.844+0000 7f8fdaf35640 1 -- 172.21.15.87:0/1626591300 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94779495152528] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd4038040 con 0x7f8fcc021070 2024-05-08T18:31:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.844+0000 7f8fdd43d800 20 remove_watcher() i=3 2024-05-08T18:31:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.844+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94779495161696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56339223e2f0 con 0x563392233bd0 2024-05-08T18:31:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.845+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94779495161696] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x563392233bd0 2024-05-08T18:31:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.845+0000 7f8fdd43d800 20 remove_watcher() i=4 2024-05-08T18:31:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.845+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94779495166512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56339223f350 con 0x7f8fd403b040 2024-05-08T18:31:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.846+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94779495166512] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.846+0000 7f8fdd43d800 20 remove_watcher() i=5 2024-05-08T18:31:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.846+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94779495168592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56339223e2f0 con 0x7f8fd403b040 2024-05-08T18:31:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.847+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94779495168592] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.847+0000 7f8fdd43d800 20 remove_watcher() i=6 2024-05-08T18:31:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.847+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94779495169648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56339223f350 con 0x7f8fd403b040 2024-05-08T18:31:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94779495169648] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc405a040 con 0x7f8fd403b040 2024-05-08T18:31:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fdd43d800 20 remove_watcher() i=7 2024-05-08T18:31:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8fd403b040 msgr2=0x7f8fd403c8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8fd403b040 0x7f8fd403c8c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563392233bd0 msgr2=0x563392236090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563392233bd0 0x563392236090 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8fcc021070 msgr2=0x7f8fcc03da00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8fcc021070 0x7f8fcc03da00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563392239de0 msgr2=0x56339223c1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563392239de0 0x56339223c1d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8ea403bb50 msgr2=0x7f8ea403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8ea403bb50 0x7f8ea403e010 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40021b0 tx=0x7f8fd4045000 comp rx=0 tx=0).stop 2024-05-08T18:31:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392220b20 msgr2=0x563392228140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1626591300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392220b20 0x563392228140 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0076e0 tx=0x7f8fcc0529a0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 reap_dead start 2024-05-08T18:31:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fda734640 1 -- 172.21.15.87:0/1626591300 reap_dead start 2024-05-08T18:31:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 shutdown_connections 2024-05-08T18:31:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 >> 172.21.15.87:0/1626591300 conn(0x56339221ce80 msgr2=0x56339221a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 shutdown_connections 2024-05-08T18:31:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.848+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1626591300 wait complete. 2024-05-08T18:31:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 -- 172.21.15.87:0/4224513249 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8eb403bba0 msgr2=0x7f8eb403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/4224513249 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8eb403bba0 0x7f8eb403e060 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40017a0 tx=0x7f8fd4019ac0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 -- 172.21.15.87:0/4224513249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392213820 msgr2=0x563392213c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/4224513249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392213820 0x563392213c40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x5633921f96d0 tx=0x7f8fcc00ef30 comp rx=0 tx=0).stop 2024-05-08T18:31:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 -- 172.21.15.87:0/4224513249 shutdown_connections 2024-05-08T18:31:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/4224513249 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8eb403bba0 0x7f8eb403e060 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/4224513249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563392213820 0x563392213c40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 -- 172.21.15.87:0/4224513249 >> 172.21.15.87:0/4224513249 conn(0x5633922078c0 msgr2=0x563392207cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 -- 172.21.15.87:0/4224513249 shutdown_connections 2024-05-08T18:31:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 -- 172.21.15.87:0/4224513249 wait complete. 2024-05-08T18:31:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1832538861 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563392202c70 msgr2=0x563392205060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563392202c70 0x563392205060 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1832538861 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5633921036c0 msgr2=0x5633921ff510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5633921036c0 0x5633921ff510 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1832538861 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8ec003bba0 msgr2=0x7f8ec003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8ec003bba0 0x7f8ec003e060 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4054000 tx=0x7f8fc404e000 comp rx=0 tx=0).stop 2024-05-08T18:31:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1832538861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633920ff2d0 msgr2=0x5633921f82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633920ff2d0 0x5633921f82d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4000f80 tx=0x7f8fd4001250 comp rx=0 tx=0).stop 2024-05-08T18:31:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1832538861 shutdown_connections 2024-05-08T18:31:21.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5633921036c0 0x5633921ff510 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563392202c70 0x563392205060 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8ec003bba0 0x7f8ec003e060 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 --2- 172.21.15.87:0/1832538861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5633920ff2d0 0x5633921f82d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1832538861 >> 172.21.15.87:0/1832538861 conn(0x5633920fa850 msgr2=0x5633921ea820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1832538861 shutdown_connections 2024-05-08T18:31:21.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.849+0000 7f8fdd43d800 1 -- 172.21.15.87:0/1832538861 wait complete. 2024-05-08T18:31:21.860 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-08T18:31:21.860 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-08T18:31:21.860 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-08T18:31:21.905 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:21.905 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:21.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.907+0000 7f9c7672c800 1 Processor -- start 2024-05-08T18:31:21.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.907+0000 7f9c7672c800 1 -- start start 2024-05-08T18:31:21.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.907+0000 7f9c7672c800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a1f4ba06a0 0x55a1f4ba2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.907+0000 7f9c7672c800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a1f4ba3060 con 0x55a1f4b9c2b0 2024-05-08T18:31:21.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.907+0000 7f9c7672c800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55a1f4a3ce20 con 0x55a1f4ba06a0 2024-05-08T18:31:21.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.908+0000 7f9c71c5c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a1f4ba06a0 0x55a1f4ba2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.908+0000 7f9c7245d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55a1f4b9c2b0 0x55a1f4b9c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42164/0 (socket says 172.21.15.87:42164) 2024-05-08T18:31:21.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.908+0000 7f9c7245d640 1 -- 172.21.15.87:0/3342590475 learned_addr learned my addr 172.21.15.87:0/3342590475 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:21.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.908+0000 7f9c71c5c640 1 -- 172.21.15.87:0/3342590475 >> v1:172.21.15.53:6789/0 conn(0x55a1f4b9c2b0 legacy=0x55a1f4b9c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.908+0000 7f9c71c5c640 1 -- 172.21.15.87:0/3342590475 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f4ba4290 con 0x55a1f4ba06a0 2024-05-08T18:31:21.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.910+0000 7f9c71c5c640 1 --2- 172.21.15.87:0/3342590475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4ba06a0 0x55a1f4ba2a90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800a470 tx=0x7f9c6801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ecb88a18dca017 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.910+0000 7f9c7145b640 1 -- 172.21.15.87:0/3342590475 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c68057070 con 0x55a1f4ba06a0 2024-05-08T18:31:21.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.910+0000 7f9c7145b640 1 -- 172.21.15.87:0/3342590475 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c68052570 con 0x55a1f4ba06a0 2024-05-08T18:31:21.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.910+0000 7f9c7145b640 1 -- 172.21.15.87:0/3342590475 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c68052870 con 0x55a1f4ba06a0 2024-05-08T18:31:21.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.911+0000 7f9c7672c800 1 -- 172.21.15.87:0/3342590475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4ba06a0 msgr2=0x55a1f4ba2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.911+0000 7f9c7672c800 1 --2- 172.21.15.87:0/3342590475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4ba06a0 0x55a1f4ba2a90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800a470 tx=0x7f9c6801ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:21.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.911+0000 7f9c7672c800 1 -- 172.21.15.87:0/3342590475 shutdown_connections 2024-05-08T18:31:21.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.911+0000 7f9c7672c800 1 --2- 172.21.15.87:0/3342590475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4ba06a0 0x55a1f4ba2a90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.911+0000 7f9c7672c800 1 -- 172.21.15.87:0/3342590475 >> 172.21.15.87:0/3342590475 conn(0x55a1f4b97830 msgr2=0x55a1f4b99c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.911+0000 7f9c7672c800 1 -- 172.21.15.87:0/3342590475 shutdown_connections 2024-05-08T18:31:21.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.911+0000 7f9c7672c800 1 -- 172.21.15.87:0/3342590475 wait complete. 2024-05-08T18:31:21.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.924+0000 7f9c7672c800 1 Processor -- start 2024-05-08T18:31:21.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.924+0000 7f9c7672c800 1 -- start start 2024-05-08T18:31:21.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.924+0000 7f9c7672c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4b9c2b0 0x55a1f4b11c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.924+0000 7f9c7672c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a1f4ae75b0 con 0x55a1f4b9c2b0 2024-05-08T18:31:21.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.925+0000 7f9c7245d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4b9c2b0 0x55a1f4b11c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.925+0000 7f9c7245d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4b9c2b0 0x55a1f4b11c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34320/0 (socket says 172.21.15.87:34320) 2024-05-08T18:31:21.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.925+0000 7f9c7245d640 1 -- 172.21.15.87:0/3878361638 learned_addr learned my addr 172.21.15.87:0/3878361638 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.925+0000 7f9c7245d640 1 -- 172.21.15.87:0/3878361638 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f4b10230 con 0x55a1f4b9c2b0 2024-05-08T18:31:21.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.925+0000 7f9c7245d640 1 --2- 172.21.15.87:0/3878361638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4b9c2b0 0x55a1f4b11c70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9c640017a0 tx=0x7f9c64001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523b8c753e18156a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.925+0000 7f9b60608640 1 -- 172.21.15.87:0/3878361638 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c64016070 con 0x55a1f4b9c2b0 2024-05-08T18:31:21.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.925+0000 7f9b60608640 1 -- 172.21.15.87:0/3878361638 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c64004520 con 0x55a1f4b9c2b0 2024-05-08T18:31:21.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.925+0000 7f9b60608640 1 -- 172.21.15.87:0/3878361638 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c64004820 con 0x55a1f4b9c2b0 2024-05-08T18:31:21.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.926+0000 7f9c7672c800 1 -- 172.21.15.87:0/3878361638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4b9c2b0 msgr2=0x55a1f4b11c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.926+0000 7f9c7672c800 1 --2- 172.21.15.87:0/3878361638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4b9c2b0 0x55a1f4b11c70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9c640017a0 tx=0x7f9c64001c60 comp rx=0 tx=0).stop 2024-05-08T18:31:21.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.926+0000 7f9c7672c800 1 -- 172.21.15.87:0/3878361638 shutdown_connections 2024-05-08T18:31:21.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.926+0000 7f9c7672c800 1 --2- 172.21.15.87:0/3878361638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4b9c2b0 0x55a1f4b11c70 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.926+0000 7f9c7672c800 1 -- 172.21.15.87:0/3878361638 >> 172.21.15.87:0/3878361638 conn(0x55a1f4b97830 msgr2=0x55a1f4c88f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.926+0000 7f9c7672c800 1 -- 172.21.15.87:0/3878361638 shutdown_connections 2024-05-08T18:31:21.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.926+0000 7f9c7672c800 1 -- 172.21.15.87:0/3878361638 wait complete. 2024-05-08T18:31:21.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.926+0000 7f9c7672c800 1 Processor -- start 2024-05-08T18:31:21.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.926+0000 7f9c7672c800 1 -- start start 2024-05-08T18:31:21.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.926+0000 7f9c7672c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4b9c2b0 0x55a1f4c97440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.926+0000 7f9c7672c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a1f4ba3530 con 0x55a1f4b9c2b0 2024-05-08T18:31:21.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.927+0000 7f9c7245d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4b9c2b0 0x55a1f4c97440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.927+0000 7f9c7245d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4b9c2b0 0x55a1f4c97440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34330/0 (socket says 172.21.15.87:34330) 2024-05-08T18:31:21.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.927+0000 7f9c7245d640 1 -- 172.21.15.87:0/1628196939 learned_addr learned my addr 172.21.15.87:0/1628196939 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.927+0000 7f9c7245d640 1 -- 172.21.15.87:0/1628196939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f4c97980 con 0x55a1f4b9c2b0 2024-05-08T18:31:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.927+0000 7f9c7245d640 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4b9c2b0 0x55a1f4c97440 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9c64000f80 tx=0x7f9c64001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.927+0000 7f9b5ee05640 1 -- 172.21.15.87:0/1628196939 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c64016040 con 0x55a1f4b9c2b0 2024-05-08T18:31:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.927+0000 7f9b5ee05640 1 -- 172.21.15.87:0/1628196939 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c64011530 con 0x55a1f4b9c2b0 2024-05-08T18:31:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.927+0000 7f9c7672c800 1 -- 172.21.15.87:0/1628196939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1f4c97c10 con 0x55a1f4b9c2b0 2024-05-08T18:31:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.927+0000 7f9b5ee05640 1 -- 172.21.15.87:0/1628196939 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c64011890 con 0x55a1f4b9c2b0 2024-05-08T18:31:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.927+0000 7f9c7672c800 1 -- 172.21.15.87:0/1628196939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1f4c9a870 con 0x55a1f4b9c2b0 2024-05-08T18:31:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.928+0000 7f9b5ee05640 1 -- 172.21.15.87:0/1628196939 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9c6401c3f0 con 0x55a1f4b9c2b0 2024-05-08T18:31:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.928+0000 7f9b5ee05640 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b5803bbf0 0x7f9b5803e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.928+0000 7f9b5ee05640 1 -- 172.21.15.87:0/1628196939 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f9c64051d20 con 0x55a1f4b9c2b0 2024-05-08T18:31:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.929+0000 7f9c71c5c640 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b5803bbf0 0x7f9b5803e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.929+0000 7f9c7672c800 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a1f4ba06a0 0x55a1f4c9e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.929+0000 7f9c7672c800 1 -- 172.21.15.87:0/1628196939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4c9ebc0 con 0x55a1f4ba06a0 2024-05-08T18:31:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.929+0000 7f9c72c5e640 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a1f4ba06a0 0x55a1f4c9e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.929+0000 7f9c71c5c640 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b5803bbf0 0x7f9b5803e0b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9c68054000 tx=0x7f9c6804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.929+0000 7f9c72c5e640 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a1f4ba06a0 0x55a1f4c9e630 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.929+0000 7f9c72c5e640 1 -- 172.21.15.87:0/1628196939 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c6c0083e0 con 0x55a1f4ba06a0 2024-05-08T18:31:21.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.929+0000 7f9c7672c800 1 -- 172.21.15.87:0/1628196939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4c9bbe0 con 0x55a1f4ba06a0 2024-05-08T18:31:21.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.930+0000 7f9c72c5e640 1 -- 172.21.15.87:0/1628196939 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c6c0083e0 con 0x55a1f4ba06a0 2024-05-08T18:31:21.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.930+0000 7f9c7672c800 1 -- 172.21.15.87:0/1628196939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4ca09e0 con 0x55a1f4ba06a0 2024-05-08T18:31:21.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.930+0000 7f9c72c5e640 1 -- 172.21.15.87:0/1628196939 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9c6c0083e0 con 0x55a1f4ba06a0 2024-05-08T18:31:21.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.930+0000 7f9c7672c800 1 -- 172.21.15.87:0/1628196939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4c9fc10 con 0x55a1f4ba06a0 2024-05-08T18:31:21.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.930+0000 7f9c72c5e640 1 -- 172.21.15.87:0/1628196939 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c6c0083e0 con 0x55a1f4ba06a0 2024-05-08T18:31:21.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.930+0000 7f9c7672c800 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a1f4ca1d90 0x55a1f4ca4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.930+0000 7f9c7672c800 1 -- 172.21.15.87:0/1628196939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4ca46c0 con 0x55a1f4ca1d90 2024-05-08T18:31:21.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.930+0000 7f9c7245d640 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a1f4ca1d90 0x55a1f4ca4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.931+0000 7f9c7245d640 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a1f4ca1d90 0x55a1f4ca4180 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.931+0000 7f9c7245d640 1 -- 172.21.15.87:0/1628196939 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9c64019050 con 0x55a1f4ca1d90 2024-05-08T18:31:21.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.931+0000 7f9c7672c800 1 Processor -- start 2024-05-08T18:31:21.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.931+0000 7f9c7672c800 1 -- start start 2024-05-08T18:31:21.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.932+0000 7f9c7672c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cb2940 0x55a1f4cb2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.932+0000 7f9c7672c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a1f4a8dfc0 con 0x55a1f4cb2940 2024-05-08T18:31:21.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.932+0000 7f9c72c5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cb2940 0x55a1f4cb2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.932+0000 7f9c72c5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cb2940 0x55a1f4cb2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34334/0 (socket says 172.21.15.87:34334) 2024-05-08T18:31:21.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.932+0000 7f9c72c5e640 1 -- 172.21.15.87:0/3921966212 learned_addr learned my addr 172.21.15.87:0/3921966212 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.932+0000 7f9c72c5e640 1 -- 172.21.15.87:0/3921966212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f4cb32a0 con 0x55a1f4cb2940 2024-05-08T18:31:21.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.932+0000 7f9c72c5e640 1 --2- 172.21.15.87:0/3921966212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cb2940 0x55a1f4cb2d60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x55a1f4c987f0 tx=0x7f9c6c00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.932+0000 7f9b57fff640 1 -- 172.21.15.87:0/3921966212 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c6c01c070 con 0x55a1f4cb2940 2024-05-08T18:31:21.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.932+0000 7f9b57fff640 1 -- 172.21.15.87:0/3921966212 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c6c00bdc0 con 0x55a1f4cb2940 2024-05-08T18:31:21.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.932+0000 7f9b57fff640 1 -- 172.21.15.87:0/3921966212 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c6c018540 con 0x55a1f4cb2940 2024-05-08T18:31:21.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.932+0000 7f9c7672c800 1 -- 172.21.15.87:0/3921966212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1f4cb3d10 con 0x55a1f4cb2940 2024-05-08T18:31:21.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.933+0000 7f9c7672c800 1 -- 172.21.15.87:0/3921966212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1f4cb4210 con 0x55a1f4cb2940 2024-05-08T18:31:21.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.933+0000 7f9b57fff640 1 -- 172.21.15.87:0/3921966212 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9c6c01f070 con 0x55a1f4cb2940 2024-05-08T18:31:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.933+0000 7f9b57fff640 1 --2- 172.21.15.87:0/3921966212 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b4c03bba0 0x7f9b4c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.933+0000 7f9b57fff640 1 -- 172.21.15.87:0/3921966212 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f9c6c0546e0 con 0x55a1f4cb2940 2024-05-08T18:31:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.934+0000 7f9c7245d640 1 --2- 172.21.15.87:0/3921966212 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b4c03bba0 0x7f9b4c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.934+0000 7f9c7672c800 1 Processor -- start 2024-05-08T18:31:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.934+0000 7f9c7672c800 1 -- start start 2024-05-08T18:31:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.934+0000 7f9c7245d640 1 --2- 172.21.15.87:0/3921966212 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b4c03bba0 0x7f9b4c03e060 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9c64019fd0 tx=0x7f9c64019520 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.934+0000 7f9c7672c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cbfc40 0x55a1f4cc0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.934+0000 7f9c7672c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a1f4b105b0 con 0x55a1f4cbfc40 2024-05-08T18:31:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.934+0000 7f9c72c5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cbfc40 0x55a1f4cc0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.934+0000 7f9c72c5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cbfc40 0x55a1f4cc0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34344/0 (socket says 172.21.15.87:34344) 2024-05-08T18:31:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.934+0000 7f9c72c5e640 1 -- 172.21.15.87:0/454088459 learned_addr learned my addr 172.21.15.87:0/454088459 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.934+0000 7f9c72c5e640 1 -- 172.21.15.87:0/454088459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f4cc0630 con 0x55a1f4cbfc40 2024-05-08T18:31:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.935+0000 7f9c72c5e640 1 --2- 172.21.15.87:0/454088459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cbfc40 0x55a1f4cc0060 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c052a40 tx=0x7f9c6c014bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce310142add2c8b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.935+0000 7f9b55ffb640 1 -- 172.21.15.87:0/454088459 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c6c0173a0 con 0x55a1f4cbfc40 2024-05-08T18:31:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.935+0000 7f9b55ffb640 1 -- 172.21.15.87:0/454088459 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c6c017540 con 0x55a1f4cbfc40 2024-05-08T18:31:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.935+0000 7f9b55ffb640 1 -- 172.21.15.87:0/454088459 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c6c051300 con 0x55a1f4cbfc40 2024-05-08T18:31:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.935+0000 7f9c7672c800 1 -- 172.21.15.87:0/454088459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cbfc40 msgr2=0x55a1f4cc0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.935+0000 7f9c7672c800 1 --2- 172.21.15.87:0/454088459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cbfc40 0x55a1f4cc0060 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c052a40 tx=0x7f9c6c014bb0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.935+0000 7f9c7672c800 1 -- 172.21.15.87:0/454088459 shutdown_connections 2024-05-08T18:31:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.935+0000 7f9c7672c800 1 --2- 172.21.15.87:0/454088459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cbfc40 0x55a1f4cc0060 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.935+0000 7f9c7672c800 1 -- 172.21.15.87:0/454088459 >> 172.21.15.87:0/454088459 conn(0x55a1f4cbbfa0 msgr2=0x55a1f4cba000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.935+0000 7f9c7672c800 1 -- 172.21.15.87:0/454088459 shutdown_connections 2024-05-08T18:31:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.935+0000 7f9c7672c800 1 -- 172.21.15.87:0/454088459 wait complete. 2024-05-08T18:31:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.935+0000 7f9c7672c800 1 Processor -- start 2024-05-08T18:31:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.935+0000 7f9c7672c800 1 -- start start 2024-05-08T18:31:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.936+0000 7f9c7672c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cbfc40 0x55a1f4cc7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.936+0000 7f9c7672c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a1f4cc0da0 con 0x55a1f4cbfc40 2024-05-08T18:31:21.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.936+0000 7f9c72c5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cbfc40 0x55a1f4cc7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.936+0000 7f9c72c5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cbfc40 0x55a1f4cc7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34350/0 (socket says 172.21.15.87:34350) 2024-05-08T18:31:21.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.936+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 learned_addr learned my addr 172.21.15.87:0/4292421935 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:21.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.936+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f4cc77a0 con 0x55a1f4cbfc40 2024-05-08T18:31:21.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.936+0000 7f9c72c5e640 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cbfc40 0x55a1f4cc7260 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0076e0 tx=0x7f9c6c0529a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.937+0000 7f9b43fff640 1 -- 172.21.15.87:0/4292421935 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c6c049040 con 0x55a1f4cbfc40 2024-05-08T18:31:21.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.937+0000 7f9b43fff640 1 -- 172.21.15.87:0/4292421935 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c6c054070 con 0x55a1f4cbfc40 2024-05-08T18:31:21.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.937+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1f4cc7a30 con 0x55a1f4cbfc40 2024-05-08T18:31:21.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.937+0000 7f9b43fff640 1 -- 172.21.15.87:0/4292421935 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c6c0173a0 con 0x55a1f4cbfc40 2024-05-08T18:31:21.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.937+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1f4cca6e0 con 0x55a1f4cbfc40 2024-05-08T18:31:21.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.937+0000 7f9b43fff640 1 -- 172.21.15.87:0/4292421935 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9c6c054350 con 0x55a1f4cbfc40 2024-05-08T18:31:21.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.938+0000 7f9b43fff640 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b3c03bb50 0x7f9b3c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.938+0000 7f9b43fff640 1 -- 172.21.15.87:0/4292421935 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f9c6c035ca0 con 0x55a1f4cbfc40 2024-05-08T18:31:21.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.938+0000 7f9c7245d640 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b3c03bb50 0x7f9b3c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.938+0000 7f9c7245d640 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b3c03bb50 0x7f9b3c03e010 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9c640021b0 tx=0x7f9c64045000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.938+0000 7f9c7672c800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.938+0000 7f9c7672c800 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a1f4cd2cf0 0x55a1f4cd51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.938+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cd5900 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.938+0000 7f9c71c5c640 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a1f4cd2cf0 0x55a1f4cd51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.939+0000 7f9c71c5c640 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a1f4cd2cf0 0x55a1f4cd51b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.939+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.939+0000 7f9c7672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.939+0000 7f9c7672c800 20 realm 2024-05-08T18:31:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.939+0000 7f9c7672c800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.939+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cd5cd0 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.939+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.939+0000 7f9c7672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.939+0000 7f9c7672c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.939+0000 7f9c7672c800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.939+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cd65a0 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.939+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.939+0000 7f9c7672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.939+0000 7f9c7672c800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.939+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cd6940 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.940+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.940+0000 7f9c7672c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.940+0000 7f9c7672c800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.940+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cd7190 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.940+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.940+0000 7f9c7672c800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.940+0000 7f9c7672c800 20 searching for the correct realm 2024-05-08T18:31:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.940+0000 7f9c7672c800 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a1f4cd8f00 0x55a1f4cdb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.940+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x55a1f4cd8f00 2024-05-08T18:31:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.940+0000 7f9c72c5e640 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a1f4cd8f00 0x55a1f4cdb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.940+0000 7f9c72c5e640 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a1f4cd8f00 0x55a1f4cdb2f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.941+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.941+0000 7f9c72c5e640 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9c6c021070 0x7f9c6c03da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.941+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x7f9c6c021070 2024-05-08T18:31:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.941+0000 7f9c7245d640 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9c6c021070 0x7f9c6c03da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.941+0000 7f9c7245d640 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9c6c021070 0x7f9c6c03da00 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.941+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.941+0000 7f9c7245d640 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f9c6403b040 0x7f9c6403c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.941+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x7f9c6403b040 2024-05-08T18:31:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.942+0000 7f9c71c5c640 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f9c6403b040 0x7f9c6403c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.942+0000 7f9c71c5c640 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f9c6403b040 0x7f9c6403c8c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.942+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.942+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.942+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.942+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.943+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.943+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x7f9c6403b040 2024-05-08T18:31:21.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.943+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.943+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x7f9c6403b040 2024-05-08T18:31:21.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.943+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.943+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x7f9c6c021070 2024-05-08T18:31:21.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.943+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:21.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.943+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x55a1f4cd8f00 2024-05-08T18:31:21.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.943+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.943+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.944+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.944+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x7f9c6403b040 2024-05-08T18:31:21.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.944+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.944+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.944+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.944+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x7f9c6c021070 2024-05-08T18:31:21.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.944+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:21.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.944+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x55a1f4cd8f00 2024-05-08T18:31:21.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.945+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.945+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x55a1f4cd8f00 2024-05-08T18:31:21.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.945+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.945+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x7f9c6403b040 2024-05-08T18:31:21.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.946+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.946+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x55a1f4cd8f00 2024-05-08T18:31:21.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.946+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.946+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x55a1f4cd8f00 2024-05-08T18:31:21.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.946+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.946+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.946+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.946+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.947+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.947+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x7f9c6403b040 2024-05-08T18:31:21.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.947+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.947+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x55a1f4cd8f00 2024-05-08T18:31:21.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.947+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.947+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x7f9c6c021070 2024-05-08T18:31:21.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.947+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.947+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.948+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.948+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x7f9c6403b040 2024-05-08T18:31:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.948+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.948+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x55a1f4cd8f00 2024-05-08T18:31:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.948+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.948+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x7f9c6403b040 2024-05-08T18:31:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.949+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.949+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x7f9c6c021070 2024-05-08T18:31:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.949+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.949+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x55a1f4cd8f00 2024-05-08T18:31:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.949+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.949+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x7f9c6403b040 2024-05-08T18:31:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.949+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.949+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdb880 con 0x7f9c6c021070 2024-05-08T18:31:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c7672c800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c7672c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c7672c800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c7672c800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c7672c800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c7672c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c7672c800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cd7b10 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c7672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c7672c800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cd83b0 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c7672c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c7672c800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.950+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdbd00 con 0x7f9c6403b040 2024-05-08T18:31:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c7672c800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c7672c800 20 zone default found 2024-05-08T18:31:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c7672c800 4 Realm: () 2024-05-08T18:31:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c7672c800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c7672c800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c7672c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c7672c800 20 zonegroup default 2024-05-08T18:31:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c7672c800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdc1b0 con 0x7f9c6403b040 2024-05-08T18:31:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c7672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c7672c800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cddb90 con 0x55a1f4cd8f00 2024-05-08T18:31:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c7672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c7672c800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.951+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cde090 con 0x55a1f4cd8f00 2024-05-08T18:31:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.952+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.952+0000 7f9c7672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.952+0000 7f9c7672c800 20 started sync module instance, tier type = 2024-05-08T18:31:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.952+0000 7f9c7672c800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.952+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdd020 con 0x7f9c6c021070 2024-05-08T18:31:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.953+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.953+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94154085225488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdcc80 con 0x7f9c6c021070 2024-05-08T18:31:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.953+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdefc0 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.954+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94154085225488] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.954+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.954+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94154085231376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdf3e0 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.954+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdfda0 con 0x55a1f4cd8f00 2024-05-08T18:31:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.955+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.955+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94154085234928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdfd50 con 0x55a1f4cd8f00 2024-05-08T18:31:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.955+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4ce0d50 con 0x7f9c6c021070 2024-05-08T18:31:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.955+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94154085231376] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.956+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94154085234928] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.956+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.956+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94154085237136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4ce0860 con 0x7f9c6c021070 2024-05-08T18:31:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.956+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4ce1760 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.957+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.957+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94154085241792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4ce1e10 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.957+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4ce2930 con 0x7f9c6403b040 2024-05-08T18:31:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.957+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94154085237136] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.958+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94154085241792] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.958+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.958+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94154085245952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4ce28f0 con 0x7f9c6403b040 2024-05-08T18:31:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.958+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4ce31d0 con 0x7f9c6403b040 2024-05-08T18:31:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.959+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(56 notify.6 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.959+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94154085248288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4ce28f0 con 0x7f9c6403b040 2024-05-08T18:31:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.959+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4ce3d40 con 0x7f9c6403b040 2024-05-08T18:31:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.959+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94154085245952] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.960+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94154085248288] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.960+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.960+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94154085249344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdef30 con 0x7f9c6403b040 2024-05-08T18:31:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.960+0000 7f9c7672c800 20 add_watcher() i=0 2024-05-08T18:31:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.960+0000 7f9c7672c800 20 add_watcher() i=1 2024-05-08T18:31:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.960+0000 7f9c7672c800 20 add_watcher() i=2 2024-05-08T18:31:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.960+0000 7f9c7672c800 20 add_watcher() i=3 2024-05-08T18:31:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.960+0000 7f9c7672c800 20 add_watcher() i=4 2024-05-08T18:31:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.960+0000 7f9c7672c800 20 add_watcher() i=5 2024-05-08T18:31:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.960+0000 7f9c7672c800 20 add_watcher() i=6 2024-05-08T18:31:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.961+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94154085249344] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.961+0000 7f9c7672c800 20 add_watcher() i=7 2024-05-08T18:31:21.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.961+0000 7f9c7672c800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:21.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.961+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4ce6d30 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.961+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.961+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94154085251088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4ce41b0 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.962+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94154085251088] v27'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.963+0000 7f9b28fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:21.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.963+0000 7f9c7672c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:21.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.963+0000 7f9c7672c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:21.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.963+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cef4c0 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.964+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.964+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cefb10 con 0x7f9c6403b040 2024-05-08T18:31:21.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.965+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.965+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4ceff70 con 0x55a1f4cd8f00 2024-05-08T18:31:21.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.966+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.966+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cefe90 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.967+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'122 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.967+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0480 con 0x7f9c6c021070 2024-05-08T18:31:21.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.968+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:21.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.968+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf09f0 con 0x55a1f4cd8f00 2024-05-08T18:31:21.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.969+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.969+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf09f0 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.970+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.970+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf09f0 con 0x7f9c6403b040 2024-05-08T18:31:21.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.971+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.971+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf09f0 con 0x7f9c6c021070 2024-05-08T18:31:21.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.972+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:21.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.972+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x55a1f4cd8f00 2024-05-08T18:31:21.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.973+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.973+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x7f9c6c021070 2024-05-08T18:31:21.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.974+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:21.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.974+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x7f9c6403b040 2024-05-08T18:31:21.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.976+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.976+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x7f9c6c021070 2024-05-08T18:31:21.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.977+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:21.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.977+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x7f9c6403b040 2024-05-08T18:31:21.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.978+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'29 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.978+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.979+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'123 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.979+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x55a1f4cd8f00 2024-05-08T18:31:21.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.980+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.980+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x7f9c6c021070 2024-05-08T18:31:21.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.981+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:21.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.981+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x55a1f4cd8f00 2024-05-08T18:31:21.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.982+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.982+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.983+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.983+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.984+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'124 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:21.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.984+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x55a1f4cd8f00 2024-05-08T18:31:21.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.985+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.985+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x7f9c6c021070 2024-05-08T18:31:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.986+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.986+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x55a1f4cd8f00 2024-05-08T18:31:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.987+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.987+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x55a1f4cd8f00 2024-05-08T18:31:21.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.988+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.988+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x55a1f4cd8f00 2024-05-08T18:31:21.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.989+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.989+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x55a1f4cd8f00 2024-05-08T18:31:21.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.990+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.990+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x7f9c6403b040 2024-05-08T18:31:21.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.991+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.991+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x55a1f4cd8f00 2024-05-08T18:31:21.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.992+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.992+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x7f9c6403b040 2024-05-08T18:31:21.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.993+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.993+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x55a1f4cd8f00 2024-05-08T18:31:21.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.994+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'31 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.994+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x7f9c6403b040 2024-05-08T18:31:21.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.995+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.995+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cf0fa0 con 0x7f9c6c021070 2024-05-08T18:31:21.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.996+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:21.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.996+0000 7f9aa37fe640 20 reqs_thread_entry: start 2024-05-08T18:31:21.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.996+0000 7f9c7672c800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:21.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.997+0000 7f9c7672c800 20 Filter name: none 2024-05-08T18:31:21.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.997+0000 7f9aa17fa640 20 reqs_thread_entry: start 2024-05-08T18:31:21.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.997+0000 7f9c7672c800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:31:21.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.997+0000 7f9c7672c800 20 rados->read ofs=0 len=0 2024-05-08T18:31:21.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.997+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4d1bf10 con 0x7f9c6403b040 2024-05-08T18:31:21.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.997+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.997+0000 7f9c7672c800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:31:21.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.997+0000 7f9c7672c800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T18:31:21.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.997+0000 7f9c7672c800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:31:21.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.997+0000 7f9c7672c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:21.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.997+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4d1e840 con 0x7f9c6403b040 2024-05-08T18:31:21.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.998+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.998+0000 7f9c7672c800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-08T18:31:21.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.998+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4d1c820 con 0x7f9c6403b040 2024-05-08T18:31:21.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.999+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v27'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:21.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.999+0000 7f9c7672c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:31:21.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.999+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94154085487408 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4d1eeb0 con 0x55a1f4cd8f00 2024-05-08T18:31:21.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.999+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== watch-notify(notify (1) cookie 94154085234928 notify 115964116995 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55a1f4ceef50 con 0x55a1f4cd8f00 2024-05-08T18:31:21.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.999+0000 7f9b55ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 94154085234928 notifier 4522 bl.length()=170 2024-05-08T18:31:21.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.999+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 27 ==== osd_op_reply(97 notify.2 [notify cookie 94154085487408 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.999+0000 7f9b55ffb640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f9b38003d60 con 0x55a1f4cd8f00 2024-05-08T18:31:21.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.999+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:21.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.999+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 29 ==== watch-notify(notify_complete (2) cookie 94154085487408 notify 115964116995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a1f4cc77a0 con 0x55a1f4cd8f00 2024-05-08T18:31:21.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.999+0000 7f9c7672c800 10 removing email index: 2024-05-08T18:31:21.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.999+0000 7f9c7672c800 10 removing user buckets index 2024-05-08T18:31:21.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:21.999+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4d1edb0 con 0x7f9c6403b040 2024-05-08T18:31:22.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.001+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(99 fud.buckets [delete] v27'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:22.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.001+0000 7f9c7672c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-05-08T18:31:22.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.001+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94154085492992 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4d1e340 con 0x7f9c6403b040 2024-05-08T18:31:22.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.001+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 29 ==== watch-notify(notify (1) cookie 94154085248288 notify 115964116998 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55a1f4cefb10 con 0x7f9c6403b040 2024-05-08T18:31:22.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.001+0000 7f9b557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116998 cookie 94154085248288 notifier 4522 bl.length()=160 2024-05-08T18:31:22.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.001+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 30 ==== osd_op_reply(100 notify.6 [notify cookie 94154085492992 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:22.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.001+0000 7f9b557fa640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f9aa80032c0 con 0x7f9c6403b040 2024-05-08T18:31:22.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.001+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 31 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:22.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.001+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 32 ==== watch-notify(notify_complete (2) cookie 94154085492992 notify 115964116998 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a1f4cc7a30 con 0x7f9c6403b040 2024-05-08T18:31:22.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.001+0000 7f9c7672c800 10 removing user index: fud 2024-05-08T18:31:22.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.001+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4d1e4a0 con 0x7f9c6403b040 2024-05-08T18:31:22.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.002+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 33 ==== osd_op_reply(102 fud [call,call,delete] v27'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:22.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.002+0000 7f9c7672c800 10 removing default.rgw.meta+users.uid+fud from cache 2024-05-08T18:31:22.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.002+0000 7f9c7672c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-08T18:31:22.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.002+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94154085491872 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4d1d330 con 0x7f9c6403b040 2024-05-08T18:31:22.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.002+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 34 ==== watch-notify(notify (1) cookie 94154085245952 notify 115964116999 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55a1f4cc7a30 con 0x7f9c6403b040 2024-05-08T18:31:22.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.002+0000 7f9b557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116999 cookie 94154085245952 notifier 4522 bl.length()=152 2024-05-08T18:31:22.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.002+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 35 ==== osd_op_reply(103 notify.5 [notify cookie 94154085491872 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:22.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.002+0000 7f9b557fa640 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f9aa8003260 con 0x7f9c6403b040 2024-05-08T18:31:22.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.003+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 36 ==== watch-notify(notify_complete (2) cookie 94154085491872 notify 115964116999 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a1f4cef690 con 0x7f9c6403b040 2024-05-08T18:31:22.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.003+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 37 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:22.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.004+0000 7f9b28fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:22.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.004+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94154085251088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4d1e4a0 con 0x55a1f4cd2cf0 2024-05-08T18:31:22.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.005+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94154085251088] v27'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:22.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.005+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94154085225488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4d1e4a0 con 0x7f9c6c021070 2024-05-08T18:31:22.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.006+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94154085225488] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:22.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.006+0000 7f9c7672c800 20 remove_watcher() i=0 2024-05-08T18:31:22.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.006+0000 7f9c7672c800 2 removed watcher, disabling cache 2024-05-08T18:31:22.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.006+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94154085231376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdd410 con 0x55a1f4cd2cf0 2024-05-08T18:31:22.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.007+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94154085231376] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:22.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.007+0000 7f9c7672c800 20 remove_watcher() i=1 2024-05-08T18:31:22.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.007+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94154085234928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4d1e4a0 con 0x55a1f4cd8f00 2024-05-08T18:31:22.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.007+0000 7f9c72c5e640 1 -- 172.21.15.87:0/4292421935 <== osd.3 v2:172.21.15.87:6800/2929215285 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94154085234928] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6c051070 con 0x55a1f4cd8f00 2024-05-08T18:31:22.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.007+0000 7f9c7672c800 20 remove_watcher() i=2 2024-05-08T18:31:22.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.007+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94154085237136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdeb10 con 0x7f9c6c021070 2024-05-08T18:31:22.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.008+0000 7f9c7245d640 1 -- 172.21.15.87:0/4292421935 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94154085237136] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64038040 con 0x7f9c6c021070 2024-05-08T18:31:22.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.008+0000 7f9c7672c800 20 remove_watcher() i=3 2024-05-08T18:31:22.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.008+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94154085241792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdd410 con 0x55a1f4cd2cf0 2024-05-08T18:31:22.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.009+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94154085241792] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x55a1f4cd2cf0 2024-05-08T18:31:22.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.009+0000 7f9c7672c800 20 remove_watcher() i=4 2024-05-08T18:31:22.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.009+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94154085245952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4ce0190 con 0x7f9c6403b040 2024-05-08T18:31:22.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.010+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94154085245952] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:22.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.010+0000 7f9c7672c800 20 remove_watcher() i=5 2024-05-08T18:31:22.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.010+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94154085248288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4cdeb10 con 0x7f9c6403b040 2024-05-08T18:31:22.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.011+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94154085248288] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:22.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.011+0000 7f9c7672c800 20 remove_watcher() i=6 2024-05-08T18:31:22.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.011+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94154085249344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a1f4ce13c0 con 0x7f9c6403b040 2024-05-08T18:31:22.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 <== osd.0 v2:172.21.15.53:6800/443747735 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94154085249344] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6805a040 con 0x7f9c6403b040 2024-05-08T18:31:22.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c7672c800 20 remove_watcher() i=7 2024-05-08T18:31:22.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f9c6403b040 msgr2=0x7f9c6403c8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c7672c800 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f9c6403b040 0x7f9c6403c8c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a1f4cd2cf0 msgr2=0x55a1f4cd51b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c7672c800 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a1f4cd2cf0 0x55a1f4cd51b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9c6c021070 msgr2=0x7f9c6c03da00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c7672c800 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9c6c021070 0x7f9c6c03da00 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a1f4cd8f00 msgr2=0x55a1f4cdb2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c7672c800 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55a1f4cd8f00 0x55a1f4cdb2f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b3c03bb50 msgr2=0x7f9b3c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c7672c800 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b3c03bb50 0x7f9b3c03e010 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9c640021b0 tx=0x7f9c64045000 comp rx=0 tx=0).stop 2024-05-08T18:31:22.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cbfc40 msgr2=0x55a1f4cc7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c7672c800 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cbfc40 0x55a1f4cc7260 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0076e0 tx=0x7f9c6c0529a0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c71c5c640 1 -- 172.21.15.87:0/4292421935 reap_dead start 2024-05-08T18:31:22.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 shutdown_connections 2024-05-08T18:31:22.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c7672c800 1 --2- 172.21.15.87:0/4292421935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cbfc40 0x55a1f4cc7260 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.012+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 >> 172.21.15.87:0/4292421935 conn(0x55a1f4cbbfa0 msgr2=0x55a1f4cb9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 shutdown_connections 2024-05-08T18:31:22.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 -- 172.21.15.87:0/4292421935 wait complete. 2024-05-08T18:31:22.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 -- 172.21.15.87:0/3921966212 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b4c03bba0 msgr2=0x7f9b4c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 --2- 172.21.15.87:0/3921966212 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b4c03bba0 0x7f9b4c03e060 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9c64019fd0 tx=0x7f9c64019520 comp rx=0 tx=0).stop 2024-05-08T18:31:22.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 -- 172.21.15.87:0/3921966212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cb2940 msgr2=0x55a1f4cb2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 --2- 172.21.15.87:0/3921966212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cb2940 0x55a1f4cb2d60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x55a1f4c987f0 tx=0x7f9c6c00ef30 comp rx=0 tx=0).stop 2024-05-08T18:31:22.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 -- 172.21.15.87:0/3921966212 shutdown_connections 2024-05-08T18:31:22.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 --2- 172.21.15.87:0/3921966212 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b4c03bba0 0x7f9b4c03e060 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 --2- 172.21.15.87:0/3921966212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4cb2940 0x55a1f4cb2d60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 -- 172.21.15.87:0/3921966212 >> 172.21.15.87:0/3921966212 conn(0x55a1f4ca69e0 msgr2=0x55a1f4ca6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 -- 172.21.15.87:0/3921966212 shutdown_connections 2024-05-08T18:31:22.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 -- 172.21.15.87:0/3921966212 wait complete. 2024-05-08T18:31:22.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 -- 172.21.15.87:0/1628196939 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a1f4ca1d90 msgr2=0x55a1f4ca4180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a1f4ca1d90 0x55a1f4ca4180 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 -- 172.21.15.87:0/1628196939 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a1f4ba06a0 msgr2=0x55a1f4c9e630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a1f4ba06a0 0x55a1f4c9e630 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 -- 172.21.15.87:0/1628196939 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b5803bbf0 msgr2=0x7f9b5803e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b5803bbf0 0x7f9b5803e0b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9c68054000 tx=0x7f9c6804e000 comp rx=0 tx=0).stop 2024-05-08T18:31:22.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 -- 172.21.15.87:0/1628196939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4b9c2b0 msgr2=0x55a1f4c97440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4b9c2b0 0x55a1f4c97440 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9c64000f80 tx=0x7f9c64001250 comp rx=0 tx=0).stop 2024-05-08T18:31:22.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 -- 172.21.15.87:0/1628196939 shutdown_connections 2024-05-08T18:31:22.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55a1f4ba06a0 0x55a1f4c9e630 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55a1f4ca1d90 0x55a1f4ca4180 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b5803bbf0 0x7f9b5803e0b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 --2- 172.21.15.87:0/1628196939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1f4b9c2b0 0x55a1f4c97440 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 -- 172.21.15.87:0/1628196939 >> 172.21.15.87:0/1628196939 conn(0x55a1f4b97830 msgr2=0x55a1f4b10b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 -- 172.21.15.87:0/1628196939 shutdown_connections 2024-05-08T18:31:22.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.013+0000 7f9c7672c800 1 -- 172.21.15.87:0/1628196939 wait complete. 2024-05-08T18:31:22.020 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-08T18:31:22.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-08T18:31:22.021 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-05-08T18:31:22.074 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:22.074 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:22.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.077+0000 7feab951f800 1 Processor -- start 2024-05-08T18:31:22.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.077+0000 7feab951f800 1 -- start start 2024-05-08T18:31:22.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.077+0000 7feab951f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560d2d8e8ba0 0x560d2d8e8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.077+0000 7feab951f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560d2d85d690 con 0x560d2d8e9500 2024-05-08T18:31:22.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.077+0000 7feab951f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x560d2d78ae20 con 0x560d2d8e8ba0 2024-05-08T18:31:22.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.078+0000 7feab51e0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560d2d8e8ba0 0x560d2d8e8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.078+0000 7feab49df640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x560d2d8e9500 0x560d2d8e99b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42168/0 (socket says 172.21.15.87:42168) 2024-05-08T18:31:22.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.078+0000 7feab49df640 1 -- 172.21.15.87:0/4124710025 learned_addr learned my addr 172.21.15.87:0/4124710025 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:22.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.078+0000 7feab51e0640 1 -- 172.21.15.87:0/4124710025 >> v1:172.21.15.53:6789/0 conn(0x560d2d8e9500 legacy=0x560d2d8e99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.078+0000 7feab51e0640 1 -- 172.21.15.87:0/4124710025 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d2d8ea0c0 con 0x560d2d8e8ba0 2024-05-08T18:31:22.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.080+0000 7feab51e0640 1 --2- 172.21.15.87:0/4124710025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e8ba0 0x560d2d8e8fc0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7feaa800a470 tx=0x7feaa801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63bb43e3a81e447 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.080+0000 7feaa7fff640 1 -- 172.21.15.87:0/4124710025 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaa8057070 con 0x560d2d8e8ba0 2024-05-08T18:31:22.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.080+0000 7feaa7fff640 1 -- 172.21.15.87:0/4124710025 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa8052570 con 0x560d2d8e8ba0 2024-05-08T18:31:22.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.080+0000 7feaa7fff640 1 -- 172.21.15.87:0/4124710025 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaa8052870 con 0x560d2d8e8ba0 2024-05-08T18:31:22.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.080+0000 7feab951f800 1 -- 172.21.15.87:0/4124710025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e8ba0 msgr2=0x560d2d8e8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.080+0000 7feab951f800 1 --2- 172.21.15.87:0/4124710025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e8ba0 0x560d2d8e8fc0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7feaa800a470 tx=0x7feaa801ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:22.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.080+0000 7feab951f800 1 -- 172.21.15.87:0/4124710025 shutdown_connections 2024-05-08T18:31:22.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.080+0000 7feab951f800 1 --2- 172.21.15.87:0/4124710025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e8ba0 0x560d2d8e8fc0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.080+0000 7feab951f800 1 -- 172.21.15.87:0/4124710025 >> 172.21.15.87:0/4124710025 conn(0x560d2d8e4760 msgr2=0x560d2d8e6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.080+0000 7feab951f800 1 -- 172.21.15.87:0/4124710025 shutdown_connections 2024-05-08T18:31:22.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.080+0000 7feab951f800 1 -- 172.21.15.87:0/4124710025 wait complete. 2024-05-08T18:31:22.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.093+0000 7feab951f800 1 Processor -- start 2024-05-08T18:31:22.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.094+0000 7feab951f800 1 -- start start 2024-05-08T18:31:22.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.094+0000 7feab951f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e8ba0 0x560d2d9ddb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.094+0000 7feab951f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560d2d8356b0 con 0x560d2d8e8ba0 2024-05-08T18:31:22.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.094+0000 7feab51e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e8ba0 0x560d2d9ddb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.094+0000 7feab51e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e8ba0 0x560d2d9ddb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34366/0 (socket says 172.21.15.87:34366) 2024-05-08T18:31:22.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.094+0000 7feab51e0640 1 -- 172.21.15.87:0/2816475074 learned_addr learned my addr 172.21.15.87:0/2816475074 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.094+0000 7feab51e0640 1 -- 172.21.15.87:0/2816475074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d2d9de140 con 0x560d2d8e8ba0 2024-05-08T18:31:22.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.094+0000 7feab51e0640 1 --2- 172.21.15.87:0/2816475074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e8ba0 0x560d2d9ddb70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7feaa8055040 tx=0x7feaa804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a8fc393beaacfe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.094+0000 7fe9a3606640 1 -- 172.21.15.87:0/2816475074 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaa8057040 con 0x560d2d8e8ba0 2024-05-08T18:31:22.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.095+0000 7fe9a3606640 1 -- 172.21.15.87:0/2816475074 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa8052990 con 0x560d2d8e8ba0 2024-05-08T18:31:22.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.095+0000 7fe9a3606640 1 -- 172.21.15.87:0/2816475074 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaa8052c70 con 0x560d2d8e8ba0 2024-05-08T18:31:22.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.095+0000 7feab951f800 1 -- 172.21.15.87:0/2816475074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e8ba0 msgr2=0x560d2d9ddb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.095+0000 7feab951f800 1 --2- 172.21.15.87:0/2816475074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e8ba0 0x560d2d9ddb70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7feaa8055040 tx=0x7feaa804c000 comp rx=0 tx=0).stop 2024-05-08T18:31:22.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.095+0000 7feab951f800 1 -- 172.21.15.87:0/2816475074 shutdown_connections 2024-05-08T18:31:22.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.095+0000 7feab951f800 1 --2- 172.21.15.87:0/2816475074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e8ba0 0x560d2d9ddb70 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.095+0000 7feab951f800 1 -- 172.21.15.87:0/2816475074 >> 172.21.15.87:0/2816475074 conn(0x560d2d8e4760 msgr2=0x560d2d9d9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.095+0000 7feab951f800 1 -- 172.21.15.87:0/2816475074 shutdown_connections 2024-05-08T18:31:22.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.095+0000 7feab951f800 1 -- 172.21.15.87:0/2816475074 wait complete. 2024-05-08T18:31:22.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.096+0000 7feab951f800 1 Processor -- start 2024-05-08T18:31:22.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.096+0000 7feab951f800 1 -- start start 2024-05-08T18:31:22.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.096+0000 7feab951f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e9500 0x560d2d9e5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.096+0000 7feab951f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560d2d8ea5f0 con 0x560d2d8e9500 2024-05-08T18:31:22.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.096+0000 7feab51e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e9500 0x560d2d9e5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.096+0000 7feab51e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e9500 0x560d2d9e5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34378/0 (socket says 172.21.15.87:34378) 2024-05-08T18:31:22.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.096+0000 7feab51e0640 1 -- 172.21.15.87:0/909902388 learned_addr learned my addr 172.21.15.87:0/909902388 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.096+0000 7feab51e0640 1 -- 172.21.15.87:0/909902388 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d2d9e5dd0 con 0x560d2d8e9500 2024-05-08T18:31:22.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.096+0000 7feab51e0640 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e9500 0x560d2d9e5890 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7feaa800a470 tx=0x7feaa8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.097+0000 7fe9a1e03640 1 -- 172.21.15.87:0/909902388 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaa8073070 con 0x560d2d8e9500 2024-05-08T18:31:22.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.097+0000 7fe9a1e03640 1 -- 172.21.15.87:0/909902388 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa805d650 con 0x560d2d8e9500 2024-05-08T18:31:22.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.097+0000 7fe9a1e03640 1 -- 172.21.15.87:0/909902388 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaa8057070 con 0x560d2d8e9500 2024-05-08T18:31:22.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.097+0000 7feab951f800 1 -- 172.21.15.87:0/909902388 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560d2d9e6060 con 0x560d2d8e9500 2024-05-08T18:31:22.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.097+0000 7feab951f800 1 -- 172.21.15.87:0/909902388 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d2d9e8cc0 con 0x560d2d8e9500 2024-05-08T18:31:22.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.097+0000 7fe9a1e03640 1 -- 172.21.15.87:0/909902388 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7feaa8076070 con 0x560d2d8e9500 2024-05-08T18:31:22.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.098+0000 7fe9a1e03640 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe99c03bba0 0x7fe99c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.098+0000 7fe9a1e03640 1 -- 172.21.15.87:0/909902388 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7feaa8094240 con 0x560d2d8e9500 2024-05-08T18:31:22.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.098+0000 7feab49df640 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe99c03bba0 0x7fe99c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.098+0000 7feab951f800 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560d2d9eaa70 0x560d2d9ece60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.098+0000 7feab951f800 1 -- 172.21.15.87:0/909902388 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2d9ed3a0 con 0x560d2d9eaa70 2024-05-08T18:31:22.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.098+0000 7feab59e1640 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560d2d9eaa70 0x560d2d9ece60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.098+0000 7feab49df640 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe99c03bba0 0x7fe99c03e060 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feaac000f60 tx=0x7feaac0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.098+0000 7feab59e1640 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560d2d9eaa70 0x560d2d9ece60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.099+0000 7feab59e1640 1 -- 172.21.15.87:0/909902388 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feab000a4a0 con 0x560d2d9eaa70 2024-05-08T18:31:22.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.099+0000 7feab951f800 1 -- 172.21.15.87:0/909902388 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2d9ea050 con 0x560d2d9eaa70 2024-05-08T18:31:22.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.099+0000 7feab59e1640 1 -- 172.21.15.87:0/909902388 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feab000a4a0 con 0x560d2d9eaa70 2024-05-08T18:31:22.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.099+0000 7feab951f800 1 -- 172.21.15.87:0/909902388 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2d9ef180 con 0x560d2d9eaa70 2024-05-08T18:31:22.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.099+0000 7feab59e1640 1 -- 172.21.15.87:0/909902388 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feab000a4a0 con 0x560d2d9eaa70 2024-05-08T18:31:22.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.099+0000 7feab951f800 1 -- 172.21.15.87:0/909902388 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2d9ee3b0 con 0x560d2d9eaa70 2024-05-08T18:31:22.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.099+0000 7feab59e1640 1 -- 172.21.15.87:0/909902388 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feab000a4a0 con 0x560d2d9eaa70 2024-05-08T18:31:22.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.099+0000 7feab951f800 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560d2d9f0530 0x560d2d9f2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.099+0000 7feab951f800 1 -- 172.21.15.87:0/909902388 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2d9f2e60 con 0x560d2d9f0530 2024-05-08T18:31:22.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.100+0000 7feab51e0640 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560d2d9f0530 0x560d2d9f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.100+0000 7feab51e0640 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560d2d9f0530 0x560d2d9f2920 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.100+0000 7feab51e0640 1 -- 172.21.15.87:0/909902388 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feaa8075030 con 0x560d2d9f0530 2024-05-08T18:31:22.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.100+0000 7feab951f800 1 Processor -- start 2024-05-08T18:31:22.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.101+0000 7feab951f800 1 -- start start 2024-05-08T18:31:22.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.101+0000 7feab951f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da010a0 0x560d2da014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.101+0000 7feab951f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560d2d7dbfc0 con 0x560d2da010a0 2024-05-08T18:31:22.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.101+0000 7feab59e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da010a0 0x560d2da014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.101+0000 7feab59e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da010a0 0x560d2da014c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34386/0 (socket says 172.21.15.87:34386) 2024-05-08T18:31:22.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.101+0000 7feab59e1640 1 -- 172.21.15.87:0/1062396483 learned_addr learned my addr 172.21.15.87:0/1062396483 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.101+0000 7feab59e1640 1 -- 172.21.15.87:0/1062396483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d2da01a00 con 0x560d2da010a0 2024-05-08T18:31:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.101+0000 7feab59e1640 1 --2- 172.21.15.87:0/1062396483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da010a0 0x560d2da014c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x560d2d9e6c40 tx=0x7feab00178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.101+0000 7fe99affd640 1 -- 172.21.15.87:0/1062396483 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab0013440 con 0x560d2da010a0 2024-05-08T18:31:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.101+0000 7fe99affd640 1 -- 172.21.15.87:0/1062396483 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab00135e0 con 0x560d2da010a0 2024-05-08T18:31:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.101+0000 7feab951f800 1 -- 172.21.15.87:0/1062396483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560d2da02470 con 0x560d2da010a0 2024-05-08T18:31:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.101+0000 7fe99affd640 1 -- 172.21.15.87:0/1062396483 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab00138c0 con 0x560d2da010a0 2024-05-08T18:31:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.101+0000 7feab951f800 1 -- 172.21.15.87:0/1062396483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d2da02970 con 0x560d2da010a0 2024-05-08T18:31:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.102+0000 7fe99affd640 1 -- 172.21.15.87:0/1062396483 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7feab0011040 con 0x560d2da010a0 2024-05-08T18:31:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.102+0000 7fe99affd640 1 --2- 172.21.15.87:0/1062396483 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe99003bba0 0x7fe99003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.103+0000 7fe99affd640 1 -- 172.21.15.87:0/1062396483 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7feab001d070 con 0x560d2da010a0 2024-05-08T18:31:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.103+0000 7feab51e0640 1 --2- 172.21.15.87:0/1062396483 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe99003bba0 0x7fe99003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.103+0000 7feab951f800 1 Processor -- start 2024-05-08T18:31:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.103+0000 7feab951f800 1 -- start start 2024-05-08T18:31:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.103+0000 7feab51e0640 1 --2- 172.21.15.87:0/1062396483 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe99003bba0 0x7fe99003e060 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feaa8001eb0 tx=0x7feaa8005370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.103+0000 7feab951f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da0e380 0x560d2da0e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.103+0000 7feab951f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560d2d9de400 con 0x560d2da0e380 2024-05-08T18:31:22.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.103+0000 7feab59e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da0e380 0x560d2da0e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.103+0000 7feab59e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da0e380 0x560d2da0e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34400/0 (socket says 172.21.15.87:34400) 2024-05-08T18:31:22.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.103+0000 7feab59e1640 1 -- 172.21.15.87:0/469826753 learned_addr learned my addr 172.21.15.87:0/469826753 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.103+0000 7feab59e1640 1 -- 172.21.15.87:0/469826753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d2da0ed70 con 0x560d2da0e380 2024-05-08T18:31:22.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.104+0000 7feab59e1640 1 --2- 172.21.15.87:0/469826753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da0e380 0x560d2da0e7a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feab0052990 tx=0x7feab0029430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70358648d331e772 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.104+0000 7fe998ff9640 1 -- 172.21.15.87:0/469826753 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab002ad80 con 0x560d2da0e380 2024-05-08T18:31:22.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.104+0000 7fe998ff9640 1 -- 172.21.15.87:0/469826753 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab00540d0 con 0x560d2da0e380 2024-05-08T18:31:22.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.104+0000 7fe998ff9640 1 -- 172.21.15.87:0/469826753 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab00543f0 con 0x560d2da0e380 2024-05-08T18:31:22.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.104+0000 7feab951f800 1 -- 172.21.15.87:0/469826753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da0e380 msgr2=0x560d2da0e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.104+0000 7feab951f800 1 --2- 172.21.15.87:0/469826753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da0e380 0x560d2da0e7a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feab0052990 tx=0x7feab0029430 comp rx=0 tx=0).stop 2024-05-08T18:31:22.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.104+0000 7feab951f800 1 -- 172.21.15.87:0/469826753 shutdown_connections 2024-05-08T18:31:22.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.104+0000 7feab951f800 1 --2- 172.21.15.87:0/469826753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da0e380 0x560d2da0e7a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.104+0000 7feab951f800 1 -- 172.21.15.87:0/469826753 >> 172.21.15.87:0/469826753 conn(0x560d2da0a6e0 msgr2=0x560d2da08740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.105+0000 7feab951f800 1 -- 172.21.15.87:0/469826753 shutdown_connections 2024-05-08T18:31:22.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.105+0000 7feab951f800 1 -- 172.21.15.87:0/469826753 wait complete. 2024-05-08T18:31:22.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.105+0000 7feab951f800 1 Processor -- start 2024-05-08T18:31:22.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.105+0000 7feab951f800 1 -- start start 2024-05-08T18:31:22.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.105+0000 7feab951f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da0e380 0x560d2da159e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.105+0000 7feab951f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560d2da0f4e0 con 0x560d2da0e380 2024-05-08T18:31:22.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.105+0000 7feab59e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da0e380 0x560d2da159e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.105+0000 7feab59e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da0e380 0x560d2da159e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34408/0 (socket says 172.21.15.87:34408) 2024-05-08T18:31:22.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.105+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 learned_addr learned my addr 172.21.15.87:0/2740110537 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.105+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d2da15f20 con 0x560d2da0e380 2024-05-08T18:31:22.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.106+0000 7feab59e1640 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da0e380 0x560d2da159e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7feab0001f40 tx=0x7feab00528f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.106+0000 7fe986ffd640 1 -- 172.21.15.87:0/2740110537 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab0030020 con 0x560d2da0e380 2024-05-08T18:31:22.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.106+0000 7fe986ffd640 1 -- 172.21.15.87:0/2740110537 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab0051310 con 0x560d2da0e380 2024-05-08T18:31:22.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.106+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560d2da161b0 con 0x560d2da0e380 2024-05-08T18:31:22.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.106+0000 7fe986ffd640 1 -- 172.21.15.87:0/2740110537 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab0013a60 con 0x560d2da0e380 2024-05-08T18:31:22.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.106+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d2da18e60 con 0x560d2da0e380 2024-05-08T18:31:22.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.106+0000 7fe986ffd640 1 -- 172.21.15.87:0/2740110537 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7feab0033020 con 0x560d2da0e380 2024-05-08T18:31:22.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.107+0000 7fe986ffd640 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe98003bba0 0x7fe98003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.107+0000 7fe986ffd640 1 -- 172.21.15.87:0/2740110537 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7feab000e040 con 0x560d2da0e380 2024-05-08T18:31:22.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.107+0000 7feab51e0640 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe98003bba0 0x7fe98003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.107+0000 7feab51e0640 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe98003bba0 0x7fe98003e060 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feaa8044810 tx=0x7feaa808c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.107+0000 7feab951f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.107+0000 7feab951f800 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560d2da21490 0x560d2da23950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.107+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2da240a0 con 0x560d2da21490 2024-05-08T18:31:22.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.107+0000 7feab49df640 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560d2da21490 0x560d2da23950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.108+0000 7feab49df640 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560d2da21490 0x560d2da23950 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.108+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feaac009050 con 0x560d2da21490 2024-05-08T18:31:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.108+0000 7feab951f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.108+0000 7feab951f800 20 realm 2024-05-08T18:31:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.108+0000 7feab951f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.108+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2da208e0 con 0x560d2da21490 2024-05-08T18:31:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.108+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feaac009050 con 0x560d2da21490 2024-05-08T18:31:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.108+0000 7feab951f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.108+0000 7feab951f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.108+0000 7feab951f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.108+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2da24b90 con 0x560d2da21490 2024-05-08T18:31:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.108+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feaac009050 con 0x560d2da21490 2024-05-08T18:31:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.108+0000 7feab951f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.108+0000 7feab951f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.108+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2da25460 con 0x560d2da21490 2024-05-08T18:31:22.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.109+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feaac009050 con 0x560d2da21490 2024-05-08T18:31:22.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.109+0000 7feab951f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:22.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.109+0000 7feab951f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.109+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2da25800 con 0x560d2da21490 2024-05-08T18:31:22.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.109+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feaac009050 con 0x560d2da21490 2024-05-08T18:31:22.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.109+0000 7feab951f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:22.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.109+0000 7feab951f800 20 searching for the correct realm 2024-05-08T18:31:22.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.109+0000 7feab951f800 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560d2da276e0 0x560d2da29ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.109+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x560d2da276e0 2024-05-08T18:31:22.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.109+0000 7feab59e1640 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560d2da276e0 0x560d2da29ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.109+0000 7feab59e1640 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560d2da276e0 0x560d2da29ad0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.110+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab0029070 con 0x560d2da276e0 2024-05-08T18:31:22.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.110+0000 7feab59e1640 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7feab0035020 0x7feab0029900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.110+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x7feab0035020 2024-05-08T18:31:22.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.110+0000 7feab51e0640 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7feab0035020 0x7feab0029900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.110+0000 7feab51e0640 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7feab0035020 0x7feab0029900 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.110+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa808a030 con 0x7feab0035020 2024-05-08T18:31:22.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.111+0000 7feab51e0640 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7feaa80a1040 0x7feaa8076580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.111+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x7feaa80a1040 2024-05-08T18:31:22.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.111+0000 7feab49df640 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7feaa80a1040 0x7feaa8076580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.111+0000 7feab49df640 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7feaa80a1040 0x7feaa8076580 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.111+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaac009050 con 0x7feaa80a1040 2024-05-08T18:31:22.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.111+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x560d2da21490 2024-05-08T18:31:22.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.112+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaac009050 con 0x560d2da21490 2024-05-08T18:31:22.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.112+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x560d2da21490 2024-05-08T18:31:22.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.112+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.112+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x7feaa80a1040 2024-05-08T18:31:22.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.112+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.112+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x7feaa80a1040 2024-05-08T18:31:22.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.112+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.112+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x7feab0035020 2024-05-08T18:31:22.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.113+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa808a030 con 0x7feab0035020 2024-05-08T18:31:22.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.113+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x560d2da276e0 2024-05-08T18:31:22.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.113+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab0029070 con 0x560d2da276e0 2024-05-08T18:31:22.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.113+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x560d2da21490 2024-05-08T18:31:22.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.113+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.113+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x7feaa80a1040 2024-05-08T18:31:22.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.113+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.113+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x560d2da21490 2024-05-08T18:31:22.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.114+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.114+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x7feab0035020 2024-05-08T18:31:22.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.114+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feaa808a030 con 0x7feab0035020 2024-05-08T18:31:22.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.114+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x560d2da276e0 2024-05-08T18:31:22.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.114+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab0029070 con 0x560d2da276e0 2024-05-08T18:31:22.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.114+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x560d2da276e0 2024-05-08T18:31:22.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.114+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab0029070 con 0x560d2da276e0 2024-05-08T18:31:22.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.114+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x7feaa80a1040 2024-05-08T18:31:22.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.114+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.115+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x560d2da276e0 2024-05-08T18:31:22.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.115+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab0029070 con 0x560d2da276e0 2024-05-08T18:31:22.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.115+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x560d2da276e0 2024-05-08T18:31:22.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.115+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab0029070 con 0x560d2da276e0 2024-05-08T18:31:22.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.115+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x560d2da21490 2024-05-08T18:31:22.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.115+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.115+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x560d2da21490 2024-05-08T18:31:22.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.115+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.115+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x7feaa80a1040 2024-05-08T18:31:22.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.116+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.116+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x560d2da276e0 2024-05-08T18:31:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.116+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab0029070 con 0x560d2da276e0 2024-05-08T18:31:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.116+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x7feab0035020 2024-05-08T18:31:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.116+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa808a030 con 0x7feab0035020 2024-05-08T18:31:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.116+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x560d2da21490 2024-05-08T18:31:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.116+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.116+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x7feaa80a1040 2024-05-08T18:31:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.117+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.117+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x560d2da276e0 2024-05-08T18:31:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.117+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab0029070 con 0x560d2da276e0 2024-05-08T18:31:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.117+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x7feaa80a1040 2024-05-08T18:31:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.117+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.117+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x7feab0035020 2024-05-08T18:31:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.117+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa808a030 con 0x7feab0035020 2024-05-08T18:31:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.117+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x560d2da276e0 2024-05-08T18:31:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.118+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab0029070 con 0x560d2da276e0 2024-05-08T18:31:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.118+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x7feaa80a1040 2024-05-08T18:31:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.118+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.118+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x560d2da21490 2024-05-08T18:31:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a180 con 0x7feab0035020 2024-05-08T18:31:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa808a030 con 0x7feab0035020 2024-05-08T18:31:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab951f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab951f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab951f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab951f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab951f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab951f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab951f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2da26180 con 0x560d2da21490 2024-05-08T18:31:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab951f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab951f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2da26a20 con 0x560d2da21490 2024-05-08T18:31:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab951f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab951f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.119+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2a600 con 0x7feaa80a1040 2024-05-08T18:31:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 20 zone default found 2024-05-08T18:31:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 4 Realm: () 2024-05-08T18:31:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 20 zonegroup default 2024-05-08T18:31:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2aab0 con 0x7feaa80a1040 2024-05-08T18:31:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2c490 con 0x560d2da276e0 2024-05-08T18:31:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feab0029070 con 0x560d2da276e0 2024-05-08T18:31:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2c940 con 0x560d2da276e0 2024-05-08T18:31:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feab0029070 con 0x560d2da276e0 2024-05-08T18:31:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 20 started sync module instance, tier type = 2024-05-08T18:31:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.120+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2b920 con 0x7feab0035020 2024-05-08T18:31:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.121+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa808a030 con 0x7feab0035020 2024-05-08T18:31:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.121+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94614600203536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2d250 con 0x7feab0035020 2024-05-08T18:31:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.121+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2daa0 con 0x560d2da21490 2024-05-08T18:31:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.122+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94614600203536] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa808a030 con 0x7feab0035020 2024-05-08T18:31:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.122+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.122+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94614600207776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2dae0 con 0x560d2da21490 2024-05-08T18:31:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.122+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2e5b0 con 0x560d2da276e0 2024-05-08T18:31:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.123+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feab0029070 con 0x560d2da276e0 2024-05-08T18:31:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.123+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94614600207776] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.123+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94614600212640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2e9d0 con 0x560d2da276e0 2024-05-08T18:31:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.123+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2f410 con 0x7feab0035020 2024-05-08T18:31:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.124+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa808a030 con 0x7feab0035020 2024-05-08T18:31:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.124+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94614600212640] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feab0029070 con 0x560d2da276e0 2024-05-08T18:31:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.124+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94614600216288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2fcb0 con 0x7feab0035020 2024-05-08T18:31:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.124+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2d610 con 0x560d2da21490 2024-05-08T18:31:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.125+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.125+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94614600221344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da30b70 con 0x560d2da21490 2024-05-08T18:31:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.125+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da31570 con 0x7feaa80a1040 2024-05-08T18:31:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.126+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94614600216288] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa808a030 con 0x7feab0035020 2024-05-08T18:31:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.126+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94614600221344] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.126+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.126+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94614600218624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da306c0 con 0x7feaa80a1040 2024-05-08T18:31:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.126+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da31e40 con 0x7feaa80a1040 2024-05-08T18:31:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.127+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94614600218624] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.128+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.128+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94614600224896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da306c0 con 0x7feaa80a1040 2024-05-08T18:31:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.128+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da32460 con 0x7feaa80a1040 2024-05-08T18:31:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.128+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94614600224896] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.129+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.129+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94614600227136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da32460 con 0x7feaa80a1040 2024-05-08T18:31:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.129+0000 7feab951f800 20 add_watcher() i=0 2024-05-08T18:31:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.129+0000 7feab951f800 20 add_watcher() i=1 2024-05-08T18:31:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.129+0000 7feab951f800 20 add_watcher() i=2 2024-05-08T18:31:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.129+0000 7feab951f800 20 add_watcher() i=3 2024-05-08T18:31:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.129+0000 7feab951f800 20 add_watcher() i=4 2024-05-08T18:31:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.129+0000 7feab951f800 20 add_watcher() i=5 2024-05-08T18:31:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.129+0000 7feab951f800 20 add_watcher() i=6 2024-05-08T18:31:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.129+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94614600227136] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.129+0000 7feab951f800 20 add_watcher() i=7 2024-05-08T18:31:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.129+0000 7feab951f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.129+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2da357a0 con 0x560d2da21490 2024-05-08T18:31:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.130+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.130+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94614600241600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da325d0 con 0x560d2da21490 2024-05-08T18:31:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.131+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94614600241600] v27'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.131+0000 7fe96b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.131+0000 7feab951f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.131+0000 7feab951f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.131+0000 7feab951f800 5 note: GC not initialized 2024-05-08T18:31:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.131+0000 7fe96a7e4640 20 reqs_thread_entry: start 2024-05-08T18:31:22.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.131+0000 7feab951f800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:22.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.131+0000 7feab951f800 20 Filter name: none 2024-05-08T18:31:22.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7fe8dbfff640 20 reqs_thread_entry: start 2024-05-08T18:31:22.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7feab951f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-08T18:31:22.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7feab951f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2da68f80 con 0x7feaa80a1040 2024-05-08T18:31:22.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7feab951f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7feab951f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-05-08T18:31:22.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7feab951f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T18:31:22.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7feab951f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-08T18:31:22.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7feab951f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2da67670 con 0x7feaa80a1040 2024-05-08T18:31:22.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7feab951f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7feab951f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-08T18:31:22.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7feab951f800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:31:22.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7feab951f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:31:22.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7feab951f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:31:22.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.132+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da6bac0 con 0x7feaa80a1040 2024-05-08T18:31:22.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.133+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v27'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.133+0000 7feab951f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-05-08T18:31:22.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.133+0000 7feab951f800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T18:31:22.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.133+0000 7feab951f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-05-08T18:31:22.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.133+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94614600463456 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2da6c610 con 0x7feab0035020 2024-05-08T18:31:22.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.134+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== watch-notify(notify (1) cookie 94614600216288 notify 115964117013 ret 0) ==== 652+0+0 (crc 0 0 0) 0x560d2d9e8cc0 con 0x7feab0035020 2024-05-08T18:31:22.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.134+0000 7fe998ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117013 cookie 94614600216288 notifier 4529 bl.length()=610 2024-05-08T18:31:22.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.134+0000 7fe998ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-05-08T18:31:22.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.134+0000 7fe998ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T18:31:22.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.134+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(65 notify.3 [notify cookie 94614600463456 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feaa808a030 con 0x7feab0035020 2024-05-08T18:31:22.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.134+0000 7fe998ff9640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fe978003ea0 con 0x7feab0035020 2024-05-08T18:31:22.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.134+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa808a030 con 0x7feab0035020 2024-05-08T18:31:22.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.134+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== watch-notify(notify_complete (2) cookie 94614600463456 notify 115964117013 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560d2d9e6060 con 0x7feab0035020 2024-05-08T18:31:22.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.134+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da6b430 con 0x7feaa80a1040 2024-05-08T18:31:22.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.135+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v27'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.135+0000 7feab951f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:31:22.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.135+0000 7feab951f800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:31:22.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.135+0000 7feab951f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:31:22.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.135+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94614600463312 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560d2da6ca40 con 0x560d2da276e0 2024-05-08T18:31:22.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.135+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== watch-notify(notify (1) cookie 94614600212640 notify 115964116996 ret 0) ==== 234+0+0 (crc 0 0 0) 0x560d2da161b0 con 0x560d2da276e0 2024-05-08T18:31:22.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.135+0000 7fe998ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 94614600212640 notifier 4529 bl.length()=192 2024-05-08T18:31:22.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.135+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(68 notify.2 [notify cookie 94614600463312 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feab0029070 con 0x560d2da276e0 2024-05-08T18:31:22.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.135+0000 7fe998ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:31:22.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.135+0000 7fe998ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:31:22.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.135+0000 7fe998ff9640 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fe978003ea0 con 0x560d2da276e0 2024-05-08T18:31:22.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.136+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== watch-notify(notify_complete (2) cookie 94614600463312 notify 115964116996 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560d2da15f20 con 0x560d2da276e0 2024-05-08T18:31:22.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.136+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feab0029070 con 0x560d2da276e0 2024-05-08T18:31:22.147 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T18:31:22.133455Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:22.133443Z","tags":[],"group_ids":[]} 2024-05-08T18:31:22.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.137+0000 7fe96b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:22.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.137+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94614600241600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da34990 con 0x560d2da21490 2024-05-08T18:31:22.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.137+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94614600241600] v27'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.138+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94614600203536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da351c0 con 0x7feab0035020 2024-05-08T18:31:22.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.138+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94614600203536] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa808a030 con 0x7feab0035020 2024-05-08T18:31:22.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.138+0000 7feab951f800 20 remove_watcher() i=0 2024-05-08T18:31:22.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.138+0000 7feab951f800 2 removed watcher, disabling cache 2024-05-08T18:31:22.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.138+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94614600207776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2bd10 con 0x560d2da21490 2024-05-08T18:31:22.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.139+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94614600207776] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.139+0000 7feab951f800 20 remove_watcher() i=1 2024-05-08T18:31:22.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.139+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94614600212640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2bd10 con 0x560d2da276e0 2024-05-08T18:31:22.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.140+0000 7feab59e1640 1 -- 172.21.15.87:0/2740110537 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94614600212640] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feab0029070 con 0x560d2da276e0 2024-05-08T18:31:22.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.140+0000 7feab951f800 20 remove_watcher() i=2 2024-05-08T18:31:22.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.140+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94614600216288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2e0a0 con 0x7feab0035020 2024-05-08T18:31:22.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.141+0000 7feab51e0640 1 -- 172.21.15.87:0/2740110537 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94614600216288] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa808a030 con 0x7feab0035020 2024-05-08T18:31:22.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.141+0000 7feab951f800 20 remove_watcher() i=3 2024-05-08T18:31:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.141+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94614600221344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2bd10 con 0x560d2da21490 2024-05-08T18:31:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.142+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94614600221344] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x560d2da21490 2024-05-08T18:31:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.142+0000 7feab951f800 20 remove_watcher() i=4 2024-05-08T18:31:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.142+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94614600218624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2e0a0 con 0x7feaa80a1040 2024-05-08T18:31:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.143+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94614600218624] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.143+0000 7feab951f800 20 remove_watcher() i=5 2024-05-08T18:31:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.143+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94614600224896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da302a0 con 0x7feaa80a1040 2024-05-08T18:31:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.144+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94614600224896] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.144+0000 7feab951f800 20 remove_watcher() i=6 2024-05-08T18:31:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.144+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94614600227136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560d2da2bd10 con 0x7feaa80a1040 2024-05-08T18:31:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.145+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94614600227136] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaac02a040 con 0x7feaa80a1040 2024-05-08T18:31:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.145+0000 7feab951f800 20 remove_watcher() i=7 2024-05-08T18:31:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.145+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7feaa80a1040 msgr2=0x7feaa8076580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.145+0000 7feab951f800 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7feaa80a1040 0x7feaa8076580 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.145+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560d2da21490 msgr2=0x560d2da23950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.145+0000 7feab951f800 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560d2da21490 0x560d2da23950 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.145+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7feab0035020 msgr2=0x7feab0029900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.145+0000 7feab951f800 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7feab0035020 0x7feab0029900 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.145+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560d2da276e0 msgr2=0x560d2da29ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.145+0000 7feab951f800 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560d2da276e0 0x560d2da29ad0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.145+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe98003bba0 msgr2=0x7fe98003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.145+0000 7feab951f800 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe98003bba0 0x7fe98003e060 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feaa8044810 tx=0x7feaa808c000 comp rx=0 tx=0).stop 2024-05-08T18:31:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.145+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da0e380 msgr2=0x560d2da159e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.145+0000 7feab49df640 1 -- 172.21.15.87:0/2740110537 reap_dead start 2024-05-08T18:31:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.145+0000 7feab951f800 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da0e380 0x560d2da159e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7feab0001f40 tx=0x7feab00528f0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 shutdown_connections 2024-05-08T18:31:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 --2- 172.21.15.87:0/2740110537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da0e380 0x560d2da159e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 >> 172.21.15.87:0/2740110537 conn(0x560d2da0a6e0 msgr2=0x560d2da07d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 shutdown_connections 2024-05-08T18:31:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 -- 172.21.15.87:0/2740110537 wait complete. 2024-05-08T18:31:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 -- 172.21.15.87:0/1062396483 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe99003bba0 msgr2=0x7fe99003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 --2- 172.21.15.87:0/1062396483 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe99003bba0 0x7fe99003e060 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feaa8001eb0 tx=0x7feaa8005370 comp rx=0 tx=0).stop 2024-05-08T18:31:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 -- 172.21.15.87:0/1062396483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da010a0 msgr2=0x560d2da014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 --2- 172.21.15.87:0/1062396483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da010a0 0x560d2da014c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x560d2d9e6c40 tx=0x7feab00178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 -- 172.21.15.87:0/1062396483 shutdown_connections 2024-05-08T18:31:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 --2- 172.21.15.87:0/1062396483 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe99003bba0 0x7fe99003e060 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 --2- 172.21.15.87:0/1062396483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2da010a0 0x560d2da014c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 -- 172.21.15.87:0/1062396483 >> 172.21.15.87:0/1062396483 conn(0x560d2d9f5140 msgr2=0x560d2d9f5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 -- 172.21.15.87:0/1062396483 shutdown_connections 2024-05-08T18:31:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 -- 172.21.15.87:0/1062396483 wait complete. 2024-05-08T18:31:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 -- 172.21.15.87:0/909902388 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560d2d9f0530 msgr2=0x560d2d9f2920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560d2d9f0530 0x560d2d9f2920 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 -- 172.21.15.87:0/909902388 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560d2d9eaa70 msgr2=0x560d2d9ece60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560d2d9eaa70 0x560d2d9ece60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 -- 172.21.15.87:0/909902388 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe99c03bba0 msgr2=0x7fe99c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe99c03bba0 0x7fe99c03e060 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feaac000f60 tx=0x7feaac0012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 -- 172.21.15.87:0/909902388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e9500 msgr2=0x560d2d9e5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e9500 0x560d2d9e5890 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7feaa800a470 tx=0x7feaa8003020 comp rx=0 tx=0).stop 2024-05-08T18:31:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 -- 172.21.15.87:0/909902388 shutdown_connections 2024-05-08T18:31:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560d2d9eaa70 0x560d2d9ece60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560d2d9f0530 0x560d2d9f2920 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe99c03bba0 0x7fe99c03e060 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 --2- 172.21.15.87:0/909902388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560d2d8e9500 0x560d2d9e5890 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.146+0000 7feab951f800 1 -- 172.21.15.87:0/909902388 >> 172.21.15.87:0/909902388 conn(0x560d2d8e4760 msgr2=0x560d2d9d7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.147+0000 7feab951f800 1 -- 172.21.15.87:0/909902388 shutdown_connections 2024-05-08T18:31:22.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.147+0000 7feab951f800 1 -- 172.21.15.87:0/909902388 wait complete. 2024-05-08T18:31:22.159 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T18:31:22.133455Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:22.133443Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:22.159 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-08T18:31:22.159 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-08T18:31:22.159 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-05-08T18:31:22.207 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:22.207 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:22.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.210+0000 7fb192723800 1 Processor -- start 2024-05-08T18:31:22.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.210+0000 7fb192723800 1 -- start start 2024-05-08T18:31:22.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.210+0000 7fb192723800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5557c5138cf0 0x5557c513b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.210+0000 7fb192723800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5557c513f130 con 0x5557c513b620 2024-05-08T18:31:22.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.210+0000 7fb192723800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5557c4fd8e20 con 0x5557c5138cf0 2024-05-08T18:31:22.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.210+0000 7fb18e4b0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5557c5138cf0 0x5557c513b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.210+0000 7fb18dcaf640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5557c513b620 0x5557c513da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42182/0 (socket says 172.21.15.87:42182) 2024-05-08T18:31:22.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.210+0000 7fb18dcaf640 1 -- 172.21.15.87:0/2610639362 learned_addr learned my addr 172.21.15.87:0/2610639362 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:22.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.210+0000 7fb18e4b0640 1 --2- 172.21.15.87:0/2610639362 >> v2:172.21.15.53:3300/0 conn(0x5557c5138cf0 0x5557c513b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34412/0 (socket says 172.21.15.87:34412) 2024-05-08T18:31:22.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.211+0000 7fb18e4b0640 1 -- 172.21.15.87:0/2610639362 >> v1:172.21.15.53:6789/0 conn(0x5557c513b620 legacy=0x5557c513da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.211+0000 7fb18e4b0640 1 -- 172.21.15.87:0/2610639362 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c5140310 con 0x5557c5138cf0 2024-05-08T18:31:22.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.212+0000 7fb18e4b0640 1 --2- 172.21.15.87:0/2610639362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 0x5557c513b0e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb18000a470 tx=0x7fb18001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b18d40749aee72e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.213+0000 7fb18d4ae640 1 -- 172.21.15.87:0/2610639362 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb180057070 con 0x5557c5138cf0 2024-05-08T18:31:22.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.213+0000 7fb18d4ae640 1 -- 172.21.15.87:0/2610639362 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb180052570 con 0x5557c5138cf0 2024-05-08T18:31:22.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.213+0000 7fb18d4ae640 1 -- 172.21.15.87:0/2610639362 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb180052870 con 0x5557c5138cf0 2024-05-08T18:31:22.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.213+0000 7fb192723800 1 -- 172.21.15.87:0/2610639362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 msgr2=0x5557c513b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.213+0000 7fb192723800 1 --2- 172.21.15.87:0/2610639362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 0x5557c513b0e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb18000a470 tx=0x7fb18001ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:22.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.213+0000 7fb192723800 1 -- 172.21.15.87:0/2610639362 shutdown_connections 2024-05-08T18:31:22.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.213+0000 7fb192723800 1 --2- 172.21.15.87:0/2610639362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 0x5557c513b0e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.213+0000 7fb192723800 1 -- 172.21.15.87:0/2610639362 >> 172.21.15.87:0/2610639362 conn(0x5557c5132740 msgr2=0x5557c5134b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.213+0000 7fb192723800 1 -- 172.21.15.87:0/2610639362 shutdown_connections 2024-05-08T18:31:22.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.213+0000 7fb192723800 1 -- 172.21.15.87:0/2610639362 wait complete. 2024-05-08T18:31:22.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.227+0000 7fb192723800 1 Processor -- start 2024-05-08T18:31:22.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.227+0000 7fb192723800 1 -- start start 2024-05-08T18:31:22.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.227+0000 7fb192723800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 0x5557c5138630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.227+0000 7fb192723800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5557c50835d0 con 0x5557c5138cf0 2024-05-08T18:31:22.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.227+0000 7fb18e4b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 0x5557c5138630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.227+0000 7fb18e4b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 0x5557c5138630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34414/0 (socket says 172.21.15.87:34414) 2024-05-08T18:31:22.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.227+0000 7fb18e4b0640 1 -- 172.21.15.87:0/2511183260 learned_addr learned my addr 172.21.15.87:0/2511183260 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.228+0000 7fb18e4b0640 1 -- 172.21.15.87:0/2511183260 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c5136bf0 con 0x5557c5138cf0 2024-05-08T18:31:22.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.228+0000 7fb18e4b0640 1 --2- 172.21.15.87:0/2511183260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 0x5557c5138630 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb180055040 tx=0x7fb18004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2631c124812668 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.228+0000 7fb07c608640 1 -- 172.21.15.87:0/2511183260 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb180057040 con 0x5557c5138cf0 2024-05-08T18:31:22.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.228+0000 7fb07c608640 1 -- 172.21.15.87:0/2511183260 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb180052990 con 0x5557c5138cf0 2024-05-08T18:31:22.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.228+0000 7fb07c608640 1 -- 172.21.15.87:0/2511183260 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb180052c70 con 0x5557c5138cf0 2024-05-08T18:31:22.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.229+0000 7fb192723800 1 -- 172.21.15.87:0/2511183260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 msgr2=0x5557c5138630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.229+0000 7fb192723800 1 --2- 172.21.15.87:0/2511183260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 0x5557c5138630 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb180055040 tx=0x7fb18004c000 comp rx=0 tx=0).stop 2024-05-08T18:31:22.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.229+0000 7fb192723800 1 -- 172.21.15.87:0/2511183260 shutdown_connections 2024-05-08T18:31:22.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.229+0000 7fb192723800 1 --2- 172.21.15.87:0/2511183260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 0x5557c5138630 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.229+0000 7fb192723800 1 -- 172.21.15.87:0/2511183260 >> 172.21.15.87:0/2511183260 conn(0x5557c5132740 msgr2=0x5557c5224f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.229+0000 7fb192723800 1 -- 172.21.15.87:0/2511183260 shutdown_connections 2024-05-08T18:31:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.229+0000 7fb192723800 1 -- 172.21.15.87:0/2511183260 wait complete. 2024-05-08T18:31:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.229+0000 7fb192723800 1 Processor -- start 2024-05-08T18:31:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.229+0000 7fb192723800 1 -- start start 2024-05-08T18:31:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.229+0000 7fb192723800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 0x5557c52332f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.229+0000 7fb192723800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5557c513f5a0 con 0x5557c5138cf0 2024-05-08T18:31:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.229+0000 7fb18e4b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 0x5557c52332f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.229+0000 7fb18e4b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 0x5557c52332f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34428/0 (socket says 172.21.15.87:34428) 2024-05-08T18:31:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.229+0000 7fb18e4b0640 1 -- 172.21.15.87:0/4286931261 learned_addr learned my addr 172.21.15.87:0/4286931261 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.230+0000 7fb18e4b0640 1 -- 172.21.15.87:0/4286931261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c5233830 con 0x5557c5138cf0 2024-05-08T18:31:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.230+0000 7fb18e4b0640 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 0x5557c52332f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb18000a470 tx=0x7fb180003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.230+0000 7fb07ae05640 1 -- 172.21.15.87:0/4286931261 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb180073070 con 0x5557c5138cf0 2024-05-08T18:31:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.230+0000 7fb07ae05640 1 -- 172.21.15.87:0/4286931261 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb18005d650 con 0x5557c5138cf0 2024-05-08T18:31:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.230+0000 7fb192723800 1 -- 172.21.15.87:0/4286931261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557c5233ac0 con 0x5557c5138cf0 2024-05-08T18:31:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.230+0000 7fb07ae05640 1 -- 172.21.15.87:0/4286931261 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb180057070 con 0x5557c5138cf0 2024-05-08T18:31:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.230+0000 7fb192723800 1 -- 172.21.15.87:0/4286931261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557c5236770 con 0x5557c5138cf0 2024-05-08T18:31:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.231+0000 7fb07ae05640 1 -- 172.21.15.87:0/4286931261 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb180076070 con 0x5557c5138cf0 2024-05-08T18:31:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.231+0000 7fb07ae05640 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb07403bba0 0x7fb07403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.231+0000 7fb07ae05640 1 -- 172.21.15.87:0/4286931261 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb180094330 con 0x5557c5138cf0 2024-05-08T18:31:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.231+0000 7fb18dcaf640 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb07403bba0 0x7fb07403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.231+0000 7fb192723800 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5557c513b620 0x5557c523a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.231+0000 7fb192723800 1 -- 172.21.15.87:0/4286931261 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c523aa70 con 0x5557c513b620 2024-05-08T18:31:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.231+0000 7fb18ecb1640 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5557c513b620 0x5557c523a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.231+0000 7fb18dcaf640 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb07403bba0 0x7fb07403e060 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb178000f60 tx=0x7fb1780012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.232+0000 7fb18ecb1640 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5557c513b620 0x5557c523a530 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.232+0000 7fb18ecb1640 1 -- 172.21.15.87:0/4286931261 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb18800a4a0 con 0x5557c513b620 2024-05-08T18:31:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.232+0000 7fb192723800 1 -- 172.21.15.87:0/4286931261 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c5237b00 con 0x5557c513b620 2024-05-08T18:31:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.232+0000 7fb18ecb1640 1 -- 172.21.15.87:0/4286931261 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb18800a4a0 con 0x5557c513b620 2024-05-08T18:31:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.232+0000 7fb192723800 1 -- 172.21.15.87:0/4286931261 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c523c8b0 con 0x5557c513b620 2024-05-08T18:31:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.232+0000 7fb18ecb1640 1 -- 172.21.15.87:0/4286931261 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb18800a4a0 con 0x5557c513b620 2024-05-08T18:31:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.232+0000 7fb192723800 1 -- 172.21.15.87:0/4286931261 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c523bae0 con 0x5557c513b620 2024-05-08T18:31:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.233+0000 7fb18ecb1640 1 -- 172.21.15.87:0/4286931261 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb18800a4a0 con 0x5557c513b620 2024-05-08T18:31:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.233+0000 7fb192723800 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5557c523dc60 0x5557c5240050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.233+0000 7fb192723800 1 -- 172.21.15.87:0/4286931261 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c5240590 con 0x5557c523dc60 2024-05-08T18:31:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.233+0000 7fb18e4b0640 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5557c523dc60 0x5557c5240050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.233+0000 7fb18e4b0640 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5557c523dc60 0x5557c5240050 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.234+0000 7fb18e4b0640 1 -- 172.21.15.87:0/4286931261 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb180075030 con 0x5557c523dc60 2024-05-08T18:31:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.234+0000 7fb192723800 1 Processor -- start 2024-05-08T18:31:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.234+0000 7fb192723800 1 -- start start 2024-05-08T18:31:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.234+0000 7fb192723800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c524e860 0x5557c524ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.234+0000 7fb192723800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5557c5029fc0 con 0x5557c524e860 2024-05-08T18:31:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.234+0000 7fb18ecb1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c524e860 0x5557c524ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.234+0000 7fb18ecb1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c524e860 0x5557c524ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34432/0 (socket says 172.21.15.87:34432) 2024-05-08T18:31:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.234+0000 7fb18ecb1640 1 -- 172.21.15.87:0/1446209535 learned_addr learned my addr 172.21.15.87:0/1446209535 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.235+0000 7fb18ecb1640 1 -- 172.21.15.87:0/1446209535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c524f1c0 con 0x5557c524e860 2024-05-08T18:31:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.235+0000 7fb18ecb1640 1 --2- 172.21.15.87:0/1446209535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c524e860 0x5557c524ec80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x5557c52346f0 tx=0x7fb1880178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.235+0000 7fb073fff640 1 -- 172.21.15.87:0/1446209535 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb188013440 con 0x5557c524e860 2024-05-08T18:31:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.235+0000 7fb073fff640 1 -- 172.21.15.87:0/1446209535 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1880135e0 con 0x5557c524e860 2024-05-08T18:31:22.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.235+0000 7fb192723800 1 -- 172.21.15.87:0/1446209535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557c524fc30 con 0x5557c524e860 2024-05-08T18:31:22.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.235+0000 7fb073fff640 1 -- 172.21.15.87:0/1446209535 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1880138c0 con 0x5557c524e860 2024-05-08T18:31:22.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.235+0000 7fb192723800 1 -- 172.21.15.87:0/1446209535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557c5250130 con 0x5557c524e860 2024-05-08T18:31:22.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.236+0000 7fb073fff640 1 -- 172.21.15.87:0/1446209535 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb188011040 con 0x5557c524e860 2024-05-08T18:31:22.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.236+0000 7fb073fff640 1 --2- 172.21.15.87:0/1446209535 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb06803bba0 0x7fb06803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.236+0000 7fb073fff640 1 -- 172.21.15.87:0/1446209535 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb18801d070 con 0x5557c524e860 2024-05-08T18:31:22.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.236+0000 7fb18e4b0640 1 --2- 172.21.15.87:0/1446209535 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb06803bba0 0x7fb06803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.236+0000 7fb192723800 1 Processor -- start 2024-05-08T18:31:22.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.236+0000 7fb18e4b0640 1 --2- 172.21.15.87:0/1446209535 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb06803bba0 0x7fb06803e060 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb18005b730 tx=0x7fb180053f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.236+0000 7fb192723800 1 -- start start 2024-05-08T18:31:22.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.236+0000 7fb192723800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c525baf0 0x5557c525bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.236+0000 7fb192723800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5557c5136eb0 con 0x5557c525baf0 2024-05-08T18:31:22.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.237+0000 7fb18ecb1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c525baf0 0x5557c525bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.237+0000 7fb18ecb1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c525baf0 0x5557c525bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34438/0 (socket says 172.21.15.87:34438) 2024-05-08T18:31:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.237+0000 7fb18ecb1640 1 -- 172.21.15.87:0/4031208141 learned_addr learned my addr 172.21.15.87:0/4031208141 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.237+0000 7fb18ecb1640 1 -- 172.21.15.87:0/4031208141 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c525c4e0 con 0x5557c525baf0 2024-05-08T18:31:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.237+0000 7fb18ecb1640 1 --2- 172.21.15.87:0/4031208141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c525baf0 0x5557c525bf10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb1880103f0 tx=0x7fb188001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be7b38181d67c64 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.237+0000 7fb071ffb640 1 -- 172.21.15.87:0/4031208141 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb18802ad80 con 0x5557c525baf0 2024-05-08T18:31:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.237+0000 7fb071ffb640 1 -- 172.21.15.87:0/4031208141 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1880540d0 con 0x5557c525baf0 2024-05-08T18:31:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.237+0000 7fb071ffb640 1 -- 172.21.15.87:0/4031208141 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1880014f0 con 0x5557c525baf0 2024-05-08T18:31:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.238+0000 7fb192723800 1 -- 172.21.15.87:0/4031208141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c525baf0 msgr2=0x5557c525bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.238+0000 7fb192723800 1 --2- 172.21.15.87:0/4031208141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c525baf0 0x5557c525bf10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb1880103f0 tx=0x7fb188001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.238+0000 7fb192723800 1 -- 172.21.15.87:0/4031208141 shutdown_connections 2024-05-08T18:31:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.238+0000 7fb192723800 1 --2- 172.21.15.87:0/4031208141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c525baf0 0x5557c525bf10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.238+0000 7fb192723800 1 -- 172.21.15.87:0/4031208141 >> 172.21.15.87:0/4031208141 conn(0x5557c5257e00 msgr2=0x5557c5255eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.238+0000 7fb192723800 1 -- 172.21.15.87:0/4031208141 shutdown_connections 2024-05-08T18:31:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.238+0000 7fb192723800 1 -- 172.21.15.87:0/4031208141 wait complete. 2024-05-08T18:31:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.238+0000 7fb192723800 1 Processor -- start 2024-05-08T18:31:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.238+0000 7fb192723800 1 -- start start 2024-05-08T18:31:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.238+0000 7fb192723800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c525baf0 0x5557c5263060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.238+0000 7fb192723800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5557c525ccb0 con 0x5557c525baf0 2024-05-08T18:31:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.238+0000 7fb18ecb1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c525baf0 0x5557c5263060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.238+0000 7fb18ecb1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c525baf0 0x5557c5263060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34454/0 (socket says 172.21.15.87:34454) 2024-05-08T18:31:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.238+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 learned_addr learned my addr 172.21.15.87:0/3721424298 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.239+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c52635a0 con 0x5557c525baf0 2024-05-08T18:31:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.239+0000 7fb18ecb1640 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c525baf0 0x5557c5263060 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb18804d010 tx=0x7fb188052890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.239+0000 7fb05ffff640 1 -- 172.21.15.87:0/3721424298 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb188030020 con 0x5557c525baf0 2024-05-08T18:31:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.239+0000 7fb05ffff640 1 -- 172.21.15.87:0/3721424298 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1880513f0 con 0x5557c525baf0 2024-05-08T18:31:22.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.239+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557c5263830 con 0x5557c525baf0 2024-05-08T18:31:22.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.239+0000 7fb05ffff640 1 -- 172.21.15.87:0/3721424298 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb188013a60 con 0x5557c525baf0 2024-05-08T18:31:22.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.239+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557c52664e0 con 0x5557c525baf0 2024-05-08T18:31:22.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.240+0000 7fb05ffff640 1 -- 172.21.15.87:0/3721424298 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb188033020 con 0x5557c525baf0 2024-05-08T18:31:22.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.240+0000 7fb05ffff640 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb05803bba0 0x7fb05803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.240+0000 7fb05ffff640 1 -- 172.21.15.87:0/3721424298 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb18800e040 con 0x5557c525baf0 2024-05-08T18:31:22.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.240+0000 7fb18e4b0640 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb05803bba0 0x7fb05803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.240+0000 7fb18e4b0640 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb05803bba0 0x7fb05803e060 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5557c523c860 tx=0x7fb180087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.240+0000 7fb192723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.240+0000 7fb192723800 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5557c526ed10 0x5557c52711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.240+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c5271920 con 0x5557c526ed10 2024-05-08T18:31:22.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.241+0000 7fb18dcaf640 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5557c526ed10 0x5557c52711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.241+0000 7fb18dcaf640 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5557c526ed10 0x5557c52711d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.241+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb178009050 con 0x5557c526ed10 2024-05-08T18:31:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.241+0000 7fb192723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.241+0000 7fb192723800 20 realm 2024-05-08T18:31:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.241+0000 7fb192723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.241+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c526e160 con 0x5557c526ed10 2024-05-08T18:31:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.241+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb178009050 con 0x5557c526ed10 2024-05-08T18:31:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.241+0000 7fb192723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.241+0000 7fb192723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.241+0000 7fb192723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.241+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c5272410 con 0x5557c526ed10 2024-05-08T18:31:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.242+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb178009050 con 0x5557c526ed10 2024-05-08T18:31:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.242+0000 7fb192723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.242+0000 7fb192723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.242+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c5272ce0 con 0x5557c526ed10 2024-05-08T18:31:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.242+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb178009050 con 0x5557c526ed10 2024-05-08T18:31:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.242+0000 7fb192723800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.242+0000 7fb192723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.242+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c5273080 con 0x5557c526ed10 2024-05-08T18:31:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.242+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb178009050 con 0x5557c526ed10 2024-05-08T18:31:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.242+0000 7fb192723800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.242+0000 7fb192723800 20 searching for the correct realm 2024-05-08T18:31:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.242+0000 7fb192723800 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5557c5274f60 0x5557c5277370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.242+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x5557c5274f60 2024-05-08T18:31:22.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.242+0000 7fb18ecb1640 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5557c5274f60 0x5557c5277370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.242+0000 7fb18ecb1640 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5557c5274f60 0x5557c5277370 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.243+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb188029070 con 0x5557c5274f60 2024-05-08T18:31:22.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.243+0000 7fb18ecb1640 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fb188035020 0x7fb18802c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.243+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x7fb188035020 2024-05-08T18:31:22.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.243+0000 7fb18e4b0640 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fb188035020 0x7fb18802c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.243+0000 7fb18e4b0640 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fb188035020 0x7fb18802c480 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.244+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb180075030 con 0x7fb188035020 2024-05-08T18:31:22.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.244+0000 7fb18e4b0640 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fb1800a2040 0x7fb18008b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.244+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x7fb1800a2040 2024-05-08T18:31:22.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.244+0000 7fb18dcaf640 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fb1800a2040 0x7fb18008b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.244+0000 7fb18dcaf640 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fb1800a2040 0x7fb18008b530 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.244+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb178009050 con 0x7fb1800a2040 2024-05-08T18:31:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.244+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x5557c526ed10 2024-05-08T18:31:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.245+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb178009050 con 0x5557c526ed10 2024-05-08T18:31:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.245+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x5557c526ed10 2024-05-08T18:31:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.245+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.245+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x7fb1800a2040 2024-05-08T18:31:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.245+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.245+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x7fb1800a2040 2024-05-08T18:31:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.246+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.246+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x7fb188035020 2024-05-08T18:31:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.246+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb180075030 con 0x7fb188035020 2024-05-08T18:31:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.246+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x5557c5274f60 2024-05-08T18:31:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.246+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb188029070 con 0x5557c5274f60 2024-05-08T18:31:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.246+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x5557c526ed10 2024-05-08T18:31:22.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.246+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.246+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x7fb1800a2040 2024-05-08T18:31:22.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.247+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.247+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x5557c526ed10 2024-05-08T18:31:22.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.247+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.247+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x7fb188035020 2024-05-08T18:31:22.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.247+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb180075030 con 0x7fb188035020 2024-05-08T18:31:22.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.247+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x5557c5274f60 2024-05-08T18:31:22.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.247+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb188029070 con 0x5557c5274f60 2024-05-08T18:31:22.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.247+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x5557c5274f60 2024-05-08T18:31:22.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.247+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb188029070 con 0x5557c5274f60 2024-05-08T18:31:22.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.247+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x7fb1800a2040 2024-05-08T18:31:22.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.248+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.248+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x5557c5274f60 2024-05-08T18:31:22.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.248+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb188029070 con 0x5557c5274f60 2024-05-08T18:31:22.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.248+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x5557c5274f60 2024-05-08T18:31:22.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.248+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb188029070 con 0x5557c5274f60 2024-05-08T18:31:22.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.248+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x5557c526ed10 2024-05-08T18:31:22.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.248+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.248+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x5557c526ed10 2024-05-08T18:31:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.249+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.249+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x7fb1800a2040 2024-05-08T18:31:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.249+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.249+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x5557c5274f60 2024-05-08T18:31:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.249+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb188029070 con 0x5557c5274f60 2024-05-08T18:31:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.249+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x7fb188035020 2024-05-08T18:31:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.249+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb180075030 con 0x7fb188035020 2024-05-08T18:31:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.249+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x5557c526ed10 2024-05-08T18:31:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.250+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.250+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x7fb1800a2040 2024-05-08T18:31:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.250+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.250+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x5557c5274f60 2024-05-08T18:31:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.251+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb188029070 con 0x5557c5274f60 2024-05-08T18:31:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.251+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x7fb1800a2040 2024-05-08T18:31:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.251+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.251+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x7fb188035020 2024-05-08T18:31:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.251+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb180075030 con 0x7fb188035020 2024-05-08T18:31:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.251+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x5557c5274f60 2024-05-08T18:31:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.251+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb188029070 con 0x5557c5274f60 2024-05-08T18:31:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.251+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x7fb1800a2040 2024-05-08T18:31:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.252+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.252+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x5557c526ed10 2024-05-08T18:31:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.252+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.252+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277a40 con 0x7fb188035020 2024-05-08T18:31:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.252+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb180075030 con 0x7fb188035020 2024-05-08T18:31:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.252+0000 7fb192723800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.252+0000 7fb192723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.252+0000 7fb192723800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.252+0000 7fb192723800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.252+0000 7fb192723800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.252+0000 7fb192723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.252+0000 7fb192723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.252+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c52739d0 con 0x5557c526ed10 2024-05-08T18:31:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.253+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.253+0000 7fb192723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.253+0000 7fb192723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.253+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c5274270 con 0x5557c526ed10 2024-05-08T18:31:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.253+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.253+0000 7fb192723800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.253+0000 7fb192723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.253+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c5277ec0 con 0x7fb1800a2040 2024-05-08T18:31:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 20 zone default found 2024-05-08T18:31:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 4 Realm: () 2024-05-08T18:31:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 20 zonegroup default 2024-05-08T18:31:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c5278370 con 0x7fb1800a2040 2024-05-08T18:31:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c5279d50 con 0x5557c5274f60 2024-05-08T18:31:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb188029070 con 0x5557c5274f60 2024-05-08T18:31:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c527a1e0 con 0x5557c5274f60 2024-05-08T18:31:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb188029070 con 0x5557c5274f60 2024-05-08T18:31:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 20 started sync module instance, tier type = 2024-05-08T18:31:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.254+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c52791e0 con 0x7fb188035020 2024-05-08T18:31:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.255+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb180075030 con 0x7fb188035020 2024-05-08T18:31:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.255+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93835458221520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c5278e40 con 0x7fb188035020 2024-05-08T18:31:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.255+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527b110 con 0x5557c526ed10 2024-05-08T18:31:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.256+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93835458221520] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb180075030 con 0x7fb188035020 2024-05-08T18:31:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.256+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.256+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93835458227296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527b530 con 0x5557c526ed10 2024-05-08T18:31:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.256+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527bef0 con 0x5557c5274f60 2024-05-08T18:31:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.257+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb188029070 con 0x5557c5274f60 2024-05-08T18:31:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.257+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93835458230848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527c790 con 0x5557c5274f60 2024-05-08T18:31:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.257+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527d270 con 0x7fb188035020 2024-05-08T18:31:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.258+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93835458227296] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.258+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93835458230848] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb188029070 con 0x5557c5274f60 2024-05-08T18:31:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.258+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb180075030 con 0x7fb188035020 2024-05-08T18:31:22.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.259+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93835458228352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527c790 con 0x7fb188035020 2024-05-08T18:31:22.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.259+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527db50 con 0x5557c526ed10 2024-05-08T18:31:22.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.259+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93835458228352] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb180075030 con 0x7fb188035020 2024-05-08T18:31:22.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.260+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.260+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93835458233056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527df40 con 0x5557c526ed10 2024-05-08T18:31:22.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.260+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527e940 con 0x7fb1800a2040 2024-05-08T18:31:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.260+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.261+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93835458241616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527e8b0 con 0x7fb1800a2040 2024-05-08T18:31:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.261+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527f910 con 0x7fb1800a2040 2024-05-08T18:31:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.261+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93835458233056] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.261+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93835458241616] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.262+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.262+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93835458243888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527f8d0 con 0x7fb1800a2040 2024-05-08T18:31:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.262+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527fd70 con 0x7fb1800a2040 2024-05-08T18:31:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.263+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.263+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93835458238048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c52801e0 con 0x7fb1800a2040 2024-05-08T18:31:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.263+0000 7fb192723800 20 add_watcher() i=0 2024-05-08T18:31:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.263+0000 7fb192723800 20 add_watcher() i=1 2024-05-08T18:31:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.263+0000 7fb192723800 20 add_watcher() i=2 2024-05-08T18:31:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.263+0000 7fb192723800 20 add_watcher() i=3 2024-05-08T18:31:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.263+0000 7fb192723800 20 add_watcher() i=4 2024-05-08T18:31:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.263+0000 7fb192723800 20 add_watcher() i=5 2024-05-08T18:31:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.263+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93835458243888] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.263+0000 7fb192723800 20 add_watcher() i=6 2024-05-08T18:31:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.263+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93835458238048] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.263+0000 7fb192723800 20 add_watcher() i=7 2024-05-08T18:31:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.263+0000 7fb192723800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.264+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c52801e0 con 0x5557c526ed10 2024-05-08T18:31:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.264+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.264+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93835458247904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c5280100 con 0x5557c526ed10 2024-05-08T18:31:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.265+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93835458247904] v27'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.265+0000 7fb044fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.265+0000 7fb192723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.265+0000 7fb192723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.265+0000 7fb192723800 5 note: GC not initialized 2024-05-08T18:31:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.266+0000 7fafbf7fe640 20 reqs_thread_entry: start 2024-05-08T18:31:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.266+0000 7fb192723800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.266+0000 7fb192723800 20 Filter name: none 2024-05-08T18:31:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.266+0000 7fafbd7fa640 20 reqs_thread_entry: start 2024-05-08T18:31:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.266+0000 7fb192723800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-08T18:31:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.266+0000 7fb192723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.266+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c52b68a0 con 0x7fb1800a2040 2024-05-08T18:31:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.267+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.267+0000 7fb192723800 20 rados_obj.operate() r=0 bl.length=419 2024-05-08T18:31:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.267+0000 7fb192723800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-05-08T18:31:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.267+0000 7fb192723800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T18:31:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.267+0000 7fb192723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.267+0000 7fb192723800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:31:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.267+0000 7fb192723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.267+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c52b8370 con 0x7fb188035020 2024-05-08T18:31:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.267+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb180075030 con 0x7fb188035020 2024-05-08T18:31:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.267+0000 7fb192723800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.267+0000 7fb192723800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:31:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.267+0000 7fb192723800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.267+0000 7fb192723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 : miss 2024-05-08T18:31:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.267+0000 7fb192723800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.267+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c52ba290 con 0x5557c5274f60 2024-05-08T18:31:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.268+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb188029070 con 0x5557c5274f60 2024-05-08T18:31:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.268+0000 7fb192723800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.268+0000 7fb192723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x17 2024-05-08T18:31:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.268+0000 7fb192723800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.268+0000 7fb192723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.268+0000 7fb192723800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.268+0000 7fb192723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 2024-05-08T18:31:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.268+0000 7fb192723800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-05-08T18:31:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.268+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c52be680 con 0x7fb188035020 2024-05-08T18:31:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.269+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(65 foo.buckets [call] v27'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb180075030 con 0x7fb188035020 2024-05-08T18:31:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.269+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 8.15 8:aae63b4c:root::.bucket.meta.testx%3amyfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c52c1f90 con 0x5557c5274f60 2024-05-08T18:31:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.270+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [create,call,writefull 0~412,setxattr (203)] v27'3 uv3 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7fb188029070 con 0x5557c5274f60 2024-05-08T18:31:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.270+0000 7fb192723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x7 2024-05-08T18:31:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.270+0000 7fb192723800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.270+0000 7fb192723800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-05-08T18:31:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.270+0000 7fb192723800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1, ofs0, ns] 2024-05-08T18:31:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.270+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 93835458509840 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c52c18d0 con 0x7fb1800a2040 2024-05-08T18:31:22.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.271+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== watch-notify(notify (1) cookie 93835458238048 notify 115964117000 ret 0) ==== 889+0+0 (crc 0 0 0) 0x5557c513f130 con 0x7fb1800a2040 2024-05-08T18:31:22.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.271+0000 7fb071ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117000 cookie 93835458238048 notifier 4536 bl.length()=847 2024-05-08T18:31:22.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.271+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(67 notify.7 [notify cookie 93835458509840 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.271+0000 7fb071ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x7 2024-05-08T18:31:22.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.271+0000 7fb071ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:22.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.271+0000 7fb071ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-05-08T18:31:22.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.271+0000 7fb071ffb640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fb054003ea0 con 0x7fb1800a2040 2024-05-08T18:31:22.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.271+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== watch-notify(notify_complete (2) cookie 93835458509840 notify 115964117000 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb17802ea80 con 0x7fb1800a2040 2024-05-08T18:31:22.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.271+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.271+0000 7fb192723800 20 handle_bi_update(): bucket=testx:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): orig_sources= new_sources= 2024-05-08T18:31:22.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.271+0000 7fb192723800 20 handle_bi_update(): bucket=testx:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): potential sources added=[] removed=[] 2024-05-08T18:31:22.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.271+0000 7fb192723800 20 handle_bi_update(): bucket=testx:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): orig_dests= new_dests= 2024-05-08T18:31:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.271+0000 7fb192723800 20 handle_bi_update(): bucket=testx:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): potential dests added=[] removed=[] 2024-05-08T18:31:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.271+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c52c1d00 con 0x5557c526ed10 2024-05-08T18:31:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.272+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v27'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.272+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c52c0c20 con 0x5557c526ed10 2024-05-08T18:31:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.274+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v27'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.274+0000 7fb192723800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-05-08T18:31:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.274+0000 7fb192723800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-08T18:31:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.274+0000 7fb192723800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-05-08T18:31:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.274+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 93835458517072 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c52c0c20 con 0x5557c526ed10 2024-05-08T18:31:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.274+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== watch-notify(notify (1) cookie 93835458233056 notify 115964117003 ret 0) ==== 390+0+0 (crc 0 0 0) 0x5557c52c1d00 con 0x5557c526ed10 2024-05-08T18:31:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.274+0000 7fb071ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117003 cookie 93835458233056 notifier 4536 bl.length()=348 2024-05-08T18:31:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.274+0000 7fb071ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-05-08T18:31:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.274+0000 7fb071ffb640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-08T18:31:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.274+0000 7fb071ffb640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fb054003ea0 con 0x5557c526ed10 2024-05-08T18:31:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.274+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(71 notify.4 [notify cookie 93835458517072 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.274+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.274+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== watch-notify(notify_complete (2) cookie 93835458517072 notify 115964117003 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5557c52c1520 con 0x5557c526ed10 2024-05-08T18:31:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.274+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c52c1850 con 0x7fb188035020 2024-05-08T18:31:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.276+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(73 myfoo [call,delete] v27'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7fb180075030 con 0x7fb188035020 2024-05-08T18:31:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.276+0000 7fb192723800 10 removing default.rgw.meta+root+myfoo from cache 2024-05-08T18:31:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.276+0000 7fb192723800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:31:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.276+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93835458517072 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c52bec00 con 0x7fb1800a2040 2024-05-08T18:31:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.276+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== watch-notify(notify (1) cookie 93835458243888 notify 115964117001 ret 0) ==== 191+0+0 (crc 0 0 0) 0x5557c52c1520 con 0x7fb1800a2040 2024-05-08T18:31:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.276+0000 7fb0717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117001 cookie 93835458243888 notifier 4536 bl.length()=149 2024-05-08T18:31:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.276+0000 7fb0717fa640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fafc40032c0 con 0x7fb1800a2040 2024-05-08T18:31:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.276+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(74 notify.6 [notify cookie 93835458517072 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.276+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== watch-notify(notify_complete (2) cookie 93835458517072 notify 115964117001 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb17802ea80 con 0x7fb1800a2040 2024-05-08T18:31:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.276+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.276+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:76 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c52c1f20 con 0x5557c5274f60 2024-05-08T18:31:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.277+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(76 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call,delete] v27'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb188029070 con 0x5557c5274f60 2024-05-08T18:31:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.277+0000 7fb192723800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 from cache 2024-05-08T18:31:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.277+0000 7fb192723800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1, ofs0, ns] 2024-05-08T18:31:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.278+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93835458516816 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5557c52c1f20 con 0x7fb188035020 2024-05-08T18:31:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.278+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== watch-notify(notify (1) cookie 93835458221520 notify 115964117014 ret 0) ==== 248+0+0 (crc 0 0 0) 0x7fb180091040 con 0x7fb188035020 2024-05-08T18:31:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.278+0000 7fb071ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117014 cookie 93835458221520 notifier 4536 bl.length()=206 2024-05-08T18:31:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.278+0000 7fb071ffb640 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fb054003ea0 con 0x7fb188035020 2024-05-08T18:31:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.278+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(77 notify.0 [notify cookie 93835458516816 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb180075030 con 0x7fb188035020 2024-05-08T18:31:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.278+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== watch-notify(notify_complete (2) cookie 93835458516816 notify 115964117014 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5557c5236770 con 0x7fb188035020 2024-05-08T18:31:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.278+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb180075030 con 0x7fb188035020 2024-05-08T18:31:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.279+0000 7fb044fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.279+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93835458247904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c52b9b40 con 0x5557c526ed10 2024-05-08T18:31:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.280+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 93835458247904] v27'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.280+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93835458221520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527fce0 con 0x7fb188035020 2024-05-08T18:31:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.281+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 93835458221520] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb180075030 con 0x7fb188035020 2024-05-08T18:31:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.281+0000 7fb192723800 20 remove_watcher() i=0 2024-05-08T18:31:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.281+0000 7fb192723800 2 removed watcher, disabling cache 2024-05-08T18:31:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.281+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93835458227296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527fce0 con 0x5557c526ed10 2024-05-08T18:31:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.282+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 93835458227296] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.282+0000 7fb192723800 20 remove_watcher() i=1 2024-05-08T18:31:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.282+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93835458230848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527ac60 con 0x5557c5274f60 2024-05-08T18:31:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.283+0000 7fb18ecb1640 1 -- 172.21.15.87:0/3721424298 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 93835458230848] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb188029070 con 0x5557c5274f60 2024-05-08T18:31:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.283+0000 7fb192723800 20 remove_watcher() i=2 2024-05-08T18:31:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.283+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93835458228352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527ac60 con 0x7fb188035020 2024-05-08T18:31:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.284+0000 7fb18e4b0640 1 -- 172.21.15.87:0/3721424298 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 93835458228352] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb180075030 con 0x7fb188035020 2024-05-08T18:31:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.284+0000 7fb192723800 20 remove_watcher() i=3 2024-05-08T18:31:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.284+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93835458233056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c52795d0 con 0x5557c526ed10 2024-05-08T18:31:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.285+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 93835458233056] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x5557c526ed10 2024-05-08T18:31:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.285+0000 7fb192723800 20 remove_watcher() i=4 2024-05-08T18:31:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.285+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93835458241616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c52795d0 con 0x7fb1800a2040 2024-05-08T18:31:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.286+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 93835458241616] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.286+0000 7fb192723800 20 remove_watcher() i=5 2024-05-08T18:31:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.286+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93835458243888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c527e450 con 0x7fb1800a2040 2024-05-08T18:31:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.287+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 93835458243888] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.287+0000 7fb192723800 20 remove_watcher() i=6 2024-05-08T18:31:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.287+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93835458238048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5557c52795d0 con 0x7fb1800a2040 2024-05-08T18:31:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.288+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 <== osd.0 v2:172.21.15.53:6800/443747735 29 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 93835458238048] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17802a040 con 0x7fb1800a2040 2024-05-08T18:31:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.288+0000 7fb192723800 20 remove_watcher() i=7 2024-05-08T18:31:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.288+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fb1800a2040 msgr2=0x7fb18008b530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.288+0000 7fb192723800 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fb1800a2040 0x7fb18008b530 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.288+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5557c526ed10 msgr2=0x5557c52711d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.288+0000 7fb192723800 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5557c526ed10 0x5557c52711d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.288+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fb188035020 msgr2=0x7fb18802c480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.288+0000 7fb192723800 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fb188035020 0x7fb18802c480 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.288+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5557c5274f60 msgr2=0x5557c5277370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.288+0000 7fb192723800 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5557c5274f60 0x5557c5277370 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb05803bba0 msgr2=0x7fb05803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb05803bba0 0x7fb05803e060 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5557c523c860 tx=0x7fb180087000 comp rx=0 tx=0).stop 2024-05-08T18:31:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c525baf0 msgr2=0x5557c5263060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 --2- 172.21.15.87:0/3721424298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c525baf0 0x5557c5263060 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb18804d010 tx=0x7fb188052890 comp rx=0 tx=0).stop 2024-05-08T18:31:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb18dcaf640 1 -- 172.21.15.87:0/3721424298 reap_dead start 2024-05-08T18:31:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 shutdown_connections 2024-05-08T18:31:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 >> 172.21.15.87:0/3721424298 conn(0x5557c5257e00 msgr2=0x5557c52554b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 shutdown_connections 2024-05-08T18:31:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 -- 172.21.15.87:0/3721424298 wait complete. 2024-05-08T18:31:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 -- 172.21.15.87:0/1446209535 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb06803bba0 msgr2=0x7fb06803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 --2- 172.21.15.87:0/1446209535 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb06803bba0 0x7fb06803e060 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb18005b730 tx=0x7fb180053f50 comp rx=0 tx=0).stop 2024-05-08T18:31:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 -- 172.21.15.87:0/1446209535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c524e860 msgr2=0x5557c524ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 --2- 172.21.15.87:0/1446209535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c524e860 0x5557c524ec80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x5557c52346f0 tx=0x7fb1880178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 -- 172.21.15.87:0/1446209535 shutdown_connections 2024-05-08T18:31:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 --2- 172.21.15.87:0/1446209535 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb06803bba0 0x7fb06803e060 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 --2- 172.21.15.87:0/1446209535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c524e860 0x5557c524ec80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 -- 172.21.15.87:0/1446209535 >> 172.21.15.87:0/1446209535 conn(0x5557c5242900 msgr2=0x5557c5242d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 -- 172.21.15.87:0/1446209535 shutdown_connections 2024-05-08T18:31:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.289+0000 7fb192723800 1 -- 172.21.15.87:0/1446209535 wait complete. 2024-05-08T18:31:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.290+0000 7fb192723800 1 -- 172.21.15.87:0/4286931261 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5557c523dc60 msgr2=0x5557c5240050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.290+0000 7fb192723800 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5557c523dc60 0x5557c5240050 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.290+0000 7fb192723800 1 -- 172.21.15.87:0/4286931261 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5557c513b620 msgr2=0x5557c523a530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.290+0000 7fb192723800 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5557c513b620 0x5557c523a530 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.290+0000 7fb192723800 1 -- 172.21.15.87:0/4286931261 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb07403bba0 msgr2=0x7fb07403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.290+0000 7fb192723800 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb07403bba0 0x7fb07403e060 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb178000f60 tx=0x7fb1780012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.290+0000 7fb192723800 1 -- 172.21.15.87:0/4286931261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 msgr2=0x5557c52332f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.290+0000 7fb192723800 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 0x5557c52332f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb18000a470 tx=0x7fb180003020 comp rx=0 tx=0).stop 2024-05-08T18:31:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.290+0000 7fb192723800 1 -- 172.21.15.87:0/4286931261 shutdown_connections 2024-05-08T18:31:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.290+0000 7fb192723800 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5557c513b620 0x5557c523a530 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.290+0000 7fb192723800 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5557c523dc60 0x5557c5240050 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.290+0000 7fb192723800 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb07403bba0 0x7fb07403e060 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.290+0000 7fb192723800 1 --2- 172.21.15.87:0/4286931261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557c5138cf0 0x5557c52332f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.290+0000 7fb192723800 1 -- 172.21.15.87:0/4286931261 >> 172.21.15.87:0/4286931261 conn(0x5557c5132740 msgr2=0x5557c5137410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.290+0000 7fb192723800 1 -- 172.21.15.87:0/4286931261 shutdown_connections 2024-05-08T18:31:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.290+0000 7fb192723800 1 -- 172.21.15.87:0/4286931261 wait complete. 2024-05-08T18:31:22.306 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-05-08T18:31:22.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-05-08T18:31:22.306 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-05-08T18:31:22.350 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:22.350 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:22.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.352+0000 7f0b0fe12800 1 Processor -- start 2024-05-08T18:31:22.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.352+0000 7f0b0fe12800 1 -- start start 2024-05-08T18:31:22.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.352+0000 7f0b0fe12800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55945ea6b2b0 0x55945ea6b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.352+0000 7f0b0fe12800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55945ea6bd50 con 0x55945ea6c470 2024-05-08T18:31:22.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.352+0000 7f0b0fe12800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55945e90be20 con 0x55945ea6b2b0 2024-05-08T18:31:22.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.353+0000 7f0b0b476640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55945ea6b2b0 0x55945ea6b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.353+0000 7f0b03fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55945ea6c470 0x55945ea6c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42184/0 (socket says 172.21.15.87:42184) 2024-05-08T18:31:22.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.353+0000 7f0b03fff640 1 -- 172.21.15.87:0/3274225012 learned_addr learned my addr 172.21.15.87:0/3274225012 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:22.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.353+0000 7f0b0b476640 1 -- 172.21.15.87:0/3274225012 >> v1:172.21.15.53:6789/0 conn(0x55945ea6c470 legacy=0x55945ea6c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.353+0000 7f0b0b476640 1 -- 172.21.15.87:0/3274225012 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55945ea6d030 con 0x55945ea6b2b0 2024-05-08T18:31:22.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.355+0000 7f0b0b476640 1 --2- 172.21.15.87:0/3274225012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 0x55945ea6b6d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00a470 tx=0x7f0afc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e920ec83bc8f69c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.355+0000 7f0b0ac75640 1 -- 172.21.15.87:0/3274225012 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0afc057070 con 0x55945ea6b2b0 2024-05-08T18:31:22.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.355+0000 7f0b0ac75640 1 -- 172.21.15.87:0/3274225012 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0afc04adc0 con 0x55945ea6b2b0 2024-05-08T18:31:22.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.355+0000 7f0b0ac75640 1 -- 172.21.15.87:0/3274225012 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0afc052590 con 0x55945ea6b2b0 2024-05-08T18:31:22.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.356+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3274225012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 msgr2=0x55945ea6b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.356+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/3274225012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 0x55945ea6b6d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00a470 tx=0x7f0afc01ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:22.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.356+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3274225012 shutdown_connections 2024-05-08T18:31:22.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.356+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/3274225012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 0x55945ea6b6d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.356+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3274225012 >> 172.21.15.87:0/3274225012 conn(0x55945ea66830 msgr2=0x55945ea68c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.356+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3274225012 shutdown_connections 2024-05-08T18:31:22.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.356+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3274225012 wait complete. 2024-05-08T18:31:22.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.369+0000 7f0b0fe12800 1 Processor -- start 2024-05-08T18:31:22.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.369+0000 7f0b0fe12800 1 -- start start 2024-05-08T18:31:22.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.369+0000 7f0b0fe12800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 0x55945eb5c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.369+0000 7f0b0fe12800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55945e9b65b0 con 0x55945ea6b2b0 2024-05-08T18:31:22.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.370+0000 7f0b0b476640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 0x55945eb5c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.370+0000 7f0b0b476640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 0x55945eb5c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34474/0 (socket says 172.21.15.87:34474) 2024-05-08T18:31:22.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.370+0000 7f0b0b476640 1 -- 172.21.15.87:0/2107528091 learned_addr learned my addr 172.21.15.87:0/2107528091 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.370+0000 7f0b0b476640 1 -- 172.21.15.87:0/2107528091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55945eb5cda0 con 0x55945ea6b2b0 2024-05-08T18:31:22.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.370+0000 7f0b0b476640 1 --2- 172.21.15.87:0/2107528091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 0x55945eb5c7d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0afc055040 tx=0x7f0afc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656724c697a3e523 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.370+0000 7f09f960a640 1 -- 172.21.15.87:0/2107528091 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0afc057040 con 0x55945ea6b2b0 2024-05-08T18:31:22.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.371+0000 7f09f960a640 1 -- 172.21.15.87:0/2107528091 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0afc063070 con 0x55945ea6b2b0 2024-05-08T18:31:22.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.371+0000 7f09f960a640 1 -- 172.21.15.87:0/2107528091 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0afc05d790 con 0x55945ea6b2b0 2024-05-08T18:31:22.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.371+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2107528091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 msgr2=0x55945eb5c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.371+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/2107528091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 0x55945eb5c7d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0afc055040 tx=0x7f0afc04c000 comp rx=0 tx=0).stop 2024-05-08T18:31:22.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.371+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2107528091 shutdown_connections 2024-05-08T18:31:22.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.371+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/2107528091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 0x55945eb5c7d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.371+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2107528091 >> 172.21.15.87:0/2107528091 conn(0x55945ea66830 msgr2=0x55945eb580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.371+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2107528091 shutdown_connections 2024-05-08T18:31:22.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.371+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2107528091 wait complete. 2024-05-08T18:31:22.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.372+0000 7f0b0fe12800 1 Processor -- start 2024-05-08T18:31:22.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.372+0000 7f0b0fe12800 1 -- start start 2024-05-08T18:31:22.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.372+0000 7f0b0fe12800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 0x55945eb64290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.372+0000 7f0b0fe12800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55945ea74940 con 0x55945ea6b2b0 2024-05-08T18:31:22.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.372+0000 7f0b0b476640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 0x55945eb64290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.372+0000 7f0b0b476640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 0x55945eb64290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34488/0 (socket says 172.21.15.87:34488) 2024-05-08T18:31:22.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.372+0000 7f0b0b476640 1 -- 172.21.15.87:0/2031307055 learned_addr learned my addr 172.21.15.87:0/2031307055 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.372+0000 7f0b0b476640 1 -- 172.21.15.87:0/2031307055 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55945eb647d0 con 0x55945ea6b2b0 2024-05-08T18:31:22.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.372+0000 7f0b0b476640 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 0x55945eb64290 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00a470 tx=0x7f0afc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.372+0000 7f09f7e07640 1 -- 172.21.15.87:0/2031307055 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0afc057050 con 0x55945ea6b2b0 2024-05-08T18:31:22.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.372+0000 7f09f7e07640 1 -- 172.21.15.87:0/2031307055 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0afc05dd40 con 0x55945ea6b2b0 2024-05-08T18:31:22.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.373+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2031307055 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55945eb64a60 con 0x55945ea6b2b0 2024-05-08T18:31:22.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.373+0000 7f09f7e07640 1 -- 172.21.15.87:0/2031307055 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0afc052570 con 0x55945ea6b2b0 2024-05-08T18:31:22.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.373+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2031307055 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55945eb67670 con 0x55945ea6b2b0 2024-05-08T18:31:22.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.373+0000 7f09f7e07640 1 -- 172.21.15.87:0/2031307055 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f0afc052710 con 0x55945ea6b2b0 2024-05-08T18:31:22.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.374+0000 7f09f7e07640 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f09f003bba0 0x7f09f003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.374+0000 7f09f7e07640 1 -- 172.21.15.87:0/2031307055 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f0afc0940d0 con 0x55945ea6b2b0 2024-05-08T18:31:22.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.374+0000 7f0b03fff640 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f09f003bba0 0x7f09f003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.374+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55945ea6c470 0x55945eb6b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.374+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2031307055 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945eb6b970 con 0x55945ea6c470 2024-05-08T18:31:22.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.374+0000 7f0b0bc77640 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55945ea6c470 0x55945eb6b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.374+0000 7f0b03fff640 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f09f003bba0 0x7f09f003e060 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0af4000f60 tx=0x7f0af40012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.374+0000 7f0b0bc77640 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55945ea6c470 0x55945eb6b430 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.374+0000 7f0b0bc77640 1 -- 172.21.15.87:0/2031307055 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b0400a4a0 con 0x55945ea6c470 2024-05-08T18:31:22.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.375+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2031307055 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945eb68a00 con 0x55945ea6c470 2024-05-08T18:31:22.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.375+0000 7f0b0bc77640 1 -- 172.21.15.87:0/2031307055 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b0400a4a0 con 0x55945ea6c470 2024-05-08T18:31:22.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.375+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2031307055 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945eb6d770 con 0x55945ea6c470 2024-05-08T18:31:22.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.375+0000 7f0b0bc77640 1 -- 172.21.15.87:0/2031307055 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0b0400a4a0 con 0x55945ea6c470 2024-05-08T18:31:22.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.375+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2031307055 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945eb6c9a0 con 0x55945ea6c470 2024-05-08T18:31:22.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.375+0000 7f0b0bc77640 1 -- 172.21.15.87:0/2031307055 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b0400a4a0 con 0x55945ea6c470 2024-05-08T18:31:22.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.375+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55945eb6eb20 0x55945eb70f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.375+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2031307055 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945eb71450 con 0x55945eb6eb20 2024-05-08T18:31:22.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.376+0000 7f0b0b476640 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55945eb6eb20 0x55945eb70f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.376+0000 7f0b0b476640 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55945eb6eb20 0x55945eb70f10 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.376+0000 7f0b0b476640 1 -- 172.21.15.87:0/2031307055 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0afc078070 con 0x55945eb6eb20 2024-05-08T18:31:22.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.376+0000 7f0b0fe12800 1 Processor -- start 2024-05-08T18:31:22.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.377+0000 7f0b0fe12800 1 -- start start 2024-05-08T18:31:22.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.377+0000 7f0b0fe12800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945e9e0ed0 0x55945e9df340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.377+0000 7f0b0fe12800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55945e95cfc0 con 0x55945e9e0ed0 2024-05-08T18:31:22.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.377+0000 7f0b0bc77640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945e9e0ed0 0x55945e9df340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.377+0000 7f0b0bc77640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945e9e0ed0 0x55945e9df340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34496/0 (socket says 172.21.15.87:34496) 2024-05-08T18:31:22.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.377+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3084300307 learned_addr learned my addr 172.21.15.87:0/3084300307 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.377+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3084300307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55945e9df880 con 0x55945e9e0ed0 2024-05-08T18:31:22.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.377+0000 7f0b0bc77640 1 --2- 172.21.15.87:0/3084300307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945e9e0ed0 0x55945e9df340 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x55945eb655f0 tx=0x7f0b040178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.377+0000 7f09f5602640 1 -- 172.21.15.87:0/3084300307 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b04013440 con 0x55945e9e0ed0 2024-05-08T18:31:22.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.377+0000 7f09f5602640 1 -- 172.21.15.87:0/3084300307 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b040135e0 con 0x55945e9e0ed0 2024-05-08T18:31:22.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.377+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3084300307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55945e9dfb10 con 0x55945e9e0ed0 2024-05-08T18:31:22.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.377+0000 7f09f5602640 1 -- 172.21.15.87:0/3084300307 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b040138c0 con 0x55945e9e0ed0 2024-05-08T18:31:22.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.377+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3084300307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55945e9e0010 con 0x55945e9e0ed0 2024-05-08T18:31:22.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.378+0000 7f09f5602640 1 -- 172.21.15.87:0/3084300307 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f0b04011040 con 0x55945e9e0ed0 2024-05-08T18:31:22.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.378+0000 7f09f5602640 1 --2- 172.21.15.87:0/3084300307 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f09e403bba0 0x7f09e403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.378+0000 7f09f5602640 1 -- 172.21.15.87:0/3084300307 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f0b0401d070 con 0x55945e9e0ed0 2024-05-08T18:31:22.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.379+0000 7f0b0b476640 1 --2- 172.21.15.87:0/3084300307 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f09e403bba0 0x7f09e403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.379+0000 7f0b0fe12800 1 Processor -- start 2024-05-08T18:31:22.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.379+0000 7f0b0fe12800 1 -- start start 2024-05-08T18:31:22.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.379+0000 7f0b0b476640 1 --2- 172.21.15.87:0/3084300307 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f09e403bba0 0x7f09e403e060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0afc05b520 tx=0x7f0afc07e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.379+0000 7f0b0fe12800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945eb8ebe0 0x55945eb8f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.379+0000 7f0b0fe12800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55945eb5d060 con 0x55945eb8ebe0 2024-05-08T18:31:22.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.379+0000 7f0b0bc77640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945eb8ebe0 0x55945eb8f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.379+0000 7f0b0bc77640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945eb8ebe0 0x55945eb8f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34510/0 (socket says 172.21.15.87:34510) 2024-05-08T18:31:22.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.379+0000 7f0b0bc77640 1 -- 172.21.15.87:0/1419318494 learned_addr learned my addr 172.21.15.87:0/1419318494 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.379+0000 7f0b0bc77640 1 -- 172.21.15.87:0/1419318494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55945eb8f5d0 con 0x55945eb8ebe0 2024-05-08T18:31:22.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.380+0000 7f0b0bc77640 1 --2- 172.21.15.87:0/1419318494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945eb8ebe0 0x55945eb8f000 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0b04052990 tx=0x7f0b04029430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70620ee3a9f873c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.380+0000 7f09eeffd640 1 -- 172.21.15.87:0/1419318494 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b040540d0 con 0x55945eb8ebe0 2024-05-08T18:31:22.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.380+0000 7f09eeffd640 1 -- 172.21.15.87:0/1419318494 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b04054270 con 0x55945eb8ebe0 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.380+0000 7f09eeffd640 1 -- 172.21.15.87:0/1419318494 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b04001660 con 0x55945eb8ebe0 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.380+0000 7f0b0fe12800 1 -- 172.21.15.87:0/1419318494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945eb8ebe0 msgr2=0x55945eb8f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.380+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/1419318494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945eb8ebe0 0x55945eb8f000 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0b04052990 tx=0x7f0b04029430 comp rx=0 tx=0).stop 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.380+0000 7f0b0fe12800 1 -- 172.21.15.87:0/1419318494 shutdown_connections 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.380+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/1419318494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945eb8ebe0 0x55945eb8f000 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.380+0000 7f0b0fe12800 1 -- 172.21.15.87:0/1419318494 >> 172.21.15.87:0/1419318494 conn(0x55945eb8aef0 msgr2=0x55945eb88f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.380+0000 7f0b0fe12800 1 -- 172.21.15.87:0/1419318494 shutdown_connections 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.380+0000 7f0b0fe12800 1 -- 172.21.15.87:0/1419318494 wait complete. 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.380+0000 7f0b0fe12800 1 Processor -- start 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.380+0000 7f0b0fe12800 1 -- start start 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.381+0000 7f0b0fe12800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945eb8ebe0 0x55945eb961c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.381+0000 7f0b0fe12800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55945eb8fd20 con 0x55945eb8ebe0 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.381+0000 7f0b0bc77640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945eb8ebe0 0x55945eb961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.381+0000 7f0b0bc77640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945eb8ebe0 0x55945eb961c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34516/0 (socket says 172.21.15.87:34516) 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.381+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 learned_addr learned my addr 172.21.15.87:0/3993840806 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.381+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55945eb96700 con 0x55945eb8ebe0 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.381+0000 7f0b0bc77640 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945eb8ebe0 0x55945eb961c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0b04001f40 tx=0x7f0b040528f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.381+0000 7f09ed7fa640 1 -- 172.21.15.87:0/3993840806 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b04030020 con 0x55945eb8ebe0 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.381+0000 7f09ed7fa640 1 -- 172.21.15.87:0/3993840806 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b04015ad0 con 0x55945eb8ebe0 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.381+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55945eb96990 con 0x55945eb8ebe0 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.381+0000 7f09ed7fa640 1 -- 172.21.15.87:0/3993840806 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b040540d0 con 0x55945eb8ebe0 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.381+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55945eb99640 con 0x55945eb8ebe0 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.382+0000 7f09ed7fa640 1 -- 172.21.15.87:0/3993840806 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f0b04033020 con 0x55945eb8ebe0 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.382+0000 7f09ed7fa640 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f09d403bb00 0x7f09d403dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.382+0000 7f09ed7fa640 1 -- 172.21.15.87:0/3993840806 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f0b0400e040 con 0x55945eb8ebe0 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.382+0000 7f0b0b476640 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f09d403bb00 0x7f09d403dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.383+0000 7f0b0fe12800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.383+0000 7f0b0b476640 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f09d403bb00 0x7f09d403dfc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55945eb6d6d0 tx=0x7f0afc083000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.383+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55945eba1c50 0x55945eba4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.383+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945eba4860 con 0x55945eba1c50 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.383+0000 7f0b03fff640 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55945eba1c50 0x55945eba4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.383+0000 7f0b03fff640 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55945eba1c50 0x55945eba4110 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.383+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0af4009050 con 0x55945eba1c50 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.383+0000 7f0b0fe12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.383+0000 7f0b0fe12800 20 realm 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.383+0000 7f0b0fe12800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.383+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945eba10a0 con 0x55945eba1c50 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0af4009050 con 0x55945eba1c50 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b0fe12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b0fe12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b0fe12800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945eba5340 con 0x55945eba1c50 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0af4009050 con 0x55945eba1c50 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b0fe12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b0fe12800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945eba5c10 con 0x55945eba1c50 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0af4009050 con 0x55945eba1c50 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b0fe12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b0fe12800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945eba5fb0 con 0x55945eba1c50 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0af4009050 con 0x55945eba1c50 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b0fe12800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b0fe12800 20 searching for the correct realm 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55945eba7e90 0x55945ebaa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55945ebaa930 con 0x55945eba7e90 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.384+0000 7f0b0bc77640 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55945eba7e90 0x55945ebaa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.385+0000 7f0b0bc77640 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55945eba7e90 0x55945ebaa280 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.385+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b04029070 con 0x55945eba7e90 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.385+0000 7f0b0bc77640 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f0b04035020 0x7f0b0402c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.385+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55945ebaa930 con 0x7f0b04035020 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.385+0000 7f0b0b476640 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f0b04035020 0x7f0b0402c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.386+0000 7f0b0b476640 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f0b04035020 0x7f0b0402c480 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.386+0000 7f0b0b476640 1 -- 172.21.15.87:0/3993840806 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0afc078070 con 0x7f0b04035020 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.386+0000 7f0b0b476640 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f0afc05b590 0x7f0afc088480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.386+0000 7f0b0b476640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55945ebaa930 con 0x7f0afc05b590 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.386+0000 7f0b03fff640 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f0afc05b590 0x7f0afc088480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.387+0000 7f0b03fff640 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f0afc05b590 0x7f0afc088480 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.387+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af4009050 con 0x7f0afc05b590 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.387+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55945ebaa930 con 0x55945eba1c50 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.387+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af4009050 con 0x55945eba1c50 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.387+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55945ebaa930 con 0x55945eba1c50 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.387+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.387+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55945ebaa930 con 0x7f0afc05b590 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.387+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.387+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55945ebaa930 con 0x7f0afc05b590 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.388+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.388+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55945ebaa930 con 0x7f0b04035020 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.388+0000 7f0b0b476640 1 -- 172.21.15.87:0/3993840806 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0afc078070 con 0x7f0b04035020 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.388+0000 7f0b0b476640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55945ebaa930 con 0x55945eba7e90 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.388+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b04029070 con 0x55945eba7e90 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.388+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55945ebaa930 con 0x55945eba1c50 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.388+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.388+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55945ebaa930 con 0x7f0afc05b590 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.389+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.389+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55945ebaa930 con 0x55945eba1c50 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.389+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.389+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55945ebaa930 con 0x7f0b04035020 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.389+0000 7f0b0b476640 1 -- 172.21.15.87:0/3993840806 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0afc078070 con 0x7f0b04035020 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.389+0000 7f0b0b476640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x55945eba7e90 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.389+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b04029070 con 0x55945eba7e90 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.389+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x55945eba7e90 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.390+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b04029070 con 0x55945eba7e90 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.390+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x7f0afc05b590 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.390+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.390+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x55945eba7e90 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.390+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b04029070 con 0x55945eba7e90 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.390+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x55945eba7e90 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.390+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b04029070 con 0x55945eba7e90 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.390+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x55945eba1c50 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.391+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.391+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x55945eba1c50 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.391+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.391+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x7f0afc05b590 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.392+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.392+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x55945eba7e90 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.392+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b04029070 con 0x55945eba7e90 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.392+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x7f0b04035020 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.392+0000 7f0b0b476640 1 -- 172.21.15.87:0/3993840806 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0afc078070 con 0x7f0b04035020 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.392+0000 7f0b0b476640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x55945eba1c50 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.392+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.392+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x7f0afc05b590 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.393+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.393+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x55945eba7e90 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.393+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b04029070 con 0x55945eba7e90 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.393+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x7f0afc05b590 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.393+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.393+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x7f0b04035020 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.393+0000 7f0b0b476640 1 -- 172.21.15.87:0/3993840806 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0afc078070 con 0x7f0b04035020 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.393+0000 7f0b0b476640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x55945eba7e90 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.394+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b04029070 con 0x55945eba7e90 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.394+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x7f0afc05b590 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.394+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.394+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x55945eba1c50 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.394+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.394+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0afc0a3060 con 0x7f0b04035020 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.394+0000 7f0b0b476640 1 -- 172.21.15.87:0/3993840806 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0afc078070 con 0x7f0b04035020 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945eba6930 con 0x55945eba1c50 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945eba71d0 con 0x55945eba1c50 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945eba6570 con 0x7f0afc05b590 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 20 zone default found 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 4 Realm: () 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 20 zonegroup default 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.395+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945ebaad90 con 0x7f0afc05b590 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.396+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.396+0000 7f0b0fe12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.396+0000 7f0b0fe12800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.396+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945ebacc20 con 0x55945eba7e90 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.396+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b04029070 con 0x55945eba7e90 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.396+0000 7f0b0fe12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.396+0000 7f0b0fe12800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.396+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945ebacfc0 con 0x55945eba7e90 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.396+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b04029070 con 0x55945eba7e90 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.396+0000 7f0b0fe12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.396+0000 7f0b0fe12800 20 started sync module instance, tier type = 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.396+0000 7f0b0fe12800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.396+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebac060 con 0x7f0b04035020 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.397+0000 7f0b0b476640 1 -- 172.21.15.87:0/3993840806 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0afc078070 con 0x7f0b04035020 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.397+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94095732819072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebabcc0 con 0x7f0b04035020 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.397+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebade30 con 0x55945eba1c50 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.398+0000 7f0b0b476640 1 -- 172.21.15.87:0/3993840806 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94095732819072] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0afc078070 con 0x7f0b04035020 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.399+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.399+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94095732824448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebae250 con 0x55945eba1c50 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.399+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebaec10 con 0x55945eba7e90 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.400+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94095732824448] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.400+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b04029070 con 0x55945eba7e90 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.400+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94095732825504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebae1c0 con 0x55945eba7e90 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.400+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebafad0 con 0x7f0b04035020 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.401+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94095732825504] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b04029070 con 0x55945eba7e90 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.401+0000 7f0b0b476640 1 -- 172.21.15.87:0/3993840806 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0afc078070 con 0x7f0b04035020 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.401+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94095732830208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebafad0 con 0x7f0b04035020 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.401+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebb0540 con 0x55945eba1c50 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.402+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.402+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94095732834352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebb0500 con 0x55945eba1c50 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.402+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebb14e0 con 0x7f0afc05b590 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.402+0000 7f0b0b476640 1 -- 172.21.15.87:0/3993840806 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94095732830208] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0afc078070 con 0x7f0b04035020 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.404+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94095732834352] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.405+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.405+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94095732831776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebb1000 con 0x7f0afc05b590 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.405+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebb1db0 con 0x7f0afc05b590 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.407+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94095732831776] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.407+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.407+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94095732836560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebb1000 con 0x7f0afc05b590 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.408+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebb23d0 con 0x7f0afc05b590 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.408+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94095732836560] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.408+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.409+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94095732840480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebb23d0 con 0x7f0afc05b590 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.409+0000 7f0b0fe12800 20 add_watcher() i=0 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.409+0000 7f0b0fe12800 20 add_watcher() i=1 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.409+0000 7f0b0fe12800 20 add_watcher() i=2 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.409+0000 7f0b0fe12800 20 add_watcher() i=3 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.409+0000 7f0b0fe12800 20 add_watcher() i=4 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.409+0000 7f0b0fe12800 20 add_watcher() i=5 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.409+0000 7f0b0fe12800 20 add_watcher() i=6 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.409+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94095732840480] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.409+0000 7f0b0fe12800 20 add_watcher() i=7 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.409+0000 7f0b0fe12800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.409+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945ebb5730 con 0x55945eba1c50 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.410+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.410+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94095732842640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebb2960 con 0x55945eba1c50 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.411+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94095732842640] v27'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.411+0000 7f09c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.411+0000 7f0b0fe12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.411+0000 7f0b0fe12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.411+0000 7f0b0fe12800 5 note: GC not initialized 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.411+0000 7f09c0fe1640 20 reqs_thread_entry: start 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.411+0000 7f0b0fe12800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.411+0000 7f0b0fe12800 20 Filter name: none 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.411+0000 7f093a7fc640 20 reqs_thread_entry: start 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.411+0000 7f0b0fe12800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.411+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55945ebe8730 con 0x55945eba1c50 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.413+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.413+0000 7f0b0fe12800 20 rados_obj.operate() r=0 bl.length=193 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.414+0000 7f09c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.414+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94095732842640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebb4b40 con 0x55945eba1c50 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.415+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94095732842640] v27'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.415+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94095732819072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebb2090 con 0x7f0b04035020 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.416+0000 7f0b0b476640 1 -- 172.21.15.87:0/3993840806 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94095732819072] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0afc078070 con 0x7f0b04035020 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.416+0000 7f0b0fe12800 20 remove_watcher() i=0 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.416+0000 7f0b0fe12800 2 removed watcher, disabling cache 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.416+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94095732824448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebb2090 con 0x55945eba1c50 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.417+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94095732824448] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.417+0000 7f0b0fe12800 20 remove_watcher() i=1 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.417+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94095732825504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebb2090 con 0x55945eba7e90 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.418+0000 7f0b0bc77640 1 -- 172.21.15.87:0/3993840806 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94095732825504] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b04029070 con 0x55945eba7e90 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.418+0000 7f0b0fe12800 20 remove_watcher() i=2 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.418+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94095732830208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebb2090 con 0x7f0b04035020 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.419+0000 7f0b0b476640 1 -- 172.21.15.87:0/3993840806 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94095732830208] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0afc078070 con 0x7f0b04035020 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.419+0000 7f0b0fe12800 20 remove_watcher() i=3 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.419+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94095732834352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebb2090 con 0x55945eba1c50 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.420+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94095732834352] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x55945eba1c50 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.420+0000 7f0b0fe12800 20 remove_watcher() i=4 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.420+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94095732831776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebb2090 con 0x7f0afc05b590 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.421+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94095732831776] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.421+0000 7f0b0fe12800 20 remove_watcher() i=5 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.421+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94095732836560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebaf620 con 0x7f0afc05b590 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.422+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94095732836560] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.422+0000 7f0b0fe12800 20 remove_watcher() i=6 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.422+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94095732840480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55945ebaf620 con 0x7f0afc05b590 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94095732840480] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af402a040 con 0x7f0afc05b590 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 20 remove_watcher() i=7 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f0afc05b590 msgr2=0x7f0afc088480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f0afc05b590 0x7f0afc088480 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55945eba1c50 msgr2=0x55945eba4110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55945eba1c50 0x55945eba4110 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f0b04035020 msgr2=0x7f0b0402c480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f0b04035020 0x7f0b0402c480 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55945eba7e90 msgr2=0x55945ebaa280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55945eba7e90 0x55945ebaa280 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f09d403bb00 msgr2=0x7f09d403dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f09d403bb00 0x7f09d403dfc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55945eb6d6d0 tx=0x7f0afc083000 comp rx=0 tx=0).stop 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945eb8ebe0 msgr2=0x55945eb961c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b03fff640 1 -- 172.21.15.87:0/3993840806 reap_dead start 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945eb8ebe0 0x55945eb961c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0b04001f40 tx=0x7f0b040528f0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 shutdown_connections 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/3993840806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945eb8ebe0 0x55945eb961c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 >> 172.21.15.87:0/3993840806 conn(0x55945eb8aef0 msgr2=0x55945eb88550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 shutdown_connections 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.423+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3993840806 wait complete. 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3084300307 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f09e403bba0 msgr2=0x7f09e403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/3084300307 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f09e403bba0 0x7f09e403e060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0afc05b520 tx=0x7f0afc07e040 comp rx=0 tx=0).stop 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3084300307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945e9e0ed0 msgr2=0x55945e9df340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/3084300307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945e9e0ed0 0x55945e9df340 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x55945eb655f0 tx=0x7f0b040178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3084300307 shutdown_connections 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/3084300307 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f09e403bba0 0x7f09e403e060 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/3084300307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945e9e0ed0 0x55945e9df340 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3084300307 >> 172.21.15.87:0/3084300307 conn(0x55945eb73730 msgr2=0x55945eb73b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3084300307 shutdown_connections 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 -- 172.21.15.87:0/3084300307 wait complete. 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2031307055 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55945eb6eb20 msgr2=0x55945eb70f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55945eb6eb20 0x55945eb70f10 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2031307055 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55945ea6c470 msgr2=0x55945eb6b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55945ea6c470 0x55945eb6b430 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2031307055 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f09f003bba0 msgr2=0x7f09f003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f09f003bba0 0x7f09f003e060 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0af4000f60 tx=0x7f0af40012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2031307055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 msgr2=0x55945eb64290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 0x55945eb64290 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00a470 tx=0x7f0afc002fb0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2031307055 shutdown_connections 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55945ea6c470 0x55945eb6b430 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55945eb6eb20 0x55945eb70f10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f09f003bba0 0x7f09f003e060 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 --2- 172.21.15.87:0/2031307055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55945ea6b2b0 0x55945eb64290 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2031307055 >> 172.21.15.87:0/2031307055 conn(0x55945ea66830 msgr2=0x55945eb568f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2031307055 shutdown_connections 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.424+0000 7f0b0fe12800 1 -- 172.21.15.87:0/2031307055 wait complete. 2024-05-08T18:31:22.435 INFO:teuthology.orchestra.run.smithi087.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"r+qqMptI60nfuGZL5XcVEkye","ver":2},"mtime":"2024-05-08T18:31:22.273603Z","data":{"bucket":{"name":"myfoo","marker":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1","bucket_id":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-05-08T18:31:19.867262Z","linked":true,"has_bucket_info":false}} 2024-05-08T18:31:22.436 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'r+qqMptI60nfuGZL5XcVEkye', 'ver': 2}, 'mtime': '2024-05-08T18:31:22.273603Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1', 'bucket_id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-05-08T18:31:19.867262Z', 'linked': True, 'has_bucket_info': False}} 2024-05-08T18:31:22.436 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-05-08T18:31:22.436 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-05-08T18:31:22.436 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-05-08T18:31:22.522 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:22.522 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:22.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.525+0000 7fbd34733800 1 Processor -- start 2024-05-08T18:31:22.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.525+0000 7fbd34733800 1 -- start start 2024-05-08T18:31:22.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.525+0000 7fbd34733800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b02d3014a0 0x55b02d390e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.525+0000 7fbd34733800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b02d3950d0 con 0x55b02d391380 2024-05-08T18:31:22.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.525+0000 7fbd34733800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b02d22ee20 con 0x55b02d3014a0 2024-05-08T18:31:22.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.525+0000 7fbd303ca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b02d3014a0 0x55b02d390e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.525+0000 7fbd27bc9640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55b02d391380 0x55b02d393840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:42190/0 (socket says 172.21.15.87:42190) 2024-05-08T18:31:22.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.525+0000 7fbd27bc9640 1 -- 172.21.15.87:0/191375190 learned_addr learned my addr 172.21.15.87:0/191375190 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:22.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.525+0000 7fbd303ca640 1 -- 172.21.15.87:0/191375190 >> v1:172.21.15.53:6789/0 conn(0x55b02d391380 legacy=0x55b02d393840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.525+0000 7fbd303ca640 1 -- 172.21.15.87:0/191375190 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02d396300 con 0x55b02d3014a0 2024-05-08T18:31:22.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.527+0000 7fbd303ca640 1 --2- 172.21.15.87:0/191375190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 0x55b02d390e10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000a470 tx=0x7fbd2001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c7319a7bf70d22 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.527+0000 7fbd2fbc9640 1 -- 172.21.15.87:0/191375190 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd20057070 con 0x55b02d3014a0 2024-05-08T18:31:22.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.527+0000 7fbd2fbc9640 1 -- 172.21.15.87:0/191375190 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd20052570 con 0x55b02d3014a0 2024-05-08T18:31:22.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.527+0000 7fbd2fbc9640 1 -- 172.21.15.87:0/191375190 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd20052870 con 0x55b02d3014a0 2024-05-08T18:31:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.528+0000 7fbd34733800 1 -- 172.21.15.87:0/191375190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 msgr2=0x55b02d390e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.528+0000 7fbd34733800 1 --2- 172.21.15.87:0/191375190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 0x55b02d390e10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000a470 tx=0x7fbd2001ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.528+0000 7fbd34733800 1 -- 172.21.15.87:0/191375190 shutdown_connections 2024-05-08T18:31:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.528+0000 7fbd34733800 1 --2- 172.21.15.87:0/191375190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 0x55b02d390e10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.528+0000 7fbd34733800 1 -- 172.21.15.87:0/191375190 >> 172.21.15.87:0/191375190 conn(0x55b02d388730 msgr2=0x55b02d38ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.528+0000 7fbd34733800 1 -- 172.21.15.87:0/191375190 shutdown_connections 2024-05-08T18:31:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.528+0000 7fbd34733800 1 -- 172.21.15.87:0/191375190 wait complete. 2024-05-08T18:31:22.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.541+0000 7fbd34733800 1 Processor -- start 2024-05-08T18:31:22.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.541+0000 7fbd34733800 1 -- start start 2024-05-08T18:31:22.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.541+0000 7fbd34733800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 0x55b02d38e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.541+0000 7fbd34733800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b02d2d95c0 con 0x55b02d3014a0 2024-05-08T18:31:22.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.542+0000 7fbd303ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 0x55b02d38e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.542+0000 7fbd303ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 0x55b02d38e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34532/0 (socket says 172.21.15.87:34532) 2024-05-08T18:31:22.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.542+0000 7fbd303ca640 1 -- 172.21.15.87:0/585050002 learned_addr learned my addr 172.21.15.87:0/585050002 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.542+0000 7fbd303ca640 1 -- 172.21.15.87:0/585050002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02d38cd00 con 0x55b02d3014a0 2024-05-08T18:31:22.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.542+0000 7fbd303ca640 1 --2- 172.21.15.87:0/585050002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 0x55b02d38e740 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbd20055040 tx=0x7fbd2004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1f9c166c0679d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.542+0000 7fbc1e60c640 1 -- 172.21.15.87:0/585050002 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd20057040 con 0x55b02d3014a0 2024-05-08T18:31:22.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.542+0000 7fbc1e60c640 1 -- 172.21.15.87:0/585050002 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd20052990 con 0x55b02d3014a0 2024-05-08T18:31:22.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.542+0000 7fbc1e60c640 1 -- 172.21.15.87:0/585050002 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd20052c70 con 0x55b02d3014a0 2024-05-08T18:31:22.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.543+0000 7fbd34733800 1 -- 172.21.15.87:0/585050002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 msgr2=0x55b02d38e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.543+0000 7fbd34733800 1 --2- 172.21.15.87:0/585050002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 0x55b02d38e740 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbd20055040 tx=0x7fbd2004c000 comp rx=0 tx=0).stop 2024-05-08T18:31:22.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.543+0000 7fbd34733800 1 -- 172.21.15.87:0/585050002 shutdown_connections 2024-05-08T18:31:22.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.543+0000 7fbd34733800 1 --2- 172.21.15.87:0/585050002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 0x55b02d38e740 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.543+0000 7fbd34733800 1 -- 172.21.15.87:0/585050002 >> 172.21.15.87:0/585050002 conn(0x55b02d388730 msgr2=0x55b02d47af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.543+0000 7fbd34733800 1 -- 172.21.15.87:0/585050002 shutdown_connections 2024-05-08T18:31:22.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.543+0000 7fbd34733800 1 -- 172.21.15.87:0/585050002 wait complete. 2024-05-08T18:31:22.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.543+0000 7fbd34733800 1 Processor -- start 2024-05-08T18:31:22.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.543+0000 7fbd34733800 1 -- start start 2024-05-08T18:31:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.544+0000 7fbd34733800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 0x55b02d489310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.544+0000 7fbd34733800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b02d395540 con 0x55b02d3014a0 2024-05-08T18:31:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.544+0000 7fbd303ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 0x55b02d489310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.544+0000 7fbd303ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 0x55b02d489310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34542/0 (socket says 172.21.15.87:34542) 2024-05-08T18:31:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.544+0000 7fbd303ca640 1 -- 172.21.15.87:0/1466603186 learned_addr learned my addr 172.21.15.87:0/1466603186 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.544+0000 7fbd303ca640 1 -- 172.21.15.87:0/1466603186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02d489850 con 0x55b02d3014a0 2024-05-08T18:31:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.544+0000 7fbd303ca640 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 0x55b02d489310 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000a470 tx=0x7fbd20003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.545+0000 7fbc1ce09640 1 -- 172.21.15.87:0/1466603186 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd20073070 con 0x55b02d3014a0 2024-05-08T18:31:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.545+0000 7fbc1ce09640 1 -- 172.21.15.87:0/1466603186 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2005d650 con 0x55b02d3014a0 2024-05-08T18:31:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.545+0000 7fbd34733800 1 -- 172.21.15.87:0/1466603186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b02d489ae0 con 0x55b02d3014a0 2024-05-08T18:31:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.545+0000 7fbc1ce09640 1 -- 172.21.15.87:0/1466603186 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd20057070 con 0x55b02d3014a0 2024-05-08T18:31:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.545+0000 7fbd34733800 1 -- 172.21.15.87:0/1466603186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b02d48c790 con 0x55b02d3014a0 2024-05-08T18:31:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.545+0000 7fbc1ce09640 1 -- 172.21.15.87:0/1466603186 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbd20076070 con 0x55b02d3014a0 2024-05-08T18:31:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.546+0000 7fbc1ce09640 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbc1803bba0 0x7fbc1803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.546+0000 7fbc1ce09640 1 -- 172.21.15.87:0/1466603186 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fbd200942f0 con 0x55b02d3014a0 2024-05-08T18:31:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.546+0000 7fbd27bc9640 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbc1803bba0 0x7fbc1803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.546+0000 7fbd34733800 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b02d391380 0x55b02d490550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.546+0000 7fbd34733800 1 -- 172.21.15.87:0/1466603186 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d490a90 con 0x55b02d391380 2024-05-08T18:31:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.546+0000 7fbd30bcb640 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b02d391380 0x55b02d490550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.546+0000 7fbd27bc9640 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbc1803bba0 0x7fbc1803e060 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbd18000f60 tx=0x7fbd180012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.546+0000 7fbd30bcb640 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b02d391380 0x55b02d490550 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.546+0000 7fbd30bcb640 1 -- 172.21.15.87:0/1466603186 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd2800a4a0 con 0x55b02d391380 2024-05-08T18:31:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.546+0000 7fbd34733800 1 -- 172.21.15.87:0/1466603186 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d48db20 con 0x55b02d391380 2024-05-08T18:31:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.547+0000 7fbd30bcb640 1 -- 172.21.15.87:0/1466603186 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd2800a4a0 con 0x55b02d391380 2024-05-08T18:31:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.547+0000 7fbd34733800 1 -- 172.21.15.87:0/1466603186 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4928d0 con 0x55b02d391380 2024-05-08T18:31:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.547+0000 7fbd30bcb640 1 -- 172.21.15.87:0/1466603186 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbd2800a4a0 con 0x55b02d391380 2024-05-08T18:31:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.547+0000 7fbd34733800 1 -- 172.21.15.87:0/1466603186 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d491b00 con 0x55b02d391380 2024-05-08T18:31:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.547+0000 7fbd30bcb640 1 -- 172.21.15.87:0/1466603186 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd2800a4a0 con 0x55b02d391380 2024-05-08T18:31:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.547+0000 7fbd34733800 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b02d493c80 0x55b02d496070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.547+0000 7fbd34733800 1 -- 172.21.15.87:0/1466603186 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4965b0 con 0x55b02d493c80 2024-05-08T18:31:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.548+0000 7fbd303ca640 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b02d493c80 0x55b02d496070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.548+0000 7fbd303ca640 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b02d493c80 0x55b02d496070 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.548+0000 7fbd303ca640 1 -- 172.21.15.87:0/1466603186 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbd20075030 con 0x55b02d493c80 2024-05-08T18:31:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.548+0000 7fbd34733800 1 Processor -- start 2024-05-08T18:31:22.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.549+0000 7fbd34733800 1 -- start start 2024-05-08T18:31:22.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.549+0000 7fbd34733800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4a4880 0x55b02d4a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.549+0000 7fbd34733800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b02d27ffc0 con 0x55b02d4a4880 2024-05-08T18:31:22.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.549+0000 7fbd30bcb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4a4880 0x55b02d4a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.549+0000 7fbd30bcb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4a4880 0x55b02d4a4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34546/0 (socket says 172.21.15.87:34546) 2024-05-08T18:31:22.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.549+0000 7fbd30bcb640 1 -- 172.21.15.87:0/716699106 learned_addr learned my addr 172.21.15.87:0/716699106 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.549+0000 7fbd30bcb640 1 -- 172.21.15.87:0/716699106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02d4a51e0 con 0x55b02d4a4880 2024-05-08T18:31:22.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.549+0000 7fbd30bcb640 1 --2- 172.21.15.87:0/716699106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4a4880 0x55b02d4a4ca0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x55b02d48a710 tx=0x7fbd280178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.549+0000 7fbc15ffb640 1 -- 172.21.15.87:0/716699106 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd28013440 con 0x55b02d4a4880 2024-05-08T18:31:22.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.549+0000 7fbc15ffb640 1 -- 172.21.15.87:0/716699106 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd280135e0 con 0x55b02d4a4880 2024-05-08T18:31:22.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.549+0000 7fbc15ffb640 1 -- 172.21.15.87:0/716699106 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd280138c0 con 0x55b02d4a4880 2024-05-08T18:31:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.549+0000 7fbd34733800 1 -- 172.21.15.87:0/716699106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b02d4a5c50 con 0x55b02d4a4880 2024-05-08T18:31:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.550+0000 7fbd34733800 1 -- 172.21.15.87:0/716699106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b02d4a6150 con 0x55b02d4a4880 2024-05-08T18:31:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.550+0000 7fbc15ffb640 1 -- 172.21.15.87:0/716699106 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbd28011040 con 0x55b02d4a4880 2024-05-08T18:31:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.550+0000 7fbc15ffb640 1 --2- 172.21.15.87:0/716699106 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbc0803bba0 0x7fbc0803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.551+0000 7fbc15ffb640 1 -- 172.21.15.87:0/716699106 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fbd2801d070 con 0x55b02d4a4880 2024-05-08T18:31:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.551+0000 7fbd303ca640 1 --2- 172.21.15.87:0/716699106 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbc0803bba0 0x7fbc0803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.551+0000 7fbd34733800 1 Processor -- start 2024-05-08T18:31:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.551+0000 7fbd303ca640 1 --2- 172.21.15.87:0/716699106 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbc0803bba0 0x7fbc0803e060 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbd2005b730 tx=0x7fbd20053f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.551+0000 7fbd34733800 1 -- start start 2024-05-08T18:31:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.551+0000 7fbd34733800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4b1b10 0x55b02d4b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.551+0000 7fbd34733800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b02d38cfc0 con 0x55b02d4b1b10 2024-05-08T18:31:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.551+0000 7fbd30bcb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4b1b10 0x55b02d4b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.551+0000 7fbd30bcb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4b1b10 0x55b02d4b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34550/0 (socket says 172.21.15.87:34550) 2024-05-08T18:31:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.551+0000 7fbd30bcb640 1 -- 172.21.15.87:0/178569895 learned_addr learned my addr 172.21.15.87:0/178569895 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.551+0000 7fbd30bcb640 1 -- 172.21.15.87:0/178569895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02d4b2500 con 0x55b02d4b1b10 2024-05-08T18:31:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.552+0000 7fbd30bcb640 1 --2- 172.21.15.87:0/178569895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4b1b10 0x55b02d4b1f30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbd280103f0 tx=0x7fbd28001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca9b490e07733a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.552+0000 7fbc077fe640 1 -- 172.21.15.87:0/178569895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd280540d0 con 0x55b02d4b1b10 2024-05-08T18:31:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.552+0000 7fbc077fe640 1 -- 172.21.15.87:0/178569895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd28054270 con 0x55b02d4b1b10 2024-05-08T18:31:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.552+0000 7fbc077fe640 1 -- 172.21.15.87:0/178569895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd28001620 con 0x55b02d4b1b10 2024-05-08T18:31:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.552+0000 7fbd34733800 1 -- 172.21.15.87:0/178569895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4b1b10 msgr2=0x55b02d4b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.552+0000 7fbd34733800 1 --2- 172.21.15.87:0/178569895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4b1b10 0x55b02d4b1f30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbd280103f0 tx=0x7fbd28001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.552+0000 7fbd34733800 1 -- 172.21.15.87:0/178569895 shutdown_connections 2024-05-08T18:31:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.552+0000 7fbd34733800 1 --2- 172.21.15.87:0/178569895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4b1b10 0x55b02d4b1f30 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.552+0000 7fbd34733800 1 -- 172.21.15.87:0/178569895 >> 172.21.15.87:0/178569895 conn(0x55b02d4ade20 msgr2=0x55b02d4abed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.552+0000 7fbd34733800 1 -- 172.21.15.87:0/178569895 shutdown_connections 2024-05-08T18:31:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.552+0000 7fbd34733800 1 -- 172.21.15.87:0/178569895 wait complete. 2024-05-08T18:31:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.553+0000 7fbd34733800 1 Processor -- start 2024-05-08T18:31:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.553+0000 7fbd34733800 1 -- start start 2024-05-08T18:31:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.553+0000 7fbd34733800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4b1b10 0x55b02d4b90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.553+0000 7fbd34733800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b02d4b2cd0 con 0x55b02d4b1b10 2024-05-08T18:31:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.553+0000 7fbd30bcb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4b1b10 0x55b02d4b90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.553+0000 7fbd30bcb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4b1b10 0x55b02d4b90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:34554/0 (socket says 172.21.15.87:34554) 2024-05-08T18:31:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.553+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 learned_addr learned my addr 172.21.15.87:0/3759070421 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.553+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02d4b95f0 con 0x55b02d4b1b10 2024-05-08T18:31:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.553+0000 7fbd30bcb640 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4b1b10 0x55b02d4b90b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbd2804d010 tx=0x7fbd28052890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.554+0000 7fbc05ffb640 1 -- 172.21.15.87:0/3759070421 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd28030030 con 0x55b02d4b1b10 2024-05-08T18:31:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.554+0000 7fbc05ffb640 1 -- 172.21.15.87:0/3759070421 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd28013c70 con 0x55b02d4b1b10 2024-05-08T18:31:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.554+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b02d4b9880 con 0x55b02d4b1b10 2024-05-08T18:31:22.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.554+0000 7fbc05ffb640 1 -- 172.21.15.87:0/3759070421 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd28015430 con 0x55b02d4b1b10 2024-05-08T18:31:22.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.554+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b02d4bc530 con 0x55b02d4b1b10 2024-05-08T18:31:22.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.554+0000 7fbc05ffb640 1 -- 172.21.15.87:0/3759070421 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbd28033030 con 0x55b02d4b1b10 2024-05-08T18:31:22.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.555+0000 7fbc05ffb640 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbbf803bba0 0x7fbbf803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.555+0000 7fbc05ffb640 1 -- 172.21.15.87:0/3759070421 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fbd28031070 con 0x55b02d4b1b10 2024-05-08T18:31:22.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.555+0000 7fbd303ca640 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbbf803bba0 0x7fbbf803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.555+0000 7fbd303ca640 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbbf803bba0 0x7fbbf803e060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbd20044810 tx=0x7fbd20087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.556+0000 7fbd34733800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.556+0000 7fbd34733800 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b02d4c4d20 0x55b02d4c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.556+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4c7930 con 0x55b02d4c4d20 2024-05-08T18:31:22.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.556+0000 7fbd27bc9640 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b02d4c4d20 0x55b02d4c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.556+0000 7fbd27bc9640 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b02d4c4d20 0x55b02d4c71e0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.556+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd18009050 con 0x55b02d4c4d20 2024-05-08T18:31:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.556+0000 7fbd34733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.556+0000 7fbd34733800 20 realm 2024-05-08T18:31:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.556+0000 7fbd34733800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.556+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4c4170 con 0x55b02d4c4d20 2024-05-08T18:31:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.556+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd18009050 con 0x55b02d4c4d20 2024-05-08T18:31:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.556+0000 7fbd34733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.556+0000 7fbd34733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.556+0000 7fbd34733800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.557+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4c8420 con 0x55b02d4c4d20 2024-05-08T18:31:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.557+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd18009050 con 0x55b02d4c4d20 2024-05-08T18:31:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.557+0000 7fbd34733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.557+0000 7fbd34733800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.557+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4c8cf0 con 0x55b02d4c4d20 2024-05-08T18:31:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.557+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd18009050 con 0x55b02d4c4d20 2024-05-08T18:31:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.557+0000 7fbd34733800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.557+0000 7fbd34733800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.557+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4c9090 con 0x55b02d4c4d20 2024-05-08T18:31:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.557+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbd18009050 con 0x55b02d4c4d20 2024-05-08T18:31:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.557+0000 7fbd34733800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.557+0000 7fbd34733800 20 searching for the correct realm 2024-05-08T18:31:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.557+0000 7fbd34733800 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b02d4caf70 0x55b02d4cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.557+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cda50 con 0x55b02d4caf70 2024-05-08T18:31:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.557+0000 7fbd30bcb640 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b02d4caf70 0x55b02d4cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.558+0000 7fbd30bcb640 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b02d4caf70 0x55b02d4cd380 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.558+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2803c070 con 0x55b02d4caf70 2024-05-08T18:31:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.558+0000 7fbd30bcb640 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fbd28021c40 0x7fbd2802c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.558+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cda50 con 0x7fbd28021c40 2024-05-08T18:31:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.558+0000 7fbd303ca640 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fbd28021c40 0x7fbd2802c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.558+0000 7fbd303ca640 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fbd28021c40 0x7fbd2802c480 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.559+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd20075030 con 0x7fbd28021c40 2024-05-08T18:31:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.559+0000 7fbd303ca640 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fbd200a2040 0x7fbd2008b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.559+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cda50 con 0x7fbd200a2040 2024-05-08T18:31:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.559+0000 7fbd27bc9640 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fbd200a2040 0x7fbd2008b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.559+0000 7fbd27bc9640 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fbd200a2040 0x7fbd2008b530 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.560+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd18009050 con 0x7fbd200a2040 2024-05-08T18:31:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.560+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cda50 con 0x55b02d4c4d20 2024-05-08T18:31:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.560+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd18009050 con 0x55b02d4c4d20 2024-05-08T18:31:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.560+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cda50 con 0x55b02d4c4d20 2024-05-08T18:31:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.560+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.560+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cda50 con 0x7fbd200a2040 2024-05-08T18:31:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.560+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.560+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cda50 con 0x7fbd200a2040 2024-05-08T18:31:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.561+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.561+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cda50 con 0x7fbd28021c40 2024-05-08T18:31:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.561+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd20075030 con 0x7fbd28021c40 2024-05-08T18:31:22.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.561+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cda50 con 0x55b02d4caf70 2024-05-08T18:31:22.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.561+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2803c070 con 0x55b02d4caf70 2024-05-08T18:31:22.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.561+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cda50 con 0x55b02d4c4d20 2024-05-08T18:31:22.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.561+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.561+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cda50 con 0x7fbd200a2040 2024-05-08T18:31:22.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.562+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.562+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cda50 con 0x55b02d4c4d20 2024-05-08T18:31:22.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.562+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.562+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cda50 con 0x7fbd28021c40 2024-05-08T18:31:22.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.562+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbd20075030 con 0x7fbd28021c40 2024-05-08T18:31:22.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.562+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cda50 con 0x55b02d4caf70 2024-05-08T18:31:22.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.563+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2803c070 con 0x55b02d4caf70 2024-05-08T18:31:22.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.563+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cda50 con 0x55b02d4caf70 2024-05-08T18:31:22.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.563+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2803c070 con 0x55b02d4caf70 2024-05-08T18:31:22.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.563+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fbd28060040 con 0x7fbd200a2040 2024-05-08T18:31:22.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.563+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.563+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fbd28060040 con 0x55b02d4caf70 2024-05-08T18:31:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.564+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2803c070 con 0x55b02d4caf70 2024-05-08T18:31:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.564+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fbd28060040 con 0x55b02d4caf70 2024-05-08T18:31:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.564+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2803c070 con 0x55b02d4caf70 2024-05-08T18:31:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.564+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fbd28060040 con 0x55b02d4c4d20 2024-05-08T18:31:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.564+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.564+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fbd28060040 con 0x55b02d4c4d20 2024-05-08T18:31:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.564+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.564+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fbd28060040 con 0x7fbd200a2040 2024-05-08T18:31:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.565+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.565+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fbd28060040 con 0x55b02d4caf70 2024-05-08T18:31:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.565+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2803c070 con 0x55b02d4caf70 2024-05-08T18:31:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.565+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fbd28060040 con 0x7fbd28021c40 2024-05-08T18:31:22.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.565+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd20075030 con 0x7fbd28021c40 2024-05-08T18:31:22.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.565+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fbd28060040 con 0x55b02d4c4d20 2024-05-08T18:31:22.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.565+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.565+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fbd28060040 con 0x7fbd200a2040 2024-05-08T18:31:22.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.566+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.566+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fbd28060040 con 0x55b02d4caf70 2024-05-08T18:31:22.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.566+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2803c070 con 0x55b02d4caf70 2024-05-08T18:31:22.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.566+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fbd28060040 con 0x7fbd200a2040 2024-05-08T18:31:22.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.566+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.566+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fbd28060040 con 0x7fbd28021c40 2024-05-08T18:31:22.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.567+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd20075030 con 0x7fbd28021c40 2024-05-08T18:31:22.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.567+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fbd28060040 con 0x55b02d4caf70 2024-05-08T18:31:22.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.567+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2803c070 con 0x55b02d4caf70 2024-05-08T18:31:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.567+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fbd28060040 con 0x7fbd200a2040 2024-05-08T18:31:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.567+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.567+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fbd28060040 con 0x55b02d4c4d20 2024-05-08T18:31:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.567+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.567+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fbd28060040 con 0x7fbd28021c40 2024-05-08T18:31:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.568+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd20075030 con 0x7fbd28021c40 2024-05-08T18:31:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.568+0000 7fbd34733800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.568+0000 7fbd34733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.568+0000 7fbd34733800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.568+0000 7fbd34733800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.568+0000 7fbd34733800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.568+0000 7fbd34733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.568+0000 7fbd34733800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.568+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4c99e0 con 0x55b02d4c4d20 2024-05-08T18:31:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.568+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.568+0000 7fbd34733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.568+0000 7fbd34733800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.568+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4ca280 con 0x55b02d4c4d20 2024-05-08T18:31:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.568+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.568+0000 7fbd34733800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.568+0000 7fbd34733800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.568+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cded0 con 0x7fbd200a2040 2024-05-08T18:31:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd34733800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd34733800 20 zone default found 2024-05-08T18:31:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd34733800 4 Realm: () 2024-05-08T18:31:22.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd34733800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:22.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd34733800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:22.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd34733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:22.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd34733800 20 zonegroup default 2024-05-08T18:31:22.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd34733800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4ce380 con 0x7fbd200a2040 2024-05-08T18:31:22.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd34733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd34733800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cfd60 con 0x55b02d4caf70 2024-05-08T18:31:22.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd2803c070 con 0x55b02d4caf70 2024-05-08T18:31:22.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd34733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd34733800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.569+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4d01f0 con 0x55b02d4caf70 2024-05-08T18:31:22.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.570+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd2803c070 con 0x55b02d4caf70 2024-05-08T18:31:22.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.570+0000 7fbd34733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.570+0000 7fbd34733800 20 started sync module instance, tier type = 2024-05-08T18:31:22.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.570+0000 7fbd34733800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:22.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.570+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cf1f0 con 0x7fbd28021c40 2024-05-08T18:31:22.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.571+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd20075030 con 0x7fbd28021c40 2024-05-08T18:31:22.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.571+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94215162623456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4cee50 con 0x7fbd28021c40 2024-05-08T18:31:22.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.571+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4d1120 con 0x55b02d4c4d20 2024-05-08T18:31:22.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.572+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94215162623456] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd20075030 con 0x7fbd28021c40 2024-05-08T18:31:22.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.572+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.572+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94215162629232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4d1540 con 0x55b02d4c4d20 2024-05-08T18:31:22.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.572+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4d1f00 con 0x55b02d4caf70 2024-05-08T18:31:22.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.573+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd2803c070 con 0x55b02d4caf70 2024-05-08T18:31:22.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.573+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94215162632784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4d1eb0 con 0x55b02d4caf70 2024-05-08T18:31:22.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.573+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4d2eb0 con 0x7fbd28021c40 2024-05-08T18:31:22.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.573+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94215162629232] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.574+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94215162632784] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd2803c070 con 0x55b02d4caf70 2024-05-08T18:31:22.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.574+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd20075030 con 0x7fbd28021c40 2024-05-08T18:31:22.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.574+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94215162634992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4d29c0 con 0x7fbd28021c40 2024-05-08T18:31:22.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.574+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4d38f0 con 0x55b02d4c4d20 2024-05-08T18:31:22.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.575+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94215162634992] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd20075030 con 0x7fbd28021c40 2024-05-08T18:31:22.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.575+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.575+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94215162639424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4d3d10 con 0x55b02d4c4d20 2024-05-08T18:31:22.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.575+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4d45e0 con 0x7fbd200a2040 2024-05-08T18:31:22.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.576+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.576+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94215162639424] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.576+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94215162641680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4d4130 con 0x7fbd200a2040 2024-05-08T18:31:22.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.576+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4d3860 con 0x7fbd200a2040 2024-05-08T18:31:22.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.577+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94215162641680] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.577+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.577+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94215162640480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4d5070 con 0x7fbd200a2040 2024-05-08T18:31:22.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.577+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4d5a30 con 0x7fbd200a2040 2024-05-08T18:31:22.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.578+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.578+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94215162640480] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.578+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94215162647936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4d5e50 con 0x7fbd200a2040 2024-05-08T18:31:22.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.578+0000 7fbd34733800 20 add_watcher() i=0 2024-05-08T18:31:22.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.578+0000 7fbd34733800 20 add_watcher() i=1 2024-05-08T18:31:22.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.578+0000 7fbd34733800 20 add_watcher() i=2 2024-05-08T18:31:22.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.578+0000 7fbd34733800 20 add_watcher() i=3 2024-05-08T18:31:22.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.578+0000 7fbd34733800 20 add_watcher() i=4 2024-05-08T18:31:22.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.578+0000 7fbd34733800 20 add_watcher() i=5 2024-05-08T18:31:22.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.578+0000 7fbd34733800 20 add_watcher() i=6 2024-05-08T18:31:22.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.579+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94215162647936] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.579+0000 7fbd34733800 20 add_watcher() i=7 2024-05-08T18:31:22.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.579+0000 7fbd34733800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:22.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.579+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4d5e50 con 0x55b02d4c4d20 2024-05-08T18:31:22.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.579+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.579+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94215162648992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d4d5dc0 con 0x55b02d4c4d20 2024-05-08T18:31:22.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.580+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94215162648992] v27'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.580+0000 7fbbe67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:22.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.580+0000 7fbd34733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:22.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.580+0000 7fbd34733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:22.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.580+0000 7fbd34733800 5 note: GC not initialized 2024-05-08T18:31:22.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.581+0000 7fbbe57e2640 20 reqs_thread_entry: start 2024-05-08T18:31:22.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.581+0000 7fbd34733800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:22.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.581+0000 7fbd34733800 20 Filter name: none 2024-05-08T18:31:22.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.581+0000 7fbb56ffd640 20 reqs_thread_entry: start 2024-05-08T18:31:22.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.581+0000 7fbd34733800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:22.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.581+0000 7fbd34733800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.581+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d50c3a0 con 0x55b02d4c4d20 2024-05-08T18:31:22.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.581+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.581+0000 7fbd34733800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:22.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.581+0000 7fbd34733800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:22.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.581+0000 7fbd34733800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:22.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.581+0000 7fbd34733800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:22.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.581+0000 7fbd34733800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-05-08T18:31:22.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.581+0000 7fbd34733800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.581+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d50bec0 con 0x55b02d4c4d20 2024-05-08T18:31:22.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.582+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.582+0000 7fbd34733800 20 rados_obj.operate() r=0 bl.length=193 2024-05-08T18:31:22.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.582+0000 7fbd34733800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-05-08T18:31:22.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.582+0000 7fbd34733800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-08T18:31:22.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.582+0000 7fbd34733800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 : miss 2024-05-08T18:31:22.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.582+0000 7fbd34733800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.582+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 8.15 8:aae63b4c:root::.bucket.meta.testx%3amyfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d50fb00 con 0x55b02d4caf70 2024-05-08T18:31:22.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.582+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv3 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7fbd2803c070 con 0x55b02d4caf70 2024-05-08T18:31:22.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.582+0000 7fbd34733800 20 rados_obj.operate() r=0 bl.length=412 2024-05-08T18:31:22.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.582+0000 7fbd34733800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x17 2024-05-08T18:31:22.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.582+0000 7fbd34733800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:22.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.582+0000 7fbd34733800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:22.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.582+0000 7fbd34733800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-05-08T18:31:22.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.582+0000 7fbd34733800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 2024-05-08T18:31:22.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.582+0000 7fbd34733800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-08T18:31:22.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.582+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d513db0 con 0x55b02d4c4d20 2024-05-08T18:31:22.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.583+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v27'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.583+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d5176c0 con 0x55b02d4caf70 2024-05-08T18:31:22.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(66 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [create,call,writefull 0~379,setxattr (123)] v27'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7fbd2803c070 con 0x55b02d4caf70 2024-05-08T18:31:22.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbd34733800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x7 2024-05-08T18:31:22.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbd34733800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:22.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbd34733800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:22.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbd34733800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1, ofs0, ns] 2024-05-08T18:31:22.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94215162909376 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d516f80 con 0x7fbd28021c40 2024-05-08T18:31:22.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== watch-notify(notify (1) cookie 94215162623456 notify 115964117015 ret 0) ==== 770+0+0 (crc 0 0 0) 0x7fbd20091040 con 0x7fbd28021c40 2024-05-08T18:31:22.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbc077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117015 cookie 94215162623456 notifier 4550 bl.length()=728 2024-05-08T18:31:22.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbc077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x7 2024-05-08T18:31:22.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbc077fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:22.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbc077fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:22.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbc077fe640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fbbf4003ea0 con 0x7fbd28021c40 2024-05-08T18:31:22.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(67 notify.0 [notify cookie 94215162909376 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd20075030 con 0x7fbd28021c40 2024-05-08T18:31:22.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== watch-notify(notify_complete (2) cookie 94215162909376 notify 115964117015 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b02d48c790 con 0x7fbd28021c40 2024-05-08T18:31:22.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbd34733800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): orig_sources= new_sources= 2024-05-08T18:31:22.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd20075030 con 0x7fbd28021c40 2024-05-08T18:31:22.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbd34733800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): potential sources added=[] removed=[] 2024-05-08T18:31:22.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbd34733800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): orig_dests= new_dests= 2024-05-08T18:31:22.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbd34733800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): potential dests added=[] removed=[] 2024-05-08T18:31:22.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.585+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d5177d0 con 0x7fbd28021c40 2024-05-08T18:31:22.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.586+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(69 foo.buckets [call] v27'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbd20075030 con 0x7fbd28021c40 2024-05-08T18:31:22.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.586+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d5162d0 con 0x7fbd28021c40 2024-05-08T18:31:22.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.588+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v27'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fbd20075030 con 0x7fbd28021c40 2024-05-08T18:31:22.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.588+0000 7fbd34733800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:31:22.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.588+0000 7fbd34733800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:22.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.588+0000 7fbd34733800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:31:22.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.588+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94215162917984 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d5162d0 con 0x7fbd200a2040 2024-05-08T18:31:22.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.588+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== watch-notify(notify (1) cookie 94215162640480 notify 115964117002 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7fbd1802e740 con 0x7fbd200a2040 2024-05-08T18:31:22.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.588+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(71 notify.6 [notify cookie 94215162917984 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.588+0000 7fbc06ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117002 cookie 94215162640480 notifier 4550 bl.length()=314 2024-05-08T18:31:22.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.588+0000 7fbc06ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:31:22.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.588+0000 7fbc06ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:22.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.588+0000 7fbc06ffd640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fbb64003400 con 0x7fbd200a2040 2024-05-08T18:31:22.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.588+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== watch-notify(notify_complete (2) cookie 94215162917984 notify 115964117002 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbd1802ea00 con 0x7fbd200a2040 2024-05-08T18:31:22.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.588+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.588+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d5152c0 con 0x55b02d4c4d20 2024-05-08T18:31:22.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.589+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(73 testx/myfoo [call,delete] v27'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.589+0000 7fbd34733800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-05-08T18:31:22.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.589+0000 7fbd34733800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-05-08T18:31:22.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.589+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94215162917984 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d517880 con 0x55b02d4c4d20 2024-05-08T18:31:22.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.590+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== watch-notify(notify (1) cookie 94215162639424 notify 115964117004 ret 0) ==== 197+0+0 (crc 0 0 0) 0x7fbd1802ea00 con 0x55b02d4c4d20 2024-05-08T18:31:22.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.590+0000 7fbc06ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117004 cookie 94215162639424 notifier 4550 bl.length()=155 2024-05-08T18:31:22.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.590+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(74 notify.4 [notify cookie 94215162917984 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.590+0000 7fbc06ffd640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fbb64003400 con 0x55b02d4c4d20 2024-05-08T18:31:22.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.590+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== watch-notify(notify_complete (2) cookie 94215162917984 notify 115964117004 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbd1802eca0 con 0x55b02d4c4d20 2024-05-08T18:31:22.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.590+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.590+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:76 8.15 8:aae63b4c:root::.bucket.meta.testx%3amyfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d517460 con 0x55b02d4caf70 2024-05-08T18:31:22.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.591+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call,delete] v27'4 uv4 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7fbd2803c070 con 0x55b02d4caf70 2024-05-08T18:31:22.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.591+0000 7fbd34733800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 from cache 2024-05-08T18:31:22.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.591+0000 7fbd34733800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1, ofs0, ns] 2024-05-08T18:31:22.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.591+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [notify cookie 94215162886768 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b02d517460 con 0x7fbd200a2040 2024-05-08T18:31:22.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.592+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== watch-notify(notify (1) cookie 94215162647936 notify 115964117003 ret 0) ==== 254+0+0 (crc 0 0 0) 0x7fbd1802eca0 con 0x7fbd200a2040 2024-05-08T18:31:22.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.592+0000 7fbc077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117003 cookie 94215162647936 notifier 4550 bl.length()=212 2024-05-08T18:31:22.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.592+0000 7fbc077fe640 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fbbf4003ea0 con 0x7fbd200a2040 2024-05-08T18:31:22.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.592+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(77 notify.7 [notify cookie 94215162886768 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.592+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(78 notify.7 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.592+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== watch-notify(notify_complete (2) cookie 94215162886768 notify 115964117003 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbd1803f550 con 0x7fbd200a2040 2024-05-08T18:31:22.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.593+0000 7fbbe67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:22.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.593+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94215162648992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d517460 con 0x55b02d4c4d20 2024-05-08T18:31:22.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.594+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94215162648992] v27'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.594+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94215162623456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d50f590 con 0x7fbd28021c40 2024-05-08T18:31:22.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.595+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94215162623456] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd20075030 con 0x7fbd28021c40 2024-05-08T18:31:22.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.595+0000 7fbd34733800 20 remove_watcher() i=0 2024-05-08T18:31:22.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.595+0000 7fbd34733800 2 removed watcher, disabling cache 2024-05-08T18:31:22.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.595+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94215162629232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d517460 con 0x55b02d4c4d20 2024-05-08T18:31:22.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.596+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94215162629232] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.596+0000 7fbd34733800 20 remove_watcher() i=1 2024-05-08T18:31:22.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.596+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94215162632784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d50f590 con 0x55b02d4caf70 2024-05-08T18:31:22.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.597+0000 7fbd30bcb640 1 -- 172.21.15.87:0/3759070421 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94215162632784] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd2803c070 con 0x55b02d4caf70 2024-05-08T18:31:22.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.597+0000 7fbd34733800 20 remove_watcher() i=2 2024-05-08T18:31:22.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.597+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94215162634992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d517460 con 0x7fbd28021c40 2024-05-08T18:31:22.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.598+0000 7fbd303ca640 1 -- 172.21.15.87:0/3759070421 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94215162634992] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd20075030 con 0x7fbd28021c40 2024-05-08T18:31:22.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.598+0000 7fbd34733800 20 remove_watcher() i=3 2024-05-08T18:31:22.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.598+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94215162639424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d50f590 con 0x55b02d4c4d20 2024-05-08T18:31:22.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.599+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94215162639424] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x55b02d4c4d20 2024-05-08T18:31:22.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.599+0000 7fbd34733800 20 remove_watcher() i=4 2024-05-08T18:31:22.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.599+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94215162641680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d517460 con 0x7fbd200a2040 2024-05-08T18:31:22.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.600+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94215162641680] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.600+0000 7fbd34733800 20 remove_watcher() i=5 2024-05-08T18:31:22.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.600+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94215162640480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d50f590 con 0x7fbd200a2040 2024-05-08T18:31:22.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.601+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94215162640480] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.601+0000 7fbd34733800 20 remove_watcher() i=6 2024-05-08T18:31:22.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.601+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94215162647936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b02d517460 con 0x7fbd200a2040 2024-05-08T18:31:22.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94215162647936] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1802a040 con 0x7fbd200a2040 2024-05-08T18:31:22.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 20 remove_watcher() i=7 2024-05-08T18:31:22.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fbd200a2040 msgr2=0x7fbd2008b530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fbd200a2040 0x7fbd2008b530 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b02d4c4d20 msgr2=0x55b02d4c71e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b02d4c4d20 0x55b02d4c71e0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fbd28021c40 msgr2=0x7fbd2802c480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fbd28021c40 0x7fbd2802c480 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b02d4caf70 msgr2=0x55b02d4cd380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b02d4caf70 0x55b02d4cd380 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbbf803bba0 msgr2=0x7fbbf803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbbf803bba0 0x7fbbf803e060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbd20044810 tx=0x7fbd20087000 comp rx=0 tx=0).stop 2024-05-08T18:31:22.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4b1b10 msgr2=0x55b02d4b90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd27bc9640 1 -- 172.21.15.87:0/3759070421 reap_dead start 2024-05-08T18:31:22.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4b1b10 0x55b02d4b90b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbd2804d010 tx=0x7fbd28052890 comp rx=0 tx=0).stop 2024-05-08T18:31:22.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 shutdown_connections 2024-05-08T18:31:22.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 --2- 172.21.15.87:0/3759070421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4b1b10 0x55b02d4b90b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 >> 172.21.15.87:0/3759070421 conn(0x55b02d4ade20 msgr2=0x55b02d4ab4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 shutdown_connections 2024-05-08T18:31:22.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 -- 172.21.15.87:0/3759070421 wait complete. 2024-05-08T18:31:22.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 -- 172.21.15.87:0/716699106 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbc0803bba0 msgr2=0x7fbc0803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 --2- 172.21.15.87:0/716699106 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbc0803bba0 0x7fbc0803e060 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbd2005b730 tx=0x7fbd20053f50 comp rx=0 tx=0).stop 2024-05-08T18:31:22.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 -- 172.21.15.87:0/716699106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4a4880 msgr2=0x55b02d4a4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 --2- 172.21.15.87:0/716699106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4a4880 0x55b02d4a4ca0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x55b02d48a710 tx=0x7fbd280178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 -- 172.21.15.87:0/716699106 shutdown_connections 2024-05-08T18:31:22.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 --2- 172.21.15.87:0/716699106 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbc0803bba0 0x7fbc0803e060 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 --2- 172.21.15.87:0/716699106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d4a4880 0x55b02d4a4ca0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 -- 172.21.15.87:0/716699106 >> 172.21.15.87:0/716699106 conn(0x55b02d498920 msgr2=0x55b02d498d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 -- 172.21.15.87:0/716699106 shutdown_connections 2024-05-08T18:31:22.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.602+0000 7fbd34733800 1 -- 172.21.15.87:0/716699106 wait complete. 2024-05-08T18:31:22.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.603+0000 7fbd34733800 1 -- 172.21.15.87:0/1466603186 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b02d493c80 msgr2=0x55b02d496070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.603+0000 7fbd34733800 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b02d493c80 0x55b02d496070 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.603+0000 7fbd34733800 1 -- 172.21.15.87:0/1466603186 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b02d391380 msgr2=0x55b02d490550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.603+0000 7fbd34733800 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b02d391380 0x55b02d490550 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.603+0000 7fbd34733800 1 -- 172.21.15.87:0/1466603186 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbc1803bba0 msgr2=0x7fbc1803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.603+0000 7fbd34733800 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbc1803bba0 0x7fbc1803e060 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbd18000f60 tx=0x7fbd180012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.603+0000 7fbd34733800 1 -- 172.21.15.87:0/1466603186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 msgr2=0x55b02d489310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.603+0000 7fbd34733800 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 0x55b02d489310 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000a470 tx=0x7fbd20003020 comp rx=0 tx=0).stop 2024-05-08T18:31:22.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.603+0000 7fbd34733800 1 -- 172.21.15.87:0/1466603186 shutdown_connections 2024-05-08T18:31:22.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.603+0000 7fbd34733800 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b02d391380 0x55b02d490550 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.603+0000 7fbd34733800 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b02d493c80 0x55b02d496070 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.603+0000 7fbd34733800 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbc1803bba0 0x7fbc1803e060 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.603+0000 7fbd34733800 1 --2- 172.21.15.87:0/1466603186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b02d3014a0 0x55b02d489310 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.603+0000 7fbd34733800 1 -- 172.21.15.87:0/1466603186 >> 172.21.15.87:0/1466603186 conn(0x55b02d388730 msgr2=0x55b02d38d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.603+0000 7fbd34733800 1 -- 172.21.15.87:0/1466603186 shutdown_connections 2024-05-08T18:31:22.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.603+0000 7fbd34733800 1 -- 172.21.15.87:0/1466603186 wait complete. 2024-05-08T18:31:22.619 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-08T18:31:22.619 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-08T18:31:22.619 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-05-08T18:31:22.665 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:22.665 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:22.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.668+0000 7f4c4b5a2800 1 Processor -- start 2024-05-08T18:31:22.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.668+0000 7f4c4b5a2800 1 -- start start 2024-05-08T18:31:22.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.668+0000 7f4c4b5a2800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b8652016b0 0x55b86520a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.668+0000 7f4c4b5a2800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b865174db0 con 0x55b8651ffb70 2024-05-08T18:31:22.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.668+0000 7f4c4b5a2800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b8650a1e20 con 0x55b8652016b0 2024-05-08T18:31:22.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.668+0000 7f4c48899640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b8652016b0 0x55b86520a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.668+0000 7f4c4909a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55b8651ffb70 0x55b8651fff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:52604/0 (socket says 172.21.15.87:52604) 2024-05-08T18:31:22.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.668+0000 7f4c4909a640 1 -- 172.21.15.87:0/261143892 learned_addr learned my addr 172.21.15.87:0/261143892 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:22.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.669+0000 7f4c48899640 1 -- 172.21.15.87:0/261143892 >> v1:172.21.15.53:6789/0 conn(0x55b8651ffb70 legacy=0x55b8651fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.669+0000 7f4c3bfff640 1 -- 172.21.15.87:0/261143892 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508872525 0 0) 0x55b865174db0 con 0x55b8651ffb70 2024-05-08T18:31:22.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.669+0000 7f4c48899640 1 -- 172.21.15.87:0/261143892 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86520b700 con 0x55b8652016b0 2024-05-08T18:31:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.671+0000 7f4c48899640 1 --2- 172.21.15.87:0/261143892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8652016b0 0x55b86520a1b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000a470 tx=0x7f4c4001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e0acd20165174 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.671+0000 7f4c3bfff640 1 -- 172.21.15.87:0/261143892 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c40057070 con 0x55b8652016b0 2024-05-08T18:31:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.671+0000 7f4c3bfff640 1 -- 172.21.15.87:0/261143892 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c4004adc0 con 0x55b8652016b0 2024-05-08T18:31:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.671+0000 7f4c3bfff640 1 -- 172.21.15.87:0/261143892 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c40052590 con 0x55b8652016b0 2024-05-08T18:31:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.671+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/261143892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8652016b0 msgr2=0x55b86520a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.671+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/261143892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8652016b0 0x55b86520a1b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000a470 tx=0x7f4c4001ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.671+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/261143892 shutdown_connections 2024-05-08T18:31:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.671+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/261143892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8652016b0 0x55b86520a1b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.671+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/261143892 >> 172.21.15.87:0/261143892 conn(0x55b8651fb6b0 msgr2=0x55b8651fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.671+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/261143892 shutdown_connections 2024-05-08T18:31:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.671+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/261143892 wait complete. 2024-05-08T18:31:22.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.685+0000 7f4c4b5a2800 1 Processor -- start 2024-05-08T18:31:22.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.685+0000 7f4c4b5a2800 1 -- start start 2024-05-08T18:31:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.685+0000 7f4c4b5a2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8651ffb70 0x55b8652f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.685+0000 7f4c4b5a2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b86514c5c0 con 0x55b8651ffb70 2024-05-08T18:31:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.686+0000 7f4c4909a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8651ffb70 0x55b8652f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.686+0000 7f4c4909a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8651ffb70 0x55b8652f47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57072/0 (socket says 172.21.15.87:57072) 2024-05-08T18:31:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.686+0000 7f4c4909a640 1 -- 172.21.15.87:0/1929126743 learned_addr learned my addr 172.21.15.87:0/1929126743 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.686+0000 7f4c4909a640 1 -- 172.21.15.87:0/1929126743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8652f4d80 con 0x55b8651ffb70 2024-05-08T18:31:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.686+0000 7f4c4909a640 1 --2- 172.21.15.87:0/1929126743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8651ffb70 0x55b8652f47b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c001630 tx=0x7f4c3c001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96e402064b1e5e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.686+0000 7f4b37606640 1 -- 172.21.15.87:0/1929126743 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c3c003450 con 0x55b8651ffb70 2024-05-08T18:31:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.686+0000 7f4b37606640 1 -- 172.21.15.87:0/1929126743 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c3c0035f0 con 0x55b8651ffb70 2024-05-08T18:31:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.686+0000 7f4b37606640 1 -- 172.21.15.87:0/1929126743 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c3c003990 con 0x55b8651ffb70 2024-05-08T18:31:22.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.687+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/1929126743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8651ffb70 msgr2=0x55b8652f47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.687+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/1929126743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8651ffb70 0x55b8652f47b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c001630 tx=0x7f4c3c001af0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.687+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/1929126743 shutdown_connections 2024-05-08T18:31:22.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.687+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/1929126743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8651ffb70 0x55b8652f47b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.687+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/1929126743 >> 172.21.15.87:0/1929126743 conn(0x55b8651fb6b0 msgr2=0x55b8652f00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.687+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/1929126743 shutdown_connections 2024-05-08T18:31:22.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.687+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/1929126743 wait complete. 2024-05-08T18:31:22.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.687+0000 7f4c4b5a2800 1 Processor -- start 2024-05-08T18:31:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.687+0000 7f4c4b5a2800 1 -- start start 2024-05-08T18:31:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.688+0000 7f4c4b5a2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8651ffb70 0x55b8652fc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.688+0000 7f4c4b5a2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b86520a9c0 con 0x55b8651ffb70 2024-05-08T18:31:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.688+0000 7f4c4909a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8651ffb70 0x55b8652fc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.688+0000 7f4c4909a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8651ffb70 0x55b8652fc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57084/0 (socket says 172.21.15.87:57084) 2024-05-08T18:31:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.688+0000 7f4c4909a640 1 -- 172.21.15.87:0/4054259111 learned_addr learned my addr 172.21.15.87:0/4054259111 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.688+0000 7f4c4909a640 1 -- 172.21.15.87:0/4054259111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8652fc870 con 0x55b8651ffb70 2024-05-08T18:31:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.688+0000 7f4c4909a640 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8651ffb70 0x55b8652fc330 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c006fa0 tx=0x7f4c3c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.688+0000 7f4b35e03640 1 -- 172.21.15.87:0/4054259111 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c3c013820 con 0x55b8651ffb70 2024-05-08T18:31:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.688+0000 7f4b35e03640 1 -- 172.21.15.87:0/4054259111 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c3c023070 con 0x55b8651ffb70 2024-05-08T18:31:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.688+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/4054259111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8652fcb00 con 0x55b8651ffb70 2024-05-08T18:31:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.688+0000 7f4b35e03640 1 -- 172.21.15.87:0/4054259111 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c3c013af0 con 0x55b8651ffb70 2024-05-08T18:31:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.688+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/4054259111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8652ff7b0 con 0x55b8651ffb70 2024-05-08T18:31:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.689+0000 7f4b35e03640 1 -- 172.21.15.87:0/4054259111 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4c3c010070 con 0x55b8651ffb70 2024-05-08T18:31:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.689+0000 7f4b35e03640 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b3003bba0 0x7f4b3003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.689+0000 7f4b35e03640 1 -- 172.21.15.87:0/4054259111 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4c3c018070 con 0x55b8651ffb70 2024-05-08T18:31:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.689+0000 7f4c48899640 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b3003bba0 0x7f4b3003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.690+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b8652016b0 0x55b865303440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.690+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/4054259111 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b865303ab0 con 0x55b8652016b0 2024-05-08T18:31:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.690+0000 7f4c4989b640 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b8652016b0 0x55b865303440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.690+0000 7f4c48899640 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b3003bba0 0x7f4b3003e060 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4c40054000 tx=0x7f4c4004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.690+0000 7f4c4989b640 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b8652016b0 0x55b865303440 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.690+0000 7f4c4989b640 1 -- 172.21.15.87:0/4054259111 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c440083e0 con 0x55b8652016b0 2024-05-08T18:31:22.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.690+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/4054259111 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b865300b20 con 0x55b8652016b0 2024-05-08T18:31:22.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.691+0000 7f4c4989b640 1 -- 172.21.15.87:0/4054259111 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c440083e0 con 0x55b8652016b0 2024-05-08T18:31:22.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.691+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/4054259111 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8653058d0 con 0x55b8652016b0 2024-05-08T18:31:22.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.691+0000 7f4c4989b640 1 -- 172.21.15.87:0/4054259111 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4c440083e0 con 0x55b8652016b0 2024-05-08T18:31:22.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.691+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/4054259111 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b865304b00 con 0x55b8652016b0 2024-05-08T18:31:22.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.691+0000 7f4c4989b640 1 -- 172.21.15.87:0/4054259111 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c440083e0 con 0x55b8652016b0 2024-05-08T18:31:22.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.691+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b865306c80 0x55b865309070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.691+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/4054259111 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8653095b0 con 0x55b865306c80 2024-05-08T18:31:22.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.692+0000 7f4c4909a640 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b865306c80 0x55b865309070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.692+0000 7f4c4909a640 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b865306c80 0x55b865309070 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.692+0000 7f4c4909a640 1 -- 172.21.15.87:0/4054259111 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x55b865306c80 2024-05-08T18:31:22.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.693+0000 7f4c4b5a2800 1 Processor -- start 2024-05-08T18:31:22.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.693+0000 7f4c4b5a2800 1 -- start start 2024-05-08T18:31:22.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.693+0000 7f4c4b5a2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865317830 0x55b865317c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.693+0000 7f4c4b5a2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b8650f2fc0 con 0x55b865317830 2024-05-08T18:31:22.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.693+0000 7f4c4989b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865317830 0x55b865317c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.693+0000 7f4c4989b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865317830 0x55b865317c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57096/0 (socket says 172.21.15.87:57096) 2024-05-08T18:31:22.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.693+0000 7f4c4989b640 1 -- 172.21.15.87:0/3355417474 learned_addr learned my addr 172.21.15.87:0/3355417474 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.693+0000 7f4c4989b640 1 -- 172.21.15.87:0/3355417474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b865318190 con 0x55b865317830 2024-05-08T18:31:22.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.693+0000 7f4c4989b640 1 --2- 172.21.15.87:0/3355417474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865317830 0x55b865317c50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x55b8652fd730 tx=0x7f4c4400ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.693+0000 7f4b2effd640 1 -- 172.21.15.87:0/3355417474 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c4401c070 con 0x55b865317830 2024-05-08T18:31:22.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.693+0000 7f4b2effd640 1 -- 172.21.15.87:0/3355417474 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c4400bdc0 con 0x55b865317830 2024-05-08T18:31:22.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.694+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/3355417474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b865318c00 con 0x55b865317830 2024-05-08T18:31:22.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.694+0000 7f4b2effd640 1 -- 172.21.15.87:0/3355417474 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c44018540 con 0x55b865317830 2024-05-08T18:31:22.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.694+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/3355417474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b865319100 con 0x55b865317830 2024-05-08T18:31:22.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.694+0000 7f4b2effd640 1 -- 172.21.15.87:0/3355417474 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4c4401f070 con 0x55b865317830 2024-05-08T18:31:22.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.694+0000 7f4b2effd640 1 --2- 172.21.15.87:0/3355417474 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b2003bba0 0x7f4b2003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.695+0000 7f4b2effd640 1 -- 172.21.15.87:0/3355417474 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4c440546d0 con 0x55b865317830 2024-05-08T18:31:22.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.695+0000 7f4c4909a640 1 --2- 172.21.15.87:0/3355417474 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b2003bba0 0x7f4b2003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.695+0000 7f4c4b5a2800 1 Processor -- start 2024-05-08T18:31:22.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.695+0000 7f4c4909a640 1 --2- 172.21.15.87:0/3355417474 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b2003bba0 0x7f4b2003e060 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c0035c0 tx=0x7f4c3c011f60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.695+0000 7f4c4b5a2800 1 -- start start 2024-05-08T18:31:22.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.695+0000 7f4c4b5a2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865324ad0 0x55b865324ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.695+0000 7f4c4b5a2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b8652f5100 con 0x55b865324ad0 2024-05-08T18:31:22.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.695+0000 7f4c4989b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865324ad0 0x55b865324ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.695+0000 7f4c4989b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865324ad0 0x55b865324ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57100/0 (socket says 172.21.15.87:57100) 2024-05-08T18:31:22.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.695+0000 7f4c4989b640 1 -- 172.21.15.87:0/3115847109 learned_addr learned my addr 172.21.15.87:0/3115847109 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.695+0000 7f4c4989b640 1 -- 172.21.15.87:0/3115847109 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8653254c0 con 0x55b865324ad0 2024-05-08T18:31:22.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.696+0000 7f4c4989b640 1 --2- 172.21.15.87:0/3115847109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865324ad0 0x55b865324ef0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4c44052a00 tx=0x7f4c44016d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5baf48cb332a5f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.696+0000 7f4b2cff9640 1 -- 172.21.15.87:0/3115847109 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c44026040 con 0x55b865324ad0 2024-05-08T18:31:22.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.696+0000 7f4b2cff9640 1 -- 172.21.15.87:0/3115847109 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c44050070 con 0x55b865324ad0 2024-05-08T18:31:22.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.696+0000 7f4b2cff9640 1 -- 172.21.15.87:0/3115847109 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c44029350 con 0x55b865324ad0 2024-05-08T18:31:22.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.696+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/3115847109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865324ad0 msgr2=0x55b865324ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.696+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/3115847109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865324ad0 0x55b865324ef0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4c44052a00 tx=0x7f4c44016d60 comp rx=0 tx=0).stop 2024-05-08T18:31:22.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.696+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/3115847109 shutdown_connections 2024-05-08T18:31:22.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.696+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/3115847109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865324ad0 0x55b865324ef0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.696+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/3115847109 >> 172.21.15.87:0/3115847109 conn(0x55b865320de0 msgr2=0x55b86531ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.696+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/3115847109 shutdown_connections 2024-05-08T18:31:22.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.696+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/3115847109 wait complete. 2024-05-08T18:31:22.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.696+0000 7f4c4b5a2800 1 Processor -- start 2024-05-08T18:31:22.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.697+0000 7f4c4b5a2800 1 -- start start 2024-05-08T18:31:22.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.697+0000 7f4c4b5a2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865324ad0 0x55b86532c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.697+0000 7f4c4b5a2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b865325c90 con 0x55b865324ad0 2024-05-08T18:31:22.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.697+0000 7f4c4989b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865324ad0 0x55b86532c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.697+0000 7f4c4989b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865324ad0 0x55b86532c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57116/0 (socket says 172.21.15.87:57116) 2024-05-08T18:31:22.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.697+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 learned_addr learned my addr 172.21.15.87:0/847717617 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.697+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86532c5a0 con 0x55b865324ad0 2024-05-08T18:31:22.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.697+0000 7f4c4989b640 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865324ad0 0x55b86532c060 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4c44014b00 tx=0x7f4c44052990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.697+0000 7f4b1effd640 1 -- 172.21.15.87:0/847717617 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c44026070 con 0x55b865324ad0 2024-05-08T18:31:22.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.697+0000 7f4b1effd640 1 -- 172.21.15.87:0/847717617 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c44030070 con 0x55b865324ad0 2024-05-08T18:31:22.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.697+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b86532c830 con 0x55b865324ad0 2024-05-08T18:31:22.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.697+0000 7f4b1effd640 1 -- 172.21.15.87:0/847717617 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c440542e0 con 0x55b865324ad0 2024-05-08T18:31:22.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.697+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b86532f4e0 con 0x55b865324ad0 2024-05-08T18:31:22.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.698+0000 7f4b1effd640 1 -- 172.21.15.87:0/847717617 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4c440186e0 con 0x55b865324ad0 2024-05-08T18:31:22.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.698+0000 7f4b1effd640 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b1403bb50 0x7f4b1403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.698+0000 7f4b1effd640 1 -- 172.21.15.87:0/847717617 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4c4400a4e0 con 0x55b865324ad0 2024-05-08T18:31:22.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.698+0000 7f4c4909a640 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b1403bb50 0x7f4b1403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.699+0000 7f4c4909a640 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b1403bb50 0x7f4b1403e010 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c002040 tx=0x7f4c3c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.699+0000 7f4c4b5a2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.699+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b865337b60 0x55b86533a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.699+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b86533a770 con 0x55b865337b60 2024-05-08T18:31:22.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.699+0000 7f4c48899640 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b865337b60 0x55b86533a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.699+0000 7f4c48899640 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b865337b60 0x55b86533a020 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.700+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.700+0000 7f4c4b5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.700+0000 7f4c4b5a2800 20 realm 2024-05-08T18:31:22.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.700+0000 7f4c4b5a2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.700+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b86533aba0 con 0x55b865337b60 2024-05-08T18:31:22.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.700+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.700+0000 7f4c4b5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.700+0000 7f4c4b5a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:22.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.700+0000 7f4c4b5a2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.700+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b86533b470 con 0x55b865337b60 2024-05-08T18:31:22.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.700+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.700+0000 7f4c4b5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.700+0000 7f4c4b5a2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.700+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b86533b810 con 0x55b865337b60 2024-05-08T18:31:22.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.700+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.701+0000 7f4c4b5a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:22.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.701+0000 7f4c4b5a2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.701+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b86533c060 con 0x55b865337b60 2024-05-08T18:31:22.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.701+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.701+0000 7f4c4b5a2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:22.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.701+0000 7f4c4b5a2800 20 searching for the correct realm 2024-05-08T18:31:22.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.701+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b86533ddd0 0x55b8653401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.701+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8653407f0 con 0x55b86533ddd0 2024-05-08T18:31:22.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.701+0000 7f4c4989b640 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b86533ddd0 0x55b8653401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.701+0000 7f4c4989b640 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b86533ddd0 0x55b8653401c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.702+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.702+0000 7f4c4989b640 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c44021070 0x7f4c44055980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.702+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8653407f0 con 0x7f4c44021070 2024-05-08T18:31:22.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.702+0000 7f4c4909a640 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c44021070 0x7f4c44055980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.702+0000 7f4c4909a640 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c44021070 0x7f4c44055980 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.702+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.702+0000 7f4c4909a640 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c3c03e040 0x7f4c3c028460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.702+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8653407f0 con 0x7f4c3c03e040 2024-05-08T18:31:22.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.702+0000 7f4c48899640 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c3c03e040 0x7f4c3c028460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.703+0000 7f4c48899640 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c3c03e040 0x7f4c3c028460 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.703+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.703+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b86533c060 con 0x55b865337b60 2024-05-08T18:31:22.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.703+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.703+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b86533c060 con 0x55b865337b60 2024-05-08T18:31:22.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.703+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.703+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b86533c060 con 0x7f4c3c03e040 2024-05-08T18:31:22.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.704+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.704+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b86533c060 con 0x7f4c3c03e040 2024-05-08T18:31:22.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.704+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.704+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b86533c060 con 0x7f4c44021070 2024-05-08T18:31:22.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.704+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.704+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b86533c060 con 0x55b86533ddd0 2024-05-08T18:31:22.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.704+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.704+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b86533c060 con 0x55b865337b60 2024-05-08T18:31:22.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.705+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.705+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b86533c060 con 0x7f4c3c03e040 2024-05-08T18:31:22.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.705+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.705+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b86533c060 con 0x55b865337b60 2024-05-08T18:31:22.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.705+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.705+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b86533c060 con 0x7f4c44021070 2024-05-08T18:31:22.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.706+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.706+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b86533c060 con 0x55b86533ddd0 2024-05-08T18:31:22.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.706+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.706+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b86533c060 con 0x55b86533ddd0 2024-05-08T18:31:22.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.706+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.706+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4c44062040 con 0x7f4c3c03e040 2024-05-08T18:31:22.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.706+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.707+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4c44062040 con 0x55b86533ddd0 2024-05-08T18:31:22.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.707+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.707+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4c44062040 con 0x55b86533ddd0 2024-05-08T18:31:22.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.707+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.707+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4c44062040 con 0x55b865337b60 2024-05-08T18:31:22.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.707+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.707+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4c44062040 con 0x55b865337b60 2024-05-08T18:31:22.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.707+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.707+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4c44062040 con 0x7f4c3c03e040 2024-05-08T18:31:22.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.708+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.708+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4c44062040 con 0x55b86533ddd0 2024-05-08T18:31:22.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.708+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.708+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4c44062040 con 0x7f4c44021070 2024-05-08T18:31:22.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.708+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.708+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4c44062040 con 0x55b865337b60 2024-05-08T18:31:22.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.709+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.709+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4c44062040 con 0x7f4c3c03e040 2024-05-08T18:31:22.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.709+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.709+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4c44062040 con 0x55b86533ddd0 2024-05-08T18:31:22.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.709+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.709+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4c44062040 con 0x7f4c3c03e040 2024-05-08T18:31:22.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.709+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.709+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4c44062040 con 0x7f4c44021070 2024-05-08T18:31:22.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.710+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.710+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4c44062040 con 0x55b86533ddd0 2024-05-08T18:31:22.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.710+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.710+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4c44062040 con 0x7f4c3c03e040 2024-05-08T18:31:22.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.710+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.710+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4c44062040 con 0x55b865337b60 2024-05-08T18:31:22.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.710+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.710+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4c44062040 con 0x7f4c44021070 2024-05-08T18:31:22.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c4b5a2800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:22.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c4b5a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:22.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c4b5a2800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:22.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c4b5a2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:22.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c4b5a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:22.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c4b5a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:22.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c4b5a2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b86533c8b0 con 0x55b865337b60 2024-05-08T18:31:22.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c4b5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c4b5a2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b86533cca0 con 0x55b865337b60 2024-05-08T18:31:22.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c4b5a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:22.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c4b5a2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b86533cca0 con 0x7f4c3c03e040 2024-05-08T18:31:22.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.711+0000 7f4c4b5a2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:22.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 20 zone default found 2024-05-08T18:31:22.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 4 Realm: () 2024-05-08T18:31:22.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:22.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:22.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:22.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 20 zonegroup default 2024-05-08T18:31:22.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b86533c4e0 con 0x7f4c3c03e040 2024-05-08T18:31:22.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b86533c510 con 0x55b86533ddd0 2024-05-08T18:31:22.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b865342790 con 0x55b86533ddd0 2024-05-08T18:31:22.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 20 started sync module instance, tier type = 2024-05-08T18:31:22.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:22.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.712+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865341af0 con 0x7f4c44021070 2024-05-08T18:31:22.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.713+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.713+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94250460255808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865342bf0 con 0x7f4c44021070 2024-05-08T18:31:22.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.713+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865343440 con 0x55b865337b60 2024-05-08T18:31:22.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.714+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94250460255808] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.715+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.715+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94250460262288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865343860 con 0x55b865337b60 2024-05-08T18:31:22.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.715+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8653440b0 con 0x55b86533ddd0 2024-05-08T18:31:22.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.716+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94250460262288] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.716+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.716+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94250460263344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865344060 con 0x55b86533ddd0 2024-05-08T18:31:22.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.716+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865344b80 con 0x7f4c44021070 2024-05-08T18:31:22.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.717+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94250460263344] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.717+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.717+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94250460268112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865344f70 con 0x7f4c44021070 2024-05-08T18:31:22.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.717+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8653459c0 con 0x55b865337b60 2024-05-08T18:31:22.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.718+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.718+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94250460271792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865345980 con 0x55b865337b60 2024-05-08T18:31:22.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.718+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865346980 con 0x7f4c3c03e040 2024-05-08T18:31:22.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.718+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94250460268112] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.719+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94250460271792] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.719+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.719+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94250460275888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865345b60 con 0x7f4c3c03e040 2024-05-08T18:31:22.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.719+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865347220 con 0x7f4c3c03e040 2024-05-08T18:31:22.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.720+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(56 notify.6 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.720+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94250460277184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865347290 con 0x7f4c3c03e040 2024-05-08T18:31:22.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.720+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865347d40 con 0x7f4c3c03e040 2024-05-08T18:31:22.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.720+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94250460275888] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.721+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94250460277184] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.721+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.721+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94250460265168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865346de0 con 0x7f4c3c03e040 2024-05-08T18:31:22.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.721+0000 7f4c4b5a2800 20 add_watcher() i=0 2024-05-08T18:31:22.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.721+0000 7f4c4b5a2800 20 add_watcher() i=1 2024-05-08T18:31:22.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.721+0000 7f4c4b5a2800 20 add_watcher() i=2 2024-05-08T18:31:22.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.721+0000 7f4c4b5a2800 20 add_watcher() i=3 2024-05-08T18:31:22.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.721+0000 7f4c4b5a2800 20 add_watcher() i=4 2024-05-08T18:31:22.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.721+0000 7f4c4b5a2800 20 add_watcher() i=5 2024-05-08T18:31:22.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.721+0000 7f4c4b5a2800 20 add_watcher() i=6 2024-05-08T18:31:22.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.722+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94250460265168] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.722+0000 7f4c4b5a2800 20 add_watcher() i=7 2024-05-08T18:31:22.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.722+0000 7f4c4b5a2800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:22.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.722+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b865346de0 con 0x55b865337b60 2024-05-08T18:31:22.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.722+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.722+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94250460280864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865346de0 con 0x55b865337b60 2024-05-08T18:31:22.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.723+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94250460280864] v27'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.723+0000 7f4aff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:22.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.724+0000 7f4c4b5a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:22.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.724+0000 7f4c4b5a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:22.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.724+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8653534a0 con 0x55b865337b60 2024-05-08T18:31:22.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.725+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.725+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865353b70 con 0x7f4c3c03e040 2024-05-08T18:31:22.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.726+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.726+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865353f90 con 0x55b86533ddd0 2024-05-08T18:31:22.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.727+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.727+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865353ef0 con 0x55b865337b60 2024-05-08T18:31:22.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.728+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'135 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.728+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354460 con 0x7f4c44021070 2024-05-08T18:31:22.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.729+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.729+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8653549d0 con 0x55b86533ddd0 2024-05-08T18:31:22.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.730+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'26 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.730+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8653549d0 con 0x55b865337b60 2024-05-08T18:31:22.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.732+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.732+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354a60 con 0x7f4c3c03e040 2024-05-08T18:31:22.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.733+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.733+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354a60 con 0x7f4c44021070 2024-05-08T18:31:22.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.734+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.734+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x55b86533ddd0 2024-05-08T18:31:22.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.735+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.735+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x7f4c44021070 2024-05-08T18:31:22.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.736+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.736+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x7f4c3c03e040 2024-05-08T18:31:22.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.737+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.737+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x7f4c44021070 2024-05-08T18:31:22.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.737+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.738+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x7f4c3c03e040 2024-05-08T18:31:22.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.738+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'31 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.739+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x55b865337b60 2024-05-08T18:31:22.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.739+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'136 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.739+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x55b86533ddd0 2024-05-08T18:31:22.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.741+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.741+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x7f4c44021070 2024-05-08T18:31:22.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.742+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.742+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x55b86533ddd0 2024-05-08T18:31:22.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.742+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.743+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x55b865337b60 2024-05-08T18:31:22.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.744+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.744+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x55b865337b60 2024-05-08T18:31:22.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.745+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'137 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.745+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x55b86533ddd0 2024-05-08T18:31:22.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.746+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.746+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x7f4c44021070 2024-05-08T18:31:22.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.747+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.747+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x55b86533ddd0 2024-05-08T18:31:22.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.748+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.748+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x55b86533ddd0 2024-05-08T18:31:22.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.749+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.749+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x55b86533ddd0 2024-05-08T18:31:22.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.750+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.750+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x55b86533ddd0 2024-05-08T18:31:22.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.751+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.751+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x7f4c3c03e040 2024-05-08T18:31:22.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.752+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.752+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x55b86533ddd0 2024-05-08T18:31:22.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.755+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.755+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x7f4c3c03e040 2024-05-08T18:31:22.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.756+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.756+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x55b86533ddd0 2024-05-08T18:31:22.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.757+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'34 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.757+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x7f4c3c03e040 2024-05-08T18:31:22.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.758+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.758+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865354f10 con 0x7f4c44021070 2024-05-08T18:31:22.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.759+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.759+0000 7f4afe7e4640 20 reqs_thread_entry: start 2024-05-08T18:31:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.759+0000 7f4c4b5a2800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.759+0000 7f4c4b5a2800 20 Filter name: none 2024-05-08T18:31:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.759+0000 7f4a6ffff640 20 reqs_thread_entry: start 2024-05-08T18:31:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.759+0000 7f4c4b5a2800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-08T18:31:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.759+0000 7f4c4b5a2800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.759+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8653802c0 con 0x7f4c3c03e040 2024-05-08T18:31:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.760+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.760+0000 7f4c4b5a2800 20 rados_obj.operate() r=0 bl.length=419 2024-05-08T18:31:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.760+0000 7f4c4b5a2800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-05-08T18:31:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.760+0000 7f4c4b5a2800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T18:31:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.760+0000 7f4c4b5a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.760+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b865382bf0 con 0x55b865337b60 2024-05-08T18:31:22.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.760+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.760+0000 7f4c4b5a2800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-08T18:31:22.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.760+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865380bd0 con 0x7f4c3c03e040 2024-05-08T18:31:22.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.761+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v27'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.761+0000 7f4c4b5a2800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:31:22.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.761+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94250460518112 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b865382fc0 con 0x55b86533ddd0 2024-05-08T18:31:22.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.761+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== watch-notify(notify (1) cookie 94250460263344 notify 115964116997 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55b865354460 con 0x55b86533ddd0 2024-05-08T18:31:22.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.761+0000 7f4b2cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 94250460263344 notifier 4557 bl.length()=170 2024-05-08T18:31:22.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.761+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 27 ==== osd_op_reply(97 notify.2 [notify cookie 94250460518112 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.761+0000 7f4b2cff9640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4b0c003d60 con 0x55b86533ddd0 2024-05-08T18:31:22.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.762+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4404a040 con 0x55b86533ddd0 2024-05-08T18:31:22.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.762+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 29 ==== watch-notify(notify_complete (2) cookie 94250460518112 notify 115964116997 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4c44069020 con 0x55b86533ddd0 2024-05-08T18:31:22.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.762+0000 7f4c4b5a2800 10 removing email index: 2024-05-08T18:31:22.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.762+0000 7f4c4b5a2800 10 removing user buckets index 2024-05-08T18:31:22.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.762+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865380b80 con 0x55b865337b60 2024-05-08T18:31:22.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.763+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v27'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.763+0000 7f4c4b5a2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-05-08T18:31:22.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.763+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94250460518112 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b865382fc0 con 0x55b865337b60 2024-05-08T18:31:22.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.763+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== watch-notify(notify (1) cookie 94250460271792 notify 115964117005 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55b865353b70 con 0x55b865337b60 2024-05-08T18:31:22.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.763+0000 7f4b2cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117005 cookie 94250460271792 notifier 4557 bl.length()=175 2024-05-08T18:31:22.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.763+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(100 notify.4 [notify cookie 94250460518112 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.763+0000 7f4b2cff9640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4b0c003d60 con 0x55b865337b60 2024-05-08T18:31:22.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.763+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.763+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 33 ==== watch-notify(notify_complete (2) cookie 94250460518112 notify 115964117005 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b86532c830 con 0x55b865337b60 2024-05-08T18:31:22.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.763+0000 7f4c4b5a2800 10 removing user index: testx$tenanteduser 2024-05-08T18:31:22.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.763+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865384d20 con 0x7f4c3c03e040 2024-05-08T18:31:22.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.764+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v27'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.764+0000 7f4c4b5a2800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-05-08T18:31:22.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.764+0000 7f4c4b5a2800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-05-08T18:31:22.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.764+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94250460530800 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b865384c90 con 0x7f4c44021070 2024-05-08T18:31:22.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.764+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== watch-notify(notify (1) cookie 94250460268112 notify 115964117016 ret 0) ==== 209+0+0 (crc 0 0 0) 0x55b865355530 con 0x7f4c44021070 2024-05-08T18:31:22.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.765+0000 7f4b1ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117016 cookie 94250460268112 notifier 4557 bl.length()=167 2024-05-08T18:31:22.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.765+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(103 notify.3 [notify cookie 94250460530800 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.765+0000 7f4b1ffff640 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4a7c0032c0 con 0x7f4c44021070 2024-05-08T18:31:22.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.765+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 20 ==== watch-notify(notify_complete (2) cookie 94250460530800 notify 115964117016 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b865354800 con 0x7f4c44021070 2024-05-08T18:31:22.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.765+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.766+0000 7f4aff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:22.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.766+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94250460280864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865384d20 con 0x55b865337b60 2024-05-08T18:31:22.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.767+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 34 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94250460280864] v27'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.767+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94250460255808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865384d20 con 0x7f4c44021070 2024-05-08T18:31:22.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.768+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94250460255808] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.768+0000 7f4c4b5a2800 20 remove_watcher() i=0 2024-05-08T18:31:22.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.768+0000 7f4c4b5a2800 2 removed watcher, disabling cache 2024-05-08T18:31:22.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.768+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94250460262288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865384d20 con 0x55b865337b60 2024-05-08T18:31:22.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.769+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 35 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94250460262288] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.769+0000 7f4c4b5a2800 20 remove_watcher() i=1 2024-05-08T18:31:22.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.769+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94250460263344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865384d20 con 0x55b86533ddd0 2024-05-08T18:31:22.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.770+0000 7f4c4989b640 1 -- 172.21.15.87:0/847717617 <== osd.3 v2:172.21.15.87:6800/2929215285 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94250460263344] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4406b040 con 0x55b86533ddd0 2024-05-08T18:31:22.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.770+0000 7f4c4b5a2800 20 remove_watcher() i=2 2024-05-08T18:31:22.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.770+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94250460268112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865341640 con 0x7f4c44021070 2024-05-08T18:31:22.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.771+0000 7f4c4909a640 1 -- 172.21.15.87:0/847717617 <== osd.2 v2:172.21.15.87:6816/2108501615 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94250460268112] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3c01b1f0 con 0x7f4c44021070 2024-05-08T18:31:22.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.771+0000 7f4c4b5a2800 20 remove_watcher() i=3 2024-05-08T18:31:22.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.771+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94250460271792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865344650 con 0x55b865337b60 2024-05-08T18:31:22.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.772+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.1 v2:172.21.15.87:6808/2448644045 36 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94250460271792] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x55b865337b60 2024-05-08T18:31:22.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.772+0000 7f4c4b5a2800 20 remove_watcher() i=4 2024-05-08T18:31:22.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.772+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94250460275888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865341640 con 0x7f4c3c03e040 2024-05-08T18:31:22.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.773+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94250460275888] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.773+0000 7f4c4b5a2800 20 remove_watcher() i=5 2024-05-08T18:31:22.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.773+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94250460277184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b865344650 con 0x7f4c3c03e040 2024-05-08T18:31:22.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.774+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94250460277184] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.774+0000 7f4c4b5a2800 20 remove_watcher() i=6 2024-05-08T18:31:22.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.774+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94250460265168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8653464b0 con 0x7f4c3c03e040 2024-05-08T18:31:22.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 <== osd.0 v2:172.21.15.53:6800/443747735 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94250460265168] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4005a040 con 0x7f4c3c03e040 2024-05-08T18:31:22.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 20 remove_watcher() i=7 2024-05-08T18:31:22.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c3c03e040 msgr2=0x7f4c3c028460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c3c03e040 0x7f4c3c028460 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b865337b60 msgr2=0x55b86533a020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b865337b60 0x55b86533a020 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c44021070 msgr2=0x7f4c44055980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c44021070 0x7f4c44055980 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b86533ddd0 msgr2=0x55b8653401c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b86533ddd0 0x55b8653401c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b1403bb50 msgr2=0x7f4b1403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b1403bb50 0x7f4b1403e010 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c002040 tx=0x7f4c3c04e000 comp rx=0 tx=0).stop 2024-05-08T18:31:22.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865324ad0 msgr2=0x55b86532c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c48899640 1 -- 172.21.15.87:0/847717617 reap_dead start 2024-05-08T18:31:22.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865324ad0 0x55b86532c060 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4c44014b00 tx=0x7f4c44052990 comp rx=0 tx=0).stop 2024-05-08T18:31:22.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 shutdown_connections 2024-05-08T18:31:22.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/847717617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865324ad0 0x55b86532c060 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 >> 172.21.15.87:0/847717617 conn(0x55b865320de0 msgr2=0x55b86531e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 shutdown_connections 2024-05-08T18:31:22.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/847717617 wait complete. 2024-05-08T18:31:22.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/3355417474 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b2003bba0 msgr2=0x7f4b2003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/3355417474 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b2003bba0 0x7f4b2003e060 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c0035c0 tx=0x7f4c3c011f60 comp rx=0 tx=0).stop 2024-05-08T18:31:22.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/3355417474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865317830 msgr2=0x55b865317c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.775+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/3355417474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865317830 0x55b865317c50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x55b8652fd730 tx=0x7f4c4400ef30 comp rx=0 tx=0).stop 2024-05-08T18:31:22.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/3355417474 shutdown_connections 2024-05-08T18:31:22.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/3355417474 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b2003bba0 0x7f4b2003e060 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/3355417474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b865317830 0x55b865317c50 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/3355417474 >> 172.21.15.87:0/3355417474 conn(0x55b86530b8d0 msgr2=0x55b86530bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/3355417474 shutdown_connections 2024-05-08T18:31:22.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/3355417474 wait complete. 2024-05-08T18:31:22.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/4054259111 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b865306c80 msgr2=0x55b865309070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b865306c80 0x55b865309070 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/4054259111 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b8652016b0 msgr2=0x55b865303440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b8652016b0 0x55b865303440 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/4054259111 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b3003bba0 msgr2=0x7f4b3003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b3003bba0 0x7f4b3003e060 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4c40054000 tx=0x7f4c4004e000 comp rx=0 tx=0).stop 2024-05-08T18:31:22.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/4054259111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8651ffb70 msgr2=0x55b8652fc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8651ffb70 0x55b8652fc330 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c006fa0 tx=0x7f4c3c001250 comp rx=0 tx=0).stop 2024-05-08T18:31:22.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/4054259111 shutdown_connections 2024-05-08T18:31:22.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b8652016b0 0x55b865303440 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b865306c80 0x55b865309070 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b3003bba0 0x7f4b3003e060 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 --2- 172.21.15.87:0/4054259111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8651ffb70 0x55b8652fc330 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/4054259111 >> 172.21.15.87:0/4054259111 conn(0x55b8651fb6b0 msgr2=0x55b8652ee8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/4054259111 shutdown_connections 2024-05-08T18:31:22.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.776+0000 7f4c4b5a2800 1 -- 172.21.15.87:0/4054259111 wait complete. 2024-05-08T18:31:22.791 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-05-08T18:31:22.794 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-05-08T18:31:22.796 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:22.796 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-05-08T18:31:22.797 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-05-08T18:31:22.797 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-05-08T18:31:22.844 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:22.844 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:22.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.847+0000 7f400da13800 1 Processor -- start 2024-05-08T18:31:22.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.847+0000 7f400da13800 1 -- start start 2024-05-08T18:31:22.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.847+0000 7f400da13800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55af46941b70 0x55af46941f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.847+0000 7f400da13800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55af468b6660 con 0x55af469424d0 2024-05-08T18:31:22.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.847+0000 7f400da13800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55af467e3e20 con 0x55af46941b70 2024-05-08T18:31:22.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.847+0000 7f4008fd5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55af46941b70 0x55af46941f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.847+0000 7f40007d4640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55af469424d0 0x55af46942980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:52606/0 (socket says 172.21.15.87:52606) 2024-05-08T18:31:22.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.847+0000 7f40007d4640 1 -- 172.21.15.87:0/1417882670 learned_addr learned my addr 172.21.15.87:0/1417882670 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:22.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.848+0000 7f4008fd5640 1 -- 172.21.15.87:0/1417882670 >> v1:172.21.15.53:6789/0 conn(0x55af469424d0 legacy=0x55af46942980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.848+0000 7f4008fd5640 1 -- 172.21.15.87:0/1417882670 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af46943090 con 0x55af46941b70 2024-05-08T18:31:22.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.849+0000 7f4008fd5640 1 --2- 172.21.15.87:0/1417882670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 0x55af46941f90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800a470 tx=0x7f3ff801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711d3742a5bc46f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.850+0000 7f4003fff640 1 -- 172.21.15.87:0/1417882670 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff8057070 con 0x55af46941b70 2024-05-08T18:31:22.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.850+0000 7f4003fff640 1 -- 172.21.15.87:0/1417882670 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff8052570 con 0x55af46941b70 2024-05-08T18:31:22.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.850+0000 7f4003fff640 1 -- 172.21.15.87:0/1417882670 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff8052870 con 0x55af46941b70 2024-05-08T18:31:22.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.850+0000 7f400da13800 1 -- 172.21.15.87:0/1417882670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 msgr2=0x55af46941f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.850+0000 7f400da13800 1 --2- 172.21.15.87:0/1417882670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 0x55af46941f90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800a470 tx=0x7f3ff801ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:22.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.850+0000 7f400da13800 1 -- 172.21.15.87:0/1417882670 shutdown_connections 2024-05-08T18:31:22.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.850+0000 7f400da13800 1 --2- 172.21.15.87:0/1417882670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 0x55af46941f90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.850+0000 7f400da13800 1 -- 172.21.15.87:0/1417882670 >> 172.21.15.87:0/1417882670 conn(0x55af4693d730 msgr2=0x55af4693fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.850+0000 7f400da13800 1 -- 172.21.15.87:0/1417882670 shutdown_connections 2024-05-08T18:31:22.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.850+0000 7f400da13800 1 -- 172.21.15.87:0/1417882670 wait complete. 2024-05-08T18:31:22.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.864+0000 7f400da13800 1 Processor -- start 2024-05-08T18:31:22.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.864+0000 7f400da13800 1 -- start start 2024-05-08T18:31:22.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.864+0000 7f400da13800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 0x55af46a36a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.864+0000 7f400da13800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55af4688e5c0 con 0x55af46941b70 2024-05-08T18:31:22.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.864+0000 7f4008fd5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 0x55af46a36a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.864+0000 7f4008fd5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 0x55af46a36a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57128/0 (socket says 172.21.15.87:57128) 2024-05-08T18:31:22.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.864+0000 7f4008fd5640 1 -- 172.21.15.87:0/4031331017 learned_addr learned my addr 172.21.15.87:0/4031331017 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.865+0000 7f4008fd5640 1 -- 172.21.15.87:0/4031331017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af46a37000 con 0x55af46941b70 2024-05-08T18:31:22.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.865+0000 7f4008fd5640 1 --2- 172.21.15.87:0/4031331017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 0x55af46a36a30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3ff801ced0 tx=0x7f3ff804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f94914ee74e325a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.865+0000 7f3ef6e0d640 1 -- 172.21.15.87:0/4031331017 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff8057040 con 0x55af46941b70 2024-05-08T18:31:22.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.865+0000 7f3ef6e0d640 1 -- 172.21.15.87:0/4031331017 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff80529a0 con 0x55af46941b70 2024-05-08T18:31:22.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.865+0000 7f3ef6e0d640 1 -- 172.21.15.87:0/4031331017 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff8052cc0 con 0x55af46941b70 2024-05-08T18:31:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.866+0000 7f400da13800 1 -- 172.21.15.87:0/4031331017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 msgr2=0x55af46a36a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.866+0000 7f400da13800 1 --2- 172.21.15.87:0/4031331017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 0x55af46a36a30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3ff801ced0 tx=0x7f3ff804c000 comp rx=0 tx=0).stop 2024-05-08T18:31:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.866+0000 7f400da13800 1 -- 172.21.15.87:0/4031331017 shutdown_connections 2024-05-08T18:31:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.866+0000 7f400da13800 1 --2- 172.21.15.87:0/4031331017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 0x55af46a36a30 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.866+0000 7f400da13800 1 -- 172.21.15.87:0/4031331017 >> 172.21.15.87:0/4031331017 conn(0x55af4693d730 msgr2=0x55af46a32350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.866+0000 7f400da13800 1 -- 172.21.15.87:0/4031331017 shutdown_connections 2024-05-08T18:31:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.866+0000 7f400da13800 1 -- 172.21.15.87:0/4031331017 wait complete. 2024-05-08T18:31:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.866+0000 7f400da13800 1 Processor -- start 2024-05-08T18:31:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.866+0000 7f400da13800 1 -- start start 2024-05-08T18:31:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.866+0000 7f400da13800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 0x55af46a3e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.866+0000 7f400da13800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55af469435c0 con 0x55af46941b70 2024-05-08T18:31:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.866+0000 7f4008fd5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 0x55af46a3e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.866+0000 7f4008fd5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 0x55af46a3e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57136/0 (socket says 172.21.15.87:57136) 2024-05-08T18:31:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.866+0000 7f4008fd5640 1 -- 172.21.15.87:0/1066880180 learned_addr learned my addr 172.21.15.87:0/1066880180 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.867+0000 7f4008fd5640 1 -- 172.21.15.87:0/1066880180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af46a3e970 con 0x55af46941b70 2024-05-08T18:31:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.867+0000 7f4008fd5640 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 0x55af46a3e430 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8052740 tx=0x7f3ff8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.867+0000 7f3ef560a640 1 -- 172.21.15.87:0/1066880180 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff8073070 con 0x55af46941b70 2024-05-08T18:31:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.867+0000 7f3ef560a640 1 -- 172.21.15.87:0/1066880180 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff805d860 con 0x55af46941b70 2024-05-08T18:31:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.867+0000 7f400da13800 1 -- 172.21.15.87:0/1066880180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55af46a3ec00 con 0x55af46941b70 2024-05-08T18:31:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.867+0000 7f3ef560a640 1 -- 172.21.15.87:0/1066880180 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff8057070 con 0x55af46941b70 2024-05-08T18:31:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.867+0000 7f400da13800 1 -- 172.21.15.87:0/1066880180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af46a41860 con 0x55af46941b70 2024-05-08T18:31:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.868+0000 7f3ef560a640 1 -- 172.21.15.87:0/1066880180 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3ff8076070 con 0x55af46941b70 2024-05-08T18:31:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.868+0000 7f3ef560a640 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ef003bb50 0x7f3ef003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.868+0000 7f3ef560a640 1 -- 172.21.15.87:0/1066880180 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f3ff8094660 con 0x55af46941b70 2024-05-08T18:31:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.868+0000 7f40007d4640 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ef003bb50 0x7f3ef003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.868+0000 7f400da13800 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55af469424d0 0x55af46a45620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.868+0000 7f400da13800 1 -- 172.21.15.87:0/1066880180 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46a45bf0 con 0x55af469424d0 2024-05-08T18:31:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.868+0000 7f40097d6640 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55af469424d0 0x55af46a45620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.869+0000 7f40007d4640 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ef003bb50 0x7f3ef003e010 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0000f60 tx=0x7f3ff00012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.869+0000 7f40097d6640 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55af469424d0 0x55af46a45620 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.869+0000 7f40097d6640 1 -- 172.21.15.87:0/1066880180 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f400400a4a0 con 0x55af469424d0 2024-05-08T18:31:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.869+0000 7f400da13800 1 -- 172.21.15.87:0/1066880180 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46a42bf0 con 0x55af469424d0 2024-05-08T18:31:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.869+0000 7f40097d6640 1 -- 172.21.15.87:0/1066880180 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f400400a4a0 con 0x55af469424d0 2024-05-08T18:31:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.869+0000 7f400da13800 1 -- 172.21.15.87:0/1066880180 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46a47a30 con 0x55af469424d0 2024-05-08T18:31:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.869+0000 7f40097d6640 1 -- 172.21.15.87:0/1066880180 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f400400a4a0 con 0x55af469424d0 2024-05-08T18:31:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.869+0000 7f400da13800 1 -- 172.21.15.87:0/1066880180 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46a46c60 con 0x55af469424d0 2024-05-08T18:31:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.870+0000 7f40097d6640 1 -- 172.21.15.87:0/1066880180 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f400400a4a0 con 0x55af469424d0 2024-05-08T18:31:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.870+0000 7f400da13800 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55af46a48de0 0x55af46a4b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.870+0000 7f400da13800 1 -- 172.21.15.87:0/1066880180 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46a4b710 con 0x55af46a48de0 2024-05-08T18:31:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.870+0000 7f4008fd5640 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55af46a48de0 0x55af46a4b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.870+0000 7f4008fd5640 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55af46a48de0 0x55af46a4b1d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.871+0000 7f4008fd5640 1 -- 172.21.15.87:0/1066880180 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3ff8075030 con 0x55af46a48de0 2024-05-08T18:31:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.871+0000 7f400da13800 1 Processor -- start 2024-05-08T18:31:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.871+0000 7f400da13800 1 -- start start 2024-05-08T18:31:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.871+0000 7f400da13800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a59990 0x55af46a59db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.871+0000 7f400da13800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55af46834fc0 con 0x55af46a59990 2024-05-08T18:31:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.871+0000 7f40097d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a59990 0x55af46a59db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.871+0000 7f40097d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a59990 0x55af46a59db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57150/0 (socket says 172.21.15.87:57150) 2024-05-08T18:31:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.871+0000 7f40097d6640 1 -- 172.21.15.87:0/1280634322 learned_addr learned my addr 172.21.15.87:0/1280634322 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.871+0000 7f40097d6640 1 -- 172.21.15.87:0/1280634322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af46a5a2f0 con 0x55af46a59990 2024-05-08T18:31:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.872+0000 7f40097d6640 1 --2- 172.21.15.87:0/1280634322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a59990 0x55af46a59db0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x55af46a3f7e0 tx=0x7f40040178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.872+0000 7f3eee7fc640 1 -- 172.21.15.87:0/1280634322 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4004013440 con 0x55af46a59990 2024-05-08T18:31:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.872+0000 7f3eee7fc640 1 -- 172.21.15.87:0/1280634322 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40040135e0 con 0x55af46a59990 2024-05-08T18:31:22.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.872+0000 7f400da13800 1 -- 172.21.15.87:0/1280634322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55af46a5ad60 con 0x55af46a59990 2024-05-08T18:31:22.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.872+0000 7f3eee7fc640 1 -- 172.21.15.87:0/1280634322 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40040138c0 con 0x55af46a59990 2024-05-08T18:31:22.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.872+0000 7f400da13800 1 -- 172.21.15.87:0/1280634322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af46a5b260 con 0x55af46a59990 2024-05-08T18:31:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.873+0000 7f3eee7fc640 1 -- 172.21.15.87:0/1280634322 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4004011040 con 0x55af46a59990 2024-05-08T18:31:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.873+0000 7f3eee7fc640 1 --2- 172.21.15.87:0/1280634322 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ee003bb50 0x7f3ee003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.873+0000 7f3eee7fc640 1 -- 172.21.15.87:0/1280634322 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f400401d070 con 0x55af46a59990 2024-05-08T18:31:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.873+0000 7f4008fd5640 1 --2- 172.21.15.87:0/1280634322 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ee003bb50 0x7f3ee003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.873+0000 7f400da13800 1 Processor -- start 2024-05-08T18:31:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.873+0000 7f400da13800 1 -- start start 2024-05-08T18:31:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.873+0000 7f4008fd5640 1 --2- 172.21.15.87:0/1280634322 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ee003bb50 0x7f3ee003e010 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55af46a47000 tx=0x7f3ff80929e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.873+0000 7f400da13800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a66cb0 0x55af46a670d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.873+0000 7f400da13800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55af46a372c0 con 0x55af46a66cb0 2024-05-08T18:31:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.874+0000 7f40097d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a66cb0 0x55af46a670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.874+0000 7f40097d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a66cb0 0x55af46a670d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57154/0 (socket says 172.21.15.87:57154) 2024-05-08T18:31:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.874+0000 7f40097d6640 1 -- 172.21.15.87:0/4150602090 learned_addr learned my addr 172.21.15.87:0/4150602090 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.874+0000 7f40097d6640 1 -- 172.21.15.87:0/4150602090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af46a676a0 con 0x55af46a66cb0 2024-05-08T18:31:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.874+0000 7f40097d6640 1 --2- 172.21.15.87:0/4150602090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a66cb0 0x55af46a670d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f40040529e0 tx=0x7f4004001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7841ec697f0a1698 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.874+0000 7f3edffff640 1 -- 172.21.15.87:0/4150602090 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f400402ac50 con 0x55af46a66cb0 2024-05-08T18:31:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.874+0000 7f3edffff640 1 -- 172.21.15.87:0/4150602090 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f400402adf0 con 0x55af46a66cb0 2024-05-08T18:31:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.874+0000 7f3edffff640 1 -- 172.21.15.87:0/4150602090 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4004054220 con 0x55af46a66cb0 2024-05-08T18:31:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.874+0000 7f400da13800 1 -- 172.21.15.87:0/4150602090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a66cb0 msgr2=0x55af46a670d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.874+0000 7f400da13800 1 --2- 172.21.15.87:0/4150602090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a66cb0 0x55af46a670d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f40040529e0 tx=0x7f4004001b10 comp rx=0 tx=0).stop 2024-05-08T18:31:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.874+0000 7f400da13800 1 -- 172.21.15.87:0/4150602090 shutdown_connections 2024-05-08T18:31:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.874+0000 7f400da13800 1 --2- 172.21.15.87:0/4150602090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a66cb0 0x55af46a670d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.874+0000 7f400da13800 1 -- 172.21.15.87:0/4150602090 >> 172.21.15.87:0/4150602090 conn(0x55af46a63010 msgr2=0x55af46a61070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.875+0000 7f400da13800 1 -- 172.21.15.87:0/4150602090 shutdown_connections 2024-05-08T18:31:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.875+0000 7f400da13800 1 -- 172.21.15.87:0/4150602090 wait complete. 2024-05-08T18:31:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.875+0000 7f400da13800 1 Processor -- start 2024-05-08T18:31:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.875+0000 7f400da13800 1 -- start start 2024-05-08T18:31:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.875+0000 7f400da13800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a66cb0 0x55af46a6e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.875+0000 7f400da13800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55af46a67e10 con 0x55af46a66cb0 2024-05-08T18:31:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.875+0000 7f40097d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a66cb0 0x55af46a6e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.875+0000 7f40097d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a66cb0 0x55af46a6e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57162/0 (socket says 172.21.15.87:57162) 2024-05-08T18:31:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.875+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 learned_addr learned my addr 172.21.15.87:0/4164730553 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.876+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af46a6e7e0 con 0x55af46a66cb0 2024-05-08T18:31:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.876+0000 7f40097d6640 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a66cb0 0x55af46a6e2a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4004043040 tx=0x7f4004052940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.876+0000 7f3ede7fc640 1 -- 172.21.15.87:0/4164730553 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f400402ac50 con 0x55af46a66cb0 2024-05-08T18:31:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.876+0000 7f3ede7fc640 1 -- 172.21.15.87:0/4164730553 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4004031070 con 0x55af46a66cb0 2024-05-08T18:31:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.876+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55af46a6ea70 con 0x55af46a66cb0 2024-05-08T18:31:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.876+0000 7f3ede7fc640 1 -- 172.21.15.87:0/4164730553 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4004013a60 con 0x55af46a66cb0 2024-05-08T18:31:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.876+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af46a71720 con 0x55af46a66cb0 2024-05-08T18:31:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.877+0000 7f3ede7fc640 1 -- 172.21.15.87:0/4164730553 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4004013c00 con 0x55af46a66cb0 2024-05-08T18:31:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.877+0000 7f3ede7fc640 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ed403bb50 0x7f3ed403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.877+0000 7f3ede7fc640 1 -- 172.21.15.87:0/4164730553 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f400400e040 con 0x55af46a66cb0 2024-05-08T18:31:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.877+0000 7f4008fd5640 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ed403bb50 0x7f3ed403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.877+0000 7f4008fd5640 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ed403bb50 0x7f3ed403e010 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3ff805b710 tx=0x7f3ff8083000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.878+0000 7f400da13800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.878+0000 7f400da13800 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55af46a79f30 0x55af46a7c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.878+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46a7cb40 con 0x55af46a79f30 2024-05-08T18:31:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.878+0000 7f40007d4640 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55af46a79f30 0x55af46a7c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.878+0000 7f40007d4640 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55af46a79f30 0x55af46a7c3f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.878+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ff0009050 con 0x55af46a79f30 2024-05-08T18:31:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.878+0000 7f400da13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.878+0000 7f400da13800 20 realm 2024-05-08T18:31:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.878+0000 7f400da13800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.878+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46a79380 con 0x55af46a79f30 2024-05-08T18:31:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.878+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ff0009050 con 0x55af46a79f30 2024-05-08T18:31:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.878+0000 7f400da13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.878+0000 7f400da13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.878+0000 7f400da13800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.878+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46a7d630 con 0x55af46a79f30 2024-05-08T18:31:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.879+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ff0009050 con 0x55af46a79f30 2024-05-08T18:31:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.879+0000 7f400da13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.879+0000 7f400da13800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.879+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46a7df00 con 0x55af46a79f30 2024-05-08T18:31:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.879+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ff0009050 con 0x55af46a79f30 2024-05-08T18:31:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.879+0000 7f400da13800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.879+0000 7f400da13800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.879+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46a7e2a0 con 0x55af46a79f30 2024-05-08T18:31:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.879+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3ff0009050 con 0x55af46a79f30 2024-05-08T18:31:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.879+0000 7f400da13800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:22.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.879+0000 7f400da13800 20 searching for the correct realm 2024-05-08T18:31:22.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.879+0000 7f400da13800 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55af46a80180 0x55af46a82570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.879+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x55af46a80180 2024-05-08T18:31:22.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.879+0000 7f40097d6640 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55af46a80180 0x55af46a82570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.880+0000 7f40097d6640 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55af46a80180 0x55af46a82570 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.880+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.880+0000 7f40097d6640 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f400402dba0 0x7f40040511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.880+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x7f400402dba0 2024-05-08T18:31:22.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.880+0000 7f4008fd5640 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f400402dba0 0x7f40040511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.880+0000 7f4008fd5640 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f400402dba0 0x7f40040511e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.881+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.881+0000 7f4008fd5640 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f3ff8078060 0x7f3ff808b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:22.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.881+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x7f3ff8078060 2024-05-08T18:31:22.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.881+0000 7f40007d4640 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f3ff8078060 0x7f3ff808b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:22.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.881+0000 7f40007d4640 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f3ff8078060 0x7f3ff808b300 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:22.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.881+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff0009050 con 0x7f3ff8078060 2024-05-08T18:31:22.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.882+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x55af46a79f30 2024-05-08T18:31:22.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.882+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff0009050 con 0x55af46a79f30 2024-05-08T18:31:22.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.882+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x55af46a79f30 2024-05-08T18:31:22.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.882+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.882+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x7f3ff8078060 2024-05-08T18:31:22.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.882+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.882+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x7f3ff8078060 2024-05-08T18:31:22.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.882+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.882+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x7f400402dba0 2024-05-08T18:31:22.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.883+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.883+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x55af46a80180 2024-05-08T18:31:22.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.883+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.883+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x55af46a79f30 2024-05-08T18:31:22.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.883+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.883+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x7f3ff8078060 2024-05-08T18:31:22.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.883+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.883+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x55af46a79f30 2024-05-08T18:31:22.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.884+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.884+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x7f400402dba0 2024-05-08T18:31:22.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.884+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.884+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x55af46a80180 2024-05-08T18:31:22.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.884+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.884+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x55af46a80180 2024-05-08T18:31:22.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.884+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.884+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x7f3ff8078060 2024-05-08T18:31:22.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.885+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.885+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x55af46a80180 2024-05-08T18:31:22.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.885+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.885+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x55af46a80180 2024-05-08T18:31:22.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.885+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.885+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x55af46a79f30 2024-05-08T18:31:22.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.885+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.885+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x55af46a79f30 2024-05-08T18:31:22.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.886+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.886+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x7f3ff8078060 2024-05-08T18:31:22.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.886+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.886+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x55af46a80180 2024-05-08T18:31:22.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.886+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.886+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x7f400402dba0 2024-05-08T18:31:22.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.887+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.887+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x55af46a79f30 2024-05-08T18:31:22.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.887+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.887+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x7f3ff8078060 2024-05-08T18:31:22.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.887+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.887+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x55af46a80180 2024-05-08T18:31:22.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.888+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.888+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x7f3ff8078060 2024-05-08T18:31:22.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.888+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.888+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x7f400402dba0 2024-05-08T18:31:22.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.888+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.888+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x55af46a80180 2024-05-08T18:31:22.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.888+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.888+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x7f3ff8078060 2024-05-08T18:31:22.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x55af46a79f30 2024-05-08T18:31:22.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55af46a82c20 con 0x7f400402dba0 2024-05-08T18:31:22.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f400da13800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:22.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f400da13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:22.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f400da13800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:22.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f400da13800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:22.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f400da13800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:22.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f400da13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:22.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f400da13800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46a7ec20 con 0x55af46a79f30 2024-05-08T18:31:22.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f400da13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f400da13800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46a7f4c0 con 0x55af46a79f30 2024-05-08T18:31:22.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.889+0000 7f400da13800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:22.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f400da13800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46a830a0 con 0x7f3ff8078060 2024-05-08T18:31:22.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f400da13800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:22.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f400da13800 20 zone default found 2024-05-08T18:31:22.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f400da13800 4 Realm: () 2024-05-08T18:31:22.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f400da13800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:22.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f400da13800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:22.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f400da13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:22.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f400da13800 20 zonegroup default 2024-05-08T18:31:22.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f400da13800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46a83550 con 0x7f3ff8078060 2024-05-08T18:31:22.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f400da13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f400da13800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46a84f30 con 0x55af46a80180 2024-05-08T18:31:22.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f400da13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f400da13800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.890+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46a853b0 con 0x55af46a80180 2024-05-08T18:31:22.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.891+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.891+0000 7f400da13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:22.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.891+0000 7f400da13800 20 started sync module instance, tier type = 2024-05-08T18:31:22.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.891+0000 7f400da13800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:22.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.891+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a843c0 con 0x7f400402dba0 2024-05-08T18:31:22.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.892+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.892+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94211293071328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a84020 con 0x7f400402dba0 2024-05-08T18:31:22.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.892+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a862e0 con 0x55af46a79f30 2024-05-08T18:31:22.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.893+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94211293071328] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.893+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.893+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94211293077040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a86700 con 0x55af46a79f30 2024-05-08T18:31:22.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.893+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a870c0 con 0x55af46a80180 2024-05-08T18:31:22.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.894+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.894+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94211293077040] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.894+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94211293080592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a87030 con 0x55af46a80180 2024-05-08T18:31:22.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.894+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a87b90 con 0x7f400402dba0 2024-05-08T18:31:22.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.895+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94211293080592] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.895+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.895+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94211293083264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a87fb0 con 0x7f400402dba0 2024-05-08T18:31:22.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.895+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a889b0 con 0x55af46a79f30 2024-05-08T18:31:22.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.896+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.896+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94211293086912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a89280 con 0x55af46a79f30 2024-05-08T18:31:22.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.896+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a89d70 con 0x7f3ff8078060 2024-05-08T18:31:22.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.896+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94211293083264] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.897+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.897+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94211293091904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a89d30 con 0x7f3ff8078060 2024-05-08T18:31:22.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.897+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a8a780 con 0x7f3ff8078060 2024-05-08T18:31:22.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.897+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94211293086912] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.898+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94211293091904] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.899+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.899+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94211293078096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a8a2d0 con 0x7f3ff8078060 2024-05-08T18:31:22.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.899+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a8ac90 con 0x7f3ff8078060 2024-05-08T18:31:22.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.899+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94211293078096] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.900+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.900+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94211293089232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a8ac90 con 0x7f3ff8078060 2024-05-08T18:31:22.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.900+0000 7f400da13800 20 add_watcher() i=0 2024-05-08T18:31:22.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.900+0000 7f400da13800 20 add_watcher() i=1 2024-05-08T18:31:22.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.900+0000 7f400da13800 20 add_watcher() i=2 2024-05-08T18:31:22.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.900+0000 7f400da13800 20 add_watcher() i=3 2024-05-08T18:31:22.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.900+0000 7f400da13800 20 add_watcher() i=4 2024-05-08T18:31:22.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.900+0000 7f400da13800 20 add_watcher() i=5 2024-05-08T18:31:22.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.900+0000 7f400da13800 20 add_watcher() i=6 2024-05-08T18:31:22.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.900+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94211293089232] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.900+0000 7f400da13800 20 add_watcher() i=7 2024-05-08T18:31:22.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.900+0000 7f400da13800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:22.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.900+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46a8dff0 con 0x55af46a79f30 2024-05-08T18:31:22.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.901+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.901+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94211293108720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a8ae00 con 0x55af46a79f30 2024-05-08T18:31:22.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.902+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94211293108720] v27'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.902+0000 7f3ebefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:22.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.902+0000 7f400da13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:22.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.902+0000 7f400da13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:22.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.902+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a96960 con 0x55af46a79f30 2024-05-08T18:31:22.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.903+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.903+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a96fb0 con 0x7f3ff8078060 2024-05-08T18:31:22.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.904+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.904+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a97410 con 0x55af46a80180 2024-05-08T18:31:22.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.905+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.905+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a973c0 con 0x55af46a79f30 2024-05-08T18:31:22.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.906+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'140 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.906+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a97930 con 0x7f400402dba0 2024-05-08T18:31:22.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.907+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.907+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98350 con 0x55af46a80180 2024-05-08T18:31:22.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.908+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'28 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.908+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98350 con 0x55af46a79f30 2024-05-08T18:31:22.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.909+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.909+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98350 con 0x7f3ff8078060 2024-05-08T18:31:22.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.910+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.910+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98350 con 0x7f400402dba0 2024-05-08T18:31:22.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.911+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.911+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a984b0 con 0x55af46a80180 2024-05-08T18:31:22.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.912+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.912+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a988e0 con 0x7f400402dba0 2024-05-08T18:31:22.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.913+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.913+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a988e0 con 0x7f3ff8078060 2024-05-08T18:31:22.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.914+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.914+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a988e0 con 0x7f400402dba0 2024-05-08T18:31:22.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.915+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.915+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a988e0 con 0x7f3ff8078060 2024-05-08T18:31:22.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.916+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'33 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.916+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a988e0 con 0x55af46a79f30 2024-05-08T18:31:22.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.917+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'141 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.917+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a988e0 con 0x55af46a80180 2024-05-08T18:31:22.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.918+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.918+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98ab0 con 0x7f400402dba0 2024-05-08T18:31:22.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.919+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.919+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98ab0 con 0x55af46a80180 2024-05-08T18:31:22.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.920+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.920+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98ab0 con 0x55af46a79f30 2024-05-08T18:31:22.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.921+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.921+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98ab0 con 0x55af46a79f30 2024-05-08T18:31:22.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.922+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'142 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.922+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98ab0 con 0x55af46a80180 2024-05-08T18:31:22.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.924+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'36 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.924+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98ab0 con 0x7f400402dba0 2024-05-08T18:31:22.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.924+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.924+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98ab0 con 0x55af46a80180 2024-05-08T18:31:22.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.925+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.925+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98ab0 con 0x55af46a80180 2024-05-08T18:31:22.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.926+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.926+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98ab0 con 0x55af46a80180 2024-05-08T18:31:22.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.927+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.927+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98ab0 con 0x55af46a80180 2024-05-08T18:31:22.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.928+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.928+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98ab0 con 0x7f3ff8078060 2024-05-08T18:31:22.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.929+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.929+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98ab0 con 0x55af46a80180 2024-05-08T18:31:22.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.930+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.930+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98ab0 con 0x7f3ff8078060 2024-05-08T18:31:22.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.931+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.931+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98ab0 con 0x55af46a80180 2024-05-08T18:31:22.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.932+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'37 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.932+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98ab0 con 0x7f3ff8078060 2024-05-08T18:31:22.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.933+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'34 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.933+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a98ab0 con 0x7f400402dba0 2024-05-08T18:31:22.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.934+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.935+0000 7f3ebdfe3640 20 reqs_thread_entry: start 2024-05-08T18:31:22.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.935+0000 7f400da13800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:22.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.935+0000 7f400da13800 20 Filter name: none 2024-05-08T18:31:22.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.935+0000 7f3e2f7fe640 20 reqs_thread_entry: start 2024-05-08T18:31:22.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.935+0000 7f400da13800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:31:22.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.935+0000 7f400da13800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.935+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46ac3c10 con 0x7f400402dba0 2024-05-08T18:31:22.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.935+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.935+0000 7f400da13800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:22.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.935+0000 7f400da13800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:31:22.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.935+0000 7f400da13800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:22.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.935+0000 7f400da13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 : miss 2024-05-08T18:31:22.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.935+0000 7f400da13800 20 rados->read ofs=0 len=0 2024-05-08T18:31:22.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.935+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:95 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46ac5640 con 0x55af46a80180 2024-05-08T18:31:22.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.936+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(95 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.936+0000 7f400da13800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:22.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.936+0000 7f400da13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x17 2024-05-08T18:31:22.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.936+0000 7f400da13800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:22.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.936+0000 7f400da13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:22.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.936+0000 7f400da13800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:22.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.936+0000 7f400da13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 2024-05-08T18:31:22.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.936+0000 7f400da13800 20 get_obj_state: octx=0x7f3ff000e510 obj=myfoo:four state=0x55af46ac6908 s->prefetch_data=0 2024-05-08T18:31:22.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.936+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:96 3.3fs0 3:fc68870a:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55af46ac7730 con 0x7f400402dba0 2024-05-08T18:31:22.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.936+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(96 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.936+0000 7f400da13800 10 manifest: total_size = 4 2024-05-08T18:31:22.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.936+0000 7f400da13800 20 get_obj_state: setting s->obj_tag to be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.4993322455744333846 2024-05-08T18:31:22.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.936+0000 7f400da13800 20 get_obj_state: octx=0x7f3ff000e510 obj=myfoo:four state=0x55af46ac6908 s->prefetch_data=0 2024-05-08T18:31:22.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.936+0000 7f400da13800 20 prepare_atomic_modification: state is not atomic. state=0x55af46ac6908 2024-05-08T18:31:22.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.936+0000 7f400da13800 20 bucket index object: :.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.6 2024-05-08T18:31:22.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.936+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:97 4.32 4:4ef39ee1:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46acc0c0 con 0x55af46a79f30 2024-05-08T18:31:22.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.937+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(97 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.6 [stat,call,call] v27'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.937+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:98 3.3fs0 3:fc68870a:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46acc0c0 con 0x7f400402dba0 2024-05-08T18:31:22.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.938+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 20 ==== osd_op_reply(98 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1_four [call] v27'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.938+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:99 4.32 4:4ef39ee1:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46acc9f0 con 0x55af46a79f30 2024-05-08T18:31:22.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.940+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(99 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.6 [stat,call,call] v27'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.940+0000 7f3edffff640 20 handle_completion(): completion ok for obj=four 2024-05-08T18:31:22.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.940+0000 7f3ebefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:22.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.940+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94211293108720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46acc9f0 con 0x55af46a79f30 2024-05-08T18:31:22.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.941+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94211293108720] v27'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.941+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94211293071328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46acc9f0 con 0x7f400402dba0 2024-05-08T18:31:22.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.942+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 21 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94211293071328] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.942+0000 7f400da13800 20 remove_watcher() i=0 2024-05-08T18:31:22.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.942+0000 7f400da13800 2 removed watcher, disabling cache 2024-05-08T18:31:22.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.942+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94211293077040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46acc9f0 con 0x55af46a79f30 2024-05-08T18:31:22.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.943+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94211293077040] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.943+0000 7f400da13800 20 remove_watcher() i=1 2024-05-08T18:31:22.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.943+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94211293080592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46acc9f0 con 0x55af46a80180 2024-05-08T18:31:22.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.944+0000 7f40097d6640 1 -- 172.21.15.87:0/4164730553 <== osd.3 v2:172.21.15.87:6800/2929215285 27 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94211293080592] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4004029070 con 0x55af46a80180 2024-05-08T18:31:22.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.944+0000 7f400da13800 20 remove_watcher() i=2 2024-05-08T18:31:22.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.944+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94211293083264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46acc9f0 con 0x7f400402dba0 2024-05-08T18:31:22.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.945+0000 7f4008fd5640 1 -- 172.21.15.87:0/4164730553 <== osd.2 v2:172.21.15.87:6816/2108501615 22 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94211293083264] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff809b040 con 0x7f400402dba0 2024-05-08T18:31:22.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.945+0000 7f400da13800 20 remove_watcher() i=3 2024-05-08T18:31:22.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.945+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94211293086912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46acc9f0 con 0x55af46a79f30 2024-05-08T18:31:22.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.946+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94211293086912] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x55af46a79f30 2024-05-08T18:31:22.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.946+0000 7f400da13800 20 remove_watcher() i=4 2024-05-08T18:31:22.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.946+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94211293091904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46acc9f0 con 0x7f3ff8078060 2024-05-08T18:31:22.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.947+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94211293091904] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.947+0000 7f400da13800 20 remove_watcher() i=5 2024-05-08T18:31:22.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.947+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94211293078096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46acc9f0 con 0x7f3ff8078060 2024-05-08T18:31:22.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.948+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94211293078096] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.948+0000 7f400da13800 20 remove_watcher() i=6 2024-05-08T18:31:22.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.948+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94211293089232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55af46a847e0 con 0x7f3ff8078060 2024-05-08T18:31:22.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94211293089232] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ff002a040 con 0x7f3ff8078060 2024-05-08T18:31:22.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f400da13800 20 remove_watcher() i=7 2024-05-08T18:31:22.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f3ff8078060 msgr2=0x7f3ff808b300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f400da13800 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f3ff8078060 0x7f3ff808b300 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55af46a79f30 msgr2=0x55af46a7c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f400da13800 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55af46a79f30 0x55af46a7c3f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f400402dba0 msgr2=0x7f40040511e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f400da13800 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f400402dba0 0x7f40040511e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55af46a80180 msgr2=0x55af46a82570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f400da13800 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55af46a80180 0x55af46a82570 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ed403bb50 msgr2=0x7f3ed403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f400da13800 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ed403bb50 0x7f3ed403e010 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3ff805b710 tx=0x7f3ff8083000 comp rx=0 tx=0).stop 2024-05-08T18:31:22.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a66cb0 msgr2=0x55af46a6e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f400da13800 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a66cb0 0x55af46a6e2a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4004043040 tx=0x7f4004052940 comp rx=0 tx=0).stop 2024-05-08T18:31:22.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f40007d4640 1 -- 172.21.15.87:0/4164730553 reap_dead start 2024-05-08T18:31:22.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 shutdown_connections 2024-05-08T18:31:22.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f400da13800 1 --2- 172.21.15.87:0/4164730553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a66cb0 0x55af46a6e2a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.949+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 >> 172.21.15.87:0/4164730553 conn(0x55af46a63010 msgr2=0x55af46a60670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 shutdown_connections 2024-05-08T18:31:22.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 -- 172.21.15.87:0/4164730553 wait complete. 2024-05-08T18:31:22.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 -- 172.21.15.87:0/1280634322 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ee003bb50 msgr2=0x7f3ee003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 --2- 172.21.15.87:0/1280634322 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ee003bb50 0x7f3ee003e010 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55af46a47000 tx=0x7f3ff80929e0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 -- 172.21.15.87:0/1280634322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a59990 msgr2=0x55af46a59db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 --2- 172.21.15.87:0/1280634322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a59990 0x55af46a59db0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x55af46a3f7e0 tx=0x7f40040178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 -- 172.21.15.87:0/1280634322 shutdown_connections 2024-05-08T18:31:22.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 --2- 172.21.15.87:0/1280634322 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ee003bb50 0x7f3ee003e010 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 --2- 172.21.15.87:0/1280634322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46a59990 0x55af46a59db0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 -- 172.21.15.87:0/1280634322 >> 172.21.15.87:0/1280634322 conn(0x55af46a4da30 msgr2=0x55af46a4de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 -- 172.21.15.87:0/1280634322 shutdown_connections 2024-05-08T18:31:22.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 -- 172.21.15.87:0/1280634322 wait complete. 2024-05-08T18:31:22.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 -- 172.21.15.87:0/1066880180 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55af46a48de0 msgr2=0x55af46a4b1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55af46a48de0 0x55af46a4b1d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 -- 172.21.15.87:0/1066880180 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55af469424d0 msgr2=0x55af46a45620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55af469424d0 0x55af46a45620 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 -- 172.21.15.87:0/1066880180 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ef003bb50 msgr2=0x7f3ef003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ef003bb50 0x7f3ef003e010 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0000f60 tx=0x7f3ff00012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 -- 172.21.15.87:0/1066880180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 msgr2=0x55af46a3e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:22.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 0x55af46a3e430 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8052740 tx=0x7f3ff8003020 comp rx=0 tx=0).stop 2024-05-08T18:31:22.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 -- 172.21.15.87:0/1066880180 shutdown_connections 2024-05-08T18:31:22.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55af469424d0 0x55af46a45620 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55af46a48de0 0x55af46a4b1d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3ef003bb50 0x7f3ef003e010 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 --2- 172.21.15.87:0/1066880180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af46941b70 0x55af46a3e430 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:22.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.950+0000 7f400da13800 1 -- 172.21.15.87:0/1066880180 >> 172.21.15.87:0/1066880180 conn(0x55af4693d730 msgr2=0x55af46a30b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:22.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.951+0000 7f400da13800 1 -- 172.21.15.87:0/1066880180 shutdown_connections 2024-05-08T18:31:22.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:22.951+0000 7f400da13800 1 -- 172.21.15.87:0/1066880180 wait complete. 2024-05-08T18:31:22.957 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:31:22.958 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:31:22.958 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-08T18:31:23.002 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:23.002 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:23.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.004+0000 7fd5ea034800 1 Processor -- start 2024-05-08T18:31:23.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.004+0000 7fd5ea034800 1 -- start start 2024-05-08T18:31:23.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.004+0000 7fd5ea034800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56063ae6a140 0x56063ae6a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.004+0000 7fd5ea034800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56063ae6abe0 con 0x56063ae6b3a0 2024-05-08T18:31:23.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.004+0000 7fd5ea034800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56063ad0be20 con 0x56063ae6a140 2024-05-08T18:31:23.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.005+0000 7fd5e7b2c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56063ae6a140 0x56063ae6a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.005+0000 7fd5e732b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56063ae6b3a0 0x56063ae6b820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:52620/0 (socket says 172.21.15.87:52620) 2024-05-08T18:31:23.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.005+0000 7fd5e732b640 1 -- 172.21.15.87:0/1623468425 learned_addr learned my addr 172.21.15.87:0/1623468425 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:23.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.005+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1623468425 >> v1:172.21.15.53:6789/0 conn(0x56063ae6b3a0 legacy=0x56063ae6b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.005+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1623468425 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56063ae6bf60 con 0x56063ae6a140 2024-05-08T18:31:23.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.007+0000 7fd5e7b2c640 1 --2- 172.21.15.87:0/1623468425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 0x56063ae6a560 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800a470 tx=0x7fd5d801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2990552a5f4e0bb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.007+0000 7fd5e6b2a640 1 -- 172.21.15.87:0/1623468425 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5d8057070 con 0x56063ae6a140 2024-05-08T18:31:23.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.007+0000 7fd5e6b2a640 1 -- 172.21.15.87:0/1623468425 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d804adc0 con 0x56063ae6a140 2024-05-08T18:31:23.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.007+0000 7fd5e6b2a640 1 -- 172.21.15.87:0/1623468425 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5d8052590 con 0x56063ae6a140 2024-05-08T18:31:23.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.007+0000 7fd5ea034800 1 -- 172.21.15.87:0/1623468425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 msgr2=0x56063ae6a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.007+0000 7fd5ea034800 1 --2- 172.21.15.87:0/1623468425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 0x56063ae6a560 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800a470 tx=0x7fd5d801ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:23.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.007+0000 7fd5ea034800 1 -- 172.21.15.87:0/1623468425 shutdown_connections 2024-05-08T18:31:23.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.007+0000 7fd5ea034800 1 --2- 172.21.15.87:0/1623468425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 0x56063ae6a560 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.007+0000 7fd5ea034800 1 -- 172.21.15.87:0/1623468425 >> 172.21.15.87:0/1623468425 conn(0x56063ae65720 msgr2=0x56063ae67b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.007+0000 7fd5ea034800 1 -- 172.21.15.87:0/1623468425 shutdown_connections 2024-05-08T18:31:23.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.007+0000 7fd5ea034800 1 -- 172.21.15.87:0/1623468425 wait complete. 2024-05-08T18:31:23.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.021+0000 7fd5ea034800 1 Processor -- start 2024-05-08T18:31:23.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.021+0000 7fd5ea034800 1 -- start start 2024-05-08T18:31:23.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.021+0000 7fd5ea034800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 0x56063af5b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.021+0000 7fd5ea034800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56063adb65b0 con 0x56063ae6a140 2024-05-08T18:31:23.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.022+0000 7fd5e7b2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 0x56063af5b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.022+0000 7fd5e7b2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 0x56063af5b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57184/0 (socket says 172.21.15.87:57184) 2024-05-08T18:31:23.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.022+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/3891146327 learned_addr learned my addr 172.21.15.87:0/3891146327 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.022+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/3891146327 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56063af5bc50 con 0x56063ae6a140 2024-05-08T18:31:23.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.022+0000 7fd5e7b2c640 1 --2- 172.21.15.87:0/3891146327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 0x56063af5b680 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8055040 tx=0x7fd5d804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7953e155fe8fe98e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.022+0000 7fd4d5e0b640 1 -- 172.21.15.87:0/3891146327 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5d8057040 con 0x56063ae6a140 2024-05-08T18:31:23.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.022+0000 7fd4d5e0b640 1 -- 172.21.15.87:0/3891146327 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d8063070 con 0x56063ae6a140 2024-05-08T18:31:23.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.022+0000 7fd4d5e0b640 1 -- 172.21.15.87:0/3891146327 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5d805d790 con 0x56063ae6a140 2024-05-08T18:31:23.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.023+0000 7fd5ea034800 1 -- 172.21.15.87:0/3891146327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 msgr2=0x56063af5b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.023+0000 7fd5ea034800 1 --2- 172.21.15.87:0/3891146327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 0x56063af5b680 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8055040 tx=0x7fd5d804c000 comp rx=0 tx=0).stop 2024-05-08T18:31:23.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.023+0000 7fd5ea034800 1 -- 172.21.15.87:0/3891146327 shutdown_connections 2024-05-08T18:31:23.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.023+0000 7fd5ea034800 1 --2- 172.21.15.87:0/3891146327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 0x56063af5b680 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.023+0000 7fd5ea034800 1 -- 172.21.15.87:0/3891146327 >> 172.21.15.87:0/3891146327 conn(0x56063ae65720 msgr2=0x56063af56fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.023+0000 7fd5ea034800 1 -- 172.21.15.87:0/3891146327 shutdown_connections 2024-05-08T18:31:23.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.023+0000 7fd5ea034800 1 -- 172.21.15.87:0/3891146327 wait complete. 2024-05-08T18:31:23.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.023+0000 7fd5ea034800 1 Processor -- start 2024-05-08T18:31:23.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.024+0000 7fd5ea034800 1 -- start start 2024-05-08T18:31:23.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.024+0000 7fd5ea034800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 0x56063adde260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.024+0000 7fd5ea034800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56063ae73870 con 0x56063ae6a140 2024-05-08T18:31:23.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.024+0000 7fd5e7b2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 0x56063adde260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.024+0000 7fd5e7b2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 0x56063adde260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57190/0 (socket says 172.21.15.87:57190) 2024-05-08T18:31:23.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.024+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/2262569998 learned_addr learned my addr 172.21.15.87:0/2262569998 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.024+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/2262569998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56063af66e90 con 0x56063ae6a140 2024-05-08T18:31:23.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.024+0000 7fd5e7b2c640 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 0x56063adde260 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800a470 tx=0x7fd5d8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.024+0000 7fd4cffff640 1 -- 172.21.15.87:0/2262569998 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5d8057050 con 0x56063ae6a140 2024-05-08T18:31:23.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.025+0000 7fd4cffff640 1 -- 172.21.15.87:0/2262569998 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d805dd40 con 0x56063ae6a140 2024-05-08T18:31:23.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.025+0000 7fd4cffff640 1 -- 172.21.15.87:0/2262569998 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5d8052570 con 0x56063ae6a140 2024-05-08T18:31:23.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.025+0000 7fd5ea034800 1 -- 172.21.15.87:0/2262569998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56063af67060 con 0x56063ae6a140 2024-05-08T18:31:23.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.025+0000 7fd5ea034800 1 -- 172.21.15.87:0/2262569998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56063af67520 con 0x56063ae6a140 2024-05-08T18:31:23.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.025+0000 7fd4cffff640 1 -- 172.21.15.87:0/2262569998 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd5d8052820 con 0x56063ae6a140 2024-05-08T18:31:23.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.026+0000 7fd4cffff640 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4d003bb50 0x7fd4d003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.026+0000 7fd4cffff640 1 -- 172.21.15.87:0/2262569998 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd5d8094130 con 0x56063ae6a140 2024-05-08T18:31:23.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.026+0000 7fd5e732b640 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4d003bb50 0x7fd4d003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.026+0000 7fd5ea034800 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56063ae6b3a0 0x56063af6b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.026+0000 7fd5ea034800 1 -- 172.21.15.87:0/2262569998 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063af6b910 con 0x56063ae6b3a0 2024-05-08T18:31:23.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.026+0000 7fd5e832d640 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56063ae6b3a0 0x56063af6b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.026+0000 7fd5e732b640 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4d003bb50 0x7fd4d003e010 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc000f60 tx=0x7fd5dc0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.026+0000 7fd5e832d640 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56063ae6b3a0 0x56063af6b390 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.026+0000 7fd5e832d640 1 -- 172.21.15.87:0/2262569998 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5e000a4a0 con 0x56063ae6b3a0 2024-05-08T18:31:23.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.026+0000 7fd5ea034800 1 -- 172.21.15.87:0/2262569998 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063af68960 con 0x56063ae6b3a0 2024-05-08T18:31:23.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.027+0000 7fd5e832d640 1 -- 172.21.15.87:0/2262569998 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd5e000a4a0 con 0x56063ae6b3a0 2024-05-08T18:31:23.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.027+0000 7fd5ea034800 1 -- 172.21.15.87:0/2262569998 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063af6d750 con 0x56063ae6b3a0 2024-05-08T18:31:23.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.027+0000 7fd5e832d640 1 -- 172.21.15.87:0/2262569998 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd5e000a4a0 con 0x56063ae6b3a0 2024-05-08T18:31:23.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.027+0000 7fd5ea034800 1 -- 172.21.15.87:0/2262569998 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063af6c980 con 0x56063ae6b3a0 2024-05-08T18:31:23.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.027+0000 7fd5e832d640 1 -- 172.21.15.87:0/2262569998 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd5e000a4a0 con 0x56063ae6b3a0 2024-05-08T18:31:23.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.027+0000 7fd5ea034800 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56063af6eb00 0x56063af70ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.027+0000 7fd5ea034800 1 -- 172.21.15.87:0/2262569998 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063af71430 con 0x56063af6eb00 2024-05-08T18:31:23.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.028+0000 7fd5e7b2c640 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56063af6eb00 0x56063af70ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.028+0000 7fd5e7b2c640 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56063af6eb00 0x56063af70ef0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.028+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/2262569998 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd5d8078070 con 0x56063af6eb00 2024-05-08T18:31:23.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.028+0000 7fd5ea034800 1 Processor -- start 2024-05-08T18:31:23.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.028+0000 7fd5ea034800 1 -- start start 2024-05-08T18:31:23.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.029+0000 7fd5ea034800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af64a20 0x56063af62e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.029+0000 7fd5ea034800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56063ad5cfc0 con 0x56063af64a20 2024-05-08T18:31:23.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.029+0000 7fd5e832d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af64a20 0x56063af62e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.029+0000 7fd5e832d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af64a20 0x56063af62e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57198/0 (socket says 172.21.15.87:57198) 2024-05-08T18:31:23.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.029+0000 7fd5e832d640 1 -- 172.21.15.87:0/2181729884 learned_addr learned my addr 172.21.15.87:0/2181729884 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.029+0000 7fd5e832d640 1 -- 172.21.15.87:0/2181729884 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56063af633d0 con 0x56063af64a20 2024-05-08T18:31:23.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.029+0000 7fd5e832d640 1 --2- 172.21.15.87:0/2181729884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af64a20 0x56063af62e90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x56063adddfa0 tx=0x7fd5e00178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.029+0000 7fd4cd7fa640 1 -- 172.21.15.87:0/2181729884 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e0013440 con 0x56063af64a20 2024-05-08T18:31:23.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.029+0000 7fd4cd7fa640 1 -- 172.21.15.87:0/2181729884 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e00135e0 con 0x56063af64a20 2024-05-08T18:31:23.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.029+0000 7fd5ea034800 1 -- 172.21.15.87:0/2181729884 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56063af63660 con 0x56063af64a20 2024-05-08T18:31:23.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.029+0000 7fd4cd7fa640 1 -- 172.21.15.87:0/2181729884 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e00138c0 con 0x56063af64a20 2024-05-08T18:31:23.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.029+0000 7fd5ea034800 1 -- 172.21.15.87:0/2181729884 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56063af63b60 con 0x56063af64a20 2024-05-08T18:31:23.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.030+0000 7fd4cd7fa640 1 -- 172.21.15.87:0/2181729884 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd5e0011040 con 0x56063af64a20 2024-05-08T18:31:23.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.030+0000 7fd4cd7fa640 1 --2- 172.21.15.87:0/2181729884 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4c003bb50 0x7fd4c003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.030+0000 7fd4cd7fa640 1 -- 172.21.15.87:0/2181729884 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd5e001d070 con 0x56063af64a20 2024-05-08T18:31:23.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.030+0000 7fd5e7b2c640 1 --2- 172.21.15.87:0/2181729884 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4c003bb50 0x7fd4c003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.031+0000 7fd5ea034800 1 Processor -- start 2024-05-08T18:31:23.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.031+0000 7fd5e7b2c640 1 --2- 172.21.15.87:0/2181729884 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4c003bb50 0x7fd4c003e010 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8079740 tx=0x7fd5d80923f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.031+0000 7fd5ea034800 1 -- start start 2024-05-08T18:31:23.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.031+0000 7fd5ea034800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af8ec10 0x56063af8f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.031+0000 7fd5ea034800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56063af5bf10 con 0x56063af8ec10 2024-05-08T18:31:23.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.031+0000 7fd5e832d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af8ec10 0x56063af8f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.031+0000 7fd5e832d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af8ec10 0x56063af8f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57200/0 (socket says 172.21.15.87:57200) 2024-05-08T18:31:23.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.031+0000 7fd5e832d640 1 -- 172.21.15.87:0/1330389950 learned_addr learned my addr 172.21.15.87:0/1330389950 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.031+0000 7fd5e832d640 1 -- 172.21.15.87:0/1330389950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56063af8f600 con 0x56063af8ec10 2024-05-08T18:31:23.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.031+0000 7fd5e832d640 1 --2- 172.21.15.87:0/1330389950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af8ec10 0x56063af8f030 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd5e00529a0 tx=0x7fd5e0001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72092054a2305324 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.032+0000 7fd4c6ffd640 1 -- 172.21.15.87:0/1330389950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e002ad80 con 0x56063af8ec10 2024-05-08T18:31:23.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.032+0000 7fd4c6ffd640 1 -- 172.21.15.87:0/1330389950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e00014f0 con 0x56063af8ec10 2024-05-08T18:31:23.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.032+0000 7fd4c6ffd640 1 -- 172.21.15.87:0/1330389950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e0001810 con 0x56063af8ec10 2024-05-08T18:31:23.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.032+0000 7fd5ea034800 1 -- 172.21.15.87:0/1330389950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af8ec10 msgr2=0x56063af8f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.032+0000 7fd5ea034800 1 --2- 172.21.15.87:0/1330389950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af8ec10 0x56063af8f030 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd5e00529a0 tx=0x7fd5e0001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:23.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.032+0000 7fd5ea034800 1 -- 172.21.15.87:0/1330389950 shutdown_connections 2024-05-08T18:31:23.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.032+0000 7fd5ea034800 1 --2- 172.21.15.87:0/1330389950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af8ec10 0x56063af8f030 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.032+0000 7fd5ea034800 1 -- 172.21.15.87:0/1330389950 >> 172.21.15.87:0/1330389950 conn(0x56063af8af20 msgr2=0x56063af88f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.032+0000 7fd5ea034800 1 -- 172.21.15.87:0/1330389950 shutdown_connections 2024-05-08T18:31:23.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.032+0000 7fd5ea034800 1 -- 172.21.15.87:0/1330389950 wait complete. 2024-05-08T18:31:23.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.032+0000 7fd5ea034800 1 Processor -- start 2024-05-08T18:31:23.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.033+0000 7fd5ea034800 1 -- start start 2024-05-08T18:31:23.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.033+0000 7fd5ea034800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af8ec10 0x56063af96150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.033+0000 7fd5ea034800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56063af8fd50 con 0x56063af8ec10 2024-05-08T18:31:23.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.033+0000 7fd5e832d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af8ec10 0x56063af96150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.033+0000 7fd5e832d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af8ec10 0x56063af96150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57210/0 (socket says 172.21.15.87:57210) 2024-05-08T18:31:23.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.033+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 learned_addr learned my addr 172.21.15.87:0/1032304652 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.033+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56063af96690 con 0x56063af8ec10 2024-05-08T18:31:23.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.033+0000 7fd5e832d640 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af8ec10 0x56063af96150 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0001ea0 tx=0x7fd5e0052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.033+0000 7fd4c57fa640 1 -- 172.21.15.87:0/1032304652 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e0030020 con 0x56063af8ec10 2024-05-08T18:31:23.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.033+0000 7fd4c57fa640 1 -- 172.21.15.87:0/1032304652 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e0051330 con 0x56063af8ec10 2024-05-08T18:31:23.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.033+0000 7fd4c57fa640 1 -- 172.21.15.87:0/1032304652 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e0013a60 con 0x56063af8ec10 2024-05-08T18:31:23.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.033+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56063af96920 con 0x56063af8ec10 2024-05-08T18:31:23.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.033+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56063af995d0 con 0x56063af8ec10 2024-05-08T18:31:23.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.034+0000 7fd4c57fa640 1 -- 172.21.15.87:0/1032304652 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd5e0033020 con 0x56063af8ec10 2024-05-08T18:31:23.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.034+0000 7fd4c57fa640 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4b003bb50 0x7fd4b003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.034+0000 7fd4c57fa640 1 -- 172.21.15.87:0/1032304652 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd5e000e040 con 0x56063af8ec10 2024-05-08T18:31:23.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.034+0000 7fd5e7b2c640 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4b003bb50 0x7fd4b003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.035+0000 7fd5ea034800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.035+0000 7fd5ea034800 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56063afa1d80 0x56063afa4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.035+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afa4990 con 0x56063afa1d80 2024-05-08T18:31:23.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.035+0000 7fd5e732b640 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56063afa1d80 0x56063afa4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.035+0000 7fd5e7b2c640 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4b003bb50 0x7fd4b003e010 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8079510 tx=0x7fd5d807d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.035+0000 7fd5e732b640 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56063afa1d80 0x56063afa4240 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.035+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5dc009050 con 0x56063afa1d80 2024-05-08T18:31:23.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.035+0000 7fd5ea034800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.035+0000 7fd5ea034800 20 realm 2024-05-08T18:31:23.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.035+0000 7fd5ea034800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.035+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afa11d0 con 0x56063afa1d80 2024-05-08T18:31:23.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5dc009050 con 0x56063afa1d80 2024-05-08T18:31:23.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5ea034800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5ea034800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:23.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5ea034800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afa5470 con 0x56063afa1d80 2024-05-08T18:31:23.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5dc009050 con 0x56063afa1d80 2024-05-08T18:31:23.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5ea034800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5ea034800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afa5d40 con 0x56063afa1d80 2024-05-08T18:31:23.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd5dc009050 con 0x56063afa1d80 2024-05-08T18:31:23.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5ea034800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:23.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5ea034800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afa60e0 con 0x56063afa1d80 2024-05-08T18:31:23.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd5dc009050 con 0x56063afa1d80 2024-05-08T18:31:23.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5ea034800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:23.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5ea034800 20 searching for the correct realm 2024-05-08T18:31:23.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5ea034800 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56063afa7fc0 0x56063afaa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.036+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x56063afa7fc0 2024-05-08T18:31:23.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.037+0000 7fd5e832d640 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56063afa7fc0 0x56063afaa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.037+0000 7fd5e832d640 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56063afa7fc0 0x56063afaa3b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.037+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.037+0000 7fd5e832d640 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd5e0035020 0x7fd5e002b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.037+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x7fd5e0035020 2024-05-08T18:31:23.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.037+0000 7fd5e7b2c640 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd5e0035020 0x7fd5e002b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.038+0000 7fd5e7b2c640 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd5e0035020 0x7fd5e002b3e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.038+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5d8078070 con 0x7fd5e0035020 2024-05-08T18:31:23.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.038+0000 7fd5e7b2c640 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd5d808cba0 0x7fd5d80797b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.038+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x7fd5d808cba0 2024-05-08T18:31:23.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.038+0000 7fd5e732b640 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd5d808cba0 0x7fd5d80797b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.039+0000 7fd5e732b640 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd5d808cba0 0x7fd5d80797b0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.039+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5dc009050 con 0x7fd5d808cba0 2024-05-08T18:31:23.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.039+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x56063afa1d80 2024-05-08T18:31:23.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.039+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5dc009050 con 0x56063afa1d80 2024-05-08T18:31:23.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.039+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x56063afa1d80 2024-05-08T18:31:23.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.039+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.039+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x7fd5d808cba0 2024-05-08T18:31:23.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.040+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.040+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x7fd5d808cba0 2024-05-08T18:31:23.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.040+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.040+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x7fd5e0035020 2024-05-08T18:31:23.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.040+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5d8078070 con 0x7fd5e0035020 2024-05-08T18:31:23.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.040+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x56063afa7fc0 2024-05-08T18:31:23.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.040+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.040+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x56063afa1d80 2024-05-08T18:31:23.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.041+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.041+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x7fd5d808cba0 2024-05-08T18:31:23.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.041+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.041+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x56063afa1d80 2024-05-08T18:31:23.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.041+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.041+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x7fd5e0035020 2024-05-08T18:31:23.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.042+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd5d8078070 con 0x7fd5e0035020 2024-05-08T18:31:23.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.042+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x56063afa7fc0 2024-05-08T18:31:23.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.042+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.042+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x56063afa7fc0 2024-05-08T18:31:23.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.042+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.042+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x7fd5d808cba0 2024-05-08T18:31:23.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.042+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.042+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x56063afa7fc0 2024-05-08T18:31:23.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.043+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.043+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x56063afa7fc0 2024-05-08T18:31:23.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.043+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.043+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x56063afa1d80 2024-05-08T18:31:23.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.043+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.043+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x56063afa1d80 2024-05-08T18:31:23.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.043+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.043+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x7fd5d808cba0 2024-05-08T18:31:23.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.044+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.044+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x56063afa7fc0 2024-05-08T18:31:23.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.044+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.044+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x7fd5e0035020 2024-05-08T18:31:23.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.044+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5d8078070 con 0x7fd5e0035020 2024-05-08T18:31:23.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.045+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x56063afa1d80 2024-05-08T18:31:23.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.045+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.045+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x7fd5d808cba0 2024-05-08T18:31:23.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.045+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.045+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x56063afa7fc0 2024-05-08T18:31:23.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.045+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.045+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x7fd5d808cba0 2024-05-08T18:31:23.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.046+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.046+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x7fd5e0035020 2024-05-08T18:31:23.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.046+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5d8078070 con 0x7fd5e0035020 2024-05-08T18:31:23.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.046+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x56063afa7fc0 2024-05-08T18:31:23.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.046+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.046+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x7fd5d808cba0 2024-05-08T18:31:23.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.046+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.046+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x56063afa1d80 2024-05-08T18:31:23.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaa60 con 0x7fd5e0035020 2024-05-08T18:31:23.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5d8078070 con 0x7fd5e0035020 2024-05-08T18:31:23.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5ea034800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:23.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5ea034800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:23.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5ea034800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:23.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5ea034800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:23.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5ea034800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:23.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5ea034800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:23.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5ea034800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afa6a60 con 0x56063afa1d80 2024-05-08T18:31:23.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5ea034800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5ea034800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afa7300 con 0x56063afa1d80 2024-05-08T18:31:23.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5ea034800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:23.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5ea034800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.047+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afa66a0 con 0x7fd5d808cba0 2024-05-08T18:31:23.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:23.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 20 zone default found 2024-05-08T18:31:23.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 4 Realm: () 2024-05-08T18:31:23.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:23.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:23.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:23.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 20 zonegroup default 2024-05-08T18:31:23.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afaaec0 con 0x7fd5d808cba0 2024-05-08T18:31:23.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afacd50 con 0x56063afa7fc0 2024-05-08T18:31:23.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afad0f0 con 0x56063afa7fc0 2024-05-08T18:31:23.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 20 started sync module instance, tier type = 2024-05-08T18:31:23.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:23.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.048+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afac190 con 0x7fd5e0035020 2024-05-08T18:31:23.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.049+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5d8078070 con 0x7fd5e0035020 2024-05-08T18:31:23.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.049+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94584759305600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afac9a0 con 0x7fd5e0035020 2024-05-08T18:31:23.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.049+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afade30 con 0x56063afa1d80 2024-05-08T18:31:23.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.050+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94584759305600] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5d8078070 con 0x7fd5e0035020 2024-05-08T18:31:23.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.051+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.051+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94584759309456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afae220 con 0x56063afa1d80 2024-05-08T18:31:23.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.051+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afaec50 con 0x56063afa7fc0 2024-05-08T18:31:23.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.052+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94584759309456] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.052+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.052+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94584759310512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afaf070 con 0x56063afa7fc0 2024-05-08T18:31:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.052+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afafa90 con 0x7fd5e0035020 2024-05-08T18:31:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.053+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5d8078070 con 0x7fd5e0035020 2024-05-08T18:31:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.053+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94584759317888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afb0360 con 0x7fd5e0035020 2024-05-08T18:31:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.053+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afb0e40 con 0x56063afa1d80 2024-05-08T18:31:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.053+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94584759310512] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.054+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.054+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94584759322960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afb1230 con 0x56063afa1d80 2024-05-08T18:31:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.054+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afb1c30 con 0x7fd5d808cba0 2024-05-08T18:31:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.054+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94584759317888] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5d8078070 con 0x7fd5e0035020 2024-05-08T18:31:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.055+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94584759322960] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.055+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.055+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94584759314272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afb1740 con 0x7fd5d808cba0 2024-05-08T18:31:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.055+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afb24d0 con 0x7fd5d808cba0 2024-05-08T18:31:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.056+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94584759314272] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.056+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.056+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94584759320240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afb1740 con 0x7fd5d808cba0 2024-05-08T18:31:23.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.056+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afb2af0 con 0x7fd5d808cba0 2024-05-08T18:31:23.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.057+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94584759320240] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.057+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.057+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94584759328640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afb2af0 con 0x7fd5d808cba0 2024-05-08T18:31:23.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.057+0000 7fd5ea034800 20 add_watcher() i=0 2024-05-08T18:31:23.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.057+0000 7fd5ea034800 20 add_watcher() i=1 2024-05-08T18:31:23.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.057+0000 7fd5ea034800 20 add_watcher() i=2 2024-05-08T18:31:23.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.057+0000 7fd5ea034800 20 add_watcher() i=3 2024-05-08T18:31:23.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.057+0000 7fd5ea034800 20 add_watcher() i=4 2024-05-08T18:31:23.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.057+0000 7fd5ea034800 20 add_watcher() i=5 2024-05-08T18:31:23.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.057+0000 7fd5ea034800 20 add_watcher() i=6 2024-05-08T18:31:23.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.058+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94584759328640] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.058+0000 7fd5ea034800 20 add_watcher() i=7 2024-05-08T18:31:23.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.058+0000 7fd5ea034800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:23.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.058+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afb5df0 con 0x56063afa1d80 2024-05-08T18:31:23.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.058+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.058+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94584759330736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afb3080 con 0x56063afa1d80 2024-05-08T18:31:23.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.059+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94584759330736] v27'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.059+0000 7fd49dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:23.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.059+0000 7fd5ea034800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:23.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.059+0000 7fd5ea034800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:23.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.059+0000 7fd5ea034800 5 note: GC not initialized 2024-05-08T18:31:23.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.060+0000 7fd49cfe1640 20 reqs_thread_entry: start 2024-05-08T18:31:23.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.060+0000 7fd5ea034800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:23.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.060+0000 7fd5ea034800 20 Filter name: none 2024-05-08T18:31:23.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.060+0000 7fd4167fc640 20 reqs_thread_entry: start 2024-05-08T18:31:23.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.060+0000 7fd5ea034800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.060+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afe9430 con 0x7fd5e0035020 2024-05-08T18:31:23.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.060+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd5d8078070 con 0x7fd5e0035020 2024-05-08T18:31:23.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.060+0000 7fd5ea034800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:23.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.060+0000 7fd5ea034800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.060+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:63 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afe9cc0 con 0x56063afa7fc0 2024-05-08T18:31:23.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(63 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5ea034800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:23.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5ea034800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:31:23.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5ea034800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afe9e70 con 0x7fd5e0035020 2024-05-08T18:31:23.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd5d8078070 con 0x7fd5e0035020 2024-05-08T18:31:23.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5ea034800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:23.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5ea034800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:65 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afe87d0 con 0x56063afa7fc0 2024-05-08T18:31:23.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(65 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5ea034800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:23.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5ea034800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:31:23.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 4.3c 4:3e5af247:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afec800 con 0x56063afa1d80 2024-05-08T18:31:23.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 4.13 4:c87a77a1:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afef360 con 0x7fd5e0035020 2024-05-08T18:31:23.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:68 4.2d 4:b6c641c8:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063aff1f80 con 0x7fd5d808cba0 2024-05-08T18:31:23.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 4.8 4:106dbb9b:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063aff4940 con 0x56063afa7fc0 2024-05-08T18:31:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 4.28 4:146af900:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063aff1f80 con 0x56063afa1d80 2024-05-08T18:31:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 4.6 4:613ec2f8:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063aff9680 con 0x56063afa7fc0 2024-05-08T18:31:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.061+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 4.32 4:4ef39ee1:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063affbd40 con 0x56063afa1d80 2024-05-08T18:31:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.062+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 4.1c 4:38258a38:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063affe810 con 0x7fd5d808cba0 2024-05-08T18:31:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.062+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(68 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.062+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(69 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.062+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(67 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd5d8078070 con 0x7fd5e0035020 2024-05-08T18:31:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.062+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:74 4.38 4:1e0d588e:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afeed10 con 0x56063afa1d80 2024-05-08T18:31:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.062+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(66 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.062+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 4.f 4:f0da020c:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063aff2a70 con 0x56063afa1d80 2024-05-08T18:31:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.062+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(70 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.062+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:76 4.1d 4:baf32667:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56063afeb340 con 0x56063afa7fc0 2024-05-08T18:31:23.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.062+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(73 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.062+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(71 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.062+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(72 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.6 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.062+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(74 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.062+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(75 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.062+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(76 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.063+0000 7fd49dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:23.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.063+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94584759330736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afe8070 con 0x56063afa1d80 2024-05-08T18:31:23.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.064+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94584759330736] v27'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.064+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94584759305600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afe8070 con 0x7fd5e0035020 2024-05-08T18:31:23.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.065+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94584759305600] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5d8078070 con 0x7fd5e0035020 2024-05-08T18:31:23.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.065+0000 7fd5ea034800 20 remove_watcher() i=0 2024-05-08T18:31:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.065+0000 7fd5ea034800 2 removed watcher, disabling cache 2024-05-08T18:31:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.065+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94584759309456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afac580 con 0x56063afa1d80 2024-05-08T18:31:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.066+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94584759309456] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.066+0000 7fd5ea034800 20 remove_watcher() i=1 2024-05-08T18:31:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.066+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94584759310512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afe8070 con 0x56063afa7fc0 2024-05-08T18:31:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.067+0000 7fd5e832d640 1 -- 172.21.15.87:0/1032304652 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94584759310512] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e0029070 con 0x56063afa7fc0 2024-05-08T18:31:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.067+0000 7fd5ea034800 20 remove_watcher() i=2 2024-05-08T18:31:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.067+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94584759317888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afac580 con 0x7fd5e0035020 2024-05-08T18:31:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.068+0000 7fd5e7b2c640 1 -- 172.21.15.87:0/1032304652 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94584759317888] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5d8078070 con 0x7fd5e0035020 2024-05-08T18:31:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.068+0000 7fd5ea034800 20 remove_watcher() i=3 2024-05-08T18:31:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.068+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94584759322960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afe8070 con 0x56063afa1d80 2024-05-08T18:31:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.069+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94584759322960] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x56063afa1d80 2024-05-08T18:31:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.069+0000 7fd5ea034800 20 remove_watcher() i=4 2024-05-08T18:31:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.069+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94584759314272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afac580 con 0x7fd5d808cba0 2024-05-08T18:31:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.070+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94584759314272] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.070+0000 7fd5ea034800 20 remove_watcher() i=5 2024-05-08T18:31:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.070+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94584759320240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afe8070 con 0x7fd5d808cba0 2024-05-08T18:31:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.071+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94584759320240] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.071+0000 7fd5ea034800 20 remove_watcher() i=6 2024-05-08T18:31:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.071+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94584759328640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56063afae760 con 0x7fd5d808cba0 2024-05-08T18:31:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.072+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94584759328640] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5dc02a040 con 0x7fd5d808cba0 2024-05-08T18:31:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.072+0000 7fd5ea034800 20 remove_watcher() i=7 2024-05-08T18:31:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.072+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd5d808cba0 msgr2=0x7fd5d80797b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.072+0000 7fd5ea034800 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd5d808cba0 0x7fd5d80797b0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.072+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56063afa1d80 msgr2=0x56063afa4240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.072+0000 7fd5ea034800 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56063afa1d80 0x56063afa4240 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.072+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd5e0035020 msgr2=0x7fd5e002b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.072+0000 7fd5ea034800 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd5e0035020 0x7fd5e002b3e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.072+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56063afa7fc0 msgr2=0x56063afaa3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.072+0000 7fd5ea034800 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56063afa7fc0 0x56063afaa3b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4b003bb50 msgr2=0x7fd4b003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4b003bb50 0x7fd4b003e010 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8079510 tx=0x7fd5d807d000 comp rx=0 tx=0).stop 2024-05-08T18:31:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af8ec10 msgr2=0x56063af96150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5e732b640 1 -- 172.21.15.87:0/1032304652 reap_dead start 2024-05-08T18:31:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af8ec10 0x56063af96150 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0001ea0 tx=0x7fd5e0052900 comp rx=0 tx=0).stop 2024-05-08T18:31:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 shutdown_connections 2024-05-08T18:31:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 --2- 172.21.15.87:0/1032304652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af8ec10 0x56063af96150 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 >> 172.21.15.87:0/1032304652 conn(0x56063af8af20 msgr2=0x56063af88580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 shutdown_connections 2024-05-08T18:31:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 -- 172.21.15.87:0/1032304652 wait complete. 2024-05-08T18:31:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 -- 172.21.15.87:0/2181729884 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4c003bb50 msgr2=0x7fd4c003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 --2- 172.21.15.87:0/2181729884 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4c003bb50 0x7fd4c003e010 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8079740 tx=0x7fd5d80923f0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 -- 172.21.15.87:0/2181729884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af64a20 msgr2=0x56063af62e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 --2- 172.21.15.87:0/2181729884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af64a20 0x56063af62e90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x56063adddfa0 tx=0x7fd5e00178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 -- 172.21.15.87:0/2181729884 shutdown_connections 2024-05-08T18:31:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 --2- 172.21.15.87:0/2181729884 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4c003bb50 0x7fd4c003e010 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 --2- 172.21.15.87:0/2181729884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063af64a20 0x56063af62e90 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 -- 172.21.15.87:0/2181729884 >> 172.21.15.87:0/2181729884 conn(0x56063af73710 msgr2=0x56063af73b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 -- 172.21.15.87:0/2181729884 shutdown_connections 2024-05-08T18:31:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 -- 172.21.15.87:0/2181729884 wait complete. 2024-05-08T18:31:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 -- 172.21.15.87:0/2262569998 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56063af6eb00 msgr2=0x56063af70ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56063af6eb00 0x56063af70ef0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 -- 172.21.15.87:0/2262569998 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56063ae6b3a0 msgr2=0x56063af6b390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56063ae6b3a0 0x56063af6b390 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 -- 172.21.15.87:0/2262569998 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4d003bb50 msgr2=0x7fd4d003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.073+0000 7fd5ea034800 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4d003bb50 0x7fd4d003e010 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc000f60 tx=0x7fd5dc0012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.074+0000 7fd5ea034800 1 -- 172.21.15.87:0/2262569998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 msgr2=0x56063adde260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.074+0000 7fd5ea034800 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 0x56063adde260 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800a470 tx=0x7fd5d8002fb0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.074+0000 7fd5ea034800 1 -- 172.21.15.87:0/2262569998 shutdown_connections 2024-05-08T18:31:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.074+0000 7fd5ea034800 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56063ae6b3a0 0x56063af6b390 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.074+0000 7fd5ea034800 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56063af6eb00 0x56063af70ef0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.074+0000 7fd5ea034800 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd4d003bb50 0x7fd4d003e010 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.074+0000 7fd5ea034800 1 --2- 172.21.15.87:0/2262569998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063ae6a140 0x56063adde260 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.074+0000 7fd5ea034800 1 -- 172.21.15.87:0/2262569998 >> 172.21.15.87:0/2262569998 conn(0x56063ae65720 msgr2=0x56063af557a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.074+0000 7fd5ea034800 1 -- 172.21.15.87:0/2262569998 shutdown_connections 2024-05-08T18:31:23.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.074+0000 7fd5ea034800 1 -- 172.21.15.87:0/2262569998 wait complete. 2024-05-08T18:31:23.091 INFO:teuthology.orchestra.run.smithi087.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"603f2301-f6d0-4df6-aa57-6b1659110044","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1","marker":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-08T18:31:22.584613Z","creation_time":"2024-05-08T18:31:19.867262Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-08T18:31:23.092 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '603f2301-f6d0-4df6-aa57-6b1659110044', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1', 'marker': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:31:22.584613Z', 'creation_time': '2024-05-08T18:31:19.867262Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:31:23.092 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-05-08T18:31:23.092 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-05-08T18:31:23.092 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-05-08T18:31:23.134 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:23.134 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.136+0000 7fd557087800 1 Processor -- start 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.137+0000 7fd557087800 1 -- start start 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.137+0000 7fd557087800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e2a9a8b880 0x55e2a9a8dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.137+0000 7fd557087800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e2a9a8e240 con 0x55e2a9a87440 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.137+0000 7fd557087800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e2a9925e20 con 0x55e2a9a8b880 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.137+0000 7fd54c37e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e2a9a8b880 0x55e2a9a8dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.137+0000 7fd554b7f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55e2a9a87440 0x55e2a9a87860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:52636/0 (socket says 172.21.15.87:52636) 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.137+0000 7fd54c37e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e2a9a8b880 0x55e2a9a8dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57216/0 (socket says 172.21.15.87:57216) 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.137+0000 7fd54c37e640 1 -- 172.21.15.87:0/4023568526 learned_addr learned my addr 172.21.15.87:0/4023568526 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.137+0000 7fd54c37e640 1 -- 172.21.15.87:0/4023568526 >> v1:172.21.15.53:6789/0 conn(0x55e2a9a87440 legacy=0x55e2a9a87860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.137+0000 7fd54c37e640 1 -- 172.21.15.87:0/4023568526 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a9a8f470 con 0x55e2a9a8b880 2024-05-08T18:31:23.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.139+0000 7fd54c37e640 1 --2- 172.21.15.87:0/4023568526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a8b880 0x55e2a9a8dc70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00a520 tx=0x7fd53c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9179efa57319315 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.139+0000 7fd54ffff640 1 -- 172.21.15.87:0/4023568526 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd53c057070 con 0x55e2a9a8b880 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.139+0000 7fd54ffff640 1 -- 172.21.15.87:0/4023568526 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd53c052570 con 0x55e2a9a8b880 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.139+0000 7fd54ffff640 1 -- 172.21.15.87:0/4023568526 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd53c04ae60 con 0x55e2a9a8b880 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.140+0000 7fd557087800 1 -- 172.21.15.87:0/4023568526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a8b880 msgr2=0x55e2a9a8dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.140+0000 7fd557087800 1 --2- 172.21.15.87:0/4023568526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a8b880 0x55e2a9a8dc70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00a520 tx=0x7fd53c01d010 comp rx=0 tx=0).stop 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.140+0000 7fd557087800 1 -- 172.21.15.87:0/4023568526 shutdown_connections 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.140+0000 7fd557087800 1 --2- 172.21.15.87:0/4023568526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a8b880 0x55e2a9a8dc70 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.140+0000 7fd557087800 1 -- 172.21.15.87:0/4023568526 >> 172.21.15.87:0/4023568526 conn(0x55e2a9a82c60 msgr2=0x55e2a9a85050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.140+0000 7fd557087800 1 -- 172.21.15.87:0/4023568526 shutdown_connections 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.140+0000 7fd557087800 1 -- 172.21.15.87:0/4023568526 wait complete. 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.154+0000 7fd557087800 1 Processor -- start 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.154+0000 7fd557087800 1 -- start start 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.154+0000 7fd557087800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a87440 0x55e2a9b78800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.154+0000 7fd557087800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e2a99d05a0 con 0x55e2a9a87440 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.154+0000 7fd554b7f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a87440 0x55e2a9b78800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.154+0000 7fd554b7f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a87440 0x55e2a9b78800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57218/0 (socket says 172.21.15.87:57218) 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.154+0000 7fd554b7f640 1 -- 172.21.15.87:0/799593572 learned_addr learned my addr 172.21.15.87:0/799593572 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.154+0000 7fd554b7f640 1 -- 172.21.15.87:0/799593572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a9b78dd0 con 0x55e2a9a87440 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.155+0000 7fd554b7f640 1 --2- 172.21.15.87:0/799593572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a87440 0x55e2a9b78800 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd54400b230 tx=0x7fd54400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1e665585290b56 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.155+0000 7fd442e0d640 1 -- 172.21.15.87:0/799593572 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd54400e5c0 con 0x55e2a9a87440 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.155+0000 7fd442e0d640 1 -- 172.21.15.87:0/799593572 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd544006070 con 0x55e2a9a87440 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.155+0000 7fd442e0d640 1 -- 172.21.15.87:0/799593572 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd54400e890 con 0x55e2a9a87440 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.155+0000 7fd557087800 1 -- 172.21.15.87:0/799593572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a87440 msgr2=0x55e2a9b78800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.155+0000 7fd557087800 1 --2- 172.21.15.87:0/799593572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a87440 0x55e2a9b78800 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd54400b230 tx=0x7fd54400b6f0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.156+0000 7fd557087800 1 -- 172.21.15.87:0/799593572 shutdown_connections 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.156+0000 7fd557087800 1 --2- 172.21.15.87:0/799593572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a87440 0x55e2a9b78800 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.156+0000 7fd557087800 1 -- 172.21.15.87:0/799593572 >> 172.21.15.87:0/799593572 conn(0x55e2a9a82c60 msgr2=0x55e2a9b74120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.156+0000 7fd557087800 1 -- 172.21.15.87:0/799593572 shutdown_connections 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.156+0000 7fd557087800 1 -- 172.21.15.87:0/799593572 wait complete. 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.156+0000 7fd557087800 1 Processor -- start 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.156+0000 7fd557087800 1 -- start start 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.156+0000 7fd557087800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a87440 0x55e2a9b803a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.156+0000 7fd557087800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e2a9a8e710 con 0x55e2a9a87440 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.156+0000 7fd554b7f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a87440 0x55e2a9b803a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.156+0000 7fd554b7f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a87440 0x55e2a9b803a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57226/0 (socket says 172.21.15.87:57226) 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.156+0000 7fd554b7f640 1 -- 172.21.15.87:0/182379041 learned_addr learned my addr 172.21.15.87:0/182379041 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.156+0000 7fd554b7f640 1 -- 172.21.15.87:0/182379041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a9b808e0 con 0x55e2a9a87440 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.157+0000 7fd554b7f640 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a87440 0x55e2a9b803a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd544000fd0 tx=0x7fd544000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.157+0000 7fd44160a640 1 -- 172.21.15.87:0/182379041 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd54400f8d0 con 0x55e2a9a87440 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.157+0000 7fd44160a640 1 -- 172.21.15.87:0/182379041 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd54400fa90 con 0x55e2a9a87440 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.157+0000 7fd557087800 1 -- 172.21.15.87:0/182379041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2a9b80b70 con 0x55e2a9a87440 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.157+0000 7fd44160a640 1 -- 172.21.15.87:0/182379041 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd54400fdb0 con 0x55e2a9a87440 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.157+0000 7fd557087800 1 -- 172.21.15.87:0/182379041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2a9b83820 con 0x55e2a9a87440 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.158+0000 7fd44160a640 1 -- 172.21.15.87:0/182379041 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd544017070 con 0x55e2a9a87440 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.158+0000 7fd44160a640 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd43c03bb50 0x7fd43c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.158+0000 7fd44160a640 1 -- 172.21.15.87:0/182379041 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd544015020 con 0x55e2a9a87440 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.158+0000 7fd54c37e640 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd43c03bb50 0x7fd43c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.158+0000 7fd557087800 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e2a9a8b880 0x55e2a9b875e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.158+0000 7fd557087800 1 -- 172.21.15.87:0/182379041 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9b87b70 con 0x55e2a9a8b880 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.158+0000 7fd555380640 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e2a9a8b880 0x55e2a9b875e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.158+0000 7fd54c37e640 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd43c03bb50 0x7fd43c03e010 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd53c054000 tx=0x7fd53c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.158+0000 7fd555380640 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e2a9a8b880 0x55e2a9b875e0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.159+0000 7fd555380640 1 -- 172.21.15.87:0/182379041 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd55000a4a0 con 0x55e2a9a8b880 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.159+0000 7fd557087800 1 -- 172.21.15.87:0/182379041 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9b84bb0 con 0x55e2a9a8b880 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.159+0000 7fd555380640 1 -- 172.21.15.87:0/182379041 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd55000a4a0 con 0x55e2a9a8b880 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.159+0000 7fd557087800 1 -- 172.21.15.87:0/182379041 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9b89990 con 0x55e2a9a8b880 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.159+0000 7fd555380640 1 -- 172.21.15.87:0/182379041 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd55000a4a0 con 0x55e2a9a8b880 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.159+0000 7fd557087800 1 -- 172.21.15.87:0/182379041 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9b88ad0 con 0x55e2a9a8b880 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.159+0000 7fd555380640 1 -- 172.21.15.87:0/182379041 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd55000a4a0 con 0x55e2a9a8b880 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.160+0000 7fd557087800 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55e2a9b895a0 0x55e2a9b8cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.160+0000 7fd557087800 1 -- 172.21.15.87:0/182379041 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9b8d570 con 0x55e2a9b895a0 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.160+0000 7fd554b7f640 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55e2a9b895a0 0x55e2a9b8cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.160+0000 7fd554b7f640 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55e2a9b895a0 0x55e2a9b8cde0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.160+0000 7fd554b7f640 1 -- 172.21.15.87:0/182379041 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd54402e070 con 0x55e2a9b895a0 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.161+0000 7fd557087800 1 Processor -- start 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.161+0000 7fd557087800 1 -- start start 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.161+0000 7fd557087800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9b9b8c0 0x55e2a9b9bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.161+0000 7fd557087800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e2a9976fc0 con 0x55e2a9b9b8c0 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.161+0000 7fd555380640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9b9b8c0 0x55e2a9b9bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.161+0000 7fd555380640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9b9b8c0 0x55e2a9b9bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57228/0 (socket says 172.21.15.87:57228) 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.161+0000 7fd555380640 1 -- 172.21.15.87:0/1031593075 learned_addr learned my addr 172.21.15.87:0/1031593075 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.161+0000 7fd555380640 1 -- 172.21.15.87:0/1031593075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a9b9c220 con 0x55e2a9b9b8c0 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.162+0000 7fd555380640 1 --2- 172.21.15.87:0/1031593075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9b9b8c0 0x55e2a9b9bce0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x55e2a9b87f50 tx=0x7fd5500178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.162+0000 7fd43a7fc640 1 -- 172.21.15.87:0/1031593075 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd550013440 con 0x55e2a9b9b8c0 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.162+0000 7fd43a7fc640 1 -- 172.21.15.87:0/1031593075 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5500135e0 con 0x55e2a9b9b8c0 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.162+0000 7fd43a7fc640 1 -- 172.21.15.87:0/1031593075 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5500138c0 con 0x55e2a9b9b8c0 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.162+0000 7fd557087800 1 -- 172.21.15.87:0/1031593075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2a9b9cc90 con 0x55e2a9b9b8c0 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.162+0000 7fd557087800 1 -- 172.21.15.87:0/1031593075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2a9b9d190 con 0x55e2a9b9b8c0 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.163+0000 7fd43a7fc640 1 -- 172.21.15.87:0/1031593075 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd550011040 con 0x55e2a9b9b8c0 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.163+0000 7fd43a7fc640 1 --2- 172.21.15.87:0/1031593075 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd42c03bba0 0x7fd42c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.163+0000 7fd43a7fc640 1 -- 172.21.15.87:0/1031593075 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd55001d070 con 0x55e2a9b9b8c0 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.163+0000 7fd554b7f640 1 --2- 172.21.15.87:0/1031593075 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd42c03bba0 0x7fd42c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.164+0000 7fd557087800 1 Processor -- start 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.164+0000 7fd554b7f640 1 --2- 172.21.15.87:0/1031593075 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd42c03bba0 0x7fd42c03e060 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd54401dfd0 tx=0x7fd54400ff50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.164+0000 7fd557087800 1 -- start start 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.164+0000 7fd557087800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9ba8bf0 0x55e2a9ba9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.164+0000 7fd557087800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e2a9b79150 con 0x55e2a9ba8bf0 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.164+0000 7fd555380640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9ba8bf0 0x55e2a9ba9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.164+0000 7fd555380640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9ba8bf0 0x55e2a9ba9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57238/0 (socket says 172.21.15.87:57238) 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.164+0000 7fd555380640 1 -- 172.21.15.87:0/496209526 learned_addr learned my addr 172.21.15.87:0/496209526 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.164+0000 7fd555380640 1 -- 172.21.15.87:0/496209526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a9ba95e0 con 0x55e2a9ba8bf0 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.164+0000 7fd555380640 1 --2- 172.21.15.87:0/496209526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9ba8bf0 0x55e2a9ba9010 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd550052970 tx=0x7fd550001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0d1981eddabd55 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.165+0000 7fd42bfff640 1 -- 172.21.15.87:0/496209526 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5500157b0 con 0x55e2a9ba8bf0 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.165+0000 7fd42bfff640 1 -- 172.21.15.87:0/496209526 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd55002ac50 con 0x55e2a9ba8bf0 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.165+0000 7fd42bfff640 1 -- 172.21.15.87:0/496209526 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd550015950 con 0x55e2a9ba8bf0 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.165+0000 7fd557087800 1 -- 172.21.15.87:0/496209526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9ba8bf0 msgr2=0x55e2a9ba9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.165+0000 7fd557087800 1 --2- 172.21.15.87:0/496209526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9ba8bf0 0x55e2a9ba9010 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd550052970 tx=0x7fd550001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.165+0000 7fd557087800 1 -- 172.21.15.87:0/496209526 shutdown_connections 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.165+0000 7fd557087800 1 --2- 172.21.15.87:0/496209526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9ba8bf0 0x55e2a9ba9010 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.165+0000 7fd557087800 1 -- 172.21.15.87:0/496209526 >> 172.21.15.87:0/496209526 conn(0x55e2a9ba4ec0 msgr2=0x55e2a9ba2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.165+0000 7fd557087800 1 -- 172.21.15.87:0/496209526 shutdown_connections 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.165+0000 7fd557087800 1 -- 172.21.15.87:0/496209526 wait complete. 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.165+0000 7fd557087800 1 Processor -- start 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.165+0000 7fd557087800 1 -- start start 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.166+0000 7fd557087800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9ba8bf0 0x55e2a9bb00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.166+0000 7fd557087800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e2a9ba9d30 con 0x55e2a9ba8bf0 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.166+0000 7fd555380640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9ba8bf0 0x55e2a9bb00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.166+0000 7fd555380640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9ba8bf0 0x55e2a9bb00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57240/0 (socket says 172.21.15.87:57240) 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.166+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 learned_addr learned my addr 172.21.15.87:0/2702101527 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.166+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a9bb05e0 con 0x55e2a9ba8bf0 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.166+0000 7fd555380640 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9ba8bf0 0x55e2a9bb00a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd550052970 tx=0x7fd550052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.166+0000 7fd42a7fc640 1 -- 172.21.15.87:0/2702101527 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd550030020 con 0x55e2a9ba8bf0 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.166+0000 7fd42a7fc640 1 -- 172.21.15.87:0/2702101527 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd550013a60 con 0x55e2a9ba8bf0 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.166+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2a9bb0870 con 0x55e2a9ba8bf0 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.166+0000 7fd42a7fc640 1 -- 172.21.15.87:0/2702101527 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd550013d80 con 0x55e2a9ba8bf0 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.167+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2a9bb3520 con 0x55e2a9ba8bf0 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.167+0000 7fd42a7fc640 1 -- 172.21.15.87:0/2702101527 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd550033020 con 0x55e2a9ba8bf0 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.167+0000 7fd42a7fc640 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd42003bba0 0x7fd42003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.168+0000 7fd42a7fc640 1 -- 172.21.15.87:0/2702101527 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd55000e040 con 0x55e2a9ba8bf0 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.168+0000 7fd554b7f640 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd42003bba0 0x7fd42003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.168+0000 7fd557087800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.168+0000 7fd557087800 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e2a9bbbd70 0x55e2a9bbe230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.168+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bbe980 con 0x55e2a9bbbd70 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.168+0000 7fd54c37e640 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e2a9bbbd70 0x55e2a9bbe230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.168+0000 7fd554b7f640 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd42003bba0 0x7fd42003e060 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd544017cd0 tx=0x7fd544033000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.168+0000 7fd54c37e640 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e2a9bbbd70 0x55e2a9bbe230 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.168+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.168+0000 7fd557087800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.168+0000 7fd557087800 20 realm 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.168+0000 7fd557087800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.168+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bbed50 con 0x55e2a9bbbd70 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd557087800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd557087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd557087800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bbf5f0 con 0x55e2a9bbbd70 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd557087800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd557087800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bbf990 con 0x55e2a9bbbd70 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd557087800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd557087800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bbf240 con 0x55e2a9bbbd70 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd557087800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd557087800 20 searching for the correct realm 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd557087800 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55e2a9bc1e40 0x55e2a9bc4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.169+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x55e2a9bc1e40 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.170+0000 7fd555380640 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55e2a9bc1e40 0x55e2a9bc4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.170+0000 7fd555380640 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55e2a9bc1e40 0x55e2a9bc4270 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.170+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.170+0000 7fd555380640 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd550035020 0x7fd550037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.170+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x7fd550035020 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.170+0000 7fd554b7f640 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd550035020 0x7fd550037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.171+0000 7fd554b7f640 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd550035020 0x7fd550037070 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.171+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd54402e070 con 0x7fd550035020 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.171+0000 7fd554b7f640 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd54400f070 0x7fd54404a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.171+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x7fd54400f070 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.171+0000 7fd54c37e640 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd54400f070 0x7fd54404a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.171+0000 7fd54c37e640 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd54400f070 0x7fd54404a6d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.172+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.172+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x55e2a9bbbd70 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.172+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.172+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x55e2a9bbbd70 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.172+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.172+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x7fd54400f070 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.172+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.172+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x7fd54400f070 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.173+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.173+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x7fd550035020 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.173+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd54402e070 con 0x7fd550035020 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.173+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x55e2a9bc1e40 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.173+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.173+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x55e2a9bbbd70 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.173+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.173+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x7fd54400f070 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.174+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.174+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x55e2a9bbbd70 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.174+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.174+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x7fd550035020 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.174+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd54402e070 con 0x7fd550035020 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.174+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x55e2a9bc1e40 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.174+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.174+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x55e2a9bc1e40 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.174+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.174+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x7fd54400f070 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.175+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.175+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x55e2a9bc1e40 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.175+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.175+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x55e2a9bc1e40 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.175+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.175+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x55e2a9bbbd70 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.175+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.175+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x55e2a9bbbd70 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.176+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.176+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x7fd54400f070 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.176+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.176+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x55e2a9bc1e40 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.177+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.177+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x7fd550035020 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.177+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd54402e070 con 0x7fd550035020 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.177+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x55e2a9bbbd70 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.177+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.177+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x7fd54400f070 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.177+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.177+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x55e2a9bc1e40 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.178+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.178+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x7fd54400f070 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.178+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.178+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x7fd550035020 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.178+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd54402e070 con 0x7fd550035020 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.178+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x55e2a9bc1e40 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.178+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.178+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x7fd54400f070 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.179+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.179+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x55e2a9bbbd70 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.179+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.179+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc4940 con 0x7fd550035020 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.179+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd54402e070 con 0x7fd550035020 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.179+0000 7fd557087800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.179+0000 7fd557087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.179+0000 7fd557087800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.179+0000 7fd557087800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.179+0000 7fd557087800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.179+0000 7fd557087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.179+0000 7fd557087800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.179+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc08e0 con 0x55e2a9bbbd70 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd557087800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd557087800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc1180 con 0x55e2a9bbbd70 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd557087800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd557087800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc0520 con 0x7fd54400f070 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd557087800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd557087800 20 zone default found 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd557087800 4 Realm: () 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd557087800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd557087800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd557087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd557087800 20 zonegroup default 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd557087800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.180+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc5270 con 0x7fd54400f070 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.181+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.181+0000 7fd557087800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.181+0000 7fd557087800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.181+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc6d70 con 0x55e2a9bc1e40 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.181+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.181+0000 7fd557087800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.181+0000 7fd557087800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.181+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc7230 con 0x55e2a9bc1e40 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.181+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.181+0000 7fd557087800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.181+0000 7fd557087800 20 started sync module instance, tier type = 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.181+0000 7fd557087800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.181+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc5c70 con 0x7fd550035020 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.182+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd54402e070 con 0x7fd550035020 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.182+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94431998664848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc7b40 con 0x7fd550035020 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.182+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc8390 con 0x55e2a9bbbd70 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.183+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.183+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94431998664848] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd54402e070 con 0x7fd550035020 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.183+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94431998672608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc8970 con 0x55e2a9bbbd70 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.183+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bc1e40 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.184+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.184+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94431998676832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc9830 con 0x55e2a9bc1e40 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.184+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bca320 con 0x7fd550035020 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.185+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94431998672608] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.185+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd54402e070 con 0x7fd550035020 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.185+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94431998676832] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.185+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94431998673856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc9830 con 0x7fd550035020 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.185+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bcac00 con 0x55e2a9bbbd70 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.186+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.186+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94431998682896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bcb4a0 con 0x55e2a9bbbd70 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.186+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bcbf60 con 0x7fd54400f070 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.187+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94431998673856] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd54402e070 con 0x7fd550035020 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.188+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94431998682896] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.188+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.188+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94431998687792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bcaf00 con 0x7fd54400f070 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.188+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bcc800 con 0x7fd54400f070 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.189+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94431998687792] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.191+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.191+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94431998677888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bcaf00 con 0x7fd54400f070 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.191+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bcce20 con 0x7fd54400f070 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.192+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94431998677888] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.192+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.192+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94431998690048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bcce20 con 0x7fd54400f070 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.192+0000 7fd557087800 20 add_watcher() i=0 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.192+0000 7fd557087800 20 add_watcher() i=1 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.192+0000 7fd557087800 20 add_watcher() i=2 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.192+0000 7fd557087800 20 add_watcher() i=3 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.192+0000 7fd557087800 20 add_watcher() i=4 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.192+0000 7fd557087800 20 add_watcher() i=5 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.192+0000 7fd557087800 20 add_watcher() i=6 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.193+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94431998690048] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.193+0000 7fd557087800 20 add_watcher() i=7 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.193+0000 7fd557087800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.193+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bd0130 con 0x55e2a9bbbd70 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.193+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.193+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94431998692064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bcd3b0 con 0x55e2a9bbbd70 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.194+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94431998692064] v27'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.194+0000 7fd40afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.194+0000 7fd557087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.194+0000 7fd557087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.194+0000 7fd557087800 5 note: GC not initialized 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.195+0000 7fd409fe3640 20 reqs_thread_entry: start 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.195+0000 7fd557087800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.195+0000 7fd557087800 20 Filter name: none 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.195+0000 7fd37b7fe640 20 reqs_thread_entry: start 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.195+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9c02bf0 con 0x7fd54400f070 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.196+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(62 [pgnls start_epoch 27 out=254b] v27'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.196+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc0520 con 0x7fd54400f070 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.196+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(63 [pgnls start_epoch 27 out=131b] v27'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.196+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc0520 con 0x55e2a9bc1e40 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.196+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 [pgnls start_epoch 27 out=295b] v27'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.196+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x7fd54400f070 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.196+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(65 [pgnls start_epoch 27 out=172b] v27'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.197+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bbbd70 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.197+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(66 [pgnls start_epoch 27 out=335b] v27'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.197+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x7fd550035020 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.197+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(67 [pgnls start_epoch 27 out=213b] v27'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd54402e070 con 0x7fd550035020 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.197+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bc1e40 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.197+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(68 [pgnls start_epoch 27 out=254b] v27'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.197+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bc1e40 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.198+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(69 [pgnls start_epoch 27 out=295b] v27'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.198+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bc1e40 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.198+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(70 [pgnls start_epoch 27 out=213b] v27'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.198+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x7fd550035020 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.198+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(71 [pgnls start_epoch 27 out=172b] v27'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd54402e070 con 0x7fd550035020 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.198+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x7fd550035020 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.198+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(72 [pgnls start_epoch 27 out=336b] v27'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7fd54402e070 con 0x7fd550035020 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.198+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bc1e40 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.199+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(73 [pgnls start_epoch 27 out=131b] v27'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.199+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bc1e40 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.199+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(74 [pgnls start_epoch 27 out=254b] v27'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.199+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bc1e40 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.199+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(75 [pgnls start_epoch 27 out=90b] v27'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.199+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bbbd70 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.200+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(76 [pgnls start_epoch 27 out=213b] v27'20 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.200+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bc1e40 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.200+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(77 [pgnls start_epoch 27 out=254b] v27'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.200+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bbbd70 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.200+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(78 [pgnls start_epoch 27 out=254b] v27'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.200+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bc1e40 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.200+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(79 [pgnls start_epoch 27 out=213b] v27'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.200+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bc1e40 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.201+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(80 [pgnls start_epoch 27 out=172b] v27'29 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.201+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bbbd70 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.201+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(81 [pgnls start_epoch 27 out=295b] v27'24 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.201+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x7fd550035020 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.201+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(82 [pgnls start_epoch 27 out=276b] v27'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7fd54402e070 con 0x7fd550035020 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.201+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x7fd550035020 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.201+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(83 [pgnls start_epoch 27 out=172b] v27'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd54406c0c0 con 0x7fd550035020 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.201+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bbbd70 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.202+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(84 [pgnls start_epoch 27 out=295b] v27'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.202+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x7fd54400f070 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.202+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(85 [pgnls start_epoch 27 out=172b] v27'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.202+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x7fd550035020 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.203+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(86 [pgnls start_epoch 27 out=213b] v27'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd54406c0c0 con 0x7fd550035020 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.203+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x7fd54400f070 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.203+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(87 [pgnls start_epoch 27 out=172b] v27'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.203+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bc1e40 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.203+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(88 [pgnls start_epoch 27 out=172b] v27'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.203+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bc1e40 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.203+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(89 [pgnls start_epoch 27 out=90b] v27'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.203+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bc1e40 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.204+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(90 [pgnls start_epoch 27 out=90b] v27'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.204+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bbbd70 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.204+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(91 [pgnls start_epoch 27 out=131b] v27'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.204+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x7fd550035020 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.204+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(92 [pgnls start_epoch 27 out=295b] v27'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fd54406c0c0 con 0x7fd550035020 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.204+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd544071040 con 0x7fd54400f070 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.205+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(93 [pgnls start_epoch 27 out=213b] v27'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi087.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-05-08T18:31:23.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.207+0000 7fd40afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:23.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.207+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94431998692064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bbbd70 2024-05-08T18:31:23.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.208+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94431998692064] v27'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.208+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94431998664848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9c010c0 con 0x7fd550035020 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.209+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94431998664848] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd54406c0c0 con 0x7fd550035020 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.209+0000 7fd557087800 20 remove_watcher() i=0 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.209+0000 7fd557087800 2 removed watcher, disabling cache 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.209+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94431998672608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bbbd70 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.210+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94431998672608] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.210+0000 7fd557087800 20 remove_watcher() i=1 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.210+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94431998676832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc76b0 con 0x55e2a9bc1e40 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.211+0000 7fd555380640 1 -- 172.21.15.87:0/2702101527 <== osd.3 v2:172.21.15.87:6800/2929215285 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94431998676832] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd550051020 con 0x55e2a9bc1e40 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.211+0000 7fd557087800 20 remove_watcher() i=2 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.211+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94431998673856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc6090 con 0x7fd550035020 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.212+0000 7fd554b7f640 1 -- 172.21.15.87:0/2702101527 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94431998673856] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd54406c0c0 con 0x7fd550035020 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.212+0000 7fd557087800 20 remove_watcher() i=3 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.212+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94431998682896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc7ee0 con 0x55e2a9bbbd70 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.213+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94431998682896] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x55e2a9bbbd70 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.213+0000 7fd557087800 20 remove_watcher() i=4 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.213+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94431998687792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc8f60 con 0x7fd54400f070 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.214+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94431998687792] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.214+0000 7fd557087800 20 remove_watcher() i=5 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.214+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94431998677888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc6090 con 0x7fd54400f070 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.215+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94431998677888] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.215+0000 7fd557087800 20 remove_watcher() i=6 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.215+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94431998690048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2a9bc7ee0 con 0x7fd54400f070 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94431998690048] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd53c05a040 con 0x7fd54400f070 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 20 remove_watcher() i=7 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd54400f070 msgr2=0x7fd54404a6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd54400f070 0x7fd54404a6d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e2a9bbbd70 msgr2=0x55e2a9bbe230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e2a9bbbd70 0x55e2a9bbe230 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd550035020 msgr2=0x7fd550037070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd550035020 0x7fd550037070 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55e2a9bc1e40 msgr2=0x55e2a9bc4270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55e2a9bc1e40 0x55e2a9bc4270 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd42003bba0 msgr2=0x7fd42003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd42003bba0 0x7fd42003e060 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd544017cd0 tx=0x7fd544033000 comp rx=0 tx=0).stop 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9ba8bf0 msgr2=0x55e2a9bb00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd54c37e640 1 -- 172.21.15.87:0/2702101527 reap_dead start 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9ba8bf0 0x55e2a9bb00a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd550052970 tx=0x7fd550052900 comp rx=0 tx=0).stop 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 shutdown_connections 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 --2- 172.21.15.87:0/2702101527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9ba8bf0 0x55e2a9bb00a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 >> 172.21.15.87:0/2702101527 conn(0x55e2a9ba4ec0 msgr2=0x55e2a9ba2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 shutdown_connections 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 -- 172.21.15.87:0/2702101527 wait complete. 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 -- 172.21.15.87:0/1031593075 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd42c03bba0 msgr2=0x7fd42c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 --2- 172.21.15.87:0/1031593075 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd42c03bba0 0x7fd42c03e060 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd54401dfd0 tx=0x7fd54400ff50 comp rx=0 tx=0).stop 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 -- 172.21.15.87:0/1031593075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9b9b8c0 msgr2=0x55e2a9b9bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 --2- 172.21.15.87:0/1031593075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9b9b8c0 0x55e2a9b9bce0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x55e2a9b87f50 tx=0x7fd5500178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 -- 172.21.15.87:0/1031593075 shutdown_connections 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 --2- 172.21.15.87:0/1031593075 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd42c03bba0 0x7fd42c03e060 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 --2- 172.21.15.87:0/1031593075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9b9b8c0 0x55e2a9b9bce0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.216+0000 7fd557087800 1 -- 172.21.15.87:0/1031593075 >> 172.21.15.87:0/1031593075 conn(0x55e2a9b8f960 msgr2=0x55e2a9b8fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 -- 172.21.15.87:0/1031593075 shutdown_connections 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 -- 172.21.15.87:0/1031593075 wait complete. 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 -- 172.21.15.87:0/182379041 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55e2a9b895a0 msgr2=0x55e2a9b8cde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55e2a9b895a0 0x55e2a9b8cde0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 -- 172.21.15.87:0/182379041 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e2a9a8b880 msgr2=0x55e2a9b875e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e2a9a8b880 0x55e2a9b875e0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 -- 172.21.15.87:0/182379041 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd43c03bb50 msgr2=0x7fd43c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd43c03bb50 0x7fd43c03e010 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd53c054000 tx=0x7fd53c04e000 comp rx=0 tx=0).stop 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 -- 172.21.15.87:0/182379041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a87440 msgr2=0x55e2a9b803a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a87440 0x55e2a9b803a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd544000fd0 tx=0x7fd544000ed0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 -- 172.21.15.87:0/182379041 shutdown_connections 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55e2a9a8b880 0x55e2a9b875e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55e2a9b895a0 0x55e2a9b8cde0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd43c03bb50 0x7fd43c03e010 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 --2- 172.21.15.87:0/182379041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a9a87440 0x55e2a9b803a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 -- 172.21.15.87:0/182379041 >> 172.21.15.87:0/182379041 conn(0x55e2a9a82c60 msgr2=0x55e2a9b72920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 -- 172.21.15.87:0/182379041 shutdown_connections 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.217+0000 7fd557087800 1 -- 172.21.15.87:0/182379041 wait complete. 2024-05-08T18:31:23.233 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-05-08T18:31:23.234 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-05-08T18:31:23.234 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-05-08T18:31:23.234 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-05-08T18:31:23.312 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:23.312 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:23.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.314+0000 7efc07811800 1 Processor -- start 2024-05-08T18:31:23.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.314+0000 7efc07811800 1 -- start start 2024-05-08T18:31:23.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.315+0000 7efc07811800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5647cccfb790 0x5647cccfdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.315+0000 7efc07811800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5647cccfe0c0 con 0x5647cccf5520 2024-05-08T18:31:23.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.315+0000 7efc07811800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5647ccb97e20 con 0x5647cccfb790 2024-05-08T18:31:23.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.315+0000 7efc02666640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5647cccfb790 0x5647cccfdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.315+0000 7efc02666640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5647cccfb790 0x5647cccfdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57250/0 (socket says 172.21.15.87:57250) 2024-05-08T18:31:23.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.315+0000 7efc02666640 1 -- 172.21.15.87:0/460733734 learned_addr learned my addr 172.21.15.87:0/460733734 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.315+0000 7efc02e67640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5647cccf5520 0x5647cccf5940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:52646/0 (socket says 172.21.15.87:52646) 2024-05-08T18:31:23.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.315+0000 7efc02666640 1 -- 172.21.15.87:0/460733734 >> v1:172.21.15.53:6789/0 conn(0x5647cccf5520 legacy=0x5647cccf5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.315+0000 7efc02666640 1 -- 172.21.15.87:0/460733734 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647cccff2d0 con 0x5647cccfb790 2024-05-08T18:31:23.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.317+0000 7efc02666640 1 --2- 172.21.15.87:0/460733734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccfb790 0x5647cccfdb80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7efbf800a520 tx=0x7efbf801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1554c30b0a4f59b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.317+0000 7efc01e65640 1 -- 172.21.15.87:0/460733734 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf8057070 con 0x5647cccfb790 2024-05-08T18:31:23.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.317+0000 7efc01e65640 1 -- 172.21.15.87:0/460733734 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf8052570 con 0x5647cccfb790 2024-05-08T18:31:23.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.317+0000 7efc01e65640 1 -- 172.21.15.87:0/460733734 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf804ae60 con 0x5647cccfb790 2024-05-08T18:31:23.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.318+0000 7efc07811800 1 -- 172.21.15.87:0/460733734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccfb790 msgr2=0x5647cccfdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.318+0000 7efc07811800 1 --2- 172.21.15.87:0/460733734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccfb790 0x5647cccfdb80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7efbf800a520 tx=0x7efbf801d010 comp rx=0 tx=0).stop 2024-05-08T18:31:23.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.318+0000 7efc07811800 1 -- 172.21.15.87:0/460733734 shutdown_connections 2024-05-08T18:31:23.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.318+0000 7efc07811800 1 --2- 172.21.15.87:0/460733734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccfb790 0x5647cccfdb80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.318+0000 7efc07811800 1 -- 172.21.15.87:0/460733734 >> 172.21.15.87:0/460733734 conn(0x5647cccf0ea0 msgr2=0x5647cccf32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.318+0000 7efc07811800 1 -- 172.21.15.87:0/460733734 shutdown_connections 2024-05-08T18:31:23.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.318+0000 7efc07811800 1 -- 172.21.15.87:0/460733734 wait complete. 2024-05-08T18:31:23.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.331+0000 7efc07811800 1 Processor -- start 2024-05-08T18:31:23.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.331+0000 7efc07811800 1 -- start start 2024-05-08T18:31:23.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.331+0000 7efc07811800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccf5520 0x5647cccf7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.331+0000 7efc07811800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5647ccc425b0 con 0x5647cccf5520 2024-05-08T18:31:23.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.331+0000 7efc02e67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccf5520 0x5647cccf7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.332+0000 7efc02e67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccf5520 0x5647cccf7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57254/0 (socket says 172.21.15.87:57254) 2024-05-08T18:31:23.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.332+0000 7efc02e67640 1 -- 172.21.15.87:0/2129356315 learned_addr learned my addr 172.21.15.87:0/2129356315 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.332+0000 7efc02e67640 1 -- 172.21.15.87:0/2129356315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647cccf6460 con 0x5647cccf5520 2024-05-08T18:31:23.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.332+0000 7efc02e67640 1 --2- 172.21.15.87:0/2129356315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccf5520 0x5647cccf7ea0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7efbf4001e40 tx=0x7efbf4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0949ddcf7d4ad1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.332+0000 7efaf0e09640 1 -- 172.21.15.87:0/2129356315 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf400e5c0 con 0x5647cccf5520 2024-05-08T18:31:23.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.332+0000 7efaf0e09640 1 -- 172.21.15.87:0/2129356315 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf4006070 con 0x5647cccf5520 2024-05-08T18:31:23.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.332+0000 7efaf0e09640 1 -- 172.21.15.87:0/2129356315 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf400e910 con 0x5647cccf5520 2024-05-08T18:31:23.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.333+0000 7efc07811800 1 -- 172.21.15.87:0/2129356315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccf5520 msgr2=0x5647cccf7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.333+0000 7efc07811800 1 --2- 172.21.15.87:0/2129356315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccf5520 0x5647cccf7ea0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7efbf4001e40 tx=0x7efbf4001e70 comp rx=0 tx=0).stop 2024-05-08T18:31:23.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.333+0000 7efc07811800 1 -- 172.21.15.87:0/2129356315 shutdown_connections 2024-05-08T18:31:23.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.333+0000 7efc07811800 1 --2- 172.21.15.87:0/2129356315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccf5520 0x5647cccf7ea0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.333+0000 7efc07811800 1 -- 172.21.15.87:0/2129356315 >> 172.21.15.87:0/2129356315 conn(0x5647cccf0ea0 msgr2=0x5647ccde3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.333+0000 7efc07811800 1 -- 172.21.15.87:0/2129356315 shutdown_connections 2024-05-08T18:31:23.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.333+0000 7efc07811800 1 -- 172.21.15.87:0/2129356315 wait complete. 2024-05-08T18:31:23.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.333+0000 7efc07811800 1 Processor -- start 2024-05-08T18:31:23.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.333+0000 7efc07811800 1 -- start start 2024-05-08T18:31:23.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.333+0000 7efc07811800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccf5520 0x5647ccdf2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.333+0000 7efc07811800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5647cccfe590 con 0x5647cccf5520 2024-05-08T18:31:23.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.334+0000 7efc02e67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccf5520 0x5647ccdf2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.334+0000 7efc02e67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccf5520 0x5647ccdf2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57270/0 (socket says 172.21.15.87:57270) 2024-05-08T18:31:23.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.334+0000 7efc02e67640 1 -- 172.21.15.87:0/422598375 learned_addr learned my addr 172.21.15.87:0/422598375 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.334+0000 7efc02e67640 1 -- 172.21.15.87:0/422598375 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647ccdf2850 con 0x5647cccf5520 2024-05-08T18:31:23.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.334+0000 7efc02e67640 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccf5520 0x5647ccdf2310 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7efbf4000f60 tx=0x7efbf4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.334+0000 7efaef606640 1 -- 172.21.15.87:0/422598375 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf400f8d0 con 0x5647cccf5520 2024-05-08T18:31:23.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.334+0000 7efaef606640 1 -- 172.21.15.87:0/422598375 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf400fa70 con 0x5647cccf5520 2024-05-08T18:31:23.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.334+0000 7efc07811800 1 -- 172.21.15.87:0/422598375 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647ccdf2ae0 con 0x5647cccf5520 2024-05-08T18:31:23.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.334+0000 7efaef606640 1 -- 172.21.15.87:0/422598375 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf400fd90 con 0x5647cccf5520 2024-05-08T18:31:23.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.334+0000 7efc07811800 1 -- 172.21.15.87:0/422598375 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647ccdf5790 con 0x5647cccf5520 2024-05-08T18:31:23.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.335+0000 7efaef606640 1 -- 172.21.15.87:0/422598375 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7efbf4017070 con 0x5647cccf5520 2024-05-08T18:31:23.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.335+0000 7efaef606640 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efae803bb00 0x7efae803dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.335+0000 7efaef606640 1 -- 172.21.15.87:0/422598375 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7efbf4015020 con 0x5647cccf5520 2024-05-08T18:31:23.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.335+0000 7efc02666640 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efae803bb00 0x7efae803dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.335+0000 7efc07811800 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5647cccfb790 0x5647ccdf9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.335+0000 7efc07811800 1 -- 172.21.15.87:0/422598375 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647ccdf9ae0 con 0x5647cccfb790 2024-05-08T18:31:23.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.335+0000 7efc03668640 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5647cccfb790 0x5647ccdf9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.336+0000 7efc02666640 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efae803bb00 0x7efae803dfc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efbf8054000 tx=0x7efbf804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.336+0000 7efc03668640 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5647cccfb790 0x5647ccdf9550 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.336+0000 7efc03668640 1 -- 172.21.15.87:0/422598375 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efbfc00a4a0 con 0x5647cccfb790 2024-05-08T18:31:23.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.336+0000 7efc07811800 1 -- 172.21.15.87:0/422598375 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647ccdf6b00 con 0x5647cccfb790 2024-05-08T18:31:23.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.336+0000 7efc03668640 1 -- 172.21.15.87:0/422598375 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efbfc00a4a0 con 0x5647cccfb790 2024-05-08T18:31:23.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.336+0000 7efc07811800 1 -- 172.21.15.87:0/422598375 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647ccdfb900 con 0x5647cccfb790 2024-05-08T18:31:23.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.337+0000 7efc03668640 1 -- 172.21.15.87:0/422598375 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efbfc00a4a0 con 0x5647cccfb790 2024-05-08T18:31:23.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.337+0000 7efc07811800 1 -- 172.21.15.87:0/422598375 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647ccdfaa40 con 0x5647cccfb790 2024-05-08T18:31:23.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.337+0000 7efc03668640 1 -- 172.21.15.87:0/422598375 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efbfc00a4a0 con 0x5647cccfb790 2024-05-08T18:31:23.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.337+0000 7efc07811800 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5647ccdfb4e0 0x5647ccdfed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.337+0000 7efc07811800 1 -- 172.21.15.87:0/422598375 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647ccdff4d0 con 0x5647ccdfb4e0 2024-05-08T18:31:23.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.337+0000 7efc02e67640 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5647ccdfb4e0 0x5647ccdfed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.337+0000 7efc02e67640 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5647ccdfb4e0 0x5647ccdfed40 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.338+0000 7efc02e67640 1 -- 172.21.15.87:0/422598375 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efbf402e070 con 0x5647ccdfb4e0 2024-05-08T18:31:23.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.338+0000 7efc07811800 1 Processor -- start 2024-05-08T18:31:23.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.338+0000 7efc07811800 1 -- start start 2024-05-08T18:31:23.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.338+0000 7efc07811800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce0d860 0x5647cce0dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.338+0000 7efc07811800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5647ccbe8fc0 con 0x5647cce0d860 2024-05-08T18:31:23.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.338+0000 7efc03668640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce0d860 0x5647cce0dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.338+0000 7efc03668640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce0d860 0x5647cce0dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57284/0 (socket says 172.21.15.87:57284) 2024-05-08T18:31:23.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.338+0000 7efc03668640 1 -- 172.21.15.87:0/1617399819 learned_addr learned my addr 172.21.15.87:0/1617399819 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.339+0000 7efc03668640 1 -- 172.21.15.87:0/1617399819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647cce0e1c0 con 0x5647cce0d860 2024-05-08T18:31:23.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.339+0000 7efc03668640 1 --2- 172.21.15.87:0/1617399819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce0d860 0x5647cce0dc80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x5647ccdf9ee0 tx=0x7efbfc0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.339+0000 7efaece01640 1 -- 172.21.15.87:0/1617399819 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbfc013440 con 0x5647cce0d860 2024-05-08T18:31:23.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.339+0000 7efaece01640 1 -- 172.21.15.87:0/1617399819 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbfc0135e0 con 0x5647cce0d860 2024-05-08T18:31:23.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.339+0000 7efc07811800 1 -- 172.21.15.87:0/1617399819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647cce0ec30 con 0x5647cce0d860 2024-05-08T18:31:23.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.339+0000 7efaece01640 1 -- 172.21.15.87:0/1617399819 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbfc0138c0 con 0x5647cce0d860 2024-05-08T18:31:23.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.339+0000 7efc07811800 1 -- 172.21.15.87:0/1617399819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647cce0f130 con 0x5647cce0d860 2024-05-08T18:31:23.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.340+0000 7efaece01640 1 -- 172.21.15.87:0/1617399819 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7efbfc011040 con 0x5647cce0d860 2024-05-08T18:31:23.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.340+0000 7efaece01640 1 --2- 172.21.15.87:0/1617399819 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efadc03bb50 0x7efadc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.340+0000 7efaece01640 1 -- 172.21.15.87:0/1617399819 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7efbfc01d070 con 0x5647cce0d860 2024-05-08T18:31:23.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.340+0000 7efc02e67640 1 --2- 172.21.15.87:0/1617399819 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efadc03bb50 0x7efadc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.340+0000 7efc07811800 1 Processor -- start 2024-05-08T18:31:23.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.340+0000 7efc02e67640 1 --2- 172.21.15.87:0/1617399819 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efadc03bb50 0x7efadc03e010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x5647ccdfade0 tx=0x7efbf4051800 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.341+0000 7efc07811800 1 -- start start 2024-05-08T18:31:23.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.341+0000 7efc07811800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce1abf0 0x5647cce1b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.341+0000 7efc07811800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5647cccf67e0 con 0x5647cce1abf0 2024-05-08T18:31:23.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.341+0000 7efc03668640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce1abf0 0x5647cce1b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.341+0000 7efc03668640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce1abf0 0x5647cce1b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57290/0 (socket says 172.21.15.87:57290) 2024-05-08T18:31:23.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.341+0000 7efc03668640 1 -- 172.21.15.87:0/68505067 learned_addr learned my addr 172.21.15.87:0/68505067 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.341+0000 7efc03668640 1 -- 172.21.15.87:0/68505067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647cce1b5e0 con 0x5647cce1abf0 2024-05-08T18:31:23.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.341+0000 7efc03668640 1 --2- 172.21.15.87:0/68505067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce1abf0 0x5647cce1b010 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0529e0 tx=0x7efbfc052bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbeab5ceacee284 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.341+0000 7efae67fc640 1 -- 172.21.15.87:0/68505067 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbfc015950 con 0x5647cce1abf0 2024-05-08T18:31:23.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.341+0000 7efae67fc640 1 -- 172.21.15.87:0/68505067 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbfc015430 con 0x5647cce1abf0 2024-05-08T18:31:23.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.341+0000 7efae67fc640 1 -- 172.21.15.87:0/68505067 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbfc015af0 con 0x5647cce1abf0 2024-05-08T18:31:23.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.342+0000 7efc07811800 1 -- 172.21.15.87:0/68505067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce1abf0 msgr2=0x5647cce1b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.342+0000 7efc07811800 1 --2- 172.21.15.87:0/68505067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce1abf0 0x5647cce1b010 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0529e0 tx=0x7efbfc052bb0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.342+0000 7efc07811800 1 -- 172.21.15.87:0/68505067 shutdown_connections 2024-05-08T18:31:23.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.342+0000 7efc07811800 1 --2- 172.21.15.87:0/68505067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce1abf0 0x5647cce1b010 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.342+0000 7efc07811800 1 -- 172.21.15.87:0/68505067 >> 172.21.15.87:0/68505067 conn(0x5647cce16ec0 msgr2=0x5647cce14f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.342+0000 7efc07811800 1 -- 172.21.15.87:0/68505067 shutdown_connections 2024-05-08T18:31:23.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.342+0000 7efc07811800 1 -- 172.21.15.87:0/68505067 wait complete. 2024-05-08T18:31:23.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.342+0000 7efc07811800 1 Processor -- start 2024-05-08T18:31:23.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.342+0000 7efc07811800 1 -- start start 2024-05-08T18:31:23.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.342+0000 7efc07811800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce1abf0 0x5647cce22050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.342+0000 7efc07811800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5647cce1bd30 con 0x5647cce1abf0 2024-05-08T18:31:23.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.342+0000 7efc03668640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce1abf0 0x5647cce22050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.342+0000 7efc03668640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce1abf0 0x5647cce22050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57296/0 (socket says 172.21.15.87:57296) 2024-05-08T18:31:23.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.342+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 learned_addr learned my addr 172.21.15.87:0/858259348 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.343+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647cce22590 con 0x5647cce1abf0 2024-05-08T18:31:23.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.343+0000 7efc03668640 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce1abf0 0x5647cce22050 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7efbfc052910 tx=0x7efbfc052940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.343+0000 7efae4ff9640 1 -- 172.21.15.87:0/858259348 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbfc030020 con 0x5647cce1abf0 2024-05-08T18:31:23.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.343+0000 7efae4ff9640 1 -- 172.21.15.87:0/858259348 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbfc0542e0 con 0x5647cce1abf0 2024-05-08T18:31:23.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.343+0000 7efae4ff9640 1 -- 172.21.15.87:0/858259348 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbfc0512b0 con 0x5647cce1abf0 2024-05-08T18:31:23.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.343+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647cce22820 con 0x5647cce1abf0 2024-05-08T18:31:23.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.343+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647cce254d0 con 0x5647cce1abf0 2024-05-08T18:31:23.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.344+0000 7efae4ff9640 1 -- 172.21.15.87:0/858259348 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7efbfc033020 con 0x5647cce1abf0 2024-05-08T18:31:23.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.344+0000 7efae4ff9640 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efacc03bb50 0x7efacc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.344+0000 7efae4ff9640 1 -- 172.21.15.87:0/858259348 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7efbfc00e040 con 0x5647cce1abf0 2024-05-08T18:31:23.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.344+0000 7efc02e67640 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efacc03bb50 0x7efacc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.345+0000 7efc07811800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.345+0000 7efc02e67640 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efacc03bb50 0x7efacc03e010 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efbf4017d00 tx=0x7efbf4047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.345+0000 7efc07811800 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5647cce2ddd0 0x5647cce30290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.345+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce309e0 con 0x5647cce2ddd0 2024-05-08T18:31:23.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.345+0000 7efc02666640 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5647cce2ddd0 0x5647cce30290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.345+0000 7efc02666640 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5647cce2ddd0 0x5647cce30290 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.345+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.345+0000 7efc07811800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.345+0000 7efc07811800 20 realm 2024-05-08T18:31:23.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.345+0000 7efc07811800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.345+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce30db0 con 0x5647cce2ddd0 2024-05-08T18:31:23.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.345+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc07811800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc07811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:23.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc07811800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce31680 con 0x5647cce2ddd0 2024-05-08T18:31:23.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc07811800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc07811800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce31a20 con 0x5647cce2ddd0 2024-05-08T18:31:23.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc07811800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:23.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc07811800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce32270 con 0x5647cce2ddd0 2024-05-08T18:31:23.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc07811800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:23.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc07811800 20 searching for the correct realm 2024-05-08T18:31:23.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc07811800 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5647cce33fe0 0x5647cce363d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x5647cce33fe0 2024-05-08T18:31:23.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.346+0000 7efc03668640 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5647cce33fe0 0x5647cce363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.347+0000 7efc03668640 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5647cce33fe0 0x5647cce363d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.347+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbfc051020 con 0x5647cce33fe0 2024-05-08T18:31:23.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.347+0000 7efc03668640 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7efbfc035020 0x7efbfc01f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.347+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x7efbfc035020 2024-05-08T18:31:23.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.347+0000 7efc02e67640 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7efbfc035020 0x7efbfc01f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.348+0000 7efc02e67640 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7efbfc035020 0x7efbfc01f2d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.348+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf402e070 con 0x7efbfc035020 2024-05-08T18:31:23.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.348+0000 7efc02e67640 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7efbf400f070 0x7efbf401d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.348+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x7efbf400f070 2024-05-08T18:31:23.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.348+0000 7efc02666640 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7efbf400f070 0x7efbf401d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.349+0000 7efc02666640 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7efbf400f070 0x7efbf401d810 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.349+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.349+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x5647cce2ddd0 2024-05-08T18:31:23.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.349+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.349+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x5647cce2ddd0 2024-05-08T18:31:23.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.349+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.349+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x7efbf400f070 2024-05-08T18:31:23.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.350+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.350+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x7efbf400f070 2024-05-08T18:31:23.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.350+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.350+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x7efbfc035020 2024-05-08T18:31:23.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.350+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf402e070 con 0x7efbfc035020 2024-05-08T18:31:23.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.350+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x5647cce33fe0 2024-05-08T18:31:23.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.350+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbfc051020 con 0x5647cce33fe0 2024-05-08T18:31:23.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.350+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x5647cce2ddd0 2024-05-08T18:31:23.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.350+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.350+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x7efbf400f070 2024-05-08T18:31:23.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.351+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.351+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x5647cce2ddd0 2024-05-08T18:31:23.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.351+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.351+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x7efbfc035020 2024-05-08T18:31:23.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.351+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efbf402e070 con 0x7efbfc035020 2024-05-08T18:31:23.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.351+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x5647cce33fe0 2024-05-08T18:31:23.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.352+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbfc051020 con 0x5647cce33fe0 2024-05-08T18:31:23.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.352+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x5647cce33fe0 2024-05-08T18:31:23.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.352+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbfc051020 con 0x5647cce33fe0 2024-05-08T18:31:23.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.352+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x7efbf400f070 2024-05-08T18:31:23.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.352+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.352+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x5647cce33fe0 2024-05-08T18:31:23.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.352+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbfc051020 con 0x5647cce33fe0 2024-05-08T18:31:23.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.352+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x5647cce33fe0 2024-05-08T18:31:23.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.353+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbfc051020 con 0x5647cce33fe0 2024-05-08T18:31:23.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.353+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x5647cce2ddd0 2024-05-08T18:31:23.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.353+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.353+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x5647cce2ddd0 2024-05-08T18:31:23.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.353+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.353+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x7efbf400f070 2024-05-08T18:31:23.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.353+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.353+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x5647cce33fe0 2024-05-08T18:31:23.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.354+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbfc051020 con 0x5647cce33fe0 2024-05-08T18:31:23.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.354+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x7efbfc035020 2024-05-08T18:31:23.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.354+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf402e070 con 0x7efbfc035020 2024-05-08T18:31:23.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.354+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x5647cce2ddd0 2024-05-08T18:31:23.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.354+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.354+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x7efbf400f070 2024-05-08T18:31:23.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.355+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.355+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x5647cce33fe0 2024-05-08T18:31:23.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.355+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbfc051020 con 0x5647cce33fe0 2024-05-08T18:31:23.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.355+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x7efbf400f070 2024-05-08T18:31:23.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.355+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.355+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x7efbfc035020 2024-05-08T18:31:23.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.355+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf402e070 con 0x7efbfc035020 2024-05-08T18:31:23.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.355+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x5647cce33fe0 2024-05-08T18:31:23.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.356+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbfc051020 con 0x5647cce33fe0 2024-05-08T18:31:23.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.356+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x7efbf400f070 2024-05-08T18:31:23.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.356+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.356+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x5647cce2ddd0 2024-05-08T18:31:23.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.356+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.356+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36960 con 0x7efbfc035020 2024-05-08T18:31:23.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.356+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf402e070 con 0x7efbfc035020 2024-05-08T18:31:23.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.356+0000 7efc07811800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:23.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.356+0000 7efc07811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:23.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.356+0000 7efc07811800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:23.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.356+0000 7efc07811800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:23.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.356+0000 7efc07811800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:23.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.356+0000 7efc07811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:23.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.356+0000 7efc07811800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.356+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce32bf0 con 0x5647cce2ddd0 2024-05-08T18:31:23.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc07811800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc07811800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce33490 con 0x5647cce2ddd0 2024-05-08T18:31:23.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc07811800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:23.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc07811800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce36de0 con 0x7efbf400f070 2024-05-08T18:31:23.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc07811800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:23.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc07811800 20 zone default found 2024-05-08T18:31:23.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc07811800 4 Realm: () 2024-05-08T18:31:23.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc07811800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:23.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc07811800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:23.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc07811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:23.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc07811800 20 zonegroup default 2024-05-08T18:31:23.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc07811800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.357+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce37290 con 0x7efbf400f070 2024-05-08T18:31:23.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.358+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.358+0000 7efc07811800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.358+0000 7efc07811800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.358+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce38c70 con 0x5647cce33fe0 2024-05-08T18:31:23.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.358+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efbfc051020 con 0x5647cce33fe0 2024-05-08T18:31:23.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.358+0000 7efc07811800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.358+0000 7efc07811800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.358+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce390f0 con 0x5647cce33fe0 2024-05-08T18:31:23.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.358+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efbfc051020 con 0x5647cce33fe0 2024-05-08T18:31:23.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.358+0000 7efc07811800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.358+0000 7efc07811800 20 started sync module instance, tier type = 2024-05-08T18:31:23.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.358+0000 7efc07811800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:23.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.358+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce38100 con 0x7efbfc035020 2024-05-08T18:31:23.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.359+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf402e070 con 0x7efbfc035020 2024-05-08T18:31:23.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.359+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94866380129520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce37d60 con 0x7efbfc035020 2024-05-08T18:31:23.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.359+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce3a020 con 0x5647cce2ddd0 2024-05-08T18:31:23.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.360+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94866380129520] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf402e070 con 0x7efbfc035020 2024-05-08T18:31:23.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.360+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.360+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94866380135280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce39f90 con 0x5647cce2ddd0 2024-05-08T18:31:23.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.360+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce3aee0 con 0x5647cce33fe0 2024-05-08T18:31:23.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.361+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94866380135280] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.362+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbfc051020 con 0x5647cce33fe0 2024-05-08T18:31:23.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.362+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94866380139056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce3b2d0 con 0x5647cce33fe0 2024-05-08T18:31:23.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.362+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce3bcd0 con 0x7efbfc035020 2024-05-08T18:31:23.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.363+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf402e070 con 0x7efbfc035020 2024-05-08T18:31:23.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.363+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94866380142560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce3c570 con 0x7efbfc035020 2024-05-08T18:31:23.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.363+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce3d070 con 0x5647cce2ddd0 2024-05-08T18:31:23.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.363+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94866380139056] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbfc051020 con 0x5647cce33fe0 2024-05-08T18:31:23.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.364+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94866380142560] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf402e070 con 0x7efbfc035020 2024-05-08T18:31:23.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.364+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.364+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94866380144832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce3a3c0 con 0x5647cce2ddd0 2024-05-08T18:31:23.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.364+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce3d910 con 0x7efbf400f070 2024-05-08T18:31:23.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.365+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94866380144832] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.365+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.365+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94866380147552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce3d8c0 con 0x7efbf400f070 2024-05-08T18:31:23.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.365+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce3e320 con 0x7efbf400f070 2024-05-08T18:31:23.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.366+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94866380147552] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.366+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.366+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94866380150256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce3e320 con 0x7efbf400f070 2024-05-08T18:31:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.366+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce3ece0 con 0x7efbf400f070 2024-05-08T18:31:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.367+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94866380150256] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.367+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.367+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94866380155408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce3e320 con 0x7efbf400f070 2024-05-08T18:31:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.367+0000 7efc07811800 20 add_watcher() i=0 2024-05-08T18:31:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.367+0000 7efc07811800 20 add_watcher() i=1 2024-05-08T18:31:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.367+0000 7efc07811800 20 add_watcher() i=2 2024-05-08T18:31:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.367+0000 7efc07811800 20 add_watcher() i=3 2024-05-08T18:31:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.367+0000 7efc07811800 20 add_watcher() i=4 2024-05-08T18:31:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.367+0000 7efc07811800 20 add_watcher() i=5 2024-05-08T18:31:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.367+0000 7efc07811800 20 add_watcher() i=6 2024-05-08T18:31:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.368+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94866380155408] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.368+0000 7efc07811800 20 add_watcher() i=7 2024-05-08T18:31:23.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.368+0000 7efc07811800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:23.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.368+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce42100 con 0x5647cce2ddd0 2024-05-08T18:31:23.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.368+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.368+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94866380152944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce3f5c0 con 0x5647cce2ddd0 2024-05-08T18:31:23.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.369+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94866380152944] v27'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.369+0000 7efab97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:23.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.369+0000 7efc07811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:23.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.369+0000 7efc07811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:23.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.369+0000 7efc07811800 5 note: GC not initialized 2024-05-08T18:31:23.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.369+0000 7efa33fff640 20 reqs_thread_entry: start 2024-05-08T18:31:23.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.369+0000 7efc07811800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:23.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.370+0000 7efc07811800 20 Filter name: none 2024-05-08T18:31:23.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.370+0000 7efa31ffb640 20 reqs_thread_entry: start 2024-05-08T18:31:23.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.370+0000 7efc07811800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:23.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.370+0000 7efc07811800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.370+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce75500 con 0x5647cce2ddd0 2024-05-08T18:31:23.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.370+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.370+0000 7efc07811800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:23.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.370+0000 7efc07811800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:23.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.370+0000 7efc07811800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:23.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.370+0000 7efc07811800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:23.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.370+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce77e30 con 0x7efbfc035020 2024-05-08T18:31:23.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.370+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7efbf402e070 con 0x7efbfc035020 2024-05-08T18:31:23.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.370+0000 7efc07811800 20 disabling bucket name=myfoo 2024-05-08T18:31:23.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.370+0000 7efc07811800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:31:23.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.370+0000 7efc07811800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.370+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce75e10 con 0x7efbfc035020 2024-05-08T18:31:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.371+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7efbf402e070 con 0x7efbfc035020 2024-05-08T18:31:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.371+0000 7efc07811800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.371+0000 7efc07811800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-05-08T18:31:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.371+0000 7efc07811800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.371+0000 7efc07811800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 : miss 2024-05-08T18:31:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.371+0000 7efc07811800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.371+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:65 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce77740 con 0x5647cce33fe0 2024-05-08T18:31:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.371+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(65 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7efbfc051020 con 0x5647cce33fe0 2024-05-08T18:31:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.371+0000 7efc07811800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.371+0000 7efc07811800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x17 2024-05-08T18:31:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.371+0000 7efc07811800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.371+0000 7efc07811800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:23.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.371+0000 7efc07811800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.371+0000 7efc07811800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 2024-05-08T18:31:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.371+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce803c0 con 0x5647cce33fe0 2024-05-08T18:31:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.372+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(66 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v27'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7efbfc051020 con 0x5647cce33fe0 2024-05-08T18:31:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.372+0000 7efc07811800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x17 2024-05-08T18:31:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.372+0000 7efc07811800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.372+0000 7efc07811800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.372+0000 7efc07811800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1, ofs0, ns] 2024-05-08T18:31:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.372+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94866380418016 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce78680 con 0x7efbfc035020 2024-05-08T18:31:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.373+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== watch-notify(notify (1) cookie 94866380129520 notify 115964117017 ret 0) ==== 794+0+0 (crc 0 0 0) 0x5647ccdf5790 con 0x7efbfc035020 2024-05-08T18:31:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.373+0000 7efae67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117017 cookie 94866380129520 notifier 4585 bl.length()=752 2024-05-08T18:31:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.373+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(67 notify.0 [notify cookie 94866380418016 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efbf402e070 con 0x7efbfc035020 2024-05-08T18:31:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.373+0000 7efae67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x17 2024-05-08T18:31:23.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.373+0000 7efae67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:23.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.373+0000 7efae67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:23.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.373+0000 7efae67fc640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7efac8003ea0 con 0x7efbfc035020 2024-05-08T18:31:23.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.373+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf402e070 con 0x7efbfc035020 2024-05-08T18:31:23.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.373+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== watch-notify(notify_complete (2) cookie 94866380418016 notify 115964117017 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5647ccdf2ae0 con 0x7efbfc035020 2024-05-08T18:31:23.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.373+0000 7efc07811800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): orig_sources= new_sources= 2024-05-08T18:31:23.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.373+0000 7efc07811800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): potential sources added=[] removed=[] 2024-05-08T18:31:23.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.373+0000 7efc07811800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): orig_dests= new_dests= 2024-05-08T18:31:23.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.373+0000 7efc07811800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): potential dests added=[] removed=[] 2024-05-08T18:31:23.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.373+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce7b200 con 0x5647cce2ddd0 2024-05-08T18:31:23.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.374+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v27'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.374+0000 7efc07811800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:23.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.374+0000 7efc07811800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:23.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.374+0000 7efc07811800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:31:23.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.374+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94866380418016 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5647cce7bcc0 con 0x5647cce2ddd0 2024-05-08T18:31:23.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.374+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== watch-notify(notify (1) cookie 94866380144832 notify 115964117006 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5647cccff2d0 con 0x5647cce2ddd0 2024-05-08T18:31:23.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.374+0000 7efae67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117006 cookie 94866380144832 notifier 4585 bl.length()=567 2024-05-08T18:31:23.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.374+0000 7efae67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:23.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.374+0000 7efae67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:23.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.374+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(70 notify.4 [notify cookie 94866380418016 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.374+0000 7efae67fc640 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7efac8003ea0 con 0x5647cce2ddd0 2024-05-08T18:31:23.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.375+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.375+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== watch-notify(notify_complete (2) cookie 94866380418016 notify 115964117006 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efbf805d9d0 con 0x5647cce2ddd0 2024-05-08T18:31:23.395 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:23.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.376+0000 7efab97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:23.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.376+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94866380152944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce74820 con 0x5647cce2ddd0 2024-05-08T18:31:23.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.377+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94866380152944] v27'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.377+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94866380129520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce74820 con 0x7efbfc035020 2024-05-08T18:31:23.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.378+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94866380129520] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf402e070 con 0x7efbfc035020 2024-05-08T18:31:23.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.378+0000 7efc07811800 20 remove_watcher() i=0 2024-05-08T18:31:23.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.378+0000 7efc07811800 2 removed watcher, disabling cache 2024-05-08T18:31:23.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.378+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94866380135280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce384f0 con 0x5647cce2ddd0 2024-05-08T18:31:23.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.379+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94866380135280] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.379+0000 7efc07811800 20 remove_watcher() i=1 2024-05-08T18:31:23.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.379+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94866380139056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce384f0 con 0x5647cce33fe0 2024-05-08T18:31:23.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.380+0000 7efc03668640 1 -- 172.21.15.87:0/858259348 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94866380139056] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbfc051020 con 0x5647cce33fe0 2024-05-08T18:31:23.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.380+0000 7efc07811800 20 remove_watcher() i=2 2024-05-08T18:31:23.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.380+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94866380142560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce3aa30 con 0x7efbfc035020 2024-05-08T18:31:23.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.381+0000 7efc02e67640 1 -- 172.21.15.87:0/858259348 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94866380142560] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf402e070 con 0x7efbfc035020 2024-05-08T18:31:23.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.381+0000 7efc07811800 20 remove_watcher() i=3 2024-05-08T18:31:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.381+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94866380144832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce384f0 con 0x5647cce2ddd0 2024-05-08T18:31:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.382+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94866380144832] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x5647cce2ddd0 2024-05-08T18:31:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.382+0000 7efc07811800 20 remove_watcher() i=4 2024-05-08T18:31:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.382+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94866380147552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce3c0c0 con 0x7efbf400f070 2024-05-08T18:31:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.383+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94866380147552] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.383+0000 7efc07811800 20 remove_watcher() i=5 2024-05-08T18:31:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.383+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94866380150256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce384f0 con 0x7efbf400f070 2024-05-08T18:31:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.383+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94866380150256] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.383+0000 7efc07811800 20 remove_watcher() i=6 2024-05-08T18:31:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.383+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94866380155408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5647cce384f0 con 0x7efbf400f070 2024-05-08T18:31:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.384+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94866380155408] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf805a040 con 0x7efbf400f070 2024-05-08T18:31:23.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.384+0000 7efc07811800 20 remove_watcher() i=7 2024-05-08T18:31:23.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.384+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7efbf400f070 msgr2=0x7efbf401d810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.384+0000 7efc07811800 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7efbf400f070 0x7efbf401d810 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.384+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5647cce2ddd0 msgr2=0x5647cce30290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.384+0000 7efc07811800 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5647cce2ddd0 0x5647cce30290 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.384+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7efbfc035020 msgr2=0x7efbfc01f2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.384+0000 7efc07811800 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7efbfc035020 0x7efbfc01f2d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.384+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5647cce33fe0 msgr2=0x5647cce363d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.384+0000 7efc07811800 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5647cce33fe0 0x5647cce363d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efacc03bb50 msgr2=0x7efacc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efacc03bb50 0x7efacc03e010 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efbf4017d00 tx=0x7efbf4047000 comp rx=0 tx=0).stop 2024-05-08T18:31:23.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce1abf0 msgr2=0x5647cce22050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 --2- 172.21.15.87:0/858259348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce1abf0 0x5647cce22050 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7efbfc052910 tx=0x7efbfc052940 comp rx=0 tx=0).stop 2024-05-08T18:31:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 reap_dead start 2024-05-08T18:31:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc02666640 1 -- 172.21.15.87:0/858259348 reap_dead start 2024-05-08T18:31:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 shutdown_connections 2024-05-08T18:31:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 >> 172.21.15.87:0/858259348 conn(0x5647cce16ec0 msgr2=0x5647cce14520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 shutdown_connections 2024-05-08T18:31:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 -- 172.21.15.87:0/858259348 wait complete. 2024-05-08T18:31:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 -- 172.21.15.87:0/1617399819 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efadc03bb50 msgr2=0x7efadc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 --2- 172.21.15.87:0/1617399819 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efadc03bb50 0x7efadc03e010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x5647ccdfade0 tx=0x7efbf4051800 comp rx=0 tx=0).stop 2024-05-08T18:31:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 -- 172.21.15.87:0/1617399819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce0d860 msgr2=0x5647cce0dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 --2- 172.21.15.87:0/1617399819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce0d860 0x5647cce0dc80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x5647ccdf9ee0 tx=0x7efbfc0178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 -- 172.21.15.87:0/1617399819 shutdown_connections 2024-05-08T18:31:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 --2- 172.21.15.87:0/1617399819 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efadc03bb50 0x7efadc03e010 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 --2- 172.21.15.87:0/1617399819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cce0d860 0x5647cce0dc80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 -- 172.21.15.87:0/1617399819 >> 172.21.15.87:0/1617399819 conn(0x5647cce01900 msgr2=0x5647cce01d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 -- 172.21.15.87:0/1617399819 shutdown_connections 2024-05-08T18:31:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 -- 172.21.15.87:0/1617399819 wait complete. 2024-05-08T18:31:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 -- 172.21.15.87:0/422598375 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5647ccdfb4e0 msgr2=0x5647ccdfed40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5647ccdfb4e0 0x5647ccdfed40 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 -- 172.21.15.87:0/422598375 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5647cccfb790 msgr2=0x5647ccdf9550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.385+0000 7efc07811800 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5647cccfb790 0x5647ccdf9550 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.386+0000 7efc07811800 1 -- 172.21.15.87:0/422598375 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efae803bb00 msgr2=0x7efae803dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.386+0000 7efc07811800 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efae803bb00 0x7efae803dfc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efbf8054000 tx=0x7efbf804e000 comp rx=0 tx=0).stop 2024-05-08T18:31:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.386+0000 7efc07811800 1 -- 172.21.15.87:0/422598375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccf5520 msgr2=0x5647ccdf2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.386+0000 7efc07811800 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccf5520 0x5647ccdf2310 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7efbf4000f60 tx=0x7efbf4000bc0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.386+0000 7efc07811800 1 -- 172.21.15.87:0/422598375 shutdown_connections 2024-05-08T18:31:23.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.386+0000 7efc07811800 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5647cccfb790 0x5647ccdf9550 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.386+0000 7efc07811800 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5647ccdfb4e0 0x5647ccdfed40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.386+0000 7efc07811800 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efae803bb00 0x7efae803dfc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.386+0000 7efc07811800 1 --2- 172.21.15.87:0/422598375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647cccf5520 0x5647ccdf2310 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.386+0000 7efc07811800 1 -- 172.21.15.87:0/422598375 >> 172.21.15.87:0/422598375 conn(0x5647cccf0ea0 msgr2=0x5647cccf6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.386+0000 7efc07811800 1 -- 172.21.15.87:0/422598375 shutdown_connections 2024-05-08T18:31:23.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.386+0000 7efc07811800 1 -- 172.21.15.87:0/422598375 wait complete. 2024-05-08T18:31:23.409 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:23.411 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-05-08T18:31:23.411 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-05-08T18:31:23.412 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-05-08T18:31:23.455 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:23.455 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.458+0000 7f1c04d1f800 1 Processor -- start 2024-05-08T18:31:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.458+0000 7f1c04d1f800 1 -- start start 2024-05-08T18:31:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.458+0000 7f1c04d1f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556664d6e6a0 0x556664d771a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.458+0000 7f1c04d1f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556664ce1da0 con 0x556664d6cb60 2024-05-08T18:31:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.458+0000 7f1c04d1f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x556664c0ee20 con 0x556664d6e6a0 2024-05-08T18:31:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.458+0000 7f1bfbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556664d6e6a0 0x556664d771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.458+0000 7f1c009e0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x556664d6cb60 0x556664d6cf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:52656/0 (socket says 172.21.15.87:52656) 2024-05-08T18:31:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.458+0000 7f1c009e0640 1 -- 172.21.15.87:0/3379580621 learned_addr learned my addr 172.21.15.87:0/3379580621 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.459+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3379580621 >> v1:172.21.15.53:6789/0 conn(0x556664d6cb60 legacy=0x556664d6cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.459+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3379580621 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556664d786f0 con 0x556664d6e6a0 2024-05-08T18:31:23.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.461+0000 7f1bfbfff640 1 --2- 172.21.15.87:0/3379580621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6e6a0 0x556664d771a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00a470 tx=0x7f1bec01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddacc862fe80097d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.461+0000 7f1bfb7fe640 1 -- 172.21.15.87:0/3379580621 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec057070 con 0x556664d6e6a0 2024-05-08T18:31:23.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.461+0000 7f1bfb7fe640 1 -- 172.21.15.87:0/3379580621 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bec04adc0 con 0x556664d6e6a0 2024-05-08T18:31:23.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.461+0000 7f1bfb7fe640 1 -- 172.21.15.87:0/3379580621 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec052590 con 0x556664d6e6a0 2024-05-08T18:31:23.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.461+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3379580621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6e6a0 msgr2=0x556664d771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.461+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/3379580621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6e6a0 0x556664d771a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00a470 tx=0x7f1bec01ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:23.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.461+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3379580621 shutdown_connections 2024-05-08T18:31:23.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.461+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/3379580621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6e6a0 0x556664d771a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.461+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3379580621 >> 172.21.15.87:0/3379580621 conn(0x556664d686a0 msgr2=0x556664d6ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.461+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3379580621 shutdown_connections 2024-05-08T18:31:23.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.461+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3379580621 wait complete. 2024-05-08T18:31:23.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.475+0000 7f1c04d1f800 1 Processor -- start 2024-05-08T18:31:23.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.475+0000 7f1c04d1f800 1 -- start start 2024-05-08T18:31:23.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.475+0000 7f1c04d1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6cb60 0x556664e618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.475+0000 7f1c04d1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556664cb95b0 con 0x556664d6cb60 2024-05-08T18:31:23.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.475+0000 7f1c009e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6cb60 0x556664e618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.475+0000 7f1c009e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6cb60 0x556664e618f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57322/0 (socket says 172.21.15.87:57322) 2024-05-08T18:31:23.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.475+0000 7f1c009e0640 1 -- 172.21.15.87:0/3685778367 learned_addr learned my addr 172.21.15.87:0/3685778367 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.476+0000 7f1c009e0640 1 -- 172.21.15.87:0/3685778367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556664e61ec0 con 0x556664d6cb60 2024-05-08T18:31:23.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.476+0000 7f1c009e0640 1 --2- 172.21.15.87:0/3685778367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6cb60 0x556664e618f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4001d50 tx=0x7f1bf400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7190e889fb1cc24 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.476+0000 7f1aeee05640 1 -- 172.21.15.87:0/3685778367 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf4013030 con 0x556664d6cb60 2024-05-08T18:31:23.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.476+0000 7f1aeee05640 1 -- 172.21.15.87:0/3685778367 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf400e470 con 0x556664d6cb60 2024-05-08T18:31:23.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.476+0000 7f1aeee05640 1 -- 172.21.15.87:0/3685778367 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf400e810 con 0x556664d6cb60 2024-05-08T18:31:23.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.477+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3685778367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6cb60 msgr2=0x556664e618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.477+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/3685778367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6cb60 0x556664e618f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4001d50 tx=0x7f1bf400b6c0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.477+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3685778367 shutdown_connections 2024-05-08T18:31:23.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.477+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/3685778367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6cb60 0x556664e618f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.477+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3685778367 >> 172.21.15.87:0/3685778367 conn(0x556664d686a0 msgr2=0x556664e5d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.477+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3685778367 shutdown_connections 2024-05-08T18:31:23.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.477+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3685778367 wait complete. 2024-05-08T18:31:23.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.477+0000 7f1c04d1f800 1 Processor -- start 2024-05-08T18:31:23.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.477+0000 7f1c04d1f800 1 -- start start 2024-05-08T18:31:23.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.477+0000 7f1c04d1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6cb60 0x556664e69490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.477+0000 7f1c04d1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556664d779b0 con 0x556664d6cb60 2024-05-08T18:31:23.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.477+0000 7f1c009e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6cb60 0x556664e69490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.477+0000 7f1c009e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6cb60 0x556664e69490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57326/0 (socket says 172.21.15.87:57326) 2024-05-08T18:31:23.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.477+0000 7f1c009e0640 1 -- 172.21.15.87:0/1055865852 learned_addr learned my addr 172.21.15.87:0/1055865852 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.477+0000 7f1c009e0640 1 -- 172.21.15.87:0/1055865852 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556664e699d0 con 0x556664d6cb60 2024-05-08T18:31:23.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.478+0000 7f1c009e0640 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6cb60 0x556664e69490 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x556664e62680 tx=0x7f1bf4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.478+0000 7f1aed602640 1 -- 172.21.15.87:0/1055865852 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf4027070 con 0x556664d6cb60 2024-05-08T18:31:23.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.478+0000 7f1aed602640 1 -- 172.21.15.87:0/1055865852 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf4019900 con 0x556664d6cb60 2024-05-08T18:31:23.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.478+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1055865852 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556664e69c60 con 0x556664d6cb60 2024-05-08T18:31:23.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.478+0000 7f1aed602640 1 -- 172.21.15.87:0/1055865852 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf4019c40 con 0x556664d6cb60 2024-05-08T18:31:23.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.478+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1055865852 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556664e6c8c0 con 0x556664d6cb60 2024-05-08T18:31:23.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.479+0000 7f1aed602640 1 -- 172.21.15.87:0/1055865852 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1bf402a070 con 0x556664d6cb60 2024-05-08T18:31:23.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.479+0000 7f1aed602640 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1ae803bb50 0x7f1ae803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.479+0000 7f1aed602640 1 -- 172.21.15.87:0/1055865852 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1bf401f070 con 0x556664d6cb60 2024-05-08T18:31:23.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.479+0000 7f1bfbfff640 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1ae803bb50 0x7f1ae803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.479+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556664d6e6a0 0x556664e70680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.479+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1055865852 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664e70c00 con 0x556664d6e6a0 2024-05-08T18:31:23.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.479+0000 7f1c011e1640 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556664d6e6a0 0x556664e70680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.479+0000 7f1bfbfff640 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1ae803bb50 0x7f1ae803e010 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1bec054000 tx=0x7f1bec04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.479+0000 7f1c011e1640 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556664d6e6a0 0x556664e70680 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.480+0000 7f1c011e1640 1 -- 172.21.15.87:0/1055865852 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bfc00a4a0 con 0x556664d6e6a0 2024-05-08T18:31:23.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.480+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1055865852 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664e6dc50 con 0x556664d6e6a0 2024-05-08T18:31:23.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.480+0000 7f1c011e1640 1 -- 172.21.15.87:0/1055865852 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1bfc00a4a0 con 0x556664d6e6a0 2024-05-08T18:31:23.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.480+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1055865852 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664e72a20 con 0x556664d6e6a0 2024-05-08T18:31:23.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.480+0000 7f1c011e1640 1 -- 172.21.15.87:0/1055865852 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1bfc00a4a0 con 0x556664d6e6a0 2024-05-08T18:31:23.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.480+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1055865852 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664e71c50 con 0x556664d6e6a0 2024-05-08T18:31:23.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.481+0000 7f1c011e1640 1 -- 172.21.15.87:0/1055865852 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1bfc00a4a0 con 0x556664d6e6a0 2024-05-08T18:31:23.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.481+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556664e73dd0 0x556664e761c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.481+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1055865852 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664e76700 con 0x556664e73dd0 2024-05-08T18:31:23.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.481+0000 7f1c009e0640 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556664e73dd0 0x556664e761c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.481+0000 7f1c009e0640 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556664e73dd0 0x556664e761c0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.482+0000 7f1c009e0640 1 -- 172.21.15.87:0/1055865852 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1bf4029030 con 0x556664e73dd0 2024-05-08T18:31:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.482+0000 7f1c04d1f800 1 Processor -- start 2024-05-08T18:31:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.482+0000 7f1c04d1f800 1 -- start start 2024-05-08T18:31:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.482+0000 7f1c04d1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e84940 0x556664e84d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.482+0000 7f1c04d1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556664c5ffc0 con 0x556664e84940 2024-05-08T18:31:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.482+0000 7f1c011e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e84940 0x556664e84d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.482+0000 7f1c011e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e84940 0x556664e84d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57332/0 (socket says 172.21.15.87:57332) 2024-05-08T18:31:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.482+0000 7f1c011e1640 1 -- 172.21.15.87:0/1014308247 learned_addr learned my addr 172.21.15.87:0/1014308247 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.483+0000 7f1c011e1640 1 -- 172.21.15.87:0/1014308247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556664e852a0 con 0x556664e84940 2024-05-08T18:31:23.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.483+0000 7f1c011e1640 1 --2- 172.21.15.87:0/1014308247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e84940 0x556664e84d60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x556664e6a840 tx=0x7f1bfc0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.483+0000 7f1ae67fc640 1 -- 172.21.15.87:0/1014308247 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bfc013440 con 0x556664e84940 2024-05-08T18:31:23.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.483+0000 7f1ae67fc640 1 -- 172.21.15.87:0/1014308247 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bfc0135e0 con 0x556664e84940 2024-05-08T18:31:23.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.483+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1014308247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556664e85d10 con 0x556664e84940 2024-05-08T18:31:23.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.483+0000 7f1ae67fc640 1 -- 172.21.15.87:0/1014308247 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bfc0138c0 con 0x556664e84940 2024-05-08T18:31:23.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.483+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1014308247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556664e86210 con 0x556664e84940 2024-05-08T18:31:23.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.484+0000 7f1ae67fc640 1 -- 172.21.15.87:0/1014308247 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1bfc011040 con 0x556664e84940 2024-05-08T18:31:23.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.484+0000 7f1ae67fc640 1 --2- 172.21.15.87:0/1014308247 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1ad803bb50 0x7f1ad803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.484+0000 7f1ae67fc640 1 -- 172.21.15.87:0/1014308247 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1bfc01d070 con 0x556664e84940 2024-05-08T18:31:23.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.484+0000 7f1c009e0640 1 --2- 172.21.15.87:0/1014308247 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1ad803bb50 0x7f1ad803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.484+0000 7f1c04d1f800 1 Processor -- start 2024-05-08T18:31:23.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.484+0000 7f1c04d1f800 1 -- start start 2024-05-08T18:31:23.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.484+0000 7f1c009e0640 1 --2- 172.21.15.87:0/1014308247 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1ad803bb50 0x7f1ad803e010 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4001520 tx=0x7f1bf4050e50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.484+0000 7f1c04d1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e91d40 0x556664e92160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.484+0000 7f1c04d1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556664e62240 con 0x556664e91d40 2024-05-08T18:31:23.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.485+0000 7f1c011e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e91d40 0x556664e92160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.485+0000 7f1c011e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e91d40 0x556664e92160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57344/0 (socket says 172.21.15.87:57344) 2024-05-08T18:31:23.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.485+0000 7f1c011e1640 1 -- 172.21.15.87:0/2102529182 learned_addr learned my addr 172.21.15.87:0/2102529182 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.485+0000 7f1c011e1640 1 -- 172.21.15.87:0/2102529182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556664e92730 con 0x556664e91d40 2024-05-08T18:31:23.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.485+0000 7f1c011e1640 1 --2- 172.21.15.87:0/2102529182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e91d40 0x556664e92160 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0529a0 tx=0x7f1bfc001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6893a459ca9917 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.485+0000 7f1ad7fff640 1 -- 172.21.15.87:0/2102529182 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bfc0540d0 con 0x556664e91d40 2024-05-08T18:31:23.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.485+0000 7f1ad7fff640 1 -- 172.21.15.87:0/2102529182 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bfc054270 con 0x556664e91d40 2024-05-08T18:31:23.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.485+0000 7f1ad7fff640 1 -- 172.21.15.87:0/2102529182 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bfc001660 con 0x556664e91d40 2024-05-08T18:31:23.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.486+0000 7f1c04d1f800 1 -- 172.21.15.87:0/2102529182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e91d40 msgr2=0x556664e92160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.486+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/2102529182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e91d40 0x556664e92160 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0529a0 tx=0x7f1bfc001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:23.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.486+0000 7f1c04d1f800 1 -- 172.21.15.87:0/2102529182 shutdown_connections 2024-05-08T18:31:23.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.486+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/2102529182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e91d40 0x556664e92160 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.486+0000 7f1c04d1f800 1 -- 172.21.15.87:0/2102529182 >> 172.21.15.87:0/2102529182 conn(0x556664e8dfc0 msgr2=0x556664e8c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.486+0000 7f1c04d1f800 1 -- 172.21.15.87:0/2102529182 shutdown_connections 2024-05-08T18:31:23.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.486+0000 7f1c04d1f800 1 -- 172.21.15.87:0/2102529182 wait complete. 2024-05-08T18:31:23.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.486+0000 7f1c04d1f800 1 Processor -- start 2024-05-08T18:31:23.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.486+0000 7f1c04d1f800 1 -- start start 2024-05-08T18:31:23.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.486+0000 7f1c04d1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e91d40 0x556664e99260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.486+0000 7f1c04d1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556664e92e60 con 0x556664e91d40 2024-05-08T18:31:23.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.486+0000 7f1c011e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e91d40 0x556664e99260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.486+0000 7f1c011e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e91d40 0x556664e99260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:57358/0 (socket says 172.21.15.87:57358) 2024-05-08T18:31:23.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.486+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 learned_addr learned my addr 172.21.15.87:0/3880660745 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:23.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.486+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556664e997a0 con 0x556664e91d40 2024-05-08T18:31:23.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.487+0000 7f1c011e1640 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e91d40 0x556664e99260 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc001ea0 tx=0x7f1bfc052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.487+0000 7f1ad67fc640 1 -- 172.21.15.87:0/3880660745 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bfc030020 con 0x556664e91d40 2024-05-08T18:31:23.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.487+0000 7f1ad67fc640 1 -- 172.21.15.87:0/3880660745 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bfc015ab0 con 0x556664e91d40 2024-05-08T18:31:23.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.487+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556664e99a30 con 0x556664e91d40 2024-05-08T18:31:23.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.487+0000 7f1ad67fc640 1 -- 172.21.15.87:0/3880660745 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bfc015430 con 0x556664e91d40 2024-05-08T18:31:23.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.487+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556664e9c6e0 con 0x556664e91d40 2024-05-08T18:31:23.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.488+0000 7f1ad67fc640 1 -- 172.21.15.87:0/3880660745 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1bfc033020 con 0x556664e91d40 2024-05-08T18:31:23.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.488+0000 7f1ad67fc640 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1acc03bb50 0x7f1acc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.488+0000 7f1ad67fc640 1 -- 172.21.15.87:0/3880660745 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1bfc00e040 con 0x556664e91d40 2024-05-08T18:31:23.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.488+0000 7f1c009e0640 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1acc03bb50 0x7f1acc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.488+0000 7f1c009e0640 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1acc03bb50 0x7f1acc03e010 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4050f80 tx=0x7f1bf4032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.488+0000 7f1c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.488+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556664ea4ee0 0x556664ea73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.488+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664ea7af0 con 0x556664ea4ee0 2024-05-08T18:31:23.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.489+0000 7f1bfbfff640 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556664ea4ee0 0x556664ea73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.489+0000 7f1bfbfff640 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556664ea4ee0 0x556664ea73a0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.489+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.489+0000 7f1c04d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.489+0000 7f1c04d1f800 20 realm 2024-05-08T18:31:23.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.489+0000 7f1c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.489+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664ea7f20 con 0x556664ea4ee0 2024-05-08T18:31:23.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.489+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.489+0000 7f1c04d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.489+0000 7f1c04d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:23.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.489+0000 7f1c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.489+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664ea87f0 con 0x556664ea4ee0 2024-05-08T18:31:23.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.489+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.490+0000 7f1c04d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.490+0000 7f1c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.490+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664ea8b90 con 0x556664ea4ee0 2024-05-08T18:31:23.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.490+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.490+0000 7f1c04d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:23.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.490+0000 7f1c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.490+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x556664ea4ee0 2024-05-08T18:31:23.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.490+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.490+0000 7f1c04d1f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:23.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.490+0000 7f1c04d1f800 20 searching for the correct realm 2024-05-08T18:31:23.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.490+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556664eab150 0x556664ead540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.490+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664eadb70 con 0x556664eab150 2024-05-08T18:31:23.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.490+0000 7f1c011e1640 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556664eab150 0x556664ead540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.490+0000 7f1c011e1640 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556664eab150 0x556664ead540 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.491+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bfc029070 con 0x556664eab150 2024-05-08T18:31:23.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.491+0000 7f1c011e1640 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f1bfc035020 0x7f1bfc004600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.491+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664eadb70 con 0x7f1bfc035020 2024-05-08T18:31:23.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.491+0000 7f1c009e0640 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f1bfc035020 0x7f1bfc004600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.491+0000 7f1c009e0640 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f1bfc035020 0x7f1bfc004600 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.492+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf4029030 con 0x7f1bfc035020 2024-05-08T18:31:23.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.492+0000 7f1c009e0640 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f1bf402c060 0x7f1bf402b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:23.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.492+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664eadb70 con 0x7f1bf402c060 2024-05-08T18:31:23.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.492+0000 7f1bfbfff640 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f1bf402c060 0x7f1bf402b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:23.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.492+0000 7f1bfbfff640 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f1bf402c060 0x7f1bf402b580 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:23.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.492+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.492+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x556664ea4ee0 2024-05-08T18:31:23.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.493+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.493+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x556664ea4ee0 2024-05-08T18:31:23.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.493+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.493+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x7f1bf402c060 2024-05-08T18:31:23.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.493+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.493+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x7f1bf402c060 2024-05-08T18:31:23.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.493+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.493+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x7f1bfc035020 2024-05-08T18:31:23.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.494+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf4029030 con 0x7f1bfc035020 2024-05-08T18:31:23.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.494+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x556664eab150 2024-05-08T18:31:23.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.494+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bfc029070 con 0x556664eab150 2024-05-08T18:31:23.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.494+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x556664ea4ee0 2024-05-08T18:31:23.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.494+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.494+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x7f1bf402c060 2024-05-08T18:31:23.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.494+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.494+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x556664ea4ee0 2024-05-08T18:31:23.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.495+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.495+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x7f1bfc035020 2024-05-08T18:31:23.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.495+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1bf4029030 con 0x7f1bfc035020 2024-05-08T18:31:23.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.495+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x556664eab150 2024-05-08T18:31:23.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.495+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bfc061040 con 0x556664eab150 2024-05-08T18:31:23.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.495+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x556664eab150 2024-05-08T18:31:23.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.495+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bfc061040 con 0x556664eab150 2024-05-08T18:31:23.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.495+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x7f1bf402c060 2024-05-08T18:31:23.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.496+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.496+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x556664eab150 2024-05-08T18:31:23.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.496+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bfc061040 con 0x556664eab150 2024-05-08T18:31:23.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.496+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x556664eab150 2024-05-08T18:31:23.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.496+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bfc061040 con 0x556664eab150 2024-05-08T18:31:23.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.496+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x556664ea4ee0 2024-05-08T18:31:23.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.496+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.496+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x556664ea4ee0 2024-05-08T18:31:23.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.496+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.496+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x7f1bf402c060 2024-05-08T18:31:23.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.497+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.497+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x556664eab150 2024-05-08T18:31:23.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.497+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bfc061040 con 0x556664eab150 2024-05-08T18:31:23.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.497+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x7f1bfc035020 2024-05-08T18:31:23.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.497+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf4029030 con 0x7f1bfc035020 2024-05-08T18:31:23.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.497+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x556664ea4ee0 2024-05-08T18:31:23.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.497+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.497+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x7f1bf402c060 2024-05-08T18:31:23.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.498+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.498+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x556664eab150 2024-05-08T18:31:23.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.498+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bfc061040 con 0x556664eab150 2024-05-08T18:31:23.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.498+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x7f1bf402c060 2024-05-08T18:31:23.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.499+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.499+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x7f1bfc035020 2024-05-08T18:31:23.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.499+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf4029030 con 0x7f1bfc035020 2024-05-08T18:31:23.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.499+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x556664eab150 2024-05-08T18:31:23.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.499+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bfc061040 con 0x556664eab150 2024-05-08T18:31:23.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.499+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x7f1bf402c060 2024-05-08T18:31:23.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.499+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.499+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x556664ea4ee0 2024-05-08T18:31:23.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556664ea93e0 con 0x7f1bfc035020 2024-05-08T18:31:23.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf4029030 con 0x7f1bfc035020 2024-05-08T18:31:23.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1c04d1f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:23.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1c04d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:23.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1c04d1f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:23.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1c04d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:23.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1c04d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:23.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1c04d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:23.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664ea9c30 con 0x556664ea4ee0 2024-05-08T18:31:23.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1c04d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664eaa020 con 0x556664ea4ee0 2024-05-08T18:31:23.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1c04d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:23.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.500+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664eaa020 con 0x7f1bf402c060 2024-05-08T18:31:23.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.501+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.501+0000 7f1c04d1f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:23.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.501+0000 7f1c04d1f800 20 zone default found 2024-05-08T18:31:23.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.501+0000 7f1c04d1f800 4 Realm: () 2024-05-08T18:31:23.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.501+0000 7f1c04d1f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:23.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.501+0000 7f1c04d1f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:23.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.501+0000 7f1c04d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:23.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.501+0000 7f1c04d1f800 20 zonegroup default 2024-05-08T18:31:23.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.501+0000 7f1c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.501+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664eadff0 con 0x7f1bf402c060 2024-05-08T18:31:23.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.501+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.501+0000 7f1c04d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.501+0000 7f1c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.501+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664eaf9d0 con 0x556664eab150 2024-05-08T18:31:23.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.501+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1bfc061040 con 0x556664eab150 2024-05-08T18:31:23.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.502+0000 7f1c04d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.502+0000 7f1c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.502+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664eafd70 con 0x556664eab150 2024-05-08T18:31:23.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.502+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1bfc061040 con 0x556664eab150 2024-05-08T18:31:23.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.502+0000 7f1c04d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:23.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.502+0000 7f1c04d1f800 20 started sync module instance, tier type = 2024-05-08T18:31:23.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.502+0000 7f1c04d1f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:23.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.502+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eaee70 con 0x7f1bfc035020 2024-05-08T18:31:23.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.503+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf4029030 con 0x7f1bfc035020 2024-05-08T18:31:23.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.503+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93898268142016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb0110 con 0x7f1bfc035020 2024-05-08T18:31:23.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.503+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb09a0 con 0x556664ea4ee0 2024-05-08T18:31:23.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.504+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93898268142016] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf4029030 con 0x7f1bfc035020 2024-05-08T18:31:23.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.504+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.504+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93898268144272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb0dc0 con 0x556664ea4ee0 2024-05-08T18:31:23.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.504+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb1800 con 0x556664eab150 2024-05-08T18:31:23.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.505+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bfc061040 con 0x556664eab150 2024-05-08T18:31:23.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.505+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93898268152528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb20a0 con 0x556664eab150 2024-05-08T18:31:23.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.505+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb2b80 con 0x7f1bfc035020 2024-05-08T18:31:23.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.505+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93898268144272] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.506+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93898268152528] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bfc061040 con 0x556664eab150 2024-05-08T18:31:23.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.506+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf4029030 con 0x7f1bfc035020 2024-05-08T18:31:23.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.506+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93898268148912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb20a0 con 0x7f1bfc035020 2024-05-08T18:31:23.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.506+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb3590 con 0x556664ea4ee0 2024-05-08T18:31:23.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.507+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.507+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93898268148912] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf4029030 con 0x7f1bfc035020 2024-05-08T18:31:23.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.507+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93898268160224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb39b0 con 0x556664ea4ee0 2024-05-08T18:31:23.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.507+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb1c30 con 0x7f1bf402c060 2024-05-08T18:31:23.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.508+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.508+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93898268160224] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.508+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93898268163904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb1c30 con 0x7f1bf402c060 2024-05-08T18:31:23.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.508+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb3500 con 0x7f1bf402c060 2024-05-08T18:31:23.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.509+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93898268163904] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.509+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.509+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93898268161280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb4980 con 0x7f1bf402c060 2024-05-08T18:31:23.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.509+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb5340 con 0x7f1bf402c060 2024-05-08T18:31:23.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.510+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93898268161280] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.510+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.510+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93898268164960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb5340 con 0x7f1bf402c060 2024-05-08T18:31:23.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.510+0000 7f1c04d1f800 20 add_watcher() i=0 2024-05-08T18:31:23.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.510+0000 7f1c04d1f800 20 add_watcher() i=1 2024-05-08T18:31:23.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.510+0000 7f1c04d1f800 20 add_watcher() i=2 2024-05-08T18:31:23.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.510+0000 7f1c04d1f800 20 add_watcher() i=3 2024-05-08T18:31:23.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.510+0000 7f1c04d1f800 20 add_watcher() i=4 2024-05-08T18:31:23.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.510+0000 7f1c04d1f800 20 add_watcher() i=5 2024-05-08T18:31:23.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.510+0000 7f1c04d1f800 20 add_watcher() i=6 2024-05-08T18:31:23.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.511+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93898268164960] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.511+0000 7f1c04d1f800 20 add_watcher() i=7 2024-05-08T18:31:23.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.511+0000 7f1c04d1f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:23.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.511+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664eb8640 con 0x556664ea4ee0 2024-05-08T18:31:23.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.512+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.512+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93898268168192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb58d0 con 0x556664ea4ee0 2024-05-08T18:31:23.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.513+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93898268168192] v27'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.513+0000 7f1ab77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:23.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.513+0000 7f1c04d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:23.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.513+0000 7f1c04d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:23.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.513+0000 7f1c04d1f800 5 note: GC not initialized 2024-05-08T18:31:23.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.513+0000 7f1ab67e4640 20 reqs_thread_entry: start 2024-05-08T18:31:23.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.513+0000 7f1c04d1f800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:23.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.513+0000 7f1c04d1f800 20 Filter name: none 2024-05-08T18:31:23.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.513+0000 7f1aaffff640 20 reqs_thread_entry: start 2024-05-08T18:31:23.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.513+0000 7f1c04d1f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:23.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.513+0000 7f1c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.513+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664eebb00 con 0x556664ea4ee0 2024-05-08T18:31:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.514+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.514+0000 7f1c04d1f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.514+0000 7f1c04d1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.514+0000 7f1c04d1f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.514+0000 7f1c04d1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.514+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664eee430 con 0x7f1bfc035020 2024-05-08T18:31:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.514+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f1bf4029030 con 0x7f1bfc035020 2024-05-08T18:31:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.514+0000 7f1c04d1f800 20 enabling bucket name=myfoo 2024-05-08T18:31:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.514+0000 7f1c04d1f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:31:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.514+0000 7f1c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.514+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664eec410 con 0x7f1bfc035020 2024-05-08T18:31:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.515+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f1bf4029030 con 0x7f1bfc035020 2024-05-08T18:31:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.515+0000 7f1c04d1f800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:23.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.515+0000 7f1c04d1f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-05-08T18:31:23.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.515+0000 7f1c04d1f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:23.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.515+0000 7f1c04d1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 : miss 2024-05-08T18:31:23.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.515+0000 7f1c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:23.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.515+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:65 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664eeed90 con 0x556664eab150 2024-05-08T18:31:23.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.515+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(65 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1bfc061040 con 0x556664eab150 2024-05-08T18:31:23.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.515+0000 7f1c04d1f800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:23.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.515+0000 7f1c04d1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x17 2024-05-08T18:31:23.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.515+0000 7f1c04d1f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:23.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.515+0000 7f1c04d1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.515+0000 7f1c04d1f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.515+0000 7f1c04d1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 2024-05-08T18:31:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.515+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 8.b 8:d48378ab:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664ef65b0 con 0x556664eab150 2024-05-08T18:31:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.516+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(66 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v27'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f1bfc061040 con 0x556664eab150 2024-05-08T18:31:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.516+0000 7f1c04d1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x17 2024-05-08T18:31:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.516+0000 7f1c04d1f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.516+0000 7f1c04d1f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.516+0000 7f1c04d1f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1, ofs0, ns] 2024-05-08T18:31:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.516+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93898268403216 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664ef0b80 con 0x7f1bfc035020 2024-05-08T18:31:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.517+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== watch-notify(notify (1) cookie 93898268142016 notify 115964117018 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f1bf4058040 con 0x7f1bfc035020 2024-05-08T18:31:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.517+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(67 notify.0 [notify cookie 93898268403216 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1bf4029030 con 0x7f1bfc035020 2024-05-08T18:31:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.517+0000 7f1ad7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117018 cookie 93898268142016 notifier 4592 bl.length()=752 2024-05-08T18:31:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.517+0000 7f1ad7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 info.flags=0x17 2024-05-08T18:31:23.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.517+0000 7f1ad7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1 to cache LRU end 2024-05-08T18:31:23.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.517+0000 7f1ad7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:23.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.517+0000 7f1ad7fff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f1ac4003ea0 con 0x7f1bfc035020 2024-05-08T18:31:23.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.517+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== watch-notify(notify_complete (2) cookie 93898268403216 notify 115964117018 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556664e6c8c0 con 0x7f1bfc035020 2024-05-08T18:31:23.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.517+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf4029030 con 0x7f1bfc035020 2024-05-08T18:31:23.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.517+0000 7f1c04d1f800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): orig_sources= new_sources= 2024-05-08T18:31:23.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.517+0000 7f1c04d1f800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): potential sources added=[] removed=[] 2024-05-08T18:31:23.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.517+0000 7f1c04d1f800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): orig_dests= new_dests= 2024-05-08T18:31:23.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.517+0000 7f1c04d1f800 20 handle_bi_update(): bucket=:myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1]): potential dests added=[] removed=[] 2024-05-08T18:31:23.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.517+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eed5a0 con 0x556664ea4ee0 2024-05-08T18:31:23.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.518+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v27'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.518+0000 7f1c04d1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:23.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.518+0000 7f1c04d1f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:23.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.518+0000 7f1c04d1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:31:23.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.518+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 93898268400592 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556664eed5a0 con 0x556664ea4ee0 2024-05-08T18:31:23.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.519+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== watch-notify(notify (1) cookie 93898268160224 notify 115964117007 ret 0) ==== 609+0+0 (crc 0 0 0) 0x556664d786f0 con 0x556664ea4ee0 2024-05-08T18:31:23.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.519+0000 7f1ad7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117007 cookie 93898268160224 notifier 4592 bl.length()=567 2024-05-08T18:31:23.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.519+0000 7f1ad7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:23.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.519+0000 7f1ad7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:23.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.519+0000 7f1ad7fff640 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f1ac4003ea0 con 0x556664ea4ee0 2024-05-08T18:31:23.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.519+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(70 notify.4 [notify cookie 93898268400592 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.519+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== watch-notify(notify_complete (2) cookie 93898268400592 notify 115964117007 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1bec06a950 con 0x556664ea4ee0 2024-05-08T18:31:23.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.519+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.542 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:23.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.520+0000 7f1ab77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:23.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.520+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93898268168192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb77e0 con 0x556664ea4ee0 2024-05-08T18:31:23.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.521+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 93898268168192] v27'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.521+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93898268142016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb5000 con 0x7f1bfc035020 2024-05-08T18:31:23.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.522+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 93898268142016] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf4029030 con 0x7f1bfc035020 2024-05-08T18:31:23.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.522+0000 7f1c04d1f800 20 remove_watcher() i=0 2024-05-08T18:31:23.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.522+0000 7f1c04d1f800 2 removed watcher, disabling cache 2024-05-08T18:31:23.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.522+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93898268144272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb5000 con 0x556664ea4ee0 2024-05-08T18:31:23.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.523+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 93898268144272] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.523+0000 7f1c04d1f800 20 remove_watcher() i=1 2024-05-08T18:31:23.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.523+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93898268152528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb5000 con 0x556664eab150 2024-05-08T18:31:23.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.524+0000 7f1c011e1640 1 -- 172.21.15.87:0/3880660745 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 93898268152528] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bfc061040 con 0x556664eab150 2024-05-08T18:31:23.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.524+0000 7f1c04d1f800 20 remove_watcher() i=2 2024-05-08T18:31:23.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.524+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93898268148912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb5000 con 0x7f1bfc035020 2024-05-08T18:31:23.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.525+0000 7f1c009e0640 1 -- 172.21.15.87:0/3880660745 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 93898268148912] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf4029030 con 0x7f1bfc035020 2024-05-08T18:31:23.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.525+0000 7f1c04d1f800 20 remove_watcher() i=3 2024-05-08T18:31:23.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.525+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93898268160224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb04b0 con 0x556664ea4ee0 2024-05-08T18:31:23.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.526+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 93898268160224] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x556664ea4ee0 2024-05-08T18:31:23.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.526+0000 7f1c04d1f800 20 remove_watcher() i=4 2024-05-08T18:31:23.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.526+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93898268163904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb5000 con 0x7f1bf402c060 2024-05-08T18:31:23.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.527+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 93898268163904] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.527+0000 7f1c04d1f800 20 remove_watcher() i=5 2024-05-08T18:31:23.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.527+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93898268161280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb30e0 con 0x7f1bf402c060 2024-05-08T18:31:23.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.528+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 93898268161280] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.528+0000 7f1c04d1f800 20 remove_watcher() i=6 2024-05-08T18:31:23.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.528+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93898268164960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556664eb04b0 con 0x7f1bf402c060 2024-05-08T18:31:23.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 93898268164960] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec05a040 con 0x7f1bf402c060 2024-05-08T18:31:23.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 20 remove_watcher() i=7 2024-05-08T18:31:23.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f1bf402c060 msgr2=0x7f1bf402b580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f1bf402c060 0x7f1bf402b580 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556664ea4ee0 msgr2=0x556664ea73a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556664ea4ee0 0x556664ea73a0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f1bfc035020 msgr2=0x7f1bfc004600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f1bfc035020 0x7f1bfc004600 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556664eab150 msgr2=0x556664ead540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556664eab150 0x556664ead540 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1acc03bb50 msgr2=0x7f1acc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1acc03bb50 0x7f1acc03e010 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4050f80 tx=0x7f1bf4032000 comp rx=0 tx=0).stop 2024-05-08T18:31:23.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1bfbfff640 1 -- 172.21.15.87:0/3880660745 reap_dead start 2024-05-08T18:31:23.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e91d40 msgr2=0x556664e99260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e91d40 0x556664e99260 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc001ea0 tx=0x7f1bfc052900 comp rx=0 tx=0).stop 2024-05-08T18:31:23.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 shutdown_connections 2024-05-08T18:31:23.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/3880660745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e91d40 0x556664e99260 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 >> 172.21.15.87:0/3880660745 conn(0x556664e8dfc0 msgr2=0x556664e8b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 shutdown_connections 2024-05-08T18:31:23.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 -- 172.21.15.87:0/3880660745 wait complete. 2024-05-08T18:31:23.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1014308247 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1ad803bb50 msgr2=0x7f1ad803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/1014308247 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1ad803bb50 0x7f1ad803e010 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4001520 tx=0x7f1bf4050e50 comp rx=0 tx=0).stop 2024-05-08T18:31:23.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1014308247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e84940 msgr2=0x556664e84d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/1014308247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e84940 0x556664e84d60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x556664e6a840 tx=0x7f1bfc0178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1014308247 shutdown_connections 2024-05-08T18:31:23.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/1014308247 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1ad803bb50 0x7f1ad803e010 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/1014308247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664e84940 0x556664e84d60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.529+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1014308247 >> 172.21.15.87:0/1014308247 conn(0x556664e789e0 msgr2=0x556664e78de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1014308247 shutdown_connections 2024-05-08T18:31:23.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1014308247 wait complete. 2024-05-08T18:31:23.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1055865852 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556664e73dd0 msgr2=0x556664e761c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556664e73dd0 0x556664e761c0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1055865852 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556664d6e6a0 msgr2=0x556664e70680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556664d6e6a0 0x556664e70680 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1055865852 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1ae803bb50 msgr2=0x7f1ae803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1ae803bb50 0x7f1ae803e010 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1bec054000 tx=0x7f1bec04e000 comp rx=0 tx=0).stop 2024-05-08T18:31:23.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1055865852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6cb60 msgr2=0x556664e69490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:23.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6cb60 0x556664e69490 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x556664e62680 tx=0x7f1bf4000bc0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1055865852 shutdown_connections 2024-05-08T18:31:23.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556664d6e6a0 0x556664e70680 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556664e73dd0 0x556664e761c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1ae803bb50 0x7f1ae803e010 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 --2- 172.21.15.87:0/1055865852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556664d6cb60 0x556664e69490 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:23.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1055865852 >> 172.21.15.87:0/1055865852 conn(0x556664d686a0 msgr2=0x556664e5ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:23.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1055865852 shutdown_connections 2024-05-08T18:31:23.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:23.530+0000 7f1c04d1f800 1 -- 172.21.15.87:0/1055865852 wait complete. 2024-05-08T18:31:23.554 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:23.561 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-08T18:31:23.836 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-05-08T18:31:23.842 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:38.843 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-05-08T18:31:38.843 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-05-08T18:31:38.843 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-05-08T18:31:38.894 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:38.894 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:38.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.896+0000 7f05b5a30800 1 Processor -- start 2024-05-08T18:31:38.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.896+0000 7f05b5a30800 1 -- start start 2024-05-08T18:31:38.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.896+0000 7f05b5a30800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5569147dd140 0x5569147dd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:38.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.896+0000 7f05b5a30800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5569147ddbe0 con 0x5569147de3a0 2024-05-08T18:31:38.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.896+0000 7f05b5a30800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55691467ee20 con 0x5569147dd140 2024-05-08T18:31:38.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.897+0000 7f05b0c84640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5569147dd140 0x5569147dd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:38.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.897+0000 7f05a8483640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5569147de3a0 0x5569147de820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:51542/0 (socket says 172.21.15.87:51542) 2024-05-08T18:31:38.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.897+0000 7f05a8483640 1 -- 172.21.15.87:0/2007288355 learned_addr learned my addr 172.21.15.87:0/2007288355 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:38.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.897+0000 7f05b0c84640 1 -- 172.21.15.87:0/2007288355 >> v1:172.21.15.53:6789/0 conn(0x5569147de3a0 legacy=0x5569147de820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:38.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.897+0000 7f05b0c84640 1 -- 172.21.15.87:0/2007288355 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569147def60 con 0x5569147dd140 2024-05-08T18:31:38.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.899+0000 7f05b0c84640 1 --2- 172.21.15.87:0/2007288355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 0x5569147dd560 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f05a000a470 tx=0x7f05a001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f042be17bd15 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:38.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.900+0000 7f05abfff640 1 -- 172.21.15.87:0/2007288355 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a0057070 con 0x5569147dd140 2024-05-08T18:31:38.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.900+0000 7f05abfff640 1 -- 172.21.15.87:0/2007288355 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a004adc0 con 0x5569147dd140 2024-05-08T18:31:38.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.900+0000 7f05abfff640 1 -- 172.21.15.87:0/2007288355 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a0052590 con 0x5569147dd140 2024-05-08T18:31:38.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.900+0000 7f05b5a30800 1 -- 172.21.15.87:0/2007288355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 msgr2=0x5569147dd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:38.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.900+0000 7f05b5a30800 1 --2- 172.21.15.87:0/2007288355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 0x5569147dd560 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f05a000a470 tx=0x7f05a001ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:38.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.900+0000 7f05b5a30800 1 -- 172.21.15.87:0/2007288355 shutdown_connections 2024-05-08T18:31:38.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.900+0000 7f05b5a30800 1 --2- 172.21.15.87:0/2007288355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 0x5569147dd560 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:38.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.900+0000 7f05b5a30800 1 -- 172.21.15.87:0/2007288355 >> 172.21.15.87:0/2007288355 conn(0x5569147d8720 msgr2=0x5569147dab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:38.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.900+0000 7f05b5a30800 1 -- 172.21.15.87:0/2007288355 shutdown_connections 2024-05-08T18:31:38.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.900+0000 7f05b5a30800 1 -- 172.21.15.87:0/2007288355 wait complete. 2024-05-08T18:31:38.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.916+0000 7f05b5a30800 1 Processor -- start 2024-05-08T18:31:38.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.916+0000 7f05b5a30800 1 -- start start 2024-05-08T18:31:38.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.916+0000 7f05b5a30800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 0x5569148cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:38.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.916+0000 7f05b5a30800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5569147295b0 con 0x5569147dd140 2024-05-08T18:31:38.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.916+0000 7f05b0c84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 0x5569148cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:38.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.916+0000 7f05b0c84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 0x5569148cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58852/0 (socket says 172.21.15.87:58852) 2024-05-08T18:31:38.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.916+0000 7f05b0c84640 1 -- 172.21.15.87:0/1373613715 learned_addr learned my addr 172.21.15.87:0/1373613715 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:38.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.917+0000 7f05b0c84640 1 -- 172.21.15.87:0/1373613715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569148cdb40 con 0x5569147dd140 2024-05-08T18:31:38.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.917+0000 7f05b0c84640 1 --2- 172.21.15.87:0/1373613715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 0x5569148cd570 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f05a0055040 tx=0x7f05a004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8d805b4998697d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:38.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.917+0000 7f049ee0d640 1 -- 172.21.15.87:0/1373613715 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a0057040 con 0x5569147dd140 2024-05-08T18:31:38.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.917+0000 7f049ee0d640 1 -- 172.21.15.87:0/1373613715 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a0063070 con 0x5569147dd140 2024-05-08T18:31:38.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.917+0000 7f049ee0d640 1 -- 172.21.15.87:0/1373613715 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a005d790 con 0x5569147dd140 2024-05-08T18:31:38.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.918+0000 7f05b5a30800 1 -- 172.21.15.87:0/1373613715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 msgr2=0x5569148cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:38.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.918+0000 7f05b5a30800 1 --2- 172.21.15.87:0/1373613715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 0x5569148cd570 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f05a0055040 tx=0x7f05a004c000 comp rx=0 tx=0).stop 2024-05-08T18:31:38.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.918+0000 7f05b5a30800 1 -- 172.21.15.87:0/1373613715 shutdown_connections 2024-05-08T18:31:38.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.918+0000 7f05b5a30800 1 --2- 172.21.15.87:0/1373613715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 0x5569148cd570 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:38.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.918+0000 7f05b5a30800 1 -- 172.21.15.87:0/1373613715 >> 172.21.15.87:0/1373613715 conn(0x5569147d8720 msgr2=0x5569148c8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:38.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.918+0000 7f05b5a30800 1 -- 172.21.15.87:0/1373613715 shutdown_connections 2024-05-08T18:31:38.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.918+0000 7f05b5a30800 1 -- 172.21.15.87:0/1373613715 wait complete. 2024-05-08T18:31:38.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.918+0000 7f05b5a30800 1 Processor -- start 2024-05-08T18:31:38.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.919+0000 7f05b5a30800 1 -- start start 2024-05-08T18:31:38.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.919+0000 7f05b5a30800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 0x5569148d9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:38.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.919+0000 7f05b5a30800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5569147507b0 con 0x5569147dd140 2024-05-08T18:31:38.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.919+0000 7f05b0c84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 0x5569148d9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:38.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.919+0000 7f05b0c84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 0x5569148d9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58864/0 (socket says 172.21.15.87:58864) 2024-05-08T18:31:38.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.919+0000 7f05b0c84640 1 -- 172.21.15.87:0/1870935767 learned_addr learned my addr 172.21.15.87:0/1870935767 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:38.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.919+0000 7f05b0c84640 1 -- 172.21.15.87:0/1870935767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569148d9980 con 0x5569147dd140 2024-05-08T18:31:38.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.920+0000 7f05b0c84640 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 0x5569148d9440 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f05a000a470 tx=0x7f05a0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:38.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.920+0000 7f049d60a640 1 -- 172.21.15.87:0/1870935767 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a0057050 con 0x5569147dd140 2024-05-08T18:31:38.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.920+0000 7f049d60a640 1 -- 172.21.15.87:0/1870935767 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a005dd40 con 0x5569147dd140 2024-05-08T18:31:38.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.920+0000 7f049d60a640 1 -- 172.21.15.87:0/1870935767 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a0052570 con 0x5569147dd140 2024-05-08T18:31:38.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.920+0000 7f05b5a30800 1 -- 172.21.15.87:0/1870935767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5569148d9c10 con 0x5569147dd140 2024-05-08T18:31:38.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.920+0000 7f05b5a30800 1 -- 172.21.15.87:0/1870935767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569148dc820 con 0x5569147dd140 2024-05-08T18:31:38.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.921+0000 7f049d60a640 1 -- 172.21.15.87:0/1870935767 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f05a0052820 con 0x5569147dd140 2024-05-08T18:31:38.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.921+0000 7f049d60a640 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f049803bae0 0x7f049803dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:38.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.921+0000 7f049d60a640 1 -- 172.21.15.87:0/1870935767 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f05a0094050 con 0x5569147dd140 2024-05-08T18:31:38.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.921+0000 7f05a8483640 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f049803bae0 0x7f049803dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:38.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.922+0000 7f05b5a30800 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5569147de3a0 0x5569148e05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:38.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.922+0000 7f05b5a30800 1 -- 172.21.15.87:0/1870935767 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5569148e0b20 con 0x5569147de3a0 2024-05-08T18:31:38.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.922+0000 7f05b1485640 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5569147de3a0 0x5569148e05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:38.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.922+0000 7f05a8483640 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f049803bae0 0x7f049803dfa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0598000f60 tx=0x7f05980012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:38.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.922+0000 7f05b1485640 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5569147de3a0 0x5569148e05e0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:38.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.922+0000 7f05b1485640 1 -- 172.21.15.87:0/1870935767 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05ac00a4a0 con 0x5569147de3a0 2024-05-08T18:31:38.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.922+0000 7f05b5a30800 1 -- 172.21.15.87:0/1870935767 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5569148ddbb0 con 0x5569147de3a0 2024-05-08T18:31:38.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.923+0000 7f05b1485640 1 -- 172.21.15.87:0/1870935767 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05ac00a4a0 con 0x5569147de3a0 2024-05-08T18:31:38.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.923+0000 7f05b5a30800 1 -- 172.21.15.87:0/1870935767 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5569148e2990 con 0x5569147de3a0 2024-05-08T18:31:38.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.923+0000 7f05b1485640 1 -- 172.21.15.87:0/1870935767 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f05ac00a4a0 con 0x5569147de3a0 2024-05-08T18:31:38.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.923+0000 7f05b5a30800 1 -- 172.21.15.87:0/1870935767 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5569148e1ad0 con 0x5569147de3a0 2024-05-08T18:31:38.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.923+0000 7f05b1485640 1 -- 172.21.15.87:0/1870935767 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05ac00a4a0 con 0x5569147de3a0 2024-05-08T18:31:38.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.923+0000 7f05b5a30800 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5569148e25a0 0x5569148e5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:38.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.923+0000 7f05b5a30800 1 -- 172.21.15.87:0/1870935767 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5569148e6570 con 0x5569148e25a0 2024-05-08T18:31:38.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.924+0000 7f05b0c84640 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5569148e25a0 0x5569148e5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:38.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.924+0000 7f05b0c84640 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5569148e25a0 0x5569148e5de0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:38.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.925+0000 7f05b0c84640 1 -- 172.21.15.87:0/1870935767 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f05a0078070 con 0x5569148e25a0 2024-05-08T18:31:38.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.925+0000 7f05b5a30800 1 Processor -- start 2024-05-08T18:31:38.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.925+0000 7f05b5a30800 1 -- start start 2024-05-08T18:31:38.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.925+0000 7f05b5a30800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569148f4880 0x5569148f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:38.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.925+0000 7f05b5a30800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5569146cffc0 con 0x5569148f4880 2024-05-08T18:31:38.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.925+0000 7f05b1485640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569148f4880 0x5569148f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:38.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.925+0000 7f05b1485640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569148f4880 0x5569148f4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58872/0 (socket says 172.21.15.87:58872) 2024-05-08T18:31:38.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.925+0000 7f05b1485640 1 -- 172.21.15.87:0/3262104911 learned_addr learned my addr 172.21.15.87:0/3262104911 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:38.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.926+0000 7f05b1485640 1 -- 172.21.15.87:0/3262104911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569148f51e0 con 0x5569148f4880 2024-05-08T18:31:38.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.926+0000 7f05b1485640 1 --2- 172.21.15.87:0/3262104911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569148f4880 0x5569148f4ca0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x5569148e0f00 tx=0x7f05ac0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:38.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.926+0000 7f04967fc640 1 -- 172.21.15.87:0/3262104911 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ac013440 con 0x5569148f4880 2024-05-08T18:31:38.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.926+0000 7f04967fc640 1 -- 172.21.15.87:0/3262104911 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ac0135e0 con 0x5569148f4880 2024-05-08T18:31:38.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.926+0000 7f05b5a30800 1 -- 172.21.15.87:0/3262104911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5569148f5c50 con 0x5569148f4880 2024-05-08T18:31:38.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.926+0000 7f04967fc640 1 -- 172.21.15.87:0/3262104911 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ac0138c0 con 0x5569148f4880 2024-05-08T18:31:38.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.926+0000 7f05b5a30800 1 -- 172.21.15.87:0/3262104911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569148f6150 con 0x5569148f4880 2024-05-08T18:31:38.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.927+0000 7f04967fc640 1 -- 172.21.15.87:0/3262104911 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f05ac011040 con 0x5569148f4880 2024-05-08T18:31:38.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.927+0000 7f04967fc640 1 --2- 172.21.15.87:0/3262104911 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f048803bb50 0x7f048803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:38.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.927+0000 7f04967fc640 1 -- 172.21.15.87:0/3262104911 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f05ac01d070 con 0x5569148f4880 2024-05-08T18:31:38.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.927+0000 7f05b0c84640 1 --2- 172.21.15.87:0/3262104911 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f048803bb50 0x7f048803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:38.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.928+0000 7f05b5a30800 1 Processor -- start 2024-05-08T18:31:38.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.928+0000 7f05b5a30800 1 -- start start 2024-05-08T18:31:38.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.928+0000 7f05b0c84640 1 --2- 172.21.15.87:0/3262104911 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f048803bb50 0x7f048803e010 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f05a005d040 tx=0x7f05a005df70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:38.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.928+0000 7f05b5a30800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556914901c10 0x556914902030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:38.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.928+0000 7f05b5a30800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5569148cde00 con 0x556914901c10 2024-05-08T18:31:38.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.928+0000 7f05b1485640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556914901c10 0x556914902030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:38.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.928+0000 7f05b1485640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556914901c10 0x556914902030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58886/0 (socket says 172.21.15.87:58886) 2024-05-08T18:31:38.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.928+0000 7f05b1485640 1 -- 172.21.15.87:0/1667571010 learned_addr learned my addr 172.21.15.87:0/1667571010 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:38.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.929+0000 7f05b1485640 1 -- 172.21.15.87:0/1667571010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556914902600 con 0x556914901c10 2024-05-08T18:31:38.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.929+0000 7f05b1485640 1 --2- 172.21.15.87:0/1667571010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556914901c10 0x556914902030 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0529b0 tx=0x7f05ac021de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247f595e378b97e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:38.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.929+0000 7f0487fff640 1 -- 172.21.15.87:0/1667571010 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ac015560 con 0x556914901c10 2024-05-08T18:31:38.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.929+0000 7f0487fff640 1 -- 172.21.15.87:0/1667571010 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ac001310 con 0x556914901c10 2024-05-08T18:31:38.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.929+0000 7f0487fff640 1 -- 172.21.15.87:0/1667571010 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ac015950 con 0x556914901c10 2024-05-08T18:31:38.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.929+0000 7f05b5a30800 1 -- 172.21.15.87:0/1667571010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556914901c10 msgr2=0x556914902030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:38.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.929+0000 7f05b5a30800 1 --2- 172.21.15.87:0/1667571010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556914901c10 0x556914902030 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0529b0 tx=0x7f05ac021de0 comp rx=0 tx=0).stop 2024-05-08T18:31:38.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.929+0000 7f05b5a30800 1 -- 172.21.15.87:0/1667571010 shutdown_connections 2024-05-08T18:31:38.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.929+0000 7f05b5a30800 1 --2- 172.21.15.87:0/1667571010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556914901c10 0x556914902030 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:38.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.929+0000 7f05b5a30800 1 -- 172.21.15.87:0/1667571010 >> 172.21.15.87:0/1667571010 conn(0x5569148fdee0 msgr2=0x5569148fbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:38.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.930+0000 7f05b5a30800 1 -- 172.21.15.87:0/1667571010 shutdown_connections 2024-05-08T18:31:38.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.930+0000 7f05b5a30800 1 -- 172.21.15.87:0/1667571010 wait complete. 2024-05-08T18:31:38.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.930+0000 7f05b5a30800 1 Processor -- start 2024-05-08T18:31:38.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.930+0000 7f05b5a30800 1 -- start start 2024-05-08T18:31:38.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.930+0000 7f05b5a30800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556914901c10 0x556914909110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:38.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.930+0000 7f05b5a30800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556914902d90 con 0x556914901c10 2024-05-08T18:31:38.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.930+0000 7f05b1485640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556914901c10 0x556914909110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:38.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.930+0000 7f05b1485640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556914901c10 0x556914909110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58896/0 (socket says 172.21.15.87:58896) 2024-05-08T18:31:38.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.930+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 learned_addr learned my addr 172.21.15.87:0/3684378573 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:38.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.931+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556914909650 con 0x556914901c10 2024-05-08T18:31:38.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.931+0000 7f05b1485640 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556914901c10 0x556914909110 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f05ac021e20 tx=0x7f05ac052940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:38.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.931+0000 7f04867fc640 1 -- 172.21.15.87:0/3684378573 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ac013a60 con 0x556914901c10 2024-05-08T18:31:38.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.931+0000 7f04867fc640 1 -- 172.21.15.87:0/3684378573 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ac031070 con 0x556914901c10 2024-05-08T18:31:38.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.931+0000 7f04867fc640 1 -- 172.21.15.87:0/3684378573 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ac013dd0 con 0x556914901c10 2024-05-08T18:31:38.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.931+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5569149098e0 con 0x556914901c10 2024-05-08T18:31:38.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.931+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55691490c590 con 0x556914901c10 2024-05-08T18:31:38.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.932+0000 7f04867fc640 1 -- 172.21.15.87:0/3684378573 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f05ac051200 con 0x556914901c10 2024-05-08T18:31:38.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.932+0000 7f04867fc640 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f047c03bb00 0x7f047c03dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:38.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.932+0000 7f04867fc640 1 -- 172.21.15.87:0/3684378573 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f05ac00e040 con 0x556914901c10 2024-05-08T18:31:38.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.932+0000 7f05b0c84640 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f047c03bb00 0x7f047c03dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:38.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.932+0000 7f05b5a30800 20 rados->read ofs=0 len=0 2024-05-08T18:31:38.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.932+0000 7f05b5a30800 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556914914da0 0x556914917260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:38.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.932+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5569149179b0 con 0x556914914da0 2024-05-08T18:31:38.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.933+0000 7f05a8483640 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556914914da0 0x556914917260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:38.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.933+0000 7f05b0c84640 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f047c03bb00 0x7f047c03dfc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5569148e6970 tx=0x7f05a0084000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:38.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.933+0000 7f05a8483640 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556914914da0 0x556914917260 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:38.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.933+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0598009050 con 0x556914914da0 2024-05-08T18:31:38.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.933+0000 7f05b5a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:38.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.933+0000 7f05b5a30800 20 realm 2024-05-08T18:31:38.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.933+0000 7f05b5a30800 20 rados->read ofs=0 len=0 2024-05-08T18:31:38.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.933+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5569149141f0 con 0x556914914da0 2024-05-08T18:31:38.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.933+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0598009050 con 0x556914914da0 2024-05-08T18:31:38.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.933+0000 7f05b5a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:38.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.933+0000 7f05b5a30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:38.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.933+0000 7f05b5a30800 20 rados->read ofs=0 len=0 2024-05-08T18:31:38.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.933+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556914918490 con 0x556914914da0 2024-05-08T18:31:38.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.934+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0598009050 con 0x556914914da0 2024-05-08T18:31:38.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.934+0000 7f05b5a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:38.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.934+0000 7f05b5a30800 20 rados->read ofs=0 len=0 2024-05-08T18:31:38.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.934+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556914918d60 con 0x556914914da0 2024-05-08T18:31:38.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.934+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0598009050 con 0x556914914da0 2024-05-08T18:31:38.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.934+0000 7f05b5a30800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:38.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.934+0000 7f05b5a30800 20 rados->read ofs=0 len=0 2024-05-08T18:31:38.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.934+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556914919100 con 0x556914914da0 2024-05-08T18:31:38.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.934+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0598009050 con 0x556914914da0 2024-05-08T18:31:38.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.934+0000 7f05b5a30800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:38.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.934+0000 7f05b5a30800 20 searching for the correct realm 2024-05-08T18:31:38.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.934+0000 7f05b5a30800 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55691491afe0 0x55691491d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:38.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.934+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x55691491afe0 2024-05-08T18:31:38.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.934+0000 7f05b1485640 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55691491afe0 0x55691491d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:38.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.935+0000 7f05b1485640 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55691491afe0 0x55691491d3d0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:38.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.935+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.935+0000 7f05b1485640 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f05ac01f9e0 0x7f05ac040990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:38.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.935+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x7f05ac01f9e0 2024-05-08T18:31:38.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.935+0000 7f05b0c84640 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f05ac01f9e0 0x7f05ac040990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:38.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.936+0000 7f05b0c84640 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f05ac01f9e0 0x7f05ac040990 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:38.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.936+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:38.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.936+0000 7f05b0c84640 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f05a00a1040 0x7f05a005baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:38.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.936+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x7f05a00a1040 2024-05-08T18:31:38.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.936+0000 7f05a8483640 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f05a00a1040 0x7f05a005baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:38.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.937+0000 7f05a8483640 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f05a00a1040 0x7f05a005baa0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:38.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.937+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0598009050 con 0x7f05a00a1040 2024-05-08T18:31:38.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.937+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x556914914da0 2024-05-08T18:31:38.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.937+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0598009050 con 0x556914914da0 2024-05-08T18:31:38.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.937+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x556914914da0 2024-05-08T18:31:38.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.938+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.938+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x7f05a00a1040 2024-05-08T18:31:38.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.938+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.938+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x7f05a00a1040 2024-05-08T18:31:38.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.938+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.938+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x7f05ac01f9e0 2024-05-08T18:31:38.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.939+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:38.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.939+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x55691491afe0 2024-05-08T18:31:38.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.939+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.939+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x556914914da0 2024-05-08T18:31:38.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.939+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.939+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x7f05a00a1040 2024-05-08T18:31:38.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.939+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.939+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x556914914da0 2024-05-08T18:31:38.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.940+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.940+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x7f05ac01f9e0 2024-05-08T18:31:38.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.940+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:38.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.940+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x55691491afe0 2024-05-08T18:31:38.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.940+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.940+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x55691491afe0 2024-05-08T18:31:38.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.940+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.940+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x7f05a00a1040 2024-05-08T18:31:38.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.941+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.941+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x55691491afe0 2024-05-08T18:31:38.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.941+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.941+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x55691491afe0 2024-05-08T18:31:38.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.941+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.941+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x556914914da0 2024-05-08T18:31:38.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.942+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.942+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x556914914da0 2024-05-08T18:31:38.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.942+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.942+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x7f05a00a1040 2024-05-08T18:31:38.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.942+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.942+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x55691491afe0 2024-05-08T18:31:38.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.943+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.943+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x7f05ac01f9e0 2024-05-08T18:31:38.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.943+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:38.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.943+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x556914914da0 2024-05-08T18:31:38.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.943+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.943+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x7f05a00a1040 2024-05-08T18:31:38.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.944+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.944+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x55691491afe0 2024-05-08T18:31:38.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.944+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.944+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x7f05a00a1040 2024-05-08T18:31:38.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.944+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.944+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x7f05ac01f9e0 2024-05-08T18:31:38.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.945+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:38.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.945+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x55691491afe0 2024-05-08T18:31:38.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.945+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.945+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x7f05a00a1040 2024-05-08T18:31:38.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.945+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.945+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x556914914da0 2024-05-08T18:31:38.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55691491da80 con 0x7f05ac01f9e0 2024-05-08T18:31:38.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:38.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05b5a30800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:38.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05b5a30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:38.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05b5a30800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:38.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05b5a30800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:38.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05b5a30800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:38.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05b5a30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:38.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05b5a30800 20 rados->read ofs=0 len=0 2024-05-08T18:31:38.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556914919ab0 con 0x556914914da0 2024-05-08T18:31:38.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05b5a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:38.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05b5a30800 20 rados->read ofs=0 len=0 2024-05-08T18:31:38.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691491a350 con 0x556914914da0 2024-05-08T18:31:38.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05b5a30800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:38.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05b5a30800 20 rados->read ofs=0 len=0 2024-05-08T18:31:38.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.946+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5569149196f0 con 0x7f05a00a1040 2024-05-08T18:31:38.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.947+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.947+0000 7f05b5a30800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:38.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.947+0000 7f05b5a30800 20 zone default found 2024-05-08T18:31:38.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.947+0000 7f05b5a30800 4 Realm: () 2024-05-08T18:31:38.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.947+0000 7f05b5a30800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:38.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.947+0000 7f05b5a30800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:38.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.947+0000 7f05b5a30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:38.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.947+0000 7f05b5a30800 20 zonegroup default 2024-05-08T18:31:38.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.947+0000 7f05b5a30800 20 rados->read ofs=0 len=0 2024-05-08T18:31:38.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.947+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691491dee0 con 0x7f05a00a1040 2024-05-08T18:31:38.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.947+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.947+0000 7f05b5a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:38.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.947+0000 7f05b5a30800 20 rados->read ofs=0 len=0 2024-05-08T18:31:38.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.947+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691491fd70 con 0x55691491afe0 2024-05-08T18:31:38.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.947+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.948+0000 7f05b5a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:38.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.948+0000 7f05b5a30800 20 rados->read ofs=0 len=0 2024-05-08T18:31:38.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.948+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556914920110 con 0x55691491afe0 2024-05-08T18:31:38.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.948+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.948+0000 7f05b5a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:38.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.948+0000 7f05b5a30800 20 started sync module instance, tier type = 2024-05-08T18:31:38.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.948+0000 7f05b5a30800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:38.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.948+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55691491f1b0 con 0x7f05ac01f9e0 2024-05-08T18:31:38.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.949+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:38.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.949+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93909805036960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55691491f9c0 con 0x7f05ac01f9e0 2024-05-08T18:31:38.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.949+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914920f80 con 0x556914914da0 2024-05-08T18:31:38.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.950+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93909805036960] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:38.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.950+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.950+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93909805042384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5569149213a0 con 0x556914914da0 2024-05-08T18:31:38.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.950+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914921d60 con 0x55691491afe0 2024-05-08T18:31:38.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.952+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.952+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93909805042384] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.952+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93909805043440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914921310 con 0x55691491afe0 2024-05-08T18:31:38.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.952+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914922c20 con 0x7f05ac01f9e0 2024-05-08T18:31:38.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.953+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:38.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.953+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93909805049712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914923470 con 0x7f05ac01f9e0 2024-05-08T18:31:38.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.953+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914923f40 con 0x556914914da0 2024-05-08T18:31:38.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.953+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93909805043440] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.954+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93909805049712] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:38.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.954+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.954+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93909805051840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914922150 con 0x556914914da0 2024-05-08T18:31:38.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.954+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914924820 con 0x7f05a00a1040 2024-05-08T18:31:38.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.955+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93909805051840] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.955+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.955+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93909805054512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914924790 con 0x7f05a00a1040 2024-05-08T18:31:38.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.955+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914925230 con 0x7f05a00a1040 2024-05-08T18:31:38.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.956+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93909805054512] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.957+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.957+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93909805056736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914925410 con 0x7f05a00a1040 2024-05-08T18:31:38.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.957+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914925c60 con 0x7f05a00a1040 2024-05-08T18:31:38.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.958+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93909805056736] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.958+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.958+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93909805060416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914925a70 con 0x7f05a00a1040 2024-05-08T18:31:38.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.958+0000 7f05b5a30800 20 add_watcher() i=0 2024-05-08T18:31:38.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.958+0000 7f05b5a30800 20 add_watcher() i=1 2024-05-08T18:31:38.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.958+0000 7f05b5a30800 20 add_watcher() i=2 2024-05-08T18:31:38.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.958+0000 7f05b5a30800 20 add_watcher() i=3 2024-05-08T18:31:38.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.958+0000 7f05b5a30800 20 add_watcher() i=4 2024-05-08T18:31:38.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.958+0000 7f05b5a30800 20 add_watcher() i=5 2024-05-08T18:31:38.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.958+0000 7f05b5a30800 20 add_watcher() i=6 2024-05-08T18:31:38.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.959+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93909805060416] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.959+0000 7f05b5a30800 20 add_watcher() i=7 2024-05-08T18:31:38.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.959+0000 7f05b5a30800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:38.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.959+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556914928fb0 con 0x556914914da0 2024-05-08T18:31:38.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.959+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.959+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93909805061472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914926470 con 0x556914914da0 2024-05-08T18:31:38.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.960+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93909805061472] v27'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.960+0000 7f0466fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:38.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.961+0000 7f05b5a30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:38.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.961+0000 7f05b5a30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:38.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.961+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914931690 con 0x556914914da0 2024-05-08T18:31:38.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.962+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.962+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914931c00 con 0x7f05a00a1040 2024-05-08T18:31:38.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.963+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.963+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914932170 con 0x55691491afe0 2024-05-08T18:31:38.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.964+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.964+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914932170 con 0x556914914da0 2024-05-08T18:31:38.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.965+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'153 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.965+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5569149325b0 con 0x7f05ac01f9e0 2024-05-08T18:31:38.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.966+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'44 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:38.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.966+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914932e00 con 0x55691491afe0 2024-05-08T18:31:38.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.967+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'30 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.967+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914932e00 con 0x556914914da0 2024-05-08T18:31:38.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.968+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.968+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914932e00 con 0x7f05a00a1040 2024-05-08T18:31:38.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.969+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.970+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914932e00 con 0x7f05ac01f9e0 2024-05-08T18:31:38.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.971+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:38.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.971+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914932e00 con 0x55691491afe0 2024-05-08T18:31:38.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.972+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.972+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914932e90 con 0x7f05ac01f9e0 2024-05-08T18:31:38.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.972+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'45 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:38.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.972+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x7f05a00a1040 2024-05-08T18:31:38.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.974+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.974+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x7f05ac01f9e0 2024-05-08T18:31:38.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.975+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:38.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.975+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x7f05a00a1040 2024-05-08T18:31:38.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.976+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'35 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.976+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x556914914da0 2024-05-08T18:31:38.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.977+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'154 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.977+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x55691491afe0 2024-05-08T18:31:38.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.979+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'38 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.979+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x7f05ac01f9e0 2024-05-08T18:31:38.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.980+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:38.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.980+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x55691491afe0 2024-05-08T18:31:38.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.981+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.981+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x556914914da0 2024-05-08T18:31:38.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.982+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.982+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x556914914da0 2024-05-08T18:31:38.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.983+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'155 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.983+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x55691491afe0 2024-05-08T18:31:38.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.984+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'39 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.984+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x7f05ac01f9e0 2024-05-08T18:31:38.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.985+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'28 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:38.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.985+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x55691491afe0 2024-05-08T18:31:38.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.986+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.986+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x55691491afe0 2024-05-08T18:31:38.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.987+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.987+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x55691491afe0 2024-05-08T18:31:38.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.988+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'15 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.988+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x55691491afe0 2024-05-08T18:31:38.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.989+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.989+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x7f05a00a1040 2024-05-08T18:31:38.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.990+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.990+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x55691491afe0 2024-05-08T18:31:38.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.991+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.991+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x7f05a00a1040 2024-05-08T18:31:38.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.993+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.993+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x55691491afe0 2024-05-08T18:31:38.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.994+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'40 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:38.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.994+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x7f05a00a1040 2024-05-08T18:31:38.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.995+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'36 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.995+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914933440 con 0x7f05ac01f9e0 2024-05-08T18:31:38.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.996+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:38.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.996+0000 7f0465fe3640 20 reqs_thread_entry: start 2024-05-08T18:31:38.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.996+0000 7f05b5a30800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:38.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.997+0000 7f05b5a30800 20 Filter name: none 2024-05-08T18:31:38.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.997+0000 7f03d77fe640 20 reqs_thread_entry: start 2024-05-08T18:31:38.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.997+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:38.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.997+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.997+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:38.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.997+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.997+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:38.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.998+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:38.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.998+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05a00a1040 2024-05-08T18:31:38.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.998+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.998+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05a00a1040 2024-05-08T18:31:38.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.998+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:38.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.998+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05a00a1040 2024-05-08T18:31:39.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.999+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.999+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.999+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.999+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.999+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:38.999+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.000+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.000+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:39.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.000+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.000+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:39.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.000+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv13 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.000+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:39.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.000+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.000+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.001+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.001+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.001+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.001+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.001+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.001+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.001+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.001+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.002+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.002+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.002+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.002+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:39.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.002+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.002+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:39.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.002+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.002+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:39.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.003+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.003+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05a00a1040 2024-05-08T18:31:39.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.003+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.003+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05a00a1040 2024-05-08T18:31:39.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.004+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 29 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.004+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05a00a1040 2024-05-08T18:31:39.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.004+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 30 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.004+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.005+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.005+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.005+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.005+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.005+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.005+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.006+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.006+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.006+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.006+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.006+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.006+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.007+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.007+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.007+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.007+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.007+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.007+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05a00a1040 2024-05-08T18:31:39.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.008+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 31 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.008+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05a00a1040 2024-05-08T18:31:39.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.008+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 32 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.008+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05a00a1040 2024-05-08T18:31:39.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.008+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 33 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.008+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.009+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.009+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.009+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.009+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.009+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.009+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05a00a1040 2024-05-08T18:31:39.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.010+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 34 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.010+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05a00a1040 2024-05-08T18:31:39.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.010+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 35 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.010+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05a00a1040 2024-05-08T18:31:39.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.011+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 36 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.011+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:39.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.011+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.011+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:39.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.011+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.011+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.012+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.012+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.012+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.012+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.012+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.012+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.012+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.012+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.013+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.013+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.013+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.013+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.013+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.013+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.013+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.013+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.014+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.014+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.014+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.014+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.014+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.014+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.014+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.014+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.015+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.015+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.015+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.015+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.015+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.015+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x556914914da0 2024-05-08T18:31:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.015+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.015+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.016+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.016+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.016+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.016+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.016+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.016+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.016+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.016+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.016+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.017+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x7f05ac01f9e0 2024-05-08T18:31:39.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.017+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.017+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.017+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.017+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.017+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.017+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.017+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.017+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.018+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.018+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.018+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.018+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.018+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.018+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.019+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv14 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.019+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.019+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv14 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.019+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691492fc60 con 0x55691491afe0 2024-05-08T18:31:39.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.019+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 52 ==== osd_op_reply(168 gc.24 [call out=1701b] v0'0 uv14 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.019+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495f560 con 0x55691491afe0 2024-05-08T18:31:39.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.019+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.019+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495e550 con 0x55691491afe0 2024-05-08T18:31:39.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.019+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.020+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495f560 con 0x55691491afe0 2024-05-08T18:31:39.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.020+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.020+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495f560 con 0x7f05a00a1040 2024-05-08T18:31:39.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.020+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 37 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.020+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495e550 con 0x7f05a00a1040 2024-05-08T18:31:39.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.020+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 38 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.021+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495f560 con 0x7f05a00a1040 2024-05-08T18:31:39.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.021+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 39 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.021+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495f560 con 0x55691491afe0 2024-05-08T18:31:39.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.021+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.021+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495e550 con 0x55691491afe0 2024-05-08T18:31:39.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.021+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.021+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495f560 con 0x55691491afe0 2024-05-08T18:31:39.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.022+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.022+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495f560 con 0x7f05a00a1040 2024-05-08T18:31:39.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.022+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 40 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.022+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495e550 con 0x7f05a00a1040 2024-05-08T18:31:39.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.023+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 41 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.023+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495f560 con 0x7f05a00a1040 2024-05-08T18:31:39.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.023+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 42 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.023+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495f560 con 0x55691491afe0 2024-05-08T18:31:39.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.024+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.024+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495e550 con 0x55691491afe0 2024-05-08T18:31:39.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.024+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.024+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495f560 con 0x55691491afe0 2024-05-08T18:31:39.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.024+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.024+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495f560 con 0x7f05a00a1040 2024-05-08T18:31:39.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.025+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 43 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.025+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495e550 con 0x7f05a00a1040 2024-05-08T18:31:39.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.025+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 44 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.025+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495f560 con 0x7f05a00a1040 2024-05-08T18:31:39.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.025+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 45 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.025+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495f560 con 0x7f05ac01f9e0 2024-05-08T18:31:39.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.026+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.026+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495e550 con 0x7f05ac01f9e0 2024-05-08T18:31:39.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.026+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.026+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55691495f560 con 0x7f05ac01f9e0 2024-05-08T18:31:39.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.026+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.027+0000 7f0466fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:39.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.027+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93909805061472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55691492f360 con 0x556914914da0 2024-05-08T18:31:39.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.028+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 93909805061472] v27'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.028+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93909805036960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914925560 con 0x7f05ac01f9e0 2024-05-08T18:31:39.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.029+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 93909805036960] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.029+0000 7f05b5a30800 20 remove_watcher() i=0 2024-05-08T18:31:39.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.029+0000 7f05b5a30800 2 removed watcher, disabling cache 2024-05-08T18:31:39.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.029+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93909805042384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914925560 con 0x556914914da0 2024-05-08T18:31:39.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.031+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 93909805042384] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.031+0000 7f05b5a30800 20 remove_watcher() i=1 2024-05-08T18:31:39.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.031+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93909805043440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914920ad0 con 0x55691491afe0 2024-05-08T18:31:39.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.032+0000 7f05b1485640 1 -- 172.21.15.87:0/3684378573 <== osd.3 v2:172.21.15.87:6800/2929215285 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 93909805043440] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05ac029070 con 0x55691491afe0 2024-05-08T18:31:39.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.032+0000 7f05b5a30800 20 remove_watcher() i=2 2024-05-08T18:31:39.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.032+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93909805049712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914925560 con 0x7f05ac01f9e0 2024-05-08T18:31:39.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.033+0000 7f05b0c84640 1 -- 172.21.15.87:0/3684378573 <== osd.2 v2:172.21.15.87:6816/2108501615 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 93909805049712] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0078070 con 0x7f05ac01f9e0 2024-05-08T18:31:39.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.033+0000 7f05b5a30800 20 remove_watcher() i=3 2024-05-08T18:31:39.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.033+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93909805051840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914925560 con 0x556914914da0 2024-05-08T18:31:39.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.034+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.1 v2:172.21.15.87:6808/2448644045 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 93909805051840] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f059802a040 con 0x556914914da0 2024-05-08T18:31:39.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.034+0000 7f05b5a30800 20 remove_watcher() i=4 2024-05-08T18:31:39.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.034+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93909805054512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914922fc0 con 0x7f05a00a1040 2024-05-08T18:31:39.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.035+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 93909805054512] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.035+0000 7f05b5a30800 20 remove_watcher() i=5 2024-05-08T18:31:39.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.035+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93909805056736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914925560 con 0x7f05a00a1040 2024-05-08T18:31:39.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.036+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 93909805056736] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.036+0000 7f05b5a30800 20 remove_watcher() i=6 2024-05-08T18:31:39.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.036+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93909805060416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556914923a30 con 0x7f05a00a1040 2024-05-08T18:31:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 <== osd.0 v2:172.21.15.53:6800/443747735 48 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 93909805060416] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f059802a040 con 0x7f05a00a1040 2024-05-08T18:31:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 20 remove_watcher() i=7 2024-05-08T18:31:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f05a00a1040 msgr2=0x7f05a005baa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f05a00a1040 0x7f05a005baa0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556914914da0 msgr2=0x556914917260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556914914da0 0x556914917260 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f05ac01f9e0 msgr2=0x7f05ac040990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f05ac01f9e0 0x7f05ac040990 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55691491afe0 msgr2=0x55691491d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55691491afe0 0x55691491d3d0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f047c03bb00 msgr2=0x7f047c03dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f047c03bb00 0x7f047c03dfc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5569148e6970 tx=0x7f05a0084000 comp rx=0 tx=0).stop 2024-05-08T18:31:39.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05a8483640 1 -- 172.21.15.87:0/3684378573 reap_dead start 2024-05-08T18:31:39.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556914901c10 msgr2=0x556914909110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556914901c10 0x556914909110 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f05ac021e20 tx=0x7f05ac052940 comp rx=0 tx=0).stop 2024-05-08T18:31:39.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 shutdown_connections 2024-05-08T18:31:39.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 1 --2- 172.21.15.87:0/3684378573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556914901c10 0x556914909110 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 >> 172.21.15.87:0/3684378573 conn(0x5569148fdee0 msgr2=0x5569148fb540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 shutdown_connections 2024-05-08T18:31:39.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.037+0000 7f05b5a30800 1 -- 172.21.15.87:0/3684378573 wait complete. 2024-05-08T18:31:39.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 -- 172.21.15.87:0/3262104911 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f048803bb50 msgr2=0x7f048803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 --2- 172.21.15.87:0/3262104911 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f048803bb50 0x7f048803e010 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f05a005d040 tx=0x7f05a005df70 comp rx=0 tx=0).stop 2024-05-08T18:31:39.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 -- 172.21.15.87:0/3262104911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569148f4880 msgr2=0x5569148f4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 --2- 172.21.15.87:0/3262104911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569148f4880 0x5569148f4ca0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x5569148e0f00 tx=0x7f05ac0178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 -- 172.21.15.87:0/3262104911 shutdown_connections 2024-05-08T18:31:39.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 --2- 172.21.15.87:0/3262104911 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f048803bb50 0x7f048803e010 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 --2- 172.21.15.87:0/3262104911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569148f4880 0x5569148f4ca0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 -- 172.21.15.87:0/3262104911 >> 172.21.15.87:0/3262104911 conn(0x5569148e8920 msgr2=0x5569148e8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 -- 172.21.15.87:0/3262104911 shutdown_connections 2024-05-08T18:31:39.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 -- 172.21.15.87:0/3262104911 wait complete. 2024-05-08T18:31:39.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 -- 172.21.15.87:0/1870935767 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5569148e25a0 msgr2=0x5569148e5de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5569148e25a0 0x5569148e5de0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 -- 172.21.15.87:0/1870935767 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5569147de3a0 msgr2=0x5569148e05e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5569147de3a0 0x5569148e05e0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 -- 172.21.15.87:0/1870935767 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f049803bae0 msgr2=0x7f049803dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f049803bae0 0x7f049803dfa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0598000f60 tx=0x7f05980012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 -- 172.21.15.87:0/1870935767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 msgr2=0x5569148d9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 0x5569148d9440 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f05a000a470 tx=0x7f05a0002fb0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 -- 172.21.15.87:0/1870935767 shutdown_connections 2024-05-08T18:31:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5569147de3a0 0x5569148e05e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5569148e25a0 0x5569148e5de0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f049803bae0 0x7f049803dfa0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 --2- 172.21.15.87:0/1870935767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569147dd140 0x5569148d9440 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 -- 172.21.15.87:0/1870935767 >> 172.21.15.87:0/1870935767 conn(0x5569147d8720 msgr2=0x5569148c7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 -- 172.21.15.87:0/1870935767 shutdown_connections 2024-05-08T18:31:39.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.038+0000 7f05b5a30800 1 -- 172.21.15.87:0/1870935767 wait complete. 2024-05-08T18:31:39.048 INFO:teuthology.orchestra.run.smithi087.stdout:[{"tag":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.3702986012995467996\u0000","time":"2024-05-08T18:31:38.843620+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_7","key":"","instance":""}]}] 2024-05-08T18:31:39.048 DEBUG:tasks.util.rgw: json result: [{'tag': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.3702986012995467996\x00', 'time': '2024-05-08T18:31:38.843620+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_7', 'key': '', 'instance': ''}]}] 2024-05-08T18:31:39.048 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-05-08T18:31:39.048 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-05-08T18:31:39.049 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-05-08T18:31:39.091 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:39.091 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:39.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.093+0000 7fed5263b800 1 Processor -- start 2024-05-08T18:31:39.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.093+0000 7fed5263b800 1 -- start start 2024-05-08T18:31:39.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.093+0000 7fed5263b800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55726fa63130 0x55726fa63550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.093+0000 7fed5263b800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55726fa63bd0 con 0x55726fa64390 2024-05-08T18:31:39.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.093+0000 7fed5263b800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55726f904e20 con 0x55726fa63130 2024-05-08T18:31:39.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.094+0000 7fed50133640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55726fa63130 0x55726fa63550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.094+0000 7fed4f932640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55726fa64390 0x55726fa64810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:51546/0 (socket says 172.21.15.87:51546) 2024-05-08T18:31:39.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.094+0000 7fed4f932640 1 -- 172.21.15.87:0/364365896 learned_addr learned my addr 172.21.15.87:0/364365896 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:39.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.094+0000 7fed50133640 1 -- 172.21.15.87:0/364365896 >> v1:172.21.15.53:6789/0 conn(0x55726fa64390 legacy=0x55726fa64810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.094+0000 7fed50133640 1 -- 172.21.15.87:0/364365896 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55726fa64f50 con 0x55726fa63130 2024-05-08T18:31:39.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.096+0000 7fed50133640 1 --2- 172.21.15.87:0/364365896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 0x55726fa63550 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fed4000a470 tx=0x7fed4001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a8c2539c3a9a3c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.096+0000 7fed4f131640 1 -- 172.21.15.87:0/364365896 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed40057070 con 0x55726fa63130 2024-05-08T18:31:39.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.096+0000 7fed4f131640 1 -- 172.21.15.87:0/364365896 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed4004adc0 con 0x55726fa63130 2024-05-08T18:31:39.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.096+0000 7fed4f131640 1 -- 172.21.15.87:0/364365896 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed40052590 con 0x55726fa63130 2024-05-08T18:31:39.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.097+0000 7fed5263b800 1 -- 172.21.15.87:0/364365896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 msgr2=0x55726fa63550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.097+0000 7fed5263b800 1 --2- 172.21.15.87:0/364365896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 0x55726fa63550 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fed4000a470 tx=0x7fed4001ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:39.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.097+0000 7fed5263b800 1 -- 172.21.15.87:0/364365896 shutdown_connections 2024-05-08T18:31:39.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.097+0000 7fed5263b800 1 --2- 172.21.15.87:0/364365896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 0x55726fa63550 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.097+0000 7fed5263b800 1 -- 172.21.15.87:0/364365896 >> 172.21.15.87:0/364365896 conn(0x55726fa5e710 msgr2=0x55726fa60b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.097+0000 7fed5263b800 1 -- 172.21.15.87:0/364365896 shutdown_connections 2024-05-08T18:31:39.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.097+0000 7fed5263b800 1 -- 172.21.15.87:0/364365896 wait complete. 2024-05-08T18:31:39.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.110+0000 7fed5263b800 1 Processor -- start 2024-05-08T18:31:39.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.110+0000 7fed5263b800 1 -- start start 2024-05-08T18:31:39.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.110+0000 7fed5263b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 0x55726fb54670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.110+0000 7fed5263b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55726f9af5a0 con 0x55726fa63130 2024-05-08T18:31:39.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.110+0000 7fed50133640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 0x55726fb54670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.110+0000 7fed50133640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 0x55726fb54670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58928/0 (socket says 172.21.15.87:58928) 2024-05-08T18:31:39.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.110+0000 7fed50133640 1 -- 172.21.15.87:0/3672905798 learned_addr learned my addr 172.21.15.87:0/3672905798 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.111+0000 7fed50133640 1 -- 172.21.15.87:0/3672905798 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55726fb54c40 con 0x55726fa63130 2024-05-08T18:31:39.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.111+0000 7fed50133640 1 --2- 172.21.15.87:0/3672905798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 0x55726fb54670 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fed40055040 tx=0x7fed4004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643947ee485f024 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.111+0000 7fec3e60c640 1 -- 172.21.15.87:0/3672905798 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed40052630 con 0x55726fa63130 2024-05-08T18:31:39.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.111+0000 7fec3e60c640 1 -- 172.21.15.87:0/3672905798 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed400527d0 con 0x55726fa63130 2024-05-08T18:31:39.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.111+0000 7fec3e60c640 1 -- 172.21.15.87:0/3672905798 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed40052ab0 con 0x55726fa63130 2024-05-08T18:31:39.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.112+0000 7fed5263b800 1 -- 172.21.15.87:0/3672905798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 msgr2=0x55726fb54670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.112+0000 7fed5263b800 1 --2- 172.21.15.87:0/3672905798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 0x55726fb54670 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fed40055040 tx=0x7fed4004c000 comp rx=0 tx=0).stop 2024-05-08T18:31:39.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.112+0000 7fed5263b800 1 -- 172.21.15.87:0/3672905798 shutdown_connections 2024-05-08T18:31:39.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.112+0000 7fed5263b800 1 --2- 172.21.15.87:0/3672905798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 0x55726fb54670 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.112+0000 7fed5263b800 1 -- 172.21.15.87:0/3672905798 >> 172.21.15.87:0/3672905798 conn(0x55726fa5e710 msgr2=0x55726fb4ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.112+0000 7fed5263b800 1 -- 172.21.15.87:0/3672905798 shutdown_connections 2024-05-08T18:31:39.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.112+0000 7fed5263b800 1 -- 172.21.15.87:0/3672905798 wait complete. 2024-05-08T18:31:39.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.112+0000 7fed5263b800 1 Processor -- start 2024-05-08T18:31:39.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.112+0000 7fed5263b800 1 -- start start 2024-05-08T18:31:39.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.112+0000 7fed5263b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 0x55726fb5afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.112+0000 7fed5263b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55726fa6c860 con 0x55726fa63130 2024-05-08T18:31:39.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.113+0000 7fed50133640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 0x55726fb5afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.113+0000 7fed50133640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 0x55726fb5afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58940/0 (socket says 172.21.15.87:58940) 2024-05-08T18:31:39.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.113+0000 7fed50133640 1 -- 172.21.15.87:0/1613453964 learned_addr learned my addr 172.21.15.87:0/1613453964 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.113+0000 7fed50133640 1 -- 172.21.15.87:0/1613453964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55726fb5b4e0 con 0x55726fa63130 2024-05-08T18:31:39.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.113+0000 7fed50133640 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 0x55726fb5afa0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fed4001ce60 tx=0x7fed40002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.113+0000 7fec3ce09640 1 -- 172.21.15.87:0/1613453964 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed40071070 con 0x55726fa63130 2024-05-08T18:31:39.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.113+0000 7fec3ce09640 1 -- 172.21.15.87:0/1613453964 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed4006c570 con 0x55726fa63130 2024-05-08T18:31:39.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.113+0000 7fed5263b800 1 -- 172.21.15.87:0/1613453964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55726fb5b770 con 0x55726fa63130 2024-05-08T18:31:39.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.113+0000 7fec3ce09640 1 -- 172.21.15.87:0/1613453964 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed4006c890 con 0x55726fa63130 2024-05-08T18:31:39.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.114+0000 7fed5263b800 1 -- 172.21.15.87:0/1613453964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55726fb5e3d0 con 0x55726fa63130 2024-05-08T18:31:39.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.114+0000 7fec3ce09640 1 -- 172.21.15.87:0/1613453964 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fed40074070 con 0x55726fa63130 2024-05-08T18:31:39.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.115+0000 7fec3ce09640 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fec3803bba0 0x7fec3803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.115+0000 7fec3ce09640 1 -- 172.21.15.87:0/1613453964 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fed4005f070 con 0x55726fa63130 2024-05-08T18:31:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.115+0000 7fed4f932640 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fec3803bba0 0x7fec3803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.115+0000 7fed5263b800 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55726fa64390 0x55726fb62190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.115+0000 7fed5263b800 1 -- 172.21.15.87:0/1613453964 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fb626d0 con 0x55726fa64390 2024-05-08T18:31:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.115+0000 7fed50934640 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55726fa64390 0x55726fb62190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.115+0000 7fed4f932640 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fec3803bba0 0x7fec3803e060 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fed44001d90 tx=0x7fed440012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.115+0000 7fed50934640 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55726fa64390 0x55726fb62190 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.115+0000 7fed50934640 1 -- 172.21.15.87:0/1613453964 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed4800a4a0 con 0x55726fa64390 2024-05-08T18:31:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.116+0000 7fed5263b800 1 -- 172.21.15.87:0/1613453964 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fb62fb0 con 0x55726fa64390 2024-05-08T18:31:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.116+0000 7fed50934640 1 -- 172.21.15.87:0/1613453964 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fed4800a4a0 con 0x55726fa64390 2024-05-08T18:31:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.116+0000 7fed5263b800 1 -- 172.21.15.87:0/1613453964 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fb64360 con 0x55726fa64390 2024-05-08T18:31:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.116+0000 7fed50934640 1 -- 172.21.15.87:0/1613453964 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fed4800a4a0 con 0x55726fa64390 2024-05-08T18:31:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.116+0000 7fed5263b800 1 -- 172.21.15.87:0/1613453964 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fb63800 con 0x55726fa64390 2024-05-08T18:31:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.116+0000 7fed50934640 1 -- 172.21.15.87:0/1613453964 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fed4800a4a0 con 0x55726fa64390 2024-05-08T18:31:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.116+0000 7fed5263b800 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55726fb65710 0x55726fb67b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.116+0000 7fed5263b800 1 -- 172.21.15.87:0/1613453964 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fb68110 con 0x55726fb65710 2024-05-08T18:31:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.117+0000 7fed50133640 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55726fb65710 0x55726fb67b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.117+0000 7fed50133640 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55726fb65710 0x55726fb67b00 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.117+0000 7fed50133640 1 -- 172.21.15.87:0/1613453964 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fed40073030 con 0x55726fb65710 2024-05-08T18:31:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.118+0000 7fed5263b800 1 Processor -- start 2024-05-08T18:31:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.118+0000 7fed5263b800 1 -- start start 2024-05-08T18:31:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.118+0000 7fed5263b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb7a890 0x55726fb7acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.118+0000 7fed5263b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55726f955fc0 con 0x55726fb7a890 2024-05-08T18:31:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.118+0000 7fed50934640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb7a890 0x55726fb7acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.118+0000 7fed50934640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb7a890 0x55726fb7acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58944/0 (socket says 172.21.15.87:58944) 2024-05-08T18:31:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.118+0000 7fed50934640 1 -- 172.21.15.87:0/1678133089 learned_addr learned my addr 172.21.15.87:0/1678133089 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.118+0000 7fed50934640 1 -- 172.21.15.87:0/1678133089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55726fb7b1f0 con 0x55726fb7a890 2024-05-08T18:31:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.119+0000 7fed50934640 1 --2- 172.21.15.87:0/1678133089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb7a890 0x55726fb7acb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x55726fb5c170 tx=0x7fed480178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.119+0000 7fec35ffb640 1 -- 172.21.15.87:0/1678133089 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed48013440 con 0x55726fb7a890 2024-05-08T18:31:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.119+0000 7fec35ffb640 1 -- 172.21.15.87:0/1678133089 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed480135e0 con 0x55726fb7a890 2024-05-08T18:31:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.119+0000 7fed5263b800 1 -- 172.21.15.87:0/1678133089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55726fb7bc60 con 0x55726fb7a890 2024-05-08T18:31:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.119+0000 7fec35ffb640 1 -- 172.21.15.87:0/1678133089 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed480138c0 con 0x55726fb7a890 2024-05-08T18:31:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.119+0000 7fed5263b800 1 -- 172.21.15.87:0/1678133089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55726fb7c160 con 0x55726fb7a890 2024-05-08T18:31:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.120+0000 7fec35ffb640 1 -- 172.21.15.87:0/1678133089 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fed48011040 con 0x55726fb7a890 2024-05-08T18:31:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.120+0000 7fec35ffb640 1 --2- 172.21.15.87:0/1678133089 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fec2803bb50 0x7fec2803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.120+0000 7fec35ffb640 1 -- 172.21.15.87:0/1678133089 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fed4801d070 con 0x55726fb7a890 2024-05-08T18:31:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.120+0000 7fed50133640 1 --2- 172.21.15.87:0/1678133089 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fec2803bb50 0x7fec2803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.120+0000 7fed5263b800 1 Processor -- start 2024-05-08T18:31:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.120+0000 7fed5263b800 1 -- start start 2024-05-08T18:31:39.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.120+0000 7fed50133640 1 --2- 172.21.15.87:0/1678133089 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fec2803bb50 0x7fec2803e010 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x55726fb63ba0 tx=0x7fed40052f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.120+0000 7fed5263b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb87bb0 0x55726fb87fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.120+0000 7fed5263b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55726fb54ed0 con 0x55726fb87bb0 2024-05-08T18:31:39.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.121+0000 7fed50934640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb87bb0 0x55726fb87fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.121+0000 7fed50934640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb87bb0 0x55726fb87fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58960/0 (socket says 172.21.15.87:58960) 2024-05-08T18:31:39.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.121+0000 7fed50934640 1 -- 172.21.15.87:0/3911677680 learned_addr learned my addr 172.21.15.87:0/3911677680 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.121+0000 7fed50934640 1 -- 172.21.15.87:0/3911677680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55726fb885a0 con 0x55726fb87bb0 2024-05-08T18:31:39.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.121+0000 7fed50934640 1 --2- 172.21.15.87:0/3911677680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb87bb0 0x55726fb87fd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fed480529e0 tx=0x7fed48001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63d904faea76f40 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.121+0000 7fec2f7fe640 1 -- 172.21.15.87:0/3911677680 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed48021d70 con 0x55726fb87bb0 2024-05-08T18:31:39.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.121+0000 7fec2f7fe640 1 -- 172.21.15.87:0/3911677680 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed4802ac50 con 0x55726fb87bb0 2024-05-08T18:31:39.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.121+0000 7fec2f7fe640 1 -- 172.21.15.87:0/3911677680 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed480157b0 con 0x55726fb87bb0 2024-05-08T18:31:39.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.122+0000 7fed5263b800 1 -- 172.21.15.87:0/3911677680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb87bb0 msgr2=0x55726fb87fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.122+0000 7fed5263b800 1 --2- 172.21.15.87:0/3911677680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb87bb0 0x55726fb87fd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fed480529e0 tx=0x7fed48001b10 comp rx=0 tx=0).stop 2024-05-08T18:31:39.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.122+0000 7fed5263b800 1 -- 172.21.15.87:0/3911677680 shutdown_connections 2024-05-08T18:31:39.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.122+0000 7fed5263b800 1 --2- 172.21.15.87:0/3911677680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb87bb0 0x55726fb87fd0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.122+0000 7fed5263b800 1 -- 172.21.15.87:0/3911677680 >> 172.21.15.87:0/3911677680 conn(0x55726fb83f10 msgr2=0x55726fb81f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.122+0000 7fed5263b800 1 -- 172.21.15.87:0/3911677680 shutdown_connections 2024-05-08T18:31:39.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.122+0000 7fed5263b800 1 -- 172.21.15.87:0/3911677680 wait complete. 2024-05-08T18:31:39.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.122+0000 7fed5263b800 1 Processor -- start 2024-05-08T18:31:39.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.122+0000 7fed5263b800 1 -- start start 2024-05-08T18:31:39.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.122+0000 7fed5263b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb87bb0 0x55726fb8f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.122+0000 7fed5263b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55726fb88d10 con 0x55726fb87bb0 2024-05-08T18:31:39.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.122+0000 7fed50934640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb87bb0 0x55726fb8f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.122+0000 7fed50934640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb87bb0 0x55726fb8f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58966/0 (socket says 172.21.15.87:58966) 2024-05-08T18:31:39.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.122+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 learned_addr learned my addr 172.21.15.87:0/1400709571 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.123+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55726fb8f6e0 con 0x55726fb87bb0 2024-05-08T18:31:39.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.123+0000 7fed50934640 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb87bb0 0x55726fb8f1a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fed48015fd0 tx=0x7fed48052940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.123+0000 7fec2dffb640 1 -- 172.21.15.87:0/1400709571 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed4802ae00 con 0x55726fb87bb0 2024-05-08T18:31:39.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.123+0000 7fec2dffb640 1 -- 172.21.15.87:0/1400709571 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed48031070 con 0x55726fb87bb0 2024-05-08T18:31:39.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.123+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55726fb8f970 con 0x55726fb87bb0 2024-05-08T18:31:39.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.123+0000 7fec2dffb640 1 -- 172.21.15.87:0/1400709571 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed48013c70 con 0x55726fb87bb0 2024-05-08T18:31:39.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.123+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55726fb92620 con 0x55726fb87bb0 2024-05-08T18:31:39.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.124+0000 7fec2dffb640 1 -- 172.21.15.87:0/1400709571 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fed48051200 con 0x55726fb87bb0 2024-05-08T18:31:39.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.124+0000 7fec2dffb640 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fec2003bb50 0x7fec2003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.124+0000 7fec2dffb640 1 -- 172.21.15.87:0/1400709571 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fed4800e040 con 0x55726fb87bb0 2024-05-08T18:31:39.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.124+0000 7fed50133640 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fec2003bb50 0x7fec2003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.125+0000 7fed50133640 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fec2003bb50 0x7fec2003e010 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fed400942b0 tx=0x7fed40088000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.125+0000 7fed5263b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.125+0000 7fed5263b800 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55726fb9ae30 0x55726fb9d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.125+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fb9da40 con 0x55726fb9ae30 2024-05-08T18:31:39.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.125+0000 7fed4f932640 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55726fb9ae30 0x55726fb9d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.125+0000 7fed4f932640 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55726fb9ae30 0x55726fb9d2f0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.125+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed44009050 con 0x55726fb9ae30 2024-05-08T18:31:39.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.125+0000 7fed5263b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.125+0000 7fed5263b800 20 realm 2024-05-08T18:31:39.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.125+0000 7fed5263b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.125+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fb9a280 con 0x55726fb9ae30 2024-05-08T18:31:39.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.125+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed44009050 con 0x55726fb9ae30 2024-05-08T18:31:39.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.125+0000 7fed5263b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.125+0000 7fed5263b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:39.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.125+0000 7fed5263b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.126+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fb9e530 con 0x55726fb9ae30 2024-05-08T18:31:39.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.126+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed44009050 con 0x55726fb9ae30 2024-05-08T18:31:39.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.126+0000 7fed5263b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.126+0000 7fed5263b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.126+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fb9ee00 con 0x55726fb9ae30 2024-05-08T18:31:39.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.126+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fed44009050 con 0x55726fb9ae30 2024-05-08T18:31:39.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.126+0000 7fed5263b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:39.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.126+0000 7fed5263b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.126+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fb9f1a0 con 0x55726fb9ae30 2024-05-08T18:31:39.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.126+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fed44009050 con 0x55726fb9ae30 2024-05-08T18:31:39.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.126+0000 7fed5263b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:39.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.126+0000 7fed5263b800 20 searching for the correct realm 2024-05-08T18:31:39.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.126+0000 7fed5263b800 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55726fba1080 0x55726fba3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.126+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x55726fba1080 2024-05-08T18:31:39.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.126+0000 7fed50934640 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55726fba1080 0x55726fba3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.127+0000 7fed50934640 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55726fba1080 0x55726fba3470 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.127+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.127+0000 7fed50934640 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fed48041020 0x7fed48036460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.127+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x7fed48041020 2024-05-08T18:31:39.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.127+0000 7fed50133640 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fed48041020 0x7fed48036460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.127+0000 7fed50133640 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fed48041020 0x7fed48036460 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.128+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.128+0000 7fed50133640 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fed4008d040 0x7fed400953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.128+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x7fed4008d040 2024-05-08T18:31:39.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.128+0000 7fed4f932640 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fed4008d040 0x7fed400953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.128+0000 7fed4f932640 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fed4008d040 0x7fed400953d0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.129+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed44009050 con 0x7fed4008d040 2024-05-08T18:31:39.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.129+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x55726fb9ae30 2024-05-08T18:31:39.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.129+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed44009050 con 0x55726fb9ae30 2024-05-08T18:31:39.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.129+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x55726fb9ae30 2024-05-08T18:31:39.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.129+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.129+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x7fed4008d040 2024-05-08T18:31:39.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.129+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.129+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x7fed4008d040 2024-05-08T18:31:39.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.130+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.130+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x7fed48041020 2024-05-08T18:31:39.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.130+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.130+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x55726fba1080 2024-05-08T18:31:39.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.130+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.130+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x55726fb9ae30 2024-05-08T18:31:39.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.130+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.130+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x7fed4008d040 2024-05-08T18:31:39.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.131+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.131+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x55726fb9ae30 2024-05-08T18:31:39.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.131+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.131+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x7fed48041020 2024-05-08T18:31:39.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.131+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.131+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x55726fba1080 2024-05-08T18:31:39.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.131+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.131+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x55726fba1080 2024-05-08T18:31:39.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.132+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.132+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x7fed4008d040 2024-05-08T18:31:39.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.132+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.132+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x55726fba1080 2024-05-08T18:31:39.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.132+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.132+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x55726fba1080 2024-05-08T18:31:39.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.133+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.133+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x55726fb9ae30 2024-05-08T18:31:39.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.133+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.133+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x55726fb9ae30 2024-05-08T18:31:39.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.133+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.133+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x7fed4008d040 2024-05-08T18:31:39.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.133+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.133+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x55726fba1080 2024-05-08T18:31:39.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.134+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.134+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x7fed48041020 2024-05-08T18:31:39.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.134+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.134+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x55726fb9ae30 2024-05-08T18:31:39.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.134+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.134+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x7fed4008d040 2024-05-08T18:31:39.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.135+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.135+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x55726fba1080 2024-05-08T18:31:39.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.135+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.135+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x7fed4008d040 2024-05-08T18:31:39.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.135+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.135+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x7fed48041020 2024-05-08T18:31:39.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.136+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.136+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x55726fba1080 2024-05-08T18:31:39.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.136+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.136+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x7fed4008d040 2024-05-08T18:31:39.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.136+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.136+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x55726fb9ae30 2024-05-08T18:31:39.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.136+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3b20 con 0x7fed48041020 2024-05-08T18:31:39.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed5263b800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:39.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed5263b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:39.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed5263b800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:39.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed5263b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:39.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed5263b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:39.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed5263b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:39.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed5263b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fb9fb50 con 0x55726fb9ae30 2024-05-08T18:31:39.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed5263b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed5263b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fba03f0 con 0x55726fb9ae30 2024-05-08T18:31:39.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed5263b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:39.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed5263b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.137+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fba3fa0 con 0x7fed4008d040 2024-05-08T18:31:39.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed5263b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:39.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed5263b800 20 zone default found 2024-05-08T18:31:39.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed5263b800 4 Realm: () 2024-05-08T18:31:39.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed5263b800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:39.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed5263b800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:39.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed5263b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:39.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed5263b800 20 zonegroup default 2024-05-08T18:31:39.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed5263b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fba4450 con 0x7fed4008d040 2024-05-08T18:31:39.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed5263b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed5263b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fba5e30 con 0x55726fba1080 2024-05-08T18:31:39.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed5263b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed5263b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fba6300 con 0x55726fba1080 2024-05-08T18:31:39.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.138+0000 7fed5263b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.139+0000 7fed5263b800 20 started sync module instance, tier type = 2024-05-08T18:31:39.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.139+0000 7fed5263b800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:39.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.139+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fba52c0 con 0x7fed48041020 2024-05-08T18:31:39.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.140+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.140+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93949989115568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fba6c10 con 0x7fed48041020 2024-05-08T18:31:39.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.140+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fba7460 con 0x55726fb9ae30 2024-05-08T18:31:39.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.141+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93949989115568] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.141+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.141+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93949989119840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fba7460 con 0x55726fb9ae30 2024-05-08T18:31:39.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.141+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fba7f50 con 0x55726fba1080 2024-05-08T18:31:39.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.142+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.142+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93949989124640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fba87f0 con 0x55726fba1080 2024-05-08T18:31:39.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.142+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fba92f0 con 0x7fed48041020 2024-05-08T18:31:39.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.142+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93949989119840] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.143+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93949989124640] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.143+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.143+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93949989121968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fba87f0 con 0x7fed48041020 2024-05-08T18:31:39.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.143+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fba9bf0 con 0x55726fb9ae30 2024-05-08T18:31:39.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.144+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93949989121968] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.144+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.144+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93949989132000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fba9fe0 con 0x55726fb9ae30 2024-05-08T18:31:39.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.144+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbaa9a0 con 0x7fed4008d040 2024-05-08T18:31:39.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.145+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.145+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93949989135600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbaa910 con 0x7fed4008d040 2024-05-08T18:31:39.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.145+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbab910 con 0x7fed4008d040 2024-05-08T18:31:39.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.146+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93949989132000] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.147+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93949989135600] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.147+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.147+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93949989137856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbab410 con 0x7fed4008d040 2024-05-08T18:31:39.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.147+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbabdc0 con 0x7fed4008d040 2024-05-08T18:31:39.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.148+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.148+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93949989137856] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.148+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93949989140752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbac1e0 con 0x7fed4008d040 2024-05-08T18:31:39.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.148+0000 7fed5263b800 20 add_watcher() i=0 2024-05-08T18:31:39.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.148+0000 7fed5263b800 20 add_watcher() i=1 2024-05-08T18:31:39.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.148+0000 7fed5263b800 20 add_watcher() i=2 2024-05-08T18:31:39.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.148+0000 7fed5263b800 20 add_watcher() i=3 2024-05-08T18:31:39.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.148+0000 7fed5263b800 20 add_watcher() i=4 2024-05-08T18:31:39.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.148+0000 7fed5263b800 20 add_watcher() i=5 2024-05-08T18:31:39.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.148+0000 7fed5263b800 20 add_watcher() i=6 2024-05-08T18:31:39.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.149+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93949989140752] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.149+0000 7fed5263b800 20 add_watcher() i=7 2024-05-08T18:31:39.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.149+0000 7fed5263b800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:39.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.149+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbac1e0 con 0x55726fb9ae30 2024-05-08T18:31:39.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.149+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.150+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93949989141808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbac1c0 con 0x55726fb9ae30 2024-05-08T18:31:39.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.150+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93949989141808] v27'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.151+0000 7fec067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:39.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.151+0000 7fed5263b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:39.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.151+0000 7fed5263b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:39.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.151+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb7b10 con 0x55726fb9ae30 2024-05-08T18:31:39.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.152+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.152+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb8160 con 0x7fed4008d040 2024-05-08T18:31:39.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.153+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.153+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb85c0 con 0x55726fba1080 2024-05-08T18:31:39.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.154+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.154+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb8530 con 0x55726fb9ae30 2024-05-08T18:31:39.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.155+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'158 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.155+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb8ba0 con 0x7fed48041020 2024-05-08T18:31:39.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.156+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'47 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.156+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9110 con 0x55726fba1080 2024-05-08T18:31:39.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.157+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'32 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.157+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9110 con 0x55726fb9ae30 2024-05-08T18:31:39.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.158+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.158+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9110 con 0x7fed4008d040 2024-05-08T18:31:39.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.159+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.159+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9110 con 0x7fed48041020 2024-05-08T18:31:39.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.160+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.160+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x55726fba1080 2024-05-08T18:31:39.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.161+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.161+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x7fed48041020 2024-05-08T18:31:39.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.162+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'48 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.162+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x7fed4008d040 2024-05-08T18:31:39.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.163+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.163+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x7fed48041020 2024-05-08T18:31:39.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.164+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.164+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x7fed4008d040 2024-05-08T18:31:39.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.165+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'37 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.165+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x55726fb9ae30 2024-05-08T18:31:39.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.166+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'159 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.166+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x55726fba1080 2024-05-08T18:31:39.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.167+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'41 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.167+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x7fed48041020 2024-05-08T18:31:39.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.168+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.168+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x55726fba1080 2024-05-08T18:31:39.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.169+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.169+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x55726fb9ae30 2024-05-08T18:31:39.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.170+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.170+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x55726fb9ae30 2024-05-08T18:31:39.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.171+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'160 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.171+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x55726fba1080 2024-05-08T18:31:39.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.172+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'42 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.172+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x7fed48041020 2024-05-08T18:31:39.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.173+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'29 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.173+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x55726fba1080 2024-05-08T18:31:39.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.174+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.174+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x55726fba1080 2024-05-08T18:31:39.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.175+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.175+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x55726fba1080 2024-05-08T18:31:39.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.176+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'16 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.176+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x55726fba1080 2024-05-08T18:31:39.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.177+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.177+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x7fed4008d040 2024-05-08T18:31:39.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.178+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.178+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x55726fba1080 2024-05-08T18:31:39.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.179+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.179+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x7fed4008d040 2024-05-08T18:31:39.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.180+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.180+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x55726fba1080 2024-05-08T18:31:39.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.181+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'43 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.181+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x7fed4008d040 2024-05-08T18:31:39.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.182+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'38 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.182+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbb9440 con 0x7fed48041020 2024-05-08T18:31:39.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.183+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.184+0000 7fec057e2640 20 reqs_thread_entry: start 2024-05-08T18:31:39.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.184+0000 7fed5263b800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:39.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.184+0000 7fed5263b800 20 Filter name: none 2024-05-08T18:31:39.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.184+0000 7feb76ffd640 20 reqs_thread_entry: start 2024-05-08T18:31:39.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.184+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-05-08T18:31:39.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.184+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:94 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fb9ae30 2024-05-08T18:31:39.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.185+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(94 gc.19 [call] v27'161 uv161 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.185+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:95 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fb9ae30 2024-05-08T18:31:39.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.185+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(95 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.185+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.185+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:96 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe47d0 con 0x55726fb9ae30 2024-05-08T18:31:39.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.185+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(96 gc.19 [call out=24b] v0'0 uv161 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.186+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:97 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fb9ae30 2024-05-08T18:31:39.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.186+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(97 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.186+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.186+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:98 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fb9ae30 2024-05-08T18:31:39.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.186+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(98 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.186+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.186+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:99 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fb9ae30 2024-05-08T18:31:39.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.187+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 33 ==== osd_op_reply(99 gc.19 [call] v27'162 uv162 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.187+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-05-08T18:31:39.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.187+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:100 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.188+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(100 gc.20 [call] v27'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.188+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:101 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.189+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 27 ==== osd_op_reply(101 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.189+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.189+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:102 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe47d0 con 0x55726fba1080 2024-05-08T18:31:39.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.189+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 28 ==== osd_op_reply(102 gc.20 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.189+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:103 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.189+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 29 ==== osd_op_reply(103 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.189+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.189+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:104 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.189+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 30 ==== osd_op_reply(104 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.189+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.189+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:105 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.191+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 31 ==== osd_op_reply(105 gc.20 [call] v27'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.191+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-05-08T18:31:39.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.191+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:106 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x7fed48041020 2024-05-08T18:31:39.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.192+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(106 gc.21 [call] v27'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.192+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:107 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x7fed48041020 2024-05-08T18:31:39.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.192+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(107 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.192+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.192+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:108 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe47d0 con 0x7fed48041020 2024-05-08T18:31:39.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.192+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 20 ==== osd_op_reply(108 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.192+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:109 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x7fed48041020 2024-05-08T18:31:39.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.192+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 21 ==== osd_op_reply(109 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.192+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.192+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:110 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x7fed48041020 2024-05-08T18:31:39.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.193+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 22 ==== osd_op_reply(110 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.193+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.193+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:111 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x7fed48041020 2024-05-08T18:31:39.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.193+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 23 ==== osd_op_reply(111 gc.21 [call] v27'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.193+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-05-08T18:31:39.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.193+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:112 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.195+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 32 ==== osd_op_reply(112 gc.22 [call] v27'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.195+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:113 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.195+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 33 ==== osd_op_reply(113 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.195+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.195+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:114 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe47d0 con 0x55726fba1080 2024-05-08T18:31:39.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.195+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 34 ==== osd_op_reply(114 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.195+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:115 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.195+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 35 ==== osd_op_reply(115 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.195+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.195+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:116 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.195+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 36 ==== osd_op_reply(116 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.196+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.196+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:117 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.196+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 37 ==== osd_op_reply(117 gc.22 [call] v27'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.196+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-05-08T18:31:39.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.196+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:118 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.197+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 38 ==== osd_op_reply(118 gc.23 [call] v27'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.197+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:119 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.197+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 39 ==== osd_op_reply(119 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.197+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.197+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:120 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe47d0 con 0x55726fba1080 2024-05-08T18:31:39.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.198+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 40 ==== osd_op_reply(120 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.198+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:121 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.198+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 41 ==== osd_op_reply(121 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.198+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.198+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:122 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.198+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 42 ==== osd_op_reply(122 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.198+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.198+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:123 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.199+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 43 ==== osd_op_reply(123 gc.23 [call] v27'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.199+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-05-08T18:31:39.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.199+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:124 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.200+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 44 ==== osd_op_reply(124 gc.24 [call] v27'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.200+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:125 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.200+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 45 ==== osd_op_reply(125 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.200+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.200+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:126 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe47d0 con 0x55726fba1080 2024-05-08T18:31:39.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.200+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 46 ==== osd_op_reply(126 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.200+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:127 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 47 ==== osd_op_reply(127 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:128 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe57e0 con 0x55726fba1080 2024-05-08T18:31:39.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 48 ==== osd_op_reply(128 gc.24 [call out=1701b] v0'0 uv17 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-05-08T18:31:39.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 20 garbage collection: RGWGC::process iterating over entry tag='be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.3702986012995467996', time=2024-05-08T18:31:38.843620+0000, chain.objs.size()=7 2024-05-08T18:31:39.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_1 2024-05-08T18:31:39.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:129 3.21s0 3:85f87a73:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3f40 con 0x7fed4008d040 2024-05-08T18:31:39.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_2 2024-05-08T18:31:39.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:130 3.2cs0 3:37345e1c:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe8d20 con 0x55726fba1080 2024-05-08T18:31:39.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_3 2024-05-08T18:31:39.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:131 3.10s0 3:0b5f2b76:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbeb590 con 0x55726fb9ae30 2024-05-08T18:31:39.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_4 2024-05-08T18:31:39.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:132 3.3s0 3:c07cd9b4:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbede00 con 0x7fed48041020 2024-05-08T18:31:39.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_5 2024-05-08T18:31:39.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:133 3.16s0 3:6a35adba:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbf0670 con 0x7fed48041020 2024-05-08T18:31:39.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_6 2024-05-08T18:31:39.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:134 3.8s0 3:117514dd:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbf2f80 con 0x55726fba1080 2024-05-08T18:31:39.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_7 2024-05-08T18:31:39.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.201+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:135 3.31s0 3:8e449e50:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbf5bc0 con 0x7fed4008d040 2024-05-08T18:31:39.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.204+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 24 ==== osd_op_reply(132 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_4 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.204+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 34 ==== osd_op_reply(131 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_3 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.204+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(129 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_1 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.204+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(135 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_7 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.204+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 25 ==== osd_op_reply(133 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_5 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.206+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 49 ==== osd_op_reply(130 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_2 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.206+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 50 ==== osd_op_reply(134 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.1__shadow_.GbyUz7IYynMR2mhlmYvuDL9_5hCuQsz_6 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.206+0000 7fed5263b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-05-08T18:31:39.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.206+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:136 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbf5bc0 con 0x55726fba1080 2024-05-08T18:31:39.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.211+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 51 ==== osd_op_reply(136 gc.24 [call] v27'18 uv18 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.212+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:137 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbf5bc0 con 0x55726fba1080 2024-05-08T18:31:39.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.214+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 52 ==== osd_op_reply(137 gc.24 [call] v27'19 uv19 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.214+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-05-08T18:31:39.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.214+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:138 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbf5bc0 con 0x55726fba1080 2024-05-08T18:31:39.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.215+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 53 ==== osd_op_reply(138 gc.25 [call] v27'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.215+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:139 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbf5bc0 con 0x55726fba1080 2024-05-08T18:31:39.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.215+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 54 ==== osd_op_reply(139 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.215+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.215+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:140 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbf5bc0 con 0x55726fba1080 2024-05-08T18:31:39.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.216+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 55 ==== osd_op_reply(140 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.216+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:141 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbf5bc0 con 0x55726fba1080 2024-05-08T18:31:39.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.216+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 56 ==== osd_op_reply(141 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.216+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.216+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:142 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbf5bc0 con 0x55726fba1080 2024-05-08T18:31:39.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.216+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 57 ==== osd_op_reply(142 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.216+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.216+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:143 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbf5bc0 con 0x55726fba1080 2024-05-08T18:31:39.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.217+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 58 ==== osd_op_reply(143 gc.25 [call] v27'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.217+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-05-08T18:31:39.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.217+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:144 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbf5bc0 con 0x7fed4008d040 2024-05-08T18:31:39.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.218+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(144 gc.26 [call] v27'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.218+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:145 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.219+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(145 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.219+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.219+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:146 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.219+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 29 ==== osd_op_reply(146 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.219+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:147 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.219+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 30 ==== osd_op_reply(147 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.219+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.219+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:148 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.219+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 31 ==== osd_op_reply(148 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.219+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.219+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:149 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.220+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 32 ==== osd_op_reply(149 gc.26 [call] v27'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.220+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-05-08T18:31:39.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.220+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:150 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.221+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 59 ==== osd_op_reply(150 gc.27 [call] v27'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.221+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:151 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.221+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 60 ==== osd_op_reply(151 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.221+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.222+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:152 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.222+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 61 ==== osd_op_reply(152 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.222+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:153 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.222+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 62 ==== osd_op_reply(153 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.222+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.222+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:154 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.222+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 63 ==== osd_op_reply(154 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.222+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.222+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:155 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.223+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 64 ==== osd_op_reply(155 gc.27 [call] v27'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.223+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-05-08T18:31:39.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.223+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:156 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.224+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 33 ==== osd_op_reply(156 gc.28 [call] v27'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.224+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:157 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.225+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 34 ==== osd_op_reply(157 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.225+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.225+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:158 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.225+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 35 ==== osd_op_reply(158 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.225+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:159 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.225+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 36 ==== osd_op_reply(159 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.225+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.225+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:160 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.226+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 37 ==== osd_op_reply(160 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.226+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.226+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:161 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.227+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 38 ==== osd_op_reply(161 gc.28 [call] v27'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.227+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-05-08T18:31:39.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.227+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:162 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.228+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 65 ==== osd_op_reply(162 gc.29 [call] v27'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.228+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:163 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.228+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 66 ==== osd_op_reply(163 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.228+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.228+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:164 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.228+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 67 ==== osd_op_reply(164 gc.29 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.228+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:165 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.229+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 68 ==== osd_op_reply(165 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.229+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.229+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:166 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.229+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 69 ==== osd_op_reply(166 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.229+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.229+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:167 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.230+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 70 ==== osd_op_reply(167 gc.29 [call] v27'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.230+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-05-08T18:31:39.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.230+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:168 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.231+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 39 ==== osd_op_reply(168 gc.30 [call] v27'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.231+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:169 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.232+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 40 ==== osd_op_reply(169 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.232+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.232+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:170 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.232+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 41 ==== osd_op_reply(170 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.232+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:171 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.232+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 42 ==== osd_op_reply(171 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.232+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.232+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:172 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.232+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 43 ==== osd_op_reply(172 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.232+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.232+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:173 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.234+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 44 ==== osd_op_reply(173 gc.30 [call] v27'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.234+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-05-08T18:31:39.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.234+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:174 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.235+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 26 ==== osd_op_reply(174 gc.31 [call] v27'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.235+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:175 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.235+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 27 ==== osd_op_reply(175 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.235+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.235+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:176 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.235+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 28 ==== osd_op_reply(176 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.235+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:177 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.236+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 29 ==== osd_op_reply(177 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.236+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.236+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:178 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.236+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 30 ==== osd_op_reply(178 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.236+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.236+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:179 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.237+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 31 ==== osd_op_reply(179 gc.31 [call] v27'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.237+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-05-08T18:31:39.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.237+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:180 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.238+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 35 ==== osd_op_reply(180 gc.0 [call] v27'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.238+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:181 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.238+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 36 ==== osd_op_reply(181 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.238+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.238+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:182 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.238+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 37 ==== osd_op_reply(182 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.238+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:183 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.238+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 38 ==== osd_op_reply(183 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.238+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.238+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:184 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.239+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 39 ==== osd_op_reply(184 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.239+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.239+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:185 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.240+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 40 ==== osd_op_reply(185 gc.0 [call] v27'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.240+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-05-08T18:31:39.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.240+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:186 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.241+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 45 ==== osd_op_reply(186 gc.1 [call] v27'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.241+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:187 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.241+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 46 ==== osd_op_reply(187 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.241+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.241+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:188 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.241+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 47 ==== osd_op_reply(188 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.241+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:189 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.241+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 48 ==== osd_op_reply(189 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.241+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.241+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:190 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.242+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 49 ==== osd_op_reply(190 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.242+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.242+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:191 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.243+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 50 ==== osd_op_reply(191 gc.1 [call] v27'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.243+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-05-08T18:31:39.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.243+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:192 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.244+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 71 ==== osd_op_reply(192 gc.2 [call] v27'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.244+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:193 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.244+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 72 ==== osd_op_reply(193 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.244+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.244+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:194 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.244+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 73 ==== osd_op_reply(194 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.244+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:195 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.244+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 74 ==== osd_op_reply(195 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.244+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.244+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:196 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.245+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 75 ==== osd_op_reply(196 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.245+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.245+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:197 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.245+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 76 ==== osd_op_reply(197 gc.2 [call] v27'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.245+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-05-08T18:31:39.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.245+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:198 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.246+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 41 ==== osd_op_reply(198 gc.3 [call] v27'163 uv163 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.246+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:199 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.247+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 42 ==== osd_op_reply(199 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.247+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.247+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:200 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.247+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 43 ==== osd_op_reply(200 gc.3 [call out=24b] v0'0 uv163 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.247+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:201 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.247+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 44 ==== osd_op_reply(201 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.247+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.247+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:202 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.247+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 45 ==== osd_op_reply(202 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.247+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.247+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:203 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.248+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 46 ==== osd_op_reply(203 gc.3 [call] v27'164 uv164 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.248+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-05-08T18:31:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.248+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:204 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.249+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 32 ==== osd_op_reply(204 gc.4 [call] v27'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.249+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:205 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.249+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 33 ==== osd_op_reply(205 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.249+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.249+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:206 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.250+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 34 ==== osd_op_reply(206 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.250+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:207 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.250+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 35 ==== osd_op_reply(207 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.250+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.250+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:208 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.250+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 36 ==== osd_op_reply(208 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.250+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.250+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:209 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.251+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 37 ==== osd_op_reply(209 gc.4 [call] v27'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.251+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-05-08T18:31:39.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.251+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:210 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.252+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 77 ==== osd_op_reply(210 gc.5 [call] v27'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.252+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:211 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.252+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 78 ==== osd_op_reply(211 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.252+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.252+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:212 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.253+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 79 ==== osd_op_reply(212 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.253+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:213 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.253+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 80 ==== osd_op_reply(213 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.253+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.253+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:214 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.253+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 81 ==== osd_op_reply(214 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.253+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.253+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:215 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.254+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 82 ==== osd_op_reply(215 gc.5 [call] v27'37 uv37 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.254+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-05-08T18:31:39.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.254+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:216 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.255+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 47 ==== osd_op_reply(216 gc.6 [call] v27'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.255+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:217 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.255+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 48 ==== osd_op_reply(217 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.255+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.255+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:218 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbea050 con 0x55726fb9ae30 2024-05-08T18:31:39.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.256+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 49 ==== osd_op_reply(218 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.256+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:219 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.256+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 50 ==== osd_op_reply(219 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.256+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.256+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:220 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.256+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 51 ==== osd_op_reply(220 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.256+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.256+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:221 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.257+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 52 ==== osd_op_reply(221 gc.6 [call] v27'24 uv24 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.257+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-05-08T18:31:39.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.257+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:222 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.258+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 51 ==== osd_op_reply(222 gc.7 [call] v27'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.258+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:223 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.258+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 52 ==== osd_op_reply(223 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.258+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.258+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:224 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.259+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 53 ==== osd_op_reply(224 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.259+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:225 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.259+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 54 ==== osd_op_reply(225 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.259+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.259+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:226 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.259+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 55 ==== osd_op_reply(226 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.259+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.259+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:227 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.260+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 56 ==== osd_op_reply(227 gc.7 [call] v27'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.260+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-05-08T18:31:39.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.260+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:228 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.261+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 38 ==== osd_op_reply(228 gc.8 [call] v27'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.261+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:229 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.262+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 39 ==== osd_op_reply(229 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.262+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.262+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:230 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.262+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 40 ==== osd_op_reply(230 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.262+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:231 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.262+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 41 ==== osd_op_reply(231 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.262+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.262+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:232 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.262+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 42 ==== osd_op_reply(232 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.263+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.263+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:233 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.264+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 43 ==== osd_op_reply(233 gc.8 [call] v27'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.264+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-05-08T18:31:39.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.264+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:234 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.265+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 83 ==== osd_op_reply(234 gc.9 [call] v27'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.265+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:235 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.265+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 84 ==== osd_op_reply(235 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.265+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.265+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:236 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.265+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 85 ==== osd_op_reply(236 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.265+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:237 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.265+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 86 ==== osd_op_reply(237 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.265+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.265+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:238 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.265+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 87 ==== osd_op_reply(238 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.265+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.265+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:239 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.266+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 88 ==== osd_op_reply(239 gc.9 [call] v27'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.266+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-05-08T18:31:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.266+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:240 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.267+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 44 ==== osd_op_reply(240 gc.10 [call] v27'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.267+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:241 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.267+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 45 ==== osd_op_reply(241 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.267+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.267+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:242 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.268+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 46 ==== osd_op_reply(242 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.268+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:243 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.268+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 47 ==== osd_op_reply(243 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.268+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.268+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:244 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.268+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 48 ==== osd_op_reply(244 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.268+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.268+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:245 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.269+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 49 ==== osd_op_reply(245 gc.10 [call] v27'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.269+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-05-08T18:31:39.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.269+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:246 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.270+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 57 ==== osd_op_reply(246 gc.11 [call] v27'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.270+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:247 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.271+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 58 ==== osd_op_reply(247 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.271+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.271+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:248 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbea050 con 0x7fed4008d040 2024-05-08T18:31:39.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.271+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 59 ==== osd_op_reply(248 gc.11 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.271+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:249 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.271+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 60 ==== osd_op_reply(249 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.271+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.271+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:250 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.272+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 61 ==== osd_op_reply(250 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.272+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.272+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:251 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.273+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 62 ==== osd_op_reply(251 gc.11 [call] v27'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.273+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-05-08T18:31:39.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.273+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:252 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.274+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 50 ==== osd_op_reply(252 gc.12 [call] v27'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.274+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:253 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.274+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 51 ==== osd_op_reply(253 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.274+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.274+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:254 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.274+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 52 ==== osd_op_reply(254 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.274+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:255 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.274+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 53 ==== osd_op_reply(255 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.274+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.274+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:256 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.275+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 54 ==== osd_op_reply(256 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.275+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.275+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:257 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.276+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 55 ==== osd_op_reply(257 gc.12 [call] v27'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.276+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-05-08T18:31:39.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.276+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:258 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.277+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 63 ==== osd_op_reply(258 gc.13 [call] v27'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.277+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:259 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.277+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 64 ==== osd_op_reply(259 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.277+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.277+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:260 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbea050 con 0x7fed4008d040 2024-05-08T18:31:39.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.277+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 65 ==== osd_op_reply(260 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.277+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:261 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.278+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 66 ==== osd_op_reply(261 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.278+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.278+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:262 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.278+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 67 ==== osd_op_reply(262 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.278+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.278+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:263 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.279+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 68 ==== osd_op_reply(263 gc.13 [call] v27'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.279+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-05-08T18:31:39.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.279+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:264 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.280+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 53 ==== osd_op_reply(264 gc.14 [call] v27'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.280+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:265 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.280+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 54 ==== osd_op_reply(265 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.280+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.280+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:266 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.280+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 55 ==== osd_op_reply(266 gc.14 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.280+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:267 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.280+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 56 ==== osd_op_reply(267 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.281+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.281+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:268 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.281+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 57 ==== osd_op_reply(268 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.281+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.281+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:269 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.282+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 58 ==== osd_op_reply(269 gc.14 [call] v27'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.282+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-05-08T18:31:39.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.282+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:270 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.283+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 89 ==== osd_op_reply(270 gc.15 [call] v27'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.283+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:271 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.283+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 90 ==== osd_op_reply(271 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.283+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.283+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:272 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbea050 con 0x55726fba1080 2024-05-08T18:31:39.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.283+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 91 ==== osd_op_reply(272 gc.15 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.283+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:273 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.283+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 92 ==== osd_op_reply(273 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.283+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.283+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:274 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.284+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 93 ==== osd_op_reply(274 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.284+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.284+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:275 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.285+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 94 ==== osd_op_reply(275 gc.15 [call] v27'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.285+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-05-08T18:31:39.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.285+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:276 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.286+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 56 ==== osd_op_reply(276 gc.16 [call] v27'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.286+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:277 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.286+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 57 ==== osd_op_reply(277 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.286+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.286+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:278 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.286+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 58 ==== osd_op_reply(278 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.286+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:279 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.286+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 59 ==== osd_op_reply(279 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.286+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.286+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:280 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.287+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 60 ==== osd_op_reply(280 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.287+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.287+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:281 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.288+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 61 ==== osd_op_reply(281 gc.16 [call] v27'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.288+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-05-08T18:31:39.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.288+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:282 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.288+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 95 ==== osd_op_reply(282 gc.17 [call] v27'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.288+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:283 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.289+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 96 ==== osd_op_reply(283 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.289+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.289+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:284 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.289+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 97 ==== osd_op_reply(284 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.289+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:285 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.289+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 98 ==== osd_op_reply(285 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.289+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.289+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:286 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.289+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 99 ==== osd_op_reply(286 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.289+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.289+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:287 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.290+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 100 ==== osd_op_reply(287 gc.17 [call] v27'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.290+0000 7fed5263b800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-05-08T18:31:39.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.290+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:288 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.292+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 59 ==== osd_op_reply(288 gc.18 [call] v27'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.292+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:289 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.292+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 60 ==== osd_op_reply(289 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.292+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.292+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:290 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.292+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 61 ==== osd_op_reply(290 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.292+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:291 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.292+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 62 ==== osd_op_reply(291 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.292+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:31:39.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.292+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:292 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.293+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 63 ==== osd_op_reply(292 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.293+0000 7fed5263b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:31:39.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.293+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:293 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.294+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 64 ==== osd_op_reply(293 gc.18 [call] v27'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.295+0000 7fec067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:39.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.295+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93949989141808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.295+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 93949989141808] v27'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.295+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93949989115568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.296+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 93949989115568] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.296+0000 7fed5263b800 20 remove_watcher() i=0 2024-05-08T18:31:39.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.296+0000 7fed5263b800 2 removed watcher, disabling cache 2024-05-08T18:31:39.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.296+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93949989119840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.298+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 93949989119840] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.298+0000 7fed5263b800 20 remove_watcher() i=1 2024-05-08T18:31:39.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.298+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93949989124640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fba1080 2024-05-08T18:31:39.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.299+0000 7fed50934640 1 -- 172.21.15.87:0/1400709571 <== osd.3 v2:172.21.15.87:6800/2929215285 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 93949989124640] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed48029070 con 0x55726fba1080 2024-05-08T18:31:39.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.299+0000 7fed5263b800 20 remove_watcher() i=2 2024-05-08T18:31:39.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.299+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93949989121968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed48041020 2024-05-08T18:31:39.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.300+0000 7fed50133640 1 -- 172.21.15.87:0/1400709571 <== osd.2 v2:172.21.15.87:6816/2108501615 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 93949989121968] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed40073030 con 0x7fed48041020 2024-05-08T18:31:39.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.300+0000 7fed5263b800 20 remove_watcher() i=3 2024-05-08T18:31:39.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.300+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93949989132000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x55726fb9ae30 2024-05-08T18:31:39.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.301+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.1 v2:172.21.15.87:6808/2448644045 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 93949989132000] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x55726fb9ae30 2024-05-08T18:31:39.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.301+0000 7fed5263b800 20 remove_watcher() i=4 2024-05-08T18:31:39.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.301+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93949989135600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.302+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 69 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 93949989135600] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.302+0000 7fed5263b800 20 remove_watcher() i=5 2024-05-08T18:31:39.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.302+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93949989137856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.303+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 70 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 93949989137856] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.303+0000 7fed5263b800 20 remove_watcher() i=6 2024-05-08T18:31:39.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.303+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93949989140752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55726fbe3930 con 0x7fed4008d040 2024-05-08T18:31:39.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 <== osd.0 v2:172.21.15.53:6800/443747735 71 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 93949989140752] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed4402a040 con 0x7fed4008d040 2024-05-08T18:31:39.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 20 remove_watcher() i=7 2024-05-08T18:31:39.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fed4008d040 msgr2=0x7fed400953d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fed4008d040 0x7fed400953d0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55726fb9ae30 msgr2=0x55726fb9d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55726fb9ae30 0x55726fb9d2f0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fed48041020 msgr2=0x7fed48036460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fed48041020 0x7fed48036460 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55726fba1080 msgr2=0x55726fba3470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55726fba1080 0x55726fba3470 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fec2003bb50 msgr2=0x7fec2003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fec2003bb50 0x7fec2003e010 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fed400942b0 tx=0x7fed40088000 comp rx=0 tx=0).stop 2024-05-08T18:31:39.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb87bb0 msgr2=0x55726fb8f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed4f932640 1 -- 172.21.15.87:0/1400709571 reap_dead start 2024-05-08T18:31:39.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb87bb0 0x55726fb8f1a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fed48015fd0 tx=0x7fed48052940 comp rx=0 tx=0).stop 2024-05-08T18:31:39.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 shutdown_connections 2024-05-08T18:31:39.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 --2- 172.21.15.87:0/1400709571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb87bb0 0x55726fb8f1a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 >> 172.21.15.87:0/1400709571 conn(0x55726fb83f10 msgr2=0x55726fb81570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 shutdown_connections 2024-05-08T18:31:39.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 -- 172.21.15.87:0/1400709571 wait complete. 2024-05-08T18:31:39.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 -- 172.21.15.87:0/1678133089 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fec2803bb50 msgr2=0x7fec2803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 --2- 172.21.15.87:0/1678133089 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fec2803bb50 0x7fec2803e010 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x55726fb63ba0 tx=0x7fed40052f90 comp rx=0 tx=0).stop 2024-05-08T18:31:39.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 -- 172.21.15.87:0/1678133089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb7a890 msgr2=0x55726fb7acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.305+0000 7fed5263b800 1 --2- 172.21.15.87:0/1678133089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb7a890 0x55726fb7acb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x55726fb5c170 tx=0x7fed480178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 -- 172.21.15.87:0/1678133089 shutdown_connections 2024-05-08T18:31:39.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 --2- 172.21.15.87:0/1678133089 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fec2803bb50 0x7fec2803e010 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 --2- 172.21.15.87:0/1678133089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fb7a890 0x55726fb7acb0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 -- 172.21.15.87:0/1678133089 >> 172.21.15.87:0/1678133089 conn(0x55726fb6a520 msgr2=0x55726fb6a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 -- 172.21.15.87:0/1678133089 shutdown_connections 2024-05-08T18:31:39.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 -- 172.21.15.87:0/1678133089 wait complete. 2024-05-08T18:31:39.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 -- 172.21.15.87:0/1613453964 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55726fb65710 msgr2=0x55726fb67b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55726fb65710 0x55726fb67b00 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 -- 172.21.15.87:0/1613453964 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55726fa64390 msgr2=0x55726fb62190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55726fa64390 0x55726fb62190 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 -- 172.21.15.87:0/1613453964 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fec3803bba0 msgr2=0x7fec3803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fec3803bba0 0x7fec3803e060 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fed44001d90 tx=0x7fed440012f0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 -- 172.21.15.87:0/1613453964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 msgr2=0x55726fb5afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 0x55726fb5afa0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fed4001ce60 tx=0x7fed40002fb0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 -- 172.21.15.87:0/1613453964 shutdown_connections 2024-05-08T18:31:39.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55726fa64390 0x55726fb62190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55726fb65710 0x55726fb67b00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fec3803bba0 0x7fec3803e060 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 --2- 172.21.15.87:0/1613453964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55726fa63130 0x55726fb5afa0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 -- 172.21.15.87:0/1613453964 >> 172.21.15.87:0/1613453964 conn(0x55726fa5e710 msgr2=0x55726fb53060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 -- 172.21.15.87:0/1613453964 shutdown_connections 2024-05-08T18:31:39.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.306+0000 7fed5263b800 1 -- 172.21.15.87:0/1613453964 wait complete. 2024-05-08T18:31:39.320 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-05-08T18:31:39.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-05-08T18:31:39.321 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-05-08T18:31:39.403 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:39.404 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:39.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.406+0000 7ff47192d800 1 Processor -- start 2024-05-08T18:31:39.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.406+0000 7ff47192d800 1 -- start start 2024-05-08T18:31:39.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.406+0000 7ff47192d800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55728c0094b0 0x55728c098de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.406+0000 7ff47192d800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55728c09d080 con 0x55728c099380 2024-05-08T18:31:39.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.406+0000 7ff47192d800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55728bf36e20 con 0x55728c0094b0 2024-05-08T18:31:39.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.407+0000 7ff46d6be640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55728c0094b0 0x55728c098de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.407+0000 7ff46cebd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55728c099380 0x55728c09b820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:51550/0 (socket says 172.21.15.87:51550) 2024-05-08T18:31:39.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.407+0000 7ff46cebd640 1 -- 172.21.15.87:0/728773912 learned_addr learned my addr 172.21.15.87:0/728773912 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:39.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.407+0000 7ff45ffff640 1 -- 172.21.15.87:0/728773912 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 742603641 0 0) 0x55728c09d080 con 0x55728c099380 2024-05-08T18:31:39.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.407+0000 7ff45ffff640 1 -- 172.21.15.87:0/728773912 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff458001e10 con 0x55728c099380 2024-05-08T18:31:39.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.407+0000 7ff46d6be640 1 -- 172.21.15.87:0/728773912 >> v1:172.21.15.53:6789/0 conn(0x55728c099380 legacy=0x55728c09b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.407+0000 7ff46d6be640 1 -- 172.21.15.87:0/728773912 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55728c09e2b0 con 0x55728c0094b0 2024-05-08T18:31:39.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.409+0000 7ff46d6be640 1 --2- 172.21.15.87:0/728773912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 0x55728c098de0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff460005fd0 tx=0x7ff46001cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2df4e5d99a9d7e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.409+0000 7ff45ffff640 1 -- 172.21.15.87:0/728773912 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff460052560 con 0x55728c0094b0 2024-05-08T18:31:39.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.409+0000 7ff45ffff640 1 -- 172.21.15.87:0/728773912 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff460052700 con 0x55728c0094b0 2024-05-08T18:31:39.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.409+0000 7ff45ffff640 1 -- 172.21.15.87:0/728773912 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff460052a60 con 0x55728c0094b0 2024-05-08T18:31:39.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.409+0000 7ff47192d800 1 -- 172.21.15.87:0/728773912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 msgr2=0x55728c098de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.409+0000 7ff47192d800 1 --2- 172.21.15.87:0/728773912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 0x55728c098de0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff460005fd0 tx=0x7ff46001cbe0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.410+0000 7ff47192d800 1 -- 172.21.15.87:0/728773912 shutdown_connections 2024-05-08T18:31:39.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.410+0000 7ff47192d800 1 --2- 172.21.15.87:0/728773912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 0x55728c098de0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.410+0000 7ff47192d800 1 -- 172.21.15.87:0/728773912 >> 172.21.15.87:0/728773912 conn(0x55728c090720 msgr2=0x55728c092b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.410+0000 7ff47192d800 1 -- 172.21.15.87:0/728773912 shutdown_connections 2024-05-08T18:31:39.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.410+0000 7ff47192d800 1 -- 172.21.15.87:0/728773912 wait complete. 2024-05-08T18:31:39.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.423+0000 7ff47192d800 1 Processor -- start 2024-05-08T18:31:39.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.423+0000 7ff47192d800 1 -- start start 2024-05-08T18:31:39.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.424+0000 7ff47192d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 0x55728c1873c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.424+0000 7ff47192d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55728bfe15b0 con 0x55728c0094b0 2024-05-08T18:31:39.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.424+0000 7ff46d6be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 0x55728c1873c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.424+0000 7ff46d6be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 0x55728c1873c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58980/0 (socket says 172.21.15.87:58980) 2024-05-08T18:31:39.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.424+0000 7ff46d6be640 1 -- 172.21.15.87:0/156517524 learned_addr learned my addr 172.21.15.87:0/156517524 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.424+0000 7ff46d6be640 1 -- 172.21.15.87:0/156517524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55728c187990 con 0x55728c0094b0 2024-05-08T18:31:39.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.425+0000 7ff46d6be640 1 --2- 172.21.15.87:0/156517524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 0x55728c1873c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff460007000 tx=0x7ff46004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2f669f1b3acd6a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.425+0000 7ff35b606640 1 -- 172.21.15.87:0/156517524 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4600529e0 con 0x55728c0094b0 2024-05-08T18:31:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.425+0000 7ff35b606640 1 -- 172.21.15.87:0/156517524 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff460052b80 con 0x55728c0094b0 2024-05-08T18:31:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.425+0000 7ff35b606640 1 -- 172.21.15.87:0/156517524 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff46005c430 con 0x55728c0094b0 2024-05-08T18:31:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.425+0000 7ff47192d800 1 -- 172.21.15.87:0/156517524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 msgr2=0x55728c1873c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.425+0000 7ff47192d800 1 --2- 172.21.15.87:0/156517524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 0x55728c1873c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff460007000 tx=0x7ff46004c000 comp rx=0 tx=0).stop 2024-05-08T18:31:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.425+0000 7ff47192d800 1 -- 172.21.15.87:0/156517524 shutdown_connections 2024-05-08T18:31:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.425+0000 7ff47192d800 1 --2- 172.21.15.87:0/156517524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 0x55728c1873c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.426+0000 7ff47192d800 1 -- 172.21.15.87:0/156517524 >> 172.21.15.87:0/156517524 conn(0x55728c090720 msgr2=0x55728c182ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.426+0000 7ff47192d800 1 -- 172.21.15.87:0/156517524 shutdown_connections 2024-05-08T18:31:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.426+0000 7ff47192d800 1 -- 172.21.15.87:0/156517524 wait complete. 2024-05-08T18:31:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.426+0000 7ff47192d800 1 Processor -- start 2024-05-08T18:31:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.426+0000 7ff47192d800 1 -- start start 2024-05-08T18:31:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.426+0000 7ff47192d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 0x55728c096710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.426+0000 7ff47192d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55728c09d4f0 con 0x55728c0094b0 2024-05-08T18:31:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.426+0000 7ff46d6be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 0x55728c096710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.426+0000 7ff46d6be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 0x55728c096710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58984/0 (socket says 172.21.15.87:58984) 2024-05-08T18:31:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.426+0000 7ff46d6be640 1 -- 172.21.15.87:0/2900694104 learned_addr learned my addr 172.21.15.87:0/2900694104 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.427+0000 7ff46d6be640 1 -- 172.21.15.87:0/2900694104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55728c094e00 con 0x55728c0094b0 2024-05-08T18:31:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.427+0000 7ff46d6be640 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 0x55728c096710 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff460007000 tx=0x7ff460003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.427+0000 7ff359e03640 1 -- 172.21.15.87:0/2900694104 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff460074070 con 0x55728c0094b0 2024-05-08T18:31:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.427+0000 7ff359e03640 1 -- 172.21.15.87:0/2900694104 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff46006f430 con 0x55728c0094b0 2024-05-08T18:31:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.427+0000 7ff47192d800 1 -- 172.21.15.87:0/2900694104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55728c095090 con 0x55728c0094b0 2024-05-08T18:31:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.427+0000 7ff359e03640 1 -- 172.21.15.87:0/2900694104 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff46006f750 con 0x55728c0094b0 2024-05-08T18:31:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.427+0000 7ff47192d800 1 -- 172.21.15.87:0/2900694104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55728c095610 con 0x55728c0094b0 2024-05-08T18:31:39.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.428+0000 7ff359e03640 1 -- 172.21.15.87:0/2900694104 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff4600663f0 con 0x55728c0094b0 2024-05-08T18:31:39.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.428+0000 7ff359e03640 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff35403bba0 0x7ff35403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.428+0000 7ff359e03640 1 -- 172.21.15.87:0/2900694104 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff46006c050 con 0x55728c0094b0 2024-05-08T18:31:39.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.428+0000 7ff46cebd640 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff35403bba0 0x7ff35403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.428+0000 7ff47192d800 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55728c099380 0x55728c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.428+0000 7ff47192d800 1 -- 172.21.15.87:0/2900694104 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c198930 con 0x55728c099380 2024-05-08T18:31:39.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.429+0000 7ff46debf640 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55728c099380 0x55728c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.429+0000 7ff46cebd640 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff35403bba0 0x7ff35403e060 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff464000f60 tx=0x7ff4640010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.429+0000 7ff46debf640 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55728c099380 0x55728c1983f0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.429+0000 7ff46debf640 1 -- 172.21.15.87:0/2900694104 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4680083e0 con 0x55728c099380 2024-05-08T18:31:39.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.429+0000 7ff47192d800 1 -- 172.21.15.87:0/2900694104 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c199180 con 0x55728c099380 2024-05-08T18:31:39.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.430+0000 7ff46debf640 1 -- 172.21.15.87:0/2900694104 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff4680083e0 con 0x55728c099380 2024-05-08T18:31:39.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.430+0000 7ff47192d800 1 -- 172.21.15.87:0/2900694104 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c19a530 con 0x55728c099380 2024-05-08T18:31:39.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.430+0000 7ff46debf640 1 -- 172.21.15.87:0/2900694104 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff4680083e0 con 0x55728c099380 2024-05-08T18:31:39.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.430+0000 7ff47192d800 1 -- 172.21.15.87:0/2900694104 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c1999d0 con 0x55728c099380 2024-05-08T18:31:39.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.430+0000 7ff46debf640 1 -- 172.21.15.87:0/2900694104 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff4680083e0 con 0x55728c099380 2024-05-08T18:31:39.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.430+0000 7ff47192d800 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55728c19b980 0x55728c19dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.430+0000 7ff47192d800 1 -- 172.21.15.87:0/2900694104 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c19e410 con 0x55728c19b980 2024-05-08T18:31:39.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.431+0000 7ff46d6be640 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55728c19b980 0x55728c19dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.431+0000 7ff46d6be640 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55728c19b980 0x55728c19dd70 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.431+0000 7ff46d6be640 1 -- 172.21.15.87:0/2900694104 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff460064070 con 0x55728c19b980 2024-05-08T18:31:39.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.431+0000 7ff47192d800 1 Processor -- start 2024-05-08T18:31:39.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.431+0000 7ff47192d800 1 -- start start 2024-05-08T18:31:39.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.432+0000 7ff47192d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1ac740 0x55728c1acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.432+0000 7ff47192d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55728c096c50 con 0x55728c1ac740 2024-05-08T18:31:39.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.432+0000 7ff46debf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1ac740 0x55728c1acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.432+0000 7ff46debf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1ac740 0x55728c1acb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58986/0 (socket says 172.21.15.87:58986) 2024-05-08T18:31:39.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.432+0000 7ff46debf640 1 -- 172.21.15.87:0/3716209029 learned_addr learned my addr 172.21.15.87:0/3716209029 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.432+0000 7ff46debf640 1 -- 172.21.15.87:0/3716209029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55728c1ad0a0 con 0x55728c1ac740 2024-05-08T18:31:39.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.432+0000 7ff46debf640 1 --2- 172.21.15.87:0/3716209029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1ac740 0x55728c1acb60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55728c095f70 tx=0x7ff46800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.432+0000 7ff352ffd640 1 -- 172.21.15.87:0/3716209029 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff46801c070 con 0x55728c1ac740 2024-05-08T18:31:39.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.432+0000 7ff352ffd640 1 -- 172.21.15.87:0/3716209029 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff46800bdc0 con 0x55728c1ac740 2024-05-08T18:31:39.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.432+0000 7ff47192d800 1 -- 172.21.15.87:0/3716209029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55728c1adb10 con 0x55728c1ac740 2024-05-08T18:31:39.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.432+0000 7ff352ffd640 1 -- 172.21.15.87:0/3716209029 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff468018540 con 0x55728c1ac740 2024-05-08T18:31:39.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.433+0000 7ff47192d800 1 -- 172.21.15.87:0/3716209029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55728c1ae010 con 0x55728c1ac740 2024-05-08T18:31:39.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.433+0000 7ff352ffd640 1 -- 172.21.15.87:0/3716209029 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff46801f070 con 0x55728c1ac740 2024-05-08T18:31:39.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.434+0000 7ff352ffd640 1 --2- 172.21.15.87:0/3716209029 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff34403bb50 0x7ff34403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.434+0000 7ff352ffd640 1 -- 172.21.15.87:0/3716209029 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff4680546a0 con 0x55728c1ac740 2024-05-08T18:31:39.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.434+0000 7ff46d6be640 1 --2- 172.21.15.87:0/3716209029 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff34403bb50 0x7ff34403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.434+0000 7ff47192d800 1 Processor -- start 2024-05-08T18:31:39.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.434+0000 7ff46d6be640 1 --2- 172.21.15.87:0/3716209029 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff34403bb50 0x7ff34403e010 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff460076db0 tx=0x7ff460052aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.434+0000 7ff47192d800 1 -- start start 2024-05-08T18:31:39.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.434+0000 7ff47192d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1b9ab0 0x55728c1b9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.434+0000 7ff47192d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55728bf87fc0 con 0x55728c1b9ab0 2024-05-08T18:31:39.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.434+0000 7ff46debf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1b9ab0 0x55728c1b9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.434+0000 7ff46debf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1b9ab0 0x55728c1b9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:58992/0 (socket says 172.21.15.87:58992) 2024-05-08T18:31:39.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.434+0000 7ff46debf640 1 -- 172.21.15.87:0/2984955108 learned_addr learned my addr 172.21.15.87:0/2984955108 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.435+0000 7ff46debf640 1 -- 172.21.15.87:0/2984955108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55728c1ba4a0 con 0x55728c1b9ab0 2024-05-08T18:31:39.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.435+0000 7ff46debf640 1 --2- 172.21.15.87:0/2984955108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1b9ab0 0x55728c1b9ed0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff468052a40 tx=0x7ff468014bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0fac6521c23177 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.435+0000 7ff350ff9640 1 -- 172.21.15.87:0/2984955108 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4680173a0 con 0x55728c1b9ab0 2024-05-08T18:31:39.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.435+0000 7ff350ff9640 1 -- 172.21.15.87:0/2984955108 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff468017540 con 0x55728c1b9ab0 2024-05-08T18:31:39.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.435+0000 7ff350ff9640 1 -- 172.21.15.87:0/2984955108 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff468051300 con 0x55728c1b9ab0 2024-05-08T18:31:39.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.435+0000 7ff47192d800 1 -- 172.21.15.87:0/2984955108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1b9ab0 msgr2=0x55728c1b9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.435+0000 7ff47192d800 1 --2- 172.21.15.87:0/2984955108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1b9ab0 0x55728c1b9ed0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff468052a40 tx=0x7ff468014bb0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.435+0000 7ff47192d800 1 -- 172.21.15.87:0/2984955108 shutdown_connections 2024-05-08T18:31:39.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.435+0000 7ff47192d800 1 --2- 172.21.15.87:0/2984955108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1b9ab0 0x55728c1b9ed0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.435+0000 7ff47192d800 1 -- 172.21.15.87:0/2984955108 >> 172.21.15.87:0/2984955108 conn(0x55728c1b5d80 msgr2=0x55728c1b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.435+0000 7ff47192d800 1 -- 172.21.15.87:0/2984955108 shutdown_connections 2024-05-08T18:31:39.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.436+0000 7ff47192d800 1 -- 172.21.15.87:0/2984955108 wait complete. 2024-05-08T18:31:39.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.436+0000 7ff47192d800 1 Processor -- start 2024-05-08T18:31:39.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.436+0000 7ff47192d800 1 -- start start 2024-05-08T18:31:39.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.436+0000 7ff47192d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1b9ab0 0x55728c1c0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.436+0000 7ff47192d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55728c1baae0 con 0x55728c1b9ab0 2024-05-08T18:31:39.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.436+0000 7ff46debf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1b9ab0 0x55728c1c0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.436+0000 7ff46debf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1b9ab0 0x55728c1c0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59008/0 (socket says 172.21.15.87:59008) 2024-05-08T18:31:39.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.436+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 learned_addr learned my addr 172.21.15.87:0/1731712904 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.436+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55728c1c13c0 con 0x55728c1b9ab0 2024-05-08T18:31:39.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.437+0000 7ff46debf640 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1b9ab0 0x55728c1c0e80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff468052ad0 tx=0x7ff4680529a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.437+0000 7ff342ffd640 1 -- 172.21.15.87:0/1731712904 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff468049040 con 0x55728c1b9ab0 2024-05-08T18:31:39.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.437+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55728c1c1650 con 0x55728c1b9ab0 2024-05-08T18:31:39.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.437+0000 7ff342ffd640 1 -- 172.21.15.87:0/1731712904 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff468054070 con 0x55728c1b9ab0 2024-05-08T18:31:39.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.437+0000 7ff342ffd640 1 -- 172.21.15.87:0/1731712904 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4680173a0 con 0x55728c1b9ab0 2024-05-08T18:31:39.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.437+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55728c1c4300 con 0x55728c1b9ab0 2024-05-08T18:31:39.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.437+0000 7ff342ffd640 1 -- 172.21.15.87:0/1731712904 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff468054220 con 0x55728c1b9ab0 2024-05-08T18:31:39.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.438+0000 7ff342ffd640 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff33803bb50 0x7ff33803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.438+0000 7ff342ffd640 1 -- 172.21.15.87:0/1731712904 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff46803e020 con 0x55728c1b9ab0 2024-05-08T18:31:39.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.438+0000 7ff46d6be640 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff33803bb50 0x7ff33803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.438+0000 7ff47192d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.438+0000 7ff46d6be640 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff33803bb50 0x7ff33803e010 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff460092ec0 tx=0x7ff460089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.438+0000 7ff47192d800 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55728c1cc8a0 0x55728c1ced60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.438+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c1cf4b0 con 0x55728c1cc8a0 2024-05-08T18:31:39.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.438+0000 7ff46cebd640 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55728c1cc8a0 0x55728c1ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.439+0000 7ff46cebd640 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55728c1cc8a0 0x55728c1ced60 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.439+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff464009050 con 0x55728c1cc8a0 2024-05-08T18:31:39.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.439+0000 7ff47192d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.439+0000 7ff47192d800 20 realm 2024-05-08T18:31:39.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.439+0000 7ff47192d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.439+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c1cbcf0 con 0x55728c1cc8a0 2024-05-08T18:31:39.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.439+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff464009050 con 0x55728c1cc8a0 2024-05-08T18:31:39.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.439+0000 7ff47192d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.439+0000 7ff47192d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:39.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.439+0000 7ff47192d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.439+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c1cff90 con 0x55728c1cc8a0 2024-05-08T18:31:39.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.439+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff464009050 con 0x55728c1cc8a0 2024-05-08T18:31:39.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.439+0000 7ff47192d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.439+0000 7ff47192d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.439+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d0860 con 0x55728c1cc8a0 2024-05-08T18:31:39.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.440+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff464009050 con 0x55728c1cc8a0 2024-05-08T18:31:39.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.440+0000 7ff47192d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:39.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.440+0000 7ff47192d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.440+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d0c00 con 0x55728c1cc8a0 2024-05-08T18:31:39.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.440+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff464009050 con 0x55728c1cc8a0 2024-05-08T18:31:39.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.440+0000 7ff47192d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:39.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.440+0000 7ff47192d800 20 searching for the correct realm 2024-05-08T18:31:39.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.440+0000 7ff47192d800 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55728c1d2ae0 0x55728c1d4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.440+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x55728c1d2ae0 2024-05-08T18:31:39.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.440+0000 7ff46debf640 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55728c1d2ae0 0x55728c1d4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.440+0000 7ff46debf640 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55728c1d2ae0 0x55728c1d4ed0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.441+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.441+0000 7ff46debf640 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff468021070 0x7ff468034a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.441+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x7ff468021070 2024-05-08T18:31:39.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.441+0000 7ff46d6be640 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff468021070 0x7ff468034a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.441+0000 7ff46d6be640 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff468021070 0x7ff468034a50 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.441+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.441+0000 7ff46d6be640 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff460085040 0x7ff46006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.441+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x7ff460085040 2024-05-08T18:31:39.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.442+0000 7ff46cebd640 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff460085040 0x7ff46006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.442+0000 7ff46cebd640 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff460085040 0x7ff46006e8d0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.442+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff464009050 con 0x7ff460085040 2024-05-08T18:31:39.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.442+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x55728c1cc8a0 2024-05-08T18:31:39.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.442+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff464009050 con 0x55728c1cc8a0 2024-05-08T18:31:39.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.442+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x55728c1cc8a0 2024-05-08T18:31:39.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.443+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.443+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x7ff460085040 2024-05-08T18:31:39.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.443+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.443+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x7ff460085040 2024-05-08T18:31:39.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.443+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.443+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x7ff468021070 2024-05-08T18:31:39.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.444+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.444+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x55728c1d2ae0 2024-05-08T18:31:39.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.444+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.444+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x55728c1cc8a0 2024-05-08T18:31:39.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.444+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.444+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x7ff460085040 2024-05-08T18:31:39.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.444+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.444+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x55728c1cc8a0 2024-05-08T18:31:39.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.445+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.445+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x7ff468021070 2024-05-08T18:31:39.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.445+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.445+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x55728c1d2ae0 2024-05-08T18:31:39.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.445+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.445+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x55728c1d2ae0 2024-05-08T18:31:39.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.445+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.445+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x7ff460085040 2024-05-08T18:31:39.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.446+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.446+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x55728c1d2ae0 2024-05-08T18:31:39.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.446+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.446+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x55728c1d2ae0 2024-05-08T18:31:39.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.446+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.446+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x55728c1cc8a0 2024-05-08T18:31:39.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.446+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.446+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x55728c1cc8a0 2024-05-08T18:31:39.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.446+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.446+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x7ff460085040 2024-05-08T18:31:39.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.447+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.447+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x55728c1d2ae0 2024-05-08T18:31:39.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.447+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.447+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x7ff468021070 2024-05-08T18:31:39.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.447+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.447+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x55728c1cc8a0 2024-05-08T18:31:39.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.447+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.447+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x7ff460085040 2024-05-08T18:31:39.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.448+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.448+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x55728c1d2ae0 2024-05-08T18:31:39.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.448+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.448+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x7ff460085040 2024-05-08T18:31:39.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.448+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.449+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x7ff468021070 2024-05-08T18:31:39.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.449+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.449+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x55728c1d2ae0 2024-05-08T18:31:39.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.449+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.449+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x7ff460085040 2024-05-08T18:31:39.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.449+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.449+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x55728c1cc8a0 2024-05-08T18:31:39.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d55a0 con 0x7ff468021070 2024-05-08T18:31:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff47192d800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff47192d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff47192d800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff47192d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff47192d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff47192d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff47192d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d1580 con 0x55728c1cc8a0 2024-05-08T18:31:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff47192d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff47192d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d1e20 con 0x55728c1cc8a0 2024-05-08T18:31:39.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff47192d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:39.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff47192d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.450+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d11c0 con 0x7ff460085040 2024-05-08T18:31:39.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff47192d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:39.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff47192d800 20 zone default found 2024-05-08T18:31:39.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff47192d800 4 Realm: () 2024-05-08T18:31:39.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff47192d800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:39.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff47192d800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:39.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff47192d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:39.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff47192d800 20 zonegroup default 2024-05-08T18:31:39.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff47192d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d5a20 con 0x7ff460085040 2024-05-08T18:31:39.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff47192d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff47192d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d78b0 con 0x55728c1d2ae0 2024-05-08T18:31:39.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff47192d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff47192d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d7c50 con 0x55728c1d2ae0 2024-05-08T18:31:39.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.451+0000 7ff47192d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.452+0000 7ff47192d800 20 started sync module instance, tier type = 2024-05-08T18:31:39.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.452+0000 7ff47192d800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:39.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.452+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d6cf0 con 0x7ff468021070 2024-05-08T18:31:39.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.453+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.453+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93950465372432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d6950 con 0x7ff468021070 2024-05-08T18:31:39.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.453+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d89d0 con 0x55728c1cc8a0 2024-05-08T18:31:39.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.454+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.454+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93950465372432] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.454+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93950465377440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d9270 con 0x55728c1cc8a0 2024-05-08T18:31:39.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.454+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d9ba0 con 0x55728c1d2ae0 2024-05-08T18:31:39.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.455+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93950465377440] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.455+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.455+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93950465379776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d9220 con 0x55728c1d2ae0 2024-05-08T18:31:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.455+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1da2c0 con 0x7ff468021070 2024-05-08T18:31:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.456+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.456+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93950465383792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1dab60 con 0x7ff468021070 2024-05-08T18:31:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.456+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1db620 con 0x55728c1cc8a0 2024-05-08T18:31:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.456+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93950465379776] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.457+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.457+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93950465388880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1dba40 con 0x55728c1cc8a0 2024-05-08T18:31:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.457+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1dc400 con 0x7ff460085040 2024-05-08T18:31:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.457+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93950465383792] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.458+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93950465388880] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.458+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.458+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93950465382128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1dbf50 con 0x7ff460085040 2024-05-08T18:31:39.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.458+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1dc910 con 0x7ff460085040 2024-05-08T18:31:39.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.459+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(56 notify.6 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.459+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93950465393760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1dcd70 con 0x7ff460085040 2024-05-08T18:31:39.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.459+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1dd870 con 0x7ff460085040 2024-05-08T18:31:39.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.459+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93950465382128] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.460+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93950465393760] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.460+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.460+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93950465397600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1dc880 con 0x7ff460085040 2024-05-08T18:31:39.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.460+0000 7ff47192d800 20 add_watcher() i=0 2024-05-08T18:31:39.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.460+0000 7ff47192d800 20 add_watcher() i=1 2024-05-08T18:31:39.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.460+0000 7ff47192d800 20 add_watcher() i=2 2024-05-08T18:31:39.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.460+0000 7ff47192d800 20 add_watcher() i=3 2024-05-08T18:31:39.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.460+0000 7ff47192d800 20 add_watcher() i=4 2024-05-08T18:31:39.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.460+0000 7ff47192d800 20 add_watcher() i=5 2024-05-08T18:31:39.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.460+0000 7ff47192d800 20 add_watcher() i=6 2024-05-08T18:31:39.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.461+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93950465397600] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.461+0000 7ff47192d800 20 add_watcher() i=7 2024-05-08T18:31:39.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.461+0000 7ff47192d800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:39.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.461+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c1e0860 con 0x55728c1cc8a0 2024-05-08T18:31:39.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.461+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.461+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93950465386160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ddce0 con 0x55728c1cc8a0 2024-05-08T18:31:39.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.462+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93950465386160] v27'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.462+0000 7ff3237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:39.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.463+0000 7ff47192d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:39.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.463+0000 7ff47192d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:39.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.463+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1e8d60 con 0x55728c1cc8a0 2024-05-08T18:31:39.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.464+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.464+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1e92d0 con 0x7ff460085040 2024-05-08T18:31:39.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.465+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.465+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1e96d0 con 0x55728c1d2ae0 2024-05-08T18:31:39.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.466+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.466+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1e9690 con 0x55728c1cc8a0 2024-05-08T18:31:39.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.467+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'169 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.467+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1e9c40 con 0x7ff468021070 2024-05-08T18:31:39.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.468+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.468+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea1b0 con 0x55728c1d2ae0 2024-05-08T18:31:39.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.469+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.469+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea1b0 con 0x55728c1cc8a0 2024-05-08T18:31:39.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.470+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.470+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea1b0 con 0x7ff460085040 2024-05-08T18:31:39.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.471+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.471+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea1b0 con 0x7ff468021070 2024-05-08T18:31:39.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.472+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.472+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x55728c1d2ae0 2024-05-08T18:31:39.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.473+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.473+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x7ff468021070 2024-05-08T18:31:39.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.474+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.474+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x7ff460085040 2024-05-08T18:31:39.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.475+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.475+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x7ff468021070 2024-05-08T18:31:39.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.476+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.476+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x7ff460085040 2024-05-08T18:31:39.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.478+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.478+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x55728c1cc8a0 2024-05-08T18:31:39.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.479+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'170 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.479+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x55728c1d2ae0 2024-05-08T18:31:39.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.480+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'50 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.480+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea420 con 0x7ff468021070 2024-05-08T18:31:39.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.481+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.481+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea420 con 0x55728c1d2ae0 2024-05-08T18:31:39.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.481+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.481+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea420 con 0x55728c1cc8a0 2024-05-08T18:31:39.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.482+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.482+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea420 con 0x55728c1cc8a0 2024-05-08T18:31:39.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.484+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'171 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.484+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea420 con 0x55728c1d2ae0 2024-05-08T18:31:39.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.485+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'51 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.485+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x7ff468021070 2024-05-08T18:31:39.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.486+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.486+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x55728c1d2ae0 2024-05-08T18:31:39.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.487+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.487+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x55728c1d2ae0 2024-05-08T18:31:39.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.487+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.487+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x55728c1d2ae0 2024-05-08T18:31:39.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.488+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'20 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.488+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x55728c1d2ae0 2024-05-08T18:31:39.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.489+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'39 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.489+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x7ff460085040 2024-05-08T18:31:39.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.490+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.490+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x55728c1d2ae0 2024-05-08T18:31:39.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.491+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.491+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x7ff460085040 2024-05-08T18:31:39.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.493+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.493+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x55728c1d2ae0 2024-05-08T18:31:39.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.494+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'52 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.494+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x7ff460085040 2024-05-08T18:31:39.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.495+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.495+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1ea390 con 0x7ff468021070 2024-05-08T18:31:39.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.496+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.496+0000 7ff3227e4640 20 reqs_thread_entry: start 2024-05-08T18:31:39.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.496+0000 7ff47192d800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:39.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.496+0000 7ff47192d800 20 Filter name: none 2024-05-08T18:31:39.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.497+0000 7ff293fff640 20 reqs_thread_entry: start 2024-05-08T18:31:39.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.497+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1cc8a0 2024-05-08T18:31:39.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.497+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.497+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1cc8a0 2024-05-08T18:31:39.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.497+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.497+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1cc8a0 2024-05-08T18:31:39.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.498+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.498+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff460085040 2024-05-08T18:31:39.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.498+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.498+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x7ff460085040 2024-05-08T18:31:39.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.498+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.498+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff460085040 2024-05-08T18:31:39.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.499+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.499+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.499+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.499+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1d2ae0 2024-05-08T18:31:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.499+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.499+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.499+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.499+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1cc8a0 2024-05-08T18:31:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.500+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv164 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.500+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1cc8a0 2024-05-08T18:31:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.500+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv164 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.500+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1cc8a0 2024-05-08T18:31:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.500+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv164 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.500+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff468021070 2024-05-08T18:31:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.501+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.501+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x7ff468021070 2024-05-08T18:31:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.501+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.501+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff468021070 2024-05-08T18:31:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.501+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.501+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.501+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.501+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1d2ae0 2024-05-08T18:31:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.501+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv37 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.501+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.502+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.502+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1cc8a0 2024-05-08T18:31:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.502+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv24 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.502+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1cc8a0 2024-05-08T18:31:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.502+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv24 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.502+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1cc8a0 2024-05-08T18:31:39.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.502+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv24 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.502+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff460085040 2024-05-08T18:31:39.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.503+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.503+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x7ff460085040 2024-05-08T18:31:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.503+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 29 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.503+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff460085040 2024-05-08T18:31:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.504+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 30 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.504+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff468021070 2024-05-08T18:31:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.504+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.504+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x7ff468021070 2024-05-08T18:31:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.504+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.504+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff468021070 2024-05-08T18:31:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.504+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.505+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.505+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.505+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1d2ae0 2024-05-08T18:31:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.505+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.505+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.505+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.505+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff468021070 2024-05-08T18:31:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.505+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.506+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x7ff468021070 2024-05-08T18:31:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.506+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.506+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff468021070 2024-05-08T18:31:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.506+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.506+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff460085040 2024-05-08T18:31:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.507+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 31 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.507+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x7ff460085040 2024-05-08T18:31:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.507+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 32 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.507+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff460085040 2024-05-08T18:31:39.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.507+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 33 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.507+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff468021070 2024-05-08T18:31:39.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.508+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.508+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x7ff468021070 2024-05-08T18:31:39.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.508+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.508+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff468021070 2024-05-08T18:31:39.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.508+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.508+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff460085040 2024-05-08T18:31:39.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.508+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 34 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.508+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x7ff460085040 2024-05-08T18:31:39.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.509+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 35 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.509+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff460085040 2024-05-08T18:31:39.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.509+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 36 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.509+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1cc8a0 2024-05-08T18:31:39.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.509+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.509+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1cc8a0 2024-05-08T18:31:39.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.510+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.510+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1cc8a0 2024-05-08T18:31:39.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.510+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.510+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.510+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.510+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1d2ae0 2024-05-08T18:31:39.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.510+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.510+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.511+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.511+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff468021070 2024-05-08T18:31:39.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.511+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.511+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x7ff468021070 2024-05-08T18:31:39.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.511+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.511+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff468021070 2024-05-08T18:31:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.511+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.511+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.511+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.512+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1d2ae0 2024-05-08T18:31:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.512+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.512+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.512+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.512+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1cc8a0 2024-05-08T18:31:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.512+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.512+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1cc8a0 2024-05-08T18:31:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.512+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.512+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1cc8a0 2024-05-08T18:31:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.513+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.513+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1cc8a0 2024-05-08T18:31:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.513+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.513+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1cc8a0 2024-05-08T18:31:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.513+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv162 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.513+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1cc8a0 2024-05-08T18:31:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.514+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.514+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.514+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.514+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1d2ae0 2024-05-08T18:31:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.514+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.514+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.514+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.514+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff468021070 2024-05-08T18:31:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.515+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.515+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x7ff468021070 2024-05-08T18:31:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.515+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.515+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff468021070 2024-05-08T18:31:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.515+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.515+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.515+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.515+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1d2ae0 2024-05-08T18:31:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.516+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.516+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.516+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.516+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.516+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.516+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1d2ae0 2024-05-08T18:31:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.516+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.516+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.517+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.517+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.517+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.517+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1d2ae0 2024-05-08T18:31:39.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.517+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv19 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.517+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.517+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.517+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.517+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.518+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1d2ae0 2024-05-08T18:31:39.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.518+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.518+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.518+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.518+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff460085040 2024-05-08T18:31:39.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.519+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 37 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.519+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x7ff460085040 2024-05-08T18:31:39.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.519+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 38 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.519+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff460085040 2024-05-08T18:31:39.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.519+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 39 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.519+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.519+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.519+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1d2ae0 2024-05-08T18:31:39.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.520+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.520+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.520+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.520+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff460085040 2024-05-08T18:31:39.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.520+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 40 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.520+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x7ff460085040 2024-05-08T18:31:39.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.521+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 41 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.521+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff460085040 2024-05-08T18:31:39.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.521+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 42 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.521+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.521+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.521+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x55728c1d2ae0 2024-05-08T18:31:39.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.521+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.521+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x55728c1d2ae0 2024-05-08T18:31:39.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.521+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.522+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff460085040 2024-05-08T18:31:39.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.522+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 43 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.522+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x7ff460085040 2024-05-08T18:31:39.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.522+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 44 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.522+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff460085040 2024-05-08T18:31:39.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.523+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 45 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.523+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff468021070 2024-05-08T18:31:39.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.523+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.523+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c2150f0 con 0x7ff468021070 2024-05-08T18:31:39.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.523+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.523+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55728c216100 con 0x7ff468021070 2024-05-08T18:31:39.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.523+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.524+0000 7ff3237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:39.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.524+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93950465386160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1e7000 con 0x55728c1cc8a0 2024-05-08T18:31:39.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.525+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 93950465386160] v27'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.525+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93950465372432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1da6b0 con 0x7ff468021070 2024-05-08T18:31:39.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.526+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 93950465372432] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.526+0000 7ff47192d800 20 remove_watcher() i=0 2024-05-08T18:31:39.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.526+0000 7ff47192d800 2 removed watcher, disabling cache 2024-05-08T18:31:39.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.526+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93950465377440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1da6b0 con 0x55728c1cc8a0 2024-05-08T18:31:39.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.527+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 93950465377440] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.527+0000 7ff47192d800 20 remove_watcher() i=1 2024-05-08T18:31:39.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.527+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93950465379776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1da6b0 con 0x55728c1d2ae0 2024-05-08T18:31:39.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.529+0000 7ff46debf640 1 -- 172.21.15.87:0/1731712904 <== osd.3 v2:172.21.15.87:6800/2929215285 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 93950465379776] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff468051070 con 0x55728c1d2ae0 2024-05-08T18:31:39.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.529+0000 7ff47192d800 20 remove_watcher() i=2 2024-05-08T18:31:39.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.529+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93950465383792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1da6b0 con 0x7ff468021070 2024-05-08T18:31:39.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.530+0000 7ff46d6be640 1 -- 172.21.15.87:0/1731712904 <== osd.2 v2:172.21.15.87:6816/2108501615 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 93950465383792] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46008f040 con 0x7ff468021070 2024-05-08T18:31:39.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.530+0000 7ff47192d800 20 remove_watcher() i=3 2024-05-08T18:31:39.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.530+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93950465388880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1da6b0 con 0x55728c1cc8a0 2024-05-08T18:31:39.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.531+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.1 v2:172.21.15.87:6808/2448644045 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 93950465388880] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x55728c1cc8a0 2024-05-08T18:31:39.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.531+0000 7ff47192d800 20 remove_watcher() i=4 2024-05-08T18:31:39.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.531+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93950465382128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1db150 con 0x7ff460085040 2024-05-08T18:31:39.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.532+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 93950465382128] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.532+0000 7ff47192d800 20 remove_watcher() i=5 2024-05-08T18:31:39.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.532+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93950465393760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1d96f0 con 0x7ff460085040 2024-05-08T18:31:39.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.533+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 93950465393760] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.533+0000 7ff47192d800 20 remove_watcher() i=6 2024-05-08T18:31:39.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.533+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93950465397600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55728c1dc460 con 0x7ff460085040 2024-05-08T18:31:39.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 <== osd.0 v2:172.21.15.53:6800/443747735 48 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 93950465397600] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff46402a040 con 0x7ff460085040 2024-05-08T18:31:39.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 20 remove_watcher() i=7 2024-05-08T18:31:39.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff460085040 msgr2=0x7ff46006e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff460085040 0x7ff46006e8d0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55728c1cc8a0 msgr2=0x55728c1ced60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55728c1cc8a0 0x55728c1ced60 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff468021070 msgr2=0x7ff468034a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff468021070 0x7ff468034a50 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55728c1d2ae0 msgr2=0x55728c1d4ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55728c1d2ae0 0x55728c1d4ed0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff33803bb50 msgr2=0x7ff33803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff33803bb50 0x7ff33803e010 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff460092ec0 tx=0x7ff460089000 comp rx=0 tx=0).stop 2024-05-08T18:31:39.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1b9ab0 msgr2=0x55728c1c0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff46cebd640 1 -- 172.21.15.87:0/1731712904 reap_dead start 2024-05-08T18:31:39.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1b9ab0 0x55728c1c0e80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff468052ad0 tx=0x7ff4680529a0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 shutdown_connections 2024-05-08T18:31:39.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 1 --2- 172.21.15.87:0/1731712904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1b9ab0 0x55728c1c0e80 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 >> 172.21.15.87:0/1731712904 conn(0x55728c1b5d80 msgr2=0x55728c1b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 shutdown_connections 2024-05-08T18:31:39.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.534+0000 7ff47192d800 1 -- 172.21.15.87:0/1731712904 wait complete. 2024-05-08T18:31:39.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 -- 172.21.15.87:0/3716209029 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff34403bb50 msgr2=0x7ff34403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 --2- 172.21.15.87:0/3716209029 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff34403bb50 0x7ff34403e010 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff460076db0 tx=0x7ff460052aa0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 -- 172.21.15.87:0/3716209029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1ac740 msgr2=0x55728c1acb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 --2- 172.21.15.87:0/3716209029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1ac740 0x55728c1acb60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55728c095f70 tx=0x7ff46800ef30 comp rx=0 tx=0).stop 2024-05-08T18:31:39.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 -- 172.21.15.87:0/3716209029 shutdown_connections 2024-05-08T18:31:39.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 --2- 172.21.15.87:0/3716209029 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff34403bb50 0x7ff34403e010 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 --2- 172.21.15.87:0/3716209029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c1ac740 0x55728c1acb60 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 -- 172.21.15.87:0/3716209029 >> 172.21.15.87:0/3716209029 conn(0x55728c1a07e0 msgr2=0x55728c1a0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 -- 172.21.15.87:0/3716209029 shutdown_connections 2024-05-08T18:31:39.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 -- 172.21.15.87:0/3716209029 wait complete. 2024-05-08T18:31:39.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 -- 172.21.15.87:0/2900694104 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55728c19b980 msgr2=0x55728c19dd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55728c19b980 0x55728c19dd70 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 -- 172.21.15.87:0/2900694104 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55728c099380 msgr2=0x55728c1983f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55728c099380 0x55728c1983f0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 -- 172.21.15.87:0/2900694104 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff35403bba0 msgr2=0x7ff35403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff35403bba0 0x7ff35403e060 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff464000f60 tx=0x7ff4640010a0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 -- 172.21.15.87:0/2900694104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 msgr2=0x55728c096710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 0x55728c096710 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff460007000 tx=0x7ff460003330 comp rx=0 tx=0).stop 2024-05-08T18:31:39.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 -- 172.21.15.87:0/2900694104 shutdown_connections 2024-05-08T18:31:39.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55728c099380 0x55728c1983f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55728c19b980 0x55728c19dd70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff35403bba0 0x7ff35403e060 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 --2- 172.21.15.87:0/2900694104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55728c0094b0 0x55728c096710 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 -- 172.21.15.87:0/2900694104 >> 172.21.15.87:0/2900694104 conn(0x55728c090720 msgr2=0x55728c1814e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 -- 172.21.15.87:0/2900694104 shutdown_connections 2024-05-08T18:31:39.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.535+0000 7ff47192d800 1 -- 172.21.15.87:0/2900694104 wait complete. 2024-05-08T18:31:39.542 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-05-08T18:31:39.542 DEBUG:tasks.util.rgw: json result: [] 2024-05-08T18:31:39.542 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-08T18:31:39.542 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-08T18:31:39.542 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-08T18:31:39.627 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:39.628 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:39.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.630+0000 7fdb6bb27800 1 Processor -- start 2024-05-08T18:31:39.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.630+0000 7fdb6bb27800 1 -- start start 2024-05-08T18:31:39.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.630+0000 7fdb6bb27800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5604858575d0 0x5604858599c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.630+0000 7fdb6bb27800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560485859f90 con 0x560485853140 2024-05-08T18:31:39.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.630+0000 7fdb6bb27800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5604856f4e20 con 0x5604858575d0 2024-05-08T18:31:39.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.631+0000 7fdb67058640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5604858575d0 0x5604858599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.631+0000 7fdb67859640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x560485853140 0x560485853560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:51556/0 (socket says 172.21.15.87:51556) 2024-05-08T18:31:39.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.631+0000 7fdb67859640 1 -- 172.21.15.87:0/1234873039 learned_addr learned my addr 172.21.15.87:0/1234873039 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:39.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.631+0000 7fdb67058640 1 -- 172.21.15.87:0/1234873039 >> v1:172.21.15.53:6789/0 conn(0x560485853140 legacy=0x560485853560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.631+0000 7fdb66857640 1 -- 172.21.15.87:0/1234873039 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1992657916 0 0) 0x560485859f90 con 0x560485853140 2024-05-08T18:31:39.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.631+0000 7fdb67058640 1 -- 172.21.15.87:0/1234873039 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56048585b1c0 con 0x5604858575d0 2024-05-08T18:31:39.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.633+0000 7fdb67058640 1 --2- 172.21.15.87:0/1234873039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604858575d0 0x5604858599c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000a470 tx=0x7fdb5001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26133a4bd86426ad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.633+0000 7fdb66857640 1 -- 172.21.15.87:0/1234873039 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb50057070 con 0x5604858575d0 2024-05-08T18:31:39.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.633+0000 7fdb66857640 1 -- 172.21.15.87:0/1234873039 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb50052570 con 0x5604858575d0 2024-05-08T18:31:39.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.633+0000 7fdb66857640 1 -- 172.21.15.87:0/1234873039 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb50052870 con 0x5604858575d0 2024-05-08T18:31:39.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.634+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1234873039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604858575d0 msgr2=0x5604858599c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.634+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/1234873039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604858575d0 0x5604858599c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000a470 tx=0x7fdb5001ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:39.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.634+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1234873039 shutdown_connections 2024-05-08T18:31:39.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.634+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/1234873039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604858575d0 0x5604858599c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.634+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1234873039 >> 172.21.15.87:0/1234873039 conn(0x56048584e720 msgr2=0x560485850b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.634+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1234873039 shutdown_connections 2024-05-08T18:31:39.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.634+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1234873039 wait complete. 2024-05-08T18:31:39.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.647+0000 7fdb6bb27800 1 Processor -- start 2024-05-08T18:31:39.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.647+0000 7fdb6bb27800 1 -- start start 2024-05-08T18:31:39.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.648+0000 7fdb6bb27800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485853140 0x560485944380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.648+0000 7fdb6bb27800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56048579f5b0 con 0x560485853140 2024-05-08T18:31:39.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.648+0000 7fdb67859640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485853140 0x560485944380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.648+0000 7fdb67859640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485853140 0x560485944380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59026/0 (socket says 172.21.15.87:59026) 2024-05-08T18:31:39.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.648+0000 7fdb67859640 1 -- 172.21.15.87:0/1465357573 learned_addr learned my addr 172.21.15.87:0/1465357573 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.648+0000 7fdb67859640 1 -- 172.21.15.87:0/1465357573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560485944950 con 0x560485853140 2024-05-08T18:31:39.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.648+0000 7fdb67859640 1 --2- 172.21.15.87:0/1465357573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485853140 0x560485944380 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdb58001660 tx=0x7fdb58001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c8bbd42227da41 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.648+0000 7fda55e0b640 1 -- 172.21.15.87:0/1465357573 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb58003450 con 0x560485853140 2024-05-08T18:31:39.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.649+0000 7fda55e0b640 1 -- 172.21.15.87:0/1465357573 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb58003610 con 0x560485853140 2024-05-08T18:31:39.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.649+0000 7fda55e0b640 1 -- 172.21.15.87:0/1465357573 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb580039b0 con 0x560485853140 2024-05-08T18:31:39.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.649+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1465357573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485853140 msgr2=0x560485944380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.649+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/1465357573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485853140 0x560485944380 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdb58001660 tx=0x7fdb58001b20 comp rx=0 tx=0).stop 2024-05-08T18:31:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.649+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1465357573 shutdown_connections 2024-05-08T18:31:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.649+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/1465357573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485853140 0x560485944380 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.649+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1465357573 >> 172.21.15.87:0/1465357573 conn(0x56048584e720 msgr2=0x56048593fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.649+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1465357573 shutdown_connections 2024-05-08T18:31:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.649+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1465357573 wait complete. 2024-05-08T18:31:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.650+0000 7fdb6bb27800 1 Processor -- start 2024-05-08T18:31:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.650+0000 7fdb6bb27800 1 -- start start 2024-05-08T18:31:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.650+0000 7fdb6bb27800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485853140 0x56048594cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.650+0000 7fdb6bb27800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56048585a460 con 0x560485853140 2024-05-08T18:31:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.650+0000 7fdb67859640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485853140 0x56048594cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.650+0000 7fdb67859640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485853140 0x56048594cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59036/0 (socket says 172.21.15.87:59036) 2024-05-08T18:31:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.650+0000 7fdb67859640 1 -- 172.21.15.87:0/1120006581 learned_addr learned my addr 172.21.15.87:0/1120006581 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.650+0000 7fdb67859640 1 -- 172.21.15.87:0/1120006581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56048594d510 con 0x560485853140 2024-05-08T18:31:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.650+0000 7fdb67859640 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485853140 0x56048594cfd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x560485945110 tx=0x7fdb58001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.651+0000 7fda4ffff640 1 -- 172.21.15.87:0/1120006581 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb58025070 con 0x560485853140 2024-05-08T18:31:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.651+0000 7fda4ffff640 1 -- 172.21.15.87:0/1120006581 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb58019040 con 0x560485853140 2024-05-08T18:31:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.651+0000 7fda4ffff640 1 -- 172.21.15.87:0/1120006581 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb58013950 con 0x560485853140 2024-05-08T18:31:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.651+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1120006581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56048594d7a0 con 0x560485853140 2024-05-08T18:31:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.651+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1120006581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560485950450 con 0x560485853140 2024-05-08T18:31:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.652+0000 7fda4ffff640 1 -- 172.21.15.87:0/1120006581 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fdb58010070 con 0x560485853140 2024-05-08T18:31:39.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.652+0000 7fda4ffff640 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda5003bba0 0x7fda5003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.652+0000 7fda4ffff640 1 -- 172.21.15.87:0/1120006581 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fdb58052170 con 0x560485853140 2024-05-08T18:31:39.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.652+0000 7fdb67058640 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda5003bba0 0x7fda5003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.652+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5604858575d0 0x560485954210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.652+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1120006581 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560485954790 con 0x5604858575d0 2024-05-08T18:31:39.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.652+0000 7fdb6805a640 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5604858575d0 0x560485954210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.652+0000 7fdb67058640 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda5003bba0 0x7fda5003e060 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdb50054000 tx=0x7fdb5004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.652+0000 7fdb6805a640 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5604858575d0 0x560485954210 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.653+0000 7fdb6805a640 1 -- 172.21.15.87:0/1120006581 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb600083e0 con 0x5604858575d0 2024-05-08T18:31:39.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.653+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1120006581 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604859517c0 con 0x5604858575d0 2024-05-08T18:31:39.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.653+0000 7fdb6805a640 1 -- 172.21.15.87:0/1120006581 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb600083e0 con 0x5604858575d0 2024-05-08T18:31:39.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.653+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1120006581 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604859565b0 con 0x5604858575d0 2024-05-08T18:31:39.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.653+0000 7fdb6805a640 1 -- 172.21.15.87:0/1120006581 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb600083e0 con 0x5604858575d0 2024-05-08T18:31:39.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.653+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1120006581 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604859557e0 con 0x5604858575d0 2024-05-08T18:31:39.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.653+0000 7fdb6805a640 1 -- 172.21.15.87:0/1120006581 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb600083e0 con 0x5604858575d0 2024-05-08T18:31:39.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.653+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560485957960 0x560485959d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.653+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1120006581 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56048595a290 con 0x560485957960 2024-05-08T18:31:39.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.654+0000 7fdb67859640 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560485957960 0x560485959d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.654+0000 7fdb67859640 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560485957960 0x560485959d50 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.654+0000 7fdb67859640 1 -- 172.21.15.87:0/1120006581 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdb5800f030 con 0x560485957960 2024-05-08T18:31:39.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.655+0000 7fdb6bb27800 1 Processor -- start 2024-05-08T18:31:39.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.655+0000 7fdb6bb27800 1 -- start start 2024-05-08T18:31:39.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.655+0000 7fdb6bb27800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485968500 0x560485968920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.655+0000 7fdb6bb27800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560485745fc0 con 0x560485968500 2024-05-08T18:31:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.655+0000 7fdb6805a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485968500 0x560485968920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.655+0000 7fdb6805a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485968500 0x560485968920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59050/0 (socket says 172.21.15.87:59050) 2024-05-08T18:31:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.655+0000 7fdb6805a640 1 -- 172.21.15.87:0/2398406067 learned_addr learned my addr 172.21.15.87:0/2398406067 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.655+0000 7fdb6805a640 1 -- 172.21.15.87:0/2398406067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560485968e60 con 0x560485968500 2024-05-08T18:31:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.655+0000 7fdb6805a640 1 --2- 172.21.15.87:0/2398406067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485968500 0x560485968920 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x56048594e3d0 tx=0x7fdb6000ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.656+0000 7fda4dffb640 1 -- 172.21.15.87:0/2398406067 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb6001c070 con 0x560485968500 2024-05-08T18:31:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.656+0000 7fda4dffb640 1 -- 172.21.15.87:0/2398406067 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb6000bdc0 con 0x560485968500 2024-05-08T18:31:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.656+0000 7fdb6bb27800 1 -- 172.21.15.87:0/2398406067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604859698d0 con 0x560485968500 2024-05-08T18:31:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.656+0000 7fda4dffb640 1 -- 172.21.15.87:0/2398406067 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb60018540 con 0x560485968500 2024-05-08T18:31:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.656+0000 7fdb6bb27800 1 -- 172.21.15.87:0/2398406067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560485969dd0 con 0x560485968500 2024-05-08T18:31:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.657+0000 7fda4dffb640 1 -- 172.21.15.87:0/2398406067 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fdb6001f070 con 0x560485968500 2024-05-08T18:31:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.657+0000 7fda4dffb640 1 --2- 172.21.15.87:0/2398406067 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda4003bba0 0x7fda4003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.657+0000 7fda4dffb640 1 -- 172.21.15.87:0/2398406067 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fdb60054620 con 0x560485968500 2024-05-08T18:31:39.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.657+0000 7fdb67859640 1 --2- 172.21.15.87:0/2398406067 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda4003bba0 0x7fda4003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.657+0000 7fdb6bb27800 1 Processor -- start 2024-05-08T18:31:39.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.657+0000 7fdb67859640 1 --2- 172.21.15.87:0/2398406067 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda4003bba0 0x7fda4003e060 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdb58001330 tx=0x7fdb58028f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.657+0000 7fdb6bb27800 1 -- start start 2024-05-08T18:31:39.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.657+0000 7fdb6bb27800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485975800 0x560485975c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.657+0000 7fdb6bb27800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560485944c70 con 0x560485975800 2024-05-08T18:31:39.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.658+0000 7fdb6805a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485975800 0x560485975c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.658+0000 7fdb6805a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485975800 0x560485975c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59054/0 (socket says 172.21.15.87:59054) 2024-05-08T18:31:39.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.658+0000 7fdb6805a640 1 -- 172.21.15.87:0/3257018613 learned_addr learned my addr 172.21.15.87:0/3257018613 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.658+0000 7fdb6805a640 1 -- 172.21.15.87:0/3257018613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604859761f0 con 0x560485975800 2024-05-08T18:31:39.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.658+0000 7fdb6805a640 1 --2- 172.21.15.87:0/3257018613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485975800 0x560485975c20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdb60052a40 tx=0x7fdb60014bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b315437e25b1c14e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.658+0000 7fda46ffd640 1 -- 172.21.15.87:0/3257018613 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb60052c80 con 0x560485975800 2024-05-08T18:31:39.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.658+0000 7fda46ffd640 1 -- 172.21.15.87:0/3257018613 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb60052e20 con 0x560485975800 2024-05-08T18:31:39.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.658+0000 7fda46ffd640 1 -- 172.21.15.87:0/3257018613 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb600174d0 con 0x560485975800 2024-05-08T18:31:39.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.659+0000 7fdb6bb27800 1 -- 172.21.15.87:0/3257018613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485975800 msgr2=0x560485975c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.659+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/3257018613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485975800 0x560485975c20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdb60052a40 tx=0x7fdb60014bb0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.659+0000 7fdb6bb27800 1 -- 172.21.15.87:0/3257018613 shutdown_connections 2024-05-08T18:31:39.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.659+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/3257018613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485975800 0x560485975c20 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.659+0000 7fdb6bb27800 1 -- 172.21.15.87:0/3257018613 >> 172.21.15.87:0/3257018613 conn(0x560485971b60 msgr2=0x56048596fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.659+0000 7fdb6bb27800 1 -- 172.21.15.87:0/3257018613 shutdown_connections 2024-05-08T18:31:39.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.659+0000 7fdb6bb27800 1 -- 172.21.15.87:0/3257018613 wait complete. 2024-05-08T18:31:39.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.659+0000 7fdb6bb27800 1 Processor -- start 2024-05-08T18:31:39.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.659+0000 7fdb6bb27800 1 -- start start 2024-05-08T18:31:39.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.659+0000 7fdb6bb27800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485975800 0x5604859428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.659+0000 7fdb6bb27800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560485976960 con 0x560485975800 2024-05-08T18:31:39.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.659+0000 7fdb6805a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485975800 0x5604859428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.659+0000 7fdb6805a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485975800 0x5604859428b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59070/0 (socket says 172.21.15.87:59070) 2024-05-08T18:31:39.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.659+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 learned_addr learned my addr 172.21.15.87:0/915349143 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.660+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560485940fa0 con 0x560485975800 2024-05-08T18:31:39.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.660+0000 7fdb6805a640 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485975800 0x5604859428b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdb600076e0 tx=0x7fdb600529a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.660+0000 7fda457fa640 1 -- 172.21.15.87:0/915349143 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb60049040 con 0x560485975800 2024-05-08T18:31:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.660+0000 7fda457fa640 1 -- 172.21.15.87:0/915349143 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb60054070 con 0x560485975800 2024-05-08T18:31:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.660+0000 7fda457fa640 1 -- 172.21.15.87:0/915349143 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb60054350 con 0x560485975800 2024-05-08T18:31:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.660+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560485941230 con 0x560485975800 2024-05-08T18:31:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.660+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560485941730 con 0x560485975800 2024-05-08T18:31:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.661+0000 7fda457fa640 1 -- 172.21.15.87:0/915349143 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fdb60029a60 con 0x560485975800 2024-05-08T18:31:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.661+0000 7fda457fa640 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda3003bba0 0x7fda3003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.661+0000 7fda457fa640 1 -- 172.21.15.87:0/915349143 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fdb6003e020 con 0x560485975800 2024-05-08T18:31:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.661+0000 7fdb67859640 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda3003bba0 0x7fda3003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.662+0000 7fdb67859640 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda3003bba0 0x7fda3003e060 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x560485956540 tx=0x7fdb58046000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.662+0000 7fdb6bb27800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.662+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56048598aa90 0x56048598cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.662+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56048598d6a0 con 0x56048598aa90 2024-05-08T18:31:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.662+0000 7fdb67058640 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56048598aa90 0x56048598cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.662+0000 7fdb67058640 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56048598aa90 0x56048598cf50 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.662+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.662+0000 7fdb6bb27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.662+0000 7fdb6bb27800 20 realm 2024-05-08T18:31:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.662+0000 7fdb6bb27800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.662+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56048598da70 con 0x56048598aa90 2024-05-08T18:31:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.663+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.663+0000 7fdb6bb27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.663+0000 7fdb6bb27800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.663+0000 7fdb6bb27800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.663+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56048598e340 con 0x56048598aa90 2024-05-08T18:31:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.663+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.663+0000 7fdb6bb27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.663+0000 7fdb6bb27800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.663+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56048598e6e0 con 0x56048598aa90 2024-05-08T18:31:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.663+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.663+0000 7fdb6bb27800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.663+0000 7fdb6bb27800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.663+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56048598ef30 con 0x56048598aa90 2024-05-08T18:31:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.663+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.663+0000 7fdb6bb27800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.663+0000 7fdb6bb27800 20 searching for the correct realm 2024-05-08T18:31:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.664+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560485990ca0 0x560485993090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.664+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x560485990ca0 2024-05-08T18:31:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.664+0000 7fdb6805a640 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560485990ca0 0x560485993090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.664+0000 7fdb6805a640 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560485990ca0 0x560485993090 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.664+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.664+0000 7fdb6805a640 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fdb60021070 0x7fdb60034a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.664+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x7fdb60021070 2024-05-08T18:31:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.664+0000 7fdb67859640 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fdb60021070 0x7fdb60034a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.665+0000 7fdb67859640 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fdb60021070 0x7fdb60034a40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.665+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.665+0000 7fdb67859640 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fdb58033030 0x7fdb58028360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.665+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x7fdb58033030 2024-05-08T18:31:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.665+0000 7fdb67058640 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fdb58033030 0x7fdb58028360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.666+0000 7fdb67058640 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fdb58033030 0x7fdb58028360 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.666+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.666+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x56048598aa90 2024-05-08T18:31:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.666+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.666+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x56048598aa90 2024-05-08T18:31:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.666+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.666+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x7fdb58033030 2024-05-08T18:31:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.667+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.667+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x7fdb58033030 2024-05-08T18:31:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.667+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.667+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x7fdb60021070 2024-05-08T18:31:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.667+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.667+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x560485990ca0 2024-05-08T18:31:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.667+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.667+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x56048598aa90 2024-05-08T18:31:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.668+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.668+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x7fdb58033030 2024-05-08T18:31:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.668+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.668+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x56048598aa90 2024-05-08T18:31:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.668+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.668+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x7fdb60021070 2024-05-08T18:31:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.668+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.668+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x560485990ca0 2024-05-08T18:31:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.669+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.669+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x560485990ca0 2024-05-08T18:31:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.669+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.669+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x7fdb58033030 2024-05-08T18:31:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.669+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.669+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x560485990ca0 2024-05-08T18:31:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.670+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.670+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x560485990ca0 2024-05-08T18:31:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.670+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.670+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x56048598aa90 2024-05-08T18:31:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.670+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.670+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x56048598aa90 2024-05-08T18:31:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.670+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.670+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x7fdb58033030 2024-05-08T18:31:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.671+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.671+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x560485990ca0 2024-05-08T18:31:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.671+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.671+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x7fdb60021070 2024-05-08T18:31:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.671+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.671+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x56048598aa90 2024-05-08T18:31:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.671+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.671+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x7fdb58033030 2024-05-08T18:31:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.672+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.672+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x560485990ca0 2024-05-08T18:31:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.672+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.672+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x7fdb58033030 2024-05-08T18:31:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.672+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.672+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x7fdb60021070 2024-05-08T18:31:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.672+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.672+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x560485990ca0 2024-05-08T18:31:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.673+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.673+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x7fdb58033030 2024-05-08T18:31:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.673+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.673+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x56048598aa90 2024-05-08T18:31:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.673+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.673+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560485993620 con 0x7fdb60021070 2024-05-08T18:31:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.673+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.673+0000 7fdb6bb27800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:39.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.673+0000 7fdb6bb27800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:39.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.673+0000 7fdb6bb27800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:39.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.673+0000 7fdb6bb27800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:39.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.673+0000 7fdb6bb27800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:39.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.673+0000 7fdb6bb27800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:39.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.673+0000 7fdb6bb27800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.673+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56048598f8e0 con 0x56048598aa90 2024-05-08T18:31:39.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb6bb27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb6bb27800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560485990180 con 0x56048598aa90 2024-05-08T18:31:39.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb6bb27800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb6bb27800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560485993aa0 con 0x7fdb58033030 2024-05-08T18:31:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb6bb27800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb6bb27800 20 zone default found 2024-05-08T18:31:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb6bb27800 4 Realm: () 2024-05-08T18:31:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb6bb27800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb6bb27800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb6bb27800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb6bb27800 20 zonegroup default 2024-05-08T18:31:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb6bb27800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.674+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56048598fde0 con 0x7fdb58033030 2024-05-08T18:31:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.675+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.675+0000 7fdb6bb27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.675+0000 7fdb6bb27800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.675+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604859959d0 con 0x560485990ca0 2024-05-08T18:31:39.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.675+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.675+0000 7fdb6bb27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.675+0000 7fdb6bb27800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.675+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560485995da0 con 0x560485990ca0 2024-05-08T18:31:39.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.675+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.675+0000 7fdb6bb27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.675+0000 7fdb6bb27800 20 started sync module instance, tier type = 2024-05-08T18:31:39.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.675+0000 7fdb6bb27800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:39.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.675+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560485994e70 con 0x7fdb60021070 2024-05-08T18:31:39.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.676+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.676+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94577421275744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859966b0 con 0x7fdb60021070 2024-05-08T18:31:39.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.676+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560485996f00 con 0x56048598aa90 2024-05-08T18:31:39.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.677+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94577421275744] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.677+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.677+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94577421279744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560485996f60 con 0x56048598aa90 2024-05-08T18:31:39.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.677+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560485997a70 con 0x560485990ca0 2024-05-08T18:31:39.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.678+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94577421279744] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.678+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.678+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94577421284640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560485997a30 con 0x560485990ca0 2024-05-08T18:31:39.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.678+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560485998500 con 0x7fdb60021070 2024-05-08T18:31:39.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.679+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94577421284640] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.680+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.680+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94577421287472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560485998920 con 0x7fdb60021070 2024-05-08T18:31:39.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.680+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560485999360 con 0x56048598aa90 2024-05-08T18:31:39.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.681+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.681+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94577421291056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560485999c00 con 0x56048598aa90 2024-05-08T18:31:39.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.681+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56048599a680 con 0x7fdb58033030 2024-05-08T18:31:39.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.681+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94577421287472] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.682+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.682+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94577421295984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56048599a640 con 0x7fdb58033030 2024-05-08T18:31:39.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.682+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94577421291056] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.682+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560485999750 con 0x7fdb58033030 2024-05-08T18:31:39.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.682+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94577421295984] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.683+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.683+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94577421293392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56048599ac10 con 0x7fdb58033030 2024-05-08T18:31:39.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.683+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56048599b5d0 con 0x7fdb58033030 2024-05-08T18:31:39.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.684+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94577421293392] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.684+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.684+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94577421281872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56048599b5d0 con 0x7fdb58033030 2024-05-08T18:31:39.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.684+0000 7fdb6bb27800 20 add_watcher() i=0 2024-05-08T18:31:39.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.684+0000 7fdb6bb27800 20 add_watcher() i=1 2024-05-08T18:31:39.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.684+0000 7fdb6bb27800 20 add_watcher() i=2 2024-05-08T18:31:39.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.684+0000 7fdb6bb27800 20 add_watcher() i=3 2024-05-08T18:31:39.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.684+0000 7fdb6bb27800 20 add_watcher() i=4 2024-05-08T18:31:39.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.684+0000 7fdb6bb27800 20 add_watcher() i=5 2024-05-08T18:31:39.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.684+0000 7fdb6bb27800 20 add_watcher() i=6 2024-05-08T18:31:39.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.685+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94577421281872] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.685+0000 7fdb6bb27800 20 add_watcher() i=7 2024-05-08T18:31:39.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.685+0000 7fdb6bb27800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:39.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.685+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56048599e8b0 con 0x56048598aa90 2024-05-08T18:31:39.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.685+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.685+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94577421300368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56048599bb60 con 0x56048598aa90 2024-05-08T18:31:39.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.686+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94577421300368] v27'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.686+0000 7fda1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:39.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.686+0000 7fdb6bb27800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:39.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.686+0000 7fdb6bb27800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:39.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.686+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a71b0 con 0x56048598aa90 2024-05-08T18:31:39.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.687+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.687+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a7800 con 0x7fdb58033030 2024-05-08T18:31:39.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.688+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.688+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a7c60 con 0x560485990ca0 2024-05-08T18:31:39.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.689+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.689+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a7bd0 con 0x56048598aa90 2024-05-08T18:31:39.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.690+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'174 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.690+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a8240 con 0x7fdb60021070 2024-05-08T18:31:39.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.691+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.691+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a87b0 con 0x560485990ca0 2024-05-08T18:31:39.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.692+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'40 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.692+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a87b0 con 0x56048598aa90 2024-05-08T18:31:39.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.693+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.693+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a8b70 con 0x7fdb58033030 2024-05-08T18:31:39.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.694+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.694+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a8b70 con 0x7fdb60021070 2024-05-08T18:31:39.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.695+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.695+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a8c00 con 0x560485990ca0 2024-05-08T18:31:39.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.696+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.696+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a8cf0 con 0x7fdb60021070 2024-05-08T18:31:39.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.697+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.697+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x7fdb58033030 2024-05-08T18:31:39.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.699+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.699+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x7fdb60021070 2024-05-08T18:31:39.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.700+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.700+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x7fdb58033030 2024-05-08T18:31:39.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.701+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.701+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x56048598aa90 2024-05-08T18:31:39.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.702+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'175 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.702+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x560485990ca0 2024-05-08T18:31:39.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.703+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'53 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.703+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x7fdb60021070 2024-05-08T18:31:39.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.704+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.704+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x560485990ca0 2024-05-08T18:31:39.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.705+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.705+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x56048598aa90 2024-05-08T18:31:39.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.706+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.706+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x56048598aa90 2024-05-08T18:31:39.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.707+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'176 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.707+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x560485990ca0 2024-05-08T18:31:39.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.708+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'54 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.708+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x7fdb60021070 2024-05-08T18:31:39.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.709+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.709+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x560485990ca0 2024-05-08T18:31:39.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.710+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.710+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x560485990ca0 2024-05-08T18:31:39.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.711+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.711+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x560485990ca0 2024-05-08T18:31:39.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.712+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'21 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.712+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x560485990ca0 2024-05-08T18:31:39.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.713+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'41 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.713+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x7fdb58033030 2024-05-08T18:31:39.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.714+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.714+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x560485990ca0 2024-05-08T18:31:39.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.715+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.715+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x7fdb58033030 2024-05-08T18:31:39.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.716+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.716+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x560485990ca0 2024-05-08T18:31:39.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.717+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'55 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.717+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x7fdb58033030 2024-05-08T18:31:39.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.718+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.718+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a90b0 con 0x7fdb60021070 2024-05-08T18:31:39.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.719+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.720+0000 7fda1cfe1640 20 reqs_thread_entry: start 2024-05-08T18:31:39.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.720+0000 7fdb6bb27800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:39.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.720+0000 7fdb6bb27800 20 Filter name: none 2024-05-08T18:31:39.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.720+0000 7fd9967fc640 20 reqs_thread_entry: start 2024-05-08T18:31:39.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.720+0000 7fdb6bb27800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:39.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.720+0000 7fdb6bb27800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.720+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604859d41c0 con 0x56048598aa90 2024-05-08T18:31:39.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.720+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.720+0000 7fdb6bb27800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:39.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.720+0000 7fdb6bb27800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:39.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.720+0000 7fdb6bb27800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:39.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.720+0000 7fdb6bb27800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:39.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.720+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5604859d4180 con 0x7fdb60021070 2024-05-08T18:31:39.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.721+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.720 INFO:teuthology.orchestra.run.smithi087.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-08T18:31:39.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.721+0000 7fda1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:39.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.722+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94577421300368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a0e60 con 0x56048598aa90 2024-05-08T18:31:39.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.722+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94577421300368] v27'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.723+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94577421275744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5604859a4f90 con 0x7fdb60021070 2024-05-08T18:31:39.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.723+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94577421275744] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.723+0000 7fdb6bb27800 20 remove_watcher() i=0 2024-05-08T18:31:39.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.723+0000 7fdb6bb27800 2 removed watcher, disabling cache 2024-05-08T18:31:39.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.723+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94577421279744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560485995260 con 0x56048598aa90 2024-05-08T18:31:39.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.725+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94577421279744] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.725+0000 7fdb6bb27800 20 remove_watcher() i=1 2024-05-08T18:31:39.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.725+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94577421284640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560485995260 con 0x560485990ca0 2024-05-08T18:31:39.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.726+0000 7fdb6805a640 1 -- 172.21.15.87:0/915349143 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94577421284640] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb60051070 con 0x560485990ca0 2024-05-08T18:31:39.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.726+0000 7fdb6bb27800 20 remove_watcher() i=2 2024-05-08T18:31:39.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.726+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94577421287472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560485995260 con 0x7fdb60021070 2024-05-08T18:31:39.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.727+0000 7fdb67859640 1 -- 172.21.15.87:0/915349143 <== osd.2 v2:172.21.15.87:6816/2108501615 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94577421287472] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5800f030 con 0x7fdb60021070 2024-05-08T18:31:39.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.727+0000 7fdb6bb27800 20 remove_watcher() i=3 2024-05-08T18:31:39.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.727+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94577421291056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560485998030 con 0x56048598aa90 2024-05-08T18:31:39.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.728+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94577421291056] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x56048598aa90 2024-05-08T18:31:39.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.728+0000 7fdb6bb27800 20 remove_watcher() i=4 2024-05-08T18:31:39.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.728+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94577421295984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560485995260 con 0x7fdb58033030 2024-05-08T18:31:39.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.729+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94577421295984] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.729+0000 7fdb6bb27800 20 remove_watcher() i=5 2024-05-08T18:31:39.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.729+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94577421293392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560485998e30 con 0x7fdb58033030 2024-05-08T18:31:39.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.730+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94577421293392] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.730+0000 7fdb6bb27800 20 remove_watcher() i=6 2024-05-08T18:31:39.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.730+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94577421281872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560485998030 con 0x7fdb58033030 2024-05-08T18:31:39.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94577421281872] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb5005a040 con 0x7fdb58033030 2024-05-08T18:31:39.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 20 remove_watcher() i=7 2024-05-08T18:31:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fdb58033030 msgr2=0x7fdb58028360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fdb58033030 0x7fdb58028360 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56048598aa90 msgr2=0x56048598cf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56048598aa90 0x56048598cf50 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fdb60021070 msgr2=0x7fdb60034a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fdb60021070 0x7fdb60034a40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560485990ca0 msgr2=0x560485993090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560485990ca0 0x560485993090 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda3003bba0 msgr2=0x7fda3003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda3003bba0 0x7fda3003e060 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x560485956540 tx=0x7fdb58046000 comp rx=0 tx=0).stop 2024-05-08T18:31:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485975800 msgr2=0x5604859428b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb67058640 1 -- 172.21.15.87:0/915349143 reap_dead start 2024-05-08T18:31:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485975800 0x5604859428b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdb600076e0 tx=0x7fdb600529a0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 shutdown_connections 2024-05-08T18:31:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/915349143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485975800 0x5604859428b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 >> 172.21.15.87:0/915349143 conn(0x560485971b60 msgr2=0x56048596f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 shutdown_connections 2024-05-08T18:31:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 -- 172.21.15.87:0/915349143 wait complete. 2024-05-08T18:31:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 -- 172.21.15.87:0/2398406067 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda4003bba0 msgr2=0x7fda4003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/2398406067 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda4003bba0 0x7fda4003e060 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdb58001330 tx=0x7fdb58028f50 comp rx=0 tx=0).stop 2024-05-08T18:31:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 -- 172.21.15.87:0/2398406067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485968500 msgr2=0x560485968920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/2398406067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485968500 0x560485968920 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x56048594e3d0 tx=0x7fdb6000ef30 comp rx=0 tx=0).stop 2024-05-08T18:31:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 -- 172.21.15.87:0/2398406067 shutdown_connections 2024-05-08T18:31:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/2398406067 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda4003bba0 0x7fda4003e060 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/2398406067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485968500 0x560485968920 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 -- 172.21.15.87:0/2398406067 >> 172.21.15.87:0/2398406067 conn(0x56048595c5a0 msgr2=0x56048595c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.731+0000 7fdb6bb27800 1 -- 172.21.15.87:0/2398406067 shutdown_connections 2024-05-08T18:31:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.732+0000 7fdb6bb27800 1 -- 172.21.15.87:0/2398406067 wait complete. 2024-05-08T18:31:39.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.732+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1120006581 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560485957960 msgr2=0x560485959d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.732+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560485957960 0x560485959d50 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.732+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1120006581 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5604858575d0 msgr2=0x560485954210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.732+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5604858575d0 0x560485954210 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.732+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1120006581 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda5003bba0 msgr2=0x7fda5003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.732+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda5003bba0 0x7fda5003e060 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdb50054000 tx=0x7fdb5004e000 comp rx=0 tx=0).stop 2024-05-08T18:31:39.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.732+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1120006581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485853140 msgr2=0x56048594cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.732+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485853140 0x56048594cfd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x560485945110 tx=0x7fdb58001250 comp rx=0 tx=0).stop 2024-05-08T18:31:39.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.732+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1120006581 shutdown_connections 2024-05-08T18:31:39.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.732+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5604858575d0 0x560485954210 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.732+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560485957960 0x560485959d50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.732+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fda5003bba0 0x7fda5003e060 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.732+0000 7fdb6bb27800 1 --2- 172.21.15.87:0/1120006581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560485853140 0x56048594cfd0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.732+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1120006581 >> 172.21.15.87:0/1120006581 conn(0x56048584e720 msgr2=0x560485942f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.732+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1120006581 shutdown_connections 2024-05-08T18:31:39.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.732+0000 7fdb6bb27800 1 -- 172.21.15.87:0/1120006581 wait complete. 2024-05-08T18:31:39.738 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-08T18:31:39.747 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-05-08T18:31:39.751 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:39.780 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:39.791 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:39.839 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-05-08T18:31:39.844 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:39.844 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-08T18:31:39.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-08T18:31:39.844 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-05-08T18:31:39.889 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:39.889 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:39.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.891+0000 7f285812b800 1 Processor -- start 2024-05-08T18:31:39.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.891+0000 7f285812b800 1 -- start start 2024-05-08T18:31:39.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.892+0000 7f285812b800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56460a5716b0 0x56460a57a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.892+0000 7f285812b800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56460a4e4db0 con 0x56460a56fb70 2024-05-08T18:31:39.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.892+0000 7f285812b800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56460a411e20 con 0x56460a5716b0 2024-05-08T18:31:39.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.892+0000 7f284b6e7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56460a5716b0 0x56460a57a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.892+0000 7f2853ee8640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56460a56fb70 0x56460a56ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:51562/0 (socket says 172.21.15.87:51562) 2024-05-08T18:31:39.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.892+0000 7f2853ee8640 1 -- 172.21.15.87:0/3251583769 learned_addr learned my addr 172.21.15.87:0/3251583769 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:39.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.892+0000 7f284b6e7640 1 -- 172.21.15.87:0/3251583769 >> v1:172.21.15.53:6789/0 conn(0x56460a56fb70 legacy=0x56460a56ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.892+0000 7f284b6e7640 1 -- 172.21.15.87:0/3251583769 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56460a57b700 con 0x56460a5716b0 2024-05-08T18:31:39.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.892+0000 7f28536e7640 1 -- 172.21.15.87:0/3251583769 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1010754597 0 0) 0x56460a4e4db0 con 0x56460a56fb70 2024-05-08T18:31:39.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.894+0000 7f284b6e7640 1 --2- 172.21.15.87:0/3251583769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a5716b0 0x56460a57a1b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f283c00a470 tx=0x7f283c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e509ecb5c9030a09 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.894+0000 7f28536e7640 1 -- 172.21.15.87:0/3251583769 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f283c057070 con 0x56460a5716b0 2024-05-08T18:31:39.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.894+0000 7f28536e7640 1 -- 172.21.15.87:0/3251583769 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f283c04adc0 con 0x56460a5716b0 2024-05-08T18:31:39.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.894+0000 7f28536e7640 1 -- 172.21.15.87:0/3251583769 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f283c052590 con 0x56460a5716b0 2024-05-08T18:31:39.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.895+0000 7f285812b800 1 -- 172.21.15.87:0/3251583769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a5716b0 msgr2=0x56460a57a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.895+0000 7f285812b800 1 --2- 172.21.15.87:0/3251583769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a5716b0 0x56460a57a1b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f283c00a470 tx=0x7f283c01ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:39.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.895+0000 7f285812b800 1 -- 172.21.15.87:0/3251583769 shutdown_connections 2024-05-08T18:31:39.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.895+0000 7f285812b800 1 --2- 172.21.15.87:0/3251583769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a5716b0 0x56460a57a1b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.895+0000 7f285812b800 1 -- 172.21.15.87:0/3251583769 >> 172.21.15.87:0/3251583769 conn(0x56460a56b6b0 msgr2=0x56460a56db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.895+0000 7f285812b800 1 -- 172.21.15.87:0/3251583769 shutdown_connections 2024-05-08T18:31:39.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.895+0000 7f285812b800 1 -- 172.21.15.87:0/3251583769 wait complete. 2024-05-08T18:31:39.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.908+0000 7f285812b800 1 Processor -- start 2024-05-08T18:31:39.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.908+0000 7f285812b800 1 -- start start 2024-05-08T18:31:39.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.909+0000 7f285812b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a56fb70 0x56460a664770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.909+0000 7f285812b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56460a4bc5c0 con 0x56460a56fb70 2024-05-08T18:31:39.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.909+0000 7f2853ee8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a56fb70 0x56460a664770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.909+0000 7f2853ee8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a56fb70 0x56460a664770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59088/0 (socket says 172.21.15.87:59088) 2024-05-08T18:31:39.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.909+0000 7f2853ee8640 1 -- 172.21.15.87:0/4049624950 learned_addr learned my addr 172.21.15.87:0/4049624950 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.909+0000 7f2853ee8640 1 -- 172.21.15.87:0/4049624950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56460a664d40 con 0x56460a56fb70 2024-05-08T18:31:39.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.909+0000 7f2853ee8640 1 --2- 172.21.15.87:0/4049624950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a56fb70 0x56460a664770 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f284400b210 tx=0x7f284400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b34cd124277c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.910+0000 7f2741e0b640 1 -- 172.21.15.87:0/4049624950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2844008070 con 0x56460a56fb70 2024-05-08T18:31:39.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.910+0000 7f2741e0b640 1 -- 172.21.15.87:0/4049624950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284400d500 con 0x56460a56fb70 2024-05-08T18:31:39.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.910+0000 7f2741e0b640 1 -- 172.21.15.87:0/4049624950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284400d840 con 0x56460a56fb70 2024-05-08T18:31:39.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.910+0000 7f285812b800 1 -- 172.21.15.87:0/4049624950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a56fb70 msgr2=0x56460a664770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.910+0000 7f285812b800 1 --2- 172.21.15.87:0/4049624950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a56fb70 0x56460a664770 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f284400b210 tx=0x7f284400b6d0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.910+0000 7f285812b800 1 -- 172.21.15.87:0/4049624950 shutdown_connections 2024-05-08T18:31:39.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.910+0000 7f285812b800 1 --2- 172.21.15.87:0/4049624950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a56fb70 0x56460a664770 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.910+0000 7f285812b800 1 -- 172.21.15.87:0/4049624950 >> 172.21.15.87:0/4049624950 conn(0x56460a56b6b0 msgr2=0x56460a660090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.910+0000 7f285812b800 1 -- 172.21.15.87:0/4049624950 shutdown_connections 2024-05-08T18:31:39.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.910+0000 7f285812b800 1 -- 172.21.15.87:0/4049624950 wait complete. 2024-05-08T18:31:39.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.911+0000 7f285812b800 1 Processor -- start 2024-05-08T18:31:39.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.911+0000 7f285812b800 1 -- start start 2024-05-08T18:31:39.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.911+0000 7f285812b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a56fb70 0x56460a66c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.911+0000 7f285812b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56460a57a9c0 con 0x56460a56fb70 2024-05-08T18:31:39.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.911+0000 7f2853ee8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a56fb70 0x56460a66c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.911+0000 7f2853ee8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a56fb70 0x56460a66c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59104/0 (socket says 172.21.15.87:59104) 2024-05-08T18:31:39.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.911+0000 7f2853ee8640 1 -- 172.21.15.87:0/51776196 learned_addr learned my addr 172.21.15.87:0/51776196 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.911+0000 7f2853ee8640 1 -- 172.21.15.87:0/51776196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56460a66c880 con 0x56460a56fb70 2024-05-08T18:31:39.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.912+0000 7f2853ee8640 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a56fb70 0x56460a66c340 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f284400b210 tx=0x7f2844000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.912+0000 7f273bfff640 1 -- 172.21.15.87:0/51776196 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284400f950 con 0x56460a56fb70 2024-05-08T18:31:39.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.912+0000 7f273bfff640 1 -- 172.21.15.87:0/51776196 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284400faf0 con 0x56460a56fb70 2024-05-08T18:31:39.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.912+0000 7f285812b800 1 -- 172.21.15.87:0/51776196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56460a66cb10 con 0x56460a56fb70 2024-05-08T18:31:39.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.912+0000 7f273bfff640 1 -- 172.21.15.87:0/51776196 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284400fdd0 con 0x56460a56fb70 2024-05-08T18:31:39.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.912+0000 7f285812b800 1 -- 172.21.15.87:0/51776196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56460a66f7c0 con 0x56460a56fb70 2024-05-08T18:31:39.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.913+0000 7f273bfff640 1 -- 172.21.15.87:0/51776196 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2844017040 con 0x56460a56fb70 2024-05-08T18:31:39.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.913+0000 7f273bfff640 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f273c03bb50 0x7f273c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.913+0000 7f273bfff640 1 -- 172.21.15.87:0/51776196 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f2844015020 con 0x56460a56fb70 2024-05-08T18:31:39.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.913+0000 7f284b6e7640 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f273c03bb50 0x7f273c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.913+0000 7f285812b800 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56460a5716b0 0x56460a673580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.913+0000 7f285812b800 1 -- 172.21.15.87:0/51776196 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a673b00 con 0x56460a5716b0 2024-05-08T18:31:39.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.913+0000 7f28546e9640 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56460a5716b0 0x56460a673580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.913+0000 7f284b6e7640 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f273c03bb50 0x7f273c03e010 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f283c054000 tx=0x7f283c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.914+0000 7f28546e9640 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56460a5716b0 0x56460a673580 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.914+0000 7f28546e9640 1 -- 172.21.15.87:0/51776196 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f284c00a4a0 con 0x56460a5716b0 2024-05-08T18:31:39.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.914+0000 7f285812b800 1 -- 172.21.15.87:0/51776196 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a670b50 con 0x56460a5716b0 2024-05-08T18:31:39.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.914+0000 7f28546e9640 1 -- 172.21.15.87:0/51776196 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f284c00a4a0 con 0x56460a5716b0 2024-05-08T18:31:39.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.914+0000 7f285812b800 1 -- 172.21.15.87:0/51776196 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a675920 con 0x56460a5716b0 2024-05-08T18:31:39.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.914+0000 7f28546e9640 1 -- 172.21.15.87:0/51776196 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f284c00a4a0 con 0x56460a5716b0 2024-05-08T18:31:39.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.914+0000 7f285812b800 1 -- 172.21.15.87:0/51776196 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a674b50 con 0x56460a5716b0 2024-05-08T18:31:39.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.915+0000 7f28546e9640 1 -- 172.21.15.87:0/51776196 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f284c00a4a0 con 0x56460a5716b0 2024-05-08T18:31:39.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.915+0000 7f285812b800 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56460a676cd0 0x56460a6790c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.915+0000 7f285812b800 1 -- 172.21.15.87:0/51776196 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a679600 con 0x56460a676cd0 2024-05-08T18:31:39.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.915+0000 7f2853ee8640 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56460a676cd0 0x56460a6790c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.915+0000 7f2853ee8640 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56460a676cd0 0x56460a6790c0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.916+0000 7f2853ee8640 1 -- 172.21.15.87:0/51776196 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f284402d070 con 0x56460a676cd0 2024-05-08T18:31:39.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.916+0000 7f285812b800 1 Processor -- start 2024-05-08T18:31:39.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.916+0000 7f285812b800 1 -- start start 2024-05-08T18:31:39.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.917+0000 7f285812b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a687840 0x56460a687c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.917+0000 7f285812b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56460a462fc0 con 0x56460a687840 2024-05-08T18:31:39.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.917+0000 7f28546e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a687840 0x56460a687c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.917+0000 7f28546e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a687840 0x56460a687c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59112/0 (socket says 172.21.15.87:59112) 2024-05-08T18:31:39.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.917+0000 7f28546e9640 1 -- 172.21.15.87:0/521397905 learned_addr learned my addr 172.21.15.87:0/521397905 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.917+0000 7f28546e9640 1 -- 172.21.15.87:0/521397905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56460a6881a0 con 0x56460a687840 2024-05-08T18:31:39.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.917+0000 7f28546e9640 1 --2- 172.21.15.87:0/521397905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a687840 0x56460a687c60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x56460a66d740 tx=0x7f284c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.917+0000 7f27397fa640 1 -- 172.21.15.87:0/521397905 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c013440 con 0x56460a687840 2024-05-08T18:31:39.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.917+0000 7f27397fa640 1 -- 172.21.15.87:0/521397905 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284c0135e0 con 0x56460a687840 2024-05-08T18:31:39.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.917+0000 7f285812b800 1 -- 172.21.15.87:0/521397905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56460a688c10 con 0x56460a687840 2024-05-08T18:31:39.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.917+0000 7f27397fa640 1 -- 172.21.15.87:0/521397905 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c0138c0 con 0x56460a687840 2024-05-08T18:31:39.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.917+0000 7f285812b800 1 -- 172.21.15.87:0/521397905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56460a689110 con 0x56460a687840 2024-05-08T18:31:39.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.918+0000 7f27397fa640 1 -- 172.21.15.87:0/521397905 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f284c011040 con 0x56460a687840 2024-05-08T18:31:39.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.918+0000 7f27397fa640 1 --2- 172.21.15.87:0/521397905 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f272c03bb50 0x7f272c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.918+0000 7f27397fa640 1 -- 172.21.15.87:0/521397905 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f284c01d070 con 0x56460a687840 2024-05-08T18:31:39.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.918+0000 7f2853ee8640 1 --2- 172.21.15.87:0/521397905 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f272c03bb50 0x7f272c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.919+0000 7f285812b800 1 Processor -- start 2024-05-08T18:31:39.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.919+0000 7f2853ee8640 1 --2- 172.21.15.87:0/521397905 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f272c03bb50 0x7f272c03e010 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2844001e60 tx=0x7f284400b6d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.919+0000 7f285812b800 1 -- start start 2024-05-08T18:31:39.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.919+0000 7f285812b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a694bd0 0x56460a694ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.919+0000 7f285812b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56460a6650c0 con 0x56460a694bd0 2024-05-08T18:31:39.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.919+0000 7f28546e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a694bd0 0x56460a694ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.919+0000 7f28546e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a694bd0 0x56460a694ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59126/0 (socket says 172.21.15.87:59126) 2024-05-08T18:31:39.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.919+0000 7f28546e9640 1 -- 172.21.15.87:0/1946855883 learned_addr learned my addr 172.21.15.87:0/1946855883 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.919+0000 7f28546e9640 1 -- 172.21.15.87:0/1946855883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56460a6955c0 con 0x56460a694bd0 2024-05-08T18:31:39.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.919+0000 7f28546e9640 1 --2- 172.21.15.87:0/1946855883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a694bd0 0x56460a694ff0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f284c0529a0 tx=0x7f284c001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19314485fe4ebc3a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.920+0000 7f2732ffd640 1 -- 172.21.15.87:0/1946855883 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c02ad80 con 0x56460a694bd0 2024-05-08T18:31:39.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.920+0000 7f2732ffd640 1 -- 172.21.15.87:0/1946855883 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284c0014f0 con 0x56460a694bd0 2024-05-08T18:31:39.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.920+0000 7f2732ffd640 1 -- 172.21.15.87:0/1946855883 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c0017d0 con 0x56460a694bd0 2024-05-08T18:31:39.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.920+0000 7f285812b800 1 -- 172.21.15.87:0/1946855883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a694bd0 msgr2=0x56460a694ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.920+0000 7f285812b800 1 --2- 172.21.15.87:0/1946855883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a694bd0 0x56460a694ff0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f284c0529a0 tx=0x7f284c001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:39.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.920+0000 7f285812b800 1 -- 172.21.15.87:0/1946855883 shutdown_connections 2024-05-08T18:31:39.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.920+0000 7f285812b800 1 --2- 172.21.15.87:0/1946855883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a694bd0 0x56460a694ff0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.920+0000 7f285812b800 1 -- 172.21.15.87:0/1946855883 >> 172.21.15.87:0/1946855883 conn(0x56460a690ea0 msgr2=0x56460a68ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.920+0000 7f285812b800 1 -- 172.21.15.87:0/1946855883 shutdown_connections 2024-05-08T18:31:39.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.920+0000 7f285812b800 1 -- 172.21.15.87:0/1946855883 wait complete. 2024-05-08T18:31:39.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.920+0000 7f285812b800 1 Processor -- start 2024-05-08T18:31:39.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.920+0000 7f285812b800 1 -- start start 2024-05-08T18:31:39.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.921+0000 7f285812b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a694bd0 0x56460a69c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.921+0000 7f285812b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56460a695d80 con 0x56460a694bd0 2024-05-08T18:31:39.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.921+0000 7f28546e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a694bd0 0x56460a69c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.921+0000 7f28546e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a694bd0 0x56460a69c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59130/0 (socket says 172.21.15.87:59130) 2024-05-08T18:31:39.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.921+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 learned_addr learned my addr 172.21.15.87:0/3923962939 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:39.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.921+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56460a69c650 con 0x56460a694bd0 2024-05-08T18:31:39.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.921+0000 7f28546e9640 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a694bd0 0x56460a69c110 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f284c04d010 tx=0x7f284c052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.921+0000 7f27317fa640 1 -- 172.21.15.87:0/3923962939 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c030020 con 0x56460a694bd0 2024-05-08T18:31:39.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.921+0000 7f27317fa640 1 -- 172.21.15.87:0/3923962939 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284c051310 con 0x56460a694bd0 2024-05-08T18:31:39.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.921+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56460a69c8e0 con 0x56460a694bd0 2024-05-08T18:31:39.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.921+0000 7f27317fa640 1 -- 172.21.15.87:0/3923962939 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c013a60 con 0x56460a694bd0 2024-05-08T18:31:39.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.921+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56460a69f590 con 0x56460a694bd0 2024-05-08T18:31:39.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.922+0000 7f27317fa640 1 -- 172.21.15.87:0/3923962939 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f284c033020 con 0x56460a694bd0 2024-05-08T18:31:39.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.922+0000 7f27317fa640 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f271c03bba0 0x7f271c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.922+0000 7f27317fa640 1 -- 172.21.15.87:0/3923962939 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f284c00e040 con 0x56460a694bd0 2024-05-08T18:31:39.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.922+0000 7f2853ee8640 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f271c03bba0 0x7f271c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.923+0000 7f2853ee8640 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f271c03bba0 0x7f271c03e060 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2844050560 tx=0x7f2844045040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.923+0000 7f285812b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.923+0000 7f285812b800 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56460a6a7c70 0x56460a6aa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.923+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a6aa880 con 0x56460a6a7c70 2024-05-08T18:31:39.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.923+0000 7f284b6e7640 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56460a6a7c70 0x56460a6aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.923+0000 7f284b6e7640 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56460a6a7c70 0x56460a6aa130 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f285812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f285812b800 20 realm 2024-05-08T18:31:39.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f285812b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a6aacb0 con 0x56460a6a7c70 2024-05-08T18:31:39.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f285812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f285812b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:39.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f285812b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ab580 con 0x56460a6a7c70 2024-05-08T18:31:39.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f285812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f285812b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ab920 con 0x56460a6a7c70 2024-05-08T18:31:39.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f285812b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:39.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f285812b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.924+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x56460a6a7c70 2024-05-08T18:31:39.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.925+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.925+0000 7f285812b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:39.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.925+0000 7f285812b800 20 searching for the correct realm 2024-05-08T18:31:39.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.925+0000 7f285812b800 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56460a6adee0 0x56460a6b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.925+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b0900 con 0x56460a6adee0 2024-05-08T18:31:39.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.925+0000 7f28546e9640 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56460a6adee0 0x56460a6b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.925+0000 7f28546e9640 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56460a6adee0 0x56460a6b02d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.926+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c029070 con 0x56460a6adee0 2024-05-08T18:31:39.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.926+0000 7f28546e9640 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f284c035030 0x7f284c0298d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.926+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b0900 con 0x7f284c035030 2024-05-08T18:31:39.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.926+0000 7f2853ee8640 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f284c035030 0x7f284c0298d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.926+0000 7f2853ee8640 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f284c035030 0x7f284c0298d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.926+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284402d070 con 0x7f284c035030 2024-05-08T18:31:39.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.926+0000 7f2853ee8640 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2844042040 0x7f284404a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:39.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.926+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b0900 con 0x7f2844042040 2024-05-08T18:31:39.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.926+0000 7f284b6e7640 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2844042040 0x7f284404a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:39.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.927+0000 7f284b6e7640 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2844042040 0x7f284404a650 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:39.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.927+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.927+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x56460a6a7c70 2024-05-08T18:31:39.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.927+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.927+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x56460a6a7c70 2024-05-08T18:31:39.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.928+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.928+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x7f2844042040 2024-05-08T18:31:39.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.928+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.928+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x7f2844042040 2024-05-08T18:31:39.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.928+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.928+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x7f284c035030 2024-05-08T18:31:39.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.928+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284402d070 con 0x7f284c035030 2024-05-08T18:31:39.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.928+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x56460a6adee0 2024-05-08T18:31:39.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.929+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c029070 con 0x56460a6adee0 2024-05-08T18:31:39.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.929+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x56460a6a7c70 2024-05-08T18:31:39.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.929+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.929+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x7f2844042040 2024-05-08T18:31:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.929+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.929+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x56460a6a7c70 2024-05-08T18:31:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.929+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.930+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x7f284c035030 2024-05-08T18:31:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.930+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f284402d070 con 0x7f284c035030 2024-05-08T18:31:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.930+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x56460a6adee0 2024-05-08T18:31:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.930+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c029070 con 0x56460a6adee0 2024-05-08T18:31:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.930+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x56460a6adee0 2024-05-08T18:31:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.930+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c029070 con 0x56460a6adee0 2024-05-08T18:31:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.930+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x7f2844042040 2024-05-08T18:31:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.930+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.930+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x56460a6adee0 2024-05-08T18:31:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.931+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c029070 con 0x56460a6adee0 2024-05-08T18:31:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.931+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x56460a6adee0 2024-05-08T18:31:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.931+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c029070 con 0x56460a6adee0 2024-05-08T18:31:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.931+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x56460a6a7c70 2024-05-08T18:31:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.931+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.931+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x56460a6a7c70 2024-05-08T18:31:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.931+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.931+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x7f2844042040 2024-05-08T18:31:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.932+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.932+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x56460a6adee0 2024-05-08T18:31:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.932+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c029070 con 0x56460a6adee0 2024-05-08T18:31:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.932+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x7f284c035030 2024-05-08T18:31:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.932+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284402d070 con 0x7f284c035030 2024-05-08T18:31:39.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.932+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x56460a6a7c70 2024-05-08T18:31:39.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.932+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.932+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x7f2844042040 2024-05-08T18:31:39.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.933+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.933+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x56460a6adee0 2024-05-08T18:31:39.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.933+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c029070 con 0x56460a6adee0 2024-05-08T18:31:39.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.933+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x7f2844042040 2024-05-08T18:31:39.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.933+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.933+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x7f284c035030 2024-05-08T18:31:39.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.933+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284402d070 con 0x7f284c035030 2024-05-08T18:31:39.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.933+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x56460a6adee0 2024-05-08T18:31:39.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.934+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c029070 con 0x56460a6adee0 2024-05-08T18:31:39.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.934+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x7f2844042040 2024-05-08T18:31:39.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.934+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.934+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x56460a6a7c70 2024-05-08T18:31:39.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac170 con 0x7f284c035030 2024-05-08T18:31:39.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284402d070 con 0x7f284c035030 2024-05-08T18:31:39.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f285812b800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:39.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f285812b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:39.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f285812b800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:39.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f285812b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:39.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f285812b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:39.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f285812b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:39.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f285812b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac9c0 con 0x56460a6a7c70 2024-05-08T18:31:39.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f285812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f285812b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a6acdb0 con 0x56460a6a7c70 2024-05-08T18:31:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f285812b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f285812b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.935+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a6acdb0 con 0x7f2844042040 2024-05-08T18:31:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f285812b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f285812b800 20 zone default found 2024-05-08T18:31:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f285812b800 4 Realm: () 2024-05-08T18:31:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f285812b800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f285812b800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f285812b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f285812b800 20 zonegroup default 2024-05-08T18:31:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f285812b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac5d0 con 0x7f2844042040 2024-05-08T18:31:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f285812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f285812b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ac600 con 0x56460a6adee0 2024-05-08T18:31:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f284c029070 con 0x56460a6adee0 2024-05-08T18:31:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f285812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f285812b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.936+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b2870 con 0x56460a6adee0 2024-05-08T18:31:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.937+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f284c029070 con 0x56460a6adee0 2024-05-08T18:31:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.937+0000 7f285812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.937+0000 7f285812b800 20 started sync module instance, tier type = 2024-05-08T18:31:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.937+0000 7f285812b800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.937+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b1c00 con 0x7f284c035030 2024-05-08T18:31:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.938+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284402d070 con 0x7f284c035030 2024-05-08T18:31:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.938+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94858822492144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b3180 con 0x7f284c035030 2024-05-08T18:31:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.938+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b39d0 con 0x56460a6a7c70 2024-05-08T18:31:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.939+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.939+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94858822497568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b3f50 con 0x56460a6a7c70 2024-05-08T18:31:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.939+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b4a70 con 0x56460a6adee0 2024-05-08T18:31:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.940+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94858822497568] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.941+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94858822492144] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284402d070 con 0x7f284c035030 2024-05-08T18:31:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.941+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c029070 con 0x56460a6adee0 2024-05-08T18:31:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.941+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94858822495440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b39a0 con 0x56460a6adee0 2024-05-08T18:31:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.941+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b5480 con 0x7f284c035030 2024-05-08T18:31:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.942+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94858822495440] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c029070 con 0x56460a6adee0 2024-05-08T18:31:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.942+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284402d070 con 0x7f284c035030 2024-05-08T18:31:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.942+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94858822504400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b5820 con 0x7f284c035030 2024-05-08T18:31:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.942+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b61e0 con 0x56460a6a7c70 2024-05-08T18:31:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.943+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.943+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94858822508304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b69a0 con 0x56460a6a7c70 2024-05-08T18:31:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.943+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b74c0 con 0x7f2844042040 2024-05-08T18:31:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.943+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94858822504400] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284402d070 con 0x7f284c035030 2024-05-08T18:31:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.944+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.944+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94858822512528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b7480 con 0x7f2844042040 2024-05-08T18:31:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.944+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b7ed0 con 0x7f2844042040 2024-05-08T18:31:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.944+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94858822508304] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.945+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94858822512528] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.945+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.945+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94858822501696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b7a20 con 0x7f2844042040 2024-05-08T18:31:39.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.945+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b83e0 con 0x7f2844042040 2024-05-08T18:31:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.946+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94858822501696] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.946+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.946+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94858822509552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b83e0 con 0x7f2844042040 2024-05-08T18:31:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.946+0000 7f285812b800 20 add_watcher() i=0 2024-05-08T18:31:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.946+0000 7f285812b800 20 add_watcher() i=1 2024-05-08T18:31:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.946+0000 7f285812b800 20 add_watcher() i=2 2024-05-08T18:31:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.946+0000 7f285812b800 20 add_watcher() i=3 2024-05-08T18:31:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.946+0000 7f285812b800 20 add_watcher() i=4 2024-05-08T18:31:39.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.946+0000 7f285812b800 20 add_watcher() i=5 2024-05-08T18:31:39.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.946+0000 7f285812b800 20 add_watcher() i=6 2024-05-08T18:31:39.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.947+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94858822509552] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.947+0000 7f285812b800 20 add_watcher() i=7 2024-05-08T18:31:39.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.947+0000 7f285812b800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:39.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.947+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a6bb6f0 con 0x56460a6a7c70 2024-05-08T18:31:39.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.947+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.947+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94858822516896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6b8970 con 0x56460a6a7c70 2024-05-08T18:31:39.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.948+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94858822516896] v27'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.948+0000 7f2709fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:39.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.948+0000 7f285812b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:39.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.948+0000 7f285812b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:39.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.949+0000 7f285812b800 5 note: GC not initialized 2024-05-08T18:31:39.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.949+0000 7f2708fe1640 20 reqs_thread_entry: start 2024-05-08T18:31:39.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.949+0000 7f285812b800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:39.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.949+0000 7f285812b800 20 Filter name: none 2024-05-08T18:31:39.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.949+0000 7f26827fc640 20 reqs_thread_entry: start 2024-05-08T18:31:39.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.949+0000 7f285812b800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:31:39.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.949+0000 7f285812b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.949+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a6ef1a0 con 0x7f284c035030 2024-05-08T18:31:39.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.949+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f284402d070 con 0x7f284c035030 2024-05-08T18:31:39.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f285812b800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:39.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f285812b800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:31:39.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f285812b800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:39.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f285812b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 : miss 2024-05-08T18:31:39.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f285812b800 20 rados->read ofs=0 len=0 2024-05-08T18:31:39.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:63 8.f 8:f1ea543d:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a6f1030 con 0x56460a6adee0 2024-05-08T18:31:39.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(63 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f284c029070 con 0x56460a6adee0 2024-05-08T18:31:39.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f285812b800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:39.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f285812b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 info.flags=0x17 2024-05-08T18:31:39.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f285812b800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 to cache LRU end 2024-05-08T18:31:39.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f285812b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:39.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f285812b800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:39.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f285812b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 2024-05-08T18:31:39.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f285812b800 20 get_obj_state: octx=0x7f283c052490 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56460a6f34a8 s->prefetch_data=0 2024-05-08T18:31:39.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 3.22s0 3:46947052:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56460a6f46c0 con 0x56460a6adee0 2024-05-08T18:31:39.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(64 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+865 (crc 0 0 0) 0x7f284c029070 con 0x56460a6adee0 2024-05-08T18:31:39.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f285812b800 10 manifest: total_size = 5 2024-05-08T18:31:39.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.950+0000 7f285812b800 20 get_obj_state: setting s->obj_tag to _iCrJj7LT_s0wR7A8N34YCRfr4gA5T9C 2024-05-08T18:31:39.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.951+0000 7f2709fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:39.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.951+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94858822516896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6f46c0 con 0x56460a6a7c70 2024-05-08T18:31:39.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.952+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94858822516896] v27'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.952+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94858822492144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6f46c0 con 0x7f284c035030 2024-05-08T18:31:39.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.953+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94858822492144] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284402d070 con 0x7f284c035030 2024-05-08T18:31:39.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.953+0000 7f285812b800 20 remove_watcher() i=0 2024-05-08T18:31:39.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.953+0000 7f285812b800 2 removed watcher, disabling cache 2024-05-08T18:31:39.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.953+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94858822497568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6f46c0 con 0x56460a6a7c70 2024-05-08T18:31:39.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.955+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94858822497568] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.955+0000 7f285812b800 20 remove_watcher() i=1 2024-05-08T18:31:39.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.955+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94858822495440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6f46c0 con 0x56460a6adee0 2024-05-08T18:31:39.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.956+0000 7f28546e9640 1 -- 172.21.15.87:0/3923962939 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94858822495440] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c029070 con 0x56460a6adee0 2024-05-08T18:31:39.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.956+0000 7f285812b800 20 remove_watcher() i=2 2024-05-08T18:31:39.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.956+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94858822504400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6f46c0 con 0x7f284c035030 2024-05-08T18:31:39.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.957+0000 7f2853ee8640 1 -- 172.21.15.87:0/3923962939 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94858822504400] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284402d070 con 0x7f284c035030 2024-05-08T18:31:39.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.957+0000 7f285812b800 20 remove_watcher() i=3 2024-05-08T18:31:39.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.957+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94858822508304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6f46c0 con 0x56460a6a7c70 2024-05-08T18:31:39.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.958+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94858822508304] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x56460a6a7c70 2024-05-08T18:31:39.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.958+0000 7f285812b800 20 remove_watcher() i=4 2024-05-08T18:31:39.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.958+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94858822512528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6f46c0 con 0x7f2844042040 2024-05-08T18:31:39.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.958+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94858822512528] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.958+0000 7f285812b800 20 remove_watcher() i=5 2024-05-08T18:31:39.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.959+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94858822501696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6f46c0 con 0x7f2844042040 2024-05-08T18:31:39.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.960+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94858822501696] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.960+0000 7f285812b800 20 remove_watcher() i=6 2024-05-08T18:31:39.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.960+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94858822509552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56460a6f46c0 con 0x7f2844042040 2024-05-08T18:31:39.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94858822509552] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c05a040 con 0x7f2844042040 2024-05-08T18:31:39.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 20 remove_watcher() i=7 2024-05-08T18:31:39.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2844042040 msgr2=0x7f284404a650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f2844042040 0x7f284404a650 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56460a6a7c70 msgr2=0x56460a6aa130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56460a6a7c70 0x56460a6aa130 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f284c035030 msgr2=0x7f284c0298d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f284c035030 0x7f284c0298d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56460a6adee0 msgr2=0x56460a6b02d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56460a6adee0 0x56460a6b02d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f271c03bba0 msgr2=0x7f271c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f271c03bba0 0x7f271c03e060 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2844050560 tx=0x7f2844045040 comp rx=0 tx=0).stop 2024-05-08T18:31:39.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a694bd0 msgr2=0x56460a69c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f284b6e7640 1 -- 172.21.15.87:0/3923962939 reap_dead start 2024-05-08T18:31:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a694bd0 0x56460a69c110 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f284c04d010 tx=0x7f284c052900 comp rx=0 tx=0).stop 2024-05-08T18:31:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 shutdown_connections 2024-05-08T18:31:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 --2- 172.21.15.87:0/3923962939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a694bd0 0x56460a69c110 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 >> 172.21.15.87:0/3923962939 conn(0x56460a690ea0 msgr2=0x56460a68e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 shutdown_connections 2024-05-08T18:31:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 -- 172.21.15.87:0/3923962939 wait complete. 2024-05-08T18:31:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 -- 172.21.15.87:0/521397905 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f272c03bb50 msgr2=0x7f272c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 --2- 172.21.15.87:0/521397905 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f272c03bb50 0x7f272c03e010 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2844001e60 tx=0x7f284400b6d0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 -- 172.21.15.87:0/521397905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a687840 msgr2=0x56460a687c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 --2- 172.21.15.87:0/521397905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a687840 0x56460a687c60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x56460a66d740 tx=0x7f284c0178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 -- 172.21.15.87:0/521397905 shutdown_connections 2024-05-08T18:31:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 --2- 172.21.15.87:0/521397905 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f272c03bb50 0x7f272c03e010 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 --2- 172.21.15.87:0/521397905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a687840 0x56460a687c60 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.961+0000 7f285812b800 1 -- 172.21.15.87:0/521397905 >> 172.21.15.87:0/521397905 conn(0x56460a67b8e0 msgr2=0x56460a67bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 -- 172.21.15.87:0/521397905 shutdown_connections 2024-05-08T18:31:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 -- 172.21.15.87:0/521397905 wait complete. 2024-05-08T18:31:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 -- 172.21.15.87:0/51776196 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56460a676cd0 msgr2=0x56460a6790c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56460a676cd0 0x56460a6790c0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 -- 172.21.15.87:0/51776196 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56460a5716b0 msgr2=0x56460a673580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56460a5716b0 0x56460a673580 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 -- 172.21.15.87:0/51776196 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f273c03bb50 msgr2=0x7f273c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f273c03bb50 0x7f273c03e010 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f283c054000 tx=0x7f283c04e000 comp rx=0 tx=0).stop 2024-05-08T18:31:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 -- 172.21.15.87:0/51776196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a56fb70 msgr2=0x56460a66c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a56fb70 0x56460a66c340 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f284400b210 tx=0x7f2844000ed0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 -- 172.21.15.87:0/51776196 shutdown_connections 2024-05-08T18:31:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56460a5716b0 0x56460a673580 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56460a676cd0 0x56460a6790c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f273c03bb50 0x7f273c03e010 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 --2- 172.21.15.87:0/51776196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56460a56fb70 0x56460a66c340 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 -- 172.21.15.87:0/51776196 >> 172.21.15.87:0/51776196 conn(0x56460a56b6b0 msgr2=0x56460a65e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 -- 172.21.15.87:0/51776196 shutdown_connections 2024-05-08T18:31:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:39.962+0000 7f285812b800 1 -- 172.21.15.87:0/51776196 wait complete. 2024-05-08T18:31:39.972 INFO:teuthology.orchestra.run.smithi087.stdout:fooFoofooFooFULL_CONTROL 2024-05-08T18:31:39.972 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-05-08T18:31:39.974 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-05-08T18:31:39.979 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:39.979 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-08T18:31:39.979 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-08T18:31:39.980 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-05-08T18:31:40.024 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:40.025 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:40.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.027+0000 7f801bb2f800 1 Processor -- start 2024-05-08T18:31:40.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.027+0000 7f801bb2f800 1 -- start start 2024-05-08T18:31:40.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.027+0000 7f801bb2f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562a9dfe12c0 0x562a9dfe16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.027+0000 7f801bb2f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562a9dfe1d60 con 0x562a9dfe2480 2024-05-08T18:31:40.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.027+0000 7f801bb2f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x562a9de81e20 con 0x562a9dfe12c0 2024-05-08T18:31:40.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.027+0000 7f80178be640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562a9dfe12c0 0x562a9dfe16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.028+0000 7f800f0bd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x562a9dfe2480 0x562a9dfe2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:51566/0 (socket says 172.21.15.87:51566) 2024-05-08T18:31:40.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.028+0000 7f800f0bd640 1 -- 172.21.15.87:0/416403303 learned_addr learned my addr 172.21.15.87:0/416403303 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:40.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.028+0000 7f80178be640 1 --2- 172.21.15.87:0/416403303 >> v2:172.21.15.53:3300/0 conn(0x562a9dfe12c0 0x562a9dfe16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59142/0 (socket says 172.21.15.87:59142) 2024-05-08T18:31:40.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.028+0000 7f80178be640 1 -- 172.21.15.87:0/416403303 >> v1:172.21.15.53:6789/0 conn(0x562a9dfe2480 legacy=0x562a9dfe2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.028+0000 7f80178be640 1 -- 172.21.15.87:0/416403303 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a9dfe3040 con 0x562a9dfe12c0 2024-05-08T18:31:40.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.030+0000 7f80178be640 1 --2- 172.21.15.87:0/416403303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 0x562a9dfe16e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f800800a470 tx=0x7f800801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989b0041edf24128 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.030+0000 7f80170bd640 1 -- 172.21.15.87:0/416403303 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8008057070 con 0x562a9dfe12c0 2024-05-08T18:31:40.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.030+0000 7f80170bd640 1 -- 172.21.15.87:0/416403303 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f800804adc0 con 0x562a9dfe12c0 2024-05-08T18:31:40.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.030+0000 7f80170bd640 1 -- 172.21.15.87:0/416403303 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8008052590 con 0x562a9dfe12c0 2024-05-08T18:31:40.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.030+0000 7f801bb2f800 1 -- 172.21.15.87:0/416403303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 msgr2=0x562a9dfe16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.030+0000 7f801bb2f800 1 --2- 172.21.15.87:0/416403303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 0x562a9dfe16e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f800800a470 tx=0x7f800801ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:40.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.030+0000 7f801bb2f800 1 -- 172.21.15.87:0/416403303 shutdown_connections 2024-05-08T18:31:40.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.030+0000 7f801bb2f800 1 --2- 172.21.15.87:0/416403303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 0x562a9dfe16e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.030+0000 7f801bb2f800 1 -- 172.21.15.87:0/416403303 >> 172.21.15.87:0/416403303 conn(0x562a9dfdc840 msgr2=0x562a9dfdec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.030+0000 7f801bb2f800 1 -- 172.21.15.87:0/416403303 shutdown_connections 2024-05-08T18:31:40.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.030+0000 7f801bb2f800 1 -- 172.21.15.87:0/416403303 wait complete. 2024-05-08T18:31:40.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.044+0000 7f801bb2f800 1 Processor -- start 2024-05-08T18:31:40.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.044+0000 7f801bb2f800 1 -- start start 2024-05-08T18:31:40.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.044+0000 7f801bb2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 0x562a9e0d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.044+0000 7f801bb2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562a9df2c5c0 con 0x562a9dfe12c0 2024-05-08T18:31:40.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.044+0000 7f80178be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 0x562a9e0d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.044+0000 7f80178be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 0x562a9e0d2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59152/0 (socket says 172.21.15.87:59152) 2024-05-08T18:31:40.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.044+0000 7f80178be640 1 -- 172.21.15.87:0/3039076785 learned_addr learned my addr 172.21.15.87:0/3039076785 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.045+0000 7f80178be640 1 -- 172.21.15.87:0/3039076785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a9e0d2d50 con 0x562a9dfe12c0 2024-05-08T18:31:40.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.045+0000 7f80178be640 1 --2- 172.21.15.87:0/3039076785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 0x562a9e0d2780 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f800801ced0 tx=0x7f800804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45e79707b767239 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.045+0000 7f7f05e0b640 1 -- 172.21.15.87:0/3039076785 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8008057040 con 0x562a9dfe12c0 2024-05-08T18:31:40.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.045+0000 7f7f05e0b640 1 -- 172.21.15.87:0/3039076785 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8008063070 con 0x562a9dfe12c0 2024-05-08T18:31:40.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.045+0000 7f7f05e0b640 1 -- 172.21.15.87:0/3039076785 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8008052800 con 0x562a9dfe12c0 2024-05-08T18:31:40.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.046+0000 7f801bb2f800 1 -- 172.21.15.87:0/3039076785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 msgr2=0x562a9e0d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.046+0000 7f801bb2f800 1 --2- 172.21.15.87:0/3039076785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 0x562a9e0d2780 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f800801ced0 tx=0x7f800804c000 comp rx=0 tx=0).stop 2024-05-08T18:31:40.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.046+0000 7f801bb2f800 1 -- 172.21.15.87:0/3039076785 shutdown_connections 2024-05-08T18:31:40.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.046+0000 7f801bb2f800 1 --2- 172.21.15.87:0/3039076785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 0x562a9e0d2780 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.046+0000 7f801bb2f800 1 -- 172.21.15.87:0/3039076785 >> 172.21.15.87:0/3039076785 conn(0x562a9dfdc840 msgr2=0x562a9e0ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.046+0000 7f801bb2f800 1 -- 172.21.15.87:0/3039076785 shutdown_connections 2024-05-08T18:31:40.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.046+0000 7f801bb2f800 1 -- 172.21.15.87:0/3039076785 wait complete. 2024-05-08T18:31:40.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.046+0000 7f801bb2f800 1 Processor -- start 2024-05-08T18:31:40.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.046+0000 7f801bb2f800 1 -- start start 2024-05-08T18:31:40.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.046+0000 7f801bb2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 0x562a9e0da240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.046+0000 7f801bb2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562a9dfea950 con 0x562a9dfe12c0 2024-05-08T18:31:40.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.046+0000 7f80178be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 0x562a9e0da240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.046+0000 7f80178be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 0x562a9e0da240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59156/0 (socket says 172.21.15.87:59156) 2024-05-08T18:31:40.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.046+0000 7f80178be640 1 -- 172.21.15.87:0/4233314954 learned_addr learned my addr 172.21.15.87:0/4233314954 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.047+0000 7f80178be640 1 -- 172.21.15.87:0/4233314954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a9e0da780 con 0x562a9dfe12c0 2024-05-08T18:31:40.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.047+0000 7f80178be640 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 0x562a9e0da240 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f800801ced0 tx=0x7f8008002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.047+0000 7f7efffff640 1 -- 172.21.15.87:0/4233314954 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f800806d070 con 0x562a9dfe12c0 2024-05-08T18:31:40.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.047+0000 7f7efffff640 1 -- 172.21.15.87:0/4233314954 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8008052d20 con 0x562a9dfe12c0 2024-05-08T18:31:40.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.047+0000 7f801bb2f800 1 -- 172.21.15.87:0/4233314954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a9e0daa10 con 0x562a9dfe12c0 2024-05-08T18:31:40.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.047+0000 7f7efffff640 1 -- 172.21.15.87:0/4233314954 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8008057050 con 0x562a9dfe12c0 2024-05-08T18:31:40.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.047+0000 7f801bb2f800 1 -- 172.21.15.87:0/4233314954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a9e0dd620 con 0x562a9dfe12c0 2024-05-08T18:31:40.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.048+0000 7f7efffff640 1 -- 172.21.15.87:0/4233314954 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f800805d470 con 0x562a9dfe12c0 2024-05-08T18:31:40.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.048+0000 7f7efffff640 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7f0003bba0 0x7f7f0003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.048+0000 7f7efffff640 1 -- 172.21.15.87:0/4233314954 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8008094160 con 0x562a9dfe12c0 2024-05-08T18:31:40.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.048+0000 7f800f0bd640 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7f0003bba0 0x7f7f0003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.049+0000 7f801bb2f800 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562a9dfe2480 0x562a9e0e13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.049+0000 7f801bb2f800 1 -- 172.21.15.87:0/4233314954 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e0e1960 con 0x562a9dfe2480 2024-05-08T18:31:40.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.049+0000 7f80180bf640 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562a9dfe2480 0x562a9e0e13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.049+0000 7f800f0bd640 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7f0003bba0 0x7f7f0003e060 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8000000f60 tx=0x7f80000012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.049+0000 7f80180bf640 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562a9dfe2480 0x562a9e0e13e0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.049+0000 7f80180bf640 1 -- 172.21.15.87:0/4233314954 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f801000a4a0 con 0x562a9dfe2480 2024-05-08T18:31:40.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.049+0000 7f801bb2f800 1 -- 172.21.15.87:0/4233314954 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e0de9b0 con 0x562a9dfe2480 2024-05-08T18:31:40.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.049+0000 7f80180bf640 1 -- 172.21.15.87:0/4233314954 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f801000a4a0 con 0x562a9dfe2480 2024-05-08T18:31:40.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.049+0000 7f801bb2f800 1 -- 172.21.15.87:0/4233314954 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e0e3780 con 0x562a9dfe2480 2024-05-08T18:31:40.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.050+0000 7f80180bf640 1 -- 172.21.15.87:0/4233314954 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f801000a4a0 con 0x562a9dfe2480 2024-05-08T18:31:40.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.050+0000 7f801bb2f800 1 -- 172.21.15.87:0/4233314954 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e0e29b0 con 0x562a9dfe2480 2024-05-08T18:31:40.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.050+0000 7f80180bf640 1 -- 172.21.15.87:0/4233314954 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f801000a4a0 con 0x562a9dfe2480 2024-05-08T18:31:40.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.050+0000 7f801bb2f800 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562a9e0e4b30 0x562a9e0e6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.050+0000 7f801bb2f800 1 -- 172.21.15.87:0/4233314954 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e0e7460 con 0x562a9e0e4b30 2024-05-08T18:31:40.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.050+0000 7f80178be640 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562a9e0e4b30 0x562a9e0e6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.050+0000 7f80178be640 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562a9e0e4b30 0x562a9e0e6f20 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.051+0000 7f80178be640 1 -- 172.21.15.87:0/4233314954 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8008078070 con 0x562a9e0e4b30 2024-05-08T18:31:40.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.051+0000 7f801bb2f800 1 Processor -- start 2024-05-08T18:31:40.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.051+0000 7f801bb2f800 1 -- start start 2024-05-08T18:31:40.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.051+0000 7f801bb2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e0f56a0 0x562a9e0f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.051+0000 7f801bb2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562a9ded2fc0 con 0x562a9e0f56a0 2024-05-08T18:31:40.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.051+0000 7f80180bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e0f56a0 0x562a9e0f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.051+0000 7f80180bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e0f56a0 0x562a9e0f5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59158/0 (socket says 172.21.15.87:59158) 2024-05-08T18:31:40.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.051+0000 7f80180bf640 1 -- 172.21.15.87:0/1605890382 learned_addr learned my addr 172.21.15.87:0/1605890382 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.052+0000 7f80180bf640 1 -- 172.21.15.87:0/1605890382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a9e0f6000 con 0x562a9e0f56a0 2024-05-08T18:31:40.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.052+0000 7f80180bf640 1 --2- 172.21.15.87:0/1605890382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e0f56a0 0x562a9e0f5ac0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x562a9e0db5a0 tx=0x7f80100178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.052+0000 7f7efd7fa640 1 -- 172.21.15.87:0/1605890382 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8010013440 con 0x562a9e0f56a0 2024-05-08T18:31:40.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.052+0000 7f7efd7fa640 1 -- 172.21.15.87:0/1605890382 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80100135e0 con 0x562a9e0f56a0 2024-05-08T18:31:40.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.052+0000 7f801bb2f800 1 -- 172.21.15.87:0/1605890382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a9e0f6a70 con 0x562a9e0f56a0 2024-05-08T18:31:40.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.052+0000 7f7efd7fa640 1 -- 172.21.15.87:0/1605890382 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80100138c0 con 0x562a9e0f56a0 2024-05-08T18:31:40.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.052+0000 7f801bb2f800 1 -- 172.21.15.87:0/1605890382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a9e0f6f70 con 0x562a9e0f56a0 2024-05-08T18:31:40.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.053+0000 7f7efd7fa640 1 -- 172.21.15.87:0/1605890382 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8010011040 con 0x562a9e0f56a0 2024-05-08T18:31:40.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.053+0000 7f7efd7fa640 1 --2- 172.21.15.87:0/1605890382 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7ef003bba0 0x7f7ef003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.053+0000 7f7efd7fa640 1 -- 172.21.15.87:0/1605890382 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f801001d070 con 0x562a9e0f56a0 2024-05-08T18:31:40.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.053+0000 7f80178be640 1 --2- 172.21.15.87:0/1605890382 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7ef003bba0 0x7f7ef003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.053+0000 7f801bb2f800 1 Processor -- start 2024-05-08T18:31:40.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.053+0000 7f80178be640 1 --2- 172.21.15.87:0/1605890382 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7ef003bba0 0x7f7ef003e060 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f800805e790 tx=0x7f8008094040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.054+0000 7f801bb2f800 1 -- start start 2024-05-08T18:31:40.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.054+0000 7f801bb2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e102a10 0x562a9e102e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.054+0000 7f801bb2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562a9e0d3010 con 0x562a9e102a10 2024-05-08T18:31:40.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.054+0000 7f80180bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e102a10 0x562a9e102e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.054+0000 7f80180bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e102a10 0x562a9e102e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59172/0 (socket says 172.21.15.87:59172) 2024-05-08T18:31:40.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.054+0000 7f80180bf640 1 -- 172.21.15.87:0/1981140602 learned_addr learned my addr 172.21.15.87:0/1981140602 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.054+0000 7f80180bf640 1 -- 172.21.15.87:0/1981140602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a9e103400 con 0x562a9e102a10 2024-05-08T18:31:40.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.054+0000 7f80180bf640 1 --2- 172.21.15.87:0/1981140602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e102a10 0x562a9e102e30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8010052990 tx=0x7f8010029430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15c66236cfd286a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.054+0000 7f7ef6ffd640 1 -- 172.21.15.87:0/1981140602 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f801002ad80 con 0x562a9e102a10 2024-05-08T18:31:40.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.054+0000 7f7ef6ffd640 1 -- 172.21.15.87:0/1981140602 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80100540d0 con 0x562a9e102a10 2024-05-08T18:31:40.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.054+0000 7f7ef6ffd640 1 -- 172.21.15.87:0/1981140602 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80100543f0 con 0x562a9e102a10 2024-05-08T18:31:40.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.055+0000 7f801bb2f800 1 -- 172.21.15.87:0/1981140602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e102a10 msgr2=0x562a9e102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.055+0000 7f801bb2f800 1 --2- 172.21.15.87:0/1981140602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e102a10 0x562a9e102e30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8010052990 tx=0x7f8010029430 comp rx=0 tx=0).stop 2024-05-08T18:31:40.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.055+0000 7f801bb2f800 1 -- 172.21.15.87:0/1981140602 shutdown_connections 2024-05-08T18:31:40.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.055+0000 7f801bb2f800 1 --2- 172.21.15.87:0/1981140602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e102a10 0x562a9e102e30 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.055+0000 7f801bb2f800 1 -- 172.21.15.87:0/1981140602 >> 172.21.15.87:0/1981140602 conn(0x562a9e0fece0 msgr2=0x562a9e0fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.055+0000 7f801bb2f800 1 -- 172.21.15.87:0/1981140602 shutdown_connections 2024-05-08T18:31:40.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.055+0000 7f801bb2f800 1 -- 172.21.15.87:0/1981140602 wait complete. 2024-05-08T18:31:40.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.055+0000 7f801bb2f800 1 Processor -- start 2024-05-08T18:31:40.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.055+0000 7f801bb2f800 1 -- start start 2024-05-08T18:31:40.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.055+0000 7f801bb2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e102a10 0x562a9df56be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.055+0000 7f801bb2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562a9e103b50 con 0x562a9e102a10 2024-05-08T18:31:40.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.056+0000 7f80180bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e102a10 0x562a9df56be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.056+0000 7f80180bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e102a10 0x562a9df56be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59182/0 (socket says 172.21.15.87:59182) 2024-05-08T18:31:40.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.056+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 learned_addr learned my addr 172.21.15.87:0/664426254 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.056+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a9df57120 con 0x562a9e102a10 2024-05-08T18:31:40.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.056+0000 7f80180bf640 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e102a10 0x562a9df56be0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8010001f40 tx=0x7f80100528f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.056+0000 7f7ef57fa640 1 -- 172.21.15.87:0/664426254 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8010030020 con 0x562a9e102a10 2024-05-08T18:31:40.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.056+0000 7f7ef57fa640 1 -- 172.21.15.87:0/664426254 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8010051330 con 0x562a9e102a10 2024-05-08T18:31:40.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.056+0000 7f7ef57fa640 1 -- 172.21.15.87:0/664426254 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8010013a60 con 0x562a9e102a10 2024-05-08T18:31:40.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.056+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a9df552d0 con 0x562a9e102a10 2024-05-08T18:31:40.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.056+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a9df557d0 con 0x562a9e102a10 2024-05-08T18:31:40.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.057+0000 7f7ef57fa640 1 -- 172.21.15.87:0/664426254 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8010033020 con 0x562a9e102a10 2024-05-08T18:31:40.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.057+0000 7f7ef57fa640 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7ee003bb50 0x7f7ee003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.057+0000 7f7ef57fa640 1 -- 172.21.15.87:0/664426254 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f801000e040 con 0x562a9e102a10 2024-05-08T18:31:40.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.057+0000 7f80178be640 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7ee003bb50 0x7f7ee003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.058+0000 7f80178be640 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7ee003bb50 0x7f7ee003e010 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8008000c00 tx=0x7f800807e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.058+0000 7f801bb2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.058+0000 7f801bb2f800 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562a9e117c90 0x562a9e11a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.058+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e11a8a0 con 0x562a9e117c90 2024-05-08T18:31:40.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.058+0000 7f800f0bd640 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562a9e117c90 0x562a9e11a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.058+0000 7f800f0bd640 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562a9e117c90 0x562a9e11a150 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.058+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8000009050 con 0x562a9e117c90 2024-05-08T18:31:40.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.058+0000 7f801bb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.058+0000 7f801bb2f800 20 realm 2024-05-08T18:31:40.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.058+0000 7f801bb2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.058+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e1170e0 con 0x562a9e117c90 2024-05-08T18:31:40.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8000009050 con 0x562a9e117c90 2024-05-08T18:31:40.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f801bb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f801bb2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:40.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f801bb2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e11b390 con 0x562a9e117c90 2024-05-08T18:31:40.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8000009050 con 0x562a9e117c90 2024-05-08T18:31:40.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f801bb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f801bb2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e11bc60 con 0x562a9e117c90 2024-05-08T18:31:40.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8000009050 con 0x562a9e117c90 2024-05-08T18:31:40.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f801bb2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:40.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f801bb2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e11c000 con 0x562a9e117c90 2024-05-08T18:31:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8000009050 con 0x562a9e117c90 2024-05-08T18:31:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f801bb2f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f801bb2f800 20 searching for the correct realm 2024-05-08T18:31:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f801bb2f800 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562a9e11dee0 0x562a9e1202d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.059+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x562a9e11dee0 2024-05-08T18:31:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.060+0000 7f80180bf640 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562a9e11dee0 0x562a9e1202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.060+0000 7f80180bf640 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562a9e11dee0 0x562a9e1202d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.060+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8010029070 con 0x562a9e11dee0 2024-05-08T18:31:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.060+0000 7f80180bf640 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8010035020 0x7f80100298d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.060+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x7f8010035020 2024-05-08T18:31:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.060+0000 7f80178be640 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8010035020 0x7f80100298d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.061+0000 7f80178be640 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8010035020 0x7f80100298d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.061+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8008078070 con 0x7f8010035020 2024-05-08T18:31:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.061+0000 7f80178be640 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f800805b370 0x7f800808b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.061+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x7f800805b370 2024-05-08T18:31:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.061+0000 7f800f0bd640 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f800805b370 0x7f800808b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.062+0000 7f800f0bd640 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f800805b370 0x7f800808b360 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.062+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8000009050 con 0x7f800805b370 2024-05-08T18:31:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.062+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x562a9e117c90 2024-05-08T18:31:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.062+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8000009050 con 0x562a9e117c90 2024-05-08T18:31:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.062+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x562a9e117c90 2024-05-08T18:31:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.062+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.062+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x7f800805b370 2024-05-08T18:31:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.063+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.063+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x7f800805b370 2024-05-08T18:31:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.063+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.063+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x7f8010035020 2024-05-08T18:31:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.063+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8008078070 con 0x7f8010035020 2024-05-08T18:31:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.063+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x562a9e11dee0 2024-05-08T18:31:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.063+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8010029070 con 0x562a9e11dee0 2024-05-08T18:31:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.063+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x562a9e117c90 2024-05-08T18:31:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.064+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.064+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x7f800805b370 2024-05-08T18:31:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.064+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.064+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x562a9e117c90 2024-05-08T18:31:40.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.064+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.064+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x7f8010035020 2024-05-08T18:31:40.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.064+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8008078070 con 0x7f8010035020 2024-05-08T18:31:40.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.064+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x562a9e11dee0 2024-05-08T18:31:40.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.065+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8010061040 con 0x562a9e11dee0 2024-05-08T18:31:40.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.065+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x562a9e11dee0 2024-05-08T18:31:40.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.065+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8010061040 con 0x562a9e11dee0 2024-05-08T18:31:40.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.065+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x7f800805b370 2024-05-08T18:31:40.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.065+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.065+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x562a9e11dee0 2024-05-08T18:31:40.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.065+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8010061040 con 0x562a9e11dee0 2024-05-08T18:31:40.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.065+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x562a9e11dee0 2024-05-08T18:31:40.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.066+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8010061040 con 0x562a9e11dee0 2024-05-08T18:31:40.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.066+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x562a9e117c90 2024-05-08T18:31:40.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.066+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.066+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x562a9e117c90 2024-05-08T18:31:40.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.066+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.066+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x7f800805b370 2024-05-08T18:31:40.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.066+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.066+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x562a9e11dee0 2024-05-08T18:31:40.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.067+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8010061040 con 0x562a9e11dee0 2024-05-08T18:31:40.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.067+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x7f8010035020 2024-05-08T18:31:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.067+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8008078070 con 0x7f8010035020 2024-05-08T18:31:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.067+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x562a9e117c90 2024-05-08T18:31:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.067+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.067+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x7f800805b370 2024-05-08T18:31:40.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.068+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.068+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x562a9e11dee0 2024-05-08T18:31:40.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.068+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8010061040 con 0x562a9e11dee0 2024-05-08T18:31:40.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.068+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x7f800805b370 2024-05-08T18:31:40.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.068+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.068+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x7f8010035020 2024-05-08T18:31:40.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.068+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8008078070 con 0x7f8010035020 2024-05-08T18:31:40.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.068+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x562a9e11dee0 2024-05-08T18:31:40.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.069+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8010061040 con 0x562a9e11dee0 2024-05-08T18:31:40.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.069+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x7f800805b370 2024-05-08T18:31:40.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.069+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.069+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x562a9e117c90 2024-05-08T18:31:40.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.069+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.069+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120980 con 0x7f8010035020 2024-05-08T18:31:40.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.070+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8008078070 con 0x7f8010035020 2024-05-08T18:31:40.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.070+0000 7f801bb2f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:40.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.070+0000 7f801bb2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:40.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.070+0000 7f801bb2f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:40.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.070+0000 7f801bb2f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:40.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.070+0000 7f801bb2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:40.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.070+0000 7f801bb2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:40.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.070+0000 7f801bb2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.070+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e11c9b0 con 0x562a9e117c90 2024-05-08T18:31:40.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.070+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.070+0000 7f801bb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.070+0000 7f801bb2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.070+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e11d250 con 0x562a9e117c90 2024-05-08T18:31:40.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.070+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.070+0000 7f801bb2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:40.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.070+0000 7f801bb2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.070+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e120e00 con 0x7f800805b370 2024-05-08T18:31:40.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:40.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 20 zone default found 2024-05-08T18:31:40.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 4 Realm: () 2024-05-08T18:31:40.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:40.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:40.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:40.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 20 zonegroup default 2024-05-08T18:31:40.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e1212b0 con 0x7f800805b370 2024-05-08T18:31:40.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e122c90 con 0x562a9e11dee0 2024-05-08T18:31:40.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8010061040 con 0x562a9e11dee0 2024-05-08T18:31:40.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e123100 con 0x562a9e11dee0 2024-05-08T18:31:40.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8010061040 con 0x562a9e11dee0 2024-05-08T18:31:40.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 20 started sync module instance, tier type = 2024-05-08T18:31:40.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:40.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.071+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e122120 con 0x7f8010035020 2024-05-08T18:31:40.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.072+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8008078070 con 0x7f8010035020 2024-05-08T18:31:40.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.072+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94741040604432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e123a10 con 0x7f8010035020 2024-05-08T18:31:40.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.072+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e124260 con 0x562a9e117c90 2024-05-08T18:31:40.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.073+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94741040604432] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8008078070 con 0x7f8010035020 2024-05-08T18:31:40.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.074+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.074+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94741040608608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e1242c0 con 0x562a9e117c90 2024-05-08T18:31:40.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.074+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e124dd0 con 0x562a9e11dee0 2024-05-08T18:31:40.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.075+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94741040608608] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.075+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8010061040 con 0x562a9e11dee0 2024-05-08T18:31:40.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.075+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94741040613504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e1251c0 con 0x562a9e11dee0 2024-05-08T18:31:40.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.075+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e125c00 con 0x7f8010035020 2024-05-08T18:31:40.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.076+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8008078070 con 0x7f8010035020 2024-05-08T18:31:40.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.076+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94741040617168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e1264a0 con 0x7f8010035020 2024-05-08T18:31:40.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.076+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e126fa0 con 0x562a9e117c90 2024-05-08T18:31:40.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.076+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94741040613504] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8010061040 con 0x562a9e11dee0 2024-05-08T18:31:40.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.077+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.077+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94741040622224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e126f60 con 0x562a9e117c90 2024-05-08T18:31:40.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.077+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e1279f0 con 0x7f800805b370 2024-05-08T18:31:40.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.077+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94741040617168] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8008078070 con 0x7f8010035020 2024-05-08T18:31:40.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.078+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94741040622224] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.078+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.078+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94741040610736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e125ff0 con 0x7f800805b370 2024-05-08T18:31:40.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.078+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e127ea0 con 0x7f800805b370 2024-05-08T18:31:40.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.079+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94741040610736] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.079+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.079+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94741040624896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e127ea0 con 0x7f800805b370 2024-05-08T18:31:40.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.079+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e128860 con 0x7f800805b370 2024-05-08T18:31:40.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.080+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.080+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94741040628656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e128c80 con 0x7f800805b370 2024-05-08T18:31:40.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.080+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94741040624896] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.080+0000 7f801bb2f800 20 add_watcher() i=0 2024-05-08T18:31:40.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.080+0000 7f801bb2f800 20 add_watcher() i=1 2024-05-08T18:31:40.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.080+0000 7f801bb2f800 20 add_watcher() i=2 2024-05-08T18:31:40.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.080+0000 7f801bb2f800 20 add_watcher() i=3 2024-05-08T18:31:40.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.080+0000 7f801bb2f800 20 add_watcher() i=4 2024-05-08T18:31:40.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.080+0000 7f801bb2f800 20 add_watcher() i=5 2024-05-08T18:31:40.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.080+0000 7f801bb2f800 20 add_watcher() i=6 2024-05-08T18:31:40.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.081+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94741040628656] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.081+0000 7f801bb2f800 20 add_watcher() i=7 2024-05-08T18:31:40.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.081+0000 7f801bb2f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:40.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.081+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e128c80 con 0x562a9e117c90 2024-05-08T18:31:40.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.082+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.082+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94741040629712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e128c60 con 0x562a9e117c90 2024-05-08T18:31:40.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.083+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94741040629712] v27'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.083+0000 7f7ecdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:40.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.083+0000 7f801bb2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:40.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.083+0000 7f801bb2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:40.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.083+0000 7f801bb2f800 5 note: GC not initialized 2024-05-08T18:31:40.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.083+0000 7f7eccfe1640 20 reqs_thread_entry: start 2024-05-08T18:31:40.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.083+0000 7f801bb2f800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:40.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.083+0000 7f801bb2f800 20 Filter name: none 2024-05-08T18:31:40.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.083+0000 7f7e467fc640 20 reqs_thread_entry: start 2024-05-08T18:31:40.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.083+0000 7f801bb2f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:31:40.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.083+0000 7f801bb2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.083+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e15f810 con 0x7f8010035020 2024-05-08T18:31:40.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.084+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8008078070 con 0x7f8010035020 2024-05-08T18:31:40.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.084+0000 7f801bb2f800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:40.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.084+0000 7f801bb2f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:31:40.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.084+0000 7f801bb2f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:40.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.084+0000 7f801bb2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 : miss 2024-05-08T18:31:40.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.084+0000 7f801bb2f800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.084+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:63 8.f 8:f1ea543d:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e1612d0 con 0x562a9e11dee0 2024-05-08T18:31:40.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.084+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(63 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f8010061040 con 0x562a9e11dee0 2024-05-08T18:31:40.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.084+0000 7f801bb2f800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:40.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.084+0000 7f801bb2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 info.flags=0x17 2024-05-08T18:31:40.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.084+0000 7f801bb2f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 to cache LRU end 2024-05-08T18:31:40.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.084+0000 7f801bb2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:40.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.084+0000 7f801bb2f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:40.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.084+0000 7f801bb2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 2024-05-08T18:31:40.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.084+0000 7f801bb2f800 20 get_obj_state: octx=0x7f800000e510 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x562a9e163998 s->prefetch_data=0 2024-05-08T18:31:40.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.084+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 3.22s0 3:46947052:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a9e1647c0 con 0x562a9e11dee0 2024-05-08T18:31:40.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.084+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(64 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f8010061040 con 0x562a9e11dee0 2024-05-08T18:31:40.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.085+0000 7f801bb2f800 10 manifest: total_size = 5 2024-05-08T18:31:40.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.085+0000 7f801bb2f800 20 get_obj_state: setting s->obj_tag to _oCvOhlkvBps_8SujhqdUzSFN8vTOd2n 2024-05-08T18:31:40.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.085+0000 7f7ecdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:40.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.085+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94741040629712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e15d160 con 0x562a9e117c90 2024-05-08T18:31:40.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.086+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94741040629712] v27'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.086+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94741040604432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e15d160 con 0x7f8010035020 2024-05-08T18:31:40.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.087+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94741040604432] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8008078070 con 0x7f8010035020 2024-05-08T18:31:40.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.087+0000 7f801bb2f800 20 remove_watcher() i=0 2024-05-08T18:31:40.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.087+0000 7f801bb2f800 2 removed watcher, disabling cache 2024-05-08T18:31:40.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.087+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94741040608608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e15d160 con 0x562a9e117c90 2024-05-08T18:31:40.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.089+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94741040608608] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.089+0000 7f801bb2f800 20 remove_watcher() i=1 2024-05-08T18:31:40.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.089+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94741040613504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e15d160 con 0x562a9e11dee0 2024-05-08T18:31:40.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.090+0000 7f80180bf640 1 -- 172.21.15.87:0/664426254 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94741040613504] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8010061040 con 0x562a9e11dee0 2024-05-08T18:31:40.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.090+0000 7f801bb2f800 20 remove_watcher() i=2 2024-05-08T18:31:40.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.090+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94741040617168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e15d160 con 0x7f8010035020 2024-05-08T18:31:40.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.091+0000 7f80178be640 1 -- 172.21.15.87:0/664426254 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94741040617168] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8008078070 con 0x7f8010035020 2024-05-08T18:31:40.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.091+0000 7f801bb2f800 20 remove_watcher() i=3 2024-05-08T18:31:40.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.091+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94741040622224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e15d160 con 0x562a9e117c90 2024-05-08T18:31:40.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.091+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94741040622224] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800002a040 con 0x562a9e117c90 2024-05-08T18:31:40.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.091+0000 7f801bb2f800 20 remove_watcher() i=4 2024-05-08T18:31:40.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.091+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94741040610736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e15d160 con 0x7f800805b370 2024-05-08T18:31:40.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.092+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94741040610736] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.092+0000 7f801bb2f800 20 remove_watcher() i=5 2024-05-08T18:31:40.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.092+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94741040624896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e15d160 con 0x7f800805b370 2024-05-08T18:31:40.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.093+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94741040624896] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.093+0000 7f801bb2f800 20 remove_watcher() i=6 2024-05-08T18:31:40.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.093+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94741040628656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a9e15d160 con 0x7f800805b370 2024-05-08T18:31:40.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.094+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94741040628656] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800002a040 con 0x7f800805b370 2024-05-08T18:31:40.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.094+0000 7f801bb2f800 20 remove_watcher() i=7 2024-05-08T18:31:40.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.094+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f800805b370 msgr2=0x7f800808b360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.094+0000 7f801bb2f800 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f800805b370 0x7f800808b360 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.094+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562a9e117c90 msgr2=0x562a9e11a150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.094+0000 7f801bb2f800 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562a9e117c90 0x562a9e11a150 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.094+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8010035020 msgr2=0x7f80100298d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.094+0000 7f801bb2f800 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8010035020 0x7f80100298d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.094+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562a9e11dee0 msgr2=0x562a9e1202d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.094+0000 7f801bb2f800 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562a9e11dee0 0x562a9e1202d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7ee003bb50 msgr2=0x7f7ee003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7ee003bb50 0x7f7ee003e010 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8008000c00 tx=0x7f800807e000 comp rx=0 tx=0).stop 2024-05-08T18:31:40.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e102a10 msgr2=0x562a9df56be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f800f0bd640 1 -- 172.21.15.87:0/664426254 reap_dead start 2024-05-08T18:31:40.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e102a10 0x562a9df56be0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8010001f40 tx=0x7f80100528f0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 shutdown_connections 2024-05-08T18:31:40.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 --2- 172.21.15.87:0/664426254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e102a10 0x562a9df56be0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 >> 172.21.15.87:0/664426254 conn(0x562a9e0fece0 msgr2=0x562a9e0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 shutdown_connections 2024-05-08T18:31:40.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 -- 172.21.15.87:0/664426254 wait complete. 2024-05-08T18:31:40.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 -- 172.21.15.87:0/1605890382 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7ef003bba0 msgr2=0x7f7ef003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 --2- 172.21.15.87:0/1605890382 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7ef003bba0 0x7f7ef003e060 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f800805e790 tx=0x7f8008094040 comp rx=0 tx=0).stop 2024-05-08T18:31:40.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 -- 172.21.15.87:0/1605890382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e0f56a0 msgr2=0x562a9e0f5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 --2- 172.21.15.87:0/1605890382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e0f56a0 0x562a9e0f5ac0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x562a9e0db5a0 tx=0x7f80100178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 -- 172.21.15.87:0/1605890382 shutdown_connections 2024-05-08T18:31:40.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 --2- 172.21.15.87:0/1605890382 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7ef003bba0 0x7f7ef003e060 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 --2- 172.21.15.87:0/1605890382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9e0f56a0 0x562a9e0f5ac0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 -- 172.21.15.87:0/1605890382 >> 172.21.15.87:0/1605890382 conn(0x562a9e0e9740 msgr2=0x562a9e0e9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 -- 172.21.15.87:0/1605890382 shutdown_connections 2024-05-08T18:31:40.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 -- 172.21.15.87:0/1605890382 wait complete. 2024-05-08T18:31:40.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.095+0000 7f801bb2f800 1 -- 172.21.15.87:0/4233314954 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562a9e0e4b30 msgr2=0x562a9e0e6f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.096+0000 7f801bb2f800 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562a9e0e4b30 0x562a9e0e6f20 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.096+0000 7f801bb2f800 1 -- 172.21.15.87:0/4233314954 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562a9dfe2480 msgr2=0x562a9e0e13e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.096+0000 7f801bb2f800 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562a9dfe2480 0x562a9e0e13e0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.096+0000 7f801bb2f800 1 -- 172.21.15.87:0/4233314954 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7f0003bba0 msgr2=0x7f7f0003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.096+0000 7f801bb2f800 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7f0003bba0 0x7f7f0003e060 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8000000f60 tx=0x7f80000012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.096+0000 7f801bb2f800 1 -- 172.21.15.87:0/4233314954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 msgr2=0x562a9e0da240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.096+0000 7f801bb2f800 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 0x562a9e0da240 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f800801ced0 tx=0x7f8008002fb0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.096+0000 7f801bb2f800 1 -- 172.21.15.87:0/4233314954 shutdown_connections 2024-05-08T18:31:40.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.096+0000 7f801bb2f800 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562a9dfe2480 0x562a9e0e13e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.096+0000 7f801bb2f800 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562a9e0e4b30 0x562a9e0e6f20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.096+0000 7f801bb2f800 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7f0003bba0 0x7f7f0003e060 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.096+0000 7f801bb2f800 1 --2- 172.21.15.87:0/4233314954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a9dfe12c0 0x562a9e0da240 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.096+0000 7f801bb2f800 1 -- 172.21.15.87:0/4233314954 >> 172.21.15.87:0/4233314954 conn(0x562a9dfdc840 msgr2=0x562a9e0cc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.096+0000 7f801bb2f800 1 -- 172.21.15.87:0/4233314954 shutdown_connections 2024-05-08T18:31:40.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.096+0000 7f801bb2f800 1 -- 172.21.15.87:0/4233314954 wait complete. 2024-05-08T18:31:40.115 INFO:teuthology.orchestra.run.smithi087.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-05-08T18:31:40.115 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-05-08T18:31:40.118 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-05-08T18:31:40.130 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:40.235 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-05-08T18:31:40.235 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-05-08T18:31:40.235 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-08T18:31:40.235 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-05-08T18:31:40.235 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-05-08T18:31:40.235 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-05-08T18:31:40.236 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-05-08T18:31:40.281 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:40.281 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.284+0000 7f08eb213800 1 Processor -- start 2024-05-08T18:31:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.284+0000 7f08eb213800 1 -- start start 2024-05-08T18:31:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.284+0000 7f08eb213800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56494dda52c0 0x56494dda56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.284+0000 7f08eb213800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56494dda5d60 con 0x56494dda6480 2024-05-08T18:31:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.284+0000 7f08eb213800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56494dc45e20 con 0x56494dda52c0 2024-05-08T18:31:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.284+0000 7f08e681a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56494dda52c0 0x56494dda56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.284+0000 7f08e6019640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56494dda6480 0x56494dda6900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:51576/0 (socket says 172.21.15.87:51576) 2024-05-08T18:31:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.284+0000 7f08e6019640 1 -- 172.21.15.87:0/3380960531 learned_addr learned my addr 172.21.15.87:0/3380960531 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:40.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.285+0000 7f08e681a640 1 -- 172.21.15.87:0/3380960531 >> v1:172.21.15.53:6789/0 conn(0x56494dda6480 legacy=0x56494dda6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.285+0000 7f08e681a640 1 -- 172.21.15.87:0/3380960531 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56494dda7040 con 0x56494dda52c0 2024-05-08T18:31:40.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.286+0000 7f08e681a640 1 --2- 172.21.15.87:0/3380960531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 0x56494dda56e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f08d800a470 tx=0x7f08d801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f0f3c3b8641cde server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.287+0000 7f08e5818640 1 -- 172.21.15.87:0/3380960531 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d8057070 con 0x56494dda52c0 2024-05-08T18:31:40.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.287+0000 7f08e5818640 1 -- 172.21.15.87:0/3380960531 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d804adc0 con 0x56494dda52c0 2024-05-08T18:31:40.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.287+0000 7f08e5818640 1 -- 172.21.15.87:0/3380960531 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d8052590 con 0x56494dda52c0 2024-05-08T18:31:40.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.287+0000 7f08eb213800 1 -- 172.21.15.87:0/3380960531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 msgr2=0x56494dda56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.287+0000 7f08eb213800 1 --2- 172.21.15.87:0/3380960531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 0x56494dda56e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f08d800a470 tx=0x7f08d801ce90 comp rx=0 tx=0).stop 2024-05-08T18:31:40.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.287+0000 7f08eb213800 1 -- 172.21.15.87:0/3380960531 shutdown_connections 2024-05-08T18:31:40.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.287+0000 7f08eb213800 1 --2- 172.21.15.87:0/3380960531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 0x56494dda56e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.287+0000 7f08eb213800 1 -- 172.21.15.87:0/3380960531 >> 172.21.15.87:0/3380960531 conn(0x56494dda0840 msgr2=0x56494dda2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.287+0000 7f08eb213800 1 -- 172.21.15.87:0/3380960531 shutdown_connections 2024-05-08T18:31:40.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.287+0000 7f08eb213800 1 -- 172.21.15.87:0/3380960531 wait complete. 2024-05-08T18:31:40.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.302+0000 7f08eb213800 1 Processor -- start 2024-05-08T18:31:40.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.302+0000 7f08eb213800 1 -- start start 2024-05-08T18:31:40.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.302+0000 7f08eb213800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 0x56494dd1ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.302+0000 7f08eb213800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56494dcf05c0 con 0x56494dda52c0 2024-05-08T18:31:40.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.302+0000 7f08e681a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 0x56494dd1ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.302+0000 7f08e681a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 0x56494dd1ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59210/0 (socket says 172.21.15.87:59210) 2024-05-08T18:31:40.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.302+0000 7f08e681a640 1 -- 172.21.15.87:0/1811907085 learned_addr learned my addr 172.21.15.87:0/1811907085 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.303+0000 7f08e681a640 1 -- 172.21.15.87:0/1811907085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56494dd19240 con 0x56494dda52c0 2024-05-08T18:31:40.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.303+0000 7f08e681a640 1 --2- 172.21.15.87:0/1811907085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 0x56494dd1ac80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f08d8055040 tx=0x7f08d804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dacc40b7c43f482 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.303+0000 7f07d4e09640 1 -- 172.21.15.87:0/1811907085 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d8057040 con 0x56494dda52c0 2024-05-08T18:31:40.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.303+0000 7f07d4e09640 1 -- 172.21.15.87:0/1811907085 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d8063070 con 0x56494dda52c0 2024-05-08T18:31:40.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.303+0000 7f07d4e09640 1 -- 172.21.15.87:0/1811907085 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d805d790 con 0x56494dda52c0 2024-05-08T18:31:40.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.304+0000 7f08eb213800 1 -- 172.21.15.87:0/1811907085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 msgr2=0x56494dd1ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.304+0000 7f08eb213800 1 --2- 172.21.15.87:0/1811907085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 0x56494dd1ac80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f08d8055040 tx=0x7f08d804c000 comp rx=0 tx=0).stop 2024-05-08T18:31:40.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.304+0000 7f08eb213800 1 -- 172.21.15.87:0/1811907085 shutdown_connections 2024-05-08T18:31:40.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.304+0000 7f08eb213800 1 --2- 172.21.15.87:0/1811907085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 0x56494dd1ac80 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.304+0000 7f08eb213800 1 -- 172.21.15.87:0/1811907085 >> 172.21.15.87:0/1811907085 conn(0x56494dda0840 msgr2=0x56494de92080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.304+0000 7f08eb213800 1 -- 172.21.15.87:0/1811907085 shutdown_connections 2024-05-08T18:31:40.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.304+0000 7f08eb213800 1 -- 172.21.15.87:0/1811907085 wait complete. 2024-05-08T18:31:40.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.304+0000 7f08eb213800 1 Processor -- start 2024-05-08T18:31:40.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.304+0000 7f08eb213800 1 -- start start 2024-05-08T18:31:40.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.305+0000 7f08eb213800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 0x56494dea01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.305+0000 7f08eb213800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56494ddae950 con 0x56494dda52c0 2024-05-08T18:31:40.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.305+0000 7f08e681a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 0x56494dea01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.305+0000 7f08e681a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 0x56494dea01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59216/0 (socket says 172.21.15.87:59216) 2024-05-08T18:31:40.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.305+0000 7f08e681a640 1 -- 172.21.15.87:0/938944087 learned_addr learned my addr 172.21.15.87:0/938944087 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.305+0000 7f08e681a640 1 -- 172.21.15.87:0/938944087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56494dea06f0 con 0x56494dda52c0 2024-05-08T18:31:40.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.305+0000 7f08e681a640 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 0x56494dea01b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f08d800a470 tx=0x7f08d8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.305+0000 7f07d3606640 1 -- 172.21.15.87:0/938944087 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d806c070 con 0x56494dda52c0 2024-05-08T18:31:40.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.305+0000 7f08eb213800 1 -- 172.21.15.87:0/938944087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56494dea0980 con 0x56494dda52c0 2024-05-08T18:31:40.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.306+0000 7f07d3606640 1 -- 172.21.15.87:0/938944087 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d8071460 con 0x56494dda52c0 2024-05-08T18:31:40.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.306+0000 7f07d3606640 1 -- 172.21.15.87:0/938944087 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d8057070 con 0x56494dda52c0 2024-05-08T18:31:40.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.306+0000 7f08eb213800 1 -- 172.21.15.87:0/938944087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56494dea3630 con 0x56494dda52c0 2024-05-08T18:31:40.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.306+0000 7f07d3606640 1 -- 172.21.15.87:0/938944087 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f08d8071740 con 0x56494dda52c0 2024-05-08T18:31:40.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.307+0000 7f07d3606640 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f07cc03bb50 0x7f07cc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.307+0000 7f07d3606640 1 -- 172.21.15.87:0/938944087 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f08d8094c00 con 0x56494dda52c0 2024-05-08T18:31:40.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.307+0000 7f08e6019640 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f07cc03bb50 0x7f07cc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.307+0000 7f08eb213800 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56494dda6480 0x56494dea73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.307+0000 7f08eb213800 1 -- 172.21.15.87:0/938944087 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dea7930 con 0x56494dda6480 2024-05-08T18:31:40.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.307+0000 7f08e701b640 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56494dda6480 0x56494dea73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.307+0000 7f08e6019640 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f07cc03bb50 0x7f07cc03e010 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f08dc000f60 tx=0x7f08dc0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.307+0000 7f08e701b640 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56494dda6480 0x56494dea73f0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.307+0000 7f08e701b640 1 -- 172.21.15.87:0/938944087 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08e000a4a0 con 0x56494dda6480 2024-05-08T18:31:40.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.308+0000 7f08eb213800 1 -- 172.21.15.87:0/938944087 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dea49c0 con 0x56494dda6480 2024-05-08T18:31:40.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.308+0000 7f08e701b640 1 -- 172.21.15.87:0/938944087 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f08e000a4a0 con 0x56494dda6480 2024-05-08T18:31:40.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.308+0000 7f08eb213800 1 -- 172.21.15.87:0/938944087 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dea9730 con 0x56494dda6480 2024-05-08T18:31:40.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.308+0000 7f08e701b640 1 -- 172.21.15.87:0/938944087 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f08e000a4a0 con 0x56494dda6480 2024-05-08T18:31:40.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.308+0000 7f08eb213800 1 -- 172.21.15.87:0/938944087 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dea8960 con 0x56494dda6480 2024-05-08T18:31:40.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.308+0000 7f08e701b640 1 -- 172.21.15.87:0/938944087 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f08e000a4a0 con 0x56494dda6480 2024-05-08T18:31:40.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.309+0000 7f08eb213800 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56494deaaae0 0x56494deaced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.309+0000 7f08eb213800 1 -- 172.21.15.87:0/938944087 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dead410 con 0x56494deaaae0 2024-05-08T18:31:40.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.309+0000 7f08e681a640 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56494deaaae0 0x56494deaced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.309+0000 7f08e681a640 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56494deaaae0 0x56494deaced0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.310+0000 7f08e681a640 1 -- 172.21.15.87:0/938944087 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f08d805a040 con 0x56494deaaae0 2024-05-08T18:31:40.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.310+0000 7f08eb213800 1 Processor -- start 2024-05-08T18:31:40.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.310+0000 7f08eb213800 1 -- start start 2024-05-08T18:31:40.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.310+0000 7f08eb213800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494debb670 0x56494debba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.310+0000 7f08eb213800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56494dc96fc0 con 0x56494debb670 2024-05-08T18:31:40.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.310+0000 7f08e701b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494debb670 0x56494debba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.310+0000 7f08e701b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494debb670 0x56494debba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59218/0 (socket says 172.21.15.87:59218) 2024-05-08T18:31:40.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.310+0000 7f08e701b640 1 -- 172.21.15.87:0/3828349669 learned_addr learned my addr 172.21.15.87:0/3828349669 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.311+0000 7f08e701b640 1 -- 172.21.15.87:0/3828349669 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56494debbfd0 con 0x56494debb670 2024-05-08T18:31:40.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.311+0000 7f08e701b640 1 --2- 172.21.15.87:0/3828349669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494debb670 0x56494debba90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x56494dea13d0 tx=0x7f08e00178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.311+0000 7f07d0e01640 1 -- 172.21.15.87:0/3828349669 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e0013440 con 0x56494debb670 2024-05-08T18:31:40.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.311+0000 7f07d0e01640 1 -- 172.21.15.87:0/3828349669 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e00135e0 con 0x56494debb670 2024-05-08T18:31:40.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.311+0000 7f07d0e01640 1 -- 172.21.15.87:0/3828349669 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e00138c0 con 0x56494debb670 2024-05-08T18:31:40.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.311+0000 7f08eb213800 1 -- 172.21.15.87:0/3828349669 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56494debca40 con 0x56494debb670 2024-05-08T18:31:40.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.311+0000 7f08eb213800 1 -- 172.21.15.87:0/3828349669 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56494debcf40 con 0x56494debb670 2024-05-08T18:31:40.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.312+0000 7f07d0e01640 1 -- 172.21.15.87:0/3828349669 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f08e0011040 con 0x56494debb670 2024-05-08T18:31:40.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.312+0000 7f07d0e01640 1 --2- 172.21.15.87:0/3828349669 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f07c003bbf0 0x7f07c003e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.312+0000 7f07d0e01640 1 -- 172.21.15.87:0/3828349669 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f08e001d070 con 0x56494debb670 2024-05-08T18:31:40.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.312+0000 7f08e681a640 1 --2- 172.21.15.87:0/3828349669 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f07c003bbf0 0x7f07c003e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.312+0000 7f08eb213800 1 Processor -- start 2024-05-08T18:31:40.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.313+0000 7f08e681a640 1 --2- 172.21.15.87:0/3828349669 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f07c003bbf0 0x7f07c003e0b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f08d806fb20 tx=0x7f08d806f860 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.313+0000 7f08eb213800 1 -- start start 2024-05-08T18:31:40.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.313+0000 7f08eb213800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dec88f0 0x56494dec8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.313+0000 7f08eb213800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56494dd19500 con 0x56494dec88f0 2024-05-08T18:31:40.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.313+0000 7f08e701b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dec88f0 0x56494dec8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.313+0000 7f08e701b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dec88f0 0x56494dec8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59226/0 (socket says 172.21.15.87:59226) 2024-05-08T18:31:40.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.313+0000 7f08e701b640 1 -- 172.21.15.87:0/209535397 learned_addr learned my addr 172.21.15.87:0/209535397 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.313+0000 7f08e701b640 1 -- 172.21.15.87:0/209535397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56494dec92e0 con 0x56494dec88f0 2024-05-08T18:31:40.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.313+0000 7f08e701b640 1 --2- 172.21.15.87:0/209535397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dec88f0 0x56494dec8d10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f08e0052920 tx=0x7f08e0001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e52fcf29bbf13 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.313+0000 7f07ca7fc640 1 -- 172.21.15.87:0/209535397 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e0021d70 con 0x56494dec88f0 2024-05-08T18:31:40.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.314+0000 7f07ca7fc640 1 -- 172.21.15.87:0/209535397 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e002ac50 con 0x56494dec88f0 2024-05-08T18:31:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.314+0000 7f07ca7fc640 1 -- 172.21.15.87:0/209535397 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e00540d0 con 0x56494dec88f0 2024-05-08T18:31:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.314+0000 7f08eb213800 1 -- 172.21.15.87:0/209535397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dec88f0 msgr2=0x56494dec8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.314+0000 7f08eb213800 1 --2- 172.21.15.87:0/209535397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dec88f0 0x56494dec8d10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f08e0052920 tx=0x7f08e0001e60 comp rx=0 tx=0).stop 2024-05-08T18:31:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.314+0000 7f08eb213800 1 -- 172.21.15.87:0/209535397 shutdown_connections 2024-05-08T18:31:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.314+0000 7f08eb213800 1 --2- 172.21.15.87:0/209535397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dec88f0 0x56494dec8d10 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.314+0000 7f08eb213800 1 -- 172.21.15.87:0/209535397 >> 172.21.15.87:0/209535397 conn(0x56494dec4c00 msgr2=0x56494dec2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.314+0000 7f08eb213800 1 -- 172.21.15.87:0/209535397 shutdown_connections 2024-05-08T18:31:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.314+0000 7f08eb213800 1 -- 172.21.15.87:0/209535397 wait complete. 2024-05-08T18:31:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.314+0000 7f08eb213800 1 Processor -- start 2024-05-08T18:31:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.314+0000 7f08eb213800 1 -- start start 2024-05-08T18:31:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.315+0000 7f08eb213800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dec88f0 0x56494decfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.315+0000 7f08eb213800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56494dec9ab0 con 0x56494dec88f0 2024-05-08T18:31:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.315+0000 7f08e701b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dec88f0 0x56494decfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.315+0000 7f08e701b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dec88f0 0x56494decfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59232/0 (socket says 172.21.15.87:59232) 2024-05-08T18:31:40.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.315+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 learned_addr learned my addr 172.21.15.87:0/3495710969 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.315+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56494ded0390 con 0x56494dec88f0 2024-05-08T18:31:40.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.315+0000 7f08e701b640 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dec88f0 0x56494decfe50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f08e004d010 tx=0x7f08e0052880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.315+0000 7f07c8ff9640 1 -- 172.21.15.87:0/3495710969 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e0030070 con 0x56494dec88f0 2024-05-08T18:31:40.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.315+0000 7f07c8ff9640 1 -- 172.21.15.87:0/3495710969 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e0051200 con 0x56494dec88f0 2024-05-08T18:31:40.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.315+0000 7f07c8ff9640 1 -- 172.21.15.87:0/3495710969 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e00514e0 con 0x56494dec88f0 2024-05-08T18:31:40.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.315+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56494ded0620 con 0x56494dec88f0 2024-05-08T18:31:40.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.315+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56494de98460 con 0x56494dec88f0 2024-05-08T18:31:40.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.316+0000 7f07c8ff9640 1 -- 172.21.15.87:0/3495710969 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f08e0033070 con 0x56494dec88f0 2024-05-08T18:31:40.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.316+0000 7f07c8ff9640 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f07b003bba0 0x7f07b003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.317+0000 7f07c8ff9640 1 -- 172.21.15.87:0/3495710969 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f08e000e040 con 0x56494dec88f0 2024-05-08T18:31:40.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.317+0000 7f08e681a640 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f07b003bba0 0x7f07b003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.317+0000 7f08e681a640 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f07b003bba0 0x7f07b003e060 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f08d8093250 tx=0x7f08d8087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.317+0000 7f08eb213800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.317+0000 7f08eb213800 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56494dedff60 0x56494dee2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.317+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dee2b70 con 0x56494dedff60 2024-05-08T18:31:40.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.318+0000 7f08e6019640 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56494dedff60 0x56494dee2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.318+0000 7f08e6019640 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56494dedff60 0x56494dee2420 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.318+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08dc009050 con 0x56494dedff60 2024-05-08T18:31:40.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.318+0000 7f08eb213800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.318+0000 7f08eb213800 20 realm 2024-05-08T18:31:40.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.318+0000 7f08eb213800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.318+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dedf3b0 con 0x56494dedff60 2024-05-08T18:31:40.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.319+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08dc009050 con 0x56494dedff60 2024-05-08T18:31:40.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.319+0000 7f08eb213800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.319+0000 7f08eb213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:40.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.319+0000 7f08eb213800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.319+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dee3660 con 0x56494dedff60 2024-05-08T18:31:40.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.319+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08dc009050 con 0x56494dedff60 2024-05-08T18:31:40.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.319+0000 7f08eb213800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.319+0000 7f08eb213800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.319+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dee3f30 con 0x56494dedff60 2024-05-08T18:31:40.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.319+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f08dc009050 con 0x56494dedff60 2024-05-08T18:31:40.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.319+0000 7f08eb213800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:40.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.319+0000 7f08eb213800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.319+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dee42d0 con 0x56494dedff60 2024-05-08T18:31:40.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.319+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f08dc009050 con 0x56494dedff60 2024-05-08T18:31:40.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.319+0000 7f08eb213800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:40.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.320+0000 7f08eb213800 20 searching for the correct realm 2024-05-08T18:31:40.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.320+0000 7f08eb213800 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56494dee61b0 0x56494dee85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.320+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x56494dee61b0 2024-05-08T18:31:40.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.320+0000 7f08e701b640 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56494dee61b0 0x56494dee85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.320+0000 7f08e701b640 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56494dee61b0 0x56494dee85c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.320+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.320+0000 7f08e701b640 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f08e0035070 0x7f08e0022420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.320+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x7f08e0035070 2024-05-08T18:31:40.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.320+0000 7f08e681a640 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f08e0035070 0x7f08e0022420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.321+0000 7f08e681a640 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f08e0035070 0x7f08e0022420 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.321+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.321+0000 7f08e681a640 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f08d80a2040 0x7f08d807a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.321+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x7f08d80a2040 2024-05-08T18:31:40.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.321+0000 7f08e6019640 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f08d80a2040 0x7f08d807a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.322+0000 7f08e6019640 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f08d80a2040 0x7f08d807a850 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.322+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc009050 con 0x7f08d80a2040 2024-05-08T18:31:40.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.322+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x56494dedff60 2024-05-08T18:31:40.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.322+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc009050 con 0x56494dedff60 2024-05-08T18:31:40.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.322+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x56494dedff60 2024-05-08T18:31:40.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.322+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.322+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x7f08d80a2040 2024-05-08T18:31:40.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.323+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.323+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x7f08d80a2040 2024-05-08T18:31:40.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.323+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.323+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x7f08e0035070 2024-05-08T18:31:40.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.323+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.323+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x56494dee61b0 2024-05-08T18:31:40.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.323+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.323+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x56494dedff60 2024-05-08T18:31:40.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.324+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.324+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x7f08d80a2040 2024-05-08T18:31:40.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.324+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.324+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x56494dedff60 2024-05-08T18:31:40.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.324+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.324+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x7f08e0035070 2024-05-08T18:31:40.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.324+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.324+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x56494dee61b0 2024-05-08T18:31:40.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.325+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.325+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x56494dee61b0 2024-05-08T18:31:40.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.325+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.325+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x7f08d80a2040 2024-05-08T18:31:40.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.325+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.325+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x56494dee61b0 2024-05-08T18:31:40.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.325+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.325+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x56494dee61b0 2024-05-08T18:31:40.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.325+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.325+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x56494dedff60 2024-05-08T18:31:40.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.326+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.326+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x56494dedff60 2024-05-08T18:31:40.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.326+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.326+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x7f08d80a2040 2024-05-08T18:31:40.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.326+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.326+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x56494dee61b0 2024-05-08T18:31:40.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.326+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.326+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x7f08e0035070 2024-05-08T18:31:40.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.327+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.327+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x56494dedff60 2024-05-08T18:31:40.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.327+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.327+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x7f08d80a2040 2024-05-08T18:31:40.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.327+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.327+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x56494dee61b0 2024-05-08T18:31:40.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.328+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.328+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x7f08d80a2040 2024-05-08T18:31:40.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.328+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.328+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x7f08e0035070 2024-05-08T18:31:40.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.328+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.328+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x56494dee61b0 2024-05-08T18:31:40.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.328+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.328+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x7f08d80a2040 2024-05-08T18:31:40.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.329+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.329+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x56494dedff60 2024-05-08T18:31:40.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.329+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.329+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56494dee8c90 con 0x7f08e0035070 2024-05-08T18:31:40.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.329+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.329+0000 7f08eb213800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:40.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.329+0000 7f08eb213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:40.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.329+0000 7f08eb213800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:40.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.329+0000 7f08eb213800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:40.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.329+0000 7f08eb213800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:40.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.329+0000 7f08eb213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:40.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.329+0000 7f08eb213800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.329+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dee4c20 con 0x56494dedff60 2024-05-08T18:31:40.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.329+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.329+0000 7f08eb213800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.329+0000 7f08eb213800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.329+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dee54c0 con 0x56494dedff60 2024-05-08T18:31:40.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.330+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.330+0000 7f08eb213800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:40.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.330+0000 7f08eb213800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.330+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dee9110 con 0x7f08d80a2040 2024-05-08T18:31:40.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.330+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.330+0000 7f08eb213800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:40.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.330+0000 7f08eb213800 20 zone default found 2024-05-08T18:31:40.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.330+0000 7f08eb213800 4 Realm: () 2024-05-08T18:31:40.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.330+0000 7f08eb213800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:40.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.330+0000 7f08eb213800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:40.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.330+0000 7f08eb213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:40.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.330+0000 7f08eb213800 20 zonegroup default 2024-05-08T18:31:40.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.330+0000 7f08eb213800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.330+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dee95c0 con 0x7f08d80a2040 2024-05-08T18:31:40.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.331+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.331+0000 7f08eb213800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.331+0000 7f08eb213800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.331+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494deeafa0 con 0x56494dee61b0 2024-05-08T18:31:40.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.331+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.331+0000 7f08eb213800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.331+0000 7f08eb213800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.331+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494deeb430 con 0x56494dee61b0 2024-05-08T18:31:40.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.331+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.331+0000 7f08eb213800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.331+0000 7f08eb213800 20 started sync module instance, tier type = 2024-05-08T18:31:40.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.331+0000 7f08eb213800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:40.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.331+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deea430 con 0x7f08e0035070 2024-05-08T18:31:40.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.332+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.332+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94872840087584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deebd40 con 0x7f08e0035070 2024-05-08T18:31:40.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.332+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deec590 con 0x56494dedff60 2024-05-08T18:31:40.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.333+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94872840087584] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.334+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.334+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94872840091792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deec5d0 con 0x56494dedff60 2024-05-08T18:31:40.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.334+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deed0f0 con 0x56494dee61b0 2024-05-08T18:31:40.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.335+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.335+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94872840096704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deed990 con 0x56494dee61b0 2024-05-08T18:31:40.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.335+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deee460 con 0x7f08e0035070 2024-05-08T18:31:40.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.335+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94872840091792] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.335+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94872840096704] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.336+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.336+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94872840093920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deed990 con 0x7f08e0035070 2024-05-08T18:31:40.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.336+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deeed40 con 0x56494dedff60 2024-05-08T18:31:40.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.337+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.337+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94872840093920] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.337+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94872840104016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deef5e0 con 0x56494dedff60 2024-05-08T18:31:40.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.337+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deed4e0 con 0x7f08d80a2040 2024-05-08T18:31:40.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.338+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.338+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94872840108880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deed4e0 con 0x7f08d80a2040 2024-05-08T18:31:40.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.338+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494def08d0 con 0x7f08d80a2040 2024-05-08T18:31:40.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.338+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94872840104016] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.339+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94872840108880] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.339+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.339+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94872840106288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494def0420 con 0x7f08d80a2040 2024-05-08T18:31:40.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.339+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494def0f10 con 0x7f08d80a2040 2024-05-08T18:31:40.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.340+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.340+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94872840106288] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.340+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94872840112608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494def1380 con 0x7f08d80a2040 2024-05-08T18:31:40.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.340+0000 7f08eb213800 20 add_watcher() i=0 2024-05-08T18:31:40.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.340+0000 7f08eb213800 20 add_watcher() i=1 2024-05-08T18:31:40.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.340+0000 7f08eb213800 20 add_watcher() i=2 2024-05-08T18:31:40.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.340+0000 7f08eb213800 20 add_watcher() i=3 2024-05-08T18:31:40.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.340+0000 7f08eb213800 20 add_watcher() i=4 2024-05-08T18:31:40.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.340+0000 7f08eb213800 20 add_watcher() i=5 2024-05-08T18:31:40.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.340+0000 7f08eb213800 20 add_watcher() i=6 2024-05-08T18:31:40.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.341+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94872840112608] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.341+0000 7f08eb213800 20 add_watcher() i=7 2024-05-08T18:31:40.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.341+0000 7f08eb213800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:40.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.341+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494def1380 con 0x56494dedff60 2024-05-08T18:31:40.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.342+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.342+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94872840113872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494def1320 con 0x56494dedff60 2024-05-08T18:31:40.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.343+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94872840113872] v27'183 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.343+0000 7f079d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:40.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.343+0000 7f08eb213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:40.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.343+0000 7f08eb213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:40.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.343+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defccc0 con 0x56494dedff60 2024-05-08T18:31:40.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.344+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.344+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defd310 con 0x7f08d80a2040 2024-05-08T18:31:40.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.345+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.345+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defd770 con 0x56494dee61b0 2024-05-08T18:31:40.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.346+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.346+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defd6e0 con 0x56494dedff60 2024-05-08T18:31:40.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.347+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'184 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.347+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defdd30 con 0x7f08e0035070 2024-05-08T18:31:40.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.348+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.348+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe1e0 con 0x56494dee61b0 2024-05-08T18:31:40.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.349+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.349+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe1e0 con 0x56494dedff60 2024-05-08T18:31:40.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.350+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.350+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe1e0 con 0x7f08d80a2040 2024-05-08T18:31:40.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.352+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.352+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe1e0 con 0x7f08e0035070 2024-05-08T18:31:40.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.353+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.353+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe1e0 con 0x56494dee61b0 2024-05-08T18:31:40.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.353+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.353+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe1e0 con 0x7f08e0035070 2024-05-08T18:31:40.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.354+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.354+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe2f0 con 0x7f08d80a2040 2024-05-08T18:31:40.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.355+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.355+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe2f0 con 0x7f08e0035070 2024-05-08T18:31:40.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.356+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.356+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe2f0 con 0x7f08d80a2040 2024-05-08T18:31:40.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.358+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.358+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe2f0 con 0x56494dedff60 2024-05-08T18:31:40.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.359+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'185 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.359+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe7b0 con 0x56494dee61b0 2024-05-08T18:31:40.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.360+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'56 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.360+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe7b0 con 0x7f08e0035070 2024-05-08T18:31:40.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.361+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.361+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe7b0 con 0x56494dee61b0 2024-05-08T18:31:40.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.362+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.362+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe7b0 con 0x56494dedff60 2024-05-08T18:31:40.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.363+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.363+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe7b0 con 0x56494dedff60 2024-05-08T18:31:40.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.364+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'186 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.364+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe7b0 con 0x56494dee61b0 2024-05-08T18:31:40.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.365+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'57 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.365+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe7b0 con 0x7f08e0035070 2024-05-08T18:31:40.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.366+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.366+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe7b0 con 0x56494dee61b0 2024-05-08T18:31:40.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.367+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.367+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe7b0 con 0x56494dee61b0 2024-05-08T18:31:40.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.368+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.368+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe7b0 con 0x56494dee61b0 2024-05-08T18:31:40.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.368+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'22 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.368+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe7b0 con 0x56494dee61b0 2024-05-08T18:31:40.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.369+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'43 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.369+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe7b0 con 0x7f08d80a2040 2024-05-08T18:31:40.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.371+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.371+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe7b0 con 0x56494dee61b0 2024-05-08T18:31:40.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.372+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.372+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe7b0 con 0x7f08d80a2040 2024-05-08T18:31:40.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.373+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.373+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe7b0 con 0x56494dee61b0 2024-05-08T18:31:40.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.374+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'58 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.374+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe7b0 con 0x7f08d80a2040 2024-05-08T18:31:40.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.375+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.375+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494defe7b0 con 0x7f08e0035070 2024-05-08T18:31:40.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.376+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.376+0000 7f0717fff640 20 reqs_thread_entry: start 2024-05-08T18:31:40.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.376+0000 7f08eb213800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:40.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.376+0000 7f08eb213800 20 Filter name: none 2024-05-08T18:31:40.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.376+0000 7f0715ffb640 20 reqs_thread_entry: start 2024-05-08T18:31:40.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.376+0000 7f08eb213800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:31:40.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.377+0000 7f08eb213800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.377+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df297a0 con 0x7f08e0035070 2024-05-08T18:31:40.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.377+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.377+0000 7f08eb213800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:31:40.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.377+0000 7f08eb213800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:31:40.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.377+0000 7f08eb213800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:31:40.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.377+0000 7f08eb213800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 : miss 2024-05-08T18:31:40.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.377+0000 7f08eb213800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.377+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:95 8.f 8:f1ea543d:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df2b260 con 0x56494dee61b0 2024-05-08T18:31:40.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.377+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(95 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.377+0000 7f08eb213800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:31:40.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.377+0000 7f08eb213800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 info.flags=0x17 2024-05-08T18:31:40.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.377+0000 7f08eb213800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 to cache LRU end 2024-05-08T18:31:40.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.377+0000 7f08eb213800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:40.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.377+0000 7f08eb213800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:31:40.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.377+0000 7f08eb213800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 2024-05-08T18:31:40.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.377+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:96 4.1a 4:5a0cefba:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dfa8a90 con 0x7f08e0035070 2024-05-08T18:31:40.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.378+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(96 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.378+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:97 4.26 4:6436c020:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dfa8a90 con 0x7f08d80a2040 2024-05-08T18:31:40.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.378+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(97 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.378+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:98 4.3a 4:5e052b31:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dfa8a90 con 0x56494dee61b0 2024-05-08T18:31:40.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.378+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 27 ==== osd_op_reply(98 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.2 [call out=425b] v0'0 uv7 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.378+0000 7f08eb213800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-05-08T18:31:40.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.378+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:99 4.14 4:295ac550:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dfa8fb0 con 0x56494dee61b0 2024-05-08T18:31:40.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.379+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 28 ==== osd_op_reply(99 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.379+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:100 4.28 4:167138b7:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dfa8fb0 con 0x56494dedff60 2024-05-08T18:31:40.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.379+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(100 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.379+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:101 4.10 4:086bfbc1:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dfa8fb0 con 0x56494dee61b0 2024-05-08T18:31:40.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.379+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 29 ==== osd_op_reply(101 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.379+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:102 4.34 4:2e59ab6c:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dfa8fb0 con 0x7f08e0035070 2024-05-08T18:31:40.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.380+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 20 ==== osd_op_reply(102 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.6 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.380+0000 7f08eb213800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-05-08T18:31:40.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.380+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:103 4.f 4:f38351a7:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dfa8fb0 con 0x56494dedff60 2024-05-08T18:31:40.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.380+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(103 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.380+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:104 4.14 4:2986a026:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dfa8fb0 con 0x56494dee61b0 2024-05-08T18:31:40.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.380+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 30 ==== osd_op_reply(104 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.8 [call out=426b] v0'0 uv6 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.380+0000 7f08eb213800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-05-08T18:31:40.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.380+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:105 4.c 4:3163d89e:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dfa8fb0 con 0x56494dedff60 2024-05-08T18:31:40.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.381+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(105 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.381+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:106 4.31 4:8fc77ea9:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dfa8fb0 con 0x56494dedff60 2024-05-08T18:31:40.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.381+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(106 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10 [call out=697b] v0'0 uv9 ondisk = 0) ==== 195+0+697 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.381+0000 7f08eb213800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-05-08T18:31:40.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.381+0000 7f08eb213800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-05-08T18:31:40.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.381+0000 7f08eb213800 20 get_obj_state: octx=0x56494df29610 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x56494df2c038 s->prefetch_data=0 2024-05-08T18:31:40.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.381+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:107 3.39s0 3:9eb244df:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494dfa6790 con 0x56494dee61b0 2024-05-08T18:31:40.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.381+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 31 ==== osd_op_reply(107 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.381+0000 7f08eb213800 10 manifest: total_size = 6 2024-05-08T18:31:40.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.381+0000 7f08eb213800 20 get_obj_state: setting s->obj_tag to be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.8262371783912346648 2024-05-08T18:31:40.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.381+0000 7f08eb213800 20 get_obj_state: octx=0x56494df29610 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x56494df2c038 s->prefetch_data=0 2024-05-08T18:31:40.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.381+0000 7f08eb213800 20 prepare_atomic_modification: state is not atomic. state=0x56494df2c038 2024-05-08T18:31:40.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.381+0000 7f08eb213800 20 bucket index object: :.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.2 2024-05-08T18:31:40.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.381+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:108 4.3a 4:5e052b31:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df309f0 con 0x56494dee61b0 2024-05-08T18:31:40.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.382+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 32 ==== osd_op_reply(108 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.2 [stat,call,call] v27'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.382+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:109 3.39s0 3:9eb244df:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df2e9d0 con 0x56494dee61b0 2024-05-08T18:31:40.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.383+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 33 ==== osd_op_reply(109 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_9c8454ddf7aa50116496bac348d7550d [call] v27'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.383+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:110 4.3a 4:5e052b31:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df31300 con 0x56494dee61b0 2024-05-08T18:31:40.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.384+0000 7f08eb213800 20 get_obj_state: octx=0x56494df29610 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x56494df2c038 s->prefetch_data=0 2024-05-08T18:31:40.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.384+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:111 3.1cs0 3:3a70f4bb:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df31300 con 0x56494dedff60 2024-05-08T18:31:40.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.384+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(111 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.384+0000 7f08eb213800 10 manifest: total_size = 3 2024-05-08T18:31:40.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.384+0000 7f08eb213800 20 get_obj_state: setting s->obj_tag to be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9928734398501809357 2024-05-08T18:31:40.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.384+0000 7f08eb213800 20 get_obj_state: octx=0x56494df29610 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x56494df2c038 s->prefetch_data=0 2024-05-08T18:31:40.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.384+0000 7f08eb213800 20 prepare_atomic_modification: state is not atomic. state=0x56494df2c038 2024-05-08T18:31:40.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.384+0000 7f08eb213800 20 bucket index object: :.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.6 2024-05-08T18:31:40.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.384+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:112 4.34 4:2e59ab6c:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df35fb0 con 0x7f08e0035070 2024-05-08T18:31:40.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.386+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 21 ==== osd_op_reply(112 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.6 [stat,call,call] v27'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.386+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 34 ==== osd_op_reply(110 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.2 [stat,call,call] v27'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.386+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:113 3.1cs0 3:3a70f4bb:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df33f90 con 0x56494dedff60 2024-05-08T18:31:40.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.386+0000 7f07ca7fc640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-05-08T18:31:40.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.387+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 33 ==== osd_op_reply(113 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_b1b9a972ccd8c962a473909b97007eb4 [call] v27'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.388+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:114 4.34 4:2e59ab6c:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df31f70 con 0x7f08e0035070 2024-05-08T18:31:40.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.388+0000 7f08eb213800 20 get_obj_state: octx=0x56494df29610 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x56494df2c038 s->prefetch_data=0 2024-05-08T18:31:40.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.388+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:115 3.0s0 3:02dd9373:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df32b10 con 0x7f08d80a2040 2024-05-08T18:31:40.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.388+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(115 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.388+0000 7f08eb213800 10 manifest: total_size = 4 2024-05-08T18:31:40.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.388+0000 7f08eb213800 20 get_obj_state: setting s->obj_tag to be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.14027831238093316620 2024-05-08T18:31:40.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.388+0000 7f08eb213800 20 get_obj_state: octx=0x56494df29610 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x56494df2c038 s->prefetch_data=0 2024-05-08T18:31:40.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.388+0000 7f08eb213800 20 prepare_atomic_modification: state is not atomic. state=0x56494df2c038 2024-05-08T18:31:40.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.388+0000 7f08eb213800 20 bucket index object: :.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.8 2024-05-08T18:31:40.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.388+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:116 4.14 4:2986a026:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df31f70 con 0x56494dee61b0 2024-05-08T18:31:40.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.389+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 35 ==== osd_op_reply(116 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.8 [stat,call,call] v27'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.389+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:117 3.0s0 3:02dd9373:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df31f70 con 0x7f08d80a2040 2024-05-08T18:31:40.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.390+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 22 ==== osd_op_reply(114 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.6 [stat,call,call] v27'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.390+0000 7f07c9ffb640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-05-08T18:31:40.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.392+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(117 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v27'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.392+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:118 4.14 4:2986a026:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df31ac0 con 0x56494dee61b0 2024-05-08T18:31:40.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.392+0000 7f08eb213800 20 get_obj_state: octx=0x56494df29610 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x56494df2c038 s->prefetch_data=0 2024-05-08T18:31:40.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.392+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:119 3.34s0 3:2f3db009:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df2de70 con 0x56494dedff60 2024-05-08T18:31:40.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.392+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 34 ==== osd_op_reply(119 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.392+0000 7f08eb213800 10 manifest: total_size = 5 2024-05-08T18:31:40.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.392+0000 7f08eb213800 20 get_obj_state: setting s->obj_tag to be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.8200830620759409915 2024-05-08T18:31:40.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.392+0000 7f08eb213800 20 get_obj_state: octx=0x56494df29610 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x56494df2c038 s->prefetch_data=0 2024-05-08T18:31:40.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.392+0000 7f08eb213800 20 prepare_atomic_modification: state is not atomic. state=0x56494df2c038 2024-05-08T18:31:40.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.392+0000 7f08eb213800 20 bucket index object: :.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10 2024-05-08T18:31:40.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.392+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:120 4.31 4:8fc77ea9:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df31ac0 con 0x56494dedff60 2024-05-08T18:31:40.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.393+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 36 ==== osd_op_reply(118 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.8 [stat,call,call] v27'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.393+0000 7f07ca7fc640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-05-08T18:31:40.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.394+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 35 ==== osd_op_reply(120 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10 [stat,call,call] v27'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.394+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:121 3.34s0 3:2f3db009:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df31ac0 con 0x56494dedff60 2024-05-08T18:31:40.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.396+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 36 ==== osd_op_reply(121 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_24d27c169c2c881eb09a065116f2aa5c [call] v27'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.396+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:122 4.31 4:8fc77ea9:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df2c9b0 con 0x56494dedff60 2024-05-08T18:31:40.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.396+0000 7f08eb213800 20 get_obj_state: octx=0x56494df29610 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56494df2c038 s->prefetch_data=0 2024-05-08T18:31:40.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.396+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:123 3.22s0 3:46947052:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df2c9b0 con 0x56494dee61b0 2024-05-08T18:31:40.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.396+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 37 ==== osd_op_reply(123 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.396+0000 7f08eb213800 10 manifest: total_size = 5 2024-05-08T18:31:40.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.396+0000 7f08eb213800 20 get_obj_state: setting s->obj_tag to _oCvOhlkvBps_8SujhqdUzSFN8vTOd2n 2024-05-08T18:31:40.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.396+0000 7f08eb213800 20 get_obj_state: octx=0x56494df29610 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56494df2c038 s->prefetch_data=0 2024-05-08T18:31:40.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.396+0000 7f08eb213800 20 prepare_atomic_modification: state is not atomic. state=0x56494df2c038 2024-05-08T18:31:40.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.396+0000 7f08eb213800 20 bucket index object: :.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10 2024-05-08T18:31:40.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.396+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:124 4.31 4:8fc77ea9:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df2c9b0 con 0x56494dedff60 2024-05-08T18:31:40.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.397+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 37 ==== osd_op_reply(122 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10 [stat,call,call] v27'11 uv11 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.397+0000 7f07c9ffb640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-05-08T18:31:40.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.397+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 38 ==== osd_op_reply(124 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10 [stat,call,call] v27'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.397+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:125 3.22s0 3:46947052:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df2c9b0 con 0x56494dee61b0 2024-05-08T18:31:40.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.399+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 38 ==== osd_op_reply(125 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5_bb3aec0fdcdbc2974890f805c585d432 [call] v27'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.399+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:126 4.31 4:8fc77ea9:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df2c9b0 con 0x56494dedff60 2024-05-08T18:31:40.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.399+0000 7f08eb213800 20 list_objects_ordered: starting attempt 1 2024-05-08T18:31:40.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.399+0000 7f08eb213800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-08T18:31:40.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.399+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:127 4.1a 4:5a0cefba:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df2be50 con 0x7f08e0035070 2024-05-08T18:31:40.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.399+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:128 4.26 4:6436c020:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df2be50 con 0x7f08d80a2040 2024-05-08T18:31:40.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.399+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:129 4.3a 4:5e052b31:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df2be50 con 0x56494dee61b0 2024-05-08T18:31:40.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.399+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:130 4.14 4:295ac550:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df3d0f0 con 0x56494dee61b0 2024-05-08T18:31:40.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.399+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:131 4.28 4:167138b7:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df3fb10 con 0x56494dedff60 2024-05-08T18:31:40.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.399+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:132 4.10 4:086bfbc1:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df3d0f0 con 0x56494dee61b0 2024-05-08T18:31:40.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.399+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:133 4.34 4:2e59ab6c:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df3fb10 con 0x7f08e0035070 2024-05-08T18:31:40.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.400+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:134 4.f 4:f38351a7:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df46e10 con 0x56494dedff60 2024-05-08T18:31:40.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.400+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:135 4.14 4:2986a026:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df49c90 con 0x56494dee61b0 2024-05-08T18:31:40.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.400+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 23 ==== osd_op_reply(127 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.400+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:136 4.c 4:3163d89e:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df4a150 con 0x56494dedff60 2024-05-08T18:31:40.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.400+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:137 4.31 4:8fc77ea9:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df4ce30 con 0x56494dedff60 2024-05-08T18:31:40.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.400+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(128 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.400+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 24 ==== osd_op_reply(133 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.400+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 39 ==== osd_op_reply(131 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.400+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 39 ==== osd_op_reply(130 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.400+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 40 ==== osd_op_reply(132 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.400+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 41 ==== osd_op_reply(129 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.400+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 42 ==== osd_op_reply(135 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.8 [call out=124b] v0'0 uv8 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.400+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 40 ==== osd_op_reply(134 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.400+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 41 ==== osd_op_reply(136 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 42 ==== osd_op_reply(126 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10 [stat,call,call] v27'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f07c9ffb640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-05-08T18:31:40.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 43 ==== osd_op_reply(137 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08eb213800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-08T18:31:40.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08eb213800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-08T18:31:40.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08eb213800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-08T18:31:40.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08eb213800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-08T18:31:40.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08eb213800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5])"; uploads.size()=0; is_truncated=0 2024-05-08T18:31:40.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:138 4.1a 4:5a0cefba:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df4a130 con 0x7f08e0035070 2024-05-08T18:31:40.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:139 4.26 4:6436c020:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df4ce30 con 0x7f08d80a2040 2024-05-08T18:31:40.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:140 4.3a 4:5e052b31:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df2c240 con 0x56494dee61b0 2024-05-08T18:31:40.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:141 4.14 4:295ac550:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df3f550 con 0x56494dee61b0 2024-05-08T18:31:40.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:142 4.28 4:167138b7:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df2d0a0 con 0x56494dedff60 2024-05-08T18:31:40.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:143 4.10 4:086bfbc1:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df4ce30 con 0x56494dee61b0 2024-05-08T18:31:40.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:144 4.34 4:2e59ab6c:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df2c240 con 0x7f08e0035070 2024-05-08T18:31:40.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:145 4.f 4:f38351a7:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df4ce30 con 0x56494dedff60 2024-05-08T18:31:40.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:146 4.14 4:2986a026:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df3f550 con 0x56494dee61b0 2024-05-08T18:31:40.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:147 4.c 4:3163d89e:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df2d0a0 con 0x56494dedff60 2024-05-08T18:31:40.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:148 4.31 4:8fc77ea9:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df4a130 con 0x56494dedff60 2024-05-08T18:31:40.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.402+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 43 ==== osd_op_reply(140 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.403+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 25 ==== osd_op_reply(138 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.403+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 44 ==== osd_op_reply(141 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.403+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 44 ==== osd_op_reply(142 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.403+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 45 ==== osd_op_reply(143 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.403+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 26 ==== osd_op_reply(144 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.403+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 29 ==== osd_op_reply(139 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.403+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 46 ==== osd_op_reply(146 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.8 [call out=124b] v0'0 uv8 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.403+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 45 ==== osd_op_reply(145 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.403+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 46 ==== osd_op_reply(147 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.403+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 47 ==== osd_op_reply(148 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.403+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df4a130 con 0x7f08e0035070 2024-05-08T18:31:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.404+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 27 ==== osd_op_reply(149 foo.buckets [call] v27'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.404+0000 7f08eb213800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-05-08T18:31:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.404+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df4a130 con 0x7f08e0035070 2024-05-08T18:31:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.405+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 28 ==== osd_op_reply(150 myfoo [call,call,delete] v27'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.405+0000 7f08eb213800 10 removing default.rgw.meta+root+myfoo from cache 2024-05-08T18:31:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.405+0000 7f08eb213800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:31:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.405+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94872840479024 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df2d080 con 0x7f08d80a2040 2024-05-08T18:31:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.406+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 30 ==== watch-notify(notify (1) cookie 94872840106288 notify 115964117006 ret 0) ==== 191+0+0 (crc 0 0 0) 0x56494defd310 con 0x7f08d80a2040 2024-05-08T18:31:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.406+0000 7f07ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117006 cookie 94872840106288 notifier 4641 bl.length()=149 2024-05-08T18:31:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.406+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 31 ==== osd_op_reply(151 notify.6 [notify cookie 94872840479024 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.406+0000 7f07ca7fc640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f07ac003d60 con 0x7f08d80a2040 2024-05-08T18:31:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.406+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 32 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.406+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 33 ==== watch-notify(notify_complete (2) cookie 94872840479024 notify 115964117006 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56494de98460 con 0x7f08d80a2040 2024-05-08T18:31:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.406+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:153 8.f 8:f1ea543d:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df4a130 con 0x56494dee61b0 2024-05-08T18:31:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.407+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 47 ==== osd_op_reply(153 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 [call,call,delete] v27'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.407+0000 7f08eb213800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 from cache 2024-05-08T18:31:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.407+0000 7f08eb213800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5, ofs0, ns] 2024-05-08T18:31:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.407+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:154 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94872840360064 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df4a130 con 0x7f08e0035070 2024-05-08T18:31:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.407+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 29 ==== watch-notify(notify (1) cookie 94872840087584 notify 115964117023 ret 0) ==== 248+0+0 (crc 0 0 0) 0x56494defc680 con 0x7f08e0035070 2024-05-08T18:31:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.407+0000 7f07ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117023 cookie 94872840087584 notifier 4641 bl.length()=206 2024-05-08T18:31:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.407+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 30 ==== osd_op_reply(154 notify.0 [notify cookie 94872840360064 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.407+0000 7f07ca7fc640 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:155 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f07ac003d60 con 0x7f08e0035070 2024-05-08T18:31:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.407+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 31 ==== osd_op_reply(155 notify.0 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.408+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 32 ==== watch-notify(notify_complete (2) cookie 94872840360064 notify 115964117023 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f08d80aa060 con 0x7f08e0035070 2024-05-08T18:31:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.408+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:156 4.1a 4:5a0cefba:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df4a130 con 0x7f08e0035070 2024-05-08T18:31:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.408+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:157 4.26 4:6436c020:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df2d080 con 0x7f08d80a2040 2024-05-08T18:31:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.408+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:158 4.3a 4:5e052b31:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df2c1f0 con 0x56494dee61b0 2024-05-08T18:31:40.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.408+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:159 4.14 4:295ac550:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df29c00 con 0x56494dee61b0 2024-05-08T18:31:40.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.408+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:160 4.28 4:167138b7:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df2d080 con 0x56494dedff60 2024-05-08T18:31:40.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.408+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:161 4.10 4:086bfbc1:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df4a130 con 0x56494dee61b0 2024-05-08T18:31:40.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.408+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:162 4.34 4:2e59ab6c:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df2c1f0 con 0x7f08e0035070 2024-05-08T18:31:40.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.408+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:163 4.f 4:f38351a7:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df29c00 con 0x56494dedff60 2024-05-08T18:31:40.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.408+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:164 4.14 4:2986a026:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df2c1f0 con 0x56494dee61b0 2024-05-08T18:31:40.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.408+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:165 4.c 4:3163d89e:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df4a130 con 0x56494dedff60 2024-05-08T18:31:40.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.408+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:166 4.31 4:8fc77ea9:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df2d080 con 0x56494dedff60 2024-05-08T18:31:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.409+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 48 ==== osd_op_reply(160 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.4 [delete] v27'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.409+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 33 ==== osd_op_reply(156 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.0 [delete] v27'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.410+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 34 ==== osd_op_reply(157 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.1 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.410+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 48 ==== osd_op_reply(159 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.3 [delete] v27'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.410+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 34 ==== osd_op_reply(162 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.6 [delete] v27'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.410+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 49 ==== osd_op_reply(164 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.8 [delete] v27'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.410+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 50 ==== osd_op_reply(158 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.2 [delete] v27'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.410+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 51 ==== osd_op_reply(161 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.5 [delete] v27'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.410+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 49 ==== osd_op_reply(166 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.10 [delete] v27'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.410+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 50 ==== osd_op_reply(163 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.7 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.410+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 51 ==== osd_op_reply(165 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5.9 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.410+0000 7f08eb213800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 : miss 2024-05-08T18:31:40.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.410+0000 7f08eb213800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.410+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:167 6.a 6:53287211:::pubsub..bucket.myfoo%2fbe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56494df4a130 con 0x7f08e0035070 2024-05-08T18:31:40.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.410+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 35 ==== osd_op_reply(167 pubsub..bucket.myfoo/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.410+0000 7f08eb213800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.410+0000 7f08eb213800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 info.flags=0x0 2024-05-08T18:31:40.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.410+0000 7f08eb213800 10 adding default.rgw.log++pubsub..bucket.myfoo/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 to cache LRU end 2024-05-08T18:31:40.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.410+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:168 6.a 6:53287211:::pubsub..bucket.myfoo%2fbe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df4a130 con 0x7f08e0035070 2024-05-08T18:31:40.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.411+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 36 ==== osd_op_reply(168 pubsub..bucket.myfoo/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.5 [delete] v27'35 uv31 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.411+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df4a130 con 0x7f08e0035070 2024-05-08T18:31:40.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.412+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 37 ==== osd_op_reply(169 foo.buckets [call] v27'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.413+0000 7f079d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:40.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.413+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94872840113872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df4a130 con 0x56494dedff60 2024-05-08T18:31:40.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.414+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 52 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94872840113872] v27'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.414+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94872840087584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df4a130 con 0x7f08e0035070 2024-05-08T18:31:40.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.415+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 38 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94872840087584] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.415+0000 7f08eb213800 20 remove_watcher() i=0 2024-05-08T18:31:40.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.415+0000 7f08eb213800 2 removed watcher, disabling cache 2024-05-08T18:31:40.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.415+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94872840091792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deea820 con 0x56494dedff60 2024-05-08T18:31:40.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.416+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 53 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94872840091792] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.416+0000 7f08eb213800 20 remove_watcher() i=1 2024-05-08T18:31:40.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.416+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94872840096704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494df4a130 con 0x56494dee61b0 2024-05-08T18:31:40.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.417+0000 7f08e701b640 1 -- 172.21.15.87:0/3495710969 <== osd.3 v2:172.21.15.87:6800/2929215285 52 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94872840096704] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0032030 con 0x56494dee61b0 2024-05-08T18:31:40.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.417+0000 7f08eb213800 20 remove_watcher() i=2 2024-05-08T18:31:40.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.417+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94872840093920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deeb890 con 0x7f08e0035070 2024-05-08T18:31:40.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.418+0000 7f08e681a640 1 -- 172.21.15.87:0/3495710969 <== osd.2 v2:172.21.15.87:6816/2108501615 39 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94872840093920] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d805a040 con 0x7f08e0035070 2024-05-08T18:31:40.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.418+0000 7f08eb213800 20 remove_watcher() i=3 2024-05-08T18:31:40.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.418+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94872840104016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deea820 con 0x56494dedff60 2024-05-08T18:31:40.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.419+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.1 v2:172.21.15.87:6808/2448644045 54 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94872840104016] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x56494dedff60 2024-05-08T18:31:40.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.419+0000 7f08eb213800 20 remove_watcher() i=4 2024-05-08T18:31:40.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.419+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94872840108880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deecbc0 con 0x7f08d80a2040 2024-05-08T18:31:40.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.420+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 35 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94872840108880] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.420+0000 7f08eb213800 20 remove_watcher() i=5 2024-05-08T18:31:40.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.420+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94872840106288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deeb890 con 0x7f08d80a2040 2024-05-08T18:31:40.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.421+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 36 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94872840106288] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.421+0000 7f08eb213800 20 remove_watcher() i=6 2024-05-08T18:31:40.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.421+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94872840112608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56494deea820 con 0x7f08d80a2040 2024-05-08T18:31:40.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 <== osd.0 v2:172.21.15.53:6800/443747735 37 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94872840112608] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc02a040 con 0x7f08d80a2040 2024-05-08T18:31:40.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 20 remove_watcher() i=7 2024-05-08T18:31:40.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f08d80a2040 msgr2=0x7f08d807a850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f08d80a2040 0x7f08d807a850 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56494dedff60 msgr2=0x56494dee2420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56494dedff60 0x56494dee2420 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f08e0035070 msgr2=0x7f08e0022420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f08e0035070 0x7f08e0022420 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56494dee61b0 msgr2=0x56494dee85c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x56494dee61b0 0x56494dee85c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f07b003bba0 msgr2=0x7f07b003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f07b003bba0 0x7f07b003e060 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f08d8093250 tx=0x7f08d8087000 comp rx=0 tx=0).stop 2024-05-08T18:31:40.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dec88f0 msgr2=0x56494decfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08e6019640 1 -- 172.21.15.87:0/3495710969 reap_dead start 2024-05-08T18:31:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dec88f0 0x56494decfe50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f08e004d010 tx=0x7f08e0052880 comp rx=0 tx=0).stop 2024-05-08T18:31:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 shutdown_connections 2024-05-08T18:31:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 --2- 172.21.15.87:0/3495710969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dec88f0 0x56494decfe50 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 >> 172.21.15.87:0/3495710969 conn(0x56494dec4c00 msgr2=0x56494dec22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 shutdown_connections 2024-05-08T18:31:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 -- 172.21.15.87:0/3495710969 wait complete. 2024-05-08T18:31:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 -- 172.21.15.87:0/3828349669 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f07c003bbf0 msgr2=0x7f07c003e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 --2- 172.21.15.87:0/3828349669 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f07c003bbf0 0x7f07c003e0b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f08d806fb20 tx=0x7f08d806f860 comp rx=0 tx=0).stop 2024-05-08T18:31:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 -- 172.21.15.87:0/3828349669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494debb670 msgr2=0x56494debba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.422+0000 7f08eb213800 1 --2- 172.21.15.87:0/3828349669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494debb670 0x56494debba90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x56494dea13d0 tx=0x7f08e00178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 -- 172.21.15.87:0/3828349669 shutdown_connections 2024-05-08T18:31:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 --2- 172.21.15.87:0/3828349669 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f07c003bbf0 0x7f07c003e0b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 --2- 172.21.15.87:0/3828349669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494debb670 0x56494debba90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 -- 172.21.15.87:0/3828349669 >> 172.21.15.87:0/3828349669 conn(0x56494deaf710 msgr2=0x56494deafb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 -- 172.21.15.87:0/3828349669 shutdown_connections 2024-05-08T18:31:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 -- 172.21.15.87:0/3828349669 wait complete. 2024-05-08T18:31:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 -- 172.21.15.87:0/938944087 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56494deaaae0 msgr2=0x56494deaced0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56494deaaae0 0x56494deaced0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 -- 172.21.15.87:0/938944087 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56494dda6480 msgr2=0x56494dea73f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56494dda6480 0x56494dea73f0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 -- 172.21.15.87:0/938944087 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f07cc03bb50 msgr2=0x7f07cc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f07cc03bb50 0x7f07cc03e010 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f08dc000f60 tx=0x7f08dc0012b0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 -- 172.21.15.87:0/938944087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 msgr2=0x56494dea01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 0x56494dea01b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f08d800a470 tx=0x7f08d8002fb0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 -- 172.21.15.87:0/938944087 shutdown_connections 2024-05-08T18:31:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56494dda6480 0x56494dea73f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x56494deaaae0 0x56494deaced0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f07cc03bb50 0x7f07cc03e010 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 --2- 172.21.15.87:0/938944087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56494dda52c0 0x56494dea01b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 -- 172.21.15.87:0/938944087 >> 172.21.15.87:0/938944087 conn(0x56494dda0840 msgr2=0x56494dd19a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 -- 172.21.15.87:0/938944087 shutdown_connections 2024-05-08T18:31:40.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.423+0000 7f08eb213800 1 -- 172.21.15.87:0/938944087 wait complete. 2024-05-08T18:31:40.430 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-05-08T18:31:40.430 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-05-08T18:31:40.430 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-05-08T18:31:40.476 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:40.476 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:40.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.478+0000 7fc913611800 1 Processor -- start 2024-05-08T18:31:40.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.478+0000 7fc913611800 1 -- start start 2024-05-08T18:31:40.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.479+0000 7fc913611800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556842b4f5e0 0x556842b519d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.479+0000 7fc913611800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556842b51fa0 con 0x556842b4b150 2024-05-08T18:31:40.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.479+0000 7fc913611800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5568429ece20 con 0x556842b4f5e0 2024-05-08T18:31:40.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.479+0000 7fc90640c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556842b4f5e0 0x556842b519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.479+0000 7fc90640c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556842b4f5e0 0x556842b519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59234/0 (socket says 172.21.15.87:59234) 2024-05-08T18:31:40.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.479+0000 7fc90640c640 1 -- 172.21.15.87:0/1706330566 learned_addr learned my addr 172.21.15.87:0/1706330566 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.479+0000 7fc90ec0d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x556842b4b150 0x556842b4b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:51582/0 (socket says 172.21.15.87:51582) 2024-05-08T18:31:40.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.479+0000 7fc90640c640 1 -- 172.21.15.87:0/1706330566 >> v1:172.21.15.53:6789/0 conn(0x556842b4b150 legacy=0x556842b4b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.479+0000 7fc90640c640 1 -- 172.21.15.87:0/1706330566 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556842b531d0 con 0x556842b4f5e0 2024-05-08T18:31:40.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.481+0000 7fc90640c640 1 --2- 172.21.15.87:0/1706330566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4f5e0 0x556842b519d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800a520 tx=0x7fc8f801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec04a016978735 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.481+0000 7fc90e40c640 1 -- 172.21.15.87:0/1706330566 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8f8057070 con 0x556842b4f5e0 2024-05-08T18:31:40.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.481+0000 7fc90e40c640 1 -- 172.21.15.87:0/1706330566 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f8052570 con 0x556842b4f5e0 2024-05-08T18:31:40.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.481+0000 7fc90e40c640 1 -- 172.21.15.87:0/1706330566 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8f804ae60 con 0x556842b4f5e0 2024-05-08T18:31:40.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.482+0000 7fc913611800 1 -- 172.21.15.87:0/1706330566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4f5e0 msgr2=0x556842b519d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.482+0000 7fc913611800 1 --2- 172.21.15.87:0/1706330566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4f5e0 0x556842b519d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800a520 tx=0x7fc8f801d010 comp rx=0 tx=0).stop 2024-05-08T18:31:40.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.482+0000 7fc913611800 1 -- 172.21.15.87:0/1706330566 shutdown_connections 2024-05-08T18:31:40.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.482+0000 7fc913611800 1 --2- 172.21.15.87:0/1706330566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4f5e0 0x556842b519d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.482+0000 7fc913611800 1 -- 172.21.15.87:0/1706330566 >> 172.21.15.87:0/1706330566 conn(0x556842b46730 msgr2=0x556842b48b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.482+0000 7fc913611800 1 -- 172.21.15.87:0/1706330566 shutdown_connections 2024-05-08T18:31:40.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.482+0000 7fc913611800 1 -- 172.21.15.87:0/1706330566 wait complete. 2024-05-08T18:31:40.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.495+0000 7fc913611800 1 Processor -- start 2024-05-08T18:31:40.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.495+0000 7fc913611800 1 -- start start 2024-05-08T18:31:40.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.495+0000 7fc913611800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4b150 0x556842abf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.495+0000 7fc913611800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556842a975c0 con 0x556842b4b150 2024-05-08T18:31:40.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.496+0000 7fc90ec0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4b150 0x556842abf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.496+0000 7fc90ec0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4b150 0x556842abf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59248/0 (socket says 172.21.15.87:59248) 2024-05-08T18:31:40.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.496+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1727492025 learned_addr learned my addr 172.21.15.87:0/1727492025 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.496+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1727492025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556842c40380 con 0x556842b4b150 2024-05-08T18:31:40.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.496+0000 7fc90ec0d640 1 --2- 172.21.15.87:0/1727492025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4b150 0x556842abf2d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc90000b230 tx=0x7fc90000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b8085aa17c724d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.496+0000 7fc7fce09640 1 -- 172.21.15.87:0/1727492025 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc90000e5c0 con 0x556842b4b150 2024-05-08T18:31:40.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.496+0000 7fc7fce09640 1 -- 172.21.15.87:0/1727492025 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc900006070 con 0x556842b4b150 2024-05-08T18:31:40.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.496+0000 7fc7fce09640 1 -- 172.21.15.87:0/1727492025 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc90000e890 con 0x556842b4b150 2024-05-08T18:31:40.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.497+0000 7fc913611800 1 -- 172.21.15.87:0/1727492025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4b150 msgr2=0x556842abf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.497+0000 7fc913611800 1 --2- 172.21.15.87:0/1727492025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4b150 0x556842abf2d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc90000b230 tx=0x7fc90000b6f0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.497+0000 7fc913611800 1 -- 172.21.15.87:0/1727492025 shutdown_connections 2024-05-08T18:31:40.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.497+0000 7fc913611800 1 --2- 172.21.15.87:0/1727492025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4b150 0x556842abf2d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.497+0000 7fc913611800 1 -- 172.21.15.87:0/1727492025 >> 172.21.15.87:0/1727492025 conn(0x556842b46730 msgr2=0x556842c37e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.497+0000 7fc913611800 1 -- 172.21.15.87:0/1727492025 shutdown_connections 2024-05-08T18:31:40.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.497+0000 7fc913611800 1 -- 172.21.15.87:0/1727492025 wait complete. 2024-05-08T18:31:40.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.497+0000 7fc913611800 1 Processor -- start 2024-05-08T18:31:40.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.497+0000 7fc913611800 1 -- start start 2024-05-08T18:31:40.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.497+0000 7fc913611800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4b150 0x556842c451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.497+0000 7fc913611800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556842b52470 con 0x556842b4b150 2024-05-08T18:31:40.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.498+0000 7fc90ec0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4b150 0x556842c451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.498+0000 7fc90ec0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4b150 0x556842c451d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59258/0 (socket says 172.21.15.87:59258) 2024-05-08T18:31:40.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.498+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1759423500 learned_addr learned my addr 172.21.15.87:0/1759423500 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.498+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1759423500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556842c45710 con 0x556842b4b150 2024-05-08T18:31:40.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.498+0000 7fc90ec0d640 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4b150 0x556842c451d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc900000fd0 tx=0x7fc900000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.498+0000 7fc7fb606640 1 -- 172.21.15.87:0/1759423500 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc90000f8d0 con 0x556842b4b150 2024-05-08T18:31:40.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.498+0000 7fc7fb606640 1 -- 172.21.15.87:0/1759423500 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc90000fa90 con 0x556842b4b150 2024-05-08T18:31:40.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.498+0000 7fc7fb606640 1 -- 172.21.15.87:0/1759423500 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc90000fdb0 con 0x556842b4b150 2024-05-08T18:31:40.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.498+0000 7fc913611800 1 -- 172.21.15.87:0/1759423500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556842c459a0 con 0x556842b4b150 2024-05-08T18:31:40.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.498+0000 7fc913611800 1 -- 172.21.15.87:0/1759423500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556842c48650 con 0x556842b4b150 2024-05-08T18:31:40.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.499+0000 7fc7fb606640 1 -- 172.21.15.87:0/1759423500 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc900017070 con 0x556842b4b150 2024-05-08T18:31:40.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.499+0000 7fc7fb606640 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc7f403bba0 0x7fc7f403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.499+0000 7fc7fb606640 1 -- 172.21.15.87:0/1759423500 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc900015020 con 0x556842b4b150 2024-05-08T18:31:40.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.500+0000 7fc90640c640 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc7f403bba0 0x7fc7f403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.500+0000 7fc913611800 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556842b4f5e0 0x556842c4c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.500+0000 7fc913611800 1 -- 172.21.15.87:0/1759423500 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842c4c990 con 0x556842b4f5e0 2024-05-08T18:31:40.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.500+0000 7fc90f40e640 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556842b4f5e0 0x556842c4c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.500+0000 7fc90640c640 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc7f403bba0 0x7fc7f403e060 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8054000 tx=0x7fc8f804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.500+0000 7fc90f40e640 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556842b4f5e0 0x556842c4c410 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.500+0000 7fc90f40e640 1 -- 172.21.15.87:0/1759423500 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc90800a4a0 con 0x556842b4f5e0 2024-05-08T18:31:40.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.500+0000 7fc913611800 1 -- 172.21.15.87:0/1759423500 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842c499e0 con 0x556842b4f5e0 2024-05-08T18:31:40.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.501+0000 7fc90f40e640 1 -- 172.21.15.87:0/1759423500 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc90800a4a0 con 0x556842b4f5e0 2024-05-08T18:31:40.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.501+0000 7fc913611800 1 -- 172.21.15.87:0/1759423500 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842c4e7b0 con 0x556842b4f5e0 2024-05-08T18:31:40.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.501+0000 7fc90f40e640 1 -- 172.21.15.87:0/1759423500 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc90800a4a0 con 0x556842b4f5e0 2024-05-08T18:31:40.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.501+0000 7fc913611800 1 -- 172.21.15.87:0/1759423500 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842c4d9e0 con 0x556842b4f5e0 2024-05-08T18:31:40.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.501+0000 7fc90f40e640 1 -- 172.21.15.87:0/1759423500 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc90800a4a0 con 0x556842b4f5e0 2024-05-08T18:31:40.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.501+0000 7fc913611800 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556842c4fb60 0x556842c51f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.501+0000 7fc913611800 1 -- 172.21.15.87:0/1759423500 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842c52490 con 0x556842c4fb60 2024-05-08T18:31:40.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.501+0000 7fc90ec0d640 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556842c4fb60 0x556842c51f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.502+0000 7fc90ec0d640 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556842c4fb60 0x556842c51f50 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.502+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1759423500 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc90002e070 con 0x556842c4fb60 2024-05-08T18:31:40.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.502+0000 7fc913611800 1 Processor -- start 2024-05-08T18:31:40.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.502+0000 7fc913611800 1 -- start start 2024-05-08T18:31:40.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.502+0000 7fc913611800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c606d0 0x556842c60af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.502+0000 7fc913611800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556842a3dfc0 con 0x556842c606d0 2024-05-08T18:31:40.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.503+0000 7fc90f40e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c606d0 0x556842c60af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.503+0000 7fc90f40e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c606d0 0x556842c60af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59270/0 (socket says 172.21.15.87:59270) 2024-05-08T18:31:40.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.503+0000 7fc90f40e640 1 -- 172.21.15.87:0/2707833460 learned_addr learned my addr 172.21.15.87:0/2707833460 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.503+0000 7fc90f40e640 1 -- 172.21.15.87:0/2707833460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556842c61030 con 0x556842c606d0 2024-05-08T18:31:40.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.503+0000 7fc90f40e640 1 --2- 172.21.15.87:0/2707833460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c606d0 0x556842c60af0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x556842c465d0 tx=0x7fc9080178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.503+0000 7fc7f8e01640 1 -- 172.21.15.87:0/2707833460 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc908013440 con 0x556842c606d0 2024-05-08T18:31:40.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.503+0000 7fc7f8e01640 1 -- 172.21.15.87:0/2707833460 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9080135e0 con 0x556842c606d0 2024-05-08T18:31:40.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.503+0000 7fc913611800 1 -- 172.21.15.87:0/2707833460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556842c61aa0 con 0x556842c606d0 2024-05-08T18:31:40.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.504+0000 7fc7f8e01640 1 -- 172.21.15.87:0/2707833460 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9080138c0 con 0x556842c606d0 2024-05-08T18:31:40.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.504+0000 7fc913611800 1 -- 172.21.15.87:0/2707833460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556842c61fa0 con 0x556842c606d0 2024-05-08T18:31:40.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.504+0000 7fc7f8e01640 1 -- 172.21.15.87:0/2707833460 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc908011040 con 0x556842c606d0 2024-05-08T18:31:40.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.504+0000 7fc7f8e01640 1 --2- 172.21.15.87:0/2707833460 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc7e803bba0 0x7fc7e803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.505+0000 7fc7f8e01640 1 -- 172.21.15.87:0/2707833460 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc90801d070 con 0x556842c606d0 2024-05-08T18:31:40.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.505+0000 7fc90ec0d640 1 --2- 172.21.15.87:0/2707833460 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc7e803bba0 0x7fc7e803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.505+0000 7fc913611800 1 Processor -- start 2024-05-08T18:31:40.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.505+0000 7fc913611800 1 -- start start 2024-05-08T18:31:40.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.505+0000 7fc90ec0d640 1 --2- 172.21.15.87:0/2707833460 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc7e803bba0 0x7fc7e803e060 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc90001dfd0 tx=0x7fc900051740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.505+0000 7fc913611800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c6d9b0 0x556842c6ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.505+0000 7fc913611800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556842c406d0 con 0x556842c6d9b0 2024-05-08T18:31:40.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.505+0000 7fc90f40e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c6d9b0 0x556842c6ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.505+0000 7fc90f40e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c6d9b0 0x556842c6ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59284/0 (socket says 172.21.15.87:59284) 2024-05-08T18:31:40.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.505+0000 7fc90f40e640 1 -- 172.21.15.87:0/3612353285 learned_addr learned my addr 172.21.15.87:0/3612353285 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.505+0000 7fc90f40e640 1 -- 172.21.15.87:0/3612353285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556842c6e3a0 con 0x556842c6d9b0 2024-05-08T18:31:40.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.506+0000 7fc90f40e640 1 --2- 172.21.15.87:0/3612353285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c6d9b0 0x556842c6ddd0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc908052990 tx=0x7fc908029430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672059d85d553276 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.506+0000 7fc7f27fc640 1 -- 172.21.15.87:0/3612353285 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9080540d0 con 0x556842c6d9b0 2024-05-08T18:31:40.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.506+0000 7fc7f27fc640 1 -- 172.21.15.87:0/3612353285 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc908054270 con 0x556842c6d9b0 2024-05-08T18:31:40.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.506+0000 7fc7f27fc640 1 -- 172.21.15.87:0/3612353285 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc908001660 con 0x556842c6d9b0 2024-05-08T18:31:40.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.506+0000 7fc913611800 1 -- 172.21.15.87:0/3612353285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c6d9b0 msgr2=0x556842c6ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.506+0000 7fc913611800 1 --2- 172.21.15.87:0/3612353285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c6d9b0 0x556842c6ddd0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc908052990 tx=0x7fc908029430 comp rx=0 tx=0).stop 2024-05-08T18:31:40.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.506+0000 7fc913611800 1 -- 172.21.15.87:0/3612353285 shutdown_connections 2024-05-08T18:31:40.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.506+0000 7fc913611800 1 --2- 172.21.15.87:0/3612353285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c6d9b0 0x556842c6ddd0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.506+0000 7fc913611800 1 -- 172.21.15.87:0/3612353285 >> 172.21.15.87:0/3612353285 conn(0x556842c69d10 msgr2=0x556842c67d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.506+0000 7fc913611800 1 -- 172.21.15.87:0/3612353285 shutdown_connections 2024-05-08T18:31:40.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.506+0000 7fc913611800 1 -- 172.21.15.87:0/3612353285 wait complete. 2024-05-08T18:31:40.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.506+0000 7fc913611800 1 Processor -- start 2024-05-08T18:31:40.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.507+0000 7fc913611800 1 -- start start 2024-05-08T18:31:40.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.507+0000 7fc913611800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c6d9b0 0x556842c3dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.507+0000 7fc913611800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556842c6eb10 con 0x556842c6d9b0 2024-05-08T18:31:40.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.507+0000 7fc90f40e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c6d9b0 0x556842c3dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.507+0000 7fc90f40e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c6d9b0 0x556842c3dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59294/0 (socket says 172.21.15.87:59294) 2024-05-08T18:31:40.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.507+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 learned_addr learned my addr 172.21.15.87:0/1514032961 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.507+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556842c3c3a0 con 0x556842c6d9b0 2024-05-08T18:31:40.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.507+0000 7fc90f40e640 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c6d9b0 0x556842c3dcb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc908001f40 tx=0x7fc9080528f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.507+0000 7fc7f0ff9640 1 -- 172.21.15.87:0/1514032961 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc908030020 con 0x556842c6d9b0 2024-05-08T18:31:40.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.507+0000 7fc7f0ff9640 1 -- 172.21.15.87:0/1514032961 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc908015ad0 con 0x556842c6d9b0 2024-05-08T18:31:40.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.507+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556842c3c630 con 0x556842c6d9b0 2024-05-08T18:31:40.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.507+0000 7fc7f0ff9640 1 -- 172.21.15.87:0/1514032961 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9080540d0 con 0x556842c6d9b0 2024-05-08T18:31:40.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.507+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556842c3cad0 con 0x556842c6d9b0 2024-05-08T18:31:40.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.508+0000 7fc7f0ff9640 1 -- 172.21.15.87:0/1514032961 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc908033020 con 0x556842c6d9b0 2024-05-08T18:31:40.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.508+0000 7fc7f0ff9640 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc7d803bb50 0x7fc7d803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.508+0000 7fc7f0ff9640 1 -- 172.21.15.87:0/1514032961 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc90800e040 con 0x556842c6d9b0 2024-05-08T18:31:40.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.508+0000 7fc90ec0d640 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc7d803bb50 0x7fc7d803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.509+0000 7fc90ec0d640 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc7d803bb50 0x7fc7d803e010 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc900050590 tx=0x7fc900051f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.509+0000 7fc913611800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.509+0000 7fc913611800 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556842c82cf0 0x556842c851b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.509+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842c85900 con 0x556842c82cf0 2024-05-08T18:31:40.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.509+0000 7fc90640c640 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556842c82cf0 0x556842c851b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.509+0000 7fc90640c640 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556842c82cf0 0x556842c851b0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc913611800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc913611800 20 realm 2024-05-08T18:31:40.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc913611800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842c85cd0 con 0x556842c82cf0 2024-05-08T18:31:40.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc913611800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc913611800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:40.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc913611800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842c865a0 con 0x556842c82cf0 2024-05-08T18:31:40.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc913611800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc913611800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842c86940 con 0x556842c82cf0 2024-05-08T18:31:40.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc913611800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:40.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc913611800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.510+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842c87190 con 0x556842c82cf0 2024-05-08T18:31:40.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.511+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.511+0000 7fc913611800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:40.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.511+0000 7fc913611800 20 searching for the correct realm 2024-05-08T18:31:40.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.511+0000 7fc913611800 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556842c88f00 0x556842c8b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.511+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x556842c88f00 2024-05-08T18:31:40.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.511+0000 7fc90f40e640 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556842c88f00 0x556842c8b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.511+0000 7fc90f40e640 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556842c88f00 0x556842c8b2f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.512+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc908029070 con 0x556842c88f00 2024-05-08T18:31:40.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.512+0000 7fc90f40e640 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc908035020 0x7fc90802c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.512+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x7fc908035020 2024-05-08T18:31:40.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.512+0000 7fc90ec0d640 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc908035020 0x7fc90802c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.512+0000 7fc90ec0d640 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc908035020 0x7fc90802c480 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.512+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1514032961 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc90003a070 con 0x7fc908035020 2024-05-08T18:31:40.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.512+0000 7fc90ec0d640 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc90000f070 0x7fc90001c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.512+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x7fc90000f070 2024-05-08T18:31:40.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.512+0000 7fc90640c640 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc90000f070 0x7fc90001c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.513+0000 7fc90640c640 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc90000f070 0x7fc90001c7c0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.513+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.513+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x556842c82cf0 2024-05-08T18:31:40.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.513+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.513+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x556842c82cf0 2024-05-08T18:31:40.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.513+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.514+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x7fc90000f070 2024-05-08T18:31:40.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.514+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.514+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x7fc90000f070 2024-05-08T18:31:40.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.514+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.514+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x7fc908035020 2024-05-08T18:31:40.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.514+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1514032961 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc90003a070 con 0x7fc908035020 2024-05-08T18:31:40.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.514+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x556842c88f00 2024-05-08T18:31:40.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.514+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc908029070 con 0x556842c88f00 2024-05-08T18:31:40.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.515+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x556842c82cf0 2024-05-08T18:31:40.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.515+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.515+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x7fc90000f070 2024-05-08T18:31:40.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.515+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.515+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x556842c82cf0 2024-05-08T18:31:40.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.515+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.515+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x7fc908035020 2024-05-08T18:31:40.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.515+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1514032961 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc90003a070 con 0x7fc908035020 2024-05-08T18:31:40.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.515+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x556842c88f00 2024-05-08T18:31:40.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.516+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc908029070 con 0x556842c88f00 2024-05-08T18:31:40.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.516+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x556842c88f00 2024-05-08T18:31:40.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.516+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc908029070 con 0x556842c88f00 2024-05-08T18:31:40.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.516+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x7fc90000f070 2024-05-08T18:31:40.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.516+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.516+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x556842c88f00 2024-05-08T18:31:40.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.516+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc908029070 con 0x556842c88f00 2024-05-08T18:31:40.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.516+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x556842c88f00 2024-05-08T18:31:40.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.517+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc908029070 con 0x556842c88f00 2024-05-08T18:31:40.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.517+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x556842c82cf0 2024-05-08T18:31:40.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.517+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.517+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x556842c82cf0 2024-05-08T18:31:40.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.517+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.517+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x7fc90000f070 2024-05-08T18:31:40.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.518+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.518+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x556842c88f00 2024-05-08T18:31:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.518+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc908029070 con 0x556842c88f00 2024-05-08T18:31:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.518+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x7fc908035020 2024-05-08T18:31:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.518+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1514032961 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc90003a070 con 0x7fc908035020 2024-05-08T18:31:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.518+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x556842c82cf0 2024-05-08T18:31:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.518+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.518+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x7fc90000f070 2024-05-08T18:31:40.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.519+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.519+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x556842c88f00 2024-05-08T18:31:40.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.519+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc908029070 con 0x556842c88f00 2024-05-08T18:31:40.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.519+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x7fc90000f070 2024-05-08T18:31:40.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.519+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.519+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x7fc908035020 2024-05-08T18:31:40.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.519+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1514032961 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc90003a070 con 0x7fc908035020 2024-05-08T18:31:40.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.519+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x556842c88f00 2024-05-08T18:31:40.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.519+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc908029070 con 0x556842c88f00 2024-05-08T18:31:40.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.520+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x7fc90000f070 2024-05-08T18:31:40.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.520+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.520+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x556842c82cf0 2024-05-08T18:31:40.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.520+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.520+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556842c8b8d0 con 0x7fc908035020 2024-05-08T18:31:40.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.520+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1514032961 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc90003a070 con 0x7fc908035020 2024-05-08T18:31:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.520+0000 7fc913611800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.520+0000 7fc913611800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.520+0000 7fc913611800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.520+0000 7fc913611800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.520+0000 7fc913611800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.520+0000 7fc913611800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.520+0000 7fc913611800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.520+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842c87b40 con 0x556842c82cf0 2024-05-08T18:31:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842c883e0 con 0x556842c82cf0 2024-05-08T18:31:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842c8bd50 con 0x7fc90000f070 2024-05-08T18:31:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 20 zone default found 2024-05-08T18:31:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 4 Realm: () 2024-05-08T18:31:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 20 zonegroup default 2024-05-08T18:31:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842c88040 con 0x7fc90000f070 2024-05-08T18:31:40.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.521+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842c8dc80 con 0x556842c88f00 2024-05-08T18:31:40.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.522+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc908029070 con 0x556842c88f00 2024-05-08T18:31:40.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.522+0000 7fc913611800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.522+0000 7fc913611800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.522+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842c8e050 con 0x556842c88f00 2024-05-08T18:31:40.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.522+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc908029070 con 0x556842c88f00 2024-05-08T18:31:40.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.522+0000 7fc913611800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.522+0000 7fc913611800 20 started sync module instance, tier type = 2024-05-08T18:31:40.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.522+0000 7fc913611800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:40.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.522+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c8d120 con 0x7fc908035020 2024-05-08T18:31:40.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.523+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1514032961 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc90003a070 con 0x7fc908035020 2024-05-08T18:31:40.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.523+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93906285417744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c8e960 con 0x7fc908035020 2024-05-08T18:31:40.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.523+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c8f1b0 con 0x556842c82cf0 2024-05-08T18:31:40.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.524+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1514032961 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93906285417744] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc90003a070 con 0x7fc908035020 2024-05-08T18:31:40.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.524+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.524+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93906285421744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c8f250 con 0x556842c82cf0 2024-05-08T18:31:40.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.525+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c8fd70 con 0x556842c88f00 2024-05-08T18:31:40.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.526+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93906285421744] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.526+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc908029070 con 0x556842c88f00 2024-05-08T18:31:40.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.526+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93906285426752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c90110 con 0x556842c88f00 2024-05-08T18:31:40.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.526+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c90b40 con 0x7fc908035020 2024-05-08T18:31:40.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.527+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93906285426752] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc908029070 con 0x556842c88f00 2024-05-08T18:31:40.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.527+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1514032961 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc90003a070 con 0x7fc908035020 2024-05-08T18:31:40.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.527+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93906285423872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c90f60 con 0x7fc908035020 2024-05-08T18:31:40.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.527+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c919a0 con 0x556842c82cf0 2024-05-08T18:31:40.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.528+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1514032961 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93906285423872] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc90003a070 con 0x7fc908035020 2024-05-08T18:31:40.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.528+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.528+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93906285433968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c91d90 con 0x556842c82cf0 2024-05-08T18:31:40.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.528+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c92790 con 0x7fc90000f070 2024-05-08T18:31:40.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.529+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.529+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93906285437600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c926c0 con 0x7fc90000f070 2024-05-08T18:31:40.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.529+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c936e0 con 0x7fc90000f070 2024-05-08T18:31:40.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.529+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93906285433968] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.530+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93906285437600] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.530+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.530+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93906285441488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c936a0 con 0x7fc90000f070 2024-05-08T18:31:40.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.530+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c93f80 con 0x7fc90000f070 2024-05-08T18:31:40.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.531+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93906285441488] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.531+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.531+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93906285430352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c936a0 con 0x7fc90000f070 2024-05-08T18:31:40.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.531+0000 7fc913611800 20 add_watcher() i=0 2024-05-08T18:31:40.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.531+0000 7fc913611800 20 add_watcher() i=1 2024-05-08T18:31:40.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.531+0000 7fc913611800 20 add_watcher() i=2 2024-05-08T18:31:40.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.531+0000 7fc913611800 20 add_watcher() i=3 2024-05-08T18:31:40.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.531+0000 7fc913611800 20 add_watcher() i=4 2024-05-08T18:31:40.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.531+0000 7fc913611800 20 add_watcher() i=5 2024-05-08T18:31:40.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.531+0000 7fc913611800 20 add_watcher() i=6 2024-05-08T18:31:40.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.532+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93906285430352] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.532+0000 7fc913611800 20 add_watcher() i=7 2024-05-08T18:31:40.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.532+0000 7fc913611800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:40.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.532+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842c96f60 con 0x556842c82cf0 2024-05-08T18:31:40.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.532+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.532+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93906285443680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c94440 con 0x556842c82cf0 2024-05-08T18:31:40.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.533+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93906285443680] v27'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.533+0000 7fc7c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:40.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.534+0000 7fc913611800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:40.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.534+0000 7fc913611800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:40.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.534+0000 7fc913611800 5 note: GC not initialized 2024-05-08T18:31:40.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.534+0000 7fc73ffff640 20 reqs_thread_entry: start 2024-05-08T18:31:40.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.534+0000 7fc913611800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:40.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.534+0000 7fc913611800 20 Filter name: none 2024-05-08T18:31:40.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.534+0000 7fc73dffb640 20 reqs_thread_entry: start 2024-05-08T18:31:40.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.534+0000 7fc913611800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:40.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.534+0000 7fc913611800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.534+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842cca390 con 0x556842c82cf0 2024-05-08T18:31:40.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.534+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.534+0000 7fc913611800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:40.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.534+0000 7fc913611800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:40.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.534+0000 7fc913611800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:40.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.534+0000 7fc913611800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:40.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.534+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842cd04a0 con 0x556842c82cf0 2024-05-08T18:31:40.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.535+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v27'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.535+0000 7fc913611800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:40.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.535+0000 7fc913611800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:40.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.535+0000 7fc913611800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:31:40.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.536+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93906285690464 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556842ccbcb0 con 0x556842c82cf0 2024-05-08T18:31:40.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.536+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== watch-notify(notify (1) cookie 93906285433968 notify 115964117008 ret 0) ==== 621+0+0 (crc 0 0 0) 0x556842b531d0 con 0x556842c82cf0 2024-05-08T18:31:40.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.536+0000 7fc7f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117008 cookie 93906285433968 notifier 4648 bl.length()=579 2024-05-08T18:31:40.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.536+0000 7fc7f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:40.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.536+0000 7fc7f27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:40.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.536+0000 7fc7f27fc640 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fc7d4003ea0 con 0x556842c82cf0 2024-05-08T18:31:40.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.536+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(64 notify.4 [notify cookie 93906285690464 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.536+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.536+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== watch-notify(notify_complete (2) cookie 93906285690464 notify 115964117008 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc8f805db40 con 0x556842c82cf0 2024-05-08T18:31:40.548 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:40.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.537+0000 7fc7c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:40.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.537+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93906285443680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c96a60 con 0x556842c82cf0 2024-05-08T18:31:40.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.538+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93906285443680] v27'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.538+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93906285417744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c93a60 con 0x7fc908035020 2024-05-08T18:31:40.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.539+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1514032961 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93906285417744] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc90003a070 con 0x7fc908035020 2024-05-08T18:31:40.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.539+0000 7fc913611800 20 remove_watcher() i=0 2024-05-08T18:31:40.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.539+0000 7fc913611800 2 removed watcher, disabling cache 2024-05-08T18:31:40.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.539+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93906285421744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c8d510 con 0x556842c82cf0 2024-05-08T18:31:40.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.540+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93906285421744] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.540+0000 7fc913611800 20 remove_watcher() i=1 2024-05-08T18:31:40.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.540+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93906285426752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c8d510 con 0x556842c88f00 2024-05-08T18:31:40.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.541+0000 7fc90f40e640 1 -- 172.21.15.87:0/1514032961 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93906285426752] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc908029070 con 0x556842c88f00 2024-05-08T18:31:40.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.541+0000 7fc913611800 20 remove_watcher() i=2 2024-05-08T18:31:40.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.541+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93906285423872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c8d510 con 0x7fc908035020 2024-05-08T18:31:40.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.542+0000 7fc90ec0d640 1 -- 172.21.15.87:0/1514032961 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93906285423872] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc90003a070 con 0x7fc908035020 2024-05-08T18:31:40.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.542+0000 7fc913611800 20 remove_watcher() i=3 2024-05-08T18:31:40.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.542+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93906285433968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c8d510 con 0x556842c82cf0 2024-05-08T18:31:40.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.543+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93906285433968] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x556842c82cf0 2024-05-08T18:31:40.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.543+0000 7fc913611800 20 remove_watcher() i=4 2024-05-08T18:31:40.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.543+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93906285437600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c91470 con 0x7fc90000f070 2024-05-08T18:31:40.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.544+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93906285437600] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.544+0000 7fc913611800 20 remove_watcher() i=5 2024-05-08T18:31:40.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.544+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93906285441488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c8d510 con 0x7fc90000f070 2024-05-08T18:31:40.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.545+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93906285441488] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.545+0000 7fc913611800 20 remove_watcher() i=6 2024-05-08T18:31:40.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.545+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93906285430352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556842c922a0 con 0x7fc90000f070 2024-05-08T18:31:40.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93906285430352] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f805a040 con 0x7fc90000f070 2024-05-08T18:31:40.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 20 remove_watcher() i=7 2024-05-08T18:31:40.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc90000f070 msgr2=0x7fc90001c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc90000f070 0x7fc90001c7c0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556842c82cf0 msgr2=0x556842c851b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556842c82cf0 0x556842c851b0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc908035020 msgr2=0x7fc90802c480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc908035020 0x7fc90802c480 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556842c88f00 msgr2=0x556842c8b2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x556842c88f00 0x556842c8b2f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc7d803bb50 msgr2=0x7fc7d803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc7d803bb50 0x7fc7d803e010 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc900050590 tx=0x7fc900051f90 comp rx=0 tx=0).stop 2024-05-08T18:31:40.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c6d9b0 msgr2=0x556842c3dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c6d9b0 0x556842c3dcb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc908001f40 tx=0x7fc9080528f0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc90640c640 1 -- 172.21.15.87:0/1514032961 reap_dead start 2024-05-08T18:31:40.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 shutdown_connections 2024-05-08T18:31:40.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 --2- 172.21.15.87:0/1514032961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c6d9b0 0x556842c3dcb0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 >> 172.21.15.87:0/1514032961 conn(0x556842c69d10 msgr2=0x556842c67370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 shutdown_connections 2024-05-08T18:31:40.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 -- 172.21.15.87:0/1514032961 wait complete. 2024-05-08T18:31:40.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 -- 172.21.15.87:0/2707833460 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc7e803bba0 msgr2=0x7fc7e803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 --2- 172.21.15.87:0/2707833460 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc7e803bba0 0x7fc7e803e060 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc90001dfd0 tx=0x7fc900051740 comp rx=0 tx=0).stop 2024-05-08T18:31:40.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.546+0000 7fc913611800 1 -- 172.21.15.87:0/2707833460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c606d0 msgr2=0x556842c60af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 --2- 172.21.15.87:0/2707833460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c606d0 0x556842c60af0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x556842c465d0 tx=0x7fc9080178e0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 -- 172.21.15.87:0/2707833460 shutdown_connections 2024-05-08T18:31:40.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 --2- 172.21.15.87:0/2707833460 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc7e803bba0 0x7fc7e803e060 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 --2- 172.21.15.87:0/2707833460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842c606d0 0x556842c60af0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 -- 172.21.15.87:0/2707833460 >> 172.21.15.87:0/2707833460 conn(0x556842c54770 msgr2=0x556842c54b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 -- 172.21.15.87:0/2707833460 shutdown_connections 2024-05-08T18:31:40.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 -- 172.21.15.87:0/2707833460 wait complete. 2024-05-08T18:31:40.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 -- 172.21.15.87:0/1759423500 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556842c4fb60 msgr2=0x556842c51f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556842c4fb60 0x556842c51f50 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 -- 172.21.15.87:0/1759423500 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556842b4f5e0 msgr2=0x556842c4c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556842b4f5e0 0x556842c4c410 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 -- 172.21.15.87:0/1759423500 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc7f403bba0 msgr2=0x7fc7f403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc7f403bba0 0x7fc7f403e060 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8054000 tx=0x7fc8f804e000 comp rx=0 tx=0).stop 2024-05-08T18:31:40.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 -- 172.21.15.87:0/1759423500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4b150 msgr2=0x556842c451d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4b150 0x556842c451d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc900000fd0 tx=0x7fc900000ed0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 -- 172.21.15.87:0/1759423500 shutdown_connections 2024-05-08T18:31:40.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556842b4f5e0 0x556842c4c410 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x556842c4fb60 0x556842c51f50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc7f403bba0 0x7fc7f403e060 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 --2- 172.21.15.87:0/1759423500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556842b4b150 0x556842c451d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 -- 172.21.15.87:0/1759423500 >> 172.21.15.87:0/1759423500 conn(0x556842b46730 msgr2=0x556842c36670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 -- 172.21.15.87:0/1759423500 shutdown_connections 2024-05-08T18:31:40.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.547+0000 7fc913611800 1 -- 172.21.15.87:0/1759423500 wait complete. 2024-05-08T18:31:40.561 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:40.561 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-05-08T18:31:40.561 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-05-08T18:31:40.562 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-05-08T18:31:40.608 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:40.608 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:40.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.610+0000 7f557352d800 1 Processor -- start 2024-05-08T18:31:40.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.610+0000 7f557352d800 1 -- start start 2024-05-08T18:31:40.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.610+0000 7f557352d800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555e3b1c0b70 0x555e3b1c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.610+0000 7f557352d800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555e3b135ef0 con 0x555e3b1c14d0 2024-05-08T18:31:40.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.610+0000 7f557352d800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x555e3b062e20 con 0x555e3b1c0b70 2024-05-08T18:31:40.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.611+0000 7f556f1ca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555e3b1c0b70 0x555e3b1c0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.611+0000 7f556e9c9640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x555e3b1c14d0 0x555e3b1c1980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:51596/0 (socket says 172.21.15.87:51596) 2024-05-08T18:31:40.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.611+0000 7f556e9c9640 1 -- 172.21.15.87:0/1153647004 learned_addr learned my addr 172.21.15.87:0/1153647004 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:40.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.611+0000 7f556f1ca640 1 -- 172.21.15.87:0/1153647004 >> v1:172.21.15.53:6789/0 conn(0x555e3b1c14d0 legacy=0x555e3b1c1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.611+0000 7f556f1ca640 1 -- 172.21.15.87:0/1153647004 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e3b1c2090 con 0x555e3b1c0b70 2024-05-08T18:31:40.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.613+0000 7f556f1ca640 1 --2- 172.21.15.87:0/1153647004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 0x555e3b1c0f90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5560005fd0 tx=0x7f556001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ad1733d6ebbcb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.613+0000 7f556e1c8640 1 -- 172.21.15.87:0/1153647004 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5560052560 con 0x555e3b1c0b70 2024-05-08T18:31:40.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.613+0000 7f556e1c8640 1 -- 172.21.15.87:0/1153647004 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5560052700 con 0x555e3b1c0b70 2024-05-08T18:31:40.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.613+0000 7f556e1c8640 1 -- 172.21.15.87:0/1153647004 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5560052a60 con 0x555e3b1c0b70 2024-05-08T18:31:40.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.614+0000 7f557352d800 1 -- 172.21.15.87:0/1153647004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 msgr2=0x555e3b1c0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.614+0000 7f557352d800 1 --2- 172.21.15.87:0/1153647004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 0x555e3b1c0f90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5560005fd0 tx=0x7f556001ccc0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.614+0000 7f557352d800 1 -- 172.21.15.87:0/1153647004 shutdown_connections 2024-05-08T18:31:40.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.614+0000 7f557352d800 1 --2- 172.21.15.87:0/1153647004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 0x555e3b1c0f90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.614+0000 7f557352d800 1 -- 172.21.15.87:0/1153647004 >> 172.21.15.87:0/1153647004 conn(0x555e3b1bc6b0 msgr2=0x555e3b1beb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.614+0000 7f557352d800 1 -- 172.21.15.87:0/1153647004 shutdown_connections 2024-05-08T18:31:40.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.614+0000 7f557352d800 1 -- 172.21.15.87:0/1153647004 wait complete. 2024-05-08T18:31:40.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.627+0000 7f557352d800 1 Processor -- start 2024-05-08T18:31:40.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.627+0000 7f557352d800 1 -- start start 2024-05-08T18:31:40.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.628+0000 7f557352d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 0x555e3b2b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.628+0000 7f557352d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555e3b10d5c0 con 0x555e3b1c0b70 2024-05-08T18:31:40.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.628+0000 7f556f1ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 0x555e3b2b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.628+0000 7f556f1ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 0x555e3b2b5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59314/0 (socket says 172.21.15.87:59314) 2024-05-08T18:31:40.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.628+0000 7f556f1ca640 1 -- 172.21.15.87:0/3889445969 learned_addr learned my addr 172.21.15.87:0/3889445969 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.628+0000 7f556f1ca640 1 -- 172.21.15.87:0/3889445969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e3b2b5fe0 con 0x555e3b1c0b70 2024-05-08T18:31:40.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.628+0000 7f556f1ca640 1 --2- 172.21.15.87:0/3889445969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 0x555e3b2b5a10 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5560007000 tx=0x7f556004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9499af7e993cda09 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.629+0000 7f545d60a640 1 -- 172.21.15.87:0/3889445969 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55600529e0 con 0x555e3b1c0b70 2024-05-08T18:31:40.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.629+0000 7f545d60a640 1 -- 172.21.15.87:0/3889445969 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5560052b80 con 0x555e3b1c0b70 2024-05-08T18:31:40.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.629+0000 7f545d60a640 1 -- 172.21.15.87:0/3889445969 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f556005c430 con 0x555e3b1c0b70 2024-05-08T18:31:40.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.629+0000 7f557352d800 1 -- 172.21.15.87:0/3889445969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 msgr2=0x555e3b2b5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.629+0000 7f557352d800 1 --2- 172.21.15.87:0/3889445969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 0x555e3b2b5a10 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5560007000 tx=0x7f556004c000 comp rx=0 tx=0).stop 2024-05-08T18:31:40.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.629+0000 7f557352d800 1 -- 172.21.15.87:0/3889445969 shutdown_connections 2024-05-08T18:31:40.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.629+0000 7f557352d800 1 --2- 172.21.15.87:0/3889445969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 0x555e3b2b5a10 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.629+0000 7f557352d800 1 -- 172.21.15.87:0/3889445969 >> 172.21.15.87:0/3889445969 conn(0x555e3b1bc6b0 msgr2=0x555e3b2b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.629+0000 7f557352d800 1 -- 172.21.15.87:0/3889445969 shutdown_connections 2024-05-08T18:31:40.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.629+0000 7f557352d800 1 -- 172.21.15.87:0/3889445969 wait complete. 2024-05-08T18:31:40.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.630+0000 7f557352d800 1 Processor -- start 2024-05-08T18:31:40.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.630+0000 7f557352d800 1 -- start start 2024-05-08T18:31:40.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.630+0000 7f557352d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 0x555e3b2bd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.630+0000 7f557352d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555e3b1c25c0 con 0x555e3b1c0b70 2024-05-08T18:31:40.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.630+0000 7f556f1ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 0x555e3b2bd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.630+0000 7f556f1ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 0x555e3b2bd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59330/0 (socket says 172.21.15.87:59330) 2024-05-08T18:31:40.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.630+0000 7f556f1ca640 1 -- 172.21.15.87:0/4244542257 learned_addr learned my addr 172.21.15.87:0/4244542257 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.630+0000 7f556f1ca640 1 -- 172.21.15.87:0/4244542257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e3b2bda80 con 0x555e3b1c0b70 2024-05-08T18:31:40.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.631+0000 7f556f1ca640 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 0x555e3b2bd540 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f55600526d0 tx=0x7f5560003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.631+0000 7f545be07640 1 -- 172.21.15.87:0/4244542257 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5560075070 con 0x555e3b1c0b70 2024-05-08T18:31:40.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.631+0000 7f545be07640 1 -- 172.21.15.87:0/4244542257 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5560070410 con 0x555e3b1c0b70 2024-05-08T18:31:40.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.631+0000 7f557352d800 1 -- 172.21.15.87:0/4244542257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e3b2bdd10 con 0x555e3b1c0b70 2024-05-08T18:31:40.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.631+0000 7f545be07640 1 -- 172.21.15.87:0/4244542257 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55600529e0 con 0x555e3b1c0b70 2024-05-08T18:31:40.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.631+0000 7f557352d800 1 -- 172.21.15.87:0/4244542257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e3b2c0920 con 0x555e3b1c0b70 2024-05-08T18:31:40.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.632+0000 7f545be07640 1 -- 172.21.15.87:0/4244542257 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5560078070 con 0x555e3b1c0b70 2024-05-08T18:31:40.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.632+0000 7f545be07640 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f545403bba0 0x7f545403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.632+0000 7f545be07640 1 -- 172.21.15.87:0/4244542257 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f556006d070 con 0x555e3b1c0b70 2024-05-08T18:31:40.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.632+0000 7f556e9c9640 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f545403bba0 0x7f545403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.632+0000 7f557352d800 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555e3b1c14d0 0x555e3b2c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.632+0000 7f557352d800 1 -- 172.21.15.87:0/4244542257 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b2c4c20 con 0x555e3b1c14d0 2024-05-08T18:31:40.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.632+0000 7f556f9cb640 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555e3b1c14d0 0x555e3b2c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.632+0000 7f556e9c9640 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f545403bba0 0x7f545403e060 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5564001d90 tx=0x7f55640012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.632+0000 7f556f9cb640 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555e3b1c14d0 0x555e3b2c46e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.633+0000 7f556f9cb640 1 -- 172.21.15.87:0/4244542257 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55680083e0 con 0x555e3b1c14d0 2024-05-08T18:31:40.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.633+0000 7f557352d800 1 -- 172.21.15.87:0/4244542257 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b2c1cb0 con 0x555e3b1c14d0 2024-05-08T18:31:40.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.633+0000 7f556f9cb640 1 -- 172.21.15.87:0/4244542257 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55680083e0 con 0x555e3b1c14d0 2024-05-08T18:31:40.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.633+0000 7f557352d800 1 -- 172.21.15.87:0/4244542257 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b2c6a00 con 0x555e3b1c14d0 2024-05-08T18:31:40.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.633+0000 7f556f9cb640 1 -- 172.21.15.87:0/4244542257 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f55680083e0 con 0x555e3b1c14d0 2024-05-08T18:31:40.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.633+0000 7f557352d800 1 -- 172.21.15.87:0/4244542257 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b2c5c30 con 0x555e3b1c14d0 2024-05-08T18:31:40.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.633+0000 7f556f9cb640 1 -- 172.21.15.87:0/4244542257 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55680083e0 con 0x555e3b1c14d0 2024-05-08T18:31:40.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.634+0000 7f557352d800 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555e3b2c7db0 0x555e3b2ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.634+0000 7f557352d800 1 -- 172.21.15.87:0/4244542257 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b2ca6e0 con 0x555e3b2c7db0 2024-05-08T18:31:40.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.634+0000 7f556f1ca640 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555e3b2c7db0 0x555e3b2ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.634+0000 7f556f1ca640 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555e3b2c7db0 0x555e3b2ca1a0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.635+0000 7f556f1ca640 1 -- 172.21.15.87:0/4244542257 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5560077030 con 0x555e3b2c7db0 2024-05-08T18:31:40.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.635+0000 7f557352d800 1 Processor -- start 2024-05-08T18:31:40.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.635+0000 7f557352d800 1 -- start start 2024-05-08T18:31:40.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.635+0000 7f557352d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2d89a0 0x555e3b2d8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.635+0000 7f557352d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555e3b0b3fc0 con 0x555e3b2d89a0 2024-05-08T18:31:40.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.635+0000 7f556f9cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2d89a0 0x555e3b2d8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.635+0000 7f556f9cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2d89a0 0x555e3b2d8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59334/0 (socket says 172.21.15.87:59334) 2024-05-08T18:31:40.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.635+0000 7f556f9cb640 1 -- 172.21.15.87:0/2870839239 learned_addr learned my addr 172.21.15.87:0/2870839239 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.636+0000 7f556f9cb640 1 -- 172.21.15.87:0/2870839239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e3b2d9300 con 0x555e3b2d89a0 2024-05-08T18:31:40.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.636+0000 7f556f9cb640 1 --2- 172.21.15.87:0/2870839239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2d89a0 0x555e3b2d8dc0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x555e3b2be360 tx=0x7f556800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.636+0000 7f5459602640 1 -- 172.21.15.87:0/2870839239 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f556801c070 con 0x555e3b2d89a0 2024-05-08T18:31:40.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.636+0000 7f5459602640 1 -- 172.21.15.87:0/2870839239 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5568018410 con 0x555e3b2d89a0 2024-05-08T18:31:40.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.636+0000 7f557352d800 1 -- 172.21.15.87:0/2870839239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e3b2d9d70 con 0x555e3b2d89a0 2024-05-08T18:31:40.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.636+0000 7f5459602640 1 -- 172.21.15.87:0/2870839239 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f556800be60 con 0x555e3b2d89a0 2024-05-08T18:31:40.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.637+0000 7f557352d800 1 -- 172.21.15.87:0/2870839239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e3b2da270 con 0x555e3b2d89a0 2024-05-08T18:31:40.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.637+0000 7f5459602640 1 -- 172.21.15.87:0/2870839239 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f556801f070 con 0x555e3b2d89a0 2024-05-08T18:31:40.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.638+0000 7f5459602640 1 --2- 172.21.15.87:0/2870839239 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f544803bba0 0x7f544803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.638+0000 7f5459602640 1 -- 172.21.15.87:0/2870839239 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5568054660 con 0x555e3b2d89a0 2024-05-08T18:31:40.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.638+0000 7f556f1ca640 1 --2- 172.21.15.87:0/2870839239 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f544803bba0 0x7f544803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.638+0000 7f557352d800 1 Processor -- start 2024-05-08T18:31:40.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.638+0000 7f556f1ca640 1 --2- 172.21.15.87:0/2870839239 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f544803bba0 0x7f544803e060 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f556005cd30 tx=0x7f556005df10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.638+0000 7f557352d800 1 -- start start 2024-05-08T18:31:40.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.638+0000 7f557352d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2e5ca0 0x555e3b2e60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.638+0000 7f557352d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555e3b2b6300 con 0x555e3b2e5ca0 2024-05-08T18:31:40.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.638+0000 7f556f9cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2e5ca0 0x555e3b2e60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.638+0000 7f556f9cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2e5ca0 0x555e3b2e60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59340/0 (socket says 172.21.15.87:59340) 2024-05-08T18:31:40.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.638+0000 7f556f9cb640 1 -- 172.21.15.87:0/3529450274 learned_addr learned my addr 172.21.15.87:0/3529450274 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.639+0000 7f556f9cb640 1 -- 172.21.15.87:0/3529450274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e3b2e6690 con 0x555e3b2e5ca0 2024-05-08T18:31:40.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.639+0000 7f556f9cb640 1 --2- 172.21.15.87:0/3529450274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2e5ca0 0x555e3b2e60c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f55680529c0 tx=0x7f5568052b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868940949fbafdf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.639+0000 7f5452ffd640 1 -- 172.21.15.87:0/3529450274 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f556801fdb0 con 0x555e3b2e5ca0 2024-05-08T18:31:40.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.639+0000 7f5452ffd640 1 -- 172.21.15.87:0/3529450274 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55680512b0 con 0x555e3b2e5ca0 2024-05-08T18:31:40.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.639+0000 7f5452ffd640 1 -- 172.21.15.87:0/3529450274 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55680515d0 con 0x555e3b2e5ca0 2024-05-08T18:31:40.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.639+0000 7f557352d800 1 -- 172.21.15.87:0/3529450274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2e5ca0 msgr2=0x555e3b2e60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.639+0000 7f557352d800 1 --2- 172.21.15.87:0/3529450274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2e5ca0 0x555e3b2e60c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f55680529c0 tx=0x7f5568052b90 comp rx=0 tx=0).stop 2024-05-08T18:31:40.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.639+0000 7f557352d800 1 -- 172.21.15.87:0/3529450274 shutdown_connections 2024-05-08T18:31:40.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.639+0000 7f557352d800 1 --2- 172.21.15.87:0/3529450274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2e5ca0 0x555e3b2e60c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.639+0000 7f557352d800 1 -- 172.21.15.87:0/3529450274 >> 172.21.15.87:0/3529450274 conn(0x555e3b2e1fb0 msgr2=0x555e3b2e0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.639+0000 7f557352d800 1 -- 172.21.15.87:0/3529450274 shutdown_connections 2024-05-08T18:31:40.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.639+0000 7f557352d800 1 -- 172.21.15.87:0/3529450274 wait complete. 2024-05-08T18:31:40.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.640+0000 7f557352d800 1 Processor -- start 2024-05-08T18:31:40.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.640+0000 7f557352d800 1 -- start start 2024-05-08T18:31:40.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.640+0000 7f557352d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2e5ca0 0x555e3b2ed250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.640+0000 7f557352d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555e3b2e6e60 con 0x555e3b2e5ca0 2024-05-08T18:31:40.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.640+0000 7f556f9cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2e5ca0 0x555e3b2ed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.640+0000 7f556f9cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2e5ca0 0x555e3b2ed250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59344/0 (socket says 172.21.15.87:59344) 2024-05-08T18:31:40.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.640+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 learned_addr learned my addr 172.21.15.87:0/3032839036 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.640+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e3b2ed790 con 0x555e3b2e5ca0 2024-05-08T18:31:40.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.640+0000 7f556f9cb640 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2e5ca0 0x555e3b2ed250 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f55680076e0 tx=0x7f5568052920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.641+0000 7f54517fa640 1 -- 172.21.15.87:0/3032839036 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f556802f070 con 0x555e3b2e5ca0 2024-05-08T18:31:40.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.641+0000 7f54517fa640 1 -- 172.21.15.87:0/3032839036 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55680186f0 con 0x555e3b2e5ca0 2024-05-08T18:31:40.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.641+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e3b2eda20 con 0x555e3b2e5ca0 2024-05-08T18:31:40.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.641+0000 7f54517fa640 1 -- 172.21.15.87:0/3032839036 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55680189f0 con 0x555e3b2e5ca0 2024-05-08T18:31:40.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.641+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e3b2f06d0 con 0x555e3b2e5ca0 2024-05-08T18:31:40.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.641+0000 7f54517fa640 1 -- 172.21.15.87:0/3032839036 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5568032070 con 0x555e3b2e5ca0 2024-05-08T18:31:40.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.642+0000 7f54517fa640 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f543803bba0 0x7f543803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.642+0000 7f54517fa640 1 -- 172.21.15.87:0/3032839036 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5568049040 con 0x555e3b2e5ca0 2024-05-08T18:31:40.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.642+0000 7f556f1ca640 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f543803bba0 0x7f543803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.642+0000 7f556f1ca640 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f543803bba0 0x7f543803e060 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5560052450 tx=0x7f556008d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.642+0000 7f557352d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.642+0000 7f557352d800 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555e3b2f8cd0 0x555e3b2fb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.642+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b2fb8e0 con 0x555e3b2f8cd0 2024-05-08T18:31:40.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.642+0000 7f556e9c9640 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555e3b2f8cd0 0x555e3b2fb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.643+0000 7f556e9c9640 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555e3b2f8cd0 0x555e3b2fb190 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.643+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5564009050 con 0x555e3b2f8cd0 2024-05-08T18:31:40.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.643+0000 7f557352d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.643+0000 7f557352d800 20 realm 2024-05-08T18:31:40.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.643+0000 7f557352d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.643+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b2f8120 con 0x555e3b2f8cd0 2024-05-08T18:31:40.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.643+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5564009050 con 0x555e3b2f8cd0 2024-05-08T18:31:40.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.643+0000 7f557352d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.643+0000 7f557352d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:40.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.643+0000 7f557352d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.643+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b2fc3d0 con 0x555e3b2f8cd0 2024-05-08T18:31:40.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.643+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5564009050 con 0x555e3b2f8cd0 2024-05-08T18:31:40.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.643+0000 7f557352d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.643+0000 7f557352d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.643+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b2fcca0 con 0x555e3b2f8cd0 2024-05-08T18:31:40.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.644+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5564009050 con 0x555e3b2f8cd0 2024-05-08T18:31:40.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.644+0000 7f557352d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:40.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.644+0000 7f557352d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.644+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b2fd040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.644+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5564009050 con 0x555e3b2f8cd0 2024-05-08T18:31:40.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.644+0000 7f557352d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:40.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.644+0000 7f557352d800 20 searching for the correct realm 2024-05-08T18:31:40.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.644+0000 7f557352d800 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x555e3b2fef20 0x555e3b301370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.644+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x555e3b2fef20 2024-05-08T18:31:40.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.644+0000 7f556f9cb640 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x555e3b2fef20 0x555e3b301370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.644+0000 7f556f9cb640 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x555e3b2fef20 0x555e3b301370 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.645+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f556803b070 con 0x555e3b2fef20 2024-05-08T18:31:40.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.645+0000 7f556f9cb640 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5568034070 0x7f556802a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.645+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x7f5568034070 2024-05-08T18:31:40.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.645+0000 7f556f1ca640 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5568034070 0x7f556802a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.645+0000 7f556f1ca640 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5568034070 0x7f556802a3e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.645+0000 7f556f1ca640 1 -- 172.21.15.87:0/3032839036 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5560088040 con 0x7f5568034070 2024-05-08T18:31:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.646+0000 7f556f1ca640 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f55600a2040 0x7f556005b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.646+0000 7f556f1ca640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x7f55600a2040 2024-05-08T18:31:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.646+0000 7f556e9c9640 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f55600a2040 0x7f556005b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.646+0000 7f556e9c9640 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f55600a2040 0x7f556005b7c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.646+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5564009050 con 0x7f55600a2040 2024-05-08T18:31:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.646+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x555e3b2f8cd0 2024-05-08T18:31:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.647+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5564009050 con 0x555e3b2f8cd0 2024-05-08T18:31:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.647+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x555e3b2f8cd0 2024-05-08T18:31:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.647+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.647+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x7f55600a2040 2024-05-08T18:31:40.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.647+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.647+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x7f55600a2040 2024-05-08T18:31:40.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.647+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.647+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x7f5568034070 2024-05-08T18:31:40.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.648+0000 7f556f1ca640 1 -- 172.21.15.87:0/3032839036 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5560088040 con 0x7f5568034070 2024-05-08T18:31:40.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.648+0000 7f556f1ca640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x555e3b2fef20 2024-05-08T18:31:40.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.648+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f556803b070 con 0x555e3b2fef20 2024-05-08T18:31:40.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.648+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x555e3b2f8cd0 2024-05-08T18:31:40.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.648+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.648+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x7f55600a2040 2024-05-08T18:31:40.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.648+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.648+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x555e3b2f8cd0 2024-05-08T18:31:40.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.649+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.649+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x7f5568034070 2024-05-08T18:31:40.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.649+0000 7f556f1ca640 1 -- 172.21.15.87:0/3032839036 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5560088040 con 0x7f5568034070 2024-05-08T18:31:40.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.649+0000 7f556f1ca640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x555e3b2fef20 2024-05-08T18:31:40.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.649+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5568061040 con 0x555e3b2fef20 2024-05-08T18:31:40.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.649+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x555e3b2fef20 2024-05-08T18:31:40.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.649+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5568061040 con 0x555e3b2fef20 2024-05-08T18:31:40.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.649+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x7f55600a2040 2024-05-08T18:31:40.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.650+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.650+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x555e3b2fef20 2024-05-08T18:31:40.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.650+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5568061040 con 0x555e3b2fef20 2024-05-08T18:31:40.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.650+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x555e3b2fef20 2024-05-08T18:31:40.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.650+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5568061040 con 0x555e3b2fef20 2024-05-08T18:31:40.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.650+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x555e3b2f8cd0 2024-05-08T18:31:40.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.650+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.650+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x555e3b2f8cd0 2024-05-08T18:31:40.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.650+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.651+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x7f55600a2040 2024-05-08T18:31:40.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.651+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.651+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x555e3b2fef20 2024-05-08T18:31:40.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.651+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5568061040 con 0x555e3b2fef20 2024-05-08T18:31:40.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.651+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x7f5568034070 2024-05-08T18:31:40.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.651+0000 7f556f1ca640 1 -- 172.21.15.87:0/3032839036 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5560088040 con 0x7f5568034070 2024-05-08T18:31:40.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.651+0000 7f556f1ca640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x555e3b2f8cd0 2024-05-08T18:31:40.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.652+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.652+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x7f55600a2040 2024-05-08T18:31:40.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.652+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.652+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x555e3b2fef20 2024-05-08T18:31:40.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.652+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5568061040 con 0x555e3b2fef20 2024-05-08T18:31:40.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.652+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x7f55600a2040 2024-05-08T18:31:40.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.652+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.652+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x7f5568034070 2024-05-08T18:31:40.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.653+0000 7f556f1ca640 1 -- 172.21.15.87:0/3032839036 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5560088040 con 0x7f5568034070 2024-05-08T18:31:40.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.653+0000 7f556f1ca640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x555e3b2fef20 2024-05-08T18:31:40.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.653+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5568061040 con 0x555e3b2fef20 2024-05-08T18:31:40.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.653+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x7f55600a2040 2024-05-08T18:31:40.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.653+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.653+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x555e3b2f8cd0 2024-05-08T18:31:40.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.653+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.653+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301a40 con 0x7f5568034070 2024-05-08T18:31:40.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.654+0000 7f556f1ca640 1 -- 172.21.15.87:0/3032839036 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5560088040 con 0x7f5568034070 2024-05-08T18:31:40.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.654+0000 7f557352d800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:40.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.654+0000 7f557352d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:40.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.654+0000 7f557352d800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:40.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.654+0000 7f557352d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:40.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.654+0000 7f557352d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:40.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.654+0000 7f557352d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:40.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.654+0000 7f557352d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.654+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b2fd9f0 con 0x555e3b2f8cd0 2024-05-08T18:31:40.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.654+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.654+0000 7f557352d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.654+0000 7f557352d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.654+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b2fe290 con 0x555e3b2f8cd0 2024-05-08T18:31:40.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.654+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.654+0000 7f557352d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:40.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.654+0000 7f557352d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.654+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b301ec0 con 0x7f55600a2040 2024-05-08T18:31:40.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f557352d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:40.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f557352d800 20 zone default found 2024-05-08T18:31:40.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f557352d800 4 Realm: () 2024-05-08T18:31:40.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f557352d800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:40.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f557352d800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:40.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f557352d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:40.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f557352d800 20 zonegroup default 2024-05-08T18:31:40.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f557352d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b302370 con 0x7f55600a2040 2024-05-08T18:31:40.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f557352d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f557352d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b303d50 con 0x555e3b2fef20 2024-05-08T18:31:40.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5568061040 con 0x555e3b2fef20 2024-05-08T18:31:40.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f557352d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f557352d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b3041b0 con 0x555e3b2fef20 2024-05-08T18:31:40.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5568061040 con 0x555e3b2fef20 2024-05-08T18:31:40.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f557352d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.655+0000 7f557352d800 20 started sync module instance, tier type = 2024-05-08T18:31:40.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.656+0000 7f557352d800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:40.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.656+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b3031e0 con 0x7f5568034070 2024-05-08T18:31:40.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.657+0000 7f556f1ca640 1 -- 172.21.15.87:0/3032839036 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5560088040 con 0x7f5568034070 2024-05-08T18:31:40.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.657+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93863208302032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b304ac0 con 0x7f5568034070 2024-05-08T18:31:40.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.657+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b305310 con 0x555e3b2f8cd0 2024-05-08T18:31:40.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.658+0000 7f556f1ca640 1 -- 172.21.15.87:0/3032839036 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93863208302032] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5560088040 con 0x7f5568034070 2024-05-08T18:31:40.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.658+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.658+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93863208306192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b305350 con 0x555e3b2f8cd0 2024-05-08T18:31:40.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.658+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b305e40 con 0x555e3b2fef20 2024-05-08T18:31:40.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.659+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93863208306192] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.659+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5568061040 con 0x555e3b2fef20 2024-05-08T18:31:40.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.659+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93863208311056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b305e00 con 0x555e3b2fef20 2024-05-08T18:31:40.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.659+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b3068f0 con 0x7f5568034070 2024-05-08T18:31:40.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.660+0000 7f556f1ca640 1 -- 172.21.15.87:0/3032839036 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5560088040 con 0x7f5568034070 2024-05-08T18:31:40.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.660+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93863208311056] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5568061040 con 0x555e3b2fef20 2024-05-08T18:31:40.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.660+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93863208313856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b307190 con 0x7f5568034070 2024-05-08T18:31:40.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.660+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b304e80 con 0x555e3b2f8cd0 2024-05-08T18:31:40.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.661+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.661+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93863208318848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b308050 con 0x555e3b2f8cd0 2024-05-08T18:31:40.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.661+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b308a50 con 0x7f55600a2040 2024-05-08T18:31:40.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.661+0000 7f556f1ca640 1 -- 172.21.15.87:0/3032839036 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93863208313856] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5560088040 con 0x7f5568034070 2024-05-08T18:31:40.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.662+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93863208318848] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.662+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.662+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93863208316128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b307ba0 con 0x7f55600a2040 2024-05-08T18:31:40.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.662+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b3092f0 con 0x7f55600a2040 2024-05-08T18:31:40.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.663+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93863208316128] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.663+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.663+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93863208322400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b307ba0 con 0x7f55600a2040 2024-05-08T18:31:40.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.663+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b309880 con 0x7f55600a2040 2024-05-08T18:31:40.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.664+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93863208322400] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.664+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(58 notify.7 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.664+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93863208324528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b309880 con 0x7f55600a2040 2024-05-08T18:31:40.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.664+0000 7f557352d800 20 add_watcher() i=0 2024-05-08T18:31:40.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.664+0000 7f557352d800 20 add_watcher() i=1 2024-05-08T18:31:40.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.664+0000 7f557352d800 20 add_watcher() i=2 2024-05-08T18:31:40.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.664+0000 7f557352d800 20 add_watcher() i=3 2024-05-08T18:31:40.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.664+0000 7f557352d800 20 add_watcher() i=4 2024-05-08T18:31:40.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.664+0000 7f557352d800 20 add_watcher() i=5 2024-05-08T18:31:40.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.664+0000 7f557352d800 20 add_watcher() i=6 2024-05-08T18:31:40.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.665+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93863208324528] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.665+0000 7f557352d800 20 add_watcher() i=7 2024-05-08T18:31:40.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.665+0000 7f557352d800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:40.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.665+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b30cbe0 con 0x555e3b2f8cd0 2024-05-08T18:31:40.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.665+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.665+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93863208338912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b3099f0 con 0x555e3b2f8cd0 2024-05-08T18:31:40.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.666+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93863208338912] v27'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.667+0000 7f5425fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:40.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.667+0000 7f557352d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:40.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.667+0000 7f557352d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:40.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.667+0000 7f557352d800 5 note: GC not initialized 2024-05-08T18:31:40.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.667+0000 7f5424fe1640 20 reqs_thread_entry: start 2024-05-08T18:31:40.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.667+0000 7f557352d800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:40.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.667+0000 7f557352d800 20 Filter name: none 2024-05-08T18:31:40.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.667+0000 7f539e7fc640 20 reqs_thread_entry: start 2024-05-08T18:31:40.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.667+0000 7f557352d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:40.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.667+0000 7f557352d800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.667+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b340190 con 0x555e3b2f8cd0 2024-05-08T18:31:40.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.668+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.668+0000 7f557352d800 20 rados_obj.operate() r=0 bl.length=403 2024-05-08T18:31:40.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.668+0000 7f557352d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:40.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.668+0000 7f557352d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:40.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.668+0000 7f557352d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:40.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.668+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b3462d0 con 0x555e3b2f8cd0 2024-05-08T18:31:40.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.669+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v27'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.669+0000 7f557352d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:40.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.669+0000 7f557352d800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:40.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.669+0000 7f557352d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:31:40.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.669+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93863208574096 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555e3b341ab0 con 0x555e3b2f8cd0 2024-05-08T18:31:40.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.669+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== watch-notify(notify (1) cookie 93863208318848 notify 115964117009 ret 0) ==== 609+0+0 (crc 0 0 0) 0x555e3b135ef0 con 0x555e3b2f8cd0 2024-05-08T18:31:40.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.669+0000 7f5452ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117009 cookie 93863208318848 notifier 4655 bl.length()=567 2024-05-08T18:31:40.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.669+0000 7f5452ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:31:40.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.669+0000 7f5452ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:40.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.669+0000 7f5452ffd640 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f5434003ea0 con 0x555e3b2f8cd0 2024-05-08T18:31:40.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.669+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(64 notify.4 [notify cookie 93863208574096 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.669+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.670+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== watch-notify(notify_complete (2) cookie 93863208574096 notify 115964117009 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f556403fa40 con 0x555e3b2f8cd0 2024-05-08T18:31:40.683 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:31:17.112075Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:31:17.112057Z","tags":[],"group_ids":[]} 2024-05-08T18:31:40.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.670+0000 7f5425fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:40.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.670+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93863208338912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b30bdc0 con 0x555e3b2f8cd0 2024-05-08T18:31:40.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.672+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93863208338912] v27'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.672+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93863208302032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b30c5e0 con 0x7f5568034070 2024-05-08T18:31:40.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.673+0000 7f556f1ca640 1 -- 172.21.15.87:0/3032839036 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93863208302032] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5560088040 con 0x7f5568034070 2024-05-08T18:31:40.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.673+0000 7f557352d800 20 remove_watcher() i=0 2024-05-08T18:31:40.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.673+0000 7f557352d800 2 removed watcher, disabling cache 2024-05-08T18:31:40.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.673+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93863208306192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b3035d0 con 0x555e3b2f8cd0 2024-05-08T18:31:40.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.674+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93863208306192] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.674+0000 7f557352d800 20 remove_watcher() i=1 2024-05-08T18:31:40.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.674+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93863208311056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b3035d0 con 0x555e3b2fef20 2024-05-08T18:31:40.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.675+0000 7f556f9cb640 1 -- 172.21.15.87:0/3032839036 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93863208311056] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5568061040 con 0x555e3b2fef20 2024-05-08T18:31:40.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.675+0000 7f557352d800 20 remove_watcher() i=2 2024-05-08T18:31:40.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.675+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93863208313856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b3035d0 con 0x7f5568034070 2024-05-08T18:31:40.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.676+0000 7f556f1ca640 1 -- 172.21.15.87:0/3032839036 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93863208313856] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5560088040 con 0x7f5568034070 2024-05-08T18:31:40.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.676+0000 7f557352d800 20 remove_watcher() i=3 2024-05-08T18:31:40.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.676+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93863208318848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b3035d0 con 0x555e3b2f8cd0 2024-05-08T18:31:40.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.677+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93863208318848] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f556402a040 con 0x555e3b2f8cd0 2024-05-08T18:31:40.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.677+0000 7f557352d800 20 remove_watcher() i=4 2024-05-08T18:31:40.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.677+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93863208316128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b307780 con 0x7f55600a2040 2024-05-08T18:31:40.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.677+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93863208316128] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.677+0000 7f557352d800 20 remove_watcher() i=5 2024-05-08T18:31:40.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.677+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93863208322400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b3035d0 con 0x7f55600a2040 2024-05-08T18:31:40.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.678+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93863208322400] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.678+0000 7f557352d800 20 remove_watcher() i=6 2024-05-08T18:31:40.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.678+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93863208324528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555e3b307780 con 0x7f55600a2040 2024-05-08T18:31:40.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.679+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93863208324528] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f556402a040 con 0x7f55600a2040 2024-05-08T18:31:40.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.679+0000 7f557352d800 20 remove_watcher() i=7 2024-05-08T18:31:40.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.679+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f55600a2040 msgr2=0x7f556005b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.679+0000 7f557352d800 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f55600a2040 0x7f556005b7c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.679+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555e3b2f8cd0 msgr2=0x555e3b2fb190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.679+0000 7f557352d800 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555e3b2f8cd0 0x555e3b2fb190 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.679+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5568034070 msgr2=0x7f556802a3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.679+0000 7f557352d800 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5568034070 0x7f556802a3e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.679+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x555e3b2fef20 msgr2=0x555e3b301370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.679+0000 7f557352d800 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x555e3b2fef20 0x555e3b301370 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f543803bba0 msgr2=0x7f543803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f543803bba0 0x7f543803e060 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5560052450 tx=0x7f556008d000 comp rx=0 tx=0).stop 2024-05-08T18:31:40.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2e5ca0 msgr2=0x555e3b2ed250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f556e9c9640 1 -- 172.21.15.87:0/3032839036 reap_dead start 2024-05-08T18:31:40.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2e5ca0 0x555e3b2ed250 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f55680076e0 tx=0x7f5568052920 comp rx=0 tx=0).stop 2024-05-08T18:31:40.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 shutdown_connections 2024-05-08T18:31:40.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 --2- 172.21.15.87:0/3032839036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2e5ca0 0x555e3b2ed250 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 >> 172.21.15.87:0/3032839036 conn(0x555e3b2e1fb0 msgr2=0x555e3b2df660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 shutdown_connections 2024-05-08T18:31:40.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 -- 172.21.15.87:0/3032839036 wait complete. 2024-05-08T18:31:40.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 -- 172.21.15.87:0/2870839239 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f544803bba0 msgr2=0x7f544803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 --2- 172.21.15.87:0/2870839239 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f544803bba0 0x7f544803e060 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f556005cd30 tx=0x7f556005df10 comp rx=0 tx=0).stop 2024-05-08T18:31:40.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 -- 172.21.15.87:0/2870839239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2d89a0 msgr2=0x555e3b2d8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 --2- 172.21.15.87:0/2870839239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2d89a0 0x555e3b2d8dc0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x555e3b2be360 tx=0x7f556800ef30 comp rx=0 tx=0).stop 2024-05-08T18:31:40.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 -- 172.21.15.87:0/2870839239 shutdown_connections 2024-05-08T18:31:40.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 --2- 172.21.15.87:0/2870839239 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f544803bba0 0x7f544803e060 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 --2- 172.21.15.87:0/2870839239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b2d89a0 0x555e3b2d8dc0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 -- 172.21.15.87:0/2870839239 >> 172.21.15.87:0/2870839239 conn(0x555e3b2cca40 msgr2=0x555e3b2cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 -- 172.21.15.87:0/2870839239 shutdown_connections 2024-05-08T18:31:40.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.680+0000 7f557352d800 1 -- 172.21.15.87:0/2870839239 wait complete. 2024-05-08T18:31:40.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.681+0000 7f557352d800 1 -- 172.21.15.87:0/4244542257 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555e3b2c7db0 msgr2=0x555e3b2ca1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.681+0000 7f557352d800 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555e3b2c7db0 0x555e3b2ca1a0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.681+0000 7f557352d800 1 -- 172.21.15.87:0/4244542257 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555e3b1c14d0 msgr2=0x555e3b2c46e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.681+0000 7f557352d800 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555e3b1c14d0 0x555e3b2c46e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.681+0000 7f557352d800 1 -- 172.21.15.87:0/4244542257 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f545403bba0 msgr2=0x7f545403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.681+0000 7f557352d800 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f545403bba0 0x7f545403e060 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5564001d90 tx=0x7f55640012f0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.681+0000 7f557352d800 1 -- 172.21.15.87:0/4244542257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 msgr2=0x555e3b2bd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.681+0000 7f557352d800 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 0x555e3b2bd540 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f55600526d0 tx=0x7f5560003330 comp rx=0 tx=0).stop 2024-05-08T18:31:40.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.681+0000 7f557352d800 1 -- 172.21.15.87:0/4244542257 shutdown_connections 2024-05-08T18:31:40.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.681+0000 7f557352d800 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x555e3b1c14d0 0x555e3b2c46e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.681+0000 7f557352d800 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x555e3b2c7db0 0x555e3b2ca1a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.681+0000 7f557352d800 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f545403bba0 0x7f545403e060 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.681+0000 7f557352d800 1 --2- 172.21.15.87:0/4244542257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555e3b1c0b70 0x555e3b2bd540 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.681+0000 7f557352d800 1 -- 172.21.15.87:0/4244542257 >> 172.21.15.87:0/4244542257 conn(0x555e3b1bc6b0 msgr2=0x555e3b2afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.681+0000 7f557352d800 1 -- 172.21.15.87:0/4244542257 shutdown_connections 2024-05-08T18:31:40.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.681+0000 7f557352d800 1 -- 172.21.15.87:0/4244542257 wait complete. 2024-05-08T18:31:40.696 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:31:17.112075Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:31:17.112057Z', 'tags': [], 'group_ids': []} 2024-05-08T18:31:40.712 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:40.713 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-08T18:31:40.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-08T18:31:40.713 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-08T18:31:40.757 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:31:40.757 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:31:40.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.760+0000 7f4167f25800 1 Processor -- start 2024-05-08T18:31:40.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.760+0000 7f4167f25800 1 -- start start 2024-05-08T18:31:40.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.760+0000 7f4167f25800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561dd8cc32b0 0x561dd8cc36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.760+0000 7f4167f25800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561dd8cc3d50 con 0x561dd8cc4470 2024-05-08T18:31:40.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.760+0000 7f4167f25800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x561dd8b63e20 con 0x561dd8cc32b0 2024-05-08T18:31:40.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.760+0000 7f4163c52640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561dd8cc32b0 0x561dd8cc36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.760+0000 7f4163451640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x561dd8cc4470 0x561dd8cc48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:51610/0 (socket says 172.21.15.87:51610) 2024-05-08T18:31:40.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.760+0000 7f4163451640 1 -- 172.21.15.87:0/2091890076 learned_addr learned my addr 172.21.15.87:0/2091890076 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:31:40.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.760+0000 7f4163c52640 1 -- 172.21.15.87:0/2091890076 >> v1:172.21.15.53:6789/0 conn(0x561dd8cc4470 legacy=0x561dd8cc48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.760+0000 7f4162c50640 1 -- 172.21.15.87:0/2091890076 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3579472137 0 0) 0x561dd8cc3d50 con 0x561dd8cc4470 2024-05-08T18:31:40.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.760+0000 7f4163c52640 1 -- 172.21.15.87:0/2091890076 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dd8cc5030 con 0x561dd8cc32b0 2024-05-08T18:31:40.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.762+0000 7f4163c52640 1 --2- 172.21.15.87:0/2091890076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 0x561dd8cc36d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4154005fd0 tx=0x7f415401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448886c42c6e8d8d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.763+0000 7f4162c50640 1 -- 172.21.15.87:0/2091890076 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4154052560 con 0x561dd8cc32b0 2024-05-08T18:31:40.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.763+0000 7f4162c50640 1 -- 172.21.15.87:0/2091890076 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4154052700 con 0x561dd8cc32b0 2024-05-08T18:31:40.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.763+0000 7f4162c50640 1 -- 172.21.15.87:0/2091890076 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4154052a20 con 0x561dd8cc32b0 2024-05-08T18:31:40.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.763+0000 7f4167f25800 1 -- 172.21.15.87:0/2091890076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 msgr2=0x561dd8cc36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.763+0000 7f4167f25800 1 --2- 172.21.15.87:0/2091890076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 0x561dd8cc36d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4154005fd0 tx=0x7f415401ccc0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.763+0000 7f4167f25800 1 -- 172.21.15.87:0/2091890076 shutdown_connections 2024-05-08T18:31:40.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.763+0000 7f4167f25800 1 --2- 172.21.15.87:0/2091890076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 0x561dd8cc36d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.763+0000 7f4167f25800 1 -- 172.21.15.87:0/2091890076 >> 172.21.15.87:0/2091890076 conn(0x561dd8cbe830 msgr2=0x561dd8cc0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.763+0000 7f4167f25800 1 -- 172.21.15.87:0/2091890076 shutdown_connections 2024-05-08T18:31:40.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.763+0000 7f4167f25800 1 -- 172.21.15.87:0/2091890076 wait complete. 2024-05-08T18:31:40.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.776+0000 7f4167f25800 1 Processor -- start 2024-05-08T18:31:40.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.777+0000 7f4167f25800 1 -- start start 2024-05-08T18:31:40.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.777+0000 7f4167f25800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 0x561dd8db4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.777+0000 7f4167f25800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561dd8c0e5b0 con 0x561dd8cc32b0 2024-05-08T18:31:40.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.777+0000 7f4163c52640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 0x561dd8db4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.777+0000 7f4163c52640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 0x561dd8db4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59368/0 (socket says 172.21.15.87:59368) 2024-05-08T18:31:40.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.777+0000 7f4163c52640 1 -- 172.21.15.87:0/3076872357 learned_addr learned my addr 172.21.15.87:0/3076872357 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.777+0000 7f4163c52640 1 -- 172.21.15.87:0/3076872357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dd8db4ad0 con 0x561dd8cc32b0 2024-05-08T18:31:40.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.778+0000 7f4163c52640 1 --2- 172.21.15.87:0/3076872357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 0x561dd8db4500 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4154007000 tx=0x7f415404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed136fadf9c8179d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.778+0000 7f4051e0b640 1 -- 172.21.15.87:0/3076872357 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41540529e0 con 0x561dd8cc32b0 2024-05-08T18:31:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.778+0000 7f4051e0b640 1 -- 172.21.15.87:0/3076872357 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4154052b80 con 0x561dd8cc32b0 2024-05-08T18:31:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.778+0000 7f4051e0b640 1 -- 172.21.15.87:0/3076872357 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f415405c430 con 0x561dd8cc32b0 2024-05-08T18:31:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.779+0000 7f4167f25800 1 -- 172.21.15.87:0/3076872357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 msgr2=0x561dd8db4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.779+0000 7f4167f25800 1 --2- 172.21.15.87:0/3076872357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 0x561dd8db4500 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4154007000 tx=0x7f415404c000 comp rx=0 tx=0).stop 2024-05-08T18:31:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.779+0000 7f4167f25800 1 -- 172.21.15.87:0/3076872357 shutdown_connections 2024-05-08T18:31:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.779+0000 7f4167f25800 1 --2- 172.21.15.87:0/3076872357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 0x561dd8db4500 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.779+0000 7f4167f25800 1 -- 172.21.15.87:0/3076872357 >> 172.21.15.87:0/3076872357 conn(0x561dd8cbe830 msgr2=0x561dd8dafe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.779+0000 7f4167f25800 1 -- 172.21.15.87:0/3076872357 shutdown_connections 2024-05-08T18:31:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.779+0000 7f4167f25800 1 -- 172.21.15.87:0/3076872357 wait complete. 2024-05-08T18:31:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.779+0000 7f4167f25800 1 Processor -- start 2024-05-08T18:31:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.779+0000 7f4167f25800 1 -- start start 2024-05-08T18:31:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.779+0000 7f4167f25800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 0x561dd8dbbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.779+0000 7f4167f25800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561dd8ccc940 con 0x561dd8cc32b0 2024-05-08T18:31:40.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.779+0000 7f4163c52640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 0x561dd8dbbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.779+0000 7f4163c52640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 0x561dd8dbbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59372/0 (socket says 172.21.15.87:59372) 2024-05-08T18:31:40.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.779+0000 7f4163c52640 1 -- 172.21.15.87:0/804745983 learned_addr learned my addr 172.21.15.87:0/804745983 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.780+0000 7f4163c52640 1 -- 172.21.15.87:0/804745983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dd8dbc470 con 0x561dd8cc32b0 2024-05-08T18:31:40.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.780+0000 7f4163c52640 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 0x561dd8dbbf30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f41540526d0 tx=0x7f4154003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.780+0000 7f404bfff640 1 -- 172.21.15.87:0/804745983 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4154075070 con 0x561dd8cc32b0 2024-05-08T18:31:40.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.780+0000 7f404bfff640 1 -- 172.21.15.87:0/804745983 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4154070540 con 0x561dd8cc32b0 2024-05-08T18:31:40.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.780+0000 7f4167f25800 1 -- 172.21.15.87:0/804745983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561dd8dbc700 con 0x561dd8cc32b0 2024-05-08T18:31:40.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.780+0000 7f404bfff640 1 -- 172.21.15.87:0/804745983 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4154070820 con 0x561dd8cc32b0 2024-05-08T18:31:40.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.780+0000 7f4167f25800 1 -- 172.21.15.87:0/804745983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dd8dbf3b0 con 0x561dd8cc32b0 2024-05-08T18:31:40.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.781+0000 7f404bfff640 1 -- 172.21.15.87:0/804745983 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4154078070 con 0x561dd8cc32b0 2024-05-08T18:31:40.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.781+0000 7f404bfff640 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f404c03bba0 0x7f404c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.781+0000 7f404bfff640 1 -- 172.21.15.87:0/804745983 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f415406d070 con 0x561dd8cc32b0 2024-05-08T18:31:40.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.781+0000 7f4163451640 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f404c03bba0 0x7f404c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.781+0000 7f4167f25800 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561dd8cc4470 0x561dd8dc3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.781+0000 7f4167f25800 1 -- 172.21.15.87:0/804745983 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8dc36b0 con 0x561dd8cc4470 2024-05-08T18:31:40.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.782+0000 7f4164453640 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561dd8cc4470 0x561dd8dc3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.782+0000 7f4163451640 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f404c03bba0 0x7f404c03e060 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4158000c00 tx=0x7f41580013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.782+0000 7f4164453640 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561dd8cc4470 0x561dd8dc3170 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.782+0000 7f4164453640 1 -- 172.21.15.87:0/804745983 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f415c0083e0 con 0x561dd8cc4470 2024-05-08T18:31:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.782+0000 7f4167f25800 1 -- 172.21.15.87:0/804745983 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8dc06d0 con 0x561dd8cc4470 2024-05-08T18:31:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.782+0000 7f4164453640 1 -- 172.21.15.87:0/804745983 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f415c0083e0 con 0x561dd8cc4470 2024-05-08T18:31:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.782+0000 7f4167f25800 1 -- 172.21.15.87:0/804745983 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8dc5410 con 0x561dd8cc4470 2024-05-08T18:31:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.783+0000 7f4164453640 1 -- 172.21.15.87:0/804745983 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f415c0083e0 con 0x561dd8cc4470 2024-05-08T18:31:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.783+0000 7f4167f25800 1 -- 172.21.15.87:0/804745983 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8dc4670 con 0x561dd8cc4470 2024-05-08T18:31:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.783+0000 7f4164453640 1 -- 172.21.15.87:0/804745983 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f415c0083e0 con 0x561dd8cc4470 2024-05-08T18:31:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.783+0000 7f4167f25800 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561dd8dc67c0 0x561dd8dc8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.783+0000 7f4167f25800 1 -- 172.21.15.87:0/804745983 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8dc90f0 con 0x561dd8dc67c0 2024-05-08T18:31:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.783+0000 7f4163c52640 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561dd8dc67c0 0x561dd8dc8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.784+0000 7f4163c52640 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561dd8dc67c0 0x561dd8dc8bb0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.784+0000 7f4163c52640 1 -- 172.21.15.87:0/804745983 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4154077030 con 0x561dd8dc67c0 2024-05-08T18:31:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.784+0000 7f4167f25800 1 Processor -- start 2024-05-08T18:31:40.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.784+0000 7f4167f25800 1 -- start start 2024-05-08T18:31:40.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.785+0000 7f4167f25800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8dd7350 0x561dd8dd7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.785+0000 7f4167f25800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561dd8bb4fc0 con 0x561dd8dd7350 2024-05-08T18:31:40.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.785+0000 7f4164453640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8dd7350 0x561dd8dd7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.785+0000 7f4164453640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8dd7350 0x561dd8dd7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59374/0 (socket says 172.21.15.87:59374) 2024-05-08T18:31:40.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.785+0000 7f4164453640 1 -- 172.21.15.87:0/2558510347 learned_addr learned my addr 172.21.15.87:0/2558510347 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.785+0000 7f4164453640 1 -- 172.21.15.87:0/2558510347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dd8dd7cb0 con 0x561dd8dd7350 2024-05-08T18:31:40.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.785+0000 7f4164453640 1 --2- 172.21.15.87:0/2558510347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8dd7350 0x561dd8dd7770 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x561dd8dbcd50 tx=0x7f415c00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.785+0000 7f40497fa640 1 -- 172.21.15.87:0/2558510347 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f415c00ae50 con 0x561dd8dd7350 2024-05-08T18:31:40.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.785+0000 7f40497fa640 1 -- 172.21.15.87:0/2558510347 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f415c01e020 con 0x561dd8dd7350 2024-05-08T18:31:40.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.785+0000 7f4167f25800 1 -- 172.21.15.87:0/2558510347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561dd8dd8720 con 0x561dd8dd7350 2024-05-08T18:31:40.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.785+0000 7f40497fa640 1 -- 172.21.15.87:0/2558510347 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f415c019550 con 0x561dd8dd7350 2024-05-08T18:31:40.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.785+0000 7f4167f25800 1 -- 172.21.15.87:0/2558510347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dd8dd8c20 con 0x561dd8dd7350 2024-05-08T18:31:40.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.786+0000 7f40497fa640 1 -- 172.21.15.87:0/2558510347 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f415c016040 con 0x561dd8dd7350 2024-05-08T18:31:40.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.786+0000 7f40497fa640 1 --2- 172.21.15.87:0/2558510347 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f403c03bd40 0x7f403c03e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.786+0000 7f40497fa640 1 -- 172.21.15.87:0/2558510347 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f415c01f030 con 0x561dd8dd7350 2024-05-08T18:31:40.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.786+0000 7f4163c52640 1 --2- 172.21.15.87:0/2558510347 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f403c03bd40 0x7f403c03e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.787+0000 7f4167f25800 1 Processor -- start 2024-05-08T18:31:40.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.787+0000 7f4167f25800 1 -- start start 2024-05-08T18:31:40.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.787+0000 7f4163c52640 1 --2- 172.21.15.87:0/2558510347 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f403c03bd40 0x7f403c03e200 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x561dd8dc4a10 tx=0x7f4154079ef0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.787+0000 7f4167f25800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8de4650 0x561dd8de4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.787+0000 7f4167f25800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561dd8db4df0 con 0x561dd8de4650 2024-05-08T18:31:40.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.787+0000 7f4164453640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8de4650 0x561dd8de4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.787+0000 7f4164453640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8de4650 0x561dd8de4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59386/0 (socket says 172.21.15.87:59386) 2024-05-08T18:31:40.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.787+0000 7f4164453640 1 -- 172.21.15.87:0/3378100495 learned_addr learned my addr 172.21.15.87:0/3378100495 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.787+0000 7f4164453640 1 -- 172.21.15.87:0/3378100495 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dd8de5040 con 0x561dd8de4650 2024-05-08T18:31:40.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.788+0000 7f4164453640 1 --2- 172.21.15.87:0/3378100495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8de4650 0x561dd8de4a70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f415c052ee0 tx=0x7f415c052fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9721975d602d0018 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.788+0000 7f4042ffd640 1 -- 172.21.15.87:0/3378100495 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f415c01d070 con 0x561dd8de4650 2024-05-08T18:31:40.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.788+0000 7f4042ffd640 1 -- 172.21.15.87:0/3378100495 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f415c017bf0 con 0x561dd8de4650 2024-05-08T18:31:40.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.788+0000 7f4042ffd640 1 -- 172.21.15.87:0/3378100495 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f415c022950 con 0x561dd8de4650 2024-05-08T18:31:40.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.788+0000 7f4167f25800 1 -- 172.21.15.87:0/3378100495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8de4650 msgr2=0x561dd8de4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.788+0000 7f4167f25800 1 --2- 172.21.15.87:0/3378100495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8de4650 0x561dd8de4a70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f415c052ee0 tx=0x7f415c052fd0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.788+0000 7f4167f25800 1 -- 172.21.15.87:0/3378100495 shutdown_connections 2024-05-08T18:31:40.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.788+0000 7f4167f25800 1 --2- 172.21.15.87:0/3378100495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8de4650 0x561dd8de4a70 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.788+0000 7f4167f25800 1 -- 172.21.15.87:0/3378100495 >> 172.21.15.87:0/3378100495 conn(0x561dd8de09b0 msgr2=0x561dd8ddea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.788+0000 7f4167f25800 1 -- 172.21.15.87:0/3378100495 shutdown_connections 2024-05-08T18:31:40.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.788+0000 7f4167f25800 1 -- 172.21.15.87:0/3378100495 wait complete. 2024-05-08T18:31:40.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.789+0000 7f4167f25800 1 Processor -- start 2024-05-08T18:31:40.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.789+0000 7f4167f25800 1 -- start start 2024-05-08T18:31:40.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.789+0000 7f4167f25800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8de4650 0x561dd8debc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.789+0000 7f4167f25800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561dd8de57b0 con 0x561dd8de4650 2024-05-08T18:31:40.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.789+0000 7f4164453640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8de4650 0x561dd8debc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.789+0000 7f4164453640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8de4650 0x561dd8debc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:59394/0 (socket says 172.21.15.87:59394) 2024-05-08T18:31:40.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.789+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 learned_addr learned my addr 172.21.15.87:0/2905978574 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:31:40.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.789+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dd8dec1b0 con 0x561dd8de4650 2024-05-08T18:31:40.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.789+0000 7f4164453640 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8de4650 0x561dd8debc70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f415c019fd0 tx=0x7f415c052c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.789+0000 7f40417fa640 1 -- 172.21.15.87:0/2905978574 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f415c022db0 con 0x561dd8de4650 2024-05-08T18:31:40.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.789+0000 7f40417fa640 1 -- 172.21.15.87:0/2905978574 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f415c0175c0 con 0x561dd8de4650 2024-05-08T18:31:40.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.789+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561dd8dec440 con 0x561dd8de4650 2024-05-08T18:31:40.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.789+0000 7f40417fa640 1 -- 172.21.15.87:0/2905978574 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f415c0178e0 con 0x561dd8de4650 2024-05-08T18:31:40.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.790+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dd8def0f0 con 0x561dd8de4650 2024-05-08T18:31:40.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.790+0000 7f40417fa640 1 -- 172.21.15.87:0/2905978574 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f415c054120 con 0x561dd8de4650 2024-05-08T18:31:40.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.790+0000 7f40417fa640 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f402c03bab0 0x7f402c03df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.790+0000 7f40417fa640 1 -- 172.21.15.87:0/2905978574 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f415c037c90 con 0x561dd8de4650 2024-05-08T18:31:40.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.790+0000 7f4163c52640 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f402c03bab0 0x7f402c03df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.791+0000 7f4163c52640 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f402c03bab0 0x7f402c03df70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4154051e20 tx=0x7f415408c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.791+0000 7f4167f25800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.791+0000 7f4167f25800 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561dd8df7780 0x561dd8df9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.791+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8dfa390 con 0x561dd8df7780 2024-05-08T18:31:40.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.791+0000 7f4163451640 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561dd8df7780 0x561dd8df9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4163451640 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561dd8df7780 0x561dd8df9c40 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f415800f5f0 con 0x561dd8df7780 2024-05-08T18:31:40.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4167f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4167f25800 20 realm 2024-05-08T18:31:40.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4167f25800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8df6bd0 con 0x561dd8df7780 2024-05-08T18:31:40.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f415800f5f0 con 0x561dd8df7780 2024-05-08T18:31:40.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4167f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4167f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:31:40.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4167f25800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8dfae80 con 0x561dd8df7780 2024-05-08T18:31:40.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f415800f5f0 con 0x561dd8df7780 2024-05-08T18:31:40.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4167f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4167f25800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8dfb750 con 0x561dd8df7780 2024-05-08T18:31:40.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f415800f5f0 con 0x561dd8df7780 2024-05-08T18:31:40.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4167f25800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:40.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4167f25800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.792+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8dfbaf0 con 0x561dd8df7780 2024-05-08T18:31:40.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.793+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f415800f5f0 con 0x561dd8df7780 2024-05-08T18:31:40.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.793+0000 7f4167f25800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:31:40.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.793+0000 7f4167f25800 20 searching for the correct realm 2024-05-08T18:31:40.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.793+0000 7f4167f25800 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561dd8dfda20 0x561dd8dffe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.793+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x561dd8dfda20 2024-05-08T18:31:40.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.793+0000 7f4164453640 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561dd8dfda20 0x561dd8dffe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.793+0000 7f4164453640 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561dd8dfda20 0x561dd8dffe30 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.794+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.794+0000 7f4164453640 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f415c04c070 0x7f415c03f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.794+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x7f415c04c070 2024-05-08T18:31:40.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.794+0000 7f4163c52640 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f415c04c070 0x7f415c03f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.794+0000 7f4163c52640 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f415c04c070 0x7f415c03f930 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.794+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.794+0000 7f4163c52640 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f41540a1040 0x7f4154004600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:31:40.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.794+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x7f41540a1040 2024-05-08T18:31:40.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.795+0000 7f4163451640 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f41540a1040 0x7f4154004600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:31:40.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.795+0000 7f4163451640 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f41540a1040 0x7f4154004600 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:31:40.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.795+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415800f5f0 con 0x7f41540a1040 2024-05-08T18:31:40.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.795+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x561dd8df7780 2024-05-08T18:31:40.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.795+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415800f5f0 con 0x561dd8df7780 2024-05-08T18:31:40.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.795+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x561dd8df7780 2024-05-08T18:31:40.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.796+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415800f5f0 con 0x561dd8df7780 2024-05-08T18:31:40.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.796+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x7f41540a1040 2024-05-08T18:31:40.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.796+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f415800f5f0 con 0x7f41540a1040 2024-05-08T18:31:40.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.796+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x7f41540a1040 2024-05-08T18:31:40.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.796+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415800f5f0 con 0x7f41540a1040 2024-05-08T18:31:40.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.796+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x7f415c04c070 2024-05-08T18:31:40.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.796+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.796+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x561dd8dfda20 2024-05-08T18:31:40.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.797+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.797+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x561dd8df7780 2024-05-08T18:31:40.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.797+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415800f5f0 con 0x561dd8df7780 2024-05-08T18:31:40.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.797+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x7f41540a1040 2024-05-08T18:31:40.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.797+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415800f5f0 con 0x7f41540a1040 2024-05-08T18:31:40.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.797+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x561dd8df7780 2024-05-08T18:31:40.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.797+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415800f5f0 con 0x561dd8df7780 2024-05-08T18:31:40.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.797+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x7f415c04c070 2024-05-08T18:31:40.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.798+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.798+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x561dd8dfda20 2024-05-08T18:31:40.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.798+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.798+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x561dd8dfda20 2024-05-08T18:31:40.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.798+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.798+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x7f41540a1040 2024-05-08T18:31:40.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.798+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415800f5f0 con 0x7f41540a1040 2024-05-08T18:31:40.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.798+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x561dd8dfda20 2024-05-08T18:31:40.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.799+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.799+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x561dd8dfda20 2024-05-08T18:31:40.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.799+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.799+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x561dd8df7780 2024-05-08T18:31:40.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.799+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415800f5f0 con 0x561dd8df7780 2024-05-08T18:31:40.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.799+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x561dd8df7780 2024-05-08T18:31:40.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.799+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 27 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f415800f5f0 con 0x561dd8df7780 2024-05-08T18:31:40.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.799+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x7f41540a1040 2024-05-08T18:31:40.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.800+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415800f5f0 con 0x7f41540a1040 2024-05-08T18:31:40.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.800+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x561dd8dfda20 2024-05-08T18:31:40.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.800+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.800+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x7f415c04c070 2024-05-08T18:31:40.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.800+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.800+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x561dd8df7780 2024-05-08T18:31:40.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.800+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415800f5f0 con 0x561dd8df7780 2024-05-08T18:31:40.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.800+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x7f41540a1040 2024-05-08T18:31:40.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.801+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.801+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x561dd8dfda20 2024-05-08T18:31:40.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.801+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.801+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x7f41540a1040 2024-05-08T18:31:40.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.802+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.802+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x7f415c04c070 2024-05-08T18:31:40.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.802+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.802+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x561dd8dfda20 2024-05-08T18:31:40.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.802+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.802+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x7f41540a1040 2024-05-08T18:31:40.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.803+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.803+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x561dd8df7780 2024-05-08T18:31:40.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.803+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.803+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00500 con 0x7f415c04c070 2024-05-08T18:31:40.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.803+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.803+0000 7f4167f25800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:31:40.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.803+0000 7f4167f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:31:40.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.803+0000 7f4167f25800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:31:40.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.803+0000 7f4167f25800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:31:40.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.803+0000 7f4167f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:31:40.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.803+0000 7f4167f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:31:40.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.803+0000 7f4167f25800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.803+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8dfc4c0 con 0x561dd8df7780 2024-05-08T18:31:40.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.803+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.803+0000 7f4167f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.803+0000 7f4167f25800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.803+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8dfcd60 con 0x561dd8df7780 2024-05-08T18:31:40.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4167f25800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:31:40.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4167f25800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8dfcd60 con 0x7f41540a1040 2024-05-08T18:31:40.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4167f25800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:31:40.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4167f25800 20 zone default found 2024-05-08T18:31:40.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4167f25800 4 Realm: () 2024-05-08T18:31:40.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4167f25800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:31:40.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4167f25800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:31:40.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4167f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:31:40.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4167f25800 20 zonegroup default 2024-05-08T18:31:40.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4167f25800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e00980 con 0x7f41540a1040 2024-05-08T18:31:40.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4167f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4167f25800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e02390 con 0x561dd8dfda20 2024-05-08T18:31:40.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.804+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.805+0000 7f4167f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.805+0000 7f4167f25800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.805+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e02800 con 0x561dd8dfda20 2024-05-08T18:31:40.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.805+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.805+0000 7f4167f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:31:40.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.805+0000 7f4167f25800 20 started sync module instance, tier type = 2024-05-08T18:31:40.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.805+0000 7f4167f25800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:31:40.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.805+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e01800 con 0x7f415c04c070 2024-05-08T18:31:40.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.806+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(44 notify.0 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.806+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94686192606192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e01460 con 0x7f415c04c070 2024-05-08T18:31:40.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.806+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e03730 con 0x561dd8df7780 2024-05-08T18:31:40.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.807+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94686192606192] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.807+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.807+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94686192611968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e03b50 con 0x561dd8df7780 2024-05-08T18:31:40.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.807+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e04510 con 0x561dd8dfda20 2024-05-08T18:31:40.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.808+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.808+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94686192615520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e044c0 con 0x561dd8dfda20 2024-05-08T18:31:40.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.808+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e054c0 con 0x7f415c04c070 2024-05-08T18:31:40.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.808+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94686192611968] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.809+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94686192615520] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.809+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(50 notify.3 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.809+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94686192617728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e04fd0 con 0x7f415c04c070 2024-05-08T18:31:40.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.809+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e05ed0 con 0x561dd8df7780 2024-05-08T18:31:40.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.810+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94686192617728] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.810+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.810+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94686192613024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e05ed0 con 0x561dd8df7780 2024-05-08T18:31:40.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.810+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e06890 con 0x7f41540a1040 2024-05-08T18:31:40.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.811+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94686192613024] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.811+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(54 notify.5 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.811+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94686192622592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e06890 con 0x7f41540a1040 2024-05-08T18:31:40.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.811+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e07250 con 0x7f41540a1040 2024-05-08T18:31:40.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.812+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94686192622592] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.812+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(56 notify.6 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.812+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94686192625088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e07250 con 0x7f41540a1040 2024-05-08T18:31:40.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.812+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e07c10 con 0x7f41540a1040 2024-05-08T18:31:40.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.813+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(58 notify.7 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.813+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94686192629600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e08030 con 0x7f41540a1040 2024-05-08T18:31:40.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.813+0000 7f4167f25800 20 add_watcher() i=0 2024-05-08T18:31:40.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.813+0000 7f4167f25800 20 add_watcher() i=1 2024-05-08T18:31:40.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.813+0000 7f4167f25800 20 add_watcher() i=2 2024-05-08T18:31:40.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.813+0000 7f4167f25800 20 add_watcher() i=3 2024-05-08T18:31:40.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.813+0000 7f4167f25800 20 add_watcher() i=4 2024-05-08T18:31:40.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.813+0000 7f4167f25800 20 add_watcher() i=5 2024-05-08T18:31:40.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.813+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94686192625088] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.813+0000 7f4167f25800 20 add_watcher() i=6 2024-05-08T18:31:40.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.814+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94686192629600] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.814+0000 7f4167f25800 20 add_watcher() i=7 2024-05-08T18:31:40.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.814+0000 7f4167f25800 2 all 8 watchers are set, enabling cache 2024-05-08T18:31:40.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.814+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e06da0 con 0x561dd8df7780 2024-05-08T18:31:40.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.815+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.815+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94686192630656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e06da0 con 0x561dd8df7780 2024-05-08T18:31:40.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.816+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94686192630656] v27'192 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.816+0000 7f4019fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:40.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.816+0000 7f4167f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:31:40.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.816+0000 7f4167f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:31:40.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.816+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e13a00 con 0x561dd8df7780 2024-05-08T18:31:40.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.817+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.817+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e140d0 con 0x7f41540a1040 2024-05-08T18:31:40.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.819+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.819+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e144f0 con 0x561dd8dfda20 2024-05-08T18:31:40.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.820+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.820+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e144b0 con 0x561dd8df7780 2024-05-08T18:31:40.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.821+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'193 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.821+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e14ac0 con 0x7f415c04c070 2024-05-08T18:31:40.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.821+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.822+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e14f70 con 0x561dd8dfda20 2024-05-08T18:31:40.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.822+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'44 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.822+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e14f70 con 0x561dd8df7780 2024-05-08T18:31:40.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.824+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.824+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e14f70 con 0x7f41540a1040 2024-05-08T18:31:40.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.825+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.825+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e14f70 con 0x7f415c04c070 2024-05-08T18:31:40.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.826+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.826+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e15140 con 0x561dd8dfda20 2024-05-08T18:31:40.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.827+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.827+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x7f415c04c070 2024-05-08T18:31:40.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.828+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.828+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x7f41540a1040 2024-05-08T18:31:40.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.829+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.829+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x7f415c04c070 2024-05-08T18:31:40.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.830+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.830+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x7f41540a1040 2024-05-08T18:31:40.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.831+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.831+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x561dd8df7780 2024-05-08T18:31:40.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.832+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'194 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.832+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x561dd8dfda20 2024-05-08T18:31:40.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.833+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'59 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.833+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x7f415c04c070 2024-05-08T18:31:40.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.834+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.834+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x561dd8dfda20 2024-05-08T18:31:40.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.835+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.835+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x561dd8df7780 2024-05-08T18:31:40.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.836+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.836+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x561dd8df7780 2024-05-08T18:31:40.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.837+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'195 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.837+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x561dd8dfda20 2024-05-08T18:31:40.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.838+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'60 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.838+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x7f415c04c070 2024-05-08T18:31:40.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.839+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.839+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x561dd8dfda20 2024-05-08T18:31:40.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.840+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.840+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x561dd8dfda20 2024-05-08T18:31:40.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.841+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.841+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x561dd8dfda20 2024-05-08T18:31:40.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.842+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'23 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.842+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x561dd8dfda20 2024-05-08T18:31:40.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.843+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'45 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.843+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x7f41540a1040 2024-05-08T18:31:40.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.844+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.844+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x561dd8dfda20 2024-05-08T18:31:40.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.845+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.845+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x7f41540a1040 2024-05-08T18:31:40.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.846+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.846+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x561dd8dfda20 2024-05-08T18:31:40.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.847+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'61 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.847+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x7f41540a1040 2024-05-08T18:31:40.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.848+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.848+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e155a0 con 0x7f415c04c070 2024-05-08T18:31:40.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.849+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.849+0000 7f4018fe1640 20 reqs_thread_entry: start 2024-05-08T18:31:40.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.849+0000 7f4167f25800 20 init_complete bucket index max shards: 11 2024-05-08T18:31:40.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.849+0000 7f4167f25800 20 Filter name: none 2024-05-08T18:31:40.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.850+0000 7f3f927fc640 20 reqs_thread_entry: start 2024-05-08T18:31:40.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.850+0000 7f4167f25800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:31:40.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.850+0000 7f4167f25800 20 rados->read ofs=0 len=0 2024-05-08T18:31:40.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.850+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e40620 con 0x561dd8df7780 2024-05-08T18:31:40.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.850+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.850+0000 7f4167f25800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:31:40.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.850+0000 7f4167f25800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:31:40.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.850+0000 7f4167f25800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:31:40.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.850+0000 7f4167f25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:31:40.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.850+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e42a00 con 0x7f415c04c070 2024-05-08T18:31:40.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.850+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.850 INFO:teuthology.orchestra.run.smithi087.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-08T18:31:40.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.851+0000 7f4019fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:31:40.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.851+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94686192630656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e12850 con 0x561dd8df7780 2024-05-08T18:31:40.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.852+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94686192630656] v27'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.852+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94686192606192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e07b80 con 0x7f415c04c070 2024-05-08T18:31:40.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.853+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94686192606192] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.853+0000 7f4167f25800 20 remove_watcher() i=0 2024-05-08T18:31:40.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.853+0000 7f4167f25800 2 removed watcher, disabling cache 2024-05-08T18:31:40.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.853+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94686192611968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e01bf0 con 0x561dd8df7780 2024-05-08T18:31:40.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.854+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94686192611968] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.854+0000 7f4167f25800 20 remove_watcher() i=1 2024-05-08T18:31:40.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.854+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94686192615520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e01bf0 con 0x561dd8dfda20 2024-05-08T18:31:40.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.855+0000 7f4164453640 1 -- 172.21.15.87:0/2905978574 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94686192615520] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415c03d070 con 0x561dd8dfda20 2024-05-08T18:31:40.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.855+0000 7f4167f25800 20 remove_watcher() i=2 2024-05-08T18:31:40.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.855+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94686192617728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e04060 con 0x7f415c04c070 2024-05-08T18:31:40.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.856+0000 7f4163c52640 1 -- 172.21.15.87:0/2905978574 <== osd.2 v2:172.21.15.87:6816/2108501615 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94686192617728] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4154077030 con 0x7f415c04c070 2024-05-08T18:31:40.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.856+0000 7f4167f25800 20 remove_watcher() i=3 2024-05-08T18:31:40.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.856+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94686192613024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e01bf0 con 0x561dd8df7780 2024-05-08T18:31:40.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.857+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94686192613024] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415803b040 con 0x561dd8df7780 2024-05-08T18:31:40.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.857+0000 7f4167f25800 20 remove_watcher() i=4 2024-05-08T18:31:40.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.857+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94686192622592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e01bf0 con 0x7f41540a1040 2024-05-08T18:31:40.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.858+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94686192622592] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.858+0000 7f4167f25800 20 remove_watcher() i=5 2024-05-08T18:31:40.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.858+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94686192625088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e05c00 con 0x7f41540a1040 2024-05-08T18:31:40.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.859+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94686192625088] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.859+0000 7f4167f25800 20 remove_watcher() i=6 2024-05-08T18:31:40.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.859+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94686192629600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561dd8e01bf0 con 0x7f41540a1040 2024-05-08T18:31:40.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.860+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94686192629600] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415803b040 con 0x7f41540a1040 2024-05-08T18:31:40.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.860+0000 7f4167f25800 20 remove_watcher() i=7 2024-05-08T18:31:40.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.860+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f41540a1040 msgr2=0x7f4154004600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.860+0000 7f4167f25800 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f41540a1040 0x7f4154004600 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.860+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561dd8df7780 msgr2=0x561dd8df9c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561dd8df7780 0x561dd8df9c40 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f415c04c070 msgr2=0x7f415c03f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f415c04c070 0x7f415c03f930 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561dd8dfda20 msgr2=0x561dd8dffe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561dd8dfda20 0x561dd8dffe30 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f402c03bab0 msgr2=0x7f402c03df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f402c03bab0 0x7f402c03df70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4154051e20 tx=0x7f415408c000 comp rx=0 tx=0).stop 2024-05-08T18:31:40.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8de4650 msgr2=0x561dd8debc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4163451640 1 -- 172.21.15.87:0/2905978574 reap_dead start 2024-05-08T18:31:40.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8de4650 0x561dd8debc70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f415c019fd0 tx=0x7f415c052c80 comp rx=0 tx=0).stop 2024-05-08T18:31:40.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 shutdown_connections 2024-05-08T18:31:40.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 --2- 172.21.15.87:0/2905978574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8de4650 0x561dd8debc70 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 >> 172.21.15.87:0/2905978574 conn(0x561dd8de09b0 msgr2=0x561dd8dde010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 shutdown_connections 2024-05-08T18:31:40.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 -- 172.21.15.87:0/2905978574 wait complete. 2024-05-08T18:31:40.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 -- 172.21.15.87:0/2558510347 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f403c03bd40 msgr2=0x7f403c03e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 --2- 172.21.15.87:0/2558510347 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f403c03bd40 0x7f403c03e200 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x561dd8dc4a10 tx=0x7f4154079ef0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 -- 172.21.15.87:0/2558510347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8dd7350 msgr2=0x561dd8dd7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 --2- 172.21.15.87:0/2558510347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8dd7350 0x561dd8dd7770 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x561dd8dbcd50 tx=0x7f415c00ef30 comp rx=0 tx=0).stop 2024-05-08T18:31:40.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 -- 172.21.15.87:0/2558510347 shutdown_connections 2024-05-08T18:31:40.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 --2- 172.21.15.87:0/2558510347 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f403c03bd40 0x7f403c03e200 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 --2- 172.21.15.87:0/2558510347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8dd7350 0x561dd8dd7770 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 -- 172.21.15.87:0/2558510347 >> 172.21.15.87:0/2558510347 conn(0x561dd8dcb3f0 msgr2=0x561dd8dcb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 -- 172.21.15.87:0/2558510347 shutdown_connections 2024-05-08T18:31:40.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.861+0000 7f4167f25800 1 -- 172.21.15.87:0/2558510347 wait complete. 2024-05-08T18:31:40.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.862+0000 7f4167f25800 1 -- 172.21.15.87:0/804745983 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561dd8dc67c0 msgr2=0x561dd8dc8bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.862+0000 7f4167f25800 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561dd8dc67c0 0x561dd8dc8bb0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.862+0000 7f4167f25800 1 -- 172.21.15.87:0/804745983 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561dd8cc4470 msgr2=0x561dd8dc3170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.862+0000 7f4167f25800 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561dd8cc4470 0x561dd8dc3170 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.862+0000 7f4167f25800 1 -- 172.21.15.87:0/804745983 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f404c03bba0 msgr2=0x7f404c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.862+0000 7f4167f25800 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f404c03bba0 0x7f404c03e060 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4158000c00 tx=0x7f41580013b0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.862+0000 7f4167f25800 1 -- 172.21.15.87:0/804745983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 msgr2=0x561dd8dbbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:31:40.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.862+0000 7f4167f25800 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 0x561dd8dbbf30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f41540526d0 tx=0x7f4154003330 comp rx=0 tx=0).stop 2024-05-08T18:31:40.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.862+0000 7f4167f25800 1 -- 172.21.15.87:0/804745983 shutdown_connections 2024-05-08T18:31:40.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.862+0000 7f4167f25800 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561dd8cc4470 0x561dd8dc3170 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.862+0000 7f4167f25800 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561dd8dc67c0 0x561dd8dc8bb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.862+0000 7f4167f25800 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f404c03bba0 0x7f404c03e060 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.862+0000 7f4167f25800 1 --2- 172.21.15.87:0/804745983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561dd8cc32b0 0x561dd8dbbf30 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:31:40.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.862+0000 7f4167f25800 1 -- 172.21.15.87:0/804745983 >> 172.21.15.87:0/804745983 conn(0x561dd8cbe830 msgr2=0x561dd8dae620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:31:40.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.862+0000 7f4167f25800 1 -- 172.21.15.87:0/804745983 shutdown_connections 2024-05-08T18:31:40.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:31:40.862+0000 7f4167f25800 1 -- 172.21.15.87:0/804745983 wait complete. 2024-05-08T18:31:40.868 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-08T18:31:40.881 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:31:40.886 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-05-08T18:32:15.887 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-05-08T18:32:15.888 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-05-08T18:32:15.888 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-05-08T18:32:15.940 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:32:15.940 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:32:15.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.942+0000 7f21afa16800 1 Processor -- start 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.942+0000 7f21afa16800 1 -- start start 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.943+0000 7f21afa16800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fed4df67e0 0x55fed4df8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.943+0000 7f21afa16800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fed4df9110 con 0x55fed4df2cd0 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.943+0000 7f21afa16800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55fed4c92e20 con 0x55fed4df67e0 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.943+0000 7f21acd0d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fed4df67e0 0x55fed4df8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.943+0000 7f21ad50e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55fed4df2cd0 0x55fed4df50c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:40698/0 (socket says 172.21.15.87:40698) 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.943+0000 7f21acd0d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fed4df67e0 0x55fed4df8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60482/0 (socket says 172.21.15.87:60482) 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.943+0000 7f21ad50e640 1 -- 172.21.15.87:0/2357382778 learned_addr learned my addr 172.21.15.87:0/2357382778 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.943+0000 7f21acd0d640 1 -- 172.21.15.87:0/2357382778 >> v1:172.21.15.53:6789/0 conn(0x55fed4df2cd0 legacy=0x55fed4df50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:15.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.943+0000 7f21acd0d640 1 -- 172.21.15.87:0/2357382778 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed4dfa2f0 con 0x55fed4df67e0 2024-05-08T18:32:15.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.945+0000 7f21acd0d640 1 --2- 172.21.15.87:0/2357382778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df67e0 0x55fed4df8bd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f21a400a470 tx=0x7f21a401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d39f40f1aa4da9d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:15.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.946+0000 7f219ffff640 1 -- 172.21.15.87:0/2357382778 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a4057070 con 0x55fed4df67e0 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.946+0000 7f219ffff640 1 -- 172.21.15.87:0/2357382778 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a4052570 con 0x55fed4df67e0 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.946+0000 7f219ffff640 1 -- 172.21.15.87:0/2357382778 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a4052870 con 0x55fed4df67e0 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.946+0000 7f21afa16800 1 -- 172.21.15.87:0/2357382778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df67e0 msgr2=0x55fed4df8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.946+0000 7f21afa16800 1 --2- 172.21.15.87:0/2357382778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df67e0 0x55fed4df8bd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f21a400a470 tx=0x7f21a401ce90 comp rx=0 tx=0).stop 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.946+0000 7f21afa16800 1 -- 172.21.15.87:0/2357382778 shutdown_connections 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.946+0000 7f21afa16800 1 --2- 172.21.15.87:0/2357382778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df67e0 0x55fed4df8bd0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.946+0000 7f21afa16800 1 -- 172.21.15.87:0/2357382778 >> 172.21.15.87:0/2357382778 conn(0x55fed4dec720 msgr2=0x55fed4deeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.946+0000 7f21afa16800 1 -- 172.21.15.87:0/2357382778 shutdown_connections 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.946+0000 7f21afa16800 1 -- 172.21.15.87:0/2357382778 wait complete. 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.962+0000 7f21afa16800 1 Processor -- start 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.962+0000 7f21afa16800 1 -- start start 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.962+0000 7f21afa16800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2cd0 0x55fed4ee36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.962+0000 7f21afa16800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fed4d3d5b0 con 0x55fed4df2cd0 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.963+0000 7f21ad50e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2cd0 0x55fed4ee36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.963+0000 7f21ad50e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2cd0 0x55fed4ee36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60496/0 (socket says 172.21.15.87:60496) 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.963+0000 7f21ad50e640 1 -- 172.21.15.87:0/2568506298 learned_addr learned my addr 172.21.15.87:0/2568506298 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.963+0000 7f21ad50e640 1 -- 172.21.15.87:0/2568506298 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed4ee3c90 con 0x55fed4df2cd0 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.963+0000 7f21ad50e640 1 --2- 172.21.15.87:0/2568506298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2cd0 0x55fed4ee36c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f21a00017a0 tx=0x7f21a0001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd1d9b96d16d17 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.963+0000 7f209b606640 1 -- 172.21.15.87:0/2568506298 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a0004520 con 0x55fed4df2cd0 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.963+0000 7f209b606640 1 -- 172.21.15.87:0/2568506298 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a00046c0 con 0x55fed4df2cd0 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.963+0000 7f209b606640 1 -- 172.21.15.87:0/2568506298 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a0004a00 con 0x55fed4df2cd0 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.964+0000 7f21afa16800 1 -- 172.21.15.87:0/2568506298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2cd0 msgr2=0x55fed4ee36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.964+0000 7f21afa16800 1 --2- 172.21.15.87:0/2568506298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2cd0 0x55fed4ee36c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f21a00017a0 tx=0x7f21a0001c60 comp rx=0 tx=0).stop 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.964+0000 7f21afa16800 1 -- 172.21.15.87:0/2568506298 shutdown_connections 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.964+0000 7f21afa16800 1 --2- 172.21.15.87:0/2568506298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2cd0 0x55fed4ee36c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.964+0000 7f21afa16800 1 -- 172.21.15.87:0/2568506298 >> 172.21.15.87:0/2568506298 conn(0x55fed4dec720 msgr2=0x55fed4edefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.964+0000 7f21afa16800 1 -- 172.21.15.87:0/2568506298 shutdown_connections 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.964+0000 7f21afa16800 1 -- 172.21.15.87:0/2568506298 wait complete. 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.964+0000 7f21afa16800 1 Processor -- start 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.964+0000 7f21afa16800 1 -- start start 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.965+0000 7f21afa16800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2cd0 0x55fed4eeb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.965+0000 7f21afa16800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fed4df95e0 con 0x55fed4df2cd0 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.965+0000 7f21ad50e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2cd0 0x55fed4eeb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.965+0000 7f21ad50e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2cd0 0x55fed4eeb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60498/0 (socket says 172.21.15.87:60498) 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.965+0000 7f21ad50e640 1 -- 172.21.15.87:0/1129967665 learned_addr learned my addr 172.21.15.87:0/1129967665 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.965+0000 7f21ad50e640 1 -- 172.21.15.87:0/1129967665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed4eeb780 con 0x55fed4df2cd0 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.965+0000 7f21ad50e640 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2cd0 0x55fed4eeb240 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f21a0000f80 tx=0x7f21a0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.966+0000 7f2099e03640 1 -- 172.21.15.87:0/1129967665 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a0022020 con 0x55fed4df2cd0 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.966+0000 7f2099e03640 1 -- 172.21.15.87:0/1129967665 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a0014980 con 0x55fed4df2cd0 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.966+0000 7f2099e03640 1 -- 172.21.15.87:0/1129967665 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a0014d00 con 0x55fed4df2cd0 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.966+0000 7f21afa16800 1 -- 172.21.15.87:0/1129967665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fed4eeba10 con 0x55fed4df2cd0 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.966+0000 7f21afa16800 1 -- 172.21.15.87:0/1129967665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fed4eee6c0 con 0x55fed4df2cd0 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.967+0000 7f2099e03640 1 -- 172.21.15.87:0/1129967665 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f21a0025020 con 0x55fed4df2cd0 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.967+0000 7f2099e03640 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f209403bba0 0x7f209403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.967+0000 7f2099e03640 1 -- 172.21.15.87:0/1129967665 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f21a0018030 con 0x55fed4df2cd0 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.967+0000 7f21acd0d640 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f209403bba0 0x7f209403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.967+0000 7f21afa16800 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fed4df67e0 0x55fed4ef2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.967+0000 7f21afa16800 1 -- 172.21.15.87:0/1129967665 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4ef2a10 con 0x55fed4df67e0 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.967+0000 7f21add0f640 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fed4df67e0 0x55fed4ef2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.967+0000 7f21acd0d640 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f209403bba0 0x7f209403e060 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f21a4054000 tx=0x7f21a404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:15.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.967+0000 7f21add0f640 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fed4df67e0 0x55fed4ef2480 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:15.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.968+0000 7f21add0f640 1 -- 172.21.15.87:0/1129967665 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21a80083e0 con 0x55fed4df67e0 2024-05-08T18:32:15.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.968+0000 7f21afa16800 1 -- 172.21.15.87:0/1129967665 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4eefa30 con 0x55fed4df67e0 2024-05-08T18:32:15.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.968+0000 7f21add0f640 1 -- 172.21.15.87:0/1129967665 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f21a80083e0 con 0x55fed4df67e0 2024-05-08T18:32:15.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.968+0000 7f21afa16800 1 -- 172.21.15.87:0/1129967665 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4ef4810 con 0x55fed4df67e0 2024-05-08T18:32:15.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.968+0000 7f21add0f640 1 -- 172.21.15.87:0/1129967665 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f21a80083e0 con 0x55fed4df67e0 2024-05-08T18:32:15.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.968+0000 7f21afa16800 1 -- 172.21.15.87:0/1129967665 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4ef3a40 con 0x55fed4df67e0 2024-05-08T18:32:15.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.969+0000 7f21add0f640 1 -- 172.21.15.87:0/1129967665 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f21a80083e0 con 0x55fed4df67e0 2024-05-08T18:32:15.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.969+0000 7f21afa16800 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55fed4ef5bc0 0x55fed4ef7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:15.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.969+0000 7f21afa16800 1 -- 172.21.15.87:0/1129967665 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4ef84f0 con 0x55fed4ef5bc0 2024-05-08T18:32:15.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.969+0000 7f21ad50e640 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55fed4ef5bc0 0x55fed4ef7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:15.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.969+0000 7f21ad50e640 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55fed4ef5bc0 0x55fed4ef7fb0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:15.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.970+0000 7f21ad50e640 1 -- 172.21.15.87:0/1129967665 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f21a001b070 con 0x55fed4ef5bc0 2024-05-08T18:32:15.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.970+0000 7f21afa16800 1 Processor -- start 2024-05-08T18:32:15.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.970+0000 7f21afa16800 1 -- start start 2024-05-08T18:32:15.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.970+0000 7f21afa16800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2870 0x55fed4df0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:15.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.970+0000 7f21afa16800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fed4ce3fc0 con 0x55fed4df2870 2024-05-08T18:32:15.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.971+0000 7f21add0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2870 0x55fed4df0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:15.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.971+0000 7f21add0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2870 0x55fed4df0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60512/0 (socket says 172.21.15.87:60512) 2024-05-08T18:32:15.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.971+0000 7f21add0f640 1 -- 172.21.15.87:0/1931620632 learned_addr learned my addr 172.21.15.87:0/1931620632 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.971+0000 7f21add0f640 1 -- 172.21.15.87:0/1931620632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed4df1220 con 0x55fed4df2870 2024-05-08T18:32:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.971+0000 7f21add0f640 1 --2- 172.21.15.87:0/1931620632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2870 0x55fed4df0ce0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x55fed4eec110 tx=0x7f21a800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.971+0000 7f2092ffd640 1 -- 172.21.15.87:0/1931620632 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a801c070 con 0x55fed4df2870 2024-05-08T18:32:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.971+0000 7f2092ffd640 1 -- 172.21.15.87:0/1931620632 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a8018410 con 0x55fed4df2870 2024-05-08T18:32:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.971+0000 7f21afa16800 1 -- 172.21.15.87:0/1931620632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fed4df14b0 con 0x55fed4df2870 2024-05-08T18:32:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.971+0000 7f2092ffd640 1 -- 172.21.15.87:0/1931620632 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a8018730 con 0x55fed4df2870 2024-05-08T18:32:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.971+0000 7f21afa16800 1 -- 172.21.15.87:0/1931620632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fed4df19b0 con 0x55fed4df2870 2024-05-08T18:32:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.972+0000 7f2092ffd640 1 -- 172.21.15.87:0/1931620632 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f21a801f070 con 0x55fed4df2870 2024-05-08T18:32:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.972+0000 7f2092ffd640 1 --2- 172.21.15.87:0/1931620632 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f208803bb50 0x7f208803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.972+0000 7f2092ffd640 1 -- 172.21.15.87:0/1931620632 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f21a8054750 con 0x55fed4df2870 2024-05-08T18:32:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.973+0000 7f21ad50e640 1 --2- 172.21.15.87:0/1931620632 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f208803bb50 0x7f208803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.973+0000 7f21afa16800 1 Processor -- start 2024-05-08T18:32:15.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.973+0000 7f21afa16800 1 -- start start 2024-05-08T18:32:15.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.973+0000 7f21ad50e640 1 --2- 172.21.15.87:0/1931620632 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f208803bb50 0x7f208803e010 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f21a001ffd0 tx=0x7f21a004c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:15.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.973+0000 7f21afa16800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4f15d00 0x55fed4f16120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:15.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.973+0000 7f21afa16800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fed4ee4010 con 0x55fed4f15d00 2024-05-08T18:32:15.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.973+0000 7f21add0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4f15d00 0x55fed4f16120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:15.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.973+0000 7f21add0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4f15d00 0x55fed4f16120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60524/0 (socket says 172.21.15.87:60524) 2024-05-08T18:32:15.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.973+0000 7f21add0f640 1 -- 172.21.15.87:0/3102857230 learned_addr learned my addr 172.21.15.87:0/3102857230 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:15.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.974+0000 7f21add0f640 1 -- 172.21.15.87:0/3102857230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed4f166f0 con 0x55fed4f15d00 2024-05-08T18:32:15.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.974+0000 7f21add0f640 1 --2- 172.21.15.87:0/3102857230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4f15d00 0x55fed4f16120 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f21a8014fd0 tx=0x7f21a8052b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938e8a4817f933b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:15.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.974+0000 7f2090ff9640 1 -- 172.21.15.87:0/3102857230 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a8014bb0 con 0x55fed4f15d00 2024-05-08T18:32:15.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.974+0000 7f2090ff9640 1 -- 172.21.15.87:0/3102857230 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a8007c20 con 0x55fed4f15d00 2024-05-08T18:32:15.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.974+0000 7f2090ff9640 1 -- 172.21.15.87:0/3102857230 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a8017720 con 0x55fed4f15d00 2024-05-08T18:32:15.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.974+0000 7f21afa16800 1 -- 172.21.15.87:0/3102857230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4f15d00 msgr2=0x55fed4f16120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:15.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.974+0000 7f21afa16800 1 --2- 172.21.15.87:0/3102857230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4f15d00 0x55fed4f16120 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f21a8014fd0 tx=0x7f21a8052b20 comp rx=0 tx=0).stop 2024-05-08T18:32:15.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.974+0000 7f21afa16800 1 -- 172.21.15.87:0/3102857230 shutdown_connections 2024-05-08T18:32:15.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.974+0000 7f21afa16800 1 --2- 172.21.15.87:0/3102857230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4f15d00 0x55fed4f16120 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:15.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.974+0000 7f21afa16800 1 -- 172.21.15.87:0/3102857230 >> 172.21.15.87:0/3102857230 conn(0x55fed4f12060 msgr2=0x55fed4f100c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:15.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.974+0000 7f21afa16800 1 -- 172.21.15.87:0/3102857230 shutdown_connections 2024-05-08T18:32:15.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.974+0000 7f21afa16800 1 -- 172.21.15.87:0/3102857230 wait complete. 2024-05-08T18:32:15.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.975+0000 7f21afa16800 1 Processor -- start 2024-05-08T18:32:15.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.975+0000 7f21afa16800 1 -- start start 2024-05-08T18:32:15.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.975+0000 7f21afa16800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4f15d00 0x55fed4f1d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.975+0000 7f21afa16800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fed4f16e60 con 0x55fed4f15d00 2024-05-08T18:32:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.975+0000 7f21add0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4f15d00 0x55fed4f1d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.975+0000 7f21add0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4f15d00 0x55fed4f1d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60536/0 (socket says 172.21.15.87:60536) 2024-05-08T18:32:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.975+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 learned_addr learned my addr 172.21.15.87:0/3624264726 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.975+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed4f1d800 con 0x55fed4f15d00 2024-05-08T18:32:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.976+0000 7f21add0f640 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4f15d00 0x55fed4f1d2c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f21a8014fd0 tx=0x7f21a8052970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.976+0000 7f207effd640 1 -- 172.21.15.87:0/3624264726 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a8049040 con 0x55fed4f15d00 2024-05-08T18:32:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.976+0000 7f207effd640 1 -- 172.21.15.87:0/3624264726 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a802f030 con 0x55fed4f15d00 2024-05-08T18:32:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.976+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fed4f1da90 con 0x55fed4f15d00 2024-05-08T18:32:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.976+0000 7f207effd640 1 -- 172.21.15.87:0/3624264726 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a8051550 con 0x55fed4f15d00 2024-05-08T18:32:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.976+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fed4f20740 con 0x55fed4f15d00 2024-05-08T18:32:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.977+0000 7f207effd640 1 -- 172.21.15.87:0/3624264726 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f21a80189a0 con 0x55fed4f15d00 2024-05-08T18:32:15.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.977+0000 7f207effd640 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f207803bb00 0x7f207803dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:15.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.977+0000 7f207effd640 1 -- 172.21.15.87:0/3624264726 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f21a8035d40 con 0x55fed4f15d00 2024-05-08T18:32:15.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.977+0000 7f21ad50e640 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f207803bb00 0x7f207803dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:15.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.977+0000 7f21afa16800 20 rados->read ofs=0 len=0 2024-05-08T18:32:15.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.977+0000 7f21afa16800 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fed4f28de0 0x55fed4f2b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:15.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.977+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f2b9f0 con 0x55fed4f28de0 2024-05-08T18:32:15.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.978+0000 7f21acd0d640 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fed4f28de0 0x55fed4f2b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:15.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.978+0000 7f21ad50e640 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f207803bb00 0x7f207803dfc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f21a001efd0 tx=0x7f21a004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:15.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.978+0000 7f21acd0d640 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fed4f28de0 0x55fed4f2b2a0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:15.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.978+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:15.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.978+0000 7f21afa16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:15.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.978+0000 7f21afa16800 20 realm 2024-05-08T18:32:15.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.978+0000 7f21afa16800 20 rados->read ofs=0 len=0 2024-05-08T18:32:15.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.978+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f2bdc0 con 0x55fed4f28de0 2024-05-08T18:32:15.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.978+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:15.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.978+0000 7f21afa16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:15.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.978+0000 7f21afa16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:32:15.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.978+0000 7f21afa16800 20 rados->read ofs=0 len=0 2024-05-08T18:32:15.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.978+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f2c690 con 0x55fed4f28de0 2024-05-08T18:32:15.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.979+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:15.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.979+0000 7f21afa16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:15.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.979+0000 7f21afa16800 20 rados->read ofs=0 len=0 2024-05-08T18:32:15.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.979+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f2ca30 con 0x55fed4f28de0 2024-05-08T18:32:15.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.979+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:15.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.979+0000 7f21afa16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:15.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.979+0000 7f21afa16800 20 rados->read ofs=0 len=0 2024-05-08T18:32:15.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.979+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f2ce50 con 0x55fed4f28de0 2024-05-08T18:32:15.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.979+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:15.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.979+0000 7f21afa16800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:32:15.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.979+0000 7f21afa16800 20 searching for the correct realm 2024-05-08T18:32:15.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.979+0000 7f21afa16800 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55fed4f2ee50 0x55fed4f312a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:15.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.979+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x55fed4f2ee50 2024-05-08T18:32:15.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.980+0000 7f21add0f640 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55fed4f2ee50 0x55fed4f312a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:15.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.980+0000 7f21add0f640 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55fed4f2ee50 0x55fed4f312a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:15.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.980+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a803b070 con 0x55fed4f2ee50 2024-05-08T18:32:15.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.980+0000 7f21add0f640 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f21a8021070 0x7f21a8021450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:15.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.980+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x7f21a8021070 2024-05-08T18:32:15.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.980+0000 7f21ad50e640 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f21a8021070 0x7f21a8021450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:15.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.981+0000 7f21ad50e640 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f21a8021070 0x7f21a8021450 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:15.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.981+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a001b070 con 0x7f21a8021070 2024-05-08T18:32:15.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.981+0000 7f21ad50e640 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f21a0027020 0x7f21a003e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:15.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.981+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x7f21a0027020 2024-05-08T18:32:15.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.981+0000 7f21acd0d640 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f21a0027020 0x7f21a003e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:15.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.982+0000 7f21acd0d640 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f21a0027020 0x7f21a003e3b0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:15.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.982+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:15.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.982+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x55fed4f28de0 2024-05-08T18:32:15.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.982+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:15.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.982+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x55fed4f28de0 2024-05-08T18:32:15.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.983+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:15.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.983+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x7f21a0027020 2024-05-08T18:32:15.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.983+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:15.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.983+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x7f21a0027020 2024-05-08T18:32:16.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.983+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.983+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x7f21a8021070 2024-05-08T18:32:16.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.984+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a001b070 con 0x7f21a8021070 2024-05-08T18:32:16.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.984+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x55fed4f2ee50 2024-05-08T18:32:16.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.984+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a803b070 con 0x55fed4f2ee50 2024-05-08T18:32:16.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.984+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x55fed4f28de0 2024-05-08T18:32:16.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.984+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.984+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x7f21a0027020 2024-05-08T18:32:16.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.984+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.984+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x55fed4f28de0 2024-05-08T18:32:16.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.985+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.985+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x7f21a8021070 2024-05-08T18:32:16.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.985+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f21a001b070 con 0x7f21a8021070 2024-05-08T18:32:16.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.985+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x55fed4f2ee50 2024-05-08T18:32:16.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.985+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.985+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x55fed4f2ee50 2024-05-08T18:32:16.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.985+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.985+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x7f21a0027020 2024-05-08T18:32:16.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.986+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.986+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x55fed4f2ee50 2024-05-08T18:32:16.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.986+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.986+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x55fed4f2ee50 2024-05-08T18:32:16.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.986+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.986+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x55fed4f28de0 2024-05-08T18:32:16.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.987+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.987+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x55fed4f28de0 2024-05-08T18:32:16.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.987+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.987+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x7f21a0027020 2024-05-08T18:32:16.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.987+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.987+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x55fed4f2ee50 2024-05-08T18:32:16.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.987+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.987+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x7f21a8021070 2024-05-08T18:32:16.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.988+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a001b070 con 0x7f21a8021070 2024-05-08T18:32:16.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.988+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x55fed4f28de0 2024-05-08T18:32:16.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.988+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.988+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x7f21a0027020 2024-05-08T18:32:16.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.988+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.988+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x55fed4f2ee50 2024-05-08T18:32:16.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.989+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.989+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x7f21a8021070 2024-05-08T18:32:16.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.989+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a001b070 con 0x7f21a8021070 2024-05-08T18:32:16.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.989+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x7f21a8021070 2024-05-08T18:32:16.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.989+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a001b070 con 0x7f21a8021070 2024-05-08T18:32:16.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.989+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x55fed4f2ee50 2024-05-08T18:32:16.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.989+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.989+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x7f21a8021070 2024-05-08T18:32:16.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.990+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a001b070 con 0x7f21a8021070 2024-05-08T18:32:16.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.990+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x55fed4f28de0 2024-05-08T18:32:16.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.990+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.990+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31970 con 0x7f21a8021070 2024-05-08T18:32:16.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.990+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a001b070 con 0x7f21a8021070 2024-05-08T18:32:16.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.990+0000 7f21afa16800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:32:16.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.990+0000 7f21afa16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:32:16.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.990+0000 7f21afa16800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:32:16.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.990+0000 7f21afa16800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:32:16.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.990+0000 7f21afa16800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:32:16.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.990+0000 7f21afa16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:32:16.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.990+0000 7f21afa16800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.990+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f2d920 con 0x55fed4f28de0 2024-05-08T18:32:16.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.990+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.990+0000 7f21afa16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.990+0000 7f21afa16800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.991+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f2e1c0 con 0x55fed4f28de0 2024-05-08T18:32:16.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.991+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.991+0000 7f21afa16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:16.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.991+0000 7f21afa16800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.991+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f2d560 con 0x7f21a0027020 2024-05-08T18:32:16.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.991+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.991+0000 7f21afa16800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:32:16.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.991+0000 7f21afa16800 20 zone default found 2024-05-08T18:32:16.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.991+0000 7f21afa16800 4 Realm: () 2024-05-08T18:32:16.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.991+0000 7f21afa16800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:32:16.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.991+0000 7f21afa16800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:32:16.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.991+0000 7f21afa16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:32:16.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.991+0000 7f21afa16800 20 zonegroup default 2024-05-08T18:32:16.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.991+0000 7f21afa16800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.991+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f31e40 con 0x7f21a0027020 2024-05-08T18:32:16.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.992+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.992+0000 7f21afa16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.992+0000 7f21afa16800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.992+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f33cd0 con 0x55fed4f2ee50 2024-05-08T18:32:16.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.992+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.992+0000 7f21afa16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.992+0000 7f21afa16800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.992+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f34070 con 0x55fed4f2ee50 2024-05-08T18:32:16.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.992+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.992+0000 7f21afa16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.992+0000 7f21afa16800 20 started sync module instance, tier type = 2024-05-08T18:32:16.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.992+0000 7f21afa16800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:32:16.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.992+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f33160 con 0x7f21a8021070 2024-05-08T18:32:16.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.993+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a001b070 con 0x7f21a8021070 2024-05-08T18:32:16.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.993+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94552982762832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f32dc0 con 0x7f21a8021070 2024-05-08T18:32:16.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.993+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f34ee0 con 0x55fed4f28de0 2024-05-08T18:32:16.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.995+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94552982762832] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a001b070 con 0x7f21a8021070 2024-05-08T18:32:16.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.995+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.995+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94552982768176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f35300 con 0x55fed4f28de0 2024-05-08T18:32:16.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.995+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f35cc0 con 0x55fed4f2ee50 2024-05-08T18:32:16.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.996+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94552982768176] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.996+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.996+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94552982772208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f35300 con 0x55fed4f2ee50 2024-05-08T18:32:16.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.996+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f36800 con 0x7f21a8021070 2024-05-08T18:32:16.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.997+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a001b070 con 0x7f21a8021070 2024-05-08T18:32:16.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.997+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94552982772208] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.998+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94552982774480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f370a0 con 0x7f21a8021070 2024-05-08T18:32:16.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.998+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f34e70 con 0x55fed4f28de0 2024-05-08T18:32:16.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.999+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94552982774480] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a001b070 con 0x7f21a8021070 2024-05-08T18:32:16.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.999+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.999+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94552982776816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f37b10 con 0x55fed4f28de0 2024-05-08T18:32:16.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:15.999+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f384d0 con 0x7f21a0027020 2024-05-08T18:32:16.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.000+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94552982776816] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.000+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.000+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94552982780000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f384d0 con 0x7f21a0027020 2024-05-08T18:32:16.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.000+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f38e90 con 0x7f21a0027020 2024-05-08T18:32:16.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.001+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94552982780000] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.001+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.001+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94552982782464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f38e90 con 0x7f21a0027020 2024-05-08T18:32:16.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.001+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f39850 con 0x7f21a0027020 2024-05-08T18:32:16.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.003+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94552982782464] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.003+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.003+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94552982784480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f39a30 con 0x7f21a0027020 2024-05-08T18:32:16.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.003+0000 7f21afa16800 20 add_watcher() i=0 2024-05-08T18:32:16.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.003+0000 7f21afa16800 20 add_watcher() i=1 2024-05-08T18:32:16.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.003+0000 7f21afa16800 20 add_watcher() i=2 2024-05-08T18:32:16.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.003+0000 7f21afa16800 20 add_watcher() i=3 2024-05-08T18:32:16.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.003+0000 7f21afa16800 20 add_watcher() i=4 2024-05-08T18:32:16.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.003+0000 7f21afa16800 20 add_watcher() i=5 2024-05-08T18:32:16.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.003+0000 7f21afa16800 20 add_watcher() i=6 2024-05-08T18:32:16.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.004+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94552982784480] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.004+0000 7f21afa16800 20 add_watcher() i=7 2024-05-08T18:32:16.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.004+0000 7f21afa16800 2 all 8 watchers are set, enabling cache 2024-05-08T18:32:16.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.004+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f3cbe0 con 0x55fed4f28de0 2024-05-08T18:32:16.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.004+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.004+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94552982799728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f39980 con 0x55fed4f28de0 2024-05-08T18:32:16.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.005+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94552982799728] v29'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.005+0000 7f2063fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:16.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.005+0000 7f21afa16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:32:16.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.005+0000 7f21afa16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:32:16.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.005+0000 7f21afa16800 5 note: GC not initialized 2024-05-08T18:32:16.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.006+0000 7f2062fe5640 20 reqs_thread_entry: start 2024-05-08T18:32:16.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.006+0000 7f21afa16800 20 init_complete bucket index max shards: 11 2024-05-08T18:32:16.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.006+0000 7f21afa16800 20 Filter name: none 2024-05-08T18:32:16.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.006+0000 7f2060fe1640 20 reqs_thread_entry: start 2024-05-08T18:32:16.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.006+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f70650 con 0x55fed4f28de0 2024-05-08T18:32:16.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.006+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.006+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f70650 con 0x7f21a8021070 2024-05-08T18:32:16.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.006+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f21a001b070 con 0x7f21a8021070 2024-05-08T18:32:16.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.007+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f70610 con 0x55fed4f28de0 2024-05-08T18:32:16.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.007+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.007+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f70610 con 0x55fed4f2ee50 2024-05-08T18:32:16.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.007+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.007+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f70610 con 0x55fed4f2ee50 2024-05-08T18:32:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.007+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.007+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f70610 con 0x55fed4f2ee50 2024-05-08T18:32:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.007+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.007+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f70610 con 0x55fed4f28de0 2024-05-08T18:32:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.008+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.008+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f70610 con 0x55fed4f28de0 2024-05-08T18:32:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.008+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.008+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f70610 con 0x55fed4f2ee50 2024-05-08T18:32:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.008+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.008+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f70610 con 0x55fed4f2ee50 2024-05-08T18:32:16.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.008+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.008+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f70610 con 0x7f21a0027020 2024-05-08T18:32:16.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.009+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.009+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72070 con 0x55fed4f28de0 2024-05-08T18:32:16.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.009+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.009+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72070 con 0x7f21a8021070 2024-05-08T18:32:16.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.010+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a001b070 con 0x7f21a8021070 2024-05-08T18:32:16.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.010+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72070 con 0x55fed4f2ee50 2024-05-08T18:32:16.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.010+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.010+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72070 con 0x7f21a0027020 2024-05-08T18:32:16.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.010+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.010+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72050 con 0x7f21a0027020 2024-05-08T18:32:16.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.011+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.011+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72050 con 0x55fed4f2ee50 2024-05-08T18:32:16.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.011+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.011+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72050 con 0x7f21a0027020 2024-05-08T18:32:16.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.011+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.011+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72000 con 0x55fed4f28de0 2024-05-08T18:32:16.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.011+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.011+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72000 con 0x55fed4f2ee50 2024-05-08T18:32:16.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.012+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.012+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72000 con 0x7f21a0027020 2024-05-08T18:32:16.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.012+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.012+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72000 con 0x7f21a8021070 2024-05-08T18:32:16.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.012+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a001b070 con 0x7f21a8021070 2024-05-08T18:32:16.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.012+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72000 con 0x7f21a0027020 2024-05-08T18:32:16.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.013+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.013+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72000 con 0x55fed4f28de0 2024-05-08T18:32:16.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.013+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.013+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72000 con 0x55fed4f28de0 2024-05-08T18:32:16.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.013+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.013+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72000 con 0x55fed4f2ee50 2024-05-08T18:32:16.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.013+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.013+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72000 con 0x55fed4f28de0 2024-05-08T18:32:16.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.013+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.013+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72000 con 0x55fed4f28de0 2024-05-08T18:32:16.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.014+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.014+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72000 con 0x55fed4f2ee50 2024-05-08T18:32:16.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.014+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.014+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72000 con 0x55fed4f2ee50 2024-05-08T18:32:16.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.014+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.014+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72000 con 0x55fed4f2ee50 2024-05-08T18:32:16.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.014+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.014+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f72000 con 0x7f21a0027020 2024-05-08T18:32:16.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.015+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.015+0000 7f2063fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:16.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.015+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94552982799728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f6e330 con 0x55fed4f28de0 2024-05-08T18:32:16.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.016+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94552982799728] v29'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.016+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94552982762832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f71cd0 con 0x7f21a8021070 2024-05-08T18:32:16.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.017+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94552982762832] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a001b070 con 0x7f21a8021070 2024-05-08T18:32:16.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.017+0000 7f21afa16800 20 remove_watcher() i=0 2024-05-08T18:32:16.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.017+0000 7f21afa16800 2 removed watcher, disabling cache 2024-05-08T18:32:16.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.017+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94552982768176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f33550 con 0x55fed4f28de0 2024-05-08T18:32:16.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.019+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94552982768176] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.019+0000 7f21afa16800 20 remove_watcher() i=1 2024-05-08T18:32:16.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.019+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94552982772208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f33550 con 0x55fed4f2ee50 2024-05-08T18:32:16.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.020+0000 7f21add0f640 1 -- 172.21.15.87:0/3624264726 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94552982772208] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a8061040 con 0x55fed4f2ee50 2024-05-08T18:32:16.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.020+0000 7f21afa16800 20 remove_watcher() i=2 2024-05-08T18:32:16.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.020+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94552982774480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f359f0 con 0x7f21a8021070 2024-05-08T18:32:16.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.021+0000 7f21ad50e640 1 -- 172.21.15.87:0/3624264726 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94552982774480] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a001b070 con 0x7f21a8021070 2024-05-08T18:32:16.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.021+0000 7f21afa16800 20 remove_watcher() i=3 2024-05-08T18:32:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.021+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94552982776816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f33550 con 0x55fed4f28de0 2024-05-08T18:32:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.022+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.1 v2:172.21.15.87:6808/2448644045 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94552982776816] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x55fed4f28de0 2024-05-08T18:32:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.022+0000 7f21afa16800 20 remove_watcher() i=4 2024-05-08T18:32:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.022+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94552982780000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f359f0 con 0x7f21a0027020 2024-05-08T18:32:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.023+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94552982780000] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.023+0000 7f21afa16800 20 remove_watcher() i=5 2024-05-08T18:32:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.023+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94552982782464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f36bf0 con 0x7f21a0027020 2024-05-08T18:32:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.024+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94552982782464] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.024+0000 7f21afa16800 20 remove_watcher() i=6 2024-05-08T18:32:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.024+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94552982784480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed4f33550 con 0x7f21a0027020 2024-05-08T18:32:16.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.025+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94552982784480] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a405a040 con 0x7f21a0027020 2024-05-08T18:32:16.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.025+0000 7f21afa16800 20 remove_watcher() i=7 2024-05-08T18:32:16.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.025+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f21a0027020 msgr2=0x7f21a003e3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.025+0000 7f21afa16800 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f21a0027020 0x7f21a003e3b0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fed4f28de0 msgr2=0x55fed4f2b2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fed4f28de0 0x55fed4f2b2a0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f21a8021070 msgr2=0x7f21a8021450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f21a8021070 0x7f21a8021450 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55fed4f2ee50 msgr2=0x55fed4f312a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55fed4f2ee50 0x55fed4f312a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f207803bb00 msgr2=0x7f207803dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f207803bb00 0x7f207803dfc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f21a001efd0 tx=0x7f21a004e000 comp rx=0 tx=0).stop 2024-05-08T18:32:16.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4f15d00 msgr2=0x55fed4f1d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 --2- 172.21.15.87:0/3624264726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4f15d00 0x55fed4f1d2c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f21a8014fd0 tx=0x7f21a8052970 comp rx=0 tx=0).stop 2024-05-08T18:32:16.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 reap_dead start 2024-05-08T18:32:16.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21acd0d640 1 -- 172.21.15.87:0/3624264726 reap_dead start 2024-05-08T18:32:16.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 shutdown_connections 2024-05-08T18:32:16.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 >> 172.21.15.87:0/3624264726 conn(0x55fed4f12060 msgr2=0x55fed4f0f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 shutdown_connections 2024-05-08T18:32:16.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 -- 172.21.15.87:0/3624264726 wait complete. 2024-05-08T18:32:16.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 -- 172.21.15.87:0/1931620632 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f208803bb50 msgr2=0x7f208803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 --2- 172.21.15.87:0/1931620632 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f208803bb50 0x7f208803e010 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f21a001ffd0 tx=0x7f21a004c040 comp rx=0 tx=0).stop 2024-05-08T18:32:16.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 -- 172.21.15.87:0/1931620632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2870 msgr2=0x55fed4df0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 --2- 172.21.15.87:0/1931620632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2870 0x55fed4df0ce0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x55fed4eec110 tx=0x7f21a800ef30 comp rx=0 tx=0).stop 2024-05-08T18:32:16.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 -- 172.21.15.87:0/1931620632 shutdown_connections 2024-05-08T18:32:16.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 --2- 172.21.15.87:0/1931620632 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f208803bb50 0x7f208803e010 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 --2- 172.21.15.87:0/1931620632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2870 0x55fed4df0ce0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 -- 172.21.15.87:0/1931620632 >> 172.21.15.87:0/1931620632 conn(0x55fed4efa810 msgr2=0x55fed4efac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 -- 172.21.15.87:0/1931620632 shutdown_connections 2024-05-08T18:32:16.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 -- 172.21.15.87:0/1931620632 wait complete. 2024-05-08T18:32:16.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 -- 172.21.15.87:0/1129967665 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55fed4ef5bc0 msgr2=0x55fed4ef7fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.026+0000 7f21afa16800 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55fed4ef5bc0 0x55fed4ef7fb0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.027+0000 7f21afa16800 1 -- 172.21.15.87:0/1129967665 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fed4df67e0 msgr2=0x55fed4ef2480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.027+0000 7f21afa16800 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fed4df67e0 0x55fed4ef2480 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.027+0000 7f21afa16800 1 -- 172.21.15.87:0/1129967665 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f209403bba0 msgr2=0x7f209403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.027+0000 7f21afa16800 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f209403bba0 0x7f209403e060 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f21a4054000 tx=0x7f21a404e000 comp rx=0 tx=0).stop 2024-05-08T18:32:16.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.027+0000 7f21afa16800 1 -- 172.21.15.87:0/1129967665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2cd0 msgr2=0x55fed4eeb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.027+0000 7f21afa16800 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2cd0 0x55fed4eeb240 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f21a0000f80 tx=0x7f21a0001250 comp rx=0 tx=0).stop 2024-05-08T18:32:16.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.027+0000 7f21afa16800 1 -- 172.21.15.87:0/1129967665 shutdown_connections 2024-05-08T18:32:16.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.027+0000 7f21afa16800 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55fed4df67e0 0x55fed4ef2480 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.027+0000 7f21afa16800 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55fed4ef5bc0 0x55fed4ef7fb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.027+0000 7f21afa16800 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f209403bba0 0x7f209403e060 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.027+0000 7f21afa16800 1 --2- 172.21.15.87:0/1129967665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fed4df2cd0 0x55fed4eeb240 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.027+0000 7f21afa16800 1 -- 172.21.15.87:0/1129967665 >> 172.21.15.87:0/1129967665 conn(0x55fed4dec720 msgr2=0x55fed4edd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.027+0000 7f21afa16800 1 -- 172.21.15.87:0/1129967665 shutdown_connections 2024-05-08T18:32:16.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.027+0000 7f21afa16800 1 -- 172.21.15.87:0/1129967665 wait complete. 2024-05-08T18:32:16.048 INFO:teuthology.orchestra.run.smithi087.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:32:16.048 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:32:16.048 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-05-08T18:32:16.048 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-05-08T18:32:16.049 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-05-08T18:32:16.091 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:32:16.091 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:32:16.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.094+0000 7f9cd4d2b800 1 Processor -- start 2024-05-08T18:32:16.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.094+0000 7f9cd4d2b800 1 -- start start 2024-05-08T18:32:16.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.094+0000 7f9cd4d2b800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562eaa72d540 0x562eaa72fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.094+0000 7f9cd4d2b800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562eaa7300b0 con 0x562eaa69c480 2024-05-08T18:32:16.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.094+0000 7f9cd4d2b800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x562eaa5c9e20 con 0x562eaa72d540 2024-05-08T18:32:16.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.094+0000 7f9ccbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562eaa72d540 0x562eaa72fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.094+0000 7f9cd094b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x562eaa69c480 0x562eaa72bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:40712/0 (socket says 172.21.15.87:40712) 2024-05-08T18:32:16.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.094+0000 7f9ccbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562eaa72d540 0x562eaa72fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60542/0 (socket says 172.21.15.87:60542) 2024-05-08T18:32:16.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.094+0000 7f9cd094b640 1 -- 172.21.15.87:0/2182581471 learned_addr learned my addr 172.21.15.87:0/2182581471 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:32:16.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.095+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2182581471 >> v1:172.21.15.53:6789/0 conn(0x562eaa69c480 legacy=0x562eaa72bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.095+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2182581471 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eaa7312e0 con 0x562eaa72d540 2024-05-08T18:32:16.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.096+0000 7f9ccbfff640 1 --2- 172.21.15.87:0/2182581471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa72d540 0x562eaa72fa00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00a470 tx=0x7f9cbc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34d3690b7406bf7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.097+0000 7f9ccb7fe640 1 -- 172.21.15.87:0/2182581471 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cbc057070 con 0x562eaa72d540 2024-05-08T18:32:16.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.097+0000 7f9ccb7fe640 1 -- 172.21.15.87:0/2182581471 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cbc052570 con 0x562eaa72d540 2024-05-08T18:32:16.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.097+0000 7f9ccb7fe640 1 -- 172.21.15.87:0/2182581471 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cbc052870 con 0x562eaa72d540 2024-05-08T18:32:16.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.097+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2182581471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa72d540 msgr2=0x562eaa72fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.097+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/2182581471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa72d540 0x562eaa72fa00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00a470 tx=0x7f9cbc01ce90 comp rx=0 tx=0).stop 2024-05-08T18:32:16.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.097+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2182581471 shutdown_connections 2024-05-08T18:32:16.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.097+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/2182581471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa72d540 0x562eaa72fa00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.097+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2182581471 >> 172.21.15.87:0/2182581471 conn(0x562eaa723710 msgr2=0x562eaa725b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.097+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2182581471 shutdown_connections 2024-05-08T18:32:16.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.097+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2182581471 wait complete. 2024-05-08T18:32:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.111+0000 7f9cd4d2b800 1 Processor -- start 2024-05-08T18:32:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.111+0000 7f9cd4d2b800 1 -- start start 2024-05-08T18:32:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.111+0000 7f9cd4d2b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa69c480 0x562eaa81a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.111+0000 7f9cd4d2b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562eaa6745a0 con 0x562eaa69c480 2024-05-08T18:32:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.111+0000 7f9cd094b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa69c480 0x562eaa81a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.111+0000 7f9cd094b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa69c480 0x562eaa81a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60560/0 (socket says 172.21.15.87:60560) 2024-05-08T18:32:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.111+0000 7f9cd094b640 1 -- 172.21.15.87:0/4018412033 learned_addr learned my addr 172.21.15.87:0/4018412033 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.112+0000 7f9cd094b640 1 -- 172.21.15.87:0/4018412033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eaa81ac10 con 0x562eaa69c480 2024-05-08T18:32:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.112+0000 7f9cd094b640 1 --2- 172.21.15.87:0/4018412033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa69c480 0x562eaa81a640 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4001de0 tx=0x7f9cc400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bccada72e06ecd16 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.112+0000 7f9bbee05640 1 -- 172.21.15.87:0/4018412033 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc4012020 con 0x562eaa69c480 2024-05-08T18:32:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.112+0000 7f9bbee05640 1 -- 172.21.15.87:0/4018412033 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc400e5a0 con 0x562eaa69c480 2024-05-08T18:32:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.112+0000 7f9bbee05640 1 -- 172.21.15.87:0/4018412033 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc400e8c0 con 0x562eaa69c480 2024-05-08T18:32:16.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.113+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/4018412033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa69c480 msgr2=0x562eaa81a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.113+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/4018412033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa69c480 0x562eaa81a640 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4001de0 tx=0x7f9cc400b6c0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.113+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/4018412033 shutdown_connections 2024-05-08T18:32:16.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.113+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/4018412033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa69c480 0x562eaa81a640 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.113+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/4018412033 >> 172.21.15.87:0/4018412033 conn(0x562eaa723710 msgr2=0x562eaa815f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.113+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/4018412033 shutdown_connections 2024-05-08T18:32:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.113+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/4018412033 wait complete. 2024-05-08T18:32:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.113+0000 7f9cd4d2b800 1 Processor -- start 2024-05-08T18:32:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.113+0000 7f9cd4d2b800 1 -- start start 2024-05-08T18:32:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.113+0000 7f9cd4d2b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa69c480 0x562eaa822160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.113+0000 7f9cd4d2b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562eaa730580 con 0x562eaa69c480 2024-05-08T18:32:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.113+0000 7f9cd094b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa69c480 0x562eaa822160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.114+0000 7f9cd094b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa69c480 0x562eaa822160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60570/0 (socket says 172.21.15.87:60570) 2024-05-08T18:32:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.114+0000 7f9cd094b640 1 -- 172.21.15.87:0/3642088237 learned_addr learned my addr 172.21.15.87:0/3642088237 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.114+0000 7f9cd094b640 1 -- 172.21.15.87:0/3642088237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eaa8226a0 con 0x562eaa69c480 2024-05-08T18:32:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.114+0000 7f9cd094b640 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa69c480 0x562eaa822160 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4001de0 tx=0x7f9cc4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.114+0000 7f9bbd602640 1 -- 172.21.15.87:0/3642088237 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc4012030 con 0x562eaa69c480 2024-05-08T18:32:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.114+0000 7f9bbd602640 1 -- 172.21.15.87:0/3642088237 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc401a7a0 con 0x562eaa69c480 2024-05-08T18:32:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.114+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3642088237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562eaa822930 con 0x562eaa69c480 2024-05-08T18:32:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.114+0000 7f9bbd602640 1 -- 172.21.15.87:0/3642088237 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc401aac0 con 0x562eaa69c480 2024-05-08T18:32:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.114+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3642088237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eaa8255e0 con 0x562eaa69c480 2024-05-08T18:32:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.115+0000 7f9bbd602640 1 -- 172.21.15.87:0/3642088237 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9cc4015020 con 0x562eaa69c480 2024-05-08T18:32:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.115+0000 7f9bbd602640 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9bb803bba0 0x7f9bb803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.115+0000 7f9bbd602640 1 -- 172.21.15.87:0/3642088237 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f9cc4020070 con 0x562eaa69c480 2024-05-08T18:32:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.115+0000 7f9ccbfff640 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9bb803bba0 0x7f9bb803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.116+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562eaa72d540 0x562eaa8293a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.116+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3642088237 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8298e0 con 0x562eaa72d540 2024-05-08T18:32:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.116+0000 7f9cd114c640 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562eaa72d540 0x562eaa8293a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.116+0000 7f9ccbfff640 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9bb803bba0 0x7f9bb803e060 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc054000 tx=0x7f9cbc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.116+0000 7f9cd114c640 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562eaa72d540 0x562eaa8293a0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.116+0000 7f9cd114c640 1 -- 172.21.15.87:0/3642088237 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ccc00a4a0 con 0x562eaa72d540 2024-05-08T18:32:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.116+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3642088237 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa826940 con 0x562eaa72d540 2024-05-08T18:32:16.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.116+0000 7f9cd114c640 1 -- 172.21.15.87:0/3642088237 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ccc00a4a0 con 0x562eaa72d540 2024-05-08T18:32:16.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.116+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3642088237 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa82b6c0 con 0x562eaa72d540 2024-05-08T18:32:16.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.117+0000 7f9cd114c640 1 -- 172.21.15.87:0/3642088237 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9ccc00a4a0 con 0x562eaa72d540 2024-05-08T18:32:16.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.117+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3642088237 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa82a920 con 0x562eaa72d540 2024-05-08T18:32:16.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.117+0000 7f9cd114c640 1 -- 172.21.15.87:0/3642088237 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ccc00a4a0 con 0x562eaa72d540 2024-05-08T18:32:16.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.117+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562eaa82ca70 0x562eaa82ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.117+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3642088237 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa82f3a0 con 0x562eaa82ca70 2024-05-08T18:32:16.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.117+0000 7f9cd094b640 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562eaa82ca70 0x562eaa82ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.118+0000 7f9cd094b640 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562eaa82ca70 0x562eaa82ee60 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.118+0000 7f9cd094b640 1 -- 172.21.15.87:0/3642088237 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9cc401ac60 con 0x562eaa82ca70 2024-05-08T18:32:16.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.118+0000 7f9cd4d2b800 1 Processor -- start 2024-05-08T18:32:16.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.118+0000 7f9cd4d2b800 1 -- start start 2024-05-08T18:32:16.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.119+0000 7f9cd4d2b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa83d580 0x562eaa83d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.119+0000 7f9cd4d2b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562eaa61afc0 con 0x562eaa83d580 2024-05-08T18:32:16.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.119+0000 7f9cd114c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa83d580 0x562eaa83d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.119+0000 7f9cd114c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa83d580 0x562eaa83d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60582/0 (socket says 172.21.15.87:60582) 2024-05-08T18:32:16.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.119+0000 7f9cd114c640 1 -- 172.21.15.87:0/3387458389 learned_addr learned my addr 172.21.15.87:0/3387458389 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.119+0000 7f9cd114c640 1 -- 172.21.15.87:0/3387458389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eaa83dee0 con 0x562eaa83d580 2024-05-08T18:32:16.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.119+0000 7f9cd114c640 1 --2- 172.21.15.87:0/3387458389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa83d580 0x562eaa83d9a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x562eaa823560 tx=0x7f9ccc0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.119+0000 7f9bb67fc640 1 -- 172.21.15.87:0/3387458389 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ccc013440 con 0x562eaa83d580 2024-05-08T18:32:16.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.120+0000 7f9bb67fc640 1 -- 172.21.15.87:0/3387458389 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc0135e0 con 0x562eaa83d580 2024-05-08T18:32:16.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.120+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3387458389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562eaa83e950 con 0x562eaa83d580 2024-05-08T18:32:16.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.120+0000 7f9bb67fc640 1 -- 172.21.15.87:0/3387458389 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ccc0138c0 con 0x562eaa83d580 2024-05-08T18:32:16.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.120+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3387458389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eaa83ee50 con 0x562eaa83d580 2024-05-08T18:32:16.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.120+0000 7f9bb67fc640 1 -- 172.21.15.87:0/3387458389 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9ccc011040 con 0x562eaa83d580 2024-05-08T18:32:16.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.121+0000 7f9bb67fc640 1 --2- 172.21.15.87:0/3387458389 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9ba803bb50 0x7f9ba803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.121+0000 7f9bb67fc640 1 -- 172.21.15.87:0/3387458389 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f9ccc01d070 con 0x562eaa83d580 2024-05-08T18:32:16.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.121+0000 7f9cd094b640 1 --2- 172.21.15.87:0/3387458389 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9ba803bb50 0x7f9ba803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.121+0000 7f9cd4d2b800 1 Processor -- start 2024-05-08T18:32:16.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.121+0000 7f9cd094b640 1 --2- 172.21.15.87:0/3387458389 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9ba803bb50 0x7f9ba803e010 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4016b50 tx=0x7f9cc4018e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.121+0000 7f9cd4d2b800 1 -- start start 2024-05-08T18:32:16.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.121+0000 7f9cd4d2b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa84a910 0x562eaa84ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.121+0000 7f9cd4d2b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562eaa81af90 con 0x562eaa84a910 2024-05-08T18:32:16.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.121+0000 7f9cd114c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa84a910 0x562eaa84ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.121+0000 7f9cd114c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa84a910 0x562eaa84ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60592/0 (socket says 172.21.15.87:60592) 2024-05-08T18:32:16.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.121+0000 7f9cd114c640 1 -- 172.21.15.87:0/757907215 learned_addr learned my addr 172.21.15.87:0/757907215 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.122+0000 7f9cd114c640 1 -- 172.21.15.87:0/757907215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eaa84b300 con 0x562eaa84a910 2024-05-08T18:32:16.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.122+0000 7f9cd114c640 1 --2- 172.21.15.87:0/757907215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa84a910 0x562eaa84ad30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc052a10 tx=0x7f9ccc001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62181a3eb0673e6e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.122+0000 7f9ba7fff640 1 -- 172.21.15.87:0/757907215 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ccc001620 con 0x562eaa84a910 2024-05-08T18:32:16.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.122+0000 7f9ba7fff640 1 -- 172.21.15.87:0/757907215 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc0017c0 con 0x562eaa84a910 2024-05-08T18:32:16.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.122+0000 7f9ba7fff640 1 -- 172.21.15.87:0/757907215 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ccc052c90 con 0x562eaa84a910 2024-05-08T18:32:16.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.122+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/757907215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa84a910 msgr2=0x562eaa84ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.122+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/757907215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa84a910 0x562eaa84ad30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc052a10 tx=0x7f9ccc001e60 comp rx=0 tx=0).stop 2024-05-08T18:32:16.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.122+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/757907215 shutdown_connections 2024-05-08T18:32:16.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.123+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/757907215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa84a910 0x562eaa84ad30 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.123+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/757907215 >> 172.21.15.87:0/757907215 conn(0x562eaa846bd0 msgr2=0x562eaa844c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.123+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/757907215 shutdown_connections 2024-05-08T18:32:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.123+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/757907215 wait complete. 2024-05-08T18:32:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.123+0000 7f9cd4d2b800 1 Processor -- start 2024-05-08T18:32:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.123+0000 7f9cd4d2b800 1 -- start start 2024-05-08T18:32:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.123+0000 7f9cd4d2b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa84a910 0x562eaa851e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.123+0000 7f9cd4d2b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562eaa84ba40 con 0x562eaa84a910 2024-05-08T18:32:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.123+0000 7f9cd114c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa84a910 0x562eaa851e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.123+0000 7f9cd114c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa84a910 0x562eaa851e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60604/0 (socket says 172.21.15.87:60604) 2024-05-08T18:32:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.123+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 learned_addr learned my addr 172.21.15.87:0/2769956201 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.124+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eaa852350 con 0x562eaa84a910 2024-05-08T18:32:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.124+0000 7f9cd114c640 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa84a910 0x562eaa851e10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0294c0 tx=0x7f9ccc052970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.124+0000 7f9ba67fc640 1 -- 172.21.15.87:0/2769956201 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ccc0541a0 con 0x562eaa84a910 2024-05-08T18:32:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.124+0000 7f9ba67fc640 1 -- 172.21.15.87:0/2769956201 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc054340 con 0x562eaa84a910 2024-05-08T18:32:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.124+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562eaa8525e0 con 0x562eaa84a910 2024-05-08T18:32:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.124+0000 7f9ba67fc640 1 -- 172.21.15.87:0/2769956201 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ccc0512d0 con 0x562eaa84a910 2024-05-08T18:32:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.124+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eaa855290 con 0x562eaa84a910 2024-05-08T18:32:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.125+0000 7f9ba67fc640 1 -- 172.21.15.87:0/2769956201 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9ccc051470 con 0x562eaa84a910 2024-05-08T18:32:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.125+0000 7f9cd4d2b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.125+0000 7f9ba67fc640 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b9c03bb50 0x7f9b9c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.125+0000 7f9ba67fc640 1 -- 172.21.15.87:0/2769956201 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f9ccc049030 con 0x562eaa84a910 2024-05-08T18:32:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.125+0000 7f9cd094b640 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b9c03bb50 0x7f9b9c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.125+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562eaa85da90 0x562eaa85ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.125+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa860650 con 0x562eaa85da90 2024-05-08T18:32:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.125+0000 7f9ccbfff640 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562eaa85da90 0x562eaa85ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.126+0000 7f9cd094b640 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b9c03bb50 0x7f9b9c03e010 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9cc401a6f0 tx=0x7f9cc4016f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.126+0000 7f9ccbfff640 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562eaa85da90 0x562eaa85ff00 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.126+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.126+0000 7f9cd4d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.126+0000 7f9cd4d2b800 20 realm 2024-05-08T18:32:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.126+0000 7f9cd4d2b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.126+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa860a20 con 0x562eaa85da90 2024-05-08T18:32:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.126+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.126+0000 7f9cd4d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.126+0000 7f9cd4d2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:32:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.126+0000 7f9cd4d2b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.126+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8612f0 con 0x562eaa85da90 2024-05-08T18:32:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.126+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.126+0000 7f9cd4d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.126+0000 7f9cd4d2b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.126+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa861690 con 0x562eaa85da90 2024-05-08T18:32:16.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.127+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.127+0000 7f9cd4d2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:16.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.127+0000 7f9cd4d2b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.127+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa861ab0 con 0x562eaa85da90 2024-05-08T18:32:16.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.127+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.127+0000 7f9cd4d2b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:32:16.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.127+0000 7f9cd4d2b800 20 searching for the correct realm 2024-05-08T18:32:16.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.127+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562eaa863ab0 0x562eaa865f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.127+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8665d0 con 0x562eaa863ab0 2024-05-08T18:32:16.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.127+0000 7f9cd114c640 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562eaa863ab0 0x562eaa865f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.127+0000 7f9cd114c640 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562eaa863ab0 0x562eaa865f00 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.128+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.128+0000 7f9cd114c640 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9ccc021c40 0x7f9ccc0195e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.128+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8665d0 con 0x7f9ccc021c40 2024-05-08T18:32:16.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.128+0000 7f9cd094b640 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9ccc021c40 0x7f9ccc0195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.128+0000 7f9cd094b640 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9ccc021c40 0x7f9ccc0195e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.128+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc401ac60 con 0x7f9ccc021c40 2024-05-08T18:32:16.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.129+0000 7f9cd094b640 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f9cc4017050 0x7f9cc403d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.129+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8665d0 con 0x7f9cc4017050 2024-05-08T18:32:16.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.129+0000 7f9ccbfff640 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f9cc4017050 0x7f9cc403d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.129+0000 7f9ccbfff640 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f9cc4017050 0x7f9cc403d140 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.129+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.129+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8665d0 con 0x562eaa85da90 2024-05-08T18:32:16.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.130+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.130+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8665d0 con 0x562eaa85da90 2024-05-08T18:32:16.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.130+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.130+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8665d0 con 0x7f9cc4017050 2024-05-08T18:32:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.130+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.130+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8665d0 con 0x7f9cc4017050 2024-05-08T18:32:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.130+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.130+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8665d0 con 0x7f9ccc021c40 2024-05-08T18:32:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.131+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc401ac60 con 0x7f9ccc021c40 2024-05-08T18:32:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.131+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8665d0 con 0x562eaa863ab0 2024-05-08T18:32:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.131+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.131+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8665d0 con 0x562eaa85da90 2024-05-08T18:32:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.131+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.131+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8665d0 con 0x7f9cc4017050 2024-05-08T18:32:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.131+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.131+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8665d0 con 0x562eaa85da90 2024-05-08T18:32:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.132+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.132+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8665d0 con 0x7f9ccc021c40 2024-05-08T18:32:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.132+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9cc401ac60 con 0x7f9ccc021c40 2024-05-08T18:32:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.132+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8665d0 con 0x562eaa863ab0 2024-05-08T18:32:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.132+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.132+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8665d0 con 0x562eaa863ab0 2024-05-08T18:32:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.132+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.132+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9ccc062040 con 0x7f9cc4017050 2024-05-08T18:32:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.133+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.133+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9ccc062040 con 0x562eaa863ab0 2024-05-08T18:32:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.133+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.133+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9ccc062040 con 0x562eaa863ab0 2024-05-08T18:32:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.133+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.133+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9ccc062040 con 0x562eaa85da90 2024-05-08T18:32:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.133+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.133+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9ccc062040 con 0x562eaa85da90 2024-05-08T18:32:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.134+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.134+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9ccc062040 con 0x7f9cc4017050 2024-05-08T18:32:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.134+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.134+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9ccc062040 con 0x562eaa863ab0 2024-05-08T18:32:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.134+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.134+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9ccc062040 con 0x7f9ccc021c40 2024-05-08T18:32:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.134+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc401ac60 con 0x7f9ccc021c40 2024-05-08T18:32:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.134+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9ccc062040 con 0x562eaa85da90 2024-05-08T18:32:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.135+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.135+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9ccc062040 con 0x7f9cc4017050 2024-05-08T18:32:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.135+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.135+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9ccc062040 con 0x562eaa863ab0 2024-05-08T18:32:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.135+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.135+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9ccc062040 con 0x7f9ccc021c40 2024-05-08T18:32:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.136+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc401ac60 con 0x7f9ccc021c40 2024-05-08T18:32:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.136+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9ccc062040 con 0x7f9ccc021c40 2024-05-08T18:32:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.136+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc401ac60 con 0x7f9ccc021c40 2024-05-08T18:32:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.136+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9ccc062040 con 0x562eaa863ab0 2024-05-08T18:32:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.136+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.136+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9ccc062040 con 0x7f9ccc021c40 2024-05-08T18:32:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.136+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc401ac60 con 0x7f9ccc021c40 2024-05-08T18:32:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.136+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9ccc062040 con 0x562eaa85da90 2024-05-08T18:32:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9ccc062040 con 0x7f9ccc021c40 2024-05-08T18:32:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc401ac60 con 0x7f9ccc021c40 2024-05-08T18:32:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9cd4d2b800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:32:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9cd4d2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:32:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9cd4d2b800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:32:16.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9cd4d2b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:32:16.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9cd4d2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:32:16.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9cd4d2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:32:16.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9cd4d2b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa862550 con 0x562eaa85da90 2024-05-08T18:32:16.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9cd4d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9cd4d2b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa862df0 con 0x562eaa85da90 2024-05-08T18:32:16.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9cd4d2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:16.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9cd4d2b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.137+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa862190 con 0x7f9cc4017050 2024-05-08T18:32:16.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9cd4d2b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:32:16.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9cd4d2b800 20 zone default found 2024-05-08T18:32:16.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9cd4d2b800 4 Realm: () 2024-05-08T18:32:16.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9cd4d2b800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:32:16.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9cd4d2b800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:32:16.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9cd4d2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:32:16.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9cd4d2b800 20 zonegroup default 2024-05-08T18:32:16.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9cd4d2b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa866aa0 con 0x7f9cc4017050 2024-05-08T18:32:16.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9cd4d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9cd4d2b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa868930 con 0x562eaa863ab0 2024-05-08T18:32:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9cd4d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9cd4d2b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa868cd0 con 0x562eaa863ab0 2024-05-08T18:32:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.138+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.139+0000 7f9cd4d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.139+0000 7f9cd4d2b800 20 started sync module instance, tier type = 2024-05-08T18:32:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.139+0000 7f9cd4d2b800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:32:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.139+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa867d70 con 0x7f9ccc021c40 2024-05-08T18:32:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.140+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc401ac60 con 0x7f9ccc021c40 2024-05-08T18:32:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.140+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94758429426064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa869520 con 0x7f9ccc021c40 2024-05-08T18:32:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.140+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa869d70 con 0x562eaa85da90 2024-05-08T18:32:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.141+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94758429426064] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc401ac60 con 0x7f9ccc021c40 2024-05-08T18:32:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.141+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.141+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94758429429872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa869d70 con 0x562eaa85da90 2024-05-08T18:32:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.141+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa86a890 con 0x562eaa863ab0 2024-05-08T18:32:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.142+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94758429429872] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.142+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.142+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94758429434720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa869d70 con 0x562eaa863ab0 2024-05-08T18:32:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.142+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa86b330 con 0x7f9ccc021c40 2024-05-08T18:32:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.143+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc401ac60 con 0x7f9ccc021c40 2024-05-08T18:32:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.143+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94758429437472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa86bbd0 con 0x7f9ccc021c40 2024-05-08T18:32:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.143+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa86c6a0 con 0x562eaa85da90 2024-05-08T18:32:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.143+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94758429434720] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.144+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.144+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94758429437472] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc401ac60 con 0x7f9ccc021c40 2024-05-08T18:32:16.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.144+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94758429442448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8698c0 con 0x562eaa85da90 2024-05-08T18:32:16.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.145+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa86cf70 con 0x7f9cc4017050 2024-05-08T18:32:16.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.146+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94758429442448] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.146+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.146+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94758429439776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa86cf00 con 0x7f9cc4017050 2024-05-08T18:32:16.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.146+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa86d8c0 con 0x7f9cc4017050 2024-05-08T18:32:16.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.147+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94758429439776] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.147+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.147+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94758429447664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa86cf00 con 0x7f9cc4017050 2024-05-08T18:32:16.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.147+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa86cf00 con 0x7f9cc4017050 2024-05-08T18:32:16.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.148+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94758429447664] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.148+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.148+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94758429444992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa86e2d0 con 0x7f9cc4017050 2024-05-08T18:32:16.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.148+0000 7f9cd4d2b800 20 add_watcher() i=0 2024-05-08T18:32:16.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.148+0000 7f9cd4d2b800 20 add_watcher() i=1 2024-05-08T18:32:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.148+0000 7f9cd4d2b800 20 add_watcher() i=2 2024-05-08T18:32:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.148+0000 7f9cd4d2b800 20 add_watcher() i=3 2024-05-08T18:32:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.148+0000 7f9cd4d2b800 20 add_watcher() i=4 2024-05-08T18:32:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.148+0000 7f9cd4d2b800 20 add_watcher() i=5 2024-05-08T18:32:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.148+0000 7f9cd4d2b800 20 add_watcher() i=6 2024-05-08T18:32:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.149+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94758429444992] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.149+0000 7f9cd4d2b800 20 add_watcher() i=7 2024-05-08T18:32:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.149+0000 7f9cd4d2b800 2 all 8 watchers are set, enabling cache 2024-05-08T18:32:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.149+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa871700 con 0x562eaa85da90 2024-05-08T18:32:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.149+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.149+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94758429450224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa86ebf0 con 0x562eaa85da90 2024-05-08T18:32:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.150+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94758429450224] v29'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.150+0000 7f9b877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:16.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.150+0000 7f9cd4d2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:32:16.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.150+0000 7f9cd4d2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:32:16.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.151+0000 7f9cd4d2b800 5 note: GC not initialized 2024-05-08T18:32:16.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.151+0000 7f9b867e4640 20 reqs_thread_entry: start 2024-05-08T18:32:16.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.151+0000 7f9cd4d2b800 20 init_complete bucket index max shards: 11 2024-05-08T18:32:16.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.151+0000 7f9cd4d2b800 20 Filter name: none 2024-05-08T18:32:16.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.151+0000 7f9b7ffff640 20 reqs_thread_entry: start 2024-05-08T18:32:16.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.151+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a5060 con 0x562eaa85da90 2024-05-08T18:32:16.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.151+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.151+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a5060 con 0x7f9ccc021c40 2024-05-08T18:32:16.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.151+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9cc401ac60 con 0x7f9ccc021c40 2024-05-08T18:32:16.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.151+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a54e0 con 0x562eaa85da90 2024-05-08T18:32:16.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.152+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.152+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a54e0 con 0x562eaa863ab0 2024-05-08T18:32:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.152+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.152+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a54e0 con 0x562eaa863ab0 2024-05-08T18:32:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.152+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.152+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a59e0 con 0x562eaa863ab0 2024-05-08T18:32:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.152+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.152+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a59e0 con 0x562eaa85da90 2024-05-08T18:32:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.153+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.153+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a59e0 con 0x562eaa85da90 2024-05-08T18:32:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.153+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.153+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a59e0 con 0x562eaa863ab0 2024-05-08T18:32:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.153+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.153+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a5960 con 0x562eaa863ab0 2024-05-08T18:32:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.153+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.153+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a5710 con 0x7f9cc4017050 2024-05-08T18:32:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.154+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.154+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6fe0 con 0x562eaa85da90 2024-05-08T18:32:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.154+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.154+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6fe0 con 0x7f9ccc021c40 2024-05-08T18:32:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.154+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9cc401ac60 con 0x7f9ccc021c40 2024-05-08T18:32:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.155+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6fe0 con 0x562eaa863ab0 2024-05-08T18:32:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.155+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.155+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6fe0 con 0x7f9cc4017050 2024-05-08T18:32:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.155+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.155+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6f50 con 0x7f9cc4017050 2024-05-08T18:32:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.155+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.155+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6f50 con 0x562eaa863ab0 2024-05-08T18:32:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.155+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.155+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6f50 con 0x7f9cc4017050 2024-05-08T18:32:16.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.156+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.156+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6f50 con 0x562eaa85da90 2024-05-08T18:32:16.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.156+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.156+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6f50 con 0x562eaa863ab0 2024-05-08T18:32:16.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.156+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.156+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6f50 con 0x7f9cc4017050 2024-05-08T18:32:16.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.157+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.157+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6f50 con 0x7f9ccc021c40 2024-05-08T18:32:16.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.157+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9cc401ac60 con 0x7f9ccc021c40 2024-05-08T18:32:16.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.157+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6f50 con 0x7f9cc4017050 2024-05-08T18:32:16.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.157+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.157+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6f50 con 0x562eaa85da90 2024-05-08T18:32:16.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.157+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.157+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6f50 con 0x562eaa85da90 2024-05-08T18:32:16.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.158+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.158+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6f50 con 0x562eaa863ab0 2024-05-08T18:32:16.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.158+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.158+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6f50 con 0x562eaa85da90 2024-05-08T18:32:16.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.158+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.158+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6f50 con 0x562eaa85da90 2024-05-08T18:32:16.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.158+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.158+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6f50 con 0x562eaa863ab0 2024-05-08T18:32:16.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.158+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.158+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6f50 con 0x562eaa863ab0 2024-05-08T18:32:16.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.159+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.159+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6f50 con 0x562eaa863ab0 2024-05-08T18:32:16.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.159+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.159+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8a6f50 con 0x7f9cc4017050 2024-05-08T18:32:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.159+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.160+0000 7f9b877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.160+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94758429450224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa8709a0 con 0x562eaa85da90 2024-05-08T18:32:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.161+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94758429450224] v29'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.161+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94758429426064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa86dfc0 con 0x7f9ccc021c40 2024-05-08T18:32:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.162+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94758429426064] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc401ac60 con 0x7f9ccc021c40 2024-05-08T18:32:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.162+0000 7f9cd4d2b800 20 remove_watcher() i=0 2024-05-08T18:32:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.162+0000 7f9cd4d2b800 2 removed watcher, disabling cache 2024-05-08T18:32:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.162+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94758429429872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa868190 con 0x562eaa85da90 2024-05-08T18:32:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.163+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94758429429872] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.163+0000 7f9cd4d2b800 20 remove_watcher() i=1 2024-05-08T18:32:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.163+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94758429434720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa868190 con 0x562eaa863ab0 2024-05-08T18:32:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.164+0000 7f9cd114c640 1 -- 172.21.15.87:0/2769956201 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94758429434720] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc04c050 con 0x562eaa863ab0 2024-05-08T18:32:16.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.164+0000 7f9cd4d2b800 20 remove_watcher() i=2 2024-05-08T18:32:16.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.164+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94758429437472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa86a360 con 0x7f9ccc021c40 2024-05-08T18:32:16.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.165+0000 7f9cd094b640 1 -- 172.21.15.87:0/2769956201 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94758429437472] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc401ac60 con 0x7f9ccc021c40 2024-05-08T18:32:16.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.165+0000 7f9cd4d2b800 20 remove_watcher() i=3 2024-05-08T18:32:16.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.165+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94758429442448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa868190 con 0x562eaa85da90 2024-05-08T18:32:16.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.166+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.1 v2:172.21.15.87:6808/2448644045 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94758429442448] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x562eaa85da90 2024-05-08T18:32:16.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.166+0000 7f9cd4d2b800 20 remove_watcher() i=4 2024-05-08T18:32:16.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.166+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94758429439776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa86ae20 con 0x7f9cc4017050 2024-05-08T18:32:16.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.168+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94758429439776] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.168+0000 7f9cd4d2b800 20 remove_watcher() i=5 2024-05-08T18:32:16.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.168+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94758429447664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa86a360 con 0x7f9cc4017050 2024-05-08T18:32:16.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.169+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94758429447664] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.169+0000 7f9cd4d2b800 20 remove_watcher() i=6 2024-05-08T18:32:16.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.169+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94758429444992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562eaa86c190 con 0x7f9cc4017050 2024-05-08T18:32:16.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94758429444992] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc05a040 con 0x7f9cc4017050 2024-05-08T18:32:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9cd4d2b800 20 remove_watcher() i=7 2024-05-08T18:32:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f9cc4017050 msgr2=0x7f9cc403d140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f9cc4017050 0x7f9cc403d140 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562eaa85da90 msgr2=0x562eaa85ff00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562eaa85da90 0x562eaa85ff00 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9ccc021c40 msgr2=0x7f9ccc0195e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f9ccc021c40 0x7f9ccc0195e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562eaa863ab0 msgr2=0x562eaa865f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562eaa863ab0 0x562eaa865f00 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b9c03bb50 msgr2=0x7f9b9c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b9c03bb50 0x7f9b9c03e010 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9cc401a6f0 tx=0x7f9cc4016f90 comp rx=0 tx=0).stop 2024-05-08T18:32:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa84a910 msgr2=0x562eaa851e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9ccbfff640 1 -- 172.21.15.87:0/2769956201 reap_dead start 2024-05-08T18:32:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa84a910 0x562eaa851e10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0294c0 tx=0x7f9ccc052970 comp rx=0 tx=0).stop 2024-05-08T18:32:16.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 shutdown_connections 2024-05-08T18:32:16.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/2769956201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa84a910 0x562eaa851e10 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.170+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 >> 172.21.15.87:0/2769956201 conn(0x562eaa846bd0 msgr2=0x562eaa844280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 shutdown_connections 2024-05-08T18:32:16.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/2769956201 wait complete. 2024-05-08T18:32:16.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3387458389 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9ba803bb50 msgr2=0x7f9ba803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/3387458389 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9ba803bb50 0x7f9ba803e010 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4016b50 tx=0x7f9cc4018e70 comp rx=0 tx=0).stop 2024-05-08T18:32:16.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3387458389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa83d580 msgr2=0x562eaa83d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/3387458389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa83d580 0x562eaa83d9a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x562eaa823560 tx=0x7f9ccc0178e0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3387458389 shutdown_connections 2024-05-08T18:32:16.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/3387458389 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9ba803bb50 0x7f9ba803e010 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/3387458389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa83d580 0x562eaa83d9a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3387458389 >> 172.21.15.87:0/3387458389 conn(0x562eaa831620 msgr2=0x562eaa831a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3387458389 shutdown_connections 2024-05-08T18:32:16.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3387458389 wait complete. 2024-05-08T18:32:16.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3642088237 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562eaa82ca70 msgr2=0x562eaa82ee60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562eaa82ca70 0x562eaa82ee60 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3642088237 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562eaa72d540 msgr2=0x562eaa8293a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562eaa72d540 0x562eaa8293a0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3642088237 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9bb803bba0 msgr2=0x7f9bb803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9bb803bba0 0x7f9bb803e060 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc054000 tx=0x7f9cbc04e000 comp rx=0 tx=0).stop 2024-05-08T18:32:16.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3642088237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa69c480 msgr2=0x562eaa822160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa69c480 0x562eaa822160 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4001de0 tx=0x7f9cc4000ed0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3642088237 shutdown_connections 2024-05-08T18:32:16.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562eaa72d540 0x562eaa8293a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562eaa82ca70 0x562eaa82ee60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9bb803bba0 0x7f9bb803e060 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 --2- 172.21.15.87:0/3642088237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eaa69c480 0x562eaa822160 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.171+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3642088237 >> 172.21.15.87:0/3642088237 conn(0x562eaa723710 msgr2=0x562eaa814760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.172+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3642088237 shutdown_connections 2024-05-08T18:32:16.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.172+0000 7f9cd4d2b800 1 -- 172.21.15.87:0/3642088237 wait complete. 2024-05-08T18:32:16.181 INFO:teuthology.orchestra.run.smithi087.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:32:16.181 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:32:16.181 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-05-08T18:32:16.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-05-08T18:32:16.182 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-05-08T18:32:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:32:16.266 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:32:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.268+0000 7ff6b232b800 1 Processor -- start 2024-05-08T18:32:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.268+0000 7ff6b232b800 1 -- start start 2024-05-08T18:32:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.268+0000 7ff6b232b800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5624d0e796a0 0x5624d0e7ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.268+0000 7ff6b232b800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5624d0e7c060 con 0x5624d0e752b0 2024-05-08T18:32:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.268+0000 7ff6b232b800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5624d0d15e20 con 0x5624d0e796a0 2024-05-08T18:32:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.268+0000 7ff6ad7a3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5624d0e796a0 0x5624d0e7ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.269+0000 7ff6adfa4640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5624d0e752b0 0x5624d0e756d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:40724/0 (socket says 172.21.15.87:40724) 2024-05-08T18:32:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.269+0000 7ff6adfa4640 1 -- 172.21.15.87:0/873780094 learned_addr learned my addr 172.21.15.87:0/873780094 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:32:16.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.269+0000 7ff6ad7a3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5624d0e796a0 0x5624d0e7ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60606/0 (socket says 172.21.15.87:60606) 2024-05-08T18:32:16.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.269+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/873780094 >> v1:172.21.15.53:6789/0 conn(0x5624d0e752b0 legacy=0x5624d0e756d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.269+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/873780094 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624d0e7d290 con 0x5624d0e796a0 2024-05-08T18:32:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.271+0000 7ff6ad7a3640 1 --2- 172.21.15.87:0/873780094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e796a0 0x5624d0e7ba90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400a470 tx=0x7ff6a401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4003bbd86db8b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.271+0000 7ff6acfa2640 1 -- 172.21.15.87:0/873780094 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a4057070 con 0x5624d0e796a0 2024-05-08T18:32:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.271+0000 7ff6acfa2640 1 -- 172.21.15.87:0/873780094 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6a4052570 con 0x5624d0e796a0 2024-05-08T18:32:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.271+0000 7ff6acfa2640 1 -- 172.21.15.87:0/873780094 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a4052870 con 0x5624d0e796a0 2024-05-08T18:32:16.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.272+0000 7ff6b232b800 1 -- 172.21.15.87:0/873780094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e796a0 msgr2=0x5624d0e7ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.272+0000 7ff6b232b800 1 --2- 172.21.15.87:0/873780094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e796a0 0x5624d0e7ba90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400a470 tx=0x7ff6a401ce90 comp rx=0 tx=0).stop 2024-05-08T18:32:16.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.272+0000 7ff6b232b800 1 -- 172.21.15.87:0/873780094 shutdown_connections 2024-05-08T18:32:16.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.272+0000 7ff6b232b800 1 --2- 172.21.15.87:0/873780094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e796a0 0x5624d0e7ba90 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.272+0000 7ff6b232b800 1 -- 172.21.15.87:0/873780094 >> 172.21.15.87:0/873780094 conn(0x5624d0e70830 msgr2=0x5624d0e72c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.272+0000 7ff6b232b800 1 -- 172.21.15.87:0/873780094 shutdown_connections 2024-05-08T18:32:16.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.272+0000 7ff6b232b800 1 -- 172.21.15.87:0/873780094 wait complete. 2024-05-08T18:32:16.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.285+0000 7ff6b232b800 1 Processor -- start 2024-05-08T18:32:16.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.285+0000 7ff6b232b800 1 -- start start 2024-05-08T18:32:16.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.286+0000 7ff6b232b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e752b0 0x5624d0deac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.286+0000 7ff6b232b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5624d0dc05b0 con 0x5624d0e752b0 2024-05-08T18:32:16.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.286+0000 7ff6adfa4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e752b0 0x5624d0deac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.286+0000 7ff6adfa4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e752b0 0x5624d0deac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60622/0 (socket says 172.21.15.87:60622) 2024-05-08T18:32:16.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.286+0000 7ff6adfa4640 1 -- 172.21.15.87:0/4173131481 learned_addr learned my addr 172.21.15.87:0/4173131481 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.286+0000 7ff6adfa4640 1 -- 172.21.15.87:0/4173131481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624d0de9230 con 0x5624d0e752b0 2024-05-08T18:32:16.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.287+0000 7ff6adfa4640 1 --2- 172.21.15.87:0/4173131481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e752b0 0x5624d0deac70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00017a0 tx=0x7ff6a0001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73b6bb5bf4ec249 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.287+0000 7ff59be07640 1 -- 172.21.15.87:0/4173131481 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a0016070 con 0x5624d0e752b0 2024-05-08T18:32:16.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.287+0000 7ff59be07640 1 -- 172.21.15.87:0/4173131481 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6a0004520 con 0x5624d0e752b0 2024-05-08T18:32:16.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.287+0000 7ff59be07640 1 -- 172.21.15.87:0/4173131481 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a0004820 con 0x5624d0e752b0 2024-05-08T18:32:16.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.287+0000 7ff6b232b800 1 -- 172.21.15.87:0/4173131481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e752b0 msgr2=0x5624d0deac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.287+0000 7ff6b232b800 1 --2- 172.21.15.87:0/4173131481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e752b0 0x5624d0deac70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00017a0 tx=0x7ff6a0001c60 comp rx=0 tx=0).stop 2024-05-08T18:32:16.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.287+0000 7ff6b232b800 1 -- 172.21.15.87:0/4173131481 shutdown_connections 2024-05-08T18:32:16.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.287+0000 7ff6b232b800 1 --2- 172.21.15.87:0/4173131481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e752b0 0x5624d0deac70 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.287+0000 7ff6b232b800 1 -- 172.21.15.87:0/4173131481 >> 172.21.15.87:0/4173131481 conn(0x5624d0e70830 msgr2=0x5624d0f61f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.288+0000 7ff6b232b800 1 -- 172.21.15.87:0/4173131481 shutdown_connections 2024-05-08T18:32:16.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.288+0000 7ff6b232b800 1 -- 172.21.15.87:0/4173131481 wait complete. 2024-05-08T18:32:16.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.288+0000 7ff6b232b800 1 Processor -- start 2024-05-08T18:32:16.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.288+0000 7ff6b232b800 1 -- start start 2024-05-08T18:32:16.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.288+0000 7ff6b232b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e752b0 0x5624d0f70440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.288+0000 7ff6b232b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5624d0e7c530 con 0x5624d0e752b0 2024-05-08T18:32:16.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.288+0000 7ff6adfa4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e752b0 0x5624d0f70440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.288+0000 7ff6adfa4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e752b0 0x5624d0f70440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60636/0 (socket says 172.21.15.87:60636) 2024-05-08T18:32:16.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.288+0000 7ff6adfa4640 1 -- 172.21.15.87:0/2091657511 learned_addr learned my addr 172.21.15.87:0/2091657511 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.289+0000 7ff6adfa4640 1 -- 172.21.15.87:0/2091657511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624d0f70980 con 0x5624d0e752b0 2024-05-08T18:32:16.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.289+0000 7ff6adfa4640 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e752b0 0x5624d0f70440 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0000f80 tx=0x7ff6a0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.289+0000 7ff59a604640 1 -- 172.21.15.87:0/2091657511 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a0016040 con 0x5624d0e752b0 2024-05-08T18:32:16.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.289+0000 7ff59a604640 1 -- 172.21.15.87:0/2091657511 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6a0011530 con 0x5624d0e752b0 2024-05-08T18:32:16.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.289+0000 7ff6b232b800 1 -- 172.21.15.87:0/2091657511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624d0f70c10 con 0x5624d0e752b0 2024-05-08T18:32:16.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.289+0000 7ff59a604640 1 -- 172.21.15.87:0/2091657511 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a0011890 con 0x5624d0e752b0 2024-05-08T18:32:16.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.289+0000 7ff6b232b800 1 -- 172.21.15.87:0/2091657511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624d0f73870 con 0x5624d0e752b0 2024-05-08T18:32:16.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.290+0000 7ff59a604640 1 -- 172.21.15.87:0/2091657511 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff6a001c3f0 con 0x5624d0e752b0 2024-05-08T18:32:16.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.290+0000 7ff59a604640 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff59403bb50 0x7ff59403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.290+0000 7ff59a604640 1 -- 172.21.15.87:0/2091657511 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff6a0051e50 con 0x5624d0e752b0 2024-05-08T18:32:16.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.290+0000 7ff6ad7a3640 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff59403bb50 0x7ff59403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.290+0000 7ff6b232b800 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5624d0e796a0 0x5624d0f77630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.290+0000 7ff6b232b800 1 -- 172.21.15.87:0/2091657511 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0f77c00 con 0x5624d0e796a0 2024-05-08T18:32:16.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.290+0000 7ff6ae7a5640 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5624d0e796a0 0x5624d0f77630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.291+0000 7ff6ad7a3640 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff59403bb50 0x7ff59403e010 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4054000 tx=0x7ff6a404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.291+0000 7ff6ae7a5640 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5624d0e796a0 0x5624d0f77630 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.291+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/2091657511 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6a80083e0 con 0x5624d0e796a0 2024-05-08T18:32:16.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.291+0000 7ff6b232b800 1 -- 172.21.15.87:0/2091657511 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0f74be0 con 0x5624d0e796a0 2024-05-08T18:32:16.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.291+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/2091657511 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff6a80083e0 con 0x5624d0e796a0 2024-05-08T18:32:16.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.291+0000 7ff6b232b800 1 -- 172.21.15.87:0/2091657511 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0f799e0 con 0x5624d0e796a0 2024-05-08T18:32:16.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.292+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/2091657511 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff6a80083e0 con 0x5624d0e796a0 2024-05-08T18:32:16.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.292+0000 7ff6b232b800 1 -- 172.21.15.87:0/2091657511 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0f78c10 con 0x5624d0e796a0 2024-05-08T18:32:16.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.292+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/2091657511 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff6a80083e0 con 0x5624d0e796a0 2024-05-08T18:32:16.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.292+0000 7ff6b232b800 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5624d0f7ad90 0x5624d0f7d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.292+0000 7ff6b232b800 1 -- 172.21.15.87:0/2091657511 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0f7d6c0 con 0x5624d0f7ad90 2024-05-08T18:32:16.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.292+0000 7ff6adfa4640 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5624d0f7ad90 0x5624d0f7d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.292+0000 7ff6adfa4640 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5624d0f7ad90 0x5624d0f7d180 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.293+0000 7ff6adfa4640 1 -- 172.21.15.87:0/2091657511 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff6a0019050 con 0x5624d0f7ad90 2024-05-08T18:32:16.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.293+0000 7ff6b232b800 1 Processor -- start 2024-05-08T18:32:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.293+0000 7ff6b232b800 1 -- start start 2024-05-08T18:32:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.294+0000 7ff6b232b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f8b920 0x5624d0f8bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.294+0000 7ff6b232b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5624d0d66fc0 con 0x5624d0f8b920 2024-05-08T18:32:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.294+0000 7ff6ae7a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f8b920 0x5624d0f8bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.294+0000 7ff6ae7a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f8b920 0x5624d0f8bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60652/0 (socket says 172.21.15.87:60652) 2024-05-08T18:32:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.294+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/2119962206 learned_addr learned my addr 172.21.15.87:0/2119962206 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.294+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/2119962206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624d0f8c280 con 0x5624d0f8b920 2024-05-08T18:32:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.294+0000 7ff6ae7a5640 1 --2- 172.21.15.87:0/2119962206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f8b920 0x5624d0f8bd40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x5624d0f712c0 tx=0x7ff6a800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.294+0000 7ff5937fe640 1 -- 172.21.15.87:0/2119962206 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a801c070 con 0x5624d0f8b920 2024-05-08T18:32:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.294+0000 7ff5937fe640 1 -- 172.21.15.87:0/2119962206 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6a8018410 con 0x5624d0f8b920 2024-05-08T18:32:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.294+0000 7ff5937fe640 1 -- 172.21.15.87:0/2119962206 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a8018730 con 0x5624d0f8b920 2024-05-08T18:32:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.294+0000 7ff6b232b800 1 -- 172.21.15.87:0/2119962206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624d0f8ccf0 con 0x5624d0f8b920 2024-05-08T18:32:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.295+0000 7ff6b232b800 1 -- 172.21.15.87:0/2119962206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624d0f8d1f0 con 0x5624d0f8b920 2024-05-08T18:32:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.295+0000 7ff5937fe640 1 -- 172.21.15.87:0/2119962206 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff6a801f070 con 0x5624d0f8b920 2024-05-08T18:32:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.296+0000 7ff5937fe640 1 --2- 172.21.15.87:0/2119962206 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff58803bb50 0x7ff58803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.296+0000 7ff5937fe640 1 -- 172.21.15.87:0/2119962206 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff6a8054710 con 0x5624d0f8b920 2024-05-08T18:32:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.296+0000 7ff6adfa4640 1 --2- 172.21.15.87:0/2119962206 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff58803bb50 0x7ff58803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.296+0000 7ff6b232b800 1 Processor -- start 2024-05-08T18:32:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.296+0000 7ff6adfa4640 1 --2- 172.21.15.87:0/2119962206 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff58803bb50 0x7ff58803e010 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0019a00 tx=0x7ff6a0050070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.296+0000 7ff6b232b800 1 -- start start 2024-05-08T18:32:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.296+0000 7ff6b232b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f98ca0 0x5624d0f990c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.296+0000 7ff6b232b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5624d0de95b0 con 0x5624d0f98ca0 2024-05-08T18:32:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.296+0000 7ff6ae7a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f98ca0 0x5624d0f990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.296+0000 7ff6ae7a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f98ca0 0x5624d0f990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60654/0 (socket says 172.21.15.87:60654) 2024-05-08T18:32:16.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.296+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/2946011643 learned_addr learned my addr 172.21.15.87:0/2946011643 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.297+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/2946011643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624d0f99690 con 0x5624d0f98ca0 2024-05-08T18:32:16.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.297+0000 7ff6ae7a5640 1 --2- 172.21.15.87:0/2946011643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f98ca0 0x5624d0f990c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8014fd0 tx=0x7ff6a8052b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6ad03ccb70cbfa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.297+0000 7ff5917fa640 1 -- 172.21.15.87:0/2946011643 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a8007c20 con 0x5624d0f98ca0 2024-05-08T18:32:16.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.297+0000 7ff5917fa640 1 -- 172.21.15.87:0/2946011643 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6a8007dc0 con 0x5624d0f98ca0 2024-05-08T18:32:16.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.297+0000 7ff5917fa640 1 -- 172.21.15.87:0/2946011643 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a8017850 con 0x5624d0f98ca0 2024-05-08T18:32:16.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.297+0000 7ff6b232b800 1 -- 172.21.15.87:0/2946011643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f98ca0 msgr2=0x5624d0f990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.297+0000 7ff6b232b800 1 --2- 172.21.15.87:0/2946011643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f98ca0 0x5624d0f990c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8014fd0 tx=0x7ff6a8052b20 comp rx=0 tx=0).stop 2024-05-08T18:32:16.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.297+0000 7ff6b232b800 1 -- 172.21.15.87:0/2946011643 shutdown_connections 2024-05-08T18:32:16.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.297+0000 7ff6b232b800 1 --2- 172.21.15.87:0/2946011643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f98ca0 0x5624d0f990c0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.297+0000 7ff6b232b800 1 -- 172.21.15.87:0/2946011643 >> 172.21.15.87:0/2946011643 conn(0x5624d0f95000 msgr2=0x5624d0f93060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.298+0000 7ff6b232b800 1 -- 172.21.15.87:0/2946011643 shutdown_connections 2024-05-08T18:32:16.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.298+0000 7ff6b232b800 1 -- 172.21.15.87:0/2946011643 wait complete. 2024-05-08T18:32:16.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.298+0000 7ff6b232b800 1 Processor -- start 2024-05-08T18:32:16.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.298+0000 7ff6b232b800 1 -- start start 2024-05-08T18:32:16.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.298+0000 7ff6b232b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f98ca0 0x5624d0fa0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.298+0000 7ff6b232b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5624d0f99e00 con 0x5624d0f98ca0 2024-05-08T18:32:16.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.298+0000 7ff6ae7a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f98ca0 0x5624d0fa0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.298+0000 7ff6ae7a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f98ca0 0x5624d0fa0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60664/0 (socket says 172.21.15.87:60664) 2024-05-08T18:32:16.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.298+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 learned_addr learned my addr 172.21.15.87:0/3360288153 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.299+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624d0fa07a0 con 0x5624d0f98ca0 2024-05-08T18:32:16.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.299+0000 7ff6ae7a5640 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f98ca0 0x5624d0fa0260 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8014fd0 tx=0x7ff6a8052970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.299+0000 7ff57f7fe640 1 -- 172.21.15.87:0/3360288153 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a8007c20 con 0x5624d0f98ca0 2024-05-08T18:32:16.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.299+0000 7ff57f7fe640 1 -- 172.21.15.87:0/3360288153 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6a8018bb0 con 0x5624d0f98ca0 2024-05-08T18:32:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.299+0000 7ff57f7fe640 1 -- 172.21.15.87:0/3360288153 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a8054070 con 0x5624d0f98ca0 2024-05-08T18:32:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.299+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624d0fa0a30 con 0x5624d0f98ca0 2024-05-08T18:32:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.299+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624d0fa36e0 con 0x5624d0f98ca0 2024-05-08T18:32:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.300+0000 7ff57f7fe640 1 -- 172.21.15.87:0/3360288153 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff6a8054210 con 0x5624d0f98ca0 2024-05-08T18:32:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.300+0000 7ff57f7fe640 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff57803bb50 0x7ff57803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.300+0000 7ff57f7fe640 1 -- 172.21.15.87:0/3360288153 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff6a8049030 con 0x5624d0f98ca0 2024-05-08T18:32:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.300+0000 7ff6b232b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.300+0000 7ff6adfa4640 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff57803bb50 0x7ff57803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.301+0000 7ff6b232b800 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5624d0fabd30 0x5624d0fae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.301+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fae920 con 0x5624d0fabd30 2024-05-08T18:32:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.301+0000 7ff6ad7a3640 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5624d0fabd30 0x5624d0fae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.301+0000 7ff6adfa4640 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff57803bb50 0x7ff57803e010 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0004fd0 tx=0x7ff6a004d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.301+0000 7ff6ad7a3640 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5624d0fabd30 0x5624d0fae1d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.301+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.301+0000 7ff6b232b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.301+0000 7ff6b232b800 20 realm 2024-05-08T18:32:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.301+0000 7ff6b232b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.301+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0faecf0 con 0x5624d0fabd30 2024-05-08T18:32:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.302+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.302+0000 7ff6b232b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.302+0000 7ff6b232b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:32:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.302+0000 7ff6b232b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.302+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0faf5c0 con 0x5624d0fabd30 2024-05-08T18:32:16.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.302+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.302+0000 7ff6b232b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.302+0000 7ff6b232b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.302+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0faf960 con 0x5624d0fabd30 2024-05-08T18:32:16.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.302+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.302+0000 7ff6b232b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:16.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.302+0000 7ff6b232b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.302+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fafd80 con 0x5624d0fabd30 2024-05-08T18:32:16.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.303+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.303+0000 7ff6b232b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:32:16.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.303+0000 7ff6b232b800 20 searching for the correct realm 2024-05-08T18:32:16.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.303+0000 7ff6b232b800 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5624d0fb1d80 0x5624d0fb41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.303+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x5624d0fb1d80 2024-05-08T18:32:16.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.303+0000 7ff6ae7a5640 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5624d0fb1d80 0x5624d0fb41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.303+0000 7ff6ae7a5640 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5624d0fb1d80 0x5624d0fb41d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.303+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a804c050 con 0x5624d0fb1d80 2024-05-08T18:32:16.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.304+0000 7ff6ae7a5640 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff6a8021070 0x7ff6a802aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.304+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x7ff6a8021070 2024-05-08T18:32:16.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.304+0000 7ff6adfa4640 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff6a8021070 0x7ff6a802aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.304+0000 7ff6adfa4640 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff6a8021070 0x7ff6a802aa50 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.304+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a0019050 con 0x7ff6a8021070 2024-05-08T18:32:16.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.304+0000 7ff6adfa4640 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff6a0011bd0 0x7ff6a003c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.304+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x7ff6a0011bd0 2024-05-08T18:32:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.304+0000 7ff6ad7a3640 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff6a0011bd0 0x7ff6a003c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.305+0000 7ff6ad7a3640 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff6a0011bd0 0x7ff6a003c950 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.305+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.305+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x5624d0fabd30 2024-05-08T18:32:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.305+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.305+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x5624d0fabd30 2024-05-08T18:32:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.306+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.306+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x7ff6a0011bd0 2024-05-08T18:32:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.306+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.306+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x7ff6a0011bd0 2024-05-08T18:32:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.306+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.306+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x7ff6a8021070 2024-05-08T18:32:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.306+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a0019050 con 0x7ff6a8021070 2024-05-08T18:32:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.306+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x5624d0fb1d80 2024-05-08T18:32:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.307+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a804c050 con 0x5624d0fb1d80 2024-05-08T18:32:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.307+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x5624d0fabd30 2024-05-08T18:32:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.307+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.307+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x7ff6a0011bd0 2024-05-08T18:32:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.307+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.307+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x5624d0fabd30 2024-05-08T18:32:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.307+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.307+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x7ff6a8021070 2024-05-08T18:32:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.308+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff6a0019050 con 0x7ff6a8021070 2024-05-08T18:32:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.308+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x5624d0fb1d80 2024-05-08T18:32:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.308+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a804c050 con 0x5624d0fb1d80 2024-05-08T18:32:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.308+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x5624d0fb1d80 2024-05-08T18:32:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.308+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a804c050 con 0x5624d0fb1d80 2024-05-08T18:32:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.308+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x7ff6a0011bd0 2024-05-08T18:32:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.309+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.309+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x5624d0fb1d80 2024-05-08T18:32:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.309+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a804c050 con 0x5624d0fb1d80 2024-05-08T18:32:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.309+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x5624d0fb1d80 2024-05-08T18:32:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.309+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a804c050 con 0x5624d0fb1d80 2024-05-08T18:32:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.309+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x5624d0fabd30 2024-05-08T18:32:16.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.309+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.309+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x5624d0fabd30 2024-05-08T18:32:16.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.310+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.310+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x7ff6a0011bd0 2024-05-08T18:32:16.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.310+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.310+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x5624d0fb1d80 2024-05-08T18:32:16.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.310+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a804c050 con 0x5624d0fb1d80 2024-05-08T18:32:16.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.310+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x7ff6a8021070 2024-05-08T18:32:16.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.310+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a0019050 con 0x7ff6a8021070 2024-05-08T18:32:16.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.310+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x5624d0fabd30 2024-05-08T18:32:16.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.311+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.311+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x7ff6a0011bd0 2024-05-08T18:32:16.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.311+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.311+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x5624d0fb1d80 2024-05-08T18:32:16.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.311+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a804c050 con 0x5624d0fb1d80 2024-05-08T18:32:16.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.311+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x7ff6a8021070 2024-05-08T18:32:16.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.311+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a0019050 con 0x7ff6a8021070 2024-05-08T18:32:16.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.312+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x7ff6a8021070 2024-05-08T18:32:16.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.312+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a0019050 con 0x7ff6a8021070 2024-05-08T18:32:16.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.312+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x5624d0fb1d80 2024-05-08T18:32:16.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.312+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a804c050 con 0x5624d0fb1d80 2024-05-08T18:32:16.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.312+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x7ff6a8021070 2024-05-08T18:32:16.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.312+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a0019050 con 0x7ff6a8021070 2024-05-08T18:32:16.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.312+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x5624d0fabd30 2024-05-08T18:32:16.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.312+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.312+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb48a0 con 0x7ff6a8021070 2024-05-08T18:32:16.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.313+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6a0019050 con 0x7ff6a8021070 2024-05-08T18:32:16.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.313+0000 7ff6b232b800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:32:16.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.313+0000 7ff6b232b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:32:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.313+0000 7ff6b232b800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:32:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.313+0000 7ff6b232b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:32:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.313+0000 7ff6b232b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:32:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.313+0000 7ff6b232b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:32:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.313+0000 7ff6b232b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.313+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb0820 con 0x5624d0fabd30 2024-05-08T18:32:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.313+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.313+0000 7ff6b232b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.313+0000 7ff6b232b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.313+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb10c0 con 0x5624d0fabd30 2024-05-08T18:32:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.313+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.313+0000 7ff6b232b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.313+0000 7ff6b232b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.313+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb0460 con 0x7ff6a0011bd0 2024-05-08T18:32:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:32:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 20 zone default found 2024-05-08T18:32:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 4 Realm: () 2024-05-08T18:32:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:32:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:32:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:32:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 20 zonegroup default 2024-05-08T18:32:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb4d70 con 0x7ff6a0011bd0 2024-05-08T18:32:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb6c00 con 0x5624d0fb1d80 2024-05-08T18:32:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff6a804c050 con 0x5624d0fb1d80 2024-05-08T18:32:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb6fa0 con 0x5624d0fb1d80 2024-05-08T18:32:16.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff6a804c050 con 0x5624d0fb1d80 2024-05-08T18:32:16.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 20 started sync module instance, tier type = 2024-05-08T18:32:16.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:32:16.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.314+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb6040 con 0x7ff6a8021070 2024-05-08T18:32:16.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.315+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a0019050 con 0x7ff6a8021070 2024-05-08T18:32:16.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.316+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94716124947552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb77f0 con 0x7ff6a8021070 2024-05-08T18:32:16.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.316+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb8040 con 0x5624d0fabd30 2024-05-08T18:32:16.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.316+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94716124947552] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a0019050 con 0x7ff6a8021070 2024-05-08T18:32:16.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.317+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.317+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94716124951360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb8040 con 0x5624d0fabd30 2024-05-08T18:32:16.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.317+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb8b60 con 0x5624d0fb1d80 2024-05-08T18:32:16.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.318+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94716124951360] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.318+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a804c050 con 0x5624d0fb1d80 2024-05-08T18:32:16.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.318+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94716124956208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb8040 con 0x5624d0fb1d80 2024-05-08T18:32:16.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.318+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb95d0 con 0x7ff6a8021070 2024-05-08T18:32:16.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.319+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94716124956208] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a804c050 con 0x5624d0fb1d80 2024-05-08T18:32:16.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.319+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a0019050 con 0x7ff6a8021070 2024-05-08T18:32:16.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.319+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94716124953488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb7fb0 con 0x7ff6a8021070 2024-05-08T18:32:16.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.319+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fba4c0 con 0x5624d0fabd30 2024-05-08T18:32:16.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.320+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.320+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94716124963312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fbac20 con 0x5624d0fabd30 2024-05-08T18:32:16.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.320+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fbb740 con 0x7ff6a0011bd0 2024-05-08T18:32:16.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.320+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94716124953488] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a0019050 con 0x7ff6a8021070 2024-05-08T18:32:16.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.321+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94716124963312] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.321+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.321+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94716124967440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fbb700 con 0x7ff6a0011bd0 2024-05-08T18:32:16.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.321+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fbbfe0 con 0x7ff6a0011bd0 2024-05-08T18:32:16.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.322+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94716124967440] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.322+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.322+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94716124961264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fbb700 con 0x7ff6a0011bd0 2024-05-08T18:32:16.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.322+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fbc5b0 con 0x7ff6a0011bd0 2024-05-08T18:32:16.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.323+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(58 notify.7 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.323+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94716124971264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fbca10 con 0x7ff6a0011bd0 2024-05-08T18:32:16.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.323+0000 7ff6b232b800 20 add_watcher() i=0 2024-05-08T18:32:16.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.323+0000 7ff6b232b800 20 add_watcher() i=1 2024-05-08T18:32:16.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.323+0000 7ff6b232b800 20 add_watcher() i=2 2024-05-08T18:32:16.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.323+0000 7ff6b232b800 20 add_watcher() i=3 2024-05-08T18:32:16.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.323+0000 7ff6b232b800 20 add_watcher() i=4 2024-05-08T18:32:16.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.323+0000 7ff6b232b800 20 add_watcher() i=5 2024-05-08T18:32:16.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.323+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94716124961264] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.323+0000 7ff6b232b800 20 add_watcher() i=6 2024-05-08T18:32:16.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.324+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94716124971264] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.324+0000 7ff6b232b800 20 add_watcher() i=7 2024-05-08T18:32:16.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.324+0000 7ff6b232b800 2 all 8 watchers are set, enabling cache 2024-05-08T18:32:16.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.325+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fbbae0 con 0x5624d0fabd30 2024-05-08T18:32:16.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.325+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.325+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94716124969696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fbcf20 con 0x5624d0fabd30 2024-05-08T18:32:16.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.326+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94716124969696] v29'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.326+0000 7ff55f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:16.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.326+0000 7ff6b232b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:32:16.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.326+0000 7ff6b232b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:32:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.326+0000 7ff6b232b800 5 note: GC not initialized 2024-05-08T18:32:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.326+0000 7ff55e7fc640 20 reqs_thread_entry: start 2024-05-08T18:32:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.326+0000 7ff6b232b800 20 init_complete bucket index max shards: 11 2024-05-08T18:32:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.326+0000 7ff6b232b800 20 Filter name: none 2024-05-08T18:32:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.326+0000 7ff4cffff640 20 reqs_thread_entry: start 2024-05-08T18:32:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.327+0000 7ff6b232b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.327+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0ff2940 con 0x5624d0fabd30 2024-05-08T18:32:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.327+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.327+0000 7ff6b232b800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:32:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.327+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5624d0ff3d30 con 0x7ff6a0011bd0 2024-05-08T18:32:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.327+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.328+0000 7ff55f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.328+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94716124969696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fbd340 con 0x5624d0fabd30 2024-05-08T18:32:16.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.329+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94716124969696] v29'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.329+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94716124947552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fbbae0 con 0x7ff6a8021070 2024-05-08T18:32:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.330+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94716124947552] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a0019050 con 0x7ff6a8021070 2024-05-08T18:32:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.330+0000 7ff6b232b800 20 remove_watcher() i=0 2024-05-08T18:32:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.330+0000 7ff6b232b800 2 removed watcher, disabling cache 2024-05-08T18:32:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.330+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94716124951360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb6460 con 0x5624d0fabd30 2024-05-08T18:32:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.332+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94716124951360] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.332+0000 7ff6b232b800 20 remove_watcher() i=1 2024-05-08T18:32:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.332+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94716124956208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb6460 con 0x5624d0fb1d80 2024-05-08T18:32:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.333+0000 7ff6ae7a5640 1 -- 172.21.15.87:0/3360288153 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94716124956208] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a804c050 con 0x5624d0fb1d80 2024-05-08T18:32:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.333+0000 7ff6b232b800 20 remove_watcher() i=2 2024-05-08T18:32:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.333+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94716124953488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb8630 con 0x7ff6a8021070 2024-05-08T18:32:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.334+0000 7ff6adfa4640 1 -- 172.21.15.87:0/3360288153 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94716124953488] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a0019050 con 0x7ff6a8021070 2024-05-08T18:32:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.334+0000 7ff6b232b800 20 remove_watcher() i=3 2024-05-08T18:32:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.334+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94716124963312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb6460 con 0x5624d0fabd30 2024-05-08T18:32:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.335+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94716124963312] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x5624d0fabd30 2024-05-08T18:32:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.335+0000 7ff6b232b800 20 remove_watcher() i=4 2024-05-08T18:32:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.335+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94716124967440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb7b90 con 0x7ff6a0011bd0 2024-05-08T18:32:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.336+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94716124967440] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.336+0000 7ff6b232b800 20 remove_watcher() i=5 2024-05-08T18:32:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.336+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94716124961264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb8630 con 0x7ff6a0011bd0 2024-05-08T18:32:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.337+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94716124961264] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.337+0000 7ff6b232b800 20 remove_watcher() i=6 2024-05-08T18:32:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.337+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94716124971264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5624d0fb6460 con 0x7ff6a0011bd0 2024-05-08T18:32:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94716124971264] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6a405a040 con 0x7ff6a0011bd0 2024-05-08T18:32:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 20 remove_watcher() i=7 2024-05-08T18:32:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff6a0011bd0 msgr2=0x7ff6a003c950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff6a0011bd0 0x7ff6a003c950 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5624d0fabd30 msgr2=0x5624d0fae1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5624d0fabd30 0x5624d0fae1d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff6a8021070 msgr2=0x7ff6a802aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff6a8021070 0x7ff6a802aa50 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5624d0fb1d80 msgr2=0x5624d0fb41d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5624d0fb1d80 0x5624d0fb41d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff57803bb50 msgr2=0x7ff57803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff57803bb50 0x7ff57803e010 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0004fd0 tx=0x7ff6a004d000 comp rx=0 tx=0).stop 2024-05-08T18:32:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f98ca0 msgr2=0x5624d0fa0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6ad7a3640 1 -- 172.21.15.87:0/3360288153 reap_dead start 2024-05-08T18:32:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f98ca0 0x5624d0fa0260 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8014fd0 tx=0x7ff6a8052970 comp rx=0 tx=0).stop 2024-05-08T18:32:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 shutdown_connections 2024-05-08T18:32:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 1 --2- 172.21.15.87:0/3360288153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f98ca0 0x5624d0fa0260 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 >> 172.21.15.87:0/3360288153 conn(0x5624d0f95000 msgr2=0x5624d0f92660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 shutdown_connections 2024-05-08T18:32:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.338+0000 7ff6b232b800 1 -- 172.21.15.87:0/3360288153 wait complete. 2024-05-08T18:32:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 -- 172.21.15.87:0/2119962206 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff58803bb50 msgr2=0x7ff58803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 --2- 172.21.15.87:0/2119962206 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff58803bb50 0x7ff58803e010 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0019a00 tx=0x7ff6a0050070 comp rx=0 tx=0).stop 2024-05-08T18:32:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 -- 172.21.15.87:0/2119962206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f8b920 msgr2=0x5624d0f8bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 --2- 172.21.15.87:0/2119962206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f8b920 0x5624d0f8bd40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x5624d0f712c0 tx=0x7ff6a800ef30 comp rx=0 tx=0).stop 2024-05-08T18:32:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 -- 172.21.15.87:0/2119962206 shutdown_connections 2024-05-08T18:32:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 --2- 172.21.15.87:0/2119962206 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff58803bb50 0x7ff58803e010 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 --2- 172.21.15.87:0/2119962206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0f8b920 0x5624d0f8bd40 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 -- 172.21.15.87:0/2119962206 >> 172.21.15.87:0/2119962206 conn(0x5624d0f7f9c0 msgr2=0x5624d0f7fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 -- 172.21.15.87:0/2119962206 shutdown_connections 2024-05-08T18:32:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 -- 172.21.15.87:0/2119962206 wait complete. 2024-05-08T18:32:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 -- 172.21.15.87:0/2091657511 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5624d0f7ad90 msgr2=0x5624d0f7d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5624d0f7ad90 0x5624d0f7d180 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 -- 172.21.15.87:0/2091657511 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5624d0e796a0 msgr2=0x5624d0f77630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5624d0e796a0 0x5624d0f77630 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 -- 172.21.15.87:0/2091657511 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff59403bb50 msgr2=0x7ff59403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff59403bb50 0x7ff59403e010 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4054000 tx=0x7ff6a404e000 comp rx=0 tx=0).stop 2024-05-08T18:32:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 -- 172.21.15.87:0/2091657511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e752b0 msgr2=0x5624d0f70440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e752b0 0x5624d0f70440 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0000f80 tx=0x7ff6a0001250 comp rx=0 tx=0).stop 2024-05-08T18:32:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 -- 172.21.15.87:0/2091657511 shutdown_connections 2024-05-08T18:32:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5624d0e796a0 0x5624d0f77630 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5624d0f7ad90 0x5624d0f7d180 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff59403bb50 0x7ff59403e010 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 --2- 172.21.15.87:0/2091657511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624d0e752b0 0x5624d0f70440 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 -- 172.21.15.87:0/2091657511 >> 172.21.15.87:0/2091657511 conn(0x5624d0e70830 msgr2=0x5624d0de9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 -- 172.21.15.87:0/2091657511 shutdown_connections 2024-05-08T18:32:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.339+0000 7ff6b232b800 1 -- 172.21.15.87:0/2091657511 wait complete. 2024-05-08T18:32:16.354 INFO:teuthology.orchestra.run.smithi087.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:32:16.355 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:32:16.355 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-05-08T18:32:16.355 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-05-08T18:32:16.355 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-05-08T18:32:16.401 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:32:16.402 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:32:16.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.404+0000 7fe423b1f800 1 Processor -- start 2024-05-08T18:32:16.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.404+0000 7fe423b1f800 1 -- start start 2024-05-08T18:32:16.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.404+0000 7fe423b1f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559b7443d640 0x559b7443fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.404+0000 7fe423b1f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559b74440000 con 0x559b74439690 2024-05-08T18:32:16.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.404+0000 7fe423b1f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x559b742dae20 con 0x559b7443d640 2024-05-08T18:32:16.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.404+0000 7fe41efc2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559b7443d640 0x559b7443fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.405+0000 7fe41f7c3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x559b74439690 0x559b74439ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:40730/0 (socket says 172.21.15.87:40730) 2024-05-08T18:32:16.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.405+0000 7fe41f7c3640 1 -- 172.21.15.87:0/2322917340 learned_addr learned my addr 172.21.15.87:0/2322917340 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:32:16.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.405+0000 7fe41efc2640 1 -- 172.21.15.87:0/2322917340 >> v1:172.21.15.53:6789/0 conn(0x559b74439690 legacy=0x559b74439ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.405+0000 7fe41efc2640 1 -- 172.21.15.87:0/2322917340 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b74441230 con 0x559b7443d640 2024-05-08T18:32:16.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.407+0000 7fe41efc2640 1 --2- 172.21.15.87:0/2322917340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7443d640 0x559b7443fa30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe41400a470 tx=0x7fe41401cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619bd5d6f57dd70 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.407+0000 7fe41e7c1640 1 -- 172.21.15.87:0/2322917340 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe414057070 con 0x559b7443d640 2024-05-08T18:32:16.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.407+0000 7fe41e7c1640 1 -- 172.21.15.87:0/2322917340 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe414052570 con 0x559b7443d640 2024-05-08T18:32:16.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.407+0000 7fe41e7c1640 1 -- 172.21.15.87:0/2322917340 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe414052870 con 0x559b7443d640 2024-05-08T18:32:16.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.407+0000 7fe423b1f800 1 -- 172.21.15.87:0/2322917340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7443d640 msgr2=0x559b7443fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.407+0000 7fe423b1f800 1 --2- 172.21.15.87:0/2322917340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7443d640 0x559b7443fa30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe41400a470 tx=0x7fe41401cf20 comp rx=0 tx=0).stop 2024-05-08T18:32:16.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.407+0000 7fe423b1f800 1 -- 172.21.15.87:0/2322917340 shutdown_connections 2024-05-08T18:32:16.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.407+0000 7fe423b1f800 1 --2- 172.21.15.87:0/2322917340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7443d640 0x559b7443fa30 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.407+0000 7fe423b1f800 1 -- 172.21.15.87:0/2322917340 >> 172.21.15.87:0/2322917340 conn(0x559b74433eb0 msgr2=0x559b744362d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.407+0000 7fe423b1f800 1 -- 172.21.15.87:0/2322917340 shutdown_connections 2024-05-08T18:32:16.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.407+0000 7fe423b1f800 1 -- 172.21.15.87:0/2322917340 wait complete. 2024-05-08T18:32:16.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.421+0000 7fe423b1f800 1 Processor -- start 2024-05-08T18:32:16.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.421+0000 7fe423b1f800 1 -- start start 2024-05-08T18:32:16.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.421+0000 7fe423b1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b74439690 0x559b7452a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.421+0000 7fe423b1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559b743855c0 con 0x559b74439690 2024-05-08T18:32:16.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.422+0000 7fe41f7c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b74439690 0x559b7452a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.422+0000 7fe41f7c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b74439690 0x559b7452a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60694/0 (socket says 172.21.15.87:60694) 2024-05-08T18:32:16.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.422+0000 7fe41f7c3640 1 -- 172.21.15.87:0/1217787141 learned_addr learned my addr 172.21.15.87:0/1217787141 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.422+0000 7fe41f7c3640 1 -- 172.21.15.87:0/1217787141 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b7452ab00 con 0x559b74439690 2024-05-08T18:32:16.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.422+0000 7fe41f7c3640 1 --2- 172.21.15.87:0/1217787141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b74439690 0x559b7452a530 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe410001d80 tx=0x7fe410001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf180f932d2ca37 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.423+0000 7fe30d60a640 1 -- 172.21.15.87:0/1217787141 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe410013030 con 0x559b74439690 2024-05-08T18:32:16.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.423+0000 7fe30d60a640 1 -- 172.21.15.87:0/1217787141 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe41000e470 con 0x559b74439690 2024-05-08T18:32:16.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.423+0000 7fe30d60a640 1 -- 172.21.15.87:0/1217787141 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe41000e810 con 0x559b74439690 2024-05-08T18:32:16.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.423+0000 7fe423b1f800 1 -- 172.21.15.87:0/1217787141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b74439690 msgr2=0x559b7452a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.423+0000 7fe423b1f800 1 --2- 172.21.15.87:0/1217787141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b74439690 0x559b7452a530 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe410001d80 tx=0x7fe410001e70 comp rx=0 tx=0).stop 2024-05-08T18:32:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.423+0000 7fe423b1f800 1 -- 172.21.15.87:0/1217787141 shutdown_connections 2024-05-08T18:32:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.423+0000 7fe423b1f800 1 --2- 172.21.15.87:0/1217787141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b74439690 0x559b7452a530 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.423+0000 7fe423b1f800 1 -- 172.21.15.87:0/1217787141 >> 172.21.15.87:0/1217787141 conn(0x559b74433eb0 msgr2=0x559b74525e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.423+0000 7fe423b1f800 1 -- 172.21.15.87:0/1217787141 shutdown_connections 2024-05-08T18:32:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.423+0000 7fe423b1f800 1 -- 172.21.15.87:0/1217787141 wait complete. 2024-05-08T18:32:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.424+0000 7fe423b1f800 1 Processor -- start 2024-05-08T18:32:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.424+0000 7fe423b1f800 1 -- start start 2024-05-08T18:32:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.424+0000 7fe423b1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b74439690 0x559b745320b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.424+0000 7fe423b1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559b744404d0 con 0x559b74439690 2024-05-08T18:32:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.424+0000 7fe41f7c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b74439690 0x559b745320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.424+0000 7fe41f7c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b74439690 0x559b745320b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60710/0 (socket says 172.21.15.87:60710) 2024-05-08T18:32:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.424+0000 7fe41f7c3640 1 -- 172.21.15.87:0/2595953698 learned_addr learned my addr 172.21.15.87:0/2595953698 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.424+0000 7fe41f7c3640 1 -- 172.21.15.87:0/2595953698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b745325f0 con 0x559b74439690 2024-05-08T18:32:16.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.424+0000 7fe41f7c3640 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b74439690 0x559b745320b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe410004000 tx=0x7fe410000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.425+0000 7fe30be07640 1 -- 172.21.15.87:0/2595953698 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe410027070 con 0x559b74439690 2024-05-08T18:32:16.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.425+0000 7fe30be07640 1 -- 172.21.15.87:0/2595953698 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe410001400 con 0x559b74439690 2024-05-08T18:32:16.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.425+0000 7fe423b1f800 1 -- 172.21.15.87:0/2595953698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b74532880 con 0x559b74439690 2024-05-08T18:32:16.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.425+0000 7fe30be07640 1 -- 172.21.15.87:0/2595953698 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe410019a70 con 0x559b74439690 2024-05-08T18:32:16.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.425+0000 7fe423b1f800 1 -- 172.21.15.87:0/2595953698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b74535530 con 0x559b74439690 2024-05-08T18:32:16.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.426+0000 7fe30be07640 1 -- 172.21.15.87:0/2595953698 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fe41002a070 con 0x559b74439690 2024-05-08T18:32:16.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.426+0000 7fe30be07640 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe30403bba0 0x7fe30403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.426+0000 7fe30be07640 1 -- 172.21.15.87:0/2595953698 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fe41001f070 con 0x559b74439690 2024-05-08T18:32:16.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.426+0000 7fe41efc2640 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe30403bba0 0x7fe30403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.426+0000 7fe423b1f800 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559b7443d640 0x559b745392f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.426+0000 7fe423b1f800 1 -- 172.21.15.87:0/2595953698 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b74539830 con 0x559b7443d640 2024-05-08T18:32:16.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.426+0000 7fe41ffc4640 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559b7443d640 0x559b745392f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.426+0000 7fe41efc2640 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe30403bba0 0x7fe30403e060 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe414054000 tx=0x7fe41404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.426+0000 7fe41ffc4640 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559b7443d640 0x559b745392f0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.427+0000 7fe41ffc4640 1 -- 172.21.15.87:0/2595953698 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe41800a4a0 con 0x559b7443d640 2024-05-08T18:32:16.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.427+0000 7fe423b1f800 1 -- 172.21.15.87:0/2595953698 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b745368c0 con 0x559b7443d640 2024-05-08T18:32:16.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.427+0000 7fe41ffc4640 1 -- 172.21.15.87:0/2595953698 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe41800a4a0 con 0x559b7443d640 2024-05-08T18:32:16.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.427+0000 7fe423b1f800 1 -- 172.21.15.87:0/2595953698 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b7453b650 con 0x559b7443d640 2024-05-08T18:32:16.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.427+0000 7fe41ffc4640 1 -- 172.21.15.87:0/2595953698 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe41800a4a0 con 0x559b7443d640 2024-05-08T18:32:16.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.427+0000 7fe423b1f800 1 -- 172.21.15.87:0/2595953698 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b7453a880 con 0x559b7443d640 2024-05-08T18:32:16.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.428+0000 7fe41ffc4640 1 -- 172.21.15.87:0/2595953698 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe41800a4a0 con 0x559b7443d640 2024-05-08T18:32:16.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.428+0000 7fe423b1f800 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559b7453ca00 0x559b7453edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.428+0000 7fe423b1f800 1 -- 172.21.15.87:0/2595953698 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b7453f330 con 0x559b7453ca00 2024-05-08T18:32:16.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.428+0000 7fe41f7c3640 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559b7453ca00 0x559b7453edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.428+0000 7fe41f7c3640 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559b7453ca00 0x559b7453edf0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.429+0000 7fe41f7c3640 1 -- 172.21.15.87:0/2595953698 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe410029030 con 0x559b7453ca00 2024-05-08T18:32:16.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.429+0000 7fe423b1f800 1 Processor -- start 2024-05-08T18:32:16.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.429+0000 7fe423b1f800 1 -- start start 2024-05-08T18:32:16.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.429+0000 7fe423b1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7454f230 0x559b74551620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.429+0000 7fe423b1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559b7432bfc0 con 0x559b7454f230 2024-05-08T18:32:16.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.429+0000 7fe41ffc4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7454f230 0x559b74551620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.429+0000 7fe41ffc4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7454f230 0x559b74551620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60712/0 (socket says 172.21.15.87:60712) 2024-05-08T18:32:16.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.429+0000 7fe41ffc4640 1 -- 172.21.15.87:0/244516825 learned_addr learned my addr 172.21.15.87:0/244516825 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.429+0000 7fe41ffc4640 1 -- 172.21.15.87:0/244516825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b74439030 con 0x559b7454f230 2024-05-08T18:32:16.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.430+0000 7fe41ffc4640 1 --2- 172.21.15.87:0/244516825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7454f230 0x559b74551620 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x559b745334b0 tx=0x7fe4180178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.430+0000 7fe309602640 1 -- 172.21.15.87:0/244516825 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe418013440 con 0x559b7454f230 2024-05-08T18:32:16.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.430+0000 7fe309602640 1 -- 172.21.15.87:0/244516825 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4180135e0 con 0x559b7454f230 2024-05-08T18:32:16.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.430+0000 7fe423b1f800 1 -- 172.21.15.87:0/244516825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b74551b60 con 0x559b7454f230 2024-05-08T18:32:16.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.430+0000 7fe309602640 1 -- 172.21.15.87:0/244516825 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4180138c0 con 0x559b7454f230 2024-05-08T18:32:16.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.430+0000 7fe423b1f800 1 -- 172.21.15.87:0/244516825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b74552060 con 0x559b7454f230 2024-05-08T18:32:16.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.431+0000 7fe309602640 1 -- 172.21.15.87:0/244516825 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fe418011040 con 0x559b7454f230 2024-05-08T18:32:16.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.431+0000 7fe309602640 1 --2- 172.21.15.87:0/244516825 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe2f803bb50 0x7fe2f803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.431+0000 7fe309602640 1 -- 172.21.15.87:0/244516825 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fe41801d070 con 0x559b7454f230 2024-05-08T18:32:16.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.431+0000 7fe41f7c3640 1 --2- 172.21.15.87:0/244516825 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe2f803bb50 0x7fe2f803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.431+0000 7fe423b1f800 1 Processor -- start 2024-05-08T18:32:16.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.431+0000 7fe41f7c3640 1 --2- 172.21.15.87:0/244516825 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe2f803bb50 0x7fe2f803e010 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe41000c710 tx=0x7fe410017d20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.431+0000 7fe423b1f800 1 -- start start 2024-05-08T18:32:16.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.432+0000 7fe423b1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7455b990 0x559b7455bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.432+0000 7fe423b1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559b7452ae80 con 0x559b7455b990 2024-05-08T18:32:16.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.432+0000 7fe41ffc4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7455b990 0x559b7455bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.432+0000 7fe41ffc4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7455b990 0x559b7455bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60722/0 (socket says 172.21.15.87:60722) 2024-05-08T18:32:16.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.432+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3871053215 learned_addr learned my addr 172.21.15.87:0/3871053215 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.432+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3871053215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b7455c380 con 0x559b7455b990 2024-05-08T18:32:16.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.432+0000 7fe41ffc4640 1 --2- 172.21.15.87:0/3871053215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7455b990 0x559b7455bdb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe4180529a0 tx=0x7fe418001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39936a671410353 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.432+0000 7fe302ffd640 1 -- 172.21.15.87:0/3871053215 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe41802ad80 con 0x559b7455b990 2024-05-08T18:32:16.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.432+0000 7fe302ffd640 1 -- 172.21.15.87:0/3871053215 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4180014f0 con 0x559b7455b990 2024-05-08T18:32:16.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.432+0000 7fe302ffd640 1 -- 172.21.15.87:0/3871053215 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4180017d0 con 0x559b7455b990 2024-05-08T18:32:16.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.433+0000 7fe423b1f800 1 -- 172.21.15.87:0/3871053215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7455b990 msgr2=0x559b7455bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.433+0000 7fe423b1f800 1 --2- 172.21.15.87:0/3871053215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7455b990 0x559b7455bdb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe4180529a0 tx=0x7fe418001e60 comp rx=0 tx=0).stop 2024-05-08T18:32:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.433+0000 7fe423b1f800 1 -- 172.21.15.87:0/3871053215 shutdown_connections 2024-05-08T18:32:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.433+0000 7fe423b1f800 1 --2- 172.21.15.87:0/3871053215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7455b990 0x559b7455bdb0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.433+0000 7fe423b1f800 1 -- 172.21.15.87:0/3871053215 >> 172.21.15.87:0/3871053215 conn(0x559b74557ca0 msgr2=0x559b74555d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.433+0000 7fe423b1f800 1 -- 172.21.15.87:0/3871053215 shutdown_connections 2024-05-08T18:32:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.433+0000 7fe423b1f800 1 -- 172.21.15.87:0/3871053215 wait complete. 2024-05-08T18:32:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.433+0000 7fe423b1f800 1 Processor -- start 2024-05-08T18:32:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.433+0000 7fe423b1f800 1 -- start start 2024-05-08T18:32:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.433+0000 7fe423b1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7455b990 0x559b7454eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.433+0000 7fe423b1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559b7455cb50 con 0x559b7455b990 2024-05-08T18:32:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.434+0000 7fe41ffc4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7455b990 0x559b7454eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.434+0000 7fe41ffc4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7455b990 0x559b7454eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60726/0 (socket says 172.21.15.87:60726) 2024-05-08T18:32:16.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.434+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 learned_addr learned my addr 172.21.15.87:0/3718954082 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.434+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b7454d260 con 0x559b7455b990 2024-05-08T18:32:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.434+0000 7fe41ffc4640 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7455b990 0x559b7454eb70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe41804d010 tx=0x7fe418052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.434+0000 7fe3017fa640 1 -- 172.21.15.87:0/3718954082 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe418030020 con 0x559b7455b990 2024-05-08T18:32:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.434+0000 7fe3017fa640 1 -- 172.21.15.87:0/3718954082 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe418013b90 con 0x559b7455b990 2024-05-08T18:32:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.434+0000 7fe3017fa640 1 -- 172.21.15.87:0/3718954082 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4180540d0 con 0x559b7455b990 2024-05-08T18:32:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.434+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b7454d4f0 con 0x559b7455b990 2024-05-08T18:32:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.434+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b7454d990 con 0x559b7455b990 2024-05-08T18:32:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.435+0000 7fe3017fa640 1 -- 172.21.15.87:0/3718954082 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fe418033020 con 0x559b7455b990 2024-05-08T18:32:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.435+0000 7fe3017fa640 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe2e803bb50 0x7fe2e803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.436+0000 7fe3017fa640 1 -- 172.21.15.87:0/3718954082 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fe41800e040 con 0x559b7455b990 2024-05-08T18:32:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.436+0000 7fe41f7c3640 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe2e803bb50 0x7fe2e803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.436+0000 7fe423b1f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.436+0000 7fe423b1f800 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559b74570d80 0x559b74573240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.436+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b74573990 con 0x559b74570d80 2024-05-08T18:32:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.436+0000 7fe41efc2640 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559b74570d80 0x559b74573240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.436+0000 7fe41f7c3640 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe2e803bb50 0x7fe2e803e010 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe41004a3d0 tx=0x7fe410044000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.436+0000 7fe41efc2640 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559b74570d80 0x559b74573240 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.436+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.436+0000 7fe423b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.436+0000 7fe423b1f800 20 realm 2024-05-08T18:32:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.436+0000 7fe423b1f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.436+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b74573d60 con 0x559b74570d80 2024-05-08T18:32:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe423b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe423b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:32:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe423b1f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b74574630 con 0x559b74570d80 2024-05-08T18:32:16.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe423b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe423b1f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b745749d0 con 0x559b74570d80 2024-05-08T18:32:16.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe423b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:16.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe423b1f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b74574df0 con 0x559b74570d80 2024-05-08T18:32:16.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe423b1f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:32:16.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe423b1f800 20 searching for the correct realm 2024-05-08T18:32:16.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe423b1f800 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x559b74576df0 0x559b74579240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.437+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x559b74576df0 2024-05-08T18:32:16.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.438+0000 7fe41ffc4640 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x559b74576df0 0x559b74579240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.438+0000 7fe41ffc4640 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x559b74576df0 0x559b74579240 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.438+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe418029070 con 0x559b74576df0 2024-05-08T18:32:16.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.438+0000 7fe41ffc4640 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fe418035020 0x7fe4180469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.438+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x7fe418035020 2024-05-08T18:32:16.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.438+0000 7fe41f7c3640 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fe418035020 0x7fe4180469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.439+0000 7fe41f7c3640 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fe418035020 0x7fe4180469b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.439+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe410029030 con 0x7fe418035020 2024-05-08T18:32:16.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.439+0000 7fe41f7c3640 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fe41002c060 0x7fe41004f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.439+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x7fe41002c060 2024-05-08T18:32:16.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.439+0000 7fe41efc2640 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fe41002c060 0x7fe41004f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.439+0000 7fe41efc2640 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fe41002c060 0x7fe41004f6b0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.440+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.440+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x559b74570d80 2024-05-08T18:32:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.440+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.440+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x559b74570d80 2024-05-08T18:32:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.440+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.440+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x7fe41002c060 2024-05-08T18:32:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.440+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.440+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x7fe41002c060 2024-05-08T18:32:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.441+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.441+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x7fe418035020 2024-05-08T18:32:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.441+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe410029030 con 0x7fe418035020 2024-05-08T18:32:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.441+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x559b74576df0 2024-05-08T18:32:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.441+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe418029070 con 0x559b74576df0 2024-05-08T18:32:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.441+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x559b74570d80 2024-05-08T18:32:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.441+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.441+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x7fe41002c060 2024-05-08T18:32:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.442+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.442+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x559b74570d80 2024-05-08T18:32:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.442+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.442+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x7fe418035020 2024-05-08T18:32:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.442+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe410029030 con 0x7fe418035020 2024-05-08T18:32:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.442+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x559b74576df0 2024-05-08T18:32:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.442+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe418029070 con 0x559b74576df0 2024-05-08T18:32:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.443+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x559b74576df0 2024-05-08T18:32:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.443+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe418029070 con 0x559b74576df0 2024-05-08T18:32:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.443+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x7fe41002c060 2024-05-08T18:32:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.443+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.443+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x559b74576df0 2024-05-08T18:32:16.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.443+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe418029070 con 0x559b74576df0 2024-05-08T18:32:16.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.443+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x559b74576df0 2024-05-08T18:32:16.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.444+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe418029070 con 0x559b74576df0 2024-05-08T18:32:16.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.444+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x559b74570d80 2024-05-08T18:32:16.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.444+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.444+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x559b74570d80 2024-05-08T18:32:16.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.444+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.444+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x7fe41002c060 2024-05-08T18:32:16.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.444+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.444+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x559b74576df0 2024-05-08T18:32:16.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.445+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe418029070 con 0x559b74576df0 2024-05-08T18:32:16.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.445+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x7fe418035020 2024-05-08T18:32:16.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.445+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe410029030 con 0x7fe418035020 2024-05-08T18:32:16.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.445+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x559b74570d80 2024-05-08T18:32:16.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.445+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.445+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x7fe41002c060 2024-05-08T18:32:16.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.445+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.445+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x559b74576df0 2024-05-08T18:32:16.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.446+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe418029070 con 0x559b74576df0 2024-05-08T18:32:16.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.446+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x7fe418035020 2024-05-08T18:32:16.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.446+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe410029030 con 0x7fe418035020 2024-05-08T18:32:16.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.446+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x7fe418035020 2024-05-08T18:32:16.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.446+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe410029030 con 0x7fe418035020 2024-05-08T18:32:16.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.446+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x559b74576df0 2024-05-08T18:32:16.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.446+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe418029070 con 0x559b74576df0 2024-05-08T18:32:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.446+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x7fe418035020 2024-05-08T18:32:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe410029030 con 0x7fe418035020 2024-05-08T18:32:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x559b74570d80 2024-05-08T18:32:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b74579910 con 0x7fe418035020 2024-05-08T18:32:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe410029030 con 0x7fe418035020 2024-05-08T18:32:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe423b1f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:32:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe423b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:32:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe423b1f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:32:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe423b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:32:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe423b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:32:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe423b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:32:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe423b1f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b74575890 con 0x559b74570d80 2024-05-08T18:32:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe423b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe423b1f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b74576130 con 0x559b74570d80 2024-05-08T18:32:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe423b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.447+0000 7fe423b1f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.448+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b745754d0 con 0x7fe41002c060 2024-05-08T18:32:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.448+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.448+0000 7fe423b1f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:32:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.448+0000 7fe423b1f800 20 zone default found 2024-05-08T18:32:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.448+0000 7fe423b1f800 4 Realm: () 2024-05-08T18:32:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.448+0000 7fe423b1f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:32:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.448+0000 7fe423b1f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:32:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.448+0000 7fe423b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:32:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.448+0000 7fe423b1f800 20 zonegroup default 2024-05-08T18:32:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.448+0000 7fe423b1f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.448+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b74579de0 con 0x7fe41002c060 2024-05-08T18:32:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.448+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.448+0000 7fe423b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.448+0000 7fe423b1f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.448+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b7457bc70 con 0x559b74576df0 2024-05-08T18:32:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.448+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe418029070 con 0x559b74576df0 2024-05-08T18:32:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.449+0000 7fe423b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.449+0000 7fe423b1f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.449+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b7457c010 con 0x559b74576df0 2024-05-08T18:32:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.449+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe418029070 con 0x559b74576df0 2024-05-08T18:32:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.449+0000 7fe423b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.449+0000 7fe423b1f800 20 started sync module instance, tier type = 2024-05-08T18:32:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.449+0000 7fe423b1f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:32:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.449+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457b100 con 0x7fe418035020 2024-05-08T18:32:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.450+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe410029030 con 0x7fe418035020 2024-05-08T18:32:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.450+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94126160196848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457c860 con 0x7fe418035020 2024-05-08T18:32:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.450+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457d0b0 con 0x559b74570d80 2024-05-08T18:32:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.451+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94126160196848] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe410029030 con 0x7fe418035020 2024-05-08T18:32:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.451+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.451+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94126160200624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457d0f0 con 0x559b74570d80 2024-05-08T18:32:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.451+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457dc00 con 0x559b74576df0 2024-05-08T18:32:16.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.452+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94126160200624] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.453+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe418029070 con 0x559b74576df0 2024-05-08T18:32:16.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.453+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94126160205488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457dff0 con 0x559b74576df0 2024-05-08T18:32:16.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.453+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457ea30 con 0x7fe418035020 2024-05-08T18:32:16.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.454+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe410029030 con 0x7fe418035020 2024-05-08T18:32:16.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.454+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94126160209152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457ea30 con 0x7fe418035020 2024-05-08T18:32:16.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.454+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457fa30 con 0x559b74570d80 2024-05-08T18:32:16.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.454+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94126160205488] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe418029070 con 0x559b74576df0 2024-05-08T18:32:16.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.455+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.455+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94126160213280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457f9f0 con 0x559b74570d80 2024-05-08T18:32:16.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.455+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94126160209152] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe410029030 con 0x7fe418035020 2024-05-08T18:32:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.455+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457ee20 con 0x7fe41002c060 2024-05-08T18:32:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.456+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94126160213280] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.456+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.456+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94126160202752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457ee20 con 0x7fe41002c060 2024-05-08T18:32:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.456+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b74580930 con 0x7fe41002c060 2024-05-08T18:32:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.457+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94126160202752] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.457+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.457+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94126160215952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b74580860 con 0x7fe41002c060 2024-05-08T18:32:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.457+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b745812e0 con 0x7fe41002c060 2024-05-08T18:32:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.458+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94126160215952] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.458+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.458+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94126160217008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b745807d0 con 0x7fe41002c060 2024-05-08T18:32:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.458+0000 7fe423b1f800 20 add_watcher() i=0 2024-05-08T18:32:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.458+0000 7fe423b1f800 20 add_watcher() i=1 2024-05-08T18:32:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.458+0000 7fe423b1f800 20 add_watcher() i=2 2024-05-08T18:32:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.458+0000 7fe423b1f800 20 add_watcher() i=3 2024-05-08T18:32:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.458+0000 7fe423b1f800 20 add_watcher() i=4 2024-05-08T18:32:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.458+0000 7fe423b1f800 20 add_watcher() i=5 2024-05-08T18:32:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.458+0000 7fe423b1f800 20 add_watcher() i=6 2024-05-08T18:32:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.459+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94126160217008] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.459+0000 7fe423b1f800 20 add_watcher() i=7 2024-05-08T18:32:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.459+0000 7fe423b1f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:32:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.459+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b74584780 con 0x559b74570d80 2024-05-08T18:32:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.460+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.460+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94126160220832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b74581be0 con 0x559b74570d80 2024-05-08T18:32:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.461+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94126160220832] v29'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.461+0000 7fe2d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.461+0000 7fe423b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:32:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.461+0000 7fe423b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:32:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.461+0000 7fe423b1f800 5 note: GC not initialized 2024-05-08T18:32:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.461+0000 7fe2d4fe1640 20 reqs_thread_entry: start 2024-05-08T18:32:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.461+0000 7fe423b1f800 20 init_complete bucket index max shards: 11 2024-05-08T18:32:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.461+0000 7fe423b1f800 20 Filter name: none 2024-05-08T18:32:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.461+0000 7fe24e7fc640 20 reqs_thread_entry: start 2024-05-08T18:32:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.461+0000 7fe423b1f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.461+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b745b7620 con 0x559b74570d80 2024-05-08T18:32:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.462+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.462+0000 7fe423b1f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:32:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.462+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b745b8a10 con 0x7fe41002c060 2024-05-08T18:32:16.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.463+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.463+0000 7fe2d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.463+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94126160220832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b745b6270 con 0x559b74570d80 2024-05-08T18:32:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.464+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94126160220832] v29'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.464+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94126160196848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b745812a0 con 0x7fe418035020 2024-05-08T18:32:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.465+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94126160196848] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe410029030 con 0x7fe418035020 2024-05-08T18:32:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.465+0000 7fe423b1f800 20 remove_watcher() i=0 2024-05-08T18:32:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.465+0000 7fe423b1f800 2 removed watcher, disabling cache 2024-05-08T18:32:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.465+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94126160200624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457b4f0 con 0x559b74570d80 2024-05-08T18:32:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.467+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94126160200624] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.467+0000 7fe423b1f800 20 remove_watcher() i=1 2024-05-08T18:32:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.467+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94126160205488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457b4f0 con 0x559b74576df0 2024-05-08T18:32:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.468+0000 7fe41ffc4640 1 -- 172.21.15.87:0/3718954082 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94126160205488] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe418029070 con 0x559b74576df0 2024-05-08T18:32:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.468+0000 7fe423b1f800 20 remove_watcher() i=2 2024-05-08T18:32:16.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.468+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94126160209152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457d6b0 con 0x7fe418035020 2024-05-08T18:32:16.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.469+0000 7fe41f7c3640 1 -- 172.21.15.87:0/3718954082 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94126160209152] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe410029030 con 0x7fe418035020 2024-05-08T18:32:16.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.469+0000 7fe423b1f800 20 remove_watcher() i=3 2024-05-08T18:32:16.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.469+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94126160213280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457b4f0 con 0x559b74570d80 2024-05-08T18:32:16.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.470+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94126160213280] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x559b74570d80 2024-05-08T18:32:16.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.471+0000 7fe423b1f800 20 remove_watcher() i=4 2024-05-08T18:32:16.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.471+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94126160202752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457b4f0 con 0x7fe41002c060 2024-05-08T18:32:16.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.471+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94126160202752] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.471+0000 7fe423b1f800 20 remove_watcher() i=5 2024-05-08T18:32:16.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.471+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94126160215952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457cc00 con 0x7fe41002c060 2024-05-08T18:32:16.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.473+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94126160215952] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.473+0000 7fe423b1f800 20 remove_watcher() i=6 2024-05-08T18:32:16.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.473+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94126160217008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b7457cc00 con 0x7fe41002c060 2024-05-08T18:32:16.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94126160217008] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41405a040 con 0x7fe41002c060 2024-05-08T18:32:16.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 20 remove_watcher() i=7 2024-05-08T18:32:16.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fe41002c060 msgr2=0x7fe41004f6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fe41002c060 0x7fe41004f6b0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559b74570d80 msgr2=0x559b74573240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559b74570d80 0x559b74573240 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fe418035020 msgr2=0x7fe4180469b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fe418035020 0x7fe4180469b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x559b74576df0 msgr2=0x559b74579240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x559b74576df0 0x559b74579240 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe2e803bb50 msgr2=0x7fe2e803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe2e803bb50 0x7fe2e803e010 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe41004a3d0 tx=0x7fe410044000 comp rx=0 tx=0).stop 2024-05-08T18:32:16.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7455b990 msgr2=0x559b7454eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe41efc2640 1 -- 172.21.15.87:0/3718954082 reap_dead start 2024-05-08T18:32:16.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7455b990 0x559b7454eb70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe41804d010 tx=0x7fe418052900 comp rx=0 tx=0).stop 2024-05-08T18:32:16.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 shutdown_connections 2024-05-08T18:32:16.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 --2- 172.21.15.87:0/3718954082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7455b990 0x559b7454eb70 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 >> 172.21.15.87:0/3718954082 conn(0x559b74557ca0 msgr2=0x559b74555350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 shutdown_connections 2024-05-08T18:32:16.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 -- 172.21.15.87:0/3718954082 wait complete. 2024-05-08T18:32:16.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 -- 172.21.15.87:0/244516825 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe2f803bb50 msgr2=0x7fe2f803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 --2- 172.21.15.87:0/244516825 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe2f803bb50 0x7fe2f803e010 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe41000c710 tx=0x7fe410017d20 comp rx=0 tx=0).stop 2024-05-08T18:32:16.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 -- 172.21.15.87:0/244516825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7454f230 msgr2=0x559b74551620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 --2- 172.21.15.87:0/244516825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7454f230 0x559b74551620 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x559b745334b0 tx=0x7fe4180178e0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 -- 172.21.15.87:0/244516825 shutdown_connections 2024-05-08T18:32:16.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 --2- 172.21.15.87:0/244516825 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe2f803bb50 0x7fe2f803e010 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 --2- 172.21.15.87:0/244516825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b7454f230 0x559b74551620 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 -- 172.21.15.87:0/244516825 >> 172.21.15.87:0/244516825 conn(0x559b74541610 msgr2=0x559b74541a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 -- 172.21.15.87:0/244516825 shutdown_connections 2024-05-08T18:32:16.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.474+0000 7fe423b1f800 1 -- 172.21.15.87:0/244516825 wait complete. 2024-05-08T18:32:16.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.475+0000 7fe423b1f800 1 -- 172.21.15.87:0/2595953698 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559b7453ca00 msgr2=0x559b7453edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.475+0000 7fe423b1f800 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559b7453ca00 0x559b7453edf0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.475+0000 7fe423b1f800 1 -- 172.21.15.87:0/2595953698 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559b7443d640 msgr2=0x559b745392f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.475+0000 7fe423b1f800 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559b7443d640 0x559b745392f0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.475+0000 7fe423b1f800 1 -- 172.21.15.87:0/2595953698 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe30403bba0 msgr2=0x7fe30403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.475+0000 7fe423b1f800 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe30403bba0 0x7fe30403e060 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe414054000 tx=0x7fe41404e000 comp rx=0 tx=0).stop 2024-05-08T18:32:16.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.475+0000 7fe423b1f800 1 -- 172.21.15.87:0/2595953698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b74439690 msgr2=0x559b745320b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.475+0000 7fe423b1f800 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b74439690 0x559b745320b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe410004000 tx=0x7fe410000bc0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.475+0000 7fe423b1f800 1 -- 172.21.15.87:0/2595953698 shutdown_connections 2024-05-08T18:32:16.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.475+0000 7fe423b1f800 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559b7443d640 0x559b745392f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.475+0000 7fe423b1f800 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559b7453ca00 0x559b7453edf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.475+0000 7fe423b1f800 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe30403bba0 0x7fe30403e060 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.475+0000 7fe423b1f800 1 --2- 172.21.15.87:0/2595953698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b74439690 0x559b745320b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.475+0000 7fe423b1f800 1 -- 172.21.15.87:0/2595953698 >> 172.21.15.87:0/2595953698 conn(0x559b74433eb0 msgr2=0x559b74524650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.475+0000 7fe423b1f800 1 -- 172.21.15.87:0/2595953698 shutdown_connections 2024-05-08T18:32:16.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.475+0000 7fe423b1f800 1 -- 172.21.15.87:0/2595953698 wait complete. 2024-05-08T18:32:16.482 INFO:teuthology.orchestra.run.smithi087.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:32:16.482 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:32:16.483 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-05-08T18:32:16.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-05-08T18:32:16.483 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-05-08T18:32:16.529 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:32:16.529 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:32:16.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.531+0000 7fd74ca0e800 1 Processor -- start 2024-05-08T18:32:16.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.531+0000 7fd74ca0e800 1 -- start start 2024-05-08T18:32:16.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.531+0000 7fd74ca0e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5570557122c0 0x5570557126e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.531+0000 7fd74ca0e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557055712d60 con 0x557055713480 2024-05-08T18:32:16.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.531+0000 7fd74ca0e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5570555b2e20 con 0x5570557122c0 2024-05-08T18:32:16.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.532+0000 7fd74a506640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5570557122c0 0x5570557126e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.532+0000 7fd743fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x557055713480 0x557055713900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:40732/0 (socket says 172.21.15.87:40732) 2024-05-08T18:32:16.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.532+0000 7fd743fff640 1 -- 172.21.15.87:0/3685866967 learned_addr learned my addr 172.21.15.87:0/3685866967 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:32:16.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.532+0000 7fd74a506640 1 -- 172.21.15.87:0/3685866967 >> v1:172.21.15.53:6789/0 conn(0x557055713480 legacy=0x557055713900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.532+0000 7fd74a506640 1 -- 172.21.15.87:0/3685866967 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557055714040 con 0x5570557122c0 2024-05-08T18:32:16.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.534+0000 7fd74a506640 1 --2- 172.21.15.87:0/3685866967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 0x5570557126e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00a470 tx=0x7fd73c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23874b5480a8abab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.534+0000 7fd749d05640 1 -- 172.21.15.87:0/3685866967 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd73c057070 con 0x5570557122c0 2024-05-08T18:32:16.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.534+0000 7fd749d05640 1 -- 172.21.15.87:0/3685866967 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd73c04adc0 con 0x5570557122c0 2024-05-08T18:32:16.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.534+0000 7fd749d05640 1 -- 172.21.15.87:0/3685866967 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd73c052590 con 0x5570557122c0 2024-05-08T18:32:16.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.534+0000 7fd74ca0e800 1 -- 172.21.15.87:0/3685866967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 msgr2=0x5570557126e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.534+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/3685866967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 0x5570557126e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00a470 tx=0x7fd73c01ce90 comp rx=0 tx=0).stop 2024-05-08T18:32:16.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.535+0000 7fd74ca0e800 1 -- 172.21.15.87:0/3685866967 shutdown_connections 2024-05-08T18:32:16.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.535+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/3685866967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 0x5570557126e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.535+0000 7fd74ca0e800 1 -- 172.21.15.87:0/3685866967 >> 172.21.15.87:0/3685866967 conn(0x55705570d840 msgr2=0x55705570fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.535+0000 7fd74ca0e800 1 -- 172.21.15.87:0/3685866967 shutdown_connections 2024-05-08T18:32:16.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.535+0000 7fd74ca0e800 1 -- 172.21.15.87:0/3685866967 wait complete. 2024-05-08T18:32:16.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.548+0000 7fd74ca0e800 1 Processor -- start 2024-05-08T18:32:16.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.548+0000 7fd74ca0e800 1 -- start start 2024-05-08T18:32:16.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.549+0000 7fd74ca0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 0x5570558037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.549+0000 7fd74ca0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55705565d5c0 con 0x5570557122c0 2024-05-08T18:32:16.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.549+0000 7fd74a506640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 0x5570558037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.549+0000 7fd74a506640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 0x5570558037b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60742/0 (socket says 172.21.15.87:60742) 2024-05-08T18:32:16.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.549+0000 7fd74a506640 1 -- 172.21.15.87:0/1935417360 learned_addr learned my addr 172.21.15.87:0/1935417360 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.549+0000 7fd74a506640 1 -- 172.21.15.87:0/1935417360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557055803d80 con 0x5570557122c0 2024-05-08T18:32:16.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.549+0000 7fd74a506640 1 --2- 172.21.15.87:0/1935417360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 0x5570558037b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd73c055040 tx=0x7fd73c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367cb9c4131db9d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.550+0000 7fd638608640 1 -- 172.21.15.87:0/1935417360 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd73c057040 con 0x5570557122c0 2024-05-08T18:32:16.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.550+0000 7fd638608640 1 -- 172.21.15.87:0/1935417360 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd73c063070 con 0x5570557122c0 2024-05-08T18:32:16.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.550+0000 7fd638608640 1 -- 172.21.15.87:0/1935417360 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd73c05d790 con 0x5570557122c0 2024-05-08T18:32:16.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.550+0000 7fd74ca0e800 1 -- 172.21.15.87:0/1935417360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 msgr2=0x5570558037b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.550+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/1935417360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 0x5570558037b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd73c055040 tx=0x7fd73c04c000 comp rx=0 tx=0).stop 2024-05-08T18:32:16.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.550+0000 7fd74ca0e800 1 -- 172.21.15.87:0/1935417360 shutdown_connections 2024-05-08T18:32:16.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.550+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/1935417360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 0x5570558037b0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.550+0000 7fd74ca0e800 1 -- 172.21.15.87:0/1935417360 >> 172.21.15.87:0/1935417360 conn(0x55705570d840 msgr2=0x5570557ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.551+0000 7fd74ca0e800 1 -- 172.21.15.87:0/1935417360 shutdown_connections 2024-05-08T18:32:16.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.551+0000 7fd74ca0e800 1 -- 172.21.15.87:0/1935417360 wait complete. 2024-05-08T18:32:16.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.551+0000 7fd74ca0e800 1 Processor -- start 2024-05-08T18:32:16.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.551+0000 7fd74ca0e800 1 -- start start 2024-05-08T18:32:16.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.551+0000 7fd74ca0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 0x55705580b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.551+0000 7fd74ca0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55705571b950 con 0x5570557122c0 2024-05-08T18:32:16.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.551+0000 7fd74a506640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 0x55705580b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.551+0000 7fd74a506640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 0x55705580b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60752/0 (socket says 172.21.15.87:60752) 2024-05-08T18:32:16.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.551+0000 7fd74a506640 1 -- 172.21.15.87:0/2901312000 learned_addr learned my addr 172.21.15.87:0/2901312000 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.551+0000 7fd74a506640 1 -- 172.21.15.87:0/2901312000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55705580b7a0 con 0x5570557122c0 2024-05-08T18:32:16.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.552+0000 7fd74a506640 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 0x55705580b260 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00a470 tx=0x7fd73c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.552+0000 7fd636e05640 1 -- 172.21.15.87:0/2901312000 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd73c057050 con 0x5570557122c0 2024-05-08T18:32:16.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.552+0000 7fd636e05640 1 -- 172.21.15.87:0/2901312000 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd73c05dc90 con 0x5570557122c0 2024-05-08T18:32:16.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.552+0000 7fd74ca0e800 1 -- 172.21.15.87:0/2901312000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55705580ba30 con 0x5570557122c0 2024-05-08T18:32:16.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.552+0000 7fd636e05640 1 -- 172.21.15.87:0/2901312000 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd73c052440 con 0x5570557122c0 2024-05-08T18:32:16.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.552+0000 7fd74ca0e800 1 -- 172.21.15.87:0/2901312000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55705580e6e0 con 0x5570557122c0 2024-05-08T18:32:16.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.553+0000 7fd636e05640 1 -- 172.21.15.87:0/2901312000 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd73c052670 con 0x5570557122c0 2024-05-08T18:32:16.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.553+0000 7fd636e05640 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd63003bb50 0x7fd63003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.553+0000 7fd636e05640 1 -- 172.21.15.87:0/2901312000 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fd73c094060 con 0x5570557122c0 2024-05-08T18:32:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.553+0000 7fd743fff640 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd63003bb50 0x7fd63003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.553+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557055713480 0x5570558124a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.553+0000 7fd74ca0e800 1 -- 172.21.15.87:0/2901312000 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557055812a20 con 0x557055713480 2024-05-08T18:32:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.553+0000 7fd74ad07640 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557055713480 0x5570558124a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.553+0000 7fd743fff640 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd63003bb50 0x7fd63003e010 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd734000f60 tx=0x7fd7340012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.554+0000 7fd74ad07640 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557055713480 0x5570558124a0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.554+0000 7fd74ad07640 1 -- 172.21.15.87:0/2901312000 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd74400a4a0 con 0x557055713480 2024-05-08T18:32:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.554+0000 7fd74ca0e800 1 -- 172.21.15.87:0/2901312000 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55705580fa70 con 0x557055713480 2024-05-08T18:32:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.554+0000 7fd74ad07640 1 -- 172.21.15.87:0/2901312000 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd74400a4a0 con 0x557055713480 2024-05-08T18:32:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.554+0000 7fd74ca0e800 1 -- 172.21.15.87:0/2901312000 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557055814820 con 0x557055713480 2024-05-08T18:32:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.554+0000 7fd74ad07640 1 -- 172.21.15.87:0/2901312000 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd74400a4a0 con 0x557055713480 2024-05-08T18:32:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.555+0000 7fd74ca0e800 1 -- 172.21.15.87:0/2901312000 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557055813a50 con 0x557055713480 2024-05-08T18:32:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.555+0000 7fd74ad07640 1 -- 172.21.15.87:0/2901312000 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd74400a4a0 con 0x557055713480 2024-05-08T18:32:16.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.555+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x557055815bd0 0x557055817fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.555+0000 7fd74ca0e800 1 -- 172.21.15.87:0/2901312000 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557055818500 con 0x557055815bd0 2024-05-08T18:32:16.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.555+0000 7fd74a506640 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x557055815bd0 0x557055817fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.555+0000 7fd74a506640 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x557055815bd0 0x557055817fc0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.556+0000 7fd74a506640 1 -- 172.21.15.87:0/2901312000 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd73c078070 con 0x557055815bd0 2024-05-08T18:32:16.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.556+0000 7fd74ca0e800 1 Processor -- start 2024-05-08T18:32:16.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.556+0000 7fd74ca0e800 1 -- start start 2024-05-08T18:32:16.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.556+0000 7fd74ca0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055826740 0x557055826b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.556+0000 7fd74ca0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557055603fc0 con 0x557055826740 2024-05-08T18:32:16.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.556+0000 7fd74ad07640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055826740 0x557055826b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.556+0000 7fd74ad07640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055826740 0x557055826b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60760/0 (socket says 172.21.15.87:60760) 2024-05-08T18:32:16.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.556+0000 7fd74ad07640 1 -- 172.21.15.87:0/79683670 learned_addr learned my addr 172.21.15.87:0/79683670 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.557+0000 7fd74ad07640 1 -- 172.21.15.87:0/79683670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570558270a0 con 0x557055826740 2024-05-08T18:32:16.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.557+0000 7fd74ad07640 1 --2- 172.21.15.87:0/79683670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055826740 0x557055826b60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x55705580c660 tx=0x7fd7440178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.557+0000 7fd62ffff640 1 -- 172.21.15.87:0/79683670 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd744013440 con 0x557055826740 2024-05-08T18:32:16.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.557+0000 7fd62ffff640 1 -- 172.21.15.87:0/79683670 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7440135e0 con 0x557055826740 2024-05-08T18:32:16.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.557+0000 7fd74ca0e800 1 -- 172.21.15.87:0/79683670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557055827b10 con 0x557055826740 2024-05-08T18:32:16.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.557+0000 7fd62ffff640 1 -- 172.21.15.87:0/79683670 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7440138c0 con 0x557055826740 2024-05-08T18:32:16.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.557+0000 7fd74ca0e800 1 -- 172.21.15.87:0/79683670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557055828010 con 0x557055826740 2024-05-08T18:32:16.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.558+0000 7fd62ffff640 1 -- 172.21.15.87:0/79683670 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd744011040 con 0x557055826740 2024-05-08T18:32:16.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.558+0000 7fd62ffff640 1 --2- 172.21.15.87:0/79683670 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd62403bb50 0x7fd62403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.558+0000 7fd62ffff640 1 -- 172.21.15.87:0/79683670 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fd74401d070 con 0x557055826740 2024-05-08T18:32:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.558+0000 7fd74a506640 1 --2- 172.21.15.87:0/79683670 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd62403bb50 0x7fd62403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.558+0000 7fd74ca0e800 1 Processor -- start 2024-05-08T18:32:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.559+0000 7fd74ca0e800 1 -- start start 2024-05-08T18:32:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.559+0000 7fd74a506640 1 --2- 172.21.15.87:0/79683670 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd62403bb50 0x7fd62403e010 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd73c05ead0 tx=0x7fd73c07e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.559+0000 7fd74ca0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055687930 0x557055687d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.559+0000 7fd74ca0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557055804040 con 0x557055687930 2024-05-08T18:32:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.559+0000 7fd74ad07640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055687930 0x557055687d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.559+0000 7fd74ad07640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055687930 0x557055687d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60776/0 (socket says 172.21.15.87:60776) 2024-05-08T18:32:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.559+0000 7fd74ad07640 1 -- 172.21.15.87:0/785992100 learned_addr learned my addr 172.21.15.87:0/785992100 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.559+0000 7fd74ad07640 1 -- 172.21.15.87:0/785992100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557055686130 con 0x557055687930 2024-05-08T18:32:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.559+0000 7fd74ad07640 1 --2- 172.21.15.87:0/785992100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055687930 0x557055687d50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd7440529a0 tx=0x7fd744001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cd0e18717f00c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.559+0000 7fd62dffb640 1 -- 172.21.15.87:0/785992100 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd74402ad80 con 0x557055687930 2024-05-08T18:32:16.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.559+0000 7fd62dffb640 1 -- 172.21.15.87:0/785992100 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7440014f0 con 0x557055687930 2024-05-08T18:32:16.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.559+0000 7fd62dffb640 1 -- 172.21.15.87:0/785992100 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7440017f0 con 0x557055687930 2024-05-08T18:32:16.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.560+0000 7fd74ca0e800 1 -- 172.21.15.87:0/785992100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055687930 msgr2=0x557055687d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.560+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/785992100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055687930 0x557055687d50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd7440529a0 tx=0x7fd744001e60 comp rx=0 tx=0).stop 2024-05-08T18:32:16.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.560+0000 7fd74ca0e800 1 -- 172.21.15.87:0/785992100 shutdown_connections 2024-05-08T18:32:16.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.560+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/785992100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055687930 0x557055687d50 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.560+0000 7fd74ca0e800 1 -- 172.21.15.87:0/785992100 >> 172.21.15.87:0/785992100 conn(0x55705582fdc0 msgr2=0x55705582de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.560+0000 7fd74ca0e800 1 -- 172.21.15.87:0/785992100 shutdown_connections 2024-05-08T18:32:16.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.560+0000 7fd74ca0e800 1 -- 172.21.15.87:0/785992100 wait complete. 2024-05-08T18:32:16.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.560+0000 7fd74ca0e800 1 Processor -- start 2024-05-08T18:32:16.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.560+0000 7fd74ca0e800 1 -- start start 2024-05-08T18:32:16.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.560+0000 7fd74ca0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055687930 0x55705583d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.560+0000 7fd74ca0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557055686600 con 0x557055687930 2024-05-08T18:32:16.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.561+0000 7fd74ad07640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055687930 0x55705583d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.561+0000 7fd74ad07640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055687930 0x55705583d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60790/0 (socket says 172.21.15.87:60790) 2024-05-08T18:32:16.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.561+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 learned_addr learned my addr 172.21.15.87:0/970748799 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.561+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55705583d760 con 0x557055687930 2024-05-08T18:32:16.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.561+0000 7fd74ad07640 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055687930 0x55705583d220 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd74404d010 tx=0x7fd744052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.561+0000 7fd61bfff640 1 -- 172.21.15.87:0/970748799 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd744030020 con 0x557055687930 2024-05-08T18:32:16.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.561+0000 7fd61bfff640 1 -- 172.21.15.87:0/970748799 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd744013a60 con 0x557055687930 2024-05-08T18:32:16.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.561+0000 7fd61bfff640 1 -- 172.21.15.87:0/970748799 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd74404b070 con 0x557055687930 2024-05-08T18:32:16.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.561+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55705583d9f0 con 0x557055687930 2024-05-08T18:32:16.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.561+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570558406a0 con 0x557055687930 2024-05-08T18:32:16.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.562+0000 7fd61bfff640 1 -- 172.21.15.87:0/970748799 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd744033020 con 0x557055687930 2024-05-08T18:32:16.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.562+0000 7fd61bfff640 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd61403bb50 0x7fd61403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.562+0000 7fd61bfff640 1 -- 172.21.15.87:0/970748799 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fd74400e040 con 0x557055687930 2024-05-08T18:32:16.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.562+0000 7fd74a506640 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd61403bb50 0x7fd61403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.562+0000 7fd74ca0e800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.562+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557055848e80 0x55705584b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.562+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55705584ba90 con 0x557055848e80 2024-05-08T18:32:16.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.563+0000 7fd743fff640 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557055848e80 0x55705584b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.563+0000 7fd74a506640 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd61403bb50 0x7fd61403e010 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd73c05c6e0 tx=0x7fd73c084000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.563+0000 7fd743fff640 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557055848e80 0x55705584b340 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.563+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd734009050 con 0x557055848e80 2024-05-08T18:32:16.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.563+0000 7fd74ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.563+0000 7fd74ca0e800 20 realm 2024-05-08T18:32:16.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.563+0000 7fd74ca0e800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.563+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557055848320 con 0x557055848e80 2024-05-08T18:32:16.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.563+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd734009050 con 0x557055848e80 2024-05-08T18:32:16.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.563+0000 7fd74ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.563+0000 7fd74ca0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:32:16.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.563+0000 7fd74ca0e800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.563+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55705584c570 con 0x557055848e80 2024-05-08T18:32:16.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.564+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd734009050 con 0x557055848e80 2024-05-08T18:32:16.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.564+0000 7fd74ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.564+0000 7fd74ca0e800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.564+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55705584ce40 con 0x557055848e80 2024-05-08T18:32:16.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.564+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd734009050 con 0x557055848e80 2024-05-08T18:32:16.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.564+0000 7fd74ca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:16.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.564+0000 7fd74ca0e800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.564+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55705584d1e0 con 0x557055848e80 2024-05-08T18:32:16.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.564+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd734009050 con 0x557055848e80 2024-05-08T18:32:16.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.564+0000 7fd74ca0e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:32:16.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.564+0000 7fd74ca0e800 20 searching for the correct realm 2024-05-08T18:32:16.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.564+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55705584f0c0 0x5570558514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.564+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x55705584f0c0 2024-05-08T18:32:16.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.564+0000 7fd74ad07640 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55705584f0c0 0x5570558514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.564+0000 7fd74ad07640 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55705584f0c0 0x5570558514b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.565+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd744029070 con 0x55705584f0c0 2024-05-08T18:32:16.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.565+0000 7fd74ad07640 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd744035020 0x7fd7440404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.565+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x7fd744035020 2024-05-08T18:32:16.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.565+0000 7fd74a506640 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd744035020 0x7fd7440404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.565+0000 7fd74a506640 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd744035020 0x7fd7440404c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.566+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73c078070 con 0x7fd744035020 2024-05-08T18:32:16.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.566+0000 7fd74a506640 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd73c05b590 0x7fd73c0924f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.566+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x7fd73c05b590 2024-05-08T18:32:16.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.566+0000 7fd743fff640 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd73c05b590 0x7fd73c0924f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.566+0000 7fd743fff640 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd73c05b590 0x7fd73c0924f0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.566+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd734009050 con 0x7fd73c05b590 2024-05-08T18:32:16.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.566+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x557055848e80 2024-05-08T18:32:16.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.567+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd734009050 con 0x557055848e80 2024-05-08T18:32:16.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.567+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x557055848e80 2024-05-08T18:32:16.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.567+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.567+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x7fd73c05b590 2024-05-08T18:32:16.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.567+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.567+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x7fd73c05b590 2024-05-08T18:32:16.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.567+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.567+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x7fd744035020 2024-05-08T18:32:16.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.568+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73c078070 con 0x7fd744035020 2024-05-08T18:32:16.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.568+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x55705584f0c0 2024-05-08T18:32:16.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.568+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd744029070 con 0x55705584f0c0 2024-05-08T18:32:16.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.568+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x557055848e80 2024-05-08T18:32:16.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.568+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.568+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x7fd73c05b590 2024-05-08T18:32:16.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.568+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.568+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x557055848e80 2024-05-08T18:32:16.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.569+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.569+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x7fd744035020 2024-05-08T18:32:16.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.569+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd73c078070 con 0x7fd744035020 2024-05-08T18:32:16.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.569+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x55705584f0c0 2024-05-08T18:32:16.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.569+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd744029070 con 0x55705584f0c0 2024-05-08T18:32:16.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.569+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x55705584f0c0 2024-05-08T18:32:16.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.569+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd744029070 con 0x55705584f0c0 2024-05-08T18:32:16.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.569+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x7fd73c05b590 2024-05-08T18:32:16.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.570+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.570+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x55705584f0c0 2024-05-08T18:32:16.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.570+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd744029070 con 0x55705584f0c0 2024-05-08T18:32:16.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.570+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x55705584f0c0 2024-05-08T18:32:16.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.570+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd744029070 con 0x55705584f0c0 2024-05-08T18:32:16.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.570+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x557055848e80 2024-05-08T18:32:16.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.570+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.570+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x557055848e80 2024-05-08T18:32:16.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.571+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.571+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x7fd73c05b590 2024-05-08T18:32:16.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.571+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.571+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x55705584f0c0 2024-05-08T18:32:16.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.571+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd744029070 con 0x55705584f0c0 2024-05-08T18:32:16.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.571+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x7fd744035020 2024-05-08T18:32:16.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.571+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73c078070 con 0x7fd744035020 2024-05-08T18:32:16.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.571+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x557055848e80 2024-05-08T18:32:16.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.572+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.572+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x7fd73c05b590 2024-05-08T18:32:16.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.572+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.572+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x55705584f0c0 2024-05-08T18:32:16.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.572+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd744029070 con 0x55705584f0c0 2024-05-08T18:32:16.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.572+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x7fd744035020 2024-05-08T18:32:16.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.573+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73c078070 con 0x7fd744035020 2024-05-08T18:32:16.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.573+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x7fd744035020 2024-05-08T18:32:16.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.573+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73c078070 con 0x7fd744035020 2024-05-08T18:32:16.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.573+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x55705584f0c0 2024-05-08T18:32:16.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.573+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd744029070 con 0x55705584f0c0 2024-05-08T18:32:16.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.573+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x7fd744035020 2024-05-08T18:32:16.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.573+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73c078070 con 0x7fd744035020 2024-05-08T18:32:16.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.573+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x557055848e80 2024-05-08T18:32:16.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.573+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.573+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557055851b60 con 0x7fd744035020 2024-05-08T18:32:16.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.574+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73c078070 con 0x7fd744035020 2024-05-08T18:32:16.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.574+0000 7fd74ca0e800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:32:16.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.574+0000 7fd74ca0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:32:16.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.574+0000 7fd74ca0e800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:32:16.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.574+0000 7fd74ca0e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:32:16.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.574+0000 7fd74ca0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:32:16.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.574+0000 7fd74ca0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:32:16.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.574+0000 7fd74ca0e800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.574+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55705584db60 con 0x557055848e80 2024-05-08T18:32:16.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.574+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.574+0000 7fd74ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.574+0000 7fd74ca0e800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.574+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55705584e400 con 0x557055848e80 2024-05-08T18:32:16.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.574+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.574+0000 7fd74ca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:16.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.574+0000 7fd74ca0e800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.574+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55705584d7a0 con 0x7fd73c05b590 2024-05-08T18:32:16.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:32:16.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 20 zone default found 2024-05-08T18:32:16.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 4 Realm: () 2024-05-08T18:32:16.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:32:16.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:32:16.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:32:16.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 20 zonegroup default 2024-05-08T18:32:16.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557055851fc0 con 0x7fd73c05b590 2024-05-08T18:32:16.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557055853e50 con 0x55705584f0c0 2024-05-08T18:32:16.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd744029070 con 0x55705584f0c0 2024-05-08T18:32:16.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5570558541f0 con 0x55705584f0c0 2024-05-08T18:32:16.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd744029070 con 0x55705584f0c0 2024-05-08T18:32:16.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 20 started sync module instance, tier type = 2024-05-08T18:32:16.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:32:16.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.575+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557055853290 con 0x7fd744035020 2024-05-08T18:32:16.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.577+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73c078070 con 0x7fd744035020 2024-05-08T18:32:16.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.577+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93940959491760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557055854a40 con 0x7fd744035020 2024-05-08T18:32:16.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.577+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557055855290 con 0x557055848e80 2024-05-08T18:32:16.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.578+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93940959491760] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73c078070 con 0x7fd744035020 2024-05-08T18:32:16.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.578+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.578+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93940959495568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557055855290 con 0x557055848e80 2024-05-08T18:32:16.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.578+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557055855db0 con 0x55705584f0c0 2024-05-08T18:32:16.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.579+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd744029070 con 0x55705584f0c0 2024-05-08T18:32:16.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.579+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93940959495568] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.579+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93940959500416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5570558561a0 con 0x55705584f0c0 2024-05-08T18:32:16.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.579+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557055856bd0 con 0x7fd744035020 2024-05-08T18:32:16.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.580+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73c078070 con 0x7fd744035020 2024-05-08T18:32:16.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.580+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93940959504096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5570558574a0 con 0x7fd744035020 2024-05-08T18:32:16.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.580+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93940959500416] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd744029070 con 0x55705584f0c0 2024-05-08T18:32:16.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.580+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557055857f80 con 0x557055848e80 2024-05-08T18:32:16.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.581+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.581+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93940959497776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557055857f80 con 0x557055848e80 2024-05-08T18:32:16.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.581+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5570558589a0 con 0x7fd73c05b590 2024-05-08T18:32:16.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.581+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93940959504096] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73c078070 con 0x7fd744035020 2024-05-08T18:32:16.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.582+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.582+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93940959497776] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.582+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93940959511696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557055858960 con 0x7fd73c05b590 2024-05-08T18:32:16.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.582+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557055857a90 con 0x7fd73c05b590 2024-05-08T18:32:16.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.583+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(56 notify.6 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.583+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93940959514368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557055857a90 con 0x7fd73c05b590 2024-05-08T18:32:16.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.583+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557055859df0 con 0x7fd73c05b590 2024-05-08T18:32:16.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.583+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93940959511696] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.584+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(58 notify.7 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.584+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93940959514368] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.584+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93940959506416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557055859940 con 0x7fd73c05b590 2024-05-08T18:32:16.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.584+0000 7fd74ca0e800 20 add_watcher() i=0 2024-05-08T18:32:16.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.584+0000 7fd74ca0e800 20 add_watcher() i=1 2024-05-08T18:32:16.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.584+0000 7fd74ca0e800 20 add_watcher() i=2 2024-05-08T18:32:16.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.584+0000 7fd74ca0e800 20 add_watcher() i=3 2024-05-08T18:32:16.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.584+0000 7fd74ca0e800 20 add_watcher() i=4 2024-05-08T18:32:16.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.584+0000 7fd74ca0e800 20 add_watcher() i=5 2024-05-08T18:32:16.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.584+0000 7fd74ca0e800 20 add_watcher() i=6 2024-05-08T18:32:16.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.585+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93940959506416] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.585+0000 7fd74ca0e800 20 add_watcher() i=7 2024-05-08T18:32:16.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.585+0000 7fd74ca0e800 2 all 8 watchers are set, enabling cache 2024-05-08T18:32:16.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.585+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55705585ce20 con 0x557055848e80 2024-05-08T18:32:16.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.586+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.586+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93940959516992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55705585a210 con 0x557055848e80 2024-05-08T18:32:16.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.587+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93940959516992] v29'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.587+0000 7fd600fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:16.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.587+0000 7fd74ca0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:32:16.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.587+0000 7fd74ca0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:32:16.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.587+0000 7fd74ca0e800 5 note: GC not initialized 2024-05-08T18:32:16.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.587+0000 7fd57b7fe640 20 reqs_thread_entry: start 2024-05-08T18:32:16.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.587+0000 7fd74ca0e800 20 init_complete bucket index max shards: 11 2024-05-08T18:32:16.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.587+0000 7fd74ca0e800 20 Filter name: none 2024-05-08T18:32:16.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.587+0000 7fd5797fa640 20 reqs_thread_entry: start 2024-05-08T18:32:16.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.587+0000 7fd74ca0e800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.587+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55705588fc80 con 0x557055848e80 2024-05-08T18:32:16.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.588+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.588+0000 7fd74ca0e800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:32:16.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.588+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557055891070 con 0x7fd73c05b590 2024-05-08T18:32:16.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.588+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.589+0000 7fd600fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:16.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.589+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93940959516992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55705585a210 con 0x557055848e80 2024-05-08T18:32:16.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.590+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93940959516992] v29'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.590+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93940959491760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557055859df0 con 0x7fd744035020 2024-05-08T18:32:16.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.591+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93940959491760] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73c078070 con 0x7fd744035020 2024-05-08T18:32:16.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.591+0000 7fd74ca0e800 20 remove_watcher() i=0 2024-05-08T18:32:16.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.591+0000 7fd74ca0e800 2 removed watcher, disabling cache 2024-05-08T18:32:16.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.591+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93940959495568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5570558536b0 con 0x557055848e80 2024-05-08T18:32:16.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.593+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93940959495568] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.593+0000 7fd74ca0e800 20 remove_watcher() i=1 2024-05-08T18:32:16.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.593+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93940959500416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5570558536b0 con 0x55705584f0c0 2024-05-08T18:32:16.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.594+0000 7fd74ad07640 1 -- 172.21.15.87:0/970748799 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93940959500416] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd744029070 con 0x55705584f0c0 2024-05-08T18:32:16.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.594+0000 7fd74ca0e800 20 remove_watcher() i=2 2024-05-08T18:32:16.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.594+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93940959504096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557055855880 con 0x7fd744035020 2024-05-08T18:32:16.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.595+0000 7fd74a506640 1 -- 172.21.15.87:0/970748799 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93940959504096] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73c078070 con 0x7fd744035020 2024-05-08T18:32:16.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.595+0000 7fd74ca0e800 20 remove_watcher() i=3 2024-05-08T18:32:16.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.595+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93940959497776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5570558536b0 con 0x557055848e80 2024-05-08T18:32:16.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.596+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93940959497776] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x557055848e80 2024-05-08T18:32:16.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.596+0000 7fd74ca0e800 20 remove_watcher() i=4 2024-05-08T18:32:16.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.596+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93940959511696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557055855880 con 0x7fd73c05b590 2024-05-08T18:32:16.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.597+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93940959511696] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.597+0000 7fd74ca0e800 20 remove_watcher() i=5 2024-05-08T18:32:16.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.597+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93940959514368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5570558536b0 con 0x7fd73c05b590 2024-05-08T18:32:16.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.598+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93940959514368] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.598+0000 7fd74ca0e800 20 remove_watcher() i=6 2024-05-08T18:32:16.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.598+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93940959506416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557055858490 con 0x7fd73c05b590 2024-05-08T18:32:16.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93940959506416] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73402a040 con 0x7fd73c05b590 2024-05-08T18:32:16.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 20 remove_watcher() i=7 2024-05-08T18:32:16.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd73c05b590 msgr2=0x7fd73c0924f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fd73c05b590 0x7fd73c0924f0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557055848e80 msgr2=0x55705584b340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557055848e80 0x55705584b340 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd744035020 msgr2=0x7fd7440404c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fd744035020 0x7fd7440404c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55705584f0c0 msgr2=0x5570558514b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55705584f0c0 0x5570558514b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd61403bb50 msgr2=0x7fd61403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd61403bb50 0x7fd61403e010 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd73c05c6e0 tx=0x7fd73c084000 comp rx=0 tx=0).stop 2024-05-08T18:32:16.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055687930 msgr2=0x55705583d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd743fff640 1 -- 172.21.15.87:0/970748799 reap_dead start 2024-05-08T18:32:16.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055687930 0x55705583d220 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd74404d010 tx=0x7fd744052900 comp rx=0 tx=0).stop 2024-05-08T18:32:16.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 shutdown_connections 2024-05-08T18:32:16.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/970748799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055687930 0x55705583d220 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 >> 172.21.15.87:0/970748799 conn(0x55705582fdc0 msgr2=0x55705582d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 shutdown_connections 2024-05-08T18:32:16.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 -- 172.21.15.87:0/970748799 wait complete. 2024-05-08T18:32:16.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 -- 172.21.15.87:0/79683670 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd62403bb50 msgr2=0x7fd62403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/79683670 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd62403bb50 0x7fd62403e010 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd73c05ead0 tx=0x7fd73c07e040 comp rx=0 tx=0).stop 2024-05-08T18:32:16.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 -- 172.21.15.87:0/79683670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055826740 msgr2=0x557055826b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.599+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/79683670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055826740 0x557055826b60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x55705580c660 tx=0x7fd7440178e0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 -- 172.21.15.87:0/79683670 shutdown_connections 2024-05-08T18:32:16.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/79683670 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd62403bb50 0x7fd62403e010 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/79683670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557055826740 0x557055826b60 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 -- 172.21.15.87:0/79683670 >> 172.21.15.87:0/79683670 conn(0x55705581a7e0 msgr2=0x55705581abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 -- 172.21.15.87:0/79683670 shutdown_connections 2024-05-08T18:32:16.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 -- 172.21.15.87:0/79683670 wait complete. 2024-05-08T18:32:16.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 -- 172.21.15.87:0/2901312000 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x557055815bd0 msgr2=0x557055817fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x557055815bd0 0x557055817fc0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 -- 172.21.15.87:0/2901312000 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557055713480 msgr2=0x5570558124a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557055713480 0x5570558124a0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 -- 172.21.15.87:0/2901312000 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd63003bb50 msgr2=0x7fd63003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd63003bb50 0x7fd63003e010 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd734000f60 tx=0x7fd7340012b0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 -- 172.21.15.87:0/2901312000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 msgr2=0x55705580b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 0x55705580b260 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00a470 tx=0x7fd73c002fb0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 -- 172.21.15.87:0/2901312000 shutdown_connections 2024-05-08T18:32:16.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557055713480 0x5570558124a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x557055815bd0 0x557055817fc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fd63003bb50 0x7fd63003e010 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 --2- 172.21.15.87:0/2901312000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570557122c0 0x55705580b260 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 -- 172.21.15.87:0/2901312000 >> 172.21.15.87:0/2901312000 conn(0x55705570d840 msgr2=0x5570557fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 -- 172.21.15.87:0/2901312000 shutdown_connections 2024-05-08T18:32:16.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.600+0000 7fd74ca0e800 1 -- 172.21.15.87:0/2901312000 wait complete. 2024-05-08T18:32:16.609 INFO:teuthology.orchestra.run.smithi087.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:32:16.609 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:32:16.609 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-05-08T18:32:16.609 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-05-08T18:32:16.610 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-05-08T18:32:16.655 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:32:16.656 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:32:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.658+0000 7fef1e9a2800 1 Processor -- start 2024-05-08T18:32:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.658+0000 7fef1e9a2800 1 -- start start 2024-05-08T18:32:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.658+0000 7fef1e9a2800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563c755037f0 0x563c75505be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.658+0000 7fef1e9a2800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563c75506120 con 0x563c754ffce0 2024-05-08T18:32:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.658+0000 7fef1e9a2800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x563c7539fe20 con 0x563c755037f0 2024-05-08T18:32:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.658+0000 7fef1bc99640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563c755037f0 0x563c75505be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.659+0000 7fef1c49a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x563c754ffce0 0x563c755020d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:40738/0 (socket says 172.21.15.87:40738) 2024-05-08T18:32:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.659+0000 7fef1c49a640 1 -- 172.21.15.87:0/3289875909 learned_addr learned my addr 172.21.15.87:0/3289875909 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:32:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.659+0000 7fef1bc99640 1 -- 172.21.15.87:0/3289875909 >> v1:172.21.15.53:6789/0 conn(0x563c754ffce0 legacy=0x563c755020d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.659+0000 7fef1bc99640 1 -- 172.21.15.87:0/3289875909 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c75507300 con 0x563c755037f0 2024-05-08T18:32:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.661+0000 7fef1bc99640 1 --2- 172.21.15.87:0/3289875909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c755037f0 0x563c75505be0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fef1000a470 tx=0x7fef1001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5c81f2733d596d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.661+0000 7fef1b498640 1 -- 172.21.15.87:0/3289875909 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef10057070 con 0x563c755037f0 2024-05-08T18:32:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.661+0000 7fef1b498640 1 -- 172.21.15.87:0/3289875909 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef10052570 con 0x563c755037f0 2024-05-08T18:32:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.661+0000 7fef1b498640 1 -- 172.21.15.87:0/3289875909 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef10052870 con 0x563c755037f0 2024-05-08T18:32:16.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.661+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3289875909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c755037f0 msgr2=0x563c75505be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.661+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/3289875909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c755037f0 0x563c75505be0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fef1000a470 tx=0x7fef1001ce90 comp rx=0 tx=0).stop 2024-05-08T18:32:16.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.661+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3289875909 shutdown_connections 2024-05-08T18:32:16.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.661+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/3289875909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c755037f0 0x563c75505be0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.661+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3289875909 >> 172.21.15.87:0/3289875909 conn(0x563c754f9730 msgr2=0x563c754fbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.661+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3289875909 shutdown_connections 2024-05-08T18:32:16.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.661+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3289875909 wait complete. 2024-05-08T18:32:16.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.675+0000 7fef1e9a2800 1 Processor -- start 2024-05-08T18:32:16.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.675+0000 7fef1e9a2800 1 -- start start 2024-05-08T18:32:16.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.675+0000 7fef1e9a2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c754ffce0 0x563c754ff620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.675+0000 7fef1e9a2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c7544a5c0 con 0x563c754ffce0 2024-05-08T18:32:16.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.676+0000 7fef1c49a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c754ffce0 0x563c754ff620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.676+0000 7fef1c49a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c754ffce0 0x563c754ff620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60798/0 (socket says 172.21.15.87:60798) 2024-05-08T18:32:16.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.676+0000 7fef1c49a640 1 -- 172.21.15.87:0/1959333069 learned_addr learned my addr 172.21.15.87:0/1959333069 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.676+0000 7fef1c49a640 1 -- 172.21.15.87:0/1959333069 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c754fdbe0 con 0x563c754ffce0 2024-05-08T18:32:16.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.676+0000 7fef1c49a640 1 --2- 172.21.15.87:0/1959333069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c754ffce0 0x563c754ff620 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fef0c001de0 tx=0x7fef0c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=860403e5cb29e5d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.676+0000 7fee0a60c640 1 -- 172.21.15.87:0/1959333069 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0c012020 con 0x563c754ffce0 2024-05-08T18:32:16.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.676+0000 7fee0a60c640 1 -- 172.21.15.87:0/1959333069 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0c00e5a0 con 0x563c754ffce0 2024-05-08T18:32:16.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.676+0000 7fee0a60c640 1 -- 172.21.15.87:0/1959333069 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0c00e8c0 con 0x563c754ffce0 2024-05-08T18:32:16.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.677+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1959333069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c754ffce0 msgr2=0x563c754ff620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.677+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/1959333069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c754ffce0 0x563c754ff620 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fef0c001de0 tx=0x7fef0c00b6c0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.677+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1959333069 shutdown_connections 2024-05-08T18:32:16.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.677+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/1959333069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c754ffce0 0x563c754ff620 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.677+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1959333069 >> 172.21.15.87:0/1959333069 conn(0x563c754f9730 msgr2=0x563c755ebff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.677+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1959333069 shutdown_connections 2024-05-08T18:32:16.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.677+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1959333069 wait complete. 2024-05-08T18:32:16.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.677+0000 7fef1e9a2800 1 Processor -- start 2024-05-08T18:32:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.677+0000 7fef1e9a2800 1 -- start start 2024-05-08T18:32:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.678+0000 7fef1e9a2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c754ffce0 0x563c755fa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.678+0000 7fef1e9a2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c755065f0 con 0x563c754ffce0 2024-05-08T18:32:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.678+0000 7fef1c49a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c754ffce0 0x563c755fa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.678+0000 7fef1c49a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c754ffce0 0x563c755fa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60816/0 (socket says 172.21.15.87:60816) 2024-05-08T18:32:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.678+0000 7fef1c49a640 1 -- 172.21.15.87:0/1336405497 learned_addr learned my addr 172.21.15.87:0/1336405497 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.678+0000 7fef1c49a640 1 -- 172.21.15.87:0/1336405497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c755fa9b0 con 0x563c754ffce0 2024-05-08T18:32:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.678+0000 7fef1c49a640 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c754ffce0 0x563c755fa470 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00c010 tx=0x7fef0c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.678+0000 7fee08e09640 1 -- 172.21.15.87:0/1336405497 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0c012070 con 0x563c754ffce0 2024-05-08T18:32:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.678+0000 7fee08e09640 1 -- 172.21.15.87:0/1336405497 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0c01a7a0 con 0x563c754ffce0 2024-05-08T18:32:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.678+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1336405497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c755fac40 con 0x563c754ffce0 2024-05-08T18:32:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.678+0000 7fee08e09640 1 -- 172.21.15.87:0/1336405497 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0c01aa80 con 0x563c754ffce0 2024-05-08T18:32:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.678+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1336405497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c755fd8a0 con 0x563c754ffce0 2024-05-08T18:32:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.679+0000 7fee08e09640 1 -- 172.21.15.87:0/1336405497 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fef0c015020 con 0x563c754ffce0 2024-05-08T18:32:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.679+0000 7fee08e09640 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fee0403bb50 0x7fee0403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.680+0000 7fee08e09640 1 -- 172.21.15.87:0/1336405497 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fef0c020070 con 0x563c754ffce0 2024-05-08T18:32:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.680+0000 7fef1bc99640 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fee0403bb50 0x7fee0403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.680+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563c755037f0 0x563c75601660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.680+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1336405497 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c75601ba0 con 0x563c755037f0 2024-05-08T18:32:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.680+0000 7fef1cc9b640 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563c755037f0 0x563c75601660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.680+0000 7fef1bc99640 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fee0403bb50 0x7fee0403e010 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fef10054000 tx=0x7fef1004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.680+0000 7fef1cc9b640 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563c755037f0 0x563c75601660 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.680+0000 7fef1cc9b640 1 -- 172.21.15.87:0/1336405497 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef1400a4a0 con 0x563c755037f0 2024-05-08T18:32:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.680+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1336405497 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c755fec30 con 0x563c755037f0 2024-05-08T18:32:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.681+0000 7fef1cc9b640 1 -- 172.21.15.87:0/1336405497 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef1400a4a0 con 0x563c755037f0 2024-05-08T18:32:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.681+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1336405497 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c756039c0 con 0x563c755037f0 2024-05-08T18:32:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.681+0000 7fef1cc9b640 1 -- 172.21.15.87:0/1336405497 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fef1400a4a0 con 0x563c755037f0 2024-05-08T18:32:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.681+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1336405497 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c75602bf0 con 0x563c755037f0 2024-05-08T18:32:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.681+0000 7fef1cc9b640 1 -- 172.21.15.87:0/1336405497 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef1400a4a0 con 0x563c755037f0 2024-05-08T18:32:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.681+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563c75604d70 0x563c75607160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.681+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1336405497 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c756076a0 con 0x563c75604d70 2024-05-08T18:32:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.681+0000 7fef1c49a640 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563c75604d70 0x563c75607160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.682+0000 7fef1c49a640 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563c75604d70 0x563c75607160 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.682+0000 7fef1c49a640 1 -- 172.21.15.87:0/1336405497 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fef0c02b070 con 0x563c75604d70 2024-05-08T18:32:16.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.682+0000 7fef1e9a2800 1 Processor -- start 2024-05-08T18:32:16.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.682+0000 7fef1e9a2800 1 -- start start 2024-05-08T18:32:16.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.683+0000 7fef1e9a2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c756158e0 0x563c75615d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.683+0000 7fef1e9a2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c753f0fc0 con 0x563c756158e0 2024-05-08T18:32:16.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.683+0000 7fef1cc9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c756158e0 0x563c75615d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.683+0000 7fef1cc9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c756158e0 0x563c75615d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60828/0 (socket says 172.21.15.87:60828) 2024-05-08T18:32:16.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.683+0000 7fef1cc9b640 1 -- 172.21.15.87:0/4031004075 learned_addr learned my addr 172.21.15.87:0/4031004075 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.683+0000 7fef1cc9b640 1 -- 172.21.15.87:0/4031004075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c75616240 con 0x563c756158e0 2024-05-08T18:32:16.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.683+0000 7fef1cc9b640 1 --2- 172.21.15.87:0/4031004075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c756158e0 0x563c75615d00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x563c755fb180 tx=0x7fef140178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.683+0000 7fee01ffb640 1 -- 172.21.15.87:0/4031004075 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef14013440 con 0x563c756158e0 2024-05-08T18:32:16.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.683+0000 7fee01ffb640 1 -- 172.21.15.87:0/4031004075 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef140135e0 con 0x563c756158e0 2024-05-08T18:32:16.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.683+0000 7fef1e9a2800 1 -- 172.21.15.87:0/4031004075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c75616cb0 con 0x563c756158e0 2024-05-08T18:32:16.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.683+0000 7fee01ffb640 1 -- 172.21.15.87:0/4031004075 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef140138c0 con 0x563c756158e0 2024-05-08T18:32:16.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.684+0000 7fef1e9a2800 1 -- 172.21.15.87:0/4031004075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c756171b0 con 0x563c756158e0 2024-05-08T18:32:16.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.684+0000 7fee01ffb640 1 -- 172.21.15.87:0/4031004075 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fef14011040 con 0x563c756158e0 2024-05-08T18:32:16.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.684+0000 7fee01ffb640 1 --2- 172.21.15.87:0/4031004075 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fedf403bb50 0x7fedf403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.684+0000 7fee01ffb640 1 -- 172.21.15.87:0/4031004075 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fef1401d070 con 0x563c756158e0 2024-05-08T18:32:16.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.685+0000 7fef1c49a640 1 --2- 172.21.15.87:0/4031004075 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fedf403bb50 0x7fedf403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.685+0000 7fef1e9a2800 1 Processor -- start 2024-05-08T18:32:16.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.685+0000 7fef1c49a640 1 --2- 172.21.15.87:0/4031004075 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fedf403bb50 0x7fedf403e010 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fef0c001430 tx=0x7fef0c050ce0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.685+0000 7fef1e9a2800 1 -- start start 2024-05-08T18:32:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.685+0000 7fef1e9a2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c75622c00 0x563c75623020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.685+0000 7fef1e9a2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c754fdf60 con 0x563c75622c00 2024-05-08T18:32:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.685+0000 7fef1cc9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c75622c00 0x563c75623020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.685+0000 7fef1cc9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c75622c00 0x563c75623020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60846/0 (socket says 172.21.15.87:60846) 2024-05-08T18:32:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.685+0000 7fef1cc9b640 1 -- 172.21.15.87:0/1225417809 learned_addr learned my addr 172.21.15.87:0/1225417809 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.685+0000 7fef1cc9b640 1 -- 172.21.15.87:0/1225417809 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c756235f0 con 0x563c75622c00 2024-05-08T18:32:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.686+0000 7fef1cc9b640 1 --2- 172.21.15.87:0/1225417809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c75622c00 0x563c75623020 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fef140529a0 tx=0x7fef14001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9be6415de43a033 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.686+0000 7fedfb7fe640 1 -- 172.21.15.87:0/1225417809 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef1402ad80 con 0x563c75622c00 2024-05-08T18:32:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.686+0000 7fedfb7fe640 1 -- 172.21.15.87:0/1225417809 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef140014f0 con 0x563c75622c00 2024-05-08T18:32:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.686+0000 7fedfb7fe640 1 -- 172.21.15.87:0/1225417809 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef140017d0 con 0x563c75622c00 2024-05-08T18:32:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.686+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1225417809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c75622c00 msgr2=0x563c75623020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.686+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/1225417809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c75622c00 0x563c75623020 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fef140529a0 tx=0x7fef14001e60 comp rx=0 tx=0).stop 2024-05-08T18:32:16.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.686+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1225417809 shutdown_connections 2024-05-08T18:32:16.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.686+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/1225417809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c75622c00 0x563c75623020 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.686+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1225417809 >> 172.21.15.87:0/1225417809 conn(0x563c7561ef10 msgr2=0x563c7561cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.686+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1225417809 shutdown_connections 2024-05-08T18:32:16.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.686+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1225417809 wait complete. 2024-05-08T18:32:16.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.686+0000 7fef1e9a2800 1 Processor -- start 2024-05-08T18:32:16.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.687+0000 7fef1e9a2800 1 -- start start 2024-05-08T18:32:16.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.687+0000 7fef1e9a2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c75622c00 0x563c7562a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.687+0000 7fef1e9a2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c75623dc0 con 0x563c75622c00 2024-05-08T18:32:16.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.687+0000 7fef1cc9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c75622c00 0x563c7562a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.687+0000 7fef1cc9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c75622c00 0x563c7562a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60860/0 (socket says 172.21.15.87:60860) 2024-05-08T18:32:16.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.687+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 learned_addr learned my addr 172.21.15.87:0/3896613769 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.687+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c7562a690 con 0x563c75622c00 2024-05-08T18:32:16.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.687+0000 7fef1cc9b640 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c75622c00 0x563c7562a150 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fef1404d010 tx=0x7fef1400a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.687+0000 7fedf9ffb640 1 -- 172.21.15.87:0/3896613769 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef14030070 con 0x563c75622c00 2024-05-08T18:32:16.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.687+0000 7fedf9ffb640 1 -- 172.21.15.87:0/3896613769 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef14013b90 con 0x563c75622c00 2024-05-08T18:32:16.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.687+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c7562a920 con 0x563c75622c00 2024-05-08T18:32:16.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.687+0000 7fedf9ffb640 1 -- 172.21.15.87:0/3896613769 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef140540d0 con 0x563c75622c00 2024-05-08T18:32:16.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.688+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c7562d5d0 con 0x563c75622c00 2024-05-08T18:32:16.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.688+0000 7fedf9ffb640 1 -- 172.21.15.87:0/3896613769 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fef14033070 con 0x563c75622c00 2024-05-08T18:32:16.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.688+0000 7fedf9ffb640 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fedec03bba0 0x7fedec03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.688+0000 7fedf9ffb640 1 -- 172.21.15.87:0/3896613769 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fef1400e040 con 0x563c75622c00 2024-05-08T18:32:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.689+0000 7fef1c49a640 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fedec03bba0 0x7fedec03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.689+0000 7fef1e9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.689+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563c75635c50 0x563c75638110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.689+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c75638860 con 0x563c75635c50 2024-05-08T18:32:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.689+0000 7fef1bc99640 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563c75635c50 0x563c75638110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.689+0000 7fef1c49a640 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fedec03bba0 0x7fedec03e060 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fef0c02cb20 tx=0x7fef0c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.689+0000 7fef1bc99640 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563c75635c50 0x563c75638110 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.689+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.689+0000 7fef1e9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.689+0000 7fef1e9a2800 20 realm 2024-05-08T18:32:16.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.689+0000 7fef1e9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.689+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c75638c30 con 0x563c75635c50 2024-05-08T18:32:16.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1e9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1e9a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:32:16.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1e9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c75639500 con 0x563c75635c50 2024-05-08T18:32:16.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1e9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1e9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c756398a0 con 0x563c75635c50 2024-05-08T18:32:16.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1e9a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:16.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1e9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c75639cc0 con 0x563c75635c50 2024-05-08T18:32:16.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1e9a2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:32:16.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1e9a2800 20 searching for the correct realm 2024-05-08T18:32:16.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563c7563bcc0 0x563c7563e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x563c7563bcc0 2024-05-08T18:32:16.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.690+0000 7fef1cc9b640 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563c7563bcc0 0x563c7563e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.691+0000 7fef1cc9b640 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563c7563bcc0 0x563c7563e110 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.691+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef14032030 con 0x563c7563bcc0 2024-05-08T18:32:16.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.691+0000 7fef1cc9b640 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fef14035070 0x7fef14041020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.691+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x7fef14035070 2024-05-08T18:32:16.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.691+0000 7fef1c49a640 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fef14035070 0x7fef14041020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.692+0000 7fef1c49a640 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fef14035070 0x7fef14041020 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.692+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c02b070 con 0x7fef14035070 2024-05-08T18:32:16.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.692+0000 7fef1c49a640 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fef0c017050 0x7fef0c0165d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.692+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x7fef0c017050 2024-05-08T18:32:16.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.692+0000 7fef1bc99640 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fef0c017050 0x7fef0c0165d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.693+0000 7fef1bc99640 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fef0c017050 0x7fef0c0165d0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.693+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.693+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x563c75635c50 2024-05-08T18:32:16.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.693+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.693+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x563c75635c50 2024-05-08T18:32:16.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.693+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.693+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x7fef0c017050 2024-05-08T18:32:16.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.694+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.694+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x7fef0c017050 2024-05-08T18:32:16.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.694+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.694+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x7fef14035070 2024-05-08T18:32:16.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.694+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c02b070 con 0x7fef14035070 2024-05-08T18:32:16.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.694+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x563c7563bcc0 2024-05-08T18:32:16.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.694+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef14032030 con 0x563c7563bcc0 2024-05-08T18:32:16.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.694+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x563c75635c50 2024-05-08T18:32:16.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.695+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.695+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x7fef0c017050 2024-05-08T18:32:16.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.695+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.695+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x563c75635c50 2024-05-08T18:32:16.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.695+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.695+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x7fef14035070 2024-05-08T18:32:16.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.695+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fef0c02b070 con 0x7fef14035070 2024-05-08T18:32:16.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.695+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x563c7563bcc0 2024-05-08T18:32:16.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.696+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef14032030 con 0x563c7563bcc0 2024-05-08T18:32:16.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.696+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x563c7563bcc0 2024-05-08T18:32:16.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.696+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef14032030 con 0x563c7563bcc0 2024-05-08T18:32:16.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.696+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x7fef0c017050 2024-05-08T18:32:16.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.696+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.696+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x563c7563bcc0 2024-05-08T18:32:16.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.696+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef14032030 con 0x563c7563bcc0 2024-05-08T18:32:16.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.696+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x563c7563bcc0 2024-05-08T18:32:16.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.697+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef14032030 con 0x563c7563bcc0 2024-05-08T18:32:16.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.697+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x563c75635c50 2024-05-08T18:32:16.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.697+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.697+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x563c75635c50 2024-05-08T18:32:16.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.697+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.697+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x7fef0c017050 2024-05-08T18:32:16.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.697+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.697+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x563c7563bcc0 2024-05-08T18:32:16.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.698+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef14032030 con 0x563c7563bcc0 2024-05-08T18:32:16.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.698+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x7fef14035070 2024-05-08T18:32:16.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.698+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c02b070 con 0x7fef14035070 2024-05-08T18:32:16.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.698+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x563c75635c50 2024-05-08T18:32:16.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.698+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.698+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x7fef0c017050 2024-05-08T18:32:16.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.698+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.698+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x563c7563bcc0 2024-05-08T18:32:16.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.699+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef14032030 con 0x563c7563bcc0 2024-05-08T18:32:16.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.699+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x7fef14035070 2024-05-08T18:32:16.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.699+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c02b070 con 0x7fef14035070 2024-05-08T18:32:16.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.699+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x7fef14035070 2024-05-08T18:32:16.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.699+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c02b070 con 0x7fef14035070 2024-05-08T18:32:16.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.699+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x563c7563bcc0 2024-05-08T18:32:16.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.699+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef14032030 con 0x563c7563bcc0 2024-05-08T18:32:16.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.699+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x7fef14035070 2024-05-08T18:32:16.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.700+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c02b070 con 0x7fef14035070 2024-05-08T18:32:16.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.700+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x563c75635c50 2024-05-08T18:32:16.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.700+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.700+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563c7563e7e0 con 0x7fef14035070 2024-05-08T18:32:16.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.700+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c02b070 con 0x7fef14035070 2024-05-08T18:32:16.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.700+0000 7fef1e9a2800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:32:16.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.700+0000 7fef1e9a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:32:16.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.700+0000 7fef1e9a2800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:32:16.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.700+0000 7fef1e9a2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:32:16.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.700+0000 7fef1e9a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:32:16.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.700+0000 7fef1e9a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:32:16.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.700+0000 7fef1e9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.700+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c7563a760 con 0x563c75635c50 2024-05-08T18:32:16.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.700+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.700+0000 7fef1e9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.700+0000 7fef1e9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.700+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c7563b000 con 0x563c75635c50 2024-05-08T18:32:16.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1e9a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:16.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1e9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c7563a3a0 con 0x7fef0c017050 2024-05-08T18:32:16.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1e9a2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:32:16.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1e9a2800 20 zone default found 2024-05-08T18:32:16.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1e9a2800 4 Realm: () 2024-05-08T18:32:16.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1e9a2800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:32:16.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1e9a2800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:32:16.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1e9a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:32:16.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1e9a2800 20 zonegroup default 2024-05-08T18:32:16.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1e9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c7563ecb0 con 0x7fef0c017050 2024-05-08T18:32:16.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1e9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1e9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.701+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c75640b40 con 0x563c7563bcc0 2024-05-08T18:32:16.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.702+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef14032030 con 0x563c7563bcc0 2024-05-08T18:32:16.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.702+0000 7fef1e9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.702+0000 7fef1e9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.702+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c75640ee0 con 0x563c7563bcc0 2024-05-08T18:32:16.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.702+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef14032030 con 0x563c7563bcc0 2024-05-08T18:32:16.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.702+0000 7fef1e9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.702+0000 7fef1e9a2800 20 started sync module instance, tier type = 2024-05-08T18:32:16.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.702+0000 7fef1e9a2800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:32:16.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.702+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c7563ff80 con 0x7fef14035070 2024-05-08T18:32:16.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.703+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c02b070 con 0x7fef14035070 2024-05-08T18:32:16.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.703+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94817667515248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75640790 con 0x7fef14035070 2024-05-08T18:32:16.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.703+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75641c60 con 0x563c75635c50 2024-05-08T18:32:16.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.704+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94817667515248] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c02b070 con 0x7fef14035070 2024-05-08T18:32:16.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.704+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.704+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94817667519104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75642050 con 0x563c75635c50 2024-05-08T18:32:16.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.704+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75642a90 con 0x563c7563bcc0 2024-05-08T18:32:16.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.705+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94817667519104] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.706+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef14032030 con 0x563c7563bcc0 2024-05-08T18:32:16.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.706+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94817667523936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75642eb0 con 0x563c7563bcc0 2024-05-08T18:32:16.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.706+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c756438d0 con 0x7fef14035070 2024-05-08T18:32:16.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.707+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94817667523936] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef14032030 con 0x563c7563bcc0 2024-05-08T18:32:16.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.707+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c02b070 con 0x7fef14035070 2024-05-08T18:32:16.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.707+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94817667527616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75643cf0 con 0x7fef14035070 2024-05-08T18:32:16.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.707+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75644730 con 0x563c75635c50 2024-05-08T18:32:16.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.708+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.708+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94817667531264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75644fd0 con 0x563c75635c50 2024-05-08T18:32:16.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.708+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75645a70 con 0x7fef0c017050 2024-05-08T18:32:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.708+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94817667527616] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c02b070 con 0x7fef14035070 2024-05-08T18:32:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.709+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94817667531264] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.709+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.709+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94817667536192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75644ad0 con 0x7fef0c017050 2024-05-08T18:32:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.709+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75646310 con 0x7fef0c017050 2024-05-08T18:32:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.710+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(56 notify.6 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.710+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94817667538528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75644a80 con 0x7fef0c017050 2024-05-08T18:32:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.710+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75646e60 con 0x7fef0c017050 2024-05-08T18:32:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.710+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94817667536192] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.711+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94817667538528] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.711+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.711+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94817667539584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c756416a0 con 0x7fef0c017050 2024-05-08T18:32:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.711+0000 7fef1e9a2800 20 add_watcher() i=0 2024-05-08T18:32:16.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.711+0000 7fef1e9a2800 20 add_watcher() i=1 2024-05-08T18:32:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.711+0000 7fef1e9a2800 20 add_watcher() i=2 2024-05-08T18:32:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.711+0000 7fef1e9a2800 20 add_watcher() i=3 2024-05-08T18:32:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.711+0000 7fef1e9a2800 20 add_watcher() i=4 2024-05-08T18:32:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.711+0000 7fef1e9a2800 20 add_watcher() i=5 2024-05-08T18:32:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.711+0000 7fef1e9a2800 20 add_watcher() i=6 2024-05-08T18:32:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.712+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94817667539584] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.712+0000 7fef1e9a2800 20 add_watcher() i=7 2024-05-08T18:32:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.712+0000 7fef1e9a2800 2 all 8 watchers are set, enabling cache 2024-05-08T18:32:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.712+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c75649e50 con 0x563c75635c50 2024-05-08T18:32:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.712+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.712+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94817667541328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c756472d0 con 0x563c75635c50 2024-05-08T18:32:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.713+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94817667541328] v29'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.713+0000 7fedd27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.713+0000 7fef1e9a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:32:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.713+0000 7fef1e9a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:32:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.713+0000 7fef1e9a2800 5 note: GC not initialized 2024-05-08T18:32:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.714+0000 7fedd17e2640 20 reqs_thread_entry: start 2024-05-08T18:32:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.714+0000 7fef1e9a2800 20 init_complete bucket index max shards: 11 2024-05-08T18:32:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.714+0000 7fef1e9a2800 20 Filter name: none 2024-05-08T18:32:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.714+0000 7fed42ffd640 20 reqs_thread_entry: start 2024-05-08T18:32:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.714+0000 7fef1e9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.714+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c7567cc70 con 0x563c75635c50 2024-05-08T18:32:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.714+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.714+0000 7fef1e9a2800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:32:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.714+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563c7567e060 con 0x7fef0c017050 2024-05-08T18:32:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.715+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.715+0000 7fedd27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.715+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94817667541328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c7567b3f0 con 0x563c75635c50 2024-05-08T18:32:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.716+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94817667541328] v29'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.716+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94817667515248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75646950 con 0x7fef14035070 2024-05-08T18:32:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.717+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94817667515248] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c02b070 con 0x7fef14035070 2024-05-08T18:32:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.718+0000 7fef1e9a2800 20 remove_watcher() i=0 2024-05-08T18:32:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.718+0000 7fef1e9a2800 2 removed watcher, disabling cache 2024-05-08T18:32:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.718+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94817667519104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75640370 con 0x563c75635c50 2024-05-08T18:32:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.719+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94817667519104] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.719+0000 7fef1e9a2800 20 remove_watcher() i=1 2024-05-08T18:32:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.719+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94817667523936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75640370 con 0x563c7563bcc0 2024-05-08T18:32:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.720+0000 7fef1cc9b640 1 -- 172.21.15.87:0/3896613769 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94817667523936] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef14032030 con 0x563c7563bcc0 2024-05-08T18:32:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.720+0000 7fef1e9a2800 20 remove_watcher() i=2 2024-05-08T18:32:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.720+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94817667527616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75642560 con 0x7fef14035070 2024-05-08T18:32:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.721+0000 7fef1c49a640 1 -- 172.21.15.87:0/3896613769 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94817667527616] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c02b070 con 0x7fef14035070 2024-05-08T18:32:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.721+0000 7fef1e9a2800 20 remove_watcher() i=3 2024-05-08T18:32:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.721+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94817667531264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75640370 con 0x563c75635c50 2024-05-08T18:32:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.722+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94817667531264] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x563c75635c50 2024-05-08T18:32:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.722+0000 7fef1e9a2800 20 remove_watcher() i=4 2024-05-08T18:32:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.722+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94817667536192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75642560 con 0x7fef0c017050 2024-05-08T18:32:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.723+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94817667536192] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.723+0000 7fef1e9a2800 20 remove_watcher() i=5 2024-05-08T18:32:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.723+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94817667538528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75644200 con 0x7fef0c017050 2024-05-08T18:32:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.724+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94817667538528] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.724+0000 7fef1e9a2800 20 remove_watcher() i=6 2024-05-08T18:32:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.724+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94817667539584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563c75640370 con 0x7fef0c017050 2024-05-08T18:32:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94817667539584] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1005a040 con 0x7fef0c017050 2024-05-08T18:32:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 20 remove_watcher() i=7 2024-05-08T18:32:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fef0c017050 msgr2=0x7fef0c0165d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fef0c017050 0x7fef0c0165d0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563c75635c50 msgr2=0x563c75638110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563c75635c50 0x563c75638110 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fef14035070 msgr2=0x7fef14041020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fef14035070 0x7fef14041020 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563c7563bcc0 msgr2=0x563c7563e110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563c7563bcc0 0x563c7563e110 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fedec03bba0 msgr2=0x7fedec03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fedec03bba0 0x7fedec03e060 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fef0c02cb20 tx=0x7fef0c04e000 comp rx=0 tx=0).stop 2024-05-08T18:32:16.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c75622c00 msgr2=0x563c7562a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1bc99640 1 -- 172.21.15.87:0/3896613769 reap_dead start 2024-05-08T18:32:16.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c75622c00 0x563c7562a150 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fef1404d010 tx=0x7fef1400a0e0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 shutdown_connections 2024-05-08T18:32:16.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/3896613769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c75622c00 0x563c7562a150 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 >> 172.21.15.87:0/3896613769 conn(0x563c7561ef10 msgr2=0x563c7561c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 shutdown_connections 2024-05-08T18:32:16.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.725+0000 7fef1e9a2800 1 -- 172.21.15.87:0/3896613769 wait complete. 2024-05-08T18:32:16.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 -- 172.21.15.87:0/4031004075 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fedf403bb50 msgr2=0x7fedf403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/4031004075 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fedf403bb50 0x7fedf403e010 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fef0c001430 tx=0x7fef0c050ce0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 -- 172.21.15.87:0/4031004075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c756158e0 msgr2=0x563c75615d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/4031004075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c756158e0 0x563c75615d00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x563c755fb180 tx=0x7fef140178e0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 -- 172.21.15.87:0/4031004075 shutdown_connections 2024-05-08T18:32:16.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/4031004075 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fedf403bb50 0x7fedf403e010 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/4031004075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c756158e0 0x563c75615d00 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 -- 172.21.15.87:0/4031004075 >> 172.21.15.87:0/4031004075 conn(0x563c75609980 msgr2=0x563c75609d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 -- 172.21.15.87:0/4031004075 shutdown_connections 2024-05-08T18:32:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 -- 172.21.15.87:0/4031004075 wait complete. 2024-05-08T18:32:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1336405497 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563c75604d70 msgr2=0x563c75607160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563c75604d70 0x563c75607160 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1336405497 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563c755037f0 msgr2=0x563c75601660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563c755037f0 0x563c75601660 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1336405497 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fee0403bb50 msgr2=0x7fee0403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fee0403bb50 0x7fee0403e010 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fef10054000 tx=0x7fef1004e000 comp rx=0 tx=0).stop 2024-05-08T18:32:16.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1336405497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c754ffce0 msgr2=0x563c755fa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c754ffce0 0x563c755fa470 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00c010 tx=0x7fef0c000ed0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1336405497 shutdown_connections 2024-05-08T18:32:16.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563c755037f0 0x563c75601660 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563c75604d70 0x563c75607160 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fee0403bb50 0x7fee0403e010 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 --2- 172.21.15.87:0/1336405497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c754ffce0 0x563c755fa470 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1336405497 >> 172.21.15.87:0/1336405497 conn(0x563c754f9730 msgr2=0x563c754fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1336405497 shutdown_connections 2024-05-08T18:32:16.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.726+0000 7fef1e9a2800 1 -- 172.21.15.87:0/1336405497 wait complete. 2024-05-08T18:32:16.742 INFO:teuthology.orchestra.run.smithi087.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:32:16.743 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:32:16.743 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-05-08T18:32:16.743 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-05-08T18:32:16.744 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-05-08T18:32:16.790 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:32:16.790 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:32:16.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.792+0000 7fc85a32f800 1 Processor -- start 2024-05-08T18:32:16.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.792+0000 7fc85a32f800 1 -- start start 2024-05-08T18:32:16.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.793+0000 7fc85a32f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563b19850a40 0x563b198e5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.793+0000 7fc85a32f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563b19850ef0 con 0x563b19851dd0 2024-05-08T18:32:16.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.793+0000 7fc85a32f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x563b1977ce20 con 0x563b19850a40 2024-05-08T18:32:16.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.793+0000 7fc84ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563b19850a40 0x563b198e5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.793+0000 7fc855fca640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x563b19851dd0 0x563b19850330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:40754/0 (socket says 172.21.15.87:40754) 2024-05-08T18:32:16.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.793+0000 7fc855fca640 1 -- 172.21.15.87:0/231937686 learned_addr learned my addr 172.21.15.87:0/231937686 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:32:16.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.793+0000 7fc84ffff640 1 -- 172.21.15.87:0/231937686 >> v1:172.21.15.53:6789/0 conn(0x563b19851dd0 legacy=0x563b19850330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.793+0000 7fc84ffff640 1 -- 172.21.15.87:0/231937686 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b19851110 con 0x563b19850a40 2024-05-08T18:32:16.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.795+0000 7fc84ffff640 1 --2- 172.21.15.87:0/231937686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 0x563b198e5180 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc84000a470 tx=0x7fc84001cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a99c908426f32e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.795+0000 7fc8557c9640 1 -- 172.21.15.87:0/231937686 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc840057070 con 0x563b19850a40 2024-05-08T18:32:16.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.795+0000 7fc8557c9640 1 -- 172.21.15.87:0/231937686 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc840052570 con 0x563b19850a40 2024-05-08T18:32:16.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.795+0000 7fc8557c9640 1 -- 172.21.15.87:0/231937686 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc840052870 con 0x563b19850a40 2024-05-08T18:32:16.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.796+0000 7fc85a32f800 1 -- 172.21.15.87:0/231937686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 msgr2=0x563b198e5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.796+0000 7fc85a32f800 1 --2- 172.21.15.87:0/231937686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 0x563b198e5180 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc84000a470 tx=0x7fc84001cf20 comp rx=0 tx=0).stop 2024-05-08T18:32:16.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.796+0000 7fc85a32f800 1 -- 172.21.15.87:0/231937686 shutdown_connections 2024-05-08T18:32:16.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.796+0000 7fc85a32f800 1 --2- 172.21.15.87:0/231937686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 0x563b198e5180 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.796+0000 7fc85a32f800 1 -- 172.21.15.87:0/231937686 >> 172.21.15.87:0/231937686 conn(0x563b198d7840 msgr2=0x563b198d9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.796+0000 7fc85a32f800 1 -- 172.21.15.87:0/231937686 shutdown_connections 2024-05-08T18:32:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.796+0000 7fc85a32f800 1 -- 172.21.15.87:0/231937686 wait complete. 2024-05-08T18:32:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.809+0000 7fc85a32f800 1 Processor -- start 2024-05-08T18:32:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.810+0000 7fc85a32f800 1 -- start start 2024-05-08T18:32:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.810+0000 7fc85a32f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 0x563b199cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.810+0000 7fc85a32f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563b198275c0 con 0x563b19850a40 2024-05-08T18:32:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.810+0000 7fc855fca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 0x563b199cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.810+0000 7fc855fca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 0x563b199cf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60888/0 (socket says 172.21.15.87:60888) 2024-05-08T18:32:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.810+0000 7fc855fca640 1 -- 172.21.15.87:0/962050782 learned_addr learned my addr 172.21.15.87:0/962050782 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.810+0000 7fc855fca640 1 -- 172.21.15.87:0/962050782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b199cfe00 con 0x563b19850a40 2024-05-08T18:32:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.810+0000 7fc855fca640 1 --2- 172.21.15.87:0/962050782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 0x563b199cf830 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc848001da0 tx=0x7fc84800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4661edc677318e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.810+0000 7fc743e07640 1 -- 172.21.15.87:0/962050782 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc848012020 con 0x563b19850a40 2024-05-08T18:32:16.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.811+0000 7fc743e07640 1 -- 172.21.15.87:0/962050782 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84800e470 con 0x563b19850a40 2024-05-08T18:32:16.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.811+0000 7fc743e07640 1 -- 172.21.15.87:0/962050782 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc84800e810 con 0x563b19850a40 2024-05-08T18:32:16.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.811+0000 7fc85a32f800 1 -- 172.21.15.87:0/962050782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 msgr2=0x563b199cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.811+0000 7fc85a32f800 1 --2- 172.21.15.87:0/962050782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 0x563b199cf830 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc848001da0 tx=0x7fc84800b6c0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.811+0000 7fc85a32f800 1 -- 172.21.15.87:0/962050782 shutdown_connections 2024-05-08T18:32:16.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.811+0000 7fc85a32f800 1 --2- 172.21.15.87:0/962050782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 0x563b199cf830 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.811+0000 7fc85a32f800 1 -- 172.21.15.87:0/962050782 >> 172.21.15.87:0/962050782 conn(0x563b198d7840 msgr2=0x563b199cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.811+0000 7fc85a32f800 1 -- 172.21.15.87:0/962050782 shutdown_connections 2024-05-08T18:32:16.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.811+0000 7fc85a32f800 1 -- 172.21.15.87:0/962050782 wait complete. 2024-05-08T18:32:16.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.812+0000 7fc85a32f800 1 Processor -- start 2024-05-08T18:32:16.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.812+0000 7fc85a32f800 1 -- start start 2024-05-08T18:32:16.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.812+0000 7fc85a32f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 0x563b199d73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.812+0000 7fc85a32f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563b198e59c0 con 0x563b19850a40 2024-05-08T18:32:16.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.812+0000 7fc855fca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 0x563b199d73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.812+0000 7fc855fca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 0x563b199d73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60892/0 (socket says 172.21.15.87:60892) 2024-05-08T18:32:16.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.812+0000 7fc855fca640 1 -- 172.21.15.87:0/1218614820 learned_addr learned my addr 172.21.15.87:0/1218614820 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.812+0000 7fc855fca640 1 -- 172.21.15.87:0/1218614820 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b199d7910 con 0x563b19850a40 2024-05-08T18:32:16.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.812+0000 7fc855fca640 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 0x563b199d73d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc84800b700 tx=0x7fc848000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.813+0000 7fc742604640 1 -- 172.21.15.87:0/1218614820 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc848012030 con 0x563b19850a40 2024-05-08T18:32:16.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.813+0000 7fc742604640 1 -- 172.21.15.87:0/1218614820 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84801a750 con 0x563b19850a40 2024-05-08T18:32:16.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.813+0000 7fc85a32f800 1 -- 172.21.15.87:0/1218614820 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b199d7ba0 con 0x563b19850a40 2024-05-08T18:32:16.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.813+0000 7fc742604640 1 -- 172.21.15.87:0/1218614820 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc84801aa70 con 0x563b19850a40 2024-05-08T18:32:16.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.813+0000 7fc85a32f800 1 -- 172.21.15.87:0/1218614820 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b199da800 con 0x563b19850a40 2024-05-08T18:32:16.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.814+0000 7fc742604640 1 -- 172.21.15.87:0/1218614820 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc848015020 con 0x563b19850a40 2024-05-08T18:32:16.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.814+0000 7fc742604640 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc73c03bb50 0x7fc73c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.814+0000 7fc742604640 1 -- 172.21.15.87:0/1218614820 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fc848020030 con 0x563b19850a40 2024-05-08T18:32:16.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.814+0000 7fc84ffff640 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc73c03bb50 0x7fc73c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.814+0000 7fc85a32f800 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563b19851dd0 0x563b199de5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.814+0000 7fc85a32f800 1 -- 172.21.15.87:0/1218614820 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b199deb00 con 0x563b19851dd0 2024-05-08T18:32:16.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.814+0000 7fc8567cb640 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563b19851dd0 0x563b199de5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.814+0000 7fc84ffff640 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc73c03bb50 0x7fc73c03e010 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc840054000 tx=0x7fc84004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.814+0000 7fc8567cb640 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563b19851dd0 0x563b199de5c0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.815+0000 7fc8567cb640 1 -- 172.21.15.87:0/1218614820 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc85000a4a0 con 0x563b19851dd0 2024-05-08T18:32:16.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.815+0000 7fc85a32f800 1 -- 172.21.15.87:0/1218614820 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b199dbb90 con 0x563b19851dd0 2024-05-08T18:32:16.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.815+0000 7fc8567cb640 1 -- 172.21.15.87:0/1218614820 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc85000a4a0 con 0x563b19851dd0 2024-05-08T18:32:16.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.815+0000 7fc85a32f800 1 -- 172.21.15.87:0/1218614820 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b199e0970 con 0x563b19851dd0 2024-05-08T18:32:16.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.815+0000 7fc8567cb640 1 -- 172.21.15.87:0/1218614820 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc85000a4a0 con 0x563b19851dd0 2024-05-08T18:32:16.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.815+0000 7fc85a32f800 1 -- 172.21.15.87:0/1218614820 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b199dfab0 con 0x563b19851dd0 2024-05-08T18:32:16.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.815+0000 7fc8567cb640 1 -- 172.21.15.87:0/1218614820 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc85000a4a0 con 0x563b19851dd0 2024-05-08T18:32:16.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.815+0000 7fc85a32f800 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563b199e0580 0x563b199e3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.815+0000 7fc85a32f800 1 -- 172.21.15.87:0/1218614820 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b199e4550 con 0x563b199e0580 2024-05-08T18:32:16.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.816+0000 7fc855fca640 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563b199e0580 0x563b199e3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.816+0000 7fc855fca640 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563b199e0580 0x563b199e3dc0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.816+0000 7fc855fca640 1 -- 172.21.15.87:0/1218614820 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc848018900 con 0x563b199e0580 2024-05-08T18:32:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.817+0000 7fc85a32f800 1 Processor -- start 2024-05-08T18:32:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.817+0000 7fc85a32f800 1 -- start start 2024-05-08T18:32:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.817+0000 7fc85a32f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199f28c0 0x563b199f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.817+0000 7fc85a32f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563b197cdfc0 con 0x563b199f28c0 2024-05-08T18:32:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.817+0000 7fc8567cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199f28c0 0x563b199f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.817+0000 7fc8567cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199f28c0 0x563b199f2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60900/0 (socket says 172.21.15.87:60900) 2024-05-08T18:32:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.817+0000 7fc8567cb640 1 -- 172.21.15.87:0/2403609549 learned_addr learned my addr 172.21.15.87:0/2403609549 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.817+0000 7fc8567cb640 1 -- 172.21.15.87:0/2403609549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b199f3220 con 0x563b199f28c0 2024-05-08T18:32:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.818+0000 7fc8567cb640 1 --2- 172.21.15.87:0/2403609549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199f28c0 0x563b199f2ce0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x563b199deee0 tx=0x7fc8500178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.818+0000 7fc73b7fe640 1 -- 172.21.15.87:0/2403609549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc850013440 con 0x563b199f28c0 2024-05-08T18:32:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.818+0000 7fc73b7fe640 1 -- 172.21.15.87:0/2403609549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8500135e0 con 0x563b199f28c0 2024-05-08T18:32:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.818+0000 7fc85a32f800 1 -- 172.21.15.87:0/2403609549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b199f3c90 con 0x563b199f28c0 2024-05-08T18:32:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.818+0000 7fc73b7fe640 1 -- 172.21.15.87:0/2403609549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8500138c0 con 0x563b199f28c0 2024-05-08T18:32:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.818+0000 7fc85a32f800 1 -- 172.21.15.87:0/2403609549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b199f4190 con 0x563b199f28c0 2024-05-08T18:32:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.819+0000 7fc73b7fe640 1 -- 172.21.15.87:0/2403609549 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc850011040 con 0x563b199f28c0 2024-05-08T18:32:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.819+0000 7fc73b7fe640 1 --2- 172.21.15.87:0/2403609549 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc73003bb50 0x7fc73003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.819+0000 7fc73b7fe640 1 -- 172.21.15.87:0/2403609549 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fc85001d070 con 0x563b199f28c0 2024-05-08T18:32:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.819+0000 7fc855fca640 1 --2- 172.21.15.87:0/2403609549 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc73003bb50 0x7fc73003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.819+0000 7fc85a32f800 1 Processor -- start 2024-05-08T18:32:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.819+0000 7fc855fca640 1 --2- 172.21.15.87:0/2403609549 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc73003bb50 0x7fc73003e010 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc84802dfb0 tx=0x7fc848050f70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.819+0000 7fc85a32f800 1 -- start start 2024-05-08T18:32:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.819+0000 7fc85a32f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199ffbc0 0x563b199fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.819+0000 7fc85a32f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563b199d0180 con 0x563b199ffbc0 2024-05-08T18:32:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.819+0000 7fc8567cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199ffbc0 0x563b199fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.819+0000 7fc8567cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199ffbc0 0x563b199fffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60906/0 (socket says 172.21.15.87:60906) 2024-05-08T18:32:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.819+0000 7fc8567cb640 1 -- 172.21.15.87:0/2677335352 learned_addr learned my addr 172.21.15.87:0/2677335352 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.820+0000 7fc8567cb640 1 -- 172.21.15.87:0/2677335352 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b19a005b0 con 0x563b199ffbc0 2024-05-08T18:32:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.820+0000 7fc8567cb640 1 --2- 172.21.15.87:0/2677335352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199ffbc0 0x563b199fffe0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc8500529e0 tx=0x7fc850052bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7d5cc2a0b5afdb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.820+0000 7fc7397fa640 1 -- 172.21.15.87:0/2677335352 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc850015950 con 0x563b199ffbc0 2024-05-08T18:32:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.820+0000 7fc7397fa640 1 -- 172.21.15.87:0/2677335352 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc850015430 con 0x563b199ffbc0 2024-05-08T18:32:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.820+0000 7fc7397fa640 1 -- 172.21.15.87:0/2677335352 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc850015af0 con 0x563b199ffbc0 2024-05-08T18:32:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.820+0000 7fc85a32f800 1 -- 172.21.15.87:0/2677335352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199ffbc0 msgr2=0x563b199fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.820+0000 7fc85a32f800 1 --2- 172.21.15.87:0/2677335352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199ffbc0 0x563b199fffe0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc8500529e0 tx=0x7fc850052bb0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.820+0000 7fc85a32f800 1 -- 172.21.15.87:0/2677335352 shutdown_connections 2024-05-08T18:32:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.820+0000 7fc85a32f800 1 --2- 172.21.15.87:0/2677335352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199ffbc0 0x563b199fffe0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.820+0000 7fc85a32f800 1 -- 172.21.15.87:0/2677335352 >> 172.21.15.87:0/2677335352 conn(0x563b199fbf20 msgr2=0x563b199f9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.820+0000 7fc85a32f800 1 -- 172.21.15.87:0/2677335352 shutdown_connections 2024-05-08T18:32:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.821+0000 7fc85a32f800 1 -- 172.21.15.87:0/2677335352 wait complete. 2024-05-08T18:32:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.821+0000 7fc85a32f800 1 Processor -- start 2024-05-08T18:32:16.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.821+0000 7fc85a32f800 1 -- start start 2024-05-08T18:32:16.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.821+0000 7fc85a32f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199ffbc0 0x563b19a07160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.821+0000 7fc85a32f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563b19a00d20 con 0x563b199ffbc0 2024-05-08T18:32:16.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.821+0000 7fc8567cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199ffbc0 0x563b19a07160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.821+0000 7fc8567cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199ffbc0 0x563b19a07160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60908/0 (socket says 172.21.15.87:60908) 2024-05-08T18:32:16.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.821+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 learned_addr learned my addr 172.21.15.87:0/3781508379 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.821+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b19a076a0 con 0x563b199ffbc0 2024-05-08T18:32:16.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.821+0000 7fc8567cb640 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199ffbc0 0x563b19a07160 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc850052910 tx=0x7fc850052940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.822+0000 7fc7277fe640 1 -- 172.21.15.87:0/3781508379 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc850030020 con 0x563b199ffbc0 2024-05-08T18:32:16.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.822+0000 7fc7277fe640 1 -- 172.21.15.87:0/3781508379 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8500542e0 con 0x563b199ffbc0 2024-05-08T18:32:16.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.822+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b19a07930 con 0x563b199ffbc0 2024-05-08T18:32:16.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.822+0000 7fc7277fe640 1 -- 172.21.15.87:0/3781508379 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8500512b0 con 0x563b199ffbc0 2024-05-08T18:32:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.822+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b19a0a5e0 con 0x563b199ffbc0 2024-05-08T18:32:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.822+0000 7fc7277fe640 1 -- 172.21.15.87:0/3781508379 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc850033020 con 0x563b199ffbc0 2024-05-08T18:32:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.823+0000 7fc7277fe640 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc72003bba0 0x7fc72003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.823+0000 7fc7277fe640 1 -- 172.21.15.87:0/3781508379 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fc85000e040 con 0x563b199ffbc0 2024-05-08T18:32:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.823+0000 7fc855fca640 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc72003bba0 0x7fc72003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.823+0000 7fc85a32f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.823+0000 7fc85a32f800 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563b19a12db0 0x563b19a15270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.823+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b19a159c0 con 0x563b19a12db0 2024-05-08T18:32:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.823+0000 7fc84ffff640 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563b19a12db0 0x563b19a15270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.823+0000 7fc855fca640 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc72003bba0 0x7fc72003e060 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc848050f40 tx=0x7fc84804c050 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.823+0000 7fc84ffff640 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563b19a12db0 0x563b19a15270 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc85a32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc85a32f800 20 realm 2024-05-08T18:32:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc85a32f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b19a15d90 con 0x563b19a12db0 2024-05-08T18:32:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc85a32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc85a32f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:32:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc85a32f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b19a16660 con 0x563b19a12db0 2024-05-08T18:32:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc85a32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc85a32f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b19a16a00 con 0x563b19a12db0 2024-05-08T18:32:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc85a32f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc85a32f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.824+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b19a16e20 con 0x563b19a12db0 2024-05-08T18:32:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.825+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.825+0000 7fc85a32f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:32:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.825+0000 7fc85a32f800 20 searching for the correct realm 2024-05-08T18:32:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.825+0000 7fc85a32f800 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563b19a18e20 0x563b19a1b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.825+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x563b19a18e20 2024-05-08T18:32:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.825+0000 7fc8567cb640 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563b19a18e20 0x563b19a1b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.825+0000 7fc8567cb640 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563b19a18e20 0x563b19a1b270 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.825+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850051020 con 0x563b19a18e20 2024-05-08T18:32:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.825+0000 7fc8567cb640 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc850035020 0x7fc8500419b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.825+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x7fc850035020 2024-05-08T18:32:16.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.826+0000 7fc855fca640 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc850035020 0x7fc8500419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.826+0000 7fc855fca640 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc850035020 0x7fc8500419b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.826+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc848018900 con 0x7fc850035020 2024-05-08T18:32:16.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.826+0000 7fc855fca640 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc848017050 0x7fc8480523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.826+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x7fc848017050 2024-05-08T18:32:16.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.826+0000 7fc84ffff640 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc848017050 0x7fc8480523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.827+0000 7fc84ffff640 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc848017050 0x7fc8480523c0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.827+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.827+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x563b19a12db0 2024-05-08T18:32:16.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.827+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.827+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x563b19a12db0 2024-05-08T18:32:16.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.828+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.828+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x7fc848017050 2024-05-08T18:32:16.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.828+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.828+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x7fc848017050 2024-05-08T18:32:16.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.828+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.828+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x7fc850035020 2024-05-08T18:32:16.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.829+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc848018900 con 0x7fc850035020 2024-05-08T18:32:16.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.829+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x563b19a18e20 2024-05-08T18:32:16.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.829+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850051020 con 0x563b19a18e20 2024-05-08T18:32:16.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.829+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x563b19a12db0 2024-05-08T18:32:16.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.829+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.829+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x7fc848017050 2024-05-08T18:32:16.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.829+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.829+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x563b19a12db0 2024-05-08T18:32:16.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.830+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.830+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x7fc850035020 2024-05-08T18:32:16.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.830+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc848018900 con 0x7fc850035020 2024-05-08T18:32:16.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.830+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x563b19a18e20 2024-05-08T18:32:16.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.830+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850051020 con 0x563b19a18e20 2024-05-08T18:32:16.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.830+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x563b19a18e20 2024-05-08T18:32:16.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.830+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850051020 con 0x563b19a18e20 2024-05-08T18:32:16.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.830+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x7fc848017050 2024-05-08T18:32:16.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.831+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.831+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x563b19a18e20 2024-05-08T18:32:16.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.831+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850051020 con 0x563b19a18e20 2024-05-08T18:32:16.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.831+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x563b19a18e20 2024-05-08T18:32:16.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.831+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850051020 con 0x563b19a18e20 2024-05-08T18:32:16.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.831+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x563b19a12db0 2024-05-08T18:32:16.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.831+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.831+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x563b19a12db0 2024-05-08T18:32:16.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.831+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.831+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x7fc848017050 2024-05-08T18:32:16.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.832+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.832+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x563b19a18e20 2024-05-08T18:32:16.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.832+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850051020 con 0x563b19a18e20 2024-05-08T18:32:16.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.832+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x7fc850035020 2024-05-08T18:32:16.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.832+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc848018900 con 0x7fc850035020 2024-05-08T18:32:16.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.832+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x563b19a12db0 2024-05-08T18:32:16.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.832+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.832+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x7fc848017050 2024-05-08T18:32:16.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.833+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.833+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x563b19a18e20 2024-05-08T18:32:16.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.833+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850051020 con 0x563b19a18e20 2024-05-08T18:32:16.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.833+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x7fc850035020 2024-05-08T18:32:16.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.833+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc848018900 con 0x7fc850035020 2024-05-08T18:32:16.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.833+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x7fc850035020 2024-05-08T18:32:16.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.834+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc848018900 con 0x7fc850035020 2024-05-08T18:32:16.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.834+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x563b19a18e20 2024-05-08T18:32:16.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.834+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850051020 con 0x563b19a18e20 2024-05-08T18:32:16.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.834+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x7fc850035020 2024-05-08T18:32:16.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.834+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc848018900 con 0x7fc850035020 2024-05-08T18:32:16.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.834+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x563b19a12db0 2024-05-08T18:32:16.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.834+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.834+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1b940 con 0x7fc850035020 2024-05-08T18:32:16.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.834+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc848018900 con 0x7fc850035020 2024-05-08T18:32:16.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.834+0000 7fc85a32f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:32:16.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.834+0000 7fc85a32f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:32:16.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.834+0000 7fc85a32f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:32:16.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.834+0000 7fc85a32f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:32:16.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.834+0000 7fc85a32f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:32:16.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.834+0000 7fc85a32f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:32:16.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.834+0000 7fc85a32f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.834+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b19a178f0 con 0x563b19a12db0 2024-05-08T18:32:16.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc85a32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc85a32f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b19a18190 con 0x563b19a12db0 2024-05-08T18:32:16.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc85a32f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:16.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc85a32f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b19a17530 con 0x7fc848017050 2024-05-08T18:32:16.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc85a32f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:32:16.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc85a32f800 20 zone default found 2024-05-08T18:32:16.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc85a32f800 4 Realm: () 2024-05-08T18:32:16.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc85a32f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:32:16.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc85a32f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:32:16.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc85a32f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:32:16.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc85a32f800 20 zonegroup default 2024-05-08T18:32:16.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc85a32f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.835+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1be10 con 0x7fc848017050 2024-05-08T18:32:16.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.836+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.836+0000 7fc85a32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.836+0000 7fc85a32f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.836+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1dca0 con 0x563b19a18e20 2024-05-08T18:32:16.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.836+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc850051020 con 0x563b19a18e20 2024-05-08T18:32:16.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.836+0000 7fc85a32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.836+0000 7fc85a32f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.836+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1e040 con 0x563b19a18e20 2024-05-08T18:32:16.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.837+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc850051020 con 0x563b19a18e20 2024-05-08T18:32:16.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.837+0000 7fc85a32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.837+0000 7fc85a32f800 20 started sync module instance, tier type = 2024-05-08T18:32:16.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.837+0000 7fc85a32f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:32:16.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.837+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1d0e0 con 0x7fc850035020 2024-05-08T18:32:16.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.838+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848018900 con 0x7fc850035020 2024-05-08T18:32:16.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.838+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94811833095376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1d8f0 con 0x7fc850035020 2024-05-08T18:32:16.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.838+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1eeb0 con 0x563b19a12db0 2024-05-08T18:32:16.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.839+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94811833095376] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848018900 con 0x7fc850035020 2024-05-08T18:32:16.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.839+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.839+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94811833100800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1f2d0 con 0x563b19a12db0 2024-05-08T18:32:16.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.839+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1fc90 con 0x563b19a18e20 2024-05-08T18:32:16.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.840+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850051020 con 0x563b19a18e20 2024-05-08T18:32:16.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.840+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94811833104352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a204e0 con 0x563b19a18e20 2024-05-08T18:32:16.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.840+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a20fb0 con 0x7fc850035020 2024-05-08T18:32:16.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.840+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94811833100800] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.841+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94811833104352] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850051020 con 0x563b19a18e20 2024-05-08T18:32:16.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.841+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848018900 con 0x7fc850035020 2024-05-08T18:32:16.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.841+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94811833109152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a20030 con 0x7fc850035020 2024-05-08T18:32:16.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.841+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a21970 con 0x563b19a12db0 2024-05-08T18:32:16.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.842+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94811833109152] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848018900 con 0x7fc850035020 2024-05-08T18:32:16.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.842+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.842+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94811833111744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a21d90 con 0x563b19a12db0 2024-05-08T18:32:16.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.842+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a22750 con 0x7fc848017050 2024-05-08T18:32:16.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.843+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94811833111744] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.843+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.843+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94811833113280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a22750 con 0x7fc848017050 2024-05-08T18:32:16.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.843+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a23110 con 0x7fc848017050 2024-05-08T18:32:16.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.844+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94811833113280] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.844+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.845+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94811833115568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a23110 con 0x7fc848017050 2024-05-08T18:32:16.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.845+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a23ad0 con 0x7fc848017050 2024-05-08T18:32:16.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.845+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94811833115568] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.846+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.846+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94811833118272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a23ad0 con 0x7fc848017050 2024-05-08T18:32:16.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.846+0000 7fc85a32f800 20 add_watcher() i=0 2024-05-08T18:32:16.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.846+0000 7fc85a32f800 20 add_watcher() i=1 2024-05-08T18:32:16.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.846+0000 7fc85a32f800 20 add_watcher() i=2 2024-05-08T18:32:16.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.846+0000 7fc85a32f800 20 add_watcher() i=3 2024-05-08T18:32:16.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.846+0000 7fc85a32f800 20 add_watcher() i=4 2024-05-08T18:32:16.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.846+0000 7fc85a32f800 20 add_watcher() i=5 2024-05-08T18:32:16.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.846+0000 7fc85a32f800 20 add_watcher() i=6 2024-05-08T18:32:16.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.847+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94811833118272] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.847+0000 7fc85a32f800 20 add_watcher() i=7 2024-05-08T18:32:16.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.847+0000 7fc85a32f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:32:16.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.847+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b19a26e60 con 0x563b19a12db0 2024-05-08T18:32:16.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.847+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.847+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94811833133104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a23c40 con 0x563b19a12db0 2024-05-08T18:32:16.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.848+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94811833133104] v29'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.848+0000 7fc7077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:16.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.848+0000 7fc85a32f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:32:16.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.848+0000 7fc85a32f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:32:16.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.848+0000 7fc85a32f800 5 note: GC not initialized 2024-05-08T18:32:16.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.849+0000 7fc7067fc640 20 reqs_thread_entry: start 2024-05-08T18:32:16.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.849+0000 7fc85a32f800 20 init_complete bucket index max shards: 11 2024-05-08T18:32:16.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.849+0000 7fc85a32f800 20 Filter name: none 2024-05-08T18:32:16.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.849+0000 7fc677fff640 20 reqs_thread_entry: start 2024-05-08T18:32:16.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.849+0000 7fc85a32f800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.849+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b19a59e40 con 0x563b19a12db0 2024-05-08T18:32:16.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.849+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.849+0000 7fc85a32f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:32:16.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.849+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563b19a5b230 con 0x7fc848017050 2024-05-08T18:32:16.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.850+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.851+0000 7fc7077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:16.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.851+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94811833133104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a58a90 con 0x563b19a12db0 2024-05-08T18:32:16.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.852+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94811833133104] v29'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.852+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94811833095376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a26830 con 0x7fc850035020 2024-05-08T18:32:16.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.853+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94811833095376] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848018900 con 0x7fc850035020 2024-05-08T18:32:16.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.853+0000 7fc85a32f800 20 remove_watcher() i=0 2024-05-08T18:32:16.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.853+0000 7fc85a32f800 2 removed watcher, disabling cache 2024-05-08T18:32:16.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.853+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94811833100800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1d4d0 con 0x563b19a12db0 2024-05-08T18:32:16.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.854+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94811833100800] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.854+0000 7fc85a32f800 20 remove_watcher() i=1 2024-05-08T18:32:16.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.854+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94811833104352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1d4d0 con 0x563b19a18e20 2024-05-08T18:32:16.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.855+0000 7fc8567cb640 1 -- 172.21.15.87:0/3781508379 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94811833104352] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850051020 con 0x563b19a18e20 2024-05-08T18:32:16.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.855+0000 7fc85a32f800 20 remove_watcher() i=2 2024-05-08T18:32:16.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.855+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94811833109152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1d4d0 con 0x7fc850035020 2024-05-08T18:32:16.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.856+0000 7fc855fca640 1 -- 172.21.15.87:0/3781508379 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94811833109152] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc848018900 con 0x7fc850035020 2024-05-08T18:32:16.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.856+0000 7fc85a32f800 20 remove_watcher() i=3 2024-05-08T18:32:16.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.856+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94811833111744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1d4d0 con 0x563b19a12db0 2024-05-08T18:32:16.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.857+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94811833111744] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x563b19a12db0 2024-05-08T18:32:16.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.857+0000 7fc85a32f800 20 remove_watcher() i=4 2024-05-08T18:32:16.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.857+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94811833113280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a214c0 con 0x7fc848017050 2024-05-08T18:32:16.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.858+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94811833113280] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.858+0000 7fc85a32f800 20 remove_watcher() i=5 2024-05-08T18:32:16.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.858+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94811833115568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1d4d0 con 0x7fc848017050 2024-05-08T18:32:16.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.859+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94811833115568] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.859+0000 7fc85a32f800 20 remove_watcher() i=6 2024-05-08T18:32:16.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.859+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94811833118272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563b19a1d4d0 con 0x7fc848017050 2024-05-08T18:32:16.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.860+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94811833118272] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84005a040 con 0x7fc848017050 2024-05-08T18:32:16.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.860+0000 7fc85a32f800 20 remove_watcher() i=7 2024-05-08T18:32:16.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.860+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc848017050 msgr2=0x7fc8480523c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.860+0000 7fc85a32f800 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc848017050 0x7fc8480523c0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.860+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563b19a12db0 msgr2=0x563b19a15270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.860+0000 7fc85a32f800 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563b19a12db0 0x563b19a15270 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.860+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc850035020 msgr2=0x7fc8500419b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.860+0000 7fc85a32f800 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc850035020 0x7fc8500419b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.860+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563b19a18e20 msgr2=0x563b19a1b270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.860+0000 7fc85a32f800 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563b19a18e20 0x563b19a1b270 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc72003bba0 msgr2=0x7fc72003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc72003bba0 0x7fc72003e060 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc848050f40 tx=0x7fc84804c050 comp rx=0 tx=0).stop 2024-05-08T18:32:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199ffbc0 msgr2=0x563b19a07160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 --2- 172.21.15.87:0/3781508379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199ffbc0 0x563b19a07160 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc850052910 tx=0x7fc850052940 comp rx=0 tx=0).stop 2024-05-08T18:32:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 reap_dead start 2024-05-08T18:32:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc84ffff640 1 -- 172.21.15.87:0/3781508379 reap_dead start 2024-05-08T18:32:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 shutdown_connections 2024-05-08T18:32:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 >> 172.21.15.87:0/3781508379 conn(0x563b199fbf20 msgr2=0x563b199f9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 shutdown_connections 2024-05-08T18:32:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 -- 172.21.15.87:0/3781508379 wait complete. 2024-05-08T18:32:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 -- 172.21.15.87:0/2403609549 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc73003bb50 msgr2=0x7fc73003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 --2- 172.21.15.87:0/2403609549 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc73003bb50 0x7fc73003e010 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc84802dfb0 tx=0x7fc848050f70 comp rx=0 tx=0).stop 2024-05-08T18:32:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 -- 172.21.15.87:0/2403609549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199f28c0 msgr2=0x563b199f2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 --2- 172.21.15.87:0/2403609549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199f28c0 0x563b199f2ce0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x563b199deee0 tx=0x7fc8500178e0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 -- 172.21.15.87:0/2403609549 shutdown_connections 2024-05-08T18:32:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 --2- 172.21.15.87:0/2403609549 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc73003bb50 0x7fc73003e010 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 --2- 172.21.15.87:0/2403609549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b199f28c0 0x563b199f2ce0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 -- 172.21.15.87:0/2403609549 >> 172.21.15.87:0/2403609549 conn(0x563b199e6960 msgr2=0x563b199e6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 -- 172.21.15.87:0/2403609549 shutdown_connections 2024-05-08T18:32:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 -- 172.21.15.87:0/2403609549 wait complete. 2024-05-08T18:32:16.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 -- 172.21.15.87:0/1218614820 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563b199e0580 msgr2=0x563b199e3dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563b199e0580 0x563b199e3dc0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 -- 172.21.15.87:0/1218614820 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563b19851dd0 msgr2=0x563b199de5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.861+0000 7fc85a32f800 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563b19851dd0 0x563b199de5c0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.862+0000 7fc85a32f800 1 -- 172.21.15.87:0/1218614820 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc73c03bb50 msgr2=0x7fc73c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.862+0000 7fc85a32f800 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc73c03bb50 0x7fc73c03e010 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc840054000 tx=0x7fc84004e000 comp rx=0 tx=0).stop 2024-05-08T18:32:16.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.862+0000 7fc85a32f800 1 -- 172.21.15.87:0/1218614820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 msgr2=0x563b199d73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.862+0000 7fc85a32f800 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 0x563b199d73d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc84800b700 tx=0x7fc848000bc0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.862+0000 7fc85a32f800 1 -- 172.21.15.87:0/1218614820 shutdown_connections 2024-05-08T18:32:16.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.862+0000 7fc85a32f800 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563b19851dd0 0x563b199de5c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.862+0000 7fc85a32f800 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563b199e0580 0x563b199e3dc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.862+0000 7fc85a32f800 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc73c03bb50 0x7fc73c03e010 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.862+0000 7fc85a32f800 1 --2- 172.21.15.87:0/1218614820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563b19850a40 0x563b199d73d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.862+0000 7fc85a32f800 1 -- 172.21.15.87:0/1218614820 >> 172.21.15.87:0/1218614820 conn(0x563b198d7840 msgr2=0x563b199c9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.862+0000 7fc85a32f800 1 -- 172.21.15.87:0/1218614820 shutdown_connections 2024-05-08T18:32:16.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.862+0000 7fc85a32f800 1 -- 172.21.15.87:0/1218614820 wait complete. 2024-05-08T18:32:16.871 INFO:teuthology.orchestra.run.smithi087.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:32:16.871 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:32:16.871 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-05-08T18:32:16.871 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-05-08T18:32:16.871 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-05-08T18:32:16.924 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:32:16.924 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:32:16.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.926+0000 7f8481b36800 1 Processor -- start 2024-05-08T18:32:16.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.926+0000 7f8481b36800 1 -- start start 2024-05-08T18:32:16.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.926+0000 7f8481b36800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5592bf88a180 0x5592bf88a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.926+0000 7f8481b36800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5592bf88ac20 con 0x5592bf88b3e0 2024-05-08T18:32:16.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.926+0000 7f8481b36800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5592bf72be20 con 0x5592bf88a180 2024-05-08T18:32:16.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.926+0000 7f847d8c5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5592bf88a180 0x5592bf88a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.926+0000 7f8477fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5592bf88b3e0 0x5592bf88b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:40764/0 (socket says 172.21.15.87:40764) 2024-05-08T18:32:16.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.926+0000 7f8477fff640 1 -- 172.21.15.87:0/4053179359 learned_addr learned my addr 172.21.15.87:0/4053179359 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:32:16.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.927+0000 7f847d8c5640 1 -- 172.21.15.87:0/4053179359 >> v1:172.21.15.53:6789/0 conn(0x5592bf88b3e0 legacy=0x5592bf88b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.927+0000 7f847d8c5640 1 -- 172.21.15.87:0/4053179359 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592bf88bfa0 con 0x5592bf88a180 2024-05-08T18:32:16.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.929+0000 7f847d8c5640 1 --2- 172.21.15.87:0/4053179359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 0x5592bf88a5a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f847000a470 tx=0x7f847001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2df0a0dd6b55aa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.929+0000 7f847d0c4640 1 -- 172.21.15.87:0/4053179359 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8470057070 con 0x5592bf88a180 2024-05-08T18:32:16.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.929+0000 7f847d0c4640 1 -- 172.21.15.87:0/4053179359 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f847004adc0 con 0x5592bf88a180 2024-05-08T18:32:16.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.929+0000 7f847d0c4640 1 -- 172.21.15.87:0/4053179359 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8470052590 con 0x5592bf88a180 2024-05-08T18:32:16.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.929+0000 7f8481b36800 1 -- 172.21.15.87:0/4053179359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 msgr2=0x5592bf88a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.929+0000 7f8481b36800 1 --2- 172.21.15.87:0/4053179359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 0x5592bf88a5a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f847000a470 tx=0x7f847001ce90 comp rx=0 tx=0).stop 2024-05-08T18:32:16.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.929+0000 7f8481b36800 1 -- 172.21.15.87:0/4053179359 shutdown_connections 2024-05-08T18:32:16.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.929+0000 7f8481b36800 1 --2- 172.21.15.87:0/4053179359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 0x5592bf88a5a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.929+0000 7f8481b36800 1 -- 172.21.15.87:0/4053179359 >> 172.21.15.87:0/4053179359 conn(0x5592bf885760 msgr2=0x5592bf887b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.929+0000 7f8481b36800 1 -- 172.21.15.87:0/4053179359 shutdown_connections 2024-05-08T18:32:16.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.929+0000 7f8481b36800 1 -- 172.21.15.87:0/4053179359 wait complete. 2024-05-08T18:32:16.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.943+0000 7f8481b36800 1 Processor -- start 2024-05-08T18:32:16.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.943+0000 7f8481b36800 1 -- start start 2024-05-08T18:32:16.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.943+0000 7f8481b36800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 0x5592bf7fe300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.943+0000 7f8481b36800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5592bf7d65f0 con 0x5592bf88a180 2024-05-08T18:32:16.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.943+0000 7f847d8c5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 0x5592bf7fe300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.943+0000 7f847d8c5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 0x5592bf7fe300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60916/0 (socket says 172.21.15.87:60916) 2024-05-08T18:32:16.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.943+0000 7f847d8c5640 1 -- 172.21.15.87:0/134556970 learned_addr learned my addr 172.21.15.87:0/134556970 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.944+0000 7f847d8c5640 1 -- 172.21.15.87:0/134556970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592bf97f540 con 0x5592bf88a180 2024-05-08T18:32:16.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.944+0000 7f847d8c5640 1 --2- 172.21.15.87:0/134556970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 0x5592bf7fe300 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f847001ced0 tx=0x7f847004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e697bbf4cd0e30d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.944+0000 7f836be07640 1 -- 172.21.15.87:0/134556970 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8470057040 con 0x5592bf88a180 2024-05-08T18:32:16.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.944+0000 7f836be07640 1 -- 172.21.15.87:0/134556970 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8470063070 con 0x5592bf88a180 2024-05-08T18:32:16.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.944+0000 7f836be07640 1 -- 172.21.15.87:0/134556970 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8470052800 con 0x5592bf88a180 2024-05-08T18:32:16.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.945+0000 7f8481b36800 1 -- 172.21.15.87:0/134556970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 msgr2=0x5592bf7fe300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.945+0000 7f8481b36800 1 --2- 172.21.15.87:0/134556970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 0x5592bf7fe300 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f847001ced0 tx=0x7f847004c000 comp rx=0 tx=0).stop 2024-05-08T18:32:16.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.945+0000 7f8481b36800 1 -- 172.21.15.87:0/134556970 shutdown_connections 2024-05-08T18:32:16.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.945+0000 7f8481b36800 1 --2- 172.21.15.87:0/134556970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 0x5592bf7fe300 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.945+0000 7f8481b36800 1 -- 172.21.15.87:0/134556970 >> 172.21.15.87:0/134556970 conn(0x5592bf885760 msgr2=0x5592bf977030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.945+0000 7f8481b36800 1 -- 172.21.15.87:0/134556970 shutdown_connections 2024-05-08T18:32:16.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.945+0000 7f8481b36800 1 -- 172.21.15.87:0/134556970 wait complete. 2024-05-08T18:32:16.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.945+0000 7f8481b36800 1 Processor -- start 2024-05-08T18:32:16.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.945+0000 7f8481b36800 1 -- start start 2024-05-08T18:32:16.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.945+0000 7f8481b36800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 0x5592bf97ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.945+0000 7f8481b36800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5592bf8938b0 con 0x5592bf88a180 2024-05-08T18:32:16.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.945+0000 7f847d8c5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 0x5592bf97ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.945+0000 7f847d8c5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 0x5592bf97ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60924/0 (socket says 172.21.15.87:60924) 2024-05-08T18:32:16.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.945+0000 7f847d8c5640 1 -- 172.21.15.87:0/1393040208 learned_addr learned my addr 172.21.15.87:0/1393040208 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.946+0000 7f847d8c5640 1 -- 172.21.15.87:0/1393040208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592bf97b560 con 0x5592bf88a180 2024-05-08T18:32:16.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.946+0000 7f847d8c5640 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 0x5592bf97ce70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f847004ad90 tx=0x7f8470002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.946+0000 7f836a604640 1 -- 172.21.15.87:0/1393040208 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f847006d070 con 0x5592bf88a180 2024-05-08T18:32:16.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.946+0000 7f836a604640 1 -- 172.21.15.87:0/1393040208 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8470052d00 con 0x5592bf88a180 2024-05-08T18:32:16.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.946+0000 7f8481b36800 1 -- 172.21.15.87:0/1393040208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592bf97b7f0 con 0x5592bf88a180 2024-05-08T18:32:16.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.946+0000 7f836a604640 1 -- 172.21.15.87:0/1393040208 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8470057050 con 0x5592bf88a180 2024-05-08T18:32:16.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.946+0000 7f8481b36800 1 -- 172.21.15.87:0/1393040208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592bf97bd70 con 0x5592bf88a180 2024-05-08T18:32:16.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.947+0000 7f836a604640 1 -- 172.21.15.87:0/1393040208 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f847005d470 con 0x5592bf88a180 2024-05-08T18:32:16.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.947+0000 7f836a604640 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f836403bba0 0x7f836403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.947+0000 7f836a604640 1 -- 172.21.15.87:0/1393040208 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f8470093c40 con 0x5592bf88a180 2024-05-08T18:32:16.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.947+0000 7f8477fff640 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f836403bba0 0x7f836403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.947+0000 7f8481b36800 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5592bf88b3e0 0x5592bf98d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.947+0000 7f8481b36800 1 -- 172.21.15.87:0/1393040208 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bf98dd60 con 0x5592bf88b3e0 2024-05-08T18:32:16.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.948+0000 7f847e0c6640 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5592bf88b3e0 0x5592bf98d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.948+0000 7f8477fff640 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f836403bba0 0x7f836403e060 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8468000f60 tx=0x7f84680012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.948+0000 7f847e0c6640 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5592bf88b3e0 0x5592bf98d820 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.948+0000 7f847e0c6640 1 -- 172.21.15.87:0/1393040208 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f847800a4a0 con 0x5592bf88b3e0 2024-05-08T18:32:16.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.948+0000 7f8481b36800 1 -- 172.21.15.87:0/1393040208 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bf98e5b0 con 0x5592bf88b3e0 2024-05-08T18:32:16.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.948+0000 7f847e0c6640 1 -- 172.21.15.87:0/1393040208 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f847800a4a0 con 0x5592bf88b3e0 2024-05-08T18:32:16.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.948+0000 7f8481b36800 1 -- 172.21.15.87:0/1393040208 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bf98f9a0 con 0x5592bf88b3e0 2024-05-08T18:32:16.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.949+0000 7f847e0c6640 1 -- 172.21.15.87:0/1393040208 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f847800a4a0 con 0x5592bf88b3e0 2024-05-08T18:32:16.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.949+0000 7f8481b36800 1 -- 172.21.15.87:0/1393040208 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bf98ee00 con 0x5592bf88b3e0 2024-05-08T18:32:16.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.949+0000 7f847e0c6640 1 -- 172.21.15.87:0/1393040208 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f847800a4a0 con 0x5592bf88b3e0 2024-05-08T18:32:16.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.949+0000 7f8481b36800 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5592bf990e30 0x5592bf993220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.949+0000 7f8481b36800 1 -- 172.21.15.87:0/1393040208 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bf993870 con 0x5592bf990e30 2024-05-08T18:32:16.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.949+0000 7f847d8c5640 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5592bf990e30 0x5592bf993220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.950+0000 7f847d8c5640 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5592bf990e30 0x5592bf993220 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.950+0000 7f847d8c5640 1 -- 172.21.15.87:0/1393040208 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f847005a040 con 0x5592bf990e30 2024-05-08T18:32:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.950+0000 7f8481b36800 1 Processor -- start 2024-05-08T18:32:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.950+0000 7f8481b36800 1 -- start start 2024-05-08T18:32:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.950+0000 7f8481b36800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9a1ba0 0x5592bf9a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.950+0000 7f8481b36800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5592bf97d3b0 con 0x5592bf9a1ba0 2024-05-08T18:32:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.951+0000 7f847e0c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9a1ba0 0x5592bf9a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.951+0000 7f847e0c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9a1ba0 0x5592bf9a1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60932/0 (socket says 172.21.15.87:60932) 2024-05-08T18:32:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.951+0000 7f847e0c6640 1 -- 172.21.15.87:0/1423447030 learned_addr learned my addr 172.21.15.87:0/1423447030 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.951+0000 7f847e0c6640 1 -- 172.21.15.87:0/1423447030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592bf9a2500 con 0x5592bf9a1ba0 2024-05-08T18:32:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.951+0000 7f847e0c6640 1 --2- 172.21.15.87:0/1423447030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9a1ba0 0x5592bf9a1fc0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x5592bf97cbb0 tx=0x7f84780178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.951+0000 7f83637fe640 1 -- 172.21.15.87:0/1423447030 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8478013440 con 0x5592bf9a1ba0 2024-05-08T18:32:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.951+0000 7f83637fe640 1 -- 172.21.15.87:0/1423447030 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84780135e0 con 0x5592bf9a1ba0 2024-05-08T18:32:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.951+0000 7f8481b36800 1 -- 172.21.15.87:0/1423447030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592bf9a2f70 con 0x5592bf9a1ba0 2024-05-08T18:32:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.951+0000 7f83637fe640 1 -- 172.21.15.87:0/1423447030 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84780138c0 con 0x5592bf9a1ba0 2024-05-08T18:32:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.951+0000 7f8481b36800 1 -- 172.21.15.87:0/1423447030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592bf9a3470 con 0x5592bf9a1ba0 2024-05-08T18:32:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.952+0000 7f83637fe640 1 -- 172.21.15.87:0/1423447030 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8478011040 con 0x5592bf9a1ba0 2024-05-08T18:32:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.952+0000 7f83637fe640 1 --2- 172.21.15.87:0/1423447030 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f835803bba0 0x7f835803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.952+0000 7f83637fe640 1 -- 172.21.15.87:0/1423447030 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f847801d070 con 0x5592bf9a1ba0 2024-05-08T18:32:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.952+0000 7f847d8c5640 1 --2- 172.21.15.87:0/1423447030 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f835803bba0 0x7f835803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.953+0000 7f8481b36800 1 Processor -- start 2024-05-08T18:32:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.953+0000 7f847d8c5640 1 --2- 172.21.15.87:0/1423447030 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f835803bba0 0x7f835803e060 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8470066ef0 tx=0x7f8470091e60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.953+0000 7f8481b36800 1 -- start start 2024-05-08T18:32:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.953+0000 7f8481b36800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9aee50 0x5592bf9af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.953+0000 7f8481b36800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5592bf77cfc0 con 0x5592bf9aee50 2024-05-08T18:32:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.953+0000 7f847e0c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9aee50 0x5592bf9af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.953+0000 7f847e0c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9aee50 0x5592bf9af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60942/0 (socket says 172.21.15.87:60942) 2024-05-08T18:32:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.953+0000 7f847e0c6640 1 -- 172.21.15.87:0/326929950 learned_addr learned my addr 172.21.15.87:0/326929950 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.953+0000 7f847e0c6640 1 -- 172.21.15.87:0/326929950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592bf9af840 con 0x5592bf9aee50 2024-05-08T18:32:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.954+0000 7f847e0c6640 1 --2- 172.21.15.87:0/326929950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9aee50 0x5592bf9af270 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8478052990 tx=0x7f8478029430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09d9987f3225fca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.954+0000 7f83617fa640 1 -- 172.21.15.87:0/326929950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f847802ad80 con 0x5592bf9aee50 2024-05-08T18:32:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.954+0000 7f83617fa640 1 -- 172.21.15.87:0/326929950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84780014f0 con 0x5592bf9aee50 2024-05-08T18:32:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.954+0000 7f83617fa640 1 -- 172.21.15.87:0/326929950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8478001810 con 0x5592bf9aee50 2024-05-08T18:32:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.954+0000 7f8481b36800 1 -- 172.21.15.87:0/326929950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9aee50 msgr2=0x5592bf9af270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.954+0000 7f8481b36800 1 --2- 172.21.15.87:0/326929950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9aee50 0x5592bf9af270 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8478052990 tx=0x7f8478029430 comp rx=0 tx=0).stop 2024-05-08T18:32:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.954+0000 7f8481b36800 1 -- 172.21.15.87:0/326929950 shutdown_connections 2024-05-08T18:32:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.954+0000 7f8481b36800 1 --2- 172.21.15.87:0/326929950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9aee50 0x5592bf9af270 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.954+0000 7f8481b36800 1 -- 172.21.15.87:0/326929950 >> 172.21.15.87:0/326929950 conn(0x5592bf9ab200 msgr2=0x5592bf9a9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.954+0000 7f8481b36800 1 -- 172.21.15.87:0/326929950 shutdown_connections 2024-05-08T18:32:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.954+0000 7f8481b36800 1 -- 172.21.15.87:0/326929950 wait complete. 2024-05-08T18:32:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.954+0000 7f8481b36800 1 Processor -- start 2024-05-08T18:32:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.954+0000 7f8481b36800 1 -- start start 2024-05-08T18:32:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.955+0000 7f8481b36800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9aee50 0x5592bf9b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.955+0000 7f8481b36800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5592bf9afe20 con 0x5592bf9aee50 2024-05-08T18:32:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.955+0000 7f847e0c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9aee50 0x5592bf9b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.955+0000 7f847e0c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9aee50 0x5592bf9b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60948/0 (socket says 172.21.15.87:60948) 2024-05-08T18:32:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.955+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 learned_addr learned my addr 172.21.15.87:0/868674754 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.955+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592bf9b68a0 con 0x5592bf9aee50 2024-05-08T18:32:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.955+0000 7f847e0c6640 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9aee50 0x5592bf9b6360 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8478051830 tx=0x7f84780528f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.955+0000 7f834f7fe640 1 -- 172.21.15.87:0/868674754 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8478030020 con 0x5592bf9aee50 2024-05-08T18:32:16.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.955+0000 7f834f7fe640 1 -- 172.21.15.87:0/868674754 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8478013bb0 con 0x5592bf9aee50 2024-05-08T18:32:16.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.955+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592bf9b6b30 con 0x5592bf9aee50 2024-05-08T18:32:16.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.955+0000 7f834f7fe640 1 -- 172.21.15.87:0/868674754 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84780540d0 con 0x5592bf9aee50 2024-05-08T18:32:16.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.955+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592bf9b97e0 con 0x5592bf9aee50 2024-05-08T18:32:16.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.956+0000 7f834f7fe640 1 -- 172.21.15.87:0/868674754 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8478033020 con 0x5592bf9aee50 2024-05-08T18:32:16.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.956+0000 7f834f7fe640 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f834803bb50 0x7f834803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.956+0000 7f834f7fe640 1 -- 172.21.15.87:0/868674754 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f847800e040 con 0x5592bf9aee50 2024-05-08T18:32:16.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.956+0000 7f847d8c5640 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f834803bb50 0x7f834803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.957+0000 7f847d8c5640 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f834803bb50 0x7f834803e010 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8470044700 tx=0x7f847007c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.957+0000 7f8481b36800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.957+0000 7f8481b36800 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5592bf9c1db0 0x5592bf9c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.957+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9c49c0 con 0x5592bf9c1db0 2024-05-08T18:32:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.957+0000 7f8477fff640 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5592bf9c1db0 0x5592bf9c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.957+0000 7f8477fff640 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5592bf9c1db0 0x5592bf9c4270 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8468009050 con 0x5592bf9c1db0 2024-05-08T18:32:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8481b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8481b36800 20 realm 2024-05-08T18:32:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8481b36800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9c1200 con 0x5592bf9c1db0 2024-05-08T18:32:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8468009050 con 0x5592bf9c1db0 2024-05-08T18:32:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8481b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8481b36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:32:16.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8481b36800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9c54b0 con 0x5592bf9c1db0 2024-05-08T18:32:16.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8468009050 con 0x5592bf9c1db0 2024-05-08T18:32:16.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8481b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8481b36800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9c5d80 con 0x5592bf9c1db0 2024-05-08T18:32:16.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8468009050 con 0x5592bf9c1db0 2024-05-08T18:32:16.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8481b36800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:16.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8481b36800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.958+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9c6120 con 0x5592bf9c1db0 2024-05-08T18:32:16.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.959+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8468009050 con 0x5592bf9c1db0 2024-05-08T18:32:16.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.959+0000 7f8481b36800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:32:16.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.959+0000 7f8481b36800 20 searching for the correct realm 2024-05-08T18:32:16.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.959+0000 7f8481b36800 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5592bf9c8000 0x5592bf9ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.959+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9caaa0 con 0x5592bf9c8000 2024-05-08T18:32:16.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.959+0000 7f847e0c6640 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5592bf9c8000 0x5592bf9ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.959+0000 7f847e0c6640 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5592bf9c8000 0x5592bf9ca3f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.959+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8478052d70 con 0x5592bf9c8000 2024-05-08T18:32:16.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.959+0000 7f847e0c6640 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8478035020 0x7f847802c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.959+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9caaa0 con 0x7f8478035020 2024-05-08T18:32:16.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.960+0000 7f847d8c5640 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8478035020 0x7f847802c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.960+0000 7f847d8c5640 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8478035020 0x7f847802c480 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.960+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847005a040 con 0x7f8478035020 2024-05-08T18:32:16.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.960+0000 7f847d8c5640 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f84700027b0 0x7f8470066380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:16.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.960+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9caaa0 con 0x7f84700027b0 2024-05-08T18:32:16.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.960+0000 7f8477fff640 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f84700027b0 0x7f8470066380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:16.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.961+0000 7f8477fff640 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f84700027b0 0x7f8470066380 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:16.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.961+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8468009050 con 0x7f84700027b0 2024-05-08T18:32:16.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.961+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9caaa0 con 0x5592bf9c1db0 2024-05-08T18:32:16.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.961+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8468009050 con 0x5592bf9c1db0 2024-05-08T18:32:16.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.961+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9caaa0 con 0x5592bf9c1db0 2024-05-08T18:32:16.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.961+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:16.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.961+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9caaa0 con 0x7f84700027b0 2024-05-08T18:32:16.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.962+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.962+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9caaa0 con 0x7f84700027b0 2024-05-08T18:32:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.962+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.962+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9caaa0 con 0x7f8478035020 2024-05-08T18:32:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.962+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847005a040 con 0x7f8478035020 2024-05-08T18:32:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.962+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9caaa0 con 0x5592bf9c8000 2024-05-08T18:32:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.962+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8478052d70 con 0x5592bf9c8000 2024-05-08T18:32:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.962+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9caaa0 con 0x5592bf9c1db0 2024-05-08T18:32:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.963+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.963+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9caaa0 con 0x7f84700027b0 2024-05-08T18:32:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.963+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.963+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9caaa0 con 0x5592bf9c1db0 2024-05-08T18:32:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.963+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.963+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9caaa0 con 0x7f8478035020 2024-05-08T18:32:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.963+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f847005a040 con 0x7f8478035020 2024-05-08T18:32:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.963+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x5592bf9c8000 2024-05-08T18:32:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.964+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8478061040 con 0x5592bf9c8000 2024-05-08T18:32:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.964+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x5592bf9c8000 2024-05-08T18:32:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.964+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8478061040 con 0x5592bf9c8000 2024-05-08T18:32:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.964+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x7f84700027b0 2024-05-08T18:32:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.964+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.964+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x5592bf9c8000 2024-05-08T18:32:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.964+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8478061040 con 0x5592bf9c8000 2024-05-08T18:32:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.964+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x5592bf9c8000 2024-05-08T18:32:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.965+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8478061040 con 0x5592bf9c8000 2024-05-08T18:32:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.965+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x5592bf9c1db0 2024-05-08T18:32:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.965+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.965+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x5592bf9c1db0 2024-05-08T18:32:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.965+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.965+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x7f84700027b0 2024-05-08T18:32:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.965+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.965+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x5592bf9c8000 2024-05-08T18:32:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.966+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8478061040 con 0x5592bf9c8000 2024-05-08T18:32:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.966+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x7f8478035020 2024-05-08T18:32:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.966+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847005a040 con 0x7f8478035020 2024-05-08T18:32:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.966+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x5592bf9c1db0 2024-05-08T18:32:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.966+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.966+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x7f84700027b0 2024-05-08T18:32:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.966+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.966+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x5592bf9c8000 2024-05-08T18:32:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.967+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8478061040 con 0x5592bf9c8000 2024-05-08T18:32:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.967+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x7f8478035020 2024-05-08T18:32:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.967+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847005a040 con 0x7f8478035020 2024-05-08T18:32:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.967+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x7f8478035020 2024-05-08T18:32:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.967+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847005a040 con 0x7f8478035020 2024-05-08T18:32:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.967+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x5592bf9c8000 2024-05-08T18:32:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.967+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8478061040 con 0x5592bf9c8000 2024-05-08T18:32:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.967+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x7f8478035020 2024-05-08T18:32:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.967+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847005a040 con 0x7f8478035020 2024-05-08T18:32:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.967+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x5592bf9c1db0 2024-05-08T18:32:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f847009f060 con 0x7f8478035020 2024-05-08T18:32:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847005a040 con 0x7f8478035020 2024-05-08T18:32:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8481b36800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:32:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8481b36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:32:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8481b36800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:32:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8481b36800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:32:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8481b36800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:32:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8481b36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:32:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8481b36800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9c6aa0 con 0x5592bf9c1db0 2024-05-08T18:32:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8481b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8481b36800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9c7340 con 0x5592bf9c1db0 2024-05-08T18:32:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8481b36800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8481b36800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.968+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9caf20 con 0x7f84700027b0 2024-05-08T18:32:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f8481b36800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:32:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f8481b36800 20 zone default found 2024-05-08T18:32:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f8481b36800 4 Realm: () 2024-05-08T18:32:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f8481b36800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:32:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f8481b36800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:32:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f8481b36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:32:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f8481b36800 20 zonegroup default 2024-05-08T18:32:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f8481b36800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9cb3d0 con 0x7f84700027b0 2024-05-08T18:32:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f8481b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f8481b36800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9ccdb0 con 0x5592bf9c8000 2024-05-08T18:32:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8478061040 con 0x5592bf9c8000 2024-05-08T18:32:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f8481b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f8481b36800 20 rados->read ofs=0 len=0 2024-05-08T18:32:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.969+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9cd2a0 con 0x5592bf9c8000 2024-05-08T18:32:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.970+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8478061040 con 0x5592bf9c8000 2024-05-08T18:32:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.970+0000 7f8481b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.970+0000 7f8481b36800 20 started sync module instance, tier type = 2024-05-08T18:32:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.970+0000 7f8481b36800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:32:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.970+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9cc240 con 0x7f8478035020 2024-05-08T18:32:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.971+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847005a040 con 0x7f8478035020 2024-05-08T18:32:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.971+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94088768308784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9cdbb0 con 0x7f8478035020 2024-05-08T18:32:16.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.971+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9ce400 con 0x5592bf9c1db0 2024-05-08T18:32:16.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.972+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94088768308784] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847005a040 con 0x7f8478035020 2024-05-08T18:32:16.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.972+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:16.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.972+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94088768313088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9ce460 con 0x5592bf9c1db0 2024-05-08T18:32:16.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.972+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9cef70 con 0x5592bf9c8000 2024-05-08T18:32:16.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.973+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94088768313088] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:16.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.973+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8478061040 con 0x5592bf9c8000 2024-05-08T18:32:16.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.973+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94088768317984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9cf360 con 0x5592bf9c8000 2024-05-08T18:32:16.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.973+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9cfda0 con 0x7f8478035020 2024-05-08T18:32:16.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.974+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847005a040 con 0x7f8478035020 2024-05-08T18:32:16.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.974+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94088768317984] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8478061040 con 0x5592bf9c8000 2024-05-08T18:32:16.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.974+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94088768321648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9d0190 con 0x7f8478035020 2024-05-08T18:32:16.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.974+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9d0b90 con 0x5592bf9c1db0 2024-05-08T18:32:16.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.975+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94088768321648] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847005a040 con 0x7f8478035020 2024-05-08T18:32:16.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.976+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:16.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.976+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94088768315216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9d0b50 con 0x5592bf9c1db0 2024-05-08T18:32:16.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.976+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9d1610 con 0x7f84700027b0 2024-05-08T18:32:16.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.976+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94088768315216] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:16.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.977+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:16.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.977+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94088768327968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9d0b50 con 0x7f84700027b0 2024-05-08T18:32:16.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.977+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9d2050 con 0x7f84700027b0 2024-05-08T18:32:16.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.978+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94088768327968] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:16.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.978+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:16.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.978+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94088768325280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9d2230 con 0x7f84700027b0 2024-05-08T18:32:16.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.978+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9d2a80 con 0x7f84700027b0 2024-05-08T18:32:16.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.979+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94088768325280] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:17.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.979+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:17.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.979+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94088768331616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9d28b0 con 0x7f84700027b0 2024-05-08T18:32:17.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.979+0000 7f8481b36800 20 add_watcher() i=0 2024-05-08T18:32:17.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.979+0000 7f8481b36800 20 add_watcher() i=1 2024-05-08T18:32:17.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.979+0000 7f8481b36800 20 add_watcher() i=2 2024-05-08T18:32:17.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.979+0000 7f8481b36800 20 add_watcher() i=3 2024-05-08T18:32:17.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.979+0000 7f8481b36800 20 add_watcher() i=4 2024-05-08T18:32:17.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.979+0000 7f8481b36800 20 add_watcher() i=5 2024-05-08T18:32:17.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.979+0000 7f8481b36800 20 add_watcher() i=6 2024-05-08T18:32:17.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.980+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94088768331616] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:17.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.980+0000 7f8481b36800 20 add_watcher() i=7 2024-05-08T18:32:17.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.980+0000 7f8481b36800 2 all 8 watchers are set, enabling cache 2024-05-08T18:32:17.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.980+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9d5e20 con 0x5592bf9c1db0 2024-05-08T18:32:17.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.980+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:17.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.981+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94088768332672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9d3340 con 0x5592bf9c1db0 2024-05-08T18:32:17.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.982+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94088768332672] v29'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:17.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.982+0000 7f832f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:17.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.982+0000 7f8481b36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:32:17.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.982+0000 7f8481b36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:32:17.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.982+0000 7f8481b36800 5 note: GC not initialized 2024-05-08T18:32:17.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.982+0000 7f832e7fc640 20 reqs_thread_entry: start 2024-05-08T18:32:17.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.982+0000 7f8481b36800 20 init_complete bucket index max shards: 11 2024-05-08T18:32:17.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.982+0000 7f8481b36800 20 Filter name: none 2024-05-08T18:32:17.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.982+0000 7f829ffff640 20 reqs_thread_entry: start 2024-05-08T18:32:17.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.982+0000 7f8481b36800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-08T18:32:17.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.982+0000 7f8481b36800 20 rados->read ofs=0 len=0 2024-05-08T18:32:17.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.982+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bfa093c0 con 0x7f84700027b0 2024-05-08T18:32:17.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.983+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:17.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.983+0000 7f8481b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:17.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.983+0000 7f8481b36800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-05-08T18:32:17.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.983+0000 7f8481b36800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T18:32:17.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.983+0000 7f8481b36800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-05-08T18:32:17.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.983+0000 7f8481b36800 20 rados->read ofs=0 len=0 2024-05-08T18:32:17.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.983+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bfa07b60 con 0x5592bf9c1db0 2024-05-08T18:32:17.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.983+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:17.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.983+0000 7f8481b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:17.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.983+0000 7f8481b36800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-05-08T18:32:17.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.983+0000 7f8481b36800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T18:32:17.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.983+0000 7f8481b36800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-05-08T18:32:17.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.983+0000 7f8481b36800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-05-08T18:32:17.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.983+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bfa08400 con 0x7f84700027b0 2024-05-08T18:32:17.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.984+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v29'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:17.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.984+0000 7f8481b36800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-05-08T18:32:17.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.984+0000 7f8481b36800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T18:32:17.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.984+0000 7f8481b36800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-05-08T18:32:17.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.984+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94088768552784 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bfa0cd00 con 0x7f84700027b0 2024-05-08T18:32:17.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.985+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== watch-notify(notify (1) cookie 94088768331616 notify 124554051600 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5592bfa087a0 con 0x7f84700027b0 2024-05-08T18:32:17.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.985+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(65 notify.7 [notify cookie 94088768552784 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:17.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.985+0000 7f83617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051600 cookie 94088768331616 notifier 4718 bl.length()=556 2024-05-08T18:32:17.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.985+0000 7f83617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-05-08T18:32:17.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.985+0000 7f83617fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T18:32:17.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.985+0000 7f83617fa640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8340003ea0 con 0x7f84700027b0 2024-05-08T18:32:17.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.985+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:17.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.985+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== watch-notify(notify_complete (2) cookie 94088768552784 notify 124554051600 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5592bfa08e10 con 0x7f84700027b0 2024-05-08T18:32:17.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.985+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bfa07f00 con 0x5592bf9c1db0 2024-05-08T18:32:17.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.986+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:17.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.986+0000 7f8481b36800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-08T18:32:17.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.986+0000 7f8481b36800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T18:32:17.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.986+0000 7f8481b36800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-08T18:32:17.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.986+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94088768552656 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592bfa0cd00 con 0x7f84700027b0 2024-05-08T18:32:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.986+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== watch-notify(notify (1) cookie 94088768327968 notify 124554051601 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5592bfa08e10 con 0x7f84700027b0 2024-05-08T18:32:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.986+0000 7f83617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051601 cookie 94088768327968 notifier 4718 bl.length()=177 2024-05-08T18:32:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.986+0000 7f83617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-08T18:32:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.986+0000 7f83617fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T18:32:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.986+0000 7f83617fa640 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8340003ea0 con 0x7f84700027b0 2024-05-08T18:32:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.986+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(68 notify.5 [notify cookie 94088768552656 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.987+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.987+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== watch-notify(notify_complete (2) cookie 94088768552656 notify 124554051601 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5592bf88ac20 con 0x7f84700027b0 2024-05-08T18:32:17.007 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-05-08T18:32:16.984312Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:32:16.984300Z","tags":[],"group_ids":[]} 2024-05-08T18:32:17.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.987+0000 7f832f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.988+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94088768332672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9bb9d0 con 0x5592bf9c1db0 2024-05-08T18:32:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.989+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94088768332672] v29'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.989+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94088768308784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9d2380 con 0x7f8478035020 2024-05-08T18:32:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.990+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94088768308784] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847005a040 con 0x7f8478035020 2024-05-08T18:32:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.990+0000 7f8481b36800 20 remove_watcher() i=0 2024-05-08T18:32:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.990+0000 7f8481b36800 2 removed watcher, disabling cache 2024-05-08T18:32:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.990+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94088768313088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9cc630 con 0x5592bf9c1db0 2024-05-08T18:32:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.991+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94088768313088] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.991+0000 7f8481b36800 20 remove_watcher() i=1 2024-05-08T18:32:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.991+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94088768317984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9cc630 con 0x5592bf9c8000 2024-05-08T18:32:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.992+0000 7f847e0c6640 1 -- 172.21.15.87:0/868674754 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94088768317984] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8478061040 con 0x5592bf9c8000 2024-05-08T18:32:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.992+0000 7f8481b36800 20 remove_watcher() i=2 2024-05-08T18:32:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.992+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94088768321648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9cc630 con 0x7f8478035020 2024-05-08T18:32:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.993+0000 7f847d8c5640 1 -- 172.21.15.87:0/868674754 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94088768321648] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847005a040 con 0x7f8478035020 2024-05-08T18:32:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.993+0000 7f8481b36800 20 remove_watcher() i=3 2024-05-08T18:32:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.993+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94088768315216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9cc630 con 0x5592bf9c1db0 2024-05-08T18:32:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.994+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94088768315216] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f846802a040 con 0x5592bf9c1db0 2024-05-08T18:32:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.994+0000 7f8481b36800 20 remove_watcher() i=4 2024-05-08T18:32:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.994+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94088768327968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9cdf50 con 0x7f84700027b0 2024-05-08T18:32:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.995+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94088768327968] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.995+0000 7f8481b36800 20 remove_watcher() i=5 2024-05-08T18:32:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.995+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94088768325280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9cc630 con 0x7f84700027b0 2024-05-08T18:32:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.996+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94088768325280] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.996+0000 7f8481b36800 20 remove_watcher() i=6 2024-05-08T18:32:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.996+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94088768331616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5592bf9d1120 con 0x7f84700027b0 2024-05-08T18:32:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.997+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94088768331616] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f846802a040 con 0x7f84700027b0 2024-05-08T18:32:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.997+0000 7f8481b36800 20 remove_watcher() i=7 2024-05-08T18:32:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.997+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f84700027b0 msgr2=0x7f8470066380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.997+0000 7f8481b36800 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f84700027b0 0x7f8470066380 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.997+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5592bf9c1db0 msgr2=0x5592bf9c4270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.997+0000 7f8481b36800 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5592bf9c1db0 0x5592bf9c4270 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.997+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8478035020 msgr2=0x7f847802c480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.997+0000 7f8481b36800 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8478035020 0x7f847802c480 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.997+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5592bf9c8000 msgr2=0x5592bf9ca3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.997+0000 7f8481b36800 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5592bf9c8000 0x5592bf9ca3f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f834803bb50 msgr2=0x7f834803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f834803bb50 0x7f834803e010 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8470044700 tx=0x7f847007c000 comp rx=0 tx=0).stop 2024-05-08T18:32:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8477fff640 1 -- 172.21.15.87:0/868674754 reap_dead start 2024-05-08T18:32:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9aee50 msgr2=0x5592bf9b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9aee50 0x5592bf9b6360 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8478051830 tx=0x7f84780528f0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 shutdown_connections 2024-05-08T18:32:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 --2- 172.21.15.87:0/868674754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9aee50 0x5592bf9b6360 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 >> 172.21.15.87:0/868674754 conn(0x5592bf9ab200 msgr2=0x5592bf9a8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 shutdown_connections 2024-05-08T18:32:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 -- 172.21.15.87:0/868674754 wait complete. 2024-05-08T18:32:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 -- 172.21.15.87:0/1423447030 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f835803bba0 msgr2=0x7f835803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 --2- 172.21.15.87:0/1423447030 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f835803bba0 0x7f835803e060 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8470066ef0 tx=0x7f8470091e60 comp rx=0 tx=0).stop 2024-05-08T18:32:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 -- 172.21.15.87:0/1423447030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9a1ba0 msgr2=0x5592bf9a1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 --2- 172.21.15.87:0/1423447030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9a1ba0 0x5592bf9a1fc0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x5592bf97cbb0 tx=0x7f84780178e0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 -- 172.21.15.87:0/1423447030 shutdown_connections 2024-05-08T18:32:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 --2- 172.21.15.87:0/1423447030 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f835803bba0 0x7f835803e060 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 --2- 172.21.15.87:0/1423447030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf9a1ba0 0x5592bf9a1fc0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 -- 172.21.15.87:0/1423447030 >> 172.21.15.87:0/1423447030 conn(0x5592bf995c40 msgr2=0x5592bf996040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 -- 172.21.15.87:0/1423447030 shutdown_connections 2024-05-08T18:32:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 -- 172.21.15.87:0/1423447030 wait complete. 2024-05-08T18:32:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 -- 172.21.15.87:0/1393040208 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5592bf990e30 msgr2=0x5592bf993220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5592bf990e30 0x5592bf993220 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 -- 172.21.15.87:0/1393040208 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5592bf88b3e0 msgr2=0x5592bf98d820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5592bf88b3e0 0x5592bf98d820 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 -- 172.21.15.87:0/1393040208 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f836403bba0 msgr2=0x7f836403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f836403bba0 0x7f836403e060 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8468000f60 tx=0x7f84680012b0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 -- 172.21.15.87:0/1393040208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 msgr2=0x5592bf97ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.998+0000 7f8481b36800 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 0x5592bf97ce70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f847004ad90 tx=0x7f8470002fb0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.999+0000 7f8481b36800 1 -- 172.21.15.87:0/1393040208 shutdown_connections 2024-05-08T18:32:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.999+0000 7f8481b36800 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5592bf88b3e0 0x5592bf98d820 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.999+0000 7f8481b36800 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5592bf990e30 0x5592bf993220 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.999+0000 7f8481b36800 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f836403bba0 0x7f836403e060 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.999+0000 7f8481b36800 1 --2- 172.21.15.87:0/1393040208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592bf88a180 0x5592bf97ce70 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.999+0000 7f8481b36800 1 -- 172.21.15.87:0/1393040208 >> 172.21.15.87:0/1393040208 conn(0x5592bf885760 msgr2=0x5592bf975830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:17.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.999+0000 7f8481b36800 1 -- 172.21.15.87:0/1393040208 shutdown_connections 2024-05-08T18:32:17.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:16.999+0000 7f8481b36800 1 -- 172.21.15.87:0/1393040208 wait complete. 2024-05-08T18:32:17.019 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-05-08T18:32:16.984312Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:32:16.984300Z', 'tags': [], 'group_ids': []} 2024-05-08T18:32:17.032 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:32:17.036 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-05-08T18:32:17.037 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-05-08T18:32:17.037 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-05-08T18:32:17.037 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-05-08T18:32:17.083 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:32:17.083 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:32:17.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.085+0000 7fa26130c800 1 Processor -- start 2024-05-08T18:32:17.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.085+0000 7fa26130c800 1 -- start start 2024-05-08T18:32:17.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.086+0000 7fa26130c800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560972b7e720 0x560972b7eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:17.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.086+0000 7fa26130c800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560972b7fd50 con 0x560972b7f080 2024-05-08T18:32:17.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.086+0000 7fa26130c800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x560972a1fe20 con 0x560972b7e720 2024-05-08T18:32:17.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.086+0000 7fa25ee04640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560972b7e720 0x560972b7eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:17.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.086+0000 7fa25e603640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x560972b7f080 0x560972b7f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:40770/0 (socket says 172.21.15.87:40770) 2024-05-08T18:32:17.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.086+0000 7fa25e603640 1 -- 172.21.15.87:0/2527849955 learned_addr learned my addr 172.21.15.87:0/2527849955 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:32:17.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.086+0000 7fa25ee04640 1 -- 172.21.15.87:0/2527849955 >> v1:172.21.15.53:6789/0 conn(0x560972b7f080 legacy=0x560972b7f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.086+0000 7fa25ee04640 1 -- 172.21.15.87:0/2527849955 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560972b7ff70 con 0x560972b7e720 2024-05-08T18:32:17.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.088+0000 7fa25ee04640 1 --2- 172.21.15.87:0/2527849955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 0x560972b7eb40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa250005fd0 tx=0x7fa25001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ddbf1374e04d97a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:17.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.088+0000 7fa25de02640 1 -- 172.21.15.87:0/2527849955 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa250052560 con 0x560972b7e720 2024-05-08T18:32:17.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.088+0000 7fa25de02640 1 -- 172.21.15.87:0/2527849955 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa250052700 con 0x560972b7e720 2024-05-08T18:32:17.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.088+0000 7fa25de02640 1 -- 172.21.15.87:0/2527849955 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa250052a60 con 0x560972b7e720 2024-05-08T18:32:17.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.089+0000 7fa26130c800 1 -- 172.21.15.87:0/2527849955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 msgr2=0x560972b7eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.089+0000 7fa26130c800 1 --2- 172.21.15.87:0/2527849955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 0x560972b7eb40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa250005fd0 tx=0x7fa25001cc30 comp rx=0 tx=0).stop 2024-05-08T18:32:17.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.089+0000 7fa26130c800 1 -- 172.21.15.87:0/2527849955 shutdown_connections 2024-05-08T18:32:17.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.089+0000 7fa26130c800 1 --2- 172.21.15.87:0/2527849955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 0x560972b7eb40 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.089+0000 7fa26130c800 1 -- 172.21.15.87:0/2527849955 >> 172.21.15.87:0/2527849955 conn(0x560972b78eb0 msgr2=0x560972b7b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:17.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.089+0000 7fa26130c800 1 -- 172.21.15.87:0/2527849955 shutdown_connections 2024-05-08T18:32:17.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.089+0000 7fa26130c800 1 -- 172.21.15.87:0/2527849955 wait complete. 2024-05-08T18:32:17.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.103+0000 7fa26130c800 1 Processor -- start 2024-05-08T18:32:17.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.103+0000 7fa26130c800 1 -- start start 2024-05-08T18:32:17.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.103+0000 7fa26130c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 0x560972b7deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:17.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.103+0000 7fa26130c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560972aca5c0 con 0x560972b7e720 2024-05-08T18:32:17.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.103+0000 7fa25ee04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 0x560972b7deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.103+0000 7fa25ee04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 0x560972b7deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60964/0 (socket says 172.21.15.87:60964) 2024-05-08T18:32:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.103+0000 7fa25ee04640 1 -- 172.21.15.87:0/3095939727 learned_addr learned my addr 172.21.15.87:0/3095939727 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.104+0000 7fa25ee04640 1 -- 172.21.15.87:0/3095939727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560972c735b0 con 0x560972b7e720 2024-05-08T18:32:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.104+0000 7fa25ee04640 1 --2- 172.21.15.87:0/3095939727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 0x560972b7deb0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa250007000 tx=0x7fa25004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a9d826b6b6323d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.104+0000 7fa14ce09640 1 -- 172.21.15.87:0/3095939727 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2500529e0 con 0x560972b7e720 2024-05-08T18:32:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.104+0000 7fa14ce09640 1 -- 172.21.15.87:0/3095939727 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa250052b80 con 0x560972b7e720 2024-05-08T18:32:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.104+0000 7fa14ce09640 1 -- 172.21.15.87:0/3095939727 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa25005c430 con 0x560972b7e720 2024-05-08T18:32:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.105+0000 7fa26130c800 1 -- 172.21.15.87:0/3095939727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 msgr2=0x560972b7deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.105+0000 7fa26130c800 1 --2- 172.21.15.87:0/3095939727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 0x560972b7deb0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa250007000 tx=0x7fa25004c000 comp rx=0 tx=0).stop 2024-05-08T18:32:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.105+0000 7fa26130c800 1 -- 172.21.15.87:0/3095939727 shutdown_connections 2024-05-08T18:32:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.105+0000 7fa26130c800 1 --2- 172.21.15.87:0/3095939727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 0x560972b7deb0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.105+0000 7fa26130c800 1 -- 172.21.15.87:0/3095939727 >> 172.21.15.87:0/3095939727 conn(0x560972b78eb0 msgr2=0x560972c6b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.105+0000 7fa26130c800 1 -- 172.21.15.87:0/3095939727 shutdown_connections 2024-05-08T18:32:17.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.105+0000 7fa26130c800 1 -- 172.21.15.87:0/3095939727 wait complete. 2024-05-08T18:32:17.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.105+0000 7fa26130c800 1 Processor -- start 2024-05-08T18:32:17.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.105+0000 7fa26130c800 1 -- start start 2024-05-08T18:32:17.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.105+0000 7fa26130c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 0x560972c70ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:17.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.105+0000 7fa26130c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560972b87990 con 0x560972b7e720 2024-05-08T18:32:17.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.105+0000 7fa25ee04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 0x560972c70ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:17.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.105+0000 7fa25ee04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 0x560972c70ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60972/0 (socket says 172.21.15.87:60972) 2024-05-08T18:32:17.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.105+0000 7fa25ee04640 1 -- 172.21.15.87:0/1394623658 learned_addr learned my addr 172.21.15.87:0/1394623658 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:17.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.106+0000 7fa25ee04640 1 -- 172.21.15.87:0/1394623658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560972c6f5d0 con 0x560972b7e720 2024-05-08T18:32:17.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.106+0000 7fa25ee04640 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 0x560972c70ee0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa2500526d0 tx=0x7fa250003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:17.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.106+0000 7fa14b606640 1 -- 172.21.15.87:0/1394623658 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa250075070 con 0x560972b7e720 2024-05-08T18:32:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.106+0000 7fa14b606640 1 -- 172.21.15.87:0/1394623658 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa25005cd00 con 0x560972b7e720 2024-05-08T18:32:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.106+0000 7fa26130c800 1 -- 172.21.15.87:0/1394623658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560972c6f860 con 0x560972b7e720 2024-05-08T18:32:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.106+0000 7fa14b606640 1 -- 172.21.15.87:0/1394623658 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa250070410 con 0x560972b7e720 2024-05-08T18:32:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.106+0000 7fa26130c800 1 -- 172.21.15.87:0/1394623658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560972c6fde0 con 0x560972b7e720 2024-05-08T18:32:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.107+0000 7fa14b606640 1 -- 172.21.15.87:0/1394623658 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa250078070 con 0x560972b7e720 2024-05-08T18:32:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.107+0000 7fa14b606640 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa14403bb50 0x7fa14403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.107+0000 7fa14b606640 1 -- 172.21.15.87:0/1394623658 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fa25006d070 con 0x560972b7e720 2024-05-08T18:32:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.107+0000 7fa25e603640 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa14403bb50 0x7fa14403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.107+0000 7fa26130c800 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560972b7f080 0x560972c81890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:17.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.107+0000 7fa26130c800 1 -- 172.21.15.87:0/1394623658 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972c81dd0 con 0x560972b7f080 2024-05-08T18:32:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.107+0000 7fa25f605640 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560972b7f080 0x560972c81890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.108+0000 7fa25e603640 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa14403bb50 0x7fa14403e010 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa254001d90 tx=0x7fa2540012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.108+0000 7fa25f605640 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560972b7f080 0x560972c81890 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.108+0000 7fa25f605640 1 -- 172.21.15.87:0/1394623658 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2580083e0 con 0x560972b7f080 2024-05-08T18:32:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.108+0000 7fa26130c800 1 -- 172.21.15.87:0/1394623658 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972c82620 con 0x560972b7f080 2024-05-08T18:32:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.108+0000 7fa25f605640 1 -- 172.21.15.87:0/1394623658 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2580083e0 con 0x560972b7f080 2024-05-08T18:32:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.108+0000 7fa26130c800 1 -- 172.21.15.87:0/1394623658 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972c839d0 con 0x560972b7f080 2024-05-08T18:32:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.109+0000 7fa25f605640 1 -- 172.21.15.87:0/1394623658 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa2580083e0 con 0x560972b7f080 2024-05-08T18:32:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.109+0000 7fa26130c800 1 -- 172.21.15.87:0/1394623658 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972c82e70 con 0x560972b7f080 2024-05-08T18:32:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.109+0000 7fa25f605640 1 -- 172.21.15.87:0/1394623658 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa2580083e0 con 0x560972b7f080 2024-05-08T18:32:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.109+0000 7fa26130c800 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560972c84e20 0x560972c87210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.109+0000 7fa26130c800 1 -- 172.21.15.87:0/1394623658 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972c878b0 con 0x560972c84e20 2024-05-08T18:32:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.109+0000 7fa25ee04640 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560972c84e20 0x560972c87210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.109+0000 7fa25ee04640 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560972c84e20 0x560972c87210 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.110+0000 7fa25ee04640 1 -- 172.21.15.87:0/1394623658 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa250077030 con 0x560972c84e20 2024-05-08T18:32:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.110+0000 7fa26130c800 1 Processor -- start 2024-05-08T18:32:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.110+0000 7fa26130c800 1 -- start start 2024-05-08T18:32:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.110+0000 7fa26130c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972c95c00 0x560972c96020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.110+0000 7fa26130c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560972c71420 con 0x560972c95c00 2024-05-08T18:32:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.110+0000 7fa25f605640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972c95c00 0x560972c96020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.110+0000 7fa25f605640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972c95c00 0x560972c96020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60988/0 (socket says 172.21.15.87:60988) 2024-05-08T18:32:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.110+0000 7fa25f605640 1 -- 172.21.15.87:0/2522523453 learned_addr learned my addr 172.21.15.87:0/2522523453 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.111+0000 7fa25f605640 1 -- 172.21.15.87:0/2522523453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560972c96560 con 0x560972c95c00 2024-05-08T18:32:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.111+0000 7fa25f605640 1 --2- 172.21.15.87:0/2522523453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972c95c00 0x560972c96020 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x560972c70640 tx=0x7fa25800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.111+0000 7fa148e01640 1 -- 172.21.15.87:0/2522523453 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa25801c070 con 0x560972c95c00 2024-05-08T18:32:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.111+0000 7fa148e01640 1 -- 172.21.15.87:0/2522523453 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa258018410 con 0x560972c95c00 2024-05-08T18:32:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.111+0000 7fa26130c800 1 -- 172.21.15.87:0/2522523453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560972c96fd0 con 0x560972c95c00 2024-05-08T18:32:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.111+0000 7fa148e01640 1 -- 172.21.15.87:0/2522523453 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2580186f0 con 0x560972c95c00 2024-05-08T18:32:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.111+0000 7fa26130c800 1 -- 172.21.15.87:0/2522523453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560972c974d0 con 0x560972c95c00 2024-05-08T18:32:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.112+0000 7fa148e01640 1 -- 172.21.15.87:0/2522523453 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa25801f070 con 0x560972c95c00 2024-05-08T18:32:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.112+0000 7fa148e01640 1 --2- 172.21.15.87:0/2522523453 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa13803bba0 0x7fa13803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.112+0000 7fa148e01640 1 -- 172.21.15.87:0/2522523453 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fa258054710 con 0x560972c95c00 2024-05-08T18:32:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.112+0000 7fa25ee04640 1 --2- 172.21.15.87:0/2522523453 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa13803bba0 0x7fa13803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.112+0000 7fa26130c800 1 Processor -- start 2024-05-08T18:32:17.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.112+0000 7fa25ee04640 1 --2- 172.21.15.87:0/2522523453 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa13803bba0 0x7fa13803e060 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x560972c83210 tx=0x7fa25007cf50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:17.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.113+0000 7fa26130c800 1 -- start start 2024-05-08T18:32:17.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.113+0000 7fa26130c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972ca2f50 0x560972ca3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:17.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.113+0000 7fa26130c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560972a70fc0 con 0x560972ca2f50 2024-05-08T18:32:17.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.113+0000 7fa25f605640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972ca2f50 0x560972ca3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:17.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.113+0000 7fa25f605640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972ca2f50 0x560972ca3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60996/0 (socket says 172.21.15.87:60996) 2024-05-08T18:32:17.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.113+0000 7fa25f605640 1 -- 172.21.15.87:0/4160496410 learned_addr learned my addr 172.21.15.87:0/4160496410 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:17.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.113+0000 7fa25f605640 1 -- 172.21.15.87:0/4160496410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560972ca3940 con 0x560972ca2f50 2024-05-08T18:32:17.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.113+0000 7fa25f605640 1 --2- 172.21.15.87:0/4160496410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972ca2f50 0x560972ca3370 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa258052a10 tx=0x7fa258018890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de454675b31ac52 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:17.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.114+0000 7fa1427fc640 1 -- 172.21.15.87:0/4160496410 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa258018d40 con 0x560972ca2f50 2024-05-08T18:32:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.114+0000 7fa1427fc640 1 -- 172.21.15.87:0/4160496410 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa25801fc80 con 0x560972ca2f50 2024-05-08T18:32:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.114+0000 7fa1427fc640 1 -- 172.21.15.87:0/4160496410 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2580173a0 con 0x560972ca2f50 2024-05-08T18:32:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.114+0000 7fa26130c800 1 -- 172.21.15.87:0/4160496410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972ca2f50 msgr2=0x560972ca3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.114+0000 7fa26130c800 1 --2- 172.21.15.87:0/4160496410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972ca2f50 0x560972ca3370 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa258052a10 tx=0x7fa258018890 comp rx=0 tx=0).stop 2024-05-08T18:32:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.114+0000 7fa26130c800 1 -- 172.21.15.87:0/4160496410 shutdown_connections 2024-05-08T18:32:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.114+0000 7fa26130c800 1 --2- 172.21.15.87:0/4160496410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972ca2f50 0x560972ca3370 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.114+0000 7fa26130c800 1 -- 172.21.15.87:0/4160496410 >> 172.21.15.87:0/4160496410 conn(0x560972c9f220 msgr2=0x560972c9d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.114+0000 7fa26130c800 1 -- 172.21.15.87:0/4160496410 shutdown_connections 2024-05-08T18:32:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.114+0000 7fa26130c800 1 -- 172.21.15.87:0/4160496410 wait complete. 2024-05-08T18:32:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.114+0000 7fa26130c800 1 Processor -- start 2024-05-08T18:32:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.115+0000 7fa26130c800 1 -- start start 2024-05-08T18:32:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.115+0000 7fa26130c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972ca2f50 0x560972caa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.115+0000 7fa26130c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560972ca3f10 con 0x560972ca2f50 2024-05-08T18:32:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.115+0000 7fa25f605640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972ca2f50 0x560972caa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.115+0000 7fa25f605640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972ca2f50 0x560972caa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:60998/0 (socket says 172.21.15.87:60998) 2024-05-08T18:32:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.115+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 learned_addr learned my addr 172.21.15.87:0/696829424 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.115+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560972caa870 con 0x560972ca2f50 2024-05-08T18:32:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.115+0000 7fa25f605640 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972ca2f50 0x560972caa330 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa2580188d0 tx=0x7fa258052970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.115+0000 7fa140ff9640 1 -- 172.21.15.87:0/696829424 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa258016be0 con 0x560972ca2f50 2024-05-08T18:32:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.115+0000 7fa140ff9640 1 -- 172.21.15.87:0/696829424 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa258030070 con 0x560972ca2f50 2024-05-08T18:32:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.115+0000 7fa140ff9640 1 -- 172.21.15.87:0/696829424 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2580540d0 con 0x560972ca2f50 2024-05-08T18:32:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.115+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560972caab00 con 0x560972ca2f50 2024-05-08T18:32:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.115+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560972caab00 con 0x560972ca2f50 2024-05-08T18:32:17.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.116+0000 7fa140ff9640 1 -- 172.21.15.87:0/696829424 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa2580163a0 con 0x560972ca2f50 2024-05-08T18:32:17.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.116+0000 7fa140ff9640 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa12803bb50 0x7fa12803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:17.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.116+0000 7fa140ff9640 1 -- 172.21.15.87:0/696829424 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fa25800a4e0 con 0x560972ca2f50 2024-05-08T18:32:17.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.117+0000 7fa25ee04640 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa12803bb50 0x7fa12803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:17.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.117+0000 7fa25ee04640 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa12803bb50 0x7fa12803e010 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa250078fd0 tx=0x7fa25008b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:17.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.117+0000 7fa26130c800 20 rados->read ofs=0 len=0 2024-05-08T18:32:17.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.117+0000 7fa26130c800 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560972cb5c50 0x560972cb8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:17.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.117+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cb8860 con 0x560972cb5c50 2024-05-08T18:32:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.117+0000 7fa25e603640 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560972cb5c50 0x560972cb8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.117+0000 7fa25e603640 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560972cb5c50 0x560972cb8110 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa254009050 con 0x560972cb5c50 2024-05-08T18:32:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa26130c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa26130c800 20 realm 2024-05-08T18:32:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa26130c800 20 rados->read ofs=0 len=0 2024-05-08T18:32:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cb50a0 con 0x560972cb5c50 2024-05-08T18:32:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa254009050 con 0x560972cb5c50 2024-05-08T18:32:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa26130c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa26130c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:32:17.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa26130c800 20 rados->read ofs=0 len=0 2024-05-08T18:32:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cb9350 con 0x560972cb5c50 2024-05-08T18:32:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa254009050 con 0x560972cb5c50 2024-05-08T18:32:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa26130c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa26130c800 20 rados->read ofs=0 len=0 2024-05-08T18:32:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cb9c20 con 0x560972cb5c50 2024-05-08T18:32:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa254009050 con 0x560972cb5c50 2024-05-08T18:32:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa26130c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa26130c800 20 rados->read ofs=0 len=0 2024-05-08T18:32:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.118+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cb9fc0 con 0x560972cb5c50 2024-05-08T18:32:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.119+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa254009050 con 0x560972cb5c50 2024-05-08T18:32:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.119+0000 7fa26130c800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:32:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.119+0000 7fa26130c800 20 searching for the correct realm 2024-05-08T18:32:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.119+0000 7fa26130c800 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560972cbbea0 0x560972cbe290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:17.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.119+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x560972cbbea0 2024-05-08T18:32:17.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.119+0000 7fa25f605640 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560972cbbea0 0x560972cbe290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:17.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.119+0000 7fa25f605640 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560972cbbea0 0x560972cbe290 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:17.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.119+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.119+0000 7fa25f605640 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fa258021070 0x7fa2580559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:17.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.119+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x7fa258021070 2024-05-08T18:32:17.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.120+0000 7fa25ee04640 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fa258021070 0x7fa2580559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:17.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.120+0000 7fa25ee04640 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fa258021070 0x7fa2580559c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:17.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.120+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.120+0000 7fa25ee04640 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fa2500a1040 0x7fa2500911e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:17.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.120+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x7fa2500a1040 2024-05-08T18:32:17.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.120+0000 7fa25e603640 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fa2500a1040 0x7fa2500911e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:17.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.121+0000 7fa25e603640 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fa2500a1040 0x7fa2500911e0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:17.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.121+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa254009050 con 0x7fa2500a1040 2024-05-08T18:32:17.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.121+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x560972cb5c50 2024-05-08T18:32:17.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.121+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa254009050 con 0x560972cb5c50 2024-05-08T18:32:17.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.121+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x560972cb5c50 2024-05-08T18:32:17.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.122+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.122+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x7fa2500a1040 2024-05-08T18:32:17.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.122+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.122+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x7fa2500a1040 2024-05-08T18:32:17.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.122+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.122+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x7fa258021070 2024-05-08T18:32:17.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.122+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.122+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x560972cbbea0 2024-05-08T18:32:17.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.123+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.123+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x560972cb5c50 2024-05-08T18:32:17.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.123+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.123+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x7fa2500a1040 2024-05-08T18:32:17.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.123+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.123+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x560972cb5c50 2024-05-08T18:32:17.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.123+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.123+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x7fa258021070 2024-05-08T18:32:17.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.124+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.124+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x560972cbbea0 2024-05-08T18:32:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.124+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.124+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x560972cbbea0 2024-05-08T18:32:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.124+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.124+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x7fa2500a1040 2024-05-08T18:32:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.125+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.125+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x560972cbbea0 2024-05-08T18:32:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.125+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.125+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x560972cbbea0 2024-05-08T18:32:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.125+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.125+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x560972cb5c50 2024-05-08T18:32:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.125+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.125+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x560972cb5c50 2024-05-08T18:32:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.126+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.126+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x7fa2500a1040 2024-05-08T18:32:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.126+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.126+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x560972cbbea0 2024-05-08T18:32:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.126+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.126+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x7fa258021070 2024-05-08T18:32:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.127+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.127+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x560972cb5c50 2024-05-08T18:32:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.127+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.127+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x7fa2500a1040 2024-05-08T18:32:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.127+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.127+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x560972cbbea0 2024-05-08T18:32:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.128+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.128+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x7fa258021070 2024-05-08T18:32:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.128+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.128+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x7fa258021070 2024-05-08T18:32:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.128+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.128+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x560972cbbea0 2024-05-08T18:32:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.128+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.128+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x7fa258021070 2024-05-08T18:32:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.128+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.128+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x560972cb5c50 2024-05-08T18:32:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560972cbe940 con 0x7fa258021070 2024-05-08T18:32:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa26130c800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:32:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa26130c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:32:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa26130c800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:32:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa26130c800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:32:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa26130c800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:32:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa26130c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:32:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa26130c800 20 rados->read ofs=0 len=0 2024-05-08T18:32:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cba940 con 0x560972cb5c50 2024-05-08T18:32:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa26130c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa26130c800 20 rados->read ofs=0 len=0 2024-05-08T18:32:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cbb1e0 con 0x560972cb5c50 2024-05-08T18:32:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa26130c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:17.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa26130c800 20 rados->read ofs=0 len=0 2024-05-08T18:32:17.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.129+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cbedc0 con 0x7fa2500a1040 2024-05-08T18:32:17.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa26130c800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:32:17.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa26130c800 20 zone default found 2024-05-08T18:32:17.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa26130c800 4 Realm: () 2024-05-08T18:32:17.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa26130c800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:32:17.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa26130c800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:32:17.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa26130c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:32:17.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa26130c800 20 zonegroup default 2024-05-08T18:32:17.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa26130c800 20 rados->read ofs=0 len=0 2024-05-08T18:32:17.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cbf270 con 0x7fa2500a1040 2024-05-08T18:32:17.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa26130c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa26130c800 20 rados->read ofs=0 len=0 2024-05-08T18:32:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cc0c50 con 0x560972cbbea0 2024-05-08T18:32:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa26130c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa26130c800 20 rados->read ofs=0 len=0 2024-05-08T18:32:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.130+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cc1120 con 0x560972cbbea0 2024-05-08T18:32:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.131+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.131+0000 7fa26130c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.131+0000 7fa26130c800 20 started sync module instance, tier type = 2024-05-08T18:32:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.131+0000 7fa26130c800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:32:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.131+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cc00e0 con 0x7fa258021070 2024-05-08T18:32:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.132+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.132+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94598580667600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cc1a30 con 0x7fa258021070 2024-05-08T18:32:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.132+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cc2280 con 0x560972cb5c50 2024-05-08T18:32:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.133+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94598580667600] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.133+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.133+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94598580671872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cc22c0 con 0x560972cb5c50 2024-05-08T18:32:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.133+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cc2dd0 con 0x560972cbbea0 2024-05-08T18:32:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.134+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94598580671872] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.134+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.134+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94598580676736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cc2d90 con 0x560972cbbea0 2024-05-08T18:32:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.134+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cc3860 con 0x7fa258021070 2024-05-08T18:32:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.135+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.135+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94598580676736] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.135+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94598580679472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cc4100 con 0x7fa258021070 2024-05-08T18:32:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.136+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cc1df0 con 0x560972cb5c50 2024-05-08T18:32:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.136+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94598580679472] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.137+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.137+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94598580681808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cc4070 con 0x560972cb5c50 2024-05-08T18:32:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.137+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cc51c0 con 0x7fa2500a1040 2024-05-08T18:32:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.138+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94598580681808] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.138+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.138+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94598580684528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cc51c0 con 0x7fa2500a1040 2024-05-08T18:32:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.138+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cc5b80 con 0x7fa2500a1040 2024-05-08T18:32:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.139+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94598580684528] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.139+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.139+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94598580686576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cc5b80 con 0x7fa2500a1040 2024-05-08T18:32:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.139+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cc6540 con 0x7fa2500a1040 2024-05-08T18:32:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.140+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94598580686576] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.140+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.140+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94598580689072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cc6540 con 0x7fa2500a1040 2024-05-08T18:32:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.140+0000 7fa26130c800 20 add_watcher() i=0 2024-05-08T18:32:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.140+0000 7fa26130c800 20 add_watcher() i=1 2024-05-08T18:32:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.140+0000 7fa26130c800 20 add_watcher() i=2 2024-05-08T18:32:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.140+0000 7fa26130c800 20 add_watcher() i=3 2024-05-08T18:32:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.140+0000 7fa26130c800 20 add_watcher() i=4 2024-05-08T18:32:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.140+0000 7fa26130c800 20 add_watcher() i=5 2024-05-08T18:32:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.140+0000 7fa26130c800 20 add_watcher() i=6 2024-05-08T18:32:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.141+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94598580689072] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.141+0000 7fa26130c800 20 add_watcher() i=7 2024-05-08T18:32:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.141+0000 7fa26130c800 2 all 8 watchers are set, enabling cache 2024-05-08T18:32:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.141+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cc9850 con 0x560972cb5c50 2024-05-08T18:32:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.141+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.141+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94598580691456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cc6ad0 con 0x560972cb5c50 2024-05-08T18:32:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.142+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94598580691456] v29'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.142+0000 7fa1157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.142+0000 7fa26130c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:32:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.142+0000 7fa26130c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:32:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.142+0000 7fa26130c800 5 note: GC not initialized 2024-05-08T18:32:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.143+0000 7fa08ffff640 20 reqs_thread_entry: start 2024-05-08T18:32:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.143+0000 7fa26130c800 20 init_complete bucket index max shards: 11 2024-05-08T18:32:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.143+0000 7fa26130c800 20 Filter name: none 2024-05-08T18:32:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.143+0000 7fa08dffb640 20 reqs_thread_entry: start 2024-05-08T18:32:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.143+0000 7fa26130c800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-08T18:32:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.143+0000 7fa26130c800 20 rados->read ofs=0 len=0 2024-05-08T18:32:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.143+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cfcdd0 con 0x7fa2500a1040 2024-05-08T18:32:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.144+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.144+0000 7fa26130c800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:32:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.144+0000 7fa26130c800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-05-08T18:32:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.144+0000 7fa26130c800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T18:32:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.144+0000 7fa26130c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:32:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.144+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972d01000 con 0x7fa258021070 2024-05-08T18:32:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.145+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v29'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.145+0000 7fa26130c800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-08T18:32:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.145+0000 7fa26130c800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:32:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.145+0000 7fa26130c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-08T18:32:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.145+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94598580931008 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972d01cd0 con 0x7fa2500a1040 2024-05-08T18:32:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.145+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== watch-notify(notify (1) cookie 94598580684528 notify 124554051602 ret 0) ==== 424+0+0 (crc 0 0 0) 0x560972b7fd50 con 0x7fa2500a1040 2024-05-08T18:32:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.145+0000 7fa1427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051602 cookie 94598580684528 notifier 4725 bl.length()=382 2024-05-08T18:32:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.145+0000 7fa1427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-08T18:32:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.145+0000 7fa1427fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:32:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.145+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(64 notify.5 [notify cookie 94598580931008 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.145+0000 7fa1427fc640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fa124003ea0 con 0x7fa2500a1040 2024-05-08T18:32:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.146+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.146+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== watch-notify(notify_complete (2) cookie 94598580931008 notify 124554051602 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa25403f800 con 0x7fa2500a1040 2024-05-08T18:32:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.146+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972d009c0 con 0x560972cb5c50 2024-05-08T18:32:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.146+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.146+0000 7fa26130c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 : miss 2024-05-08T18:32:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.146+0000 7fa26130c800 20 rados->read ofs=0 len=0 2024-05-08T18:32:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.146+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 8.9 8:92df33a4:root::.bucket.meta.myfoo6%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cfee10 con 0x7fa258021070 2024-05-08T18:32:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.147+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(67 .bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv44 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.147+0000 7fa26130c800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:32:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.147+0000 7fa26130c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 info.flags=0x17 2024-05-08T18:32:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.147+0000 7fa26130c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 to cache LRU end 2024-05-08T18:32:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.147+0000 7fa26130c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:32:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.147+0000 7fa26130c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:32:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.147+0000 7fa26130c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 2024-05-08T18:32:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.147+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 8.9 8:92df33a4:root::.bucket.meta.myfoo6%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972d08d60 con 0x7fa258021070 2024-05-08T18:32:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(68 .bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v29'45 uv45 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa26130c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 info.flags=0x17 2024-05-08T18:32:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa26130c800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 to cache LRU end 2024-05-08T18:32:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa26130c800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T18:32:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa26130c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9, ofs0, ns] 2024-05-08T18:32:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94598580918608 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972d03110 con 0x7fa258021070 2024-05-08T18:32:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== watch-notify(notify (1) cookie 94598580679472 notify 124554051621 ret 0) ==== 790+0+0 (crc 0 0 0) 0x560972d01e60 con 0x7fa258021070 2024-05-08T18:32:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa141ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051621 cookie 94598580679472 notifier 4725 bl.length()=748 2024-05-08T18:32:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa141ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 info.flags=0x17 2024-05-08T18:32:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa141ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 to cache LRU end 2024-05-08T18:32:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa141ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T18:32:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(69 notify.3 [notify cookie 94598580918608 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa141ffb640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fa094003530 con 0x7fa258021070 2024-05-08T18:32:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== watch-notify(notify_complete (2) cookie 94598580918608 notify 124554051621 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa2500a9060 con 0x7fa258021070 2024-05-08T18:32:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa26130c800 20 handle_bi_update(): bucket=:myfoo6[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9]): orig_sources= new_sources= 2024-05-08T18:32:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa26130c800 20 handle_bi_update(): bucket=:myfoo6[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9]): potential sources added=[] removed=[] 2024-05-08T18:32:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa26130c800 20 handle_bi_update(): bucket=:myfoo6[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9]): orig_dests= new_dests= 2024-05-08T18:32:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa26130c800 20 handle_bi_update(): bucket=:myfoo6[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9]): potential dests added=[] removed=[] 2024-05-08T18:32:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.148+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cfd950 con 0x560972cb5c50 2024-05-08T18:32:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.149+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(71 bud.buckets [call] v29'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.149+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cfd950 con 0x560972cb5c50 2024-05-08T18:32:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.151+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(72 bud.buckets [call] v29'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.151+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cfd950 con 0x560972cb5c50 2024-05-08T18:32:17.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.152+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v29'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.152+0000 7fa26130c800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-05-08T18:32:17.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.152+0000 7fa26130c800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-08T18:32:17.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.152+0000 7fa26130c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-05-08T18:32:17.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.152+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94598580918608 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972d03330 con 0x7fa258021070 2024-05-08T18:32:17.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.152+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 20 ==== watch-notify(notify (1) cookie 94598580679472 notify 124554051622 ret 0) ==== 358+0+0 (crc 0 0 0) 0x560972c6fde0 con 0x7fa258021070 2024-05-08T18:32:17.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.152+0000 7fa141ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051622 cookie 94598580679472 notifier 4725 bl.length()=316 2024-05-08T18:32:17.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.152+0000 7fa141ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-05-08T18:32:17.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.152+0000 7fa141ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-08T18:32:17.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.152+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 21 ==== osd_op_reply(74 notify.3 [notify cookie 94598580918608 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.152+0000 7fa141ffb640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fa094003560 con 0x7fa258021070 2024-05-08T18:32:17.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.152+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 22 ==== watch-notify(notify_complete (2) cookie 94598580918608 notify 124554051622 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560972c6f860 con 0x7fa258021070 2024-05-08T18:32:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.152+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 23 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.153+0000 7fa26130c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 : hit (requested=0x17, cached=0x17) 2024-05-08T18:32:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.153+0000 7fa26130c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 2024-05-08T18:32:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.153+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:76 8.9 8:92df33a4:root::.bucket.meta.myfoo6%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cfe860 con 0x7fa258021070 2024-05-08T18:32:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.154+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 24 ==== osd_op_reply(76 .bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v29'46 uv46 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.154+0000 7fa26130c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 info.flags=0x17 2024-05-08T18:32:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.154+0000 7fa26130c800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 to cache LRU end 2024-05-08T18:32:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.154+0000 7fa26130c800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T18:32:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.154+0000 7fa26130c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9, ofs0, ns] 2024-05-08T18:32:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.154+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [notify cookie 94598580919856 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cfe880 con 0x7fa258021070 2024-05-08T18:32:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.154+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 25 ==== watch-notify(notify (1) cookie 94598580679472 notify 124554051623 ret 0) ==== 790+0+0 (crc 0 0 0) 0x560972c6f860 con 0x7fa258021070 2024-05-08T18:32:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.154+0000 7fa1427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051623 cookie 94598580679472 notifier 4725 bl.length()=748 2024-05-08T18:32:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.154+0000 7fa1427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 info.flags=0x17 2024-05-08T18:32:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.154+0000 7fa1427fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 to cache LRU end 2024-05-08T18:32:17.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.154+0000 7fa1427fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T18:32:17.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.154+0000 7fa1427fc640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fa124003ea0 con 0x7fa258021070 2024-05-08T18:32:17.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.154+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 26 ==== osd_op_reply(77 notify.3 [notify cookie 94598580919856 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.155+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 27 ==== watch-notify(notify_complete (2) cookie 94598580919856 notify 124554051623 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560972c6f5d0 con 0x7fa258021070 2024-05-08T18:32:17.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.155+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 28 ==== osd_op_reply(78 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.155+0000 7fa26130c800 20 handle_bi_update(): bucket=:myfoo6[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9]): orig_sources= new_sources= 2024-05-08T18:32:17.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.155+0000 7fa26130c800 20 handle_bi_update(): bucket=:myfoo6[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9]): potential sources added=[] removed=[] 2024-05-08T18:32:17.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.155+0000 7fa26130c800 20 handle_bi_update(): bucket=:myfoo6[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9]): orig_dests= new_dests= 2024-05-08T18:32:17.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.155+0000 7fa26130c800 20 handle_bi_update(): bucket=:myfoo6[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9]): potential dests added=[] removed=[] 2024-05-08T18:32:17.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.155+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:79 4.1e 4:7b415115:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cfde30 con 0x7fa2500a1040 2024-05-08T18:32:17.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.155+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(79 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.155+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:80 4.16 4:6a8df259:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cfde30 con 0x560972cbbea0 2024-05-08T18:32:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.156+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(80 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.156+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:81 4.1a 4:5b420c27:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cfde30 con 0x7fa258021070 2024-05-08T18:32:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.156+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 29 ==== osd_op_reply(81 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.156+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:82 4.c 4:330988d5:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cfde30 con 0x560972cb5c50 2024-05-08T18:32:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.156+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(82 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.157+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:83 4.4 4:2127f00f:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cfde30 con 0x7fa2500a1040 2024-05-08T18:32:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.157+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(83 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.4 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.157+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 4.1d 4:bbf255d6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cfde30 con 0x560972cbbea0 2024-05-08T18:32:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.157+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(84 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.157+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:85 4.37 4:ee670e45:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cfde30 con 0x7fa2500a1040 2024-05-08T18:32:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.158+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(85 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.158+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 4.25 4:a5cd330b:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cfde30 con 0x560972cbbea0 2024-05-08T18:32:17.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.158+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(86 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.158+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 4.3d 4:be5fd071:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cfde30 con 0x560972cbbea0 2024-05-08T18:32:17.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.158+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(87 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.158+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:88 4.9 4:90dc4ef6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cfde30 con 0x560972cb5c50 2024-05-08T18:32:17.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.159+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(88 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9 [call out=377b] v0'0 uv3 ondisk = 0) ==== 194+0+377 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.159+0000 7fa26130c800 10 cls_bucket_list_unordered: got thirteen 2024-05-08T18:32:17.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.159+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:89 4.33 4:ce4dc589:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cfe7a0 con 0x7fa2500a1040 2024-05-08T18:32:17.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.159+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(89 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.159+0000 7fa26130c800 20 get_obj_state: octx=0x560972d00da0 obj=myfoo6:thirteen state=0x560972d076e8 s->prefetch_data=0 2024-05-08T18:32:17.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.159+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 3.23s0 3:c5a3df2c:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972cfde50 con 0x7fa2500a1040 2024-05-08T18:32:17.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.159+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(90 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+870 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.159+0000 7fa26130c800 10 manifest: total_size = 8 2024-05-08T18:32:17.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.159+0000 7fa26130c800 20 get_obj_state: setting s->obj_tag to be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.3300166981251477055 2024-05-08T18:32:17.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.159+0000 7fa26130c800 20 Read xattr rgw_rados: user.rgw.acl 2024-05-08T18:32:17.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.159+0000 7fa26130c800 20 Read xattr rgw_rados: user.rgw.content_type 2024-05-08T18:32:17.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.159+0000 7fa26130c800 20 Read xattr rgw_rados: user.rgw.etag 2024-05-08T18:32:17.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.159+0000 7fa26130c800 20 Read xattr rgw_rados: user.rgw.idtag 2024-05-08T18:32:17.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.159+0000 7fa26130c800 20 Read xattr rgw_rados: user.rgw.manifest 2024-05-08T18:32:17.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.159+0000 7fa26130c800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-05-08T18:32:17.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.159+0000 7fa26130c800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-05-08T18:32:17.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.160+0000 7fa26130c800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-05-08T18:32:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.160+0000 7fa26130c800 20 get_obj_state: octx=0x560972d00da0 obj=myfoo6:thirteen state=0x560972d076e8 s->prefetch_data=0 2024-05-08T18:32:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.160+0000 7fa26130c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 : hit (requested=0x17, cached=0x17) 2024-05-08T18:32:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.160+0000 7fa26130c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 2024-05-08T18:32:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.160+0000 7fa26130c800 20 bucket index object: :.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9 2024-05-08T18:32:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.160+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:91 4.9 4:90dc4ef6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972cfe3e0 con 0x560972cb5c50 2024-05-08T18:32:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.161+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(91 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9 [stat,call,call] v29'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.161+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 3.23s0 3:c5a3df2c:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972d06550 con 0x7fa2500a1040 2024-05-08T18:32:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.162+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(92 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v29'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.162+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:93 4.9 4:90dc4ef6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972d06b30 con 0x560972cb5c50 2024-05-08T18:32:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:1 objects processed in :myfoo6[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9]). Next marker thirteen 2024-05-08T18:32:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.162+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972d016a0 con 0x7fa258021070 2024-05-08T18:32:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.163+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(93 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9 [stat,call,call] v29'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.163+0000 7fa141ffb640 20 handle_completion(): completion ok for obj=thirteen 2024-05-08T18:32:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.163+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 30 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v29'4 uv4 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.163+0000 7fa26130c800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-08T18:32:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.163+0000 7fa26130c800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:32:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.163+0000 7fa26130c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-08T18:32:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.163+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94598580955952 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972d016a0 con 0x7fa2500a1040 2024-05-08T18:32:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.164+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== watch-notify(notify (1) cookie 94598580684528 notify 124554051603 ret 0) ==== 598+0+0 (crc 0 0 0) 0x7fa254057040 con 0x7fa2500a1040 2024-05-08T18:32:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.164+0000 7fa1427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051603 cookie 94598580684528 notifier 4725 bl.length()=556 2024-05-08T18:32:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.164+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(95 notify.5 [notify cookie 94598580955952 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.164+0000 7fa1427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-08T18:32:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.164+0000 7fa1427fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:32:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.164+0000 7fa1427fc640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fa124003ea0 con 0x7fa2500a1040 2024-05-08T18:32:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.164+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 29 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.164+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 30 ==== watch-notify(notify_complete (2) cookie 94598580955952 notify 124554051603 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560972d03110 con 0x7fa2500a1040 2024-05-08T18:32:17.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.164+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972d016a0 con 0x560972cb5c50 2024-05-08T18:32:17.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.165+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v29'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.165+0000 7fa26130c800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-08T18:32:17.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.165+0000 7fa26130c800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T18:32:17.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.165+0000 7fa26130c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-08T18:32:17.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.165+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94598580955952 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972d016a0 con 0x7fa2500a1040 2024-05-08T18:32:17.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.165+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 31 ==== watch-notify(notify (1) cookie 94598580684528 notify 124554051604 ret 0) ==== 219+0+0 (crc 0 0 0) 0x560972d03110 con 0x7fa2500a1040 2024-05-08T18:32:17.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.165+0000 7fa1427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051604 cookie 94598580684528 notifier 4725 bl.length()=177 2024-05-08T18:32:17.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.165+0000 7fa1427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-08T18:32:17.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.165+0000 7fa1427fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T18:32:17.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.165+0000 7fa1427fc640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fa124003ea0 con 0x7fa2500a1040 2024-05-08T18:32:17.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.165+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 32 ==== osd_op_reply(98 notify.5 [notify cookie 94598580955952 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.166+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 33 ==== watch-notify(notify_complete (2) cookie 94598580955952 notify 124554051604 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560972cff250 con 0x7fa2500a1040 2024-05-08T18:32:17.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.166+0000 7fa26130c800 10 removing user index: bar 2024-05-08T18:32:17.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.166+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 34 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.166+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972d016a0 con 0x7fa2500a1040 2024-05-08T18:32:17.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.167+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 35 ==== osd_op_reply(100 bar [delete] v29'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.167+0000 7fa26130c800 10 removing default.rgw.meta+users.uid+bar from cache 2024-05-08T18:32:17.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.167+0000 7fa26130c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-05-08T18:32:17.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.167+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94598580955952 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560972d016a0 con 0x7fa2500a1040 2024-05-08T18:32:17.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.167+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 36 ==== watch-notify(notify (1) cookie 94598580689072 notify 124554051605 ret 0) ==== 194+0+0 (crc 0 0 0) 0x560972cff250 con 0x7fa2500a1040 2024-05-08T18:32:17.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.167+0000 7fa141ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051605 cookie 94598580689072 notifier 4725 bl.length()=152 2024-05-08T18:32:17.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.167+0000 7fa141ffb640 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fa094003560 con 0x7fa2500a1040 2024-05-08T18:32:17.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.167+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 37 ==== osd_op_reply(101 notify.7 [notify cookie 94598580955952 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.168+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 38 ==== watch-notify(notify_complete (2) cookie 94598580955952 notify 124554051605 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa254065040 con 0x7fa2500a1040 2024-05-08T18:32:17.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.168+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 39 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.190 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-05-08T18:32:16.984312Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:32:16.984300Z","tags":[],"group_ids":[]} 2024-05-08T18:32:17.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.168+0000 7fa1157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:17.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.168+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94598580691456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972d016a0 con 0x560972cb5c50 2024-05-08T18:32:17.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.169+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94598580691456] v29'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.169+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94598580667600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972d016a0 con 0x7fa258021070 2024-05-08T18:32:17.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.170+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 31 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94598580667600] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.170+0000 7fa26130c800 20 remove_watcher() i=0 2024-05-08T18:32:17.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.170+0000 7fa26130c800 2 removed watcher, disabling cache 2024-05-08T18:32:17.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.170+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94598580671872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972ce5740 con 0x560972cb5c50 2024-05-08T18:32:17.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.172+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94598580671872] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.172+0000 7fa26130c800 20 remove_watcher() i=1 2024-05-08T18:32:17.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.172+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94598580676736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972ce5740 con 0x560972cbbea0 2024-05-08T18:32:17.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.173+0000 7fa25f605640 1 -- 172.21.15.87:0/696829424 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94598580676736] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa258028070 con 0x560972cbbea0 2024-05-08T18:32:17.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.173+0000 7fa26130c800 20 remove_watcher() i=2 2024-05-08T18:32:17.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.173+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94598580679472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972ce5740 con 0x7fa258021070 2024-05-08T18:32:17.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.174+0000 7fa25ee04640 1 -- 172.21.15.87:0/696829424 <== osd.2 v2:172.21.15.87:6816/2108501615 32 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94598580679472] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa250077030 con 0x7fa258021070 2024-05-08T18:32:17.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.174+0000 7fa26130c800 20 remove_watcher() i=3 2024-05-08T18:32:17.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.174+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94598580681808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972ce5740 con 0x560972cb5c50 2024-05-08T18:32:17.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.175+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.1 v2:172.21.15.87:6808/2448644045 33 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94598580681808] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x560972cb5c50 2024-05-08T18:32:17.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.175+0000 7fa26130c800 20 remove_watcher() i=4 2024-05-08T18:32:17.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.175+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94598580684528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972ce5740 con 0x7fa2500a1040 2024-05-08T18:32:17.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.176+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 40 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94598580684528] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.176+0000 7fa26130c800 20 remove_watcher() i=5 2024-05-08T18:32:17.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.176+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94598580686576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972ce5740 con 0x7fa2500a1040 2024-05-08T18:32:17.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.177+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 41 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94598580686576] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.177+0000 7fa26130c800 20 remove_watcher() i=6 2024-05-08T18:32:17.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.177+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94598580689072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560972ce5740 con 0x7fa2500a1040 2024-05-08T18:32:17.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 <== osd.0 v2:172.21.15.53:6800/443747735 42 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94598580689072] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25402a040 con 0x7fa2500a1040 2024-05-08T18:32:17.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 20 remove_watcher() i=7 2024-05-08T18:32:17.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fa2500a1040 msgr2=0x7fa2500911e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fa2500a1040 0x7fa2500911e0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560972cb5c50 msgr2=0x560972cb8110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560972cb5c50 0x560972cb8110 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fa258021070 msgr2=0x7fa2580559c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fa258021070 0x7fa2580559c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560972cbbea0 msgr2=0x560972cbe290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x560972cbbea0 0x560972cbe290 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa12803bb50 msgr2=0x7fa12803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa12803bb50 0x7fa12803e010 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa250078fd0 tx=0x7fa25008b000 comp rx=0 tx=0).stop 2024-05-08T18:32:17.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972ca2f50 msgr2=0x560972caa330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa25e603640 1 -- 172.21.15.87:0/696829424 reap_dead start 2024-05-08T18:32:17.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972ca2f50 0x560972caa330 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa2580188d0 tx=0x7fa258052970 comp rx=0 tx=0).stop 2024-05-08T18:32:17.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 shutdown_connections 2024-05-08T18:32:17.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 --2- 172.21.15.87:0/696829424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972ca2f50 0x560972caa330 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 >> 172.21.15.87:0/696829424 conn(0x560972c9f220 msgr2=0x560972c9c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:17.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 shutdown_connections 2024-05-08T18:32:17.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 -- 172.21.15.87:0/696829424 wait complete. 2024-05-08T18:32:17.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 -- 172.21.15.87:0/2522523453 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa13803bba0 msgr2=0x7fa13803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 --2- 172.21.15.87:0/2522523453 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa13803bba0 0x7fa13803e060 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x560972c83210 tx=0x7fa25007cf50 comp rx=0 tx=0).stop 2024-05-08T18:32:17.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 -- 172.21.15.87:0/2522523453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972c95c00 msgr2=0x560972c96020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 --2- 172.21.15.87:0/2522523453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972c95c00 0x560972c96020 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x560972c70640 tx=0x7fa25800ef30 comp rx=0 tx=0).stop 2024-05-08T18:32:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.178+0000 7fa26130c800 1 -- 172.21.15.87:0/2522523453 shutdown_connections 2024-05-08T18:32:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 --2- 172.21.15.87:0/2522523453 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa13803bba0 0x7fa13803e060 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 --2- 172.21.15.87:0/2522523453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972c95c00 0x560972c96020 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 -- 172.21.15.87:0/2522523453 >> 172.21.15.87:0/2522523453 conn(0x560972c89ca0 msgr2=0x560972c8a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 -- 172.21.15.87:0/2522523453 shutdown_connections 2024-05-08T18:32:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 -- 172.21.15.87:0/2522523453 wait complete. 2024-05-08T18:32:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 -- 172.21.15.87:0/1394623658 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560972c84e20 msgr2=0x560972c87210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560972c84e20 0x560972c87210 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 -- 172.21.15.87:0/1394623658 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560972b7f080 msgr2=0x560972c81890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560972b7f080 0x560972c81890 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 -- 172.21.15.87:0/1394623658 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa14403bb50 msgr2=0x7fa14403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa14403bb50 0x7fa14403e010 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa254001d90 tx=0x7fa2540012f0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 -- 172.21.15.87:0/1394623658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 msgr2=0x560972c70ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:17.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 0x560972c70ee0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa2500526d0 tx=0x7fa250003330 comp rx=0 tx=0).stop 2024-05-08T18:32:17.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 -- 172.21.15.87:0/1394623658 shutdown_connections 2024-05-08T18:32:17.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x560972b7f080 0x560972c81890 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x560972c84e20 0x560972c87210 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fa14403bb50 0x7fa14403e010 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 --2- 172.21.15.87:0/1394623658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560972b7e720 0x560972c70ee0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:17.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 -- 172.21.15.87:0/1394623658 >> 172.21.15.87:0/1394623658 conn(0x560972b78eb0 msgr2=0x560972c698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:17.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 -- 172.21.15.87:0/1394623658 shutdown_connections 2024-05-08T18:32:17.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:17.179+0000 7fa26130c800 1 -- 172.21.15.87:0/1394623658 wait complete. 2024-05-08T18:32:17.203 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-05-08T18:32:16.984312Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:32:16.984300Z', 'tags': [], 'group_ids': []} 2024-05-08T18:32:22.211 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:32:22.211 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-05-08T18:32:22.211 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-05-08T18:32:22.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-05-08T18:32:22.212 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-05-08T18:32:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:32:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:32:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.273+0000 7f5b18f2a800 1 Processor -- start 2024-05-08T18:32:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.273+0000 7f5b18f2a800 1 -- start start 2024-05-08T18:32:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.273+0000 7f5b18f2a800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559f8c8b5e20 0x559f8c8b4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.273+0000 7f5b18f2a800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559f8c8b4e00 con 0x559f8c8b48c0 2024-05-08T18:32:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.273+0000 7f5b18f2a800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x559f8c7e0e20 con 0x559f8c8b5e20 2024-05-08T18:32:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.273+0000 7f5b14beb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559f8c8b5e20 0x559f8c8b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.274+0000 7f5b14beb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559f8c8b5e20 0x559f8c8b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32774/0 (socket says 172.21.15.87:32774) 2024-05-08T18:32:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.274+0000 7f5b14beb640 1 -- 172.21.15.87:0/2401541950 learned_addr learned my addr 172.21.15.87:0/2401541950 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.274+0000 7f5b0c3ea640 1 --1- 172.21.15.87:0/2401541950 >> v1:172.21.15.53:6789/0 conn(0x559f8c8b48c0 0x559f8c948180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:40774/0 (socket says 172.21.15.87:40774) 2024-05-08T18:32:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.274+0000 7f5b14beb640 1 -- 172.21.15.87:0/2401541950 >> v1:172.21.15.53:6789/0 conn(0x559f8c8b48c0 legacy=0x559f8c948180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.274+0000 7f5b14beb640 1 -- 172.21.15.87:0/2401541950 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f8c8b4fd0 con 0x559f8c8b5e20 2024-05-08T18:32:22.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.276+0000 7f5b14beb640 1 --2- 172.21.15.87:0/2401541950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b5e20 0x559f8c8b4380 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400a520 tx=0x7f5b0401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0202be05fc458d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.276+0000 7f5b0ffff640 1 -- 172.21.15.87:0/2401541950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b04057070 con 0x559f8c8b5e20 2024-05-08T18:32:22.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.276+0000 7f5b0ffff640 1 -- 172.21.15.87:0/2401541950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b04052570 con 0x559f8c8b5e20 2024-05-08T18:32:22.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.276+0000 7f5b0ffff640 1 -- 172.21.15.87:0/2401541950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b04052870 con 0x559f8c8b5e20 2024-05-08T18:32:22.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.277+0000 7f5b18f2a800 1 -- 172.21.15.87:0/2401541950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b5e20 msgr2=0x559f8c8b4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.277+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/2401541950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b5e20 0x559f8c8b4380 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400a520 tx=0x7f5b0401d010 comp rx=0 tx=0).stop 2024-05-08T18:32:22.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.277+0000 7f5b18f2a800 1 -- 172.21.15.87:0/2401541950 shutdown_connections 2024-05-08T18:32:22.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.277+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/2401541950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b5e20 0x559f8c8b4380 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.277+0000 7f5b18f2a800 1 -- 172.21.15.87:0/2401541950 >> 172.21.15.87:0/2401541950 conn(0x559f8c93b870 msgr2=0x559f8c93dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.277+0000 7f5b18f2a800 1 -- 172.21.15.87:0/2401541950 shutdown_connections 2024-05-08T18:32:22.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.277+0000 7f5b18f2a800 1 -- 172.21.15.87:0/2401541950 wait complete. 2024-05-08T18:32:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.293+0000 7f5b18f2a800 1 Processor -- start 2024-05-08T18:32:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.293+0000 7f5b18f2a800 1 -- start start 2024-05-08T18:32:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.294+0000 7f5b18f2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b48c0 0x559f8ca339c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.294+0000 7f5b18f2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559f8c88b5f0 con 0x559f8c8b48c0 2024-05-08T18:32:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.294+0000 7f5b14beb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b48c0 0x559f8ca339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.294+0000 7f5b14beb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b48c0 0x559f8ca339c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32788/0 (socket says 172.21.15.87:32788) 2024-05-08T18:32:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.294+0000 7f5b14beb640 1 -- 172.21.15.87:0/3447572663 learned_addr learned my addr 172.21.15.87:0/3447572663 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.294+0000 7f5b14beb640 1 -- 172.21.15.87:0/3447572663 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f8ca33f90 con 0x559f8c8b48c0 2024-05-08T18:32:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.294+0000 7f5b14beb640 1 --2- 172.21.15.87:0/3447572663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b48c0 0x559f8ca339c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5b0401d050 tx=0x7f5b0404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27c0d33f2a0e5d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.295+0000 7f5a02e0d640 1 -- 172.21.15.87:0/3447572663 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b04057040 con 0x559f8c8b48c0 2024-05-08T18:32:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.295+0000 7f5a02e0d640 1 -- 172.21.15.87:0/3447572663 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b04052850 con 0x559f8c8b48c0 2024-05-08T18:32:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.295+0000 7f5a02e0d640 1 -- 172.21.15.87:0/3447572663 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b04052b70 con 0x559f8c8b48c0 2024-05-08T18:32:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.295+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3447572663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b48c0 msgr2=0x559f8ca339c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.295+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/3447572663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b48c0 0x559f8ca339c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5b0401d050 tx=0x7f5b0404c000 comp rx=0 tx=0).stop 2024-05-08T18:32:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.295+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3447572663 shutdown_connections 2024-05-08T18:32:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.295+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/3447572663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b48c0 0x559f8ca339c0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.295+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3447572663 >> 172.21.15.87:0/3447572663 conn(0x559f8c93b870 msgr2=0x559f8ca2f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.295+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3447572663 shutdown_connections 2024-05-08T18:32:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.296+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3447572663 wait complete. 2024-05-08T18:32:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.296+0000 7f5b18f2a800 1 Processor -- start 2024-05-08T18:32:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.296+0000 7f5b18f2a800 1 -- start start 2024-05-08T18:32:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.296+0000 7f5b18f2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b48c0 0x559f8ca3b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.296+0000 7f5b18f2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559f8c94bb80 con 0x559f8c8b48c0 2024-05-08T18:32:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.296+0000 7f5b14beb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b48c0 0x559f8ca3b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.296+0000 7f5b14beb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b48c0 0x559f8ca3b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32800/0 (socket says 172.21.15.87:32800) 2024-05-08T18:32:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.296+0000 7f5b14beb640 1 -- 172.21.15.87:0/3805472304 learned_addr learned my addr 172.21.15.87:0/3805472304 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.297+0000 7f5b14beb640 1 -- 172.21.15.87:0/3805472304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f8ca3b9c0 con 0x559f8c8b48c0 2024-05-08T18:32:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.297+0000 7f5b14beb640 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b48c0 0x559f8ca3b480 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5b04000c00 tx=0x7f5b04003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.297+0000 7f5a0160a640 1 -- 172.21.15.87:0/3805472304 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b04073070 con 0x559f8c8b48c0 2024-05-08T18:32:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.297+0000 7f5a0160a640 1 -- 172.21.15.87:0/3805472304 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0405d650 con 0x559f8c8b48c0 2024-05-08T18:32:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.297+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3805472304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f8ca3bc50 con 0x559f8c8b48c0 2024-05-08T18:32:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.297+0000 7f5a0160a640 1 -- 172.21.15.87:0/3805472304 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b04057070 con 0x559f8c8b48c0 2024-05-08T18:32:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.297+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3805472304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f8ca3e900 con 0x559f8c8b48c0 2024-05-08T18:32:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.298+0000 7f5a0160a640 1 -- 172.21.15.87:0/3805472304 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5b04076070 con 0x559f8c8b48c0 2024-05-08T18:32:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.298+0000 7f5a0160a640 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f59fc03bb50 0x7f59fc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.298+0000 7f5a0160a640 1 -- 172.21.15.87:0/3805472304 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f5b040942e0 con 0x559f8c8b48c0 2024-05-08T18:32:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.298+0000 7f5b0c3ea640 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f59fc03bb50 0x7f59fc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.298+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559f8c8b5e20 0x559f8ca426c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.298+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3805472304 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca42ca0 con 0x559f8c8b5e20 2024-05-08T18:32:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.299+0000 7f5b153ec640 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559f8c8b5e20 0x559f8ca426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.299+0000 7f5b0c3ea640 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f59fc03bb50 0x7f59fc03e010 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5afc000f60 tx=0x7f5afc001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.299+0000 7f5b153ec640 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559f8c8b5e20 0x559f8ca426c0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.299+0000 7f5b153ec640 1 -- 172.21.15.87:0/3805472304 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b1000a4a0 con 0x559f8c8b5e20 2024-05-08T18:32:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.299+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3805472304 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca3fc90 con 0x559f8c8b5e20 2024-05-08T18:32:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.299+0000 7f5b153ec640 1 -- 172.21.15.87:0/3805472304 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b1000a4a0 con 0x559f8c8b5e20 2024-05-08T18:32:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.299+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3805472304 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca44ac0 con 0x559f8c8b5e20 2024-05-08T18:32:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.300+0000 7f5b153ec640 1 -- 172.21.15.87:0/3805472304 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5b1000a4a0 con 0x559f8c8b5e20 2024-05-08T18:32:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.300+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3805472304 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca43c00 con 0x559f8c8b5e20 2024-05-08T18:32:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.300+0000 7f5b153ec640 1 -- 172.21.15.87:0/3805472304 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b1000a4a0 con 0x559f8c8b5e20 2024-05-08T18:32:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.300+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559f8ca446d0 0x559f8ca47f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.300+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3805472304 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca486a0 con 0x559f8ca446d0 2024-05-08T18:32:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.300+0000 7f5b14beb640 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559f8ca446d0 0x559f8ca47f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.301+0000 7f5b14beb640 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559f8ca446d0 0x559f8ca47f10 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.301+0000 7f5b14beb640 1 -- 172.21.15.87:0/3805472304 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5b04075030 con 0x559f8ca446d0 2024-05-08T18:32:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.302+0000 7f5b18f2a800 1 Processor -- start 2024-05-08T18:32:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.302+0000 7f5b18f2a800 1 -- start start 2024-05-08T18:32:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.302+0000 7f5b18f2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca569f0 0x559f8ca56e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.302+0000 7f5b18f2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559f8c831fc0 con 0x559f8ca569f0 2024-05-08T18:32:22.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.302+0000 7f5b153ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca569f0 0x559f8ca56e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.302+0000 7f5b153ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca569f0 0x559f8ca56e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32804/0 (socket says 172.21.15.87:32804) 2024-05-08T18:32:22.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.302+0000 7f5b153ec640 1 -- 172.21.15.87:0/742544333 learned_addr learned my addr 172.21.15.87:0/742544333 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.302+0000 7f5b153ec640 1 -- 172.21.15.87:0/742544333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f8ca57350 con 0x559f8ca569f0 2024-05-08T18:32:22.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.303+0000 7f5b153ec640 1 --2- 172.21.15.87:0/742544333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca569f0 0x559f8ca56e10 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x559f8ca43080 tx=0x7f5b100178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.303+0000 7f59fa7fc640 1 -- 172.21.15.87:0/742544333 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b10013440 con 0x559f8ca569f0 2024-05-08T18:32:22.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.303+0000 7f59fa7fc640 1 -- 172.21.15.87:0/742544333 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b100135e0 con 0x559f8ca569f0 2024-05-08T18:32:22.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.303+0000 7f59fa7fc640 1 -- 172.21.15.87:0/742544333 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b100138c0 con 0x559f8ca569f0 2024-05-08T18:32:22.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.303+0000 7f5b18f2a800 1 -- 172.21.15.87:0/742544333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f8ca57dc0 con 0x559f8ca569f0 2024-05-08T18:32:22.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.303+0000 7f5b18f2a800 1 -- 172.21.15.87:0/742544333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f8ca58200 con 0x559f8ca569f0 2024-05-08T18:32:22.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.304+0000 7f59fa7fc640 1 -- 172.21.15.87:0/742544333 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5b10011040 con 0x559f8ca569f0 2024-05-08T18:32:22.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.304+0000 7f59fa7fc640 1 --2- 172.21.15.87:0/742544333 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f59ec03bb50 0x7f59ec03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.304+0000 7f59fa7fc640 1 -- 172.21.15.87:0/742544333 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f5b1001d070 con 0x559f8ca569f0 2024-05-08T18:32:22.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.304+0000 7f5b14beb640 1 --2- 172.21.15.87:0/742544333 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f59ec03bb50 0x7f59ec03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.304+0000 7f5b18f2a800 1 Processor -- start 2024-05-08T18:32:22.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.304+0000 7f5b14beb640 1 --2- 172.21.15.87:0/742544333 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f59ec03bb50 0x7f59ec03e010 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5b04006d80 tx=0x7f5b04066f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.305+0000 7f5b18f2a800 1 -- start start 2024-05-08T18:32:22.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.305+0000 7f5b18f2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca63cf0 0x559f8ca64110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.305+0000 7f5b18f2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559f8ca34250 con 0x559f8ca63cf0 2024-05-08T18:32:22.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.305+0000 7f5b153ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca63cf0 0x559f8ca64110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.305+0000 7f5b153ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca63cf0 0x559f8ca64110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32816/0 (socket says 172.21.15.87:32816) 2024-05-08T18:32:22.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.305+0000 7f5b153ec640 1 -- 172.21.15.87:0/863474256 learned_addr learned my addr 172.21.15.87:0/863474256 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.305+0000 7f5b153ec640 1 -- 172.21.15.87:0/863474256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f8ca646e0 con 0x559f8ca63cf0 2024-05-08T18:32:22.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.306+0000 7f5b153ec640 1 --2- 172.21.15.87:0/863474256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca63cf0 0x559f8ca64110 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5b10052ae0 tx=0x7f5b1002adc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894fe4919310def3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.306+0000 7f59ebfff640 1 -- 172.21.15.87:0/863474256 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b10015430 con 0x559f8ca63cf0 2024-05-08T18:32:22.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.306+0000 7f59ebfff640 1 -- 172.21.15.87:0/863474256 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b1004e020 con 0x559f8ca63cf0 2024-05-08T18:32:22.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.306+0000 7f59ebfff640 1 -- 172.21.15.87:0/863474256 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b1002a350 con 0x559f8ca63cf0 2024-05-08T18:32:22.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.306+0000 7f5b18f2a800 1 -- 172.21.15.87:0/863474256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca63cf0 msgr2=0x559f8ca64110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.306+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/863474256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca63cf0 0x559f8ca64110 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5b10052ae0 tx=0x7f5b1002adc0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.306+0000 7f5b18f2a800 1 -- 172.21.15.87:0/863474256 shutdown_connections 2024-05-08T18:32:22.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.306+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/863474256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca63cf0 0x559f8ca64110 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.306+0000 7f5b18f2a800 1 -- 172.21.15.87:0/863474256 >> 172.21.15.87:0/863474256 conn(0x559f8ca60000 msgr2=0x559f8ca5e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.306+0000 7f5b18f2a800 1 -- 172.21.15.87:0/863474256 shutdown_connections 2024-05-08T18:32:22.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.306+0000 7f5b18f2a800 1 -- 172.21.15.87:0/863474256 wait complete. 2024-05-08T18:32:22.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.307+0000 7f5b18f2a800 1 Processor -- start 2024-05-08T18:32:22.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.307+0000 7f5b18f2a800 1 -- start start 2024-05-08T18:32:22.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.307+0000 7f5b18f2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca63cf0 0x559f8ca6b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.307+0000 7f5b18f2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559f8ca64eb0 con 0x559f8ca63cf0 2024-05-08T18:32:22.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.307+0000 7f5b153ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca63cf0 0x559f8ca6b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.307+0000 7f5b153ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca63cf0 0x559f8ca6b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32830/0 (socket says 172.21.15.87:32830) 2024-05-08T18:32:22.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.307+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 learned_addr learned my addr 172.21.15.87:0/1934423122 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.307+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f8ca6b710 con 0x559f8ca63cf0 2024-05-08T18:32:22.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.308+0000 7f5b153ec640 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca63cf0 0x559f8ca6b1d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5b10012550 tx=0x7f5b10052a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.308+0000 7f59ea7fc640 1 -- 172.21.15.87:0/1934423122 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b10030070 con 0x559f8ca63cf0 2024-05-08T18:32:22.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.308+0000 7f59ea7fc640 1 -- 172.21.15.87:0/1934423122 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b10051470 con 0x559f8ca63cf0 2024-05-08T18:32:22.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.308+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f8ca6b9a0 con 0x559f8ca63cf0 2024-05-08T18:32:22.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.308+0000 7f59ea7fc640 1 -- 172.21.15.87:0/1934423122 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b100540d0 con 0x559f8ca63cf0 2024-05-08T18:32:22.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.308+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f8ca6e650 con 0x559f8ca63cf0 2024-05-08T18:32:22.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.308+0000 7f59ea7fc640 1 -- 172.21.15.87:0/1934423122 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5b10033070 con 0x559f8ca63cf0 2024-05-08T18:32:22.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.309+0000 7f59ea7fc640 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f59e003bba0 0x7f59e003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.309+0000 7f59ea7fc640 1 -- 172.21.15.87:0/1934423122 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f5b1004f030 con 0x559f8ca63cf0 2024-05-08T18:32:22.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.309+0000 7f5b14beb640 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f59e003bba0 0x7f59e003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.309+0000 7f5b14beb640 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f59e003bba0 0x7f59e003e060 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5b04076510 tx=0x7f5b0408c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.310+0000 7f5b18f2a800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.310+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559f8ca76ea0 0x559f8ca79360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.310+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca79ab0 con 0x559f8ca76ea0 2024-05-08T18:32:22.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.310+0000 7f5b0c3ea640 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559f8ca76ea0 0x559f8ca79360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.310+0000 7f5b0c3ea640 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559f8ca76ea0 0x559f8ca79360 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.310+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.310+0000 7f5b18f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.310+0000 7f5b18f2a800 20 realm 2024-05-08T18:32:22.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.310+0000 7f5b18f2a800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.310+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca762f0 con 0x559f8ca76ea0 2024-05-08T18:32:22.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b18f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b18f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:32:22.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b18f2a800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7a390 con 0x559f8ca76ea0 2024-05-08T18:32:22.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b18f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b18f2a800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7ac60 con 0x559f8ca76ea0 2024-05-08T18:32:22.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b18f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:22.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b18f2a800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7b000 con 0x559f8ca76ea0 2024-05-08T18:32:22.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b18f2a800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:32:22.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b18f2a800 20 searching for the correct realm 2024-05-08T18:32:22.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x559f8ca7cee0 0x559f8ca7f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.311+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7f9e0 con 0x559f8ca7cee0 2024-05-08T18:32:22.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.312+0000 7f5b153ec640 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x559f8ca7cee0 0x559f8ca7f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.312+0000 7f5b153ec640 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x559f8ca7cee0 0x559f8ca7f310 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.312+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1003c070 con 0x559f8ca7cee0 2024-05-08T18:32:22.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.312+0000 7f5b153ec640 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5b10035070 0x7f5b100149e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.312+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7f9e0 con 0x7f5b10035070 2024-05-08T18:32:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.312+0000 7f5b14beb640 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5b10035070 0x7f5b100149e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.313+0000 7f5b14beb640 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5b10035070 0x7f5b100149e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.313+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b0408a030 con 0x7f5b10035070 2024-05-08T18:32:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.313+0000 7f5b14beb640 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f5b040a1040 0x7f5b04076580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.313+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7f9e0 con 0x7f5b040a1040 2024-05-08T18:32:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.313+0000 7f5b0c3ea640 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f5b040a1040 0x7f5b04076580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.314+0000 7f5b0c3ea640 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f5b040a1040 0x7f5b04076580 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.314+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.314+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7f9e0 con 0x559f8ca76ea0 2024-05-08T18:32:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.314+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.314+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7f9e0 con 0x559f8ca76ea0 2024-05-08T18:32:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.314+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.315+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7f9e0 con 0x7f5b040a1040 2024-05-08T18:32:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.315+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.315+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7f9e0 con 0x7f5b040a1040 2024-05-08T18:32:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.315+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.315+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7f9e0 con 0x7f5b10035070 2024-05-08T18:32:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.315+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b0408a030 con 0x7f5b10035070 2024-05-08T18:32:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.315+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7f9e0 con 0x559f8ca7cee0 2024-05-08T18:32:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.316+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1003c070 con 0x559f8ca7cee0 2024-05-08T18:32:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.316+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7f9e0 con 0x559f8ca76ea0 2024-05-08T18:32:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.316+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.316+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7f9e0 con 0x7f5b040a1040 2024-05-08T18:32:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.316+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.316+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7f9e0 con 0x559f8ca76ea0 2024-05-08T18:32:22.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.317+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.317+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7f9e0 con 0x7f5b10035070 2024-05-08T18:32:22.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.317+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5b0408a030 con 0x7f5b10035070 2024-05-08T18:32:22.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.317+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7f9e0 con 0x559f8ca7cee0 2024-05-08T18:32:22.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.317+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1003c070 con 0x559f8ca7cee0 2024-05-08T18:32:22.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.317+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7f9e0 con 0x559f8ca7cee0 2024-05-08T18:32:22.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.317+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1003c070 con 0x559f8ca7cee0 2024-05-08T18:32:22.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.317+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5b10062040 con 0x7f5b040a1040 2024-05-08T18:32:22.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.318+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.318+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5b10062040 con 0x559f8ca7cee0 2024-05-08T18:32:22.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.318+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1003c070 con 0x559f8ca7cee0 2024-05-08T18:32:22.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.318+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5b10062040 con 0x559f8ca7cee0 2024-05-08T18:32:22.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.318+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1003c070 con 0x559f8ca7cee0 2024-05-08T18:32:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.318+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5b10062040 con 0x559f8ca76ea0 2024-05-08T18:32:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.318+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.318+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5b10062040 con 0x559f8ca76ea0 2024-05-08T18:32:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.319+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.319+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5b10062040 con 0x7f5b040a1040 2024-05-08T18:32:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.319+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.319+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5b10062040 con 0x559f8ca7cee0 2024-05-08T18:32:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.319+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1003c070 con 0x559f8ca7cee0 2024-05-08T18:32:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.319+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5b10062040 con 0x7f5b10035070 2024-05-08T18:32:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.319+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b0408a030 con 0x7f5b10035070 2024-05-08T18:32:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.319+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5b10062040 con 0x559f8ca76ea0 2024-05-08T18:32:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.320+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.320+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5b10062040 con 0x7f5b040a1040 2024-05-08T18:32:22.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.320+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.320+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5b10062040 con 0x559f8ca7cee0 2024-05-08T18:32:22.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.320+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1003c070 con 0x559f8ca7cee0 2024-05-08T18:32:22.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.320+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5b10062040 con 0x7f5b10035070 2024-05-08T18:32:22.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.321+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b0408a030 con 0x7f5b10035070 2024-05-08T18:32:22.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.321+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5b10062040 con 0x7f5b10035070 2024-05-08T18:32:22.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.321+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b0408a030 con 0x7f5b10035070 2024-05-08T18:32:22.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.321+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5b10062040 con 0x559f8ca7cee0 2024-05-08T18:32:22.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.321+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1003c070 con 0x559f8ca7cee0 2024-05-08T18:32:22.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.321+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5b10062040 con 0x7f5b10035070 2024-05-08T18:32:22.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.321+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b0408a030 con 0x7f5b10035070 2024-05-08T18:32:22.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.321+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5b10062040 con 0x559f8ca76ea0 2024-05-08T18:32:22.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.321+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5b10062040 con 0x7f5b10035070 2024-05-08T18:32:22.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b0408a030 con 0x7f5b10035070 2024-05-08T18:32:22.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b18f2a800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:32:22.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b18f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:32:22.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b18f2a800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:32:22.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b18f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:32:22.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b18f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:32:22.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b18f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:32:22.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b18f2a800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7b980 con 0x559f8ca76ea0 2024-05-08T18:32:22.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b18f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b18f2a800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7c220 con 0x559f8ca76ea0 2024-05-08T18:32:22.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b18f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:22.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b18f2a800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.322+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca7fe60 con 0x7f5b040a1040 2024-05-08T18:32:22.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.323+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.323+0000 7f5b18f2a800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:32:22.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.323+0000 7f5b18f2a800 20 zone default found 2024-05-08T18:32:22.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.323+0000 7f5b18f2a800 4 Realm: () 2024-05-08T18:32:22.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.323+0000 7f5b18f2a800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:32:22.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.323+0000 7f5b18f2a800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:32:22.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.323+0000 7f5b18f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:32:22.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.323+0000 7f5b18f2a800 20 zonegroup default 2024-05-08T18:32:22.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.323+0000 7f5b18f2a800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.323+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca80310 con 0x7f5b040a1040 2024-05-08T18:32:22.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.323+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.323+0000 7f5b18f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.323+0000 7f5b18f2a800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.323+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca81cf0 con 0x559f8ca7cee0 2024-05-08T18:32:22.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.324+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b1003c070 con 0x559f8ca7cee0 2024-05-08T18:32:22.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.324+0000 7f5b18f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.324+0000 7f5b18f2a800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.324+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca82180 con 0x559f8ca7cee0 2024-05-08T18:32:22.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.324+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b1003c070 con 0x559f8ca7cee0 2024-05-08T18:32:22.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.324+0000 7f5b18f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.324+0000 7f5b18f2a800 20 started sync module instance, tier type = 2024-05-08T18:32:22.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.324+0000 7f5b18f2a800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:32:22.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.324+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca81180 con 0x7f5b10035070 2024-05-08T18:32:22.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.325+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b0408a030 con 0x7f5b10035070 2024-05-08T18:32:22.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.325+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94143747986800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca80de0 con 0x7f5b10035070 2024-05-08T18:32:22.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.325+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca82f80 con 0x559f8ca76ea0 2024-05-08T18:32:22.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.326+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94143747986800] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b0408a030 con 0x7f5b10035070 2024-05-08T18:32:22.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.326+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.327+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94143747991008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca833a0 con 0x559f8ca76ea0 2024-05-08T18:32:22.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.327+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca83df0 con 0x559f8ca7cee0 2024-05-08T18:32:22.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.328+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b1003c070 con 0x559f8ca7cee0 2024-05-08T18:32:22.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.328+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94143747991008] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.328+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94143747995872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca83df0 con 0x559f8ca7cee0 2024-05-08T18:32:22.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.328+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca82a00 con 0x7f5b10035070 2024-05-08T18:32:22.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.329+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b0408a030 con 0x7f5b10035070 2024-05-08T18:32:22.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.329+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94143747999968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca851b0 con 0x7f5b10035070 2024-05-08T18:32:22.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.329+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca85c20 con 0x559f8ca76ea0 2024-05-08T18:32:22.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.329+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94143747995872] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b1003c070 con 0x559f8ca7cee0 2024-05-08T18:32:22.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.330+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94143747999968] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b0408a030 con 0x7f5b10035070 2024-05-08T18:32:22.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.330+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.330+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94143748001024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca841e0 con 0x559f8ca76ea0 2024-05-08T18:32:22.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.330+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca864c0 con 0x7f5b040a1040 2024-05-08T18:32:22.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.332+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.332+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94143748005824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca863e0 con 0x7f5b040a1040 2024-05-08T18:32:22.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.332+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca873c0 con 0x7f5b040a1040 2024-05-08T18:32:22.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.332+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94143748001024] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.333+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94143748005824] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.333+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.333+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94143748003568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca86ed0 con 0x7f5b040a1040 2024-05-08T18:32:22.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.333+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca87c60 con 0x7f5b040a1040 2024-05-08T18:32:22.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.334+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94143748003568] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.334+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.334+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94143748008032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca86ed0 con 0x7f5b040a1040 2024-05-08T18:32:22.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.334+0000 7f5b18f2a800 20 add_watcher() i=0 2024-05-08T18:32:22.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.334+0000 7f5b18f2a800 20 add_watcher() i=1 2024-05-08T18:32:22.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.334+0000 7f5b18f2a800 20 add_watcher() i=2 2024-05-08T18:32:22.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.334+0000 7f5b18f2a800 20 add_watcher() i=3 2024-05-08T18:32:22.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.334+0000 7f5b18f2a800 20 add_watcher() i=4 2024-05-08T18:32:22.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.334+0000 7f5b18f2a800 20 add_watcher() i=5 2024-05-08T18:32:22.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.334+0000 7f5b18f2a800 20 add_watcher() i=6 2024-05-08T18:32:22.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.335+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94143748008032] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.335+0000 7f5b18f2a800 20 add_watcher() i=7 2024-05-08T18:32:22.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.335+0000 7f5b18f2a800 2 all 8 watchers are set, enabling cache 2024-05-08T18:32:22.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.335+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca8ac90 con 0x559f8ca76ea0 2024-05-08T18:32:22.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.335+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.336+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94143748011952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca88150 con 0x559f8ca76ea0 2024-05-08T18:32:22.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.337+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94143748011952] v29'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.337+0000 7f59cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:22.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.337+0000 7f5b18f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:32:22.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.337+0000 7f5b18f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:32:22.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.337+0000 7f5b18f2a800 5 note: GC not initialized 2024-05-08T18:32:22.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.337+0000 7f59c9fe3640 20 reqs_thread_entry: start 2024-05-08T18:32:22.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.337+0000 7f5b18f2a800 20 init_complete bucket index max shards: 11 2024-05-08T18:32:22.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.337+0000 7f5b18f2a800 20 Filter name: none 2024-05-08T18:32:22.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.337+0000 7f593b7fe640 20 reqs_thread_entry: start 2024-05-08T18:32:22.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.337+0000 7f5b18f2a800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:32:22.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.337+0000 7f5b18f2a800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.337+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8cabe1e0 con 0x7f5b040a1040 2024-05-08T18:32:22.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.338+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.338+0000 7f5b18f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.338+0000 7f5b18f2a800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-08T18:32:22.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.338+0000 7f5b18f2a800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:32:22.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.338+0000 7f5b18f2a800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-08T18:32:22.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.338+0000 7f5b18f2a800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.338+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8cabc980 con 0x7f5b040a1040 2024-05-08T18:32:22.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.338+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.338+0000 7f5b18f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.338+0000 7f5b18f2a800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-08T18:32:22.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.338+0000 7f5b18f2a800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:32:22.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.338+0000 7f5b18f2a800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:32:22.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.338+0000 7f5b18f2a800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:32:22.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.338+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8cabd220 con 0x7f5b040a1040 2024-05-08T18:32:22.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.339+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v29'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.339+0000 7f5b18f2a800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-08T18:32:22.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.339+0000 7f5b18f2a800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:32:22.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.339+0000 7f5b18f2a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-08T18:32:22.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.339+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94143748230512 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8cac1b20 con 0x7f5b040a1040 2024-05-08T18:32:22.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.340+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== watch-notify(notify (1) cookie 94143748005824 notify 124554051606 ret 0) ==== 598+0+0 (crc 0 0 0) 0x559f8cabd5c0 con 0x7f5b040a1040 2024-05-08T18:32:22.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.340+0000 7f59ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051606 cookie 94143748005824 notifier 4732 bl.length()=556 2024-05-08T18:32:22.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.340+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(65 notify.5 [notify cookie 94143748230512 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.340+0000 7f59ebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-08T18:32:22.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.340+0000 7f59ebfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:32:22.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.340+0000 7f59ebfff640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f59d8003ea0 con 0x7f5b040a1040 2024-05-08T18:32:22.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.340+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== watch-notify(notify_complete (2) cookie 94143748230512 notify 124554051606 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559f8cabdc30 con 0x7f5b040a1040 2024-05-08T18:32:22.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.340+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.340+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8cabcd20 con 0x7f5b040a1040 2024-05-08T18:32:22.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.341+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v29'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.341+0000 7f5b18f2a800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:32:22.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.341+0000 7f5b18f2a800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:32:22.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.341+0000 7f5b18f2a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:32:22.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.341+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94143748230432 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559f8cac1a80 con 0x559f8ca7cee0 2024-05-08T18:32:22.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.342+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== watch-notify(notify (1) cookie 94143747995872 notify 124554051590 ret 0) ==== 219+0+0 (crc 0 0 0) 0x559f8ca6e650 con 0x559f8ca7cee0 2024-05-08T18:32:22.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.342+0000 7f59ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051590 cookie 94143747995872 notifier 4732 bl.length()=177 2024-05-08T18:32:22.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.342+0000 7f59ebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:32:22.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.342+0000 7f59ebfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:32:22.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.342+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(68 notify.2 [notify cookie 94143748230432 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5b1003c070 con 0x559f8ca7cee0 2024-05-08T18:32:22.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.342+0000 7f59ebfff640 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f59d8003ea0 con 0x559f8ca7cee0 2024-05-08T18:32:22.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.342+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b1003c070 con 0x559f8ca7cee0 2024-05-08T18:32:22.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.342+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== watch-notify(notify_complete (2) cookie 94143748230432 notify 124554051590 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559f8ca6b9a0 con 0x559f8ca7cee0 2024-05-08T18:32:22.351 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T18:32:22.339344Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:32:22.339326Z","tags":[],"group_ids":[]} 2024-05-08T18:32:22.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.343+0000 7f59cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:22.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.343+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94143748011952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca73040 con 0x559f8ca76ea0 2024-05-08T18:32:22.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.344+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94143748011952] v29'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.344+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94143747986800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca87790 con 0x7f5b10035070 2024-05-08T18:32:22.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.345+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94143747986800] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b0408a030 con 0x7f5b10035070 2024-05-08T18:32:22.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.345+0000 7f5b18f2a800 20 remove_watcher() i=0 2024-05-08T18:32:22.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.345+0000 7f5b18f2a800 2 removed watcher, disabling cache 2024-05-08T18:32:22.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.345+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94143747991008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca81570 con 0x559f8ca76ea0 2024-05-08T18:32:22.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.346+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94143747991008] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.346+0000 7f5b18f2a800 20 remove_watcher() i=1 2024-05-08T18:32:22.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.346+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94143747995872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca81570 con 0x559f8ca7cee0 2024-05-08T18:32:22.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.347+0000 7f5b153ec640 1 -- 172.21.15.87:0/1934423122 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94143747995872] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b1003c070 con 0x559f8ca7cee0 2024-05-08T18:32:22.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.347+0000 7f5b18f2a800 20 remove_watcher() i=2 2024-05-08T18:32:22.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.347+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94143747999968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca81570 con 0x7f5b10035070 2024-05-08T18:32:22.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.348+0000 7f5b14beb640 1 -- 172.21.15.87:0/1934423122 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94143747999968] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b0408a030 con 0x7f5b10035070 2024-05-08T18:32:22.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.348+0000 7f5b18f2a800 20 remove_watcher() i=3 2024-05-08T18:32:22.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.348+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94143748001024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca848e0 con 0x559f8ca76ea0 2024-05-08T18:32:22.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.349+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94143748001024] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x559f8ca76ea0 2024-05-08T18:32:22.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.349+0000 7f5b18f2a800 20 remove_watcher() i=4 2024-05-08T18:32:22.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.349+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94143748005824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca81570 con 0x7f5b040a1040 2024-05-08T18:32:22.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.351+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94143748005824] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.351+0000 7f5b18f2a800 20 remove_watcher() i=5 2024-05-08T18:32:22.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.351+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94143748003568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca81570 con 0x7f5b040a1040 2024-05-08T18:32:22.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.352+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94143748003568] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.352+0000 7f5b18f2a800 20 remove_watcher() i=6 2024-05-08T18:32:22.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.352+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94143748008032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559f8ca81570 con 0x7f5b040a1040 2024-05-08T18:32:22.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.353+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94143748008032] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5afc00f610 con 0x7f5b040a1040 2024-05-08T18:32:22.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.353+0000 7f5b18f2a800 20 remove_watcher() i=7 2024-05-08T18:32:22.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.353+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f5b040a1040 msgr2=0x7f5b04076580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.353+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f5b040a1040 0x7f5b04076580 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.353+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559f8ca76ea0 msgr2=0x559f8ca79360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.353+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559f8ca76ea0 0x559f8ca79360 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.353+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5b10035070 msgr2=0x7f5b100149e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.353+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5b10035070 0x7f5b100149e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.353+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x559f8ca7cee0 msgr2=0x559f8ca7f310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.353+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x559f8ca7cee0 0x559f8ca7f310 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.353+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f59e003bba0 msgr2=0x7f59e003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.353+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f59e003bba0 0x7f59e003e060 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5b04076510 tx=0x7f5b0408c000 comp rx=0 tx=0).stop 2024-05-08T18:32:22.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.353+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca63cf0 msgr2=0x559f8ca6b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.353+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca63cf0 0x559f8ca6b1d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5b10012550 tx=0x7f5b10052a40 comp rx=0 tx=0).stop 2024-05-08T18:32:22.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.353+0000 7f5b0c3ea640 1 -- 172.21.15.87:0/1934423122 reap_dead start 2024-05-08T18:32:22.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 shutdown_connections 2024-05-08T18:32:22.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/1934423122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca63cf0 0x559f8ca6b1d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 >> 172.21.15.87:0/1934423122 conn(0x559f8ca60000 msgr2=0x559f8ca5d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 shutdown_connections 2024-05-08T18:32:22.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 -- 172.21.15.87:0/1934423122 wait complete. 2024-05-08T18:32:22.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 -- 172.21.15.87:0/742544333 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f59ec03bb50 msgr2=0x7f59ec03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/742544333 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f59ec03bb50 0x7f59ec03e010 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5b04006d80 tx=0x7f5b04066f90 comp rx=0 tx=0).stop 2024-05-08T18:32:22.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 -- 172.21.15.87:0/742544333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca569f0 msgr2=0x559f8ca56e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/742544333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca569f0 0x559f8ca56e10 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x559f8ca43080 tx=0x7f5b100178e0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 -- 172.21.15.87:0/742544333 shutdown_connections 2024-05-08T18:32:22.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/742544333 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f59ec03bb50 0x7f59ec03e010 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/742544333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8ca569f0 0x559f8ca56e10 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 -- 172.21.15.87:0/742544333 >> 172.21.15.87:0/742544333 conn(0x559f8ca4aa90 msgr2=0x559f8ca4ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 -- 172.21.15.87:0/742544333 shutdown_connections 2024-05-08T18:32:22.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 -- 172.21.15.87:0/742544333 wait complete. 2024-05-08T18:32:22.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3805472304 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559f8ca446d0 msgr2=0x559f8ca47f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559f8ca446d0 0x559f8ca47f10 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3805472304 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559f8c8b5e20 msgr2=0x559f8ca426c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559f8c8b5e20 0x559f8ca426c0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3805472304 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f59fc03bb50 msgr2=0x7f59fc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f59fc03bb50 0x7f59fc03e010 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5afc000f60 tx=0x7f5afc001370 comp rx=0 tx=0).stop 2024-05-08T18:32:22.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3805472304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b48c0 msgr2=0x559f8ca3b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b48c0 0x559f8ca3b480 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5b04000c00 tx=0x7f5b04003020 comp rx=0 tx=0).stop 2024-05-08T18:32:22.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3805472304 shutdown_connections 2024-05-08T18:32:22.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.354+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559f8c8b5e20 0x559f8ca426c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.355+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559f8ca446d0 0x559f8ca47f10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.355+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f59fc03bb50 0x7f59fc03e010 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.355+0000 7f5b18f2a800 1 --2- 172.21.15.87:0/3805472304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f8c8b48c0 0x559f8ca3b480 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.355+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3805472304 >> 172.21.15.87:0/3805472304 conn(0x559f8c93b870 msgr2=0x559f8ca2dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.355+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3805472304 shutdown_connections 2024-05-08T18:32:22.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.355+0000 7f5b18f2a800 1 -- 172.21.15.87:0/3805472304 wait complete. 2024-05-08T18:32:22.363 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T18:32:22.339344Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:32:22.339326Z', 'tags': [], 'group_ids': []} 2024-05-08T18:32:22.377 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:32:22.382 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-05-08T18:32:22.382 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-05-08T18:32:22.382 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-05-08T18:32:22.382 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-05-08T18:32:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:32:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:32:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.431+0000 7f610cfaf800 1 Processor -- start 2024-05-08T18:32:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.431+0000 7f610cfaf800 1 -- start start 2024-05-08T18:32:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.431+0000 7f610cfaf800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55762575ea40 0x5576257f3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.431+0000 7f610cfaf800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55762575eef0 con 0x55762575fdd0 2024-05-08T18:32:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.431+0000 7f610cfaf800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55762568ae20 con 0x55762575ea40 2024-05-08T18:32:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.432+0000 7f6103fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55762575ea40 0x5576257f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.432+0000 7f6103fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55762575ea40 0x5576257f3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32840/0 (socket says 172.21.15.87:32840) 2024-05-08T18:32:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.432+0000 7f6103fff640 1 -- 172.21.15.87:0/4234360811 learned_addr learned my addr 172.21.15.87:0/4234360811 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.432+0000 7f610aaae640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55762575fdd0 0x55762575e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:40786/0 (socket says 172.21.15.87:40786) 2024-05-08T18:32:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.432+0000 7f6103fff640 1 -- 172.21.15.87:0/4234360811 >> v1:172.21.15.53:6789/0 conn(0x55762575fdd0 legacy=0x55762575e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.432+0000 7f6103fff640 1 -- 172.21.15.87:0/4234360811 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55762575f110 con 0x55762575ea40 2024-05-08T18:32:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.434+0000 7f6103fff640 1 --2- 172.21.15.87:0/4234360811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 0x5576257f3180 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f60f400a520 tx=0x7f60f401d0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4250e79a91ea186 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.434+0000 7f610a2ad640 1 -- 172.21.15.87:0/4234360811 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60f4057070 con 0x55762575ea40 2024-05-08T18:32:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.434+0000 7f610a2ad640 1 -- 172.21.15.87:0/4234360811 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f404ae50 con 0x55762575ea40 2024-05-08T18:32:22.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.434+0000 7f610a2ad640 1 -- 172.21.15.87:0/4234360811 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60f40526c0 con 0x55762575ea40 2024-05-08T18:32:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.434+0000 7f610cfaf800 1 -- 172.21.15.87:0/4234360811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 msgr2=0x5576257f3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.434+0000 7f610cfaf800 1 --2- 172.21.15.87:0/4234360811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 0x5576257f3180 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f60f400a520 tx=0x7f60f401d0a0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.434+0000 7f610cfaf800 1 -- 172.21.15.87:0/4234360811 shutdown_connections 2024-05-08T18:32:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.434+0000 7f610cfaf800 1 --2- 172.21.15.87:0/4234360811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 0x5576257f3180 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.434+0000 7f610cfaf800 1 -- 172.21.15.87:0/4234360811 >> 172.21.15.87:0/4234360811 conn(0x5576257e5840 msgr2=0x5576257e7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.434+0000 7f610cfaf800 1 -- 172.21.15.87:0/4234360811 shutdown_connections 2024-05-08T18:32:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.434+0000 7f610cfaf800 1 -- 172.21.15.87:0/4234360811 wait complete. 2024-05-08T18:32:22.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.448+0000 7f610cfaf800 1 Processor -- start 2024-05-08T18:32:22.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.448+0000 7f610cfaf800 1 -- start start 2024-05-08T18:32:22.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.448+0000 7f610cfaf800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 0x5576258dd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.448+0000 7f610cfaf800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5576257355c0 con 0x55762575ea40 2024-05-08T18:32:22.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.448+0000 7f610aaae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 0x5576258dd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.448+0000 7f610aaae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 0x5576258dd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32846/0 (socket says 172.21.15.87:32846) 2024-05-08T18:32:22.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.448+0000 7f610aaae640 1 -- 172.21.15.87:0/1328994384 learned_addr learned my addr 172.21.15.87:0/1328994384 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.449+0000 7f610aaae640 1 -- 172.21.15.87:0/1328994384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576258ddda0 con 0x55762575ea40 2024-05-08T18:32:22.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.449+0000 7f610aaae640 1 --2- 172.21.15.87:0/1328994384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 0x5576258dd7d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f60fc001e60 tx=0x7f60fc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2d689d3faa3e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.449+0000 7f5ff8e09640 1 -- 172.21.15.87:0/1328994384 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60fc00e5c0 con 0x55762575ea40 2024-05-08T18:32:22.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.449+0000 7f5ff8e09640 1 -- 172.21.15.87:0/1328994384 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60fc006070 con 0x55762575ea40 2024-05-08T18:32:22.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.449+0000 7f5ff8e09640 1 -- 172.21.15.87:0/1328994384 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60fc00e910 con 0x55762575ea40 2024-05-08T18:32:22.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.450+0000 7f610cfaf800 1 -- 172.21.15.87:0/1328994384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 msgr2=0x5576258dd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.450+0000 7f610cfaf800 1 --2- 172.21.15.87:0/1328994384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 0x5576258dd7d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f60fc001e60 tx=0x7f60fc00b6c0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.450+0000 7f610cfaf800 1 -- 172.21.15.87:0/1328994384 shutdown_connections 2024-05-08T18:32:22.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.450+0000 7f610cfaf800 1 --2- 172.21.15.87:0/1328994384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 0x5576258dd7d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.450+0000 7f610cfaf800 1 -- 172.21.15.87:0/1328994384 >> 172.21.15.87:0/1328994384 conn(0x5576257e5840 msgr2=0x5576258d90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.450+0000 7f610cfaf800 1 -- 172.21.15.87:0/1328994384 shutdown_connections 2024-05-08T18:32:22.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.450+0000 7f610cfaf800 1 -- 172.21.15.87:0/1328994384 wait complete. 2024-05-08T18:32:22.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.450+0000 7f610cfaf800 1 Processor -- start 2024-05-08T18:32:22.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.450+0000 7f610cfaf800 1 -- start start 2024-05-08T18:32:22.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.450+0000 7f610cfaf800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 0x5576258e5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.450+0000 7f610cfaf800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5576257f39c0 con 0x55762575ea40 2024-05-08T18:32:22.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.450+0000 7f610aaae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 0x5576258e5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.450+0000 7f610aaae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 0x5576258e5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32848/0 (socket says 172.21.15.87:32848) 2024-05-08T18:32:22.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.450+0000 7f610aaae640 1 -- 172.21.15.87:0/2446488970 learned_addr learned my addr 172.21.15.87:0/2446488970 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.451+0000 7f610aaae640 1 -- 172.21.15.87:0/2446488970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576258e58b0 con 0x55762575ea40 2024-05-08T18:32:22.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.451+0000 7f610aaae640 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 0x5576258e5370 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x5576258de560 tx=0x7f60fc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.451+0000 7f5ff7606640 1 -- 172.21.15.87:0/2446488970 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60fc00f8d0 con 0x55762575ea40 2024-05-08T18:32:22.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.451+0000 7f5ff7606640 1 -- 172.21.15.87:0/2446488970 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60fc00fa70 con 0x55762575ea40 2024-05-08T18:32:22.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.451+0000 7f5ff7606640 1 -- 172.21.15.87:0/2446488970 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60fc00fdf0 con 0x55762575ea40 2024-05-08T18:32:22.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.451+0000 7f610cfaf800 1 -- 172.21.15.87:0/2446488970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576258e5b40 con 0x55762575ea40 2024-05-08T18:32:22.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.451+0000 7f610cfaf800 1 -- 172.21.15.87:0/2446488970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576258e87a0 con 0x55762575ea40 2024-05-08T18:32:22.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.452+0000 7f5ff7606640 1 -- 172.21.15.87:0/2446488970 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f60fc017070 con 0x55762575ea40 2024-05-08T18:32:22.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.452+0000 7f5ff7606640 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ff003bb50 0x7f5ff003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.452+0000 7f5ff7606640 1 -- 172.21.15.87:0/2446488970 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f60fc015020 con 0x55762575ea40 2024-05-08T18:32:22.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.452+0000 7f6103fff640 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ff003bb50 0x7f5ff003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.452+0000 7f610cfaf800 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55762575fdd0 0x5576258ec560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.452+0000 7f610cfaf800 1 -- 172.21.15.87:0/2446488970 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5576258ecb30 con 0x55762575fdd0 2024-05-08T18:32:22.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.452+0000 7f610b2af640 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55762575fdd0 0x5576258ec560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.453+0000 7f6103fff640 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ff003bb50 0x7f5ff003e010 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f60f4054000 tx=0x7f60f404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.453+0000 7f610b2af640 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55762575fdd0 0x5576258ec560 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.453+0000 7f610b2af640 1 -- 172.21.15.87:0/2446488970 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f610400a4a0 con 0x55762575fdd0 2024-05-08T18:32:22.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.453+0000 7f610cfaf800 1 -- 172.21.15.87:0/2446488970 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5576258e9b10 con 0x55762575fdd0 2024-05-08T18:32:22.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.453+0000 7f610b2af640 1 -- 172.21.15.87:0/2446488970 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f610400a4a0 con 0x55762575fdd0 2024-05-08T18:32:22.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.453+0000 7f610cfaf800 1 -- 172.21.15.87:0/2446488970 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5576258ee930 con 0x55762575fdd0 2024-05-08T18:32:22.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.454+0000 7f610b2af640 1 -- 172.21.15.87:0/2446488970 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f610400a4a0 con 0x55762575fdd0 2024-05-08T18:32:22.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.454+0000 7f610cfaf800 1 -- 172.21.15.87:0/2446488970 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5576258eda70 con 0x55762575fdd0 2024-05-08T18:32:22.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.454+0000 7f610b2af640 1 -- 172.21.15.87:0/2446488970 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f610400a4a0 con 0x55762575fdd0 2024-05-08T18:32:22.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.454+0000 7f610cfaf800 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5576258ee510 0x5576258f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.454+0000 7f610cfaf800 1 -- 172.21.15.87:0/2446488970 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5576258f2500 con 0x5576258ee510 2024-05-08T18:32:22.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.454+0000 7f610aaae640 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5576258ee510 0x5576258f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.455+0000 7f610aaae640 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5576258ee510 0x5576258f1d70 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.455+0000 7f610aaae640 1 -- 172.21.15.87:0/2446488970 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f60fc02e070 con 0x5576258ee510 2024-05-08T18:32:22.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.455+0000 7f610cfaf800 1 Processor -- start 2024-05-08T18:32:22.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.455+0000 7f610cfaf800 1 -- start start 2024-05-08T18:32:22.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.456+0000 7f610cfaf800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557625900870 0x557625900c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.456+0000 7f610cfaf800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5576256dbfc0 con 0x557625900870 2024-05-08T18:32:22.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.456+0000 7f610b2af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557625900870 0x557625900c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.456+0000 7f610b2af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557625900870 0x557625900c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32850/0 (socket says 172.21.15.87:32850) 2024-05-08T18:32:22.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.456+0000 7f610b2af640 1 -- 172.21.15.87:0/1910858975 learned_addr learned my addr 172.21.15.87:0/1910858975 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.456+0000 7f610b2af640 1 -- 172.21.15.87:0/1910858975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576259011d0 con 0x557625900870 2024-05-08T18:32:22.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.456+0000 7f610b2af640 1 --2- 172.21.15.87:0/1910858975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557625900870 0x557625900c90 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x5576258ecf10 tx=0x7f61040178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.456+0000 7f5ff4e01640 1 -- 172.21.15.87:0/1910858975 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6104013440 con 0x557625900870 2024-05-08T18:32:22.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.456+0000 7f5ff4e01640 1 -- 172.21.15.87:0/1910858975 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61040135e0 con 0x557625900870 2024-05-08T18:32:22.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.456+0000 7f610cfaf800 1 -- 172.21.15.87:0/1910858975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557625901c40 con 0x557625900870 2024-05-08T18:32:22.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.456+0000 7f5ff4e01640 1 -- 172.21.15.87:0/1910858975 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61040138c0 con 0x557625900870 2024-05-08T18:32:22.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.457+0000 7f610cfaf800 1 -- 172.21.15.87:0/1910858975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557625902140 con 0x557625900870 2024-05-08T18:32:22.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.457+0000 7f5ff4e01640 1 -- 172.21.15.87:0/1910858975 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6104011040 con 0x557625900870 2024-05-08T18:32:22.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.458+0000 7f5ff4e01640 1 --2- 172.21.15.87:0/1910858975 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5fe403bb50 0x7f5fe403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.458+0000 7f5ff4e01640 1 -- 172.21.15.87:0/1910858975 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f610401d070 con 0x557625900870 2024-05-08T18:32:22.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.458+0000 7f610aaae640 1 --2- 172.21.15.87:0/1910858975 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5fe403bb50 0x7f5fe403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.458+0000 7f610cfaf800 1 Processor -- start 2024-05-08T18:32:22.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.458+0000 7f610cfaf800 1 -- start start 2024-05-08T18:32:22.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.458+0000 7f610aaae640 1 --2- 172.21.15.87:0/1910858975 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5fe403bb50 0x7f5fe403e010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5576258ede10 tx=0x7f60fc051800 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.458+0000 7f610cfaf800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762590db70 0x55762590df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.458+0000 7f610cfaf800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5576258de120 con 0x55762590db70 2024-05-08T18:32:22.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.458+0000 7f610b2af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762590db70 0x55762590df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.458+0000 7f610b2af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762590db70 0x55762590df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32864/0 (socket says 172.21.15.87:32864) 2024-05-08T18:32:22.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.458+0000 7f610b2af640 1 -- 172.21.15.87:0/1971589115 learned_addr learned my addr 172.21.15.87:0/1971589115 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.459+0000 7f610b2af640 1 -- 172.21.15.87:0/1971589115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55762590e560 con 0x55762590db70 2024-05-08T18:32:22.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.459+0000 7f610b2af640 1 --2- 172.21.15.87:0/1971589115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762590db70 0x55762590df90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f61040529e0 tx=0x7f6104021de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fd54f8a7b915ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.459+0000 7f5fee7fc640 1 -- 172.21.15.87:0/1971589115 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6104015430 con 0x55762590db70 2024-05-08T18:32:22.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.459+0000 7f5fee7fc640 1 -- 172.21.15.87:0/1971589115 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6104001310 con 0x55762590db70 2024-05-08T18:32:22.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.459+0000 7f5fee7fc640 1 -- 172.21.15.87:0/1971589115 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61040155d0 con 0x55762590db70 2024-05-08T18:32:22.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.459+0000 7f610cfaf800 1 -- 172.21.15.87:0/1971589115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762590db70 msgr2=0x55762590df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.459+0000 7f610cfaf800 1 --2- 172.21.15.87:0/1971589115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762590db70 0x55762590df90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f61040529e0 tx=0x7f6104021de0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.459+0000 7f610cfaf800 1 -- 172.21.15.87:0/1971589115 shutdown_connections 2024-05-08T18:32:22.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.459+0000 7f610cfaf800 1 --2- 172.21.15.87:0/1971589115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762590db70 0x55762590df90 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.459+0000 7f610cfaf800 1 -- 172.21.15.87:0/1971589115 >> 172.21.15.87:0/1971589115 conn(0x557625909ed0 msgr2=0x557625907f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.459+0000 7f610cfaf800 1 -- 172.21.15.87:0/1971589115 shutdown_connections 2024-05-08T18:32:22.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.459+0000 7f610cfaf800 1 -- 172.21.15.87:0/1971589115 wait complete. 2024-05-08T18:32:22.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.460+0000 7f610cfaf800 1 Processor -- start 2024-05-08T18:32:22.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.460+0000 7f610cfaf800 1 -- start start 2024-05-08T18:32:22.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.460+0000 7f610cfaf800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762590db70 0x557625915150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.460+0000 7f610cfaf800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55762590ecd0 con 0x55762590db70 2024-05-08T18:32:22.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.460+0000 7f610b2af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762590db70 0x557625915150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.460+0000 7f610b2af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762590db70 0x557625915150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:32880/0 (socket says 172.21.15.87:32880) 2024-05-08T18:32:22.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.460+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 learned_addr learned my addr 172.21.15.87:0/352481258 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.460+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557625915690 con 0x55762590db70 2024-05-08T18:32:22.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.461+0000 7f610b2af640 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762590db70 0x557625915150 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6104015fd0 tx=0x7f6104052940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.461+0000 7f5fecff9640 1 -- 172.21.15.87:0/352481258 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6104030020 con 0x55762590db70 2024-05-08T18:32:22.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.461+0000 7f5fecff9640 1 -- 172.21.15.87:0/352481258 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61040515e0 con 0x55762590db70 2024-05-08T18:32:22.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.461+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557625915920 con 0x55762590db70 2024-05-08T18:32:22.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.461+0000 7f5fecff9640 1 -- 172.21.15.87:0/352481258 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6104013e30 con 0x55762590db70 2024-05-08T18:32:22.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.461+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576259185d0 con 0x55762590db70 2024-05-08T18:32:22.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.462+0000 7f5fecff9640 1 -- 172.21.15.87:0/352481258 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6104033020 con 0x55762590db70 2024-05-08T18:32:22.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.462+0000 7f5fecff9640 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5fd403bba0 0x7f5fd403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.462+0000 7f5fecff9640 1 -- 172.21.15.87:0/352481258 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f610400e040 con 0x55762590db70 2024-05-08T18:32:22.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.462+0000 7f610aaae640 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5fd403bba0 0x7f5fd403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.462+0000 7f610aaae640 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5fd403bba0 0x7f5fd403e060 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f60fc03f470 tx=0x7f60fc047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.462+0000 7f610cfaf800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.462+0000 7f610cfaf800 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557625920e40 0x557625923300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.462+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557625923a50 con 0x557625920e40 2024-05-08T18:32:22.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.463+0000 7f6103fff640 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557625920e40 0x557625923300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.463+0000 7f6103fff640 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557625920e40 0x557625923300 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.463+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.463+0000 7f610cfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.463+0000 7f610cfaf800 20 realm 2024-05-08T18:32:22.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.463+0000 7f610cfaf800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.463+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557625923e20 con 0x557625920e40 2024-05-08T18:32:22.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.463+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.463+0000 7f610cfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.463+0000 7f610cfaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:32:22.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.463+0000 7f610cfaf800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.463+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5576259246f0 con 0x557625920e40 2024-05-08T18:32:22.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.463+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.463+0000 7f610cfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.463+0000 7f610cfaf800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.463+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557625924a90 con 0x557625920e40 2024-05-08T18:32:22.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.464+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.464+0000 7f610cfaf800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:22.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.464+0000 7f610cfaf800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.464+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5576259252e0 con 0x557625920e40 2024-05-08T18:32:22.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.464+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.464+0000 7f610cfaf800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:32:22.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.464+0000 7f610cfaf800 20 searching for the correct realm 2024-05-08T18:32:22.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.464+0000 7f610cfaf800 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x557625927050 0x557625929440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.464+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x557625927050 2024-05-08T18:32:22.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.464+0000 7f610b2af640 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x557625927050 0x557625929440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.464+0000 7f610b2af640 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x557625927050 0x557625929440 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.465+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6104051020 con 0x557625927050 2024-05-08T18:32:22.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.465+0000 7f610b2af640 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6104035020 0x7f61040540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.465+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x7f6104035020 2024-05-08T18:32:22.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.465+0000 7f610aaae640 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6104035020 0x7f61040540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.465+0000 7f610aaae640 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6104035020 0x7f61040540d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.465+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc02e070 con 0x7f6104035020 2024-05-08T18:32:22.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.465+0000 7f610aaae640 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f60fc00f070 0x7f60fc01d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.466+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x7f60fc00f070 2024-05-08T18:32:22.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.466+0000 7f6103fff640 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f60fc00f070 0x7f60fc01d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.466+0000 7f6103fff640 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f60fc00f070 0x7f60fc01d7f0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.466+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.466+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x557625920e40 2024-05-08T18:32:22.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.467+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.467+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x557625920e40 2024-05-08T18:32:22.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.467+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.467+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x7f60fc00f070 2024-05-08T18:32:22.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.467+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.467+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x7f60fc00f070 2024-05-08T18:32:22.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.467+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.467+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x7f6104035020 2024-05-08T18:32:22.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.468+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc02e070 con 0x7f6104035020 2024-05-08T18:32:22.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.468+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x557625927050 2024-05-08T18:32:22.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.468+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6104051020 con 0x557625927050 2024-05-08T18:32:22.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.468+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x557625920e40 2024-05-08T18:32:22.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.468+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.468+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x7f60fc00f070 2024-05-08T18:32:22.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.468+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.468+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x557625920e40 2024-05-08T18:32:22.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.469+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.469+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x7f6104035020 2024-05-08T18:32:22.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.469+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f60fc02e070 con 0x7f6104035020 2024-05-08T18:32:22.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.469+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x557625927050 2024-05-08T18:32:22.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.469+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6104051020 con 0x557625927050 2024-05-08T18:32:22.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.469+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x557625927050 2024-05-08T18:32:22.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.469+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6104051020 con 0x557625927050 2024-05-08T18:32:22.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.469+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x7f60fc00f070 2024-05-08T18:32:22.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.470+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.470+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x557625927050 2024-05-08T18:32:22.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.470+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6104051020 con 0x557625927050 2024-05-08T18:32:22.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.470+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x557625927050 2024-05-08T18:32:22.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.470+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6104051020 con 0x557625927050 2024-05-08T18:32:22.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.470+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x557625920e40 2024-05-08T18:32:22.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.470+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.470+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x557625920e40 2024-05-08T18:32:22.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.471+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.471+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x7f60fc00f070 2024-05-08T18:32:22.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.471+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.471+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x557625927050 2024-05-08T18:32:22.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.471+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6104051020 con 0x557625927050 2024-05-08T18:32:22.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.471+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x7f6104035020 2024-05-08T18:32:22.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.471+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc02e070 con 0x7f6104035020 2024-05-08T18:32:22.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.471+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x557625920e40 2024-05-08T18:32:22.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.471+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.472+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x7f60fc00f070 2024-05-08T18:32:22.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.472+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.472+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x557625927050 2024-05-08T18:32:22.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.472+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6104051020 con 0x557625927050 2024-05-08T18:32:22.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.472+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x7f6104035020 2024-05-08T18:32:22.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.472+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc02e070 con 0x7f6104035020 2024-05-08T18:32:22.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.472+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x7f6104035020 2024-05-08T18:32:22.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.473+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc02e070 con 0x7f6104035020 2024-05-08T18:32:22.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.473+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x557625927050 2024-05-08T18:32:22.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.473+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6104051020 con 0x557625927050 2024-05-08T18:32:22.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.473+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x7f6104035020 2024-05-08T18:32:22.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.473+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc02e070 con 0x7f6104035020 2024-05-08T18:32:22.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.473+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x557625920e40 2024-05-08T18:32:22.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.473+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.473+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5576259299d0 con 0x7f6104035020 2024-05-08T18:32:22.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.473+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc061040 con 0x7f6104035020 2024-05-08T18:32:22.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.473+0000 7f610cfaf800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:32:22.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:32:22.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:32:22.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:32:22.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:32:22.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:32:22.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557625925c90 con 0x557625920e40 2024-05-08T18:32:22.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557625926530 con 0x557625920e40 2024-05-08T18:32:22.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:22.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557625929e50 con 0x7f60fc00f070 2024-05-08T18:32:22.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:32:22.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 20 zone default found 2024-05-08T18:32:22.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 4 Realm: () 2024-05-08T18:32:22.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:32:22.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:32:22.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:32:22.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 20 zonegroup default 2024-05-08T18:32:22.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.474+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55762592a300 con 0x7f60fc00f070 2024-05-08T18:32:22.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.475+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.475+0000 7f610cfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.475+0000 7f610cfaf800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.475+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55762592bce0 con 0x557625927050 2024-05-08T18:32:22.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.475+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6104051020 con 0x557625927050 2024-05-08T18:32:22.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.475+0000 7f610cfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.475+0000 7f610cfaf800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.475+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55762592c1f0 con 0x557625927050 2024-05-08T18:32:22.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.475+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6104051020 con 0x557625927050 2024-05-08T18:32:22.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.475+0000 7f610cfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.475+0000 7f610cfaf800 20 started sync module instance, tier type = 2024-05-08T18:32:22.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.475+0000 7f610cfaf800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:32:22.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.475+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55762592b170 con 0x7f6104035020 2024-05-08T18:32:22.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.476+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc061040 con 0x7f6104035020 2024-05-08T18:32:22.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.476+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93965924873568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55762592add0 con 0x7f6104035020 2024-05-08T18:32:22.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.476+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55762592d120 con 0x557625920e40 2024-05-08T18:32:22.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.477+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93965924873568] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc061040 con 0x7f6104035020 2024-05-08T18:32:22.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.478+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.478+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93965924879472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55762592d540 con 0x557625920e40 2024-05-08T18:32:22.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.478+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55762592df00 con 0x557625927050 2024-05-08T18:32:22.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.479+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93965924879472] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.479+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104051020 con 0x557625927050 2024-05-08T18:32:22.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.479+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93965924880528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55762592d4b0 con 0x557625927050 2024-05-08T18:32:22.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.479+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55762592ed70 con 0x7f6104035020 2024-05-08T18:32:22.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.480+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc061040 con 0x7f6104035020 2024-05-08T18:32:22.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.480+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93965924886720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55762592f5c0 con 0x7f6104035020 2024-05-08T18:32:22.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.480+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557625930020 con 0x557625920e40 2024-05-08T18:32:22.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.480+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93965924880528] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104051020 con 0x557625927050 2024-05-08T18:32:22.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.481+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93965924886720] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc061040 con 0x7f6104035020 2024-05-08T18:32:22.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.481+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.481+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93965924888848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55762592fb00 con 0x557625920e40 2024-05-08T18:32:22.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.481+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5576259308c0 con 0x7f60fc00f070 2024-05-08T18:32:22.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.482+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.482+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93965924893632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557625930820 con 0x7f60fc00f070 2024-05-08T18:32:22.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.482+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557625931820 con 0x7f60fc00f070 2024-05-08T18:32:22.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.482+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93965924888848] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.483+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93965924893632] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.483+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.483+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93965924885152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557625931330 con 0x7f60fc00f070 2024-05-08T18:32:22.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.483+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557625931cf0 con 0x7f60fc00f070 2024-05-08T18:32:22.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.484+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93965924885152] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.484+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.484+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93965924895840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557625931cf0 con 0x7f60fc00f070 2024-05-08T18:32:22.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.484+0000 7f610cfaf800 20 add_watcher() i=0 2024-05-08T18:32:22.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.484+0000 7f610cfaf800 20 add_watcher() i=1 2024-05-08T18:32:22.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.484+0000 7f610cfaf800 20 add_watcher() i=2 2024-05-08T18:32:22.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.484+0000 7f610cfaf800 20 add_watcher() i=3 2024-05-08T18:32:22.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.484+0000 7f610cfaf800 20 add_watcher() i=4 2024-05-08T18:32:22.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.484+0000 7f610cfaf800 20 add_watcher() i=5 2024-05-08T18:32:22.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.484+0000 7f610cfaf800 20 add_watcher() i=6 2024-05-08T18:32:22.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.485+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93965924895840] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.485+0000 7f610cfaf800 20 add_watcher() i=7 2024-05-08T18:32:22.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.485+0000 7f610cfaf800 2 all 8 watchers are set, enabling cache 2024-05-08T18:32:22.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.485+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557625935050 con 0x557625920e40 2024-05-08T18:32:22.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.486+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.486+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93965924911696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557625931e60 con 0x557625920e40 2024-05-08T18:32:22.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.487+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93965924911696] v29'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.487+0000 7f5fc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:22.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.487+0000 7f610cfaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:32:22.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.487+0000 7f610cfaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:32:22.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.487+0000 7f610cfaf800 5 note: GC not initialized 2024-05-08T18:32:22.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.487+0000 7f5f3bfff640 20 reqs_thread_entry: start 2024-05-08T18:32:22.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.487+0000 7f610cfaf800 20 init_complete bucket index max shards: 11 2024-05-08T18:32:22.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.487+0000 7f610cfaf800 20 Filter name: none 2024-05-08T18:32:22.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.487+0000 7f5f39ffb640 20 reqs_thread_entry: start 2024-05-08T18:32:22.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.488+0000 7f610cfaf800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-08T18:32:22.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.488+0000 7f610cfaf800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.488+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5576259684c0 con 0x7f6104035020 2024-05-08T18:32:22.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.488+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f60fc061040 con 0x7f6104035020 2024-05-08T18:32:22.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.488+0000 7f610cfaf800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:32:22.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.488+0000 7f610cfaf800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-05-08T18:32:22.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.488+0000 7f610cfaf800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:32:22.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.488+0000 7f610cfaf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:32:22.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.488+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55762596cb10 con 0x7f60fc00f070 2024-05-08T18:32:22.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.489+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v29'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.500 INFO:teuthology.orchestra.run.smithi087.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-05-08T18:32:22.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.490+0000 7f5fc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:22.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.490+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93965924911696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55762591dd20 con 0x557625920e40 2024-05-08T18:32:22.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.491+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93965924911696] v29'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.491+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93965924873568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5576259349e0 con 0x7f6104035020 2024-05-08T18:32:22.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.492+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93965924873568] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc061040 con 0x7f6104035020 2024-05-08T18:32:22.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.492+0000 7f610cfaf800 20 remove_watcher() i=0 2024-05-08T18:32:22.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.492+0000 7f610cfaf800 2 removed watcher, disabling cache 2024-05-08T18:32:22.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.492+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93965924879472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55762592b560 con 0x557625920e40 2024-05-08T18:32:22.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.493+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93965924879472] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.493+0000 7f610cfaf800 20 remove_watcher() i=1 2024-05-08T18:32:22.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.493+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93965924880528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55762592b560 con 0x557625927050 2024-05-08T18:32:22.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.494+0000 7f610b2af640 1 -- 172.21.15.87:0/352481258 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93965924880528] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104051020 con 0x557625927050 2024-05-08T18:32:22.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.494+0000 7f610cfaf800 20 remove_watcher() i=2 2024-05-08T18:32:22.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.495+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93965924886720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55762592b560 con 0x7f6104035020 2024-05-08T18:32:22.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.495+0000 7f610aaae640 1 -- 172.21.15.87:0/352481258 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93965924886720] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc061040 con 0x7f6104035020 2024-05-08T18:32:22.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.495+0000 7f610cfaf800 20 remove_watcher() i=3 2024-05-08T18:32:22.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.495+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93965924888848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55762592b560 con 0x557625920e40 2024-05-08T18:32:22.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.496+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93965924888848] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x557625920e40 2024-05-08T18:32:22.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.497+0000 7f610cfaf800 20 remove_watcher() i=4 2024-05-08T18:32:22.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.497+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93965924893632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55762592b560 con 0x7f60fc00f070 2024-05-08T18:32:22.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.498+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93965924893632] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.498+0000 7f610cfaf800 20 remove_watcher() i=5 2024-05-08T18:32:22.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.498+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93965924885152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5576259303c0 con 0x7f60fc00f070 2024-05-08T18:32:22.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.499+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93965924885152] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.499+0000 7f610cfaf800 20 remove_watcher() i=6 2024-05-08T18:32:22.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.499+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93965924895840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55762592b560 con 0x7f60fc00f070 2024-05-08T18:32:22.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.499+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93965924895840] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60f405a040 con 0x7f60fc00f070 2024-05-08T18:32:22.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 20 remove_watcher() i=7 2024-05-08T18:32:22.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f60fc00f070 msgr2=0x7f60fc01d7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f60fc00f070 0x7f60fc01d7f0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557625920e40 msgr2=0x557625923300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x557625920e40 0x557625923300 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6104035020 msgr2=0x7f61040540d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6104035020 0x7f61040540d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x557625927050 msgr2=0x557625929440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x557625927050 0x557625929440 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5fd403bba0 msgr2=0x7f5fd403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5fd403bba0 0x7f5fd403e060 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f60fc03f470 tx=0x7f60fc047000 comp rx=0 tx=0).stop 2024-05-08T18:32:22.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762590db70 msgr2=0x557625915150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762590db70 0x557625915150 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6104015fd0 tx=0x7f6104052940 comp rx=0 tx=0).stop 2024-05-08T18:32:22.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f6103fff640 1 -- 172.21.15.87:0/352481258 reap_dead start 2024-05-08T18:32:22.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 shutdown_connections 2024-05-08T18:32:22.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 --2- 172.21.15.87:0/352481258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762590db70 0x557625915150 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 >> 172.21.15.87:0/352481258 conn(0x557625909ed0 msgr2=0x557625907530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 shutdown_connections 2024-05-08T18:32:22.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 -- 172.21.15.87:0/352481258 wait complete. 2024-05-08T18:32:22.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 -- 172.21.15.87:0/1910858975 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5fe403bb50 msgr2=0x7f5fe403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 --2- 172.21.15.87:0/1910858975 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5fe403bb50 0x7f5fe403e010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5576258ede10 tx=0x7f60fc051800 comp rx=0 tx=0).stop 2024-05-08T18:32:22.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 -- 172.21.15.87:0/1910858975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557625900870 msgr2=0x557625900c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 --2- 172.21.15.87:0/1910858975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557625900870 0x557625900c90 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x5576258ecf10 tx=0x7f61040178e0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 -- 172.21.15.87:0/1910858975 shutdown_connections 2024-05-08T18:32:22.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 --2- 172.21.15.87:0/1910858975 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5fe403bb50 0x7f5fe403e010 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 --2- 172.21.15.87:0/1910858975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557625900870 0x557625900c90 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 -- 172.21.15.87:0/1910858975 >> 172.21.15.87:0/1910858975 conn(0x5576258f4910 msgr2=0x5576258f4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 -- 172.21.15.87:0/1910858975 shutdown_connections 2024-05-08T18:32:22.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.500+0000 7f610cfaf800 1 -- 172.21.15.87:0/1910858975 wait complete. 2024-05-08T18:32:22.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.501+0000 7f610cfaf800 1 -- 172.21.15.87:0/2446488970 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5576258ee510 msgr2=0x5576258f1d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.501+0000 7f610cfaf800 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5576258ee510 0x5576258f1d70 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.501+0000 7f610cfaf800 1 -- 172.21.15.87:0/2446488970 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55762575fdd0 msgr2=0x5576258ec560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.501+0000 7f610cfaf800 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55762575fdd0 0x5576258ec560 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.501+0000 7f610cfaf800 1 -- 172.21.15.87:0/2446488970 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ff003bb50 msgr2=0x7f5ff003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.501+0000 7f610cfaf800 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ff003bb50 0x7f5ff003e010 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f60f4054000 tx=0x7f60f404e000 comp rx=0 tx=0).stop 2024-05-08T18:32:22.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.501+0000 7f610cfaf800 1 -- 172.21.15.87:0/2446488970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 msgr2=0x5576258e5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.501+0000 7f610cfaf800 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 0x5576258e5370 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x5576258de560 tx=0x7f60fc000bc0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.501+0000 7f610cfaf800 1 -- 172.21.15.87:0/2446488970 shutdown_connections 2024-05-08T18:32:22.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.501+0000 7f610cfaf800 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55762575fdd0 0x5576258ec560 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.501+0000 7f610cfaf800 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5576258ee510 0x5576258f1d70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.501+0000 7f610cfaf800 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f5ff003bb50 0x7f5ff003e010 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.501+0000 7f610cfaf800 1 --2- 172.21.15.87:0/2446488970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55762575ea40 0x5576258e5370 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.501+0000 7f610cfaf800 1 -- 172.21.15.87:0/2446488970 >> 172.21.15.87:0/2446488970 conn(0x5576257e5840 msgr2=0x5576258d78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.501+0000 7f610cfaf800 1 -- 172.21.15.87:0/2446488970 shutdown_connections 2024-05-08T18:32:22.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.501+0000 7f610cfaf800 1 -- 172.21.15.87:0/2446488970 wait complete. 2024-05-08T18:32:22.511 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-08T18:32:22.516 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:32:22.516 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-05-08T18:32:22.521 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:32:22.521 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-05-08T18:32:22.521 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-05-08T18:32:22.521 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-05-08T18:32:22.522 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-05-08T18:32:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:32:22.567 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:32:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.569+0000 7fc72ce62800 1 Processor -- start 2024-05-08T18:32:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.569+0000 7fc72ce62800 1 -- start start 2024-05-08T18:32:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.569+0000 7fc72ce62800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5581718416d0 0x55817184a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.569+0000 7fc72ce62800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5581717b4d90 con 0x55817183fb90 2024-05-08T18:32:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.569+0000 7fc72ce62800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5581716e1e20 con 0x5581718416d0 2024-05-08T18:32:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.569+0000 7fc723fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5581718416d0 0x55817184a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.570+0000 7fc723fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5581718416d0 0x55817184a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:43316/0 (socket says 172.21.15.87:43316) 2024-05-08T18:32:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.570+0000 7fc723fff640 1 -- 172.21.15.87:0/1300004071 learned_addr learned my addr 172.21.15.87:0/1300004071 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.570+0000 7fc72a95a640 1 --1- 172.21.15.87:0/1300004071 >> v1:172.21.15.53:6789/0 conn(0x55817183fb90 0x55817183ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:40524/0 (socket says 172.21.15.87:40524) 2024-05-08T18:32:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.570+0000 7fc723fff640 1 -- 172.21.15.87:0/1300004071 >> v1:172.21.15.53:6789/0 conn(0x55817183fb90 legacy=0x55817183ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.570+0000 7fc723fff640 1 -- 172.21.15.87:0/1300004071 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581717b4f60 con 0x5581718416d0 2024-05-08T18:32:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.572+0000 7fc723fff640 1 --2- 172.21.15.87:0/1300004071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581718416d0 0x55817184a1d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc71400a520 tx=0x7fc71401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec04d2b2b15ad66 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.572+0000 7fc72a159640 1 -- 172.21.15.87:0/1300004071 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc714057070 con 0x5581718416d0 2024-05-08T18:32:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.572+0000 7fc72a159640 1 -- 172.21.15.87:0/1300004071 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc714052570 con 0x5581718416d0 2024-05-08T18:32:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.572+0000 7fc72a159640 1 -- 172.21.15.87:0/1300004071 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc71404ae60 con 0x5581718416d0 2024-05-08T18:32:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.572+0000 7fc72ce62800 1 -- 172.21.15.87:0/1300004071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581718416d0 msgr2=0x55817184a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.572+0000 7fc72ce62800 1 --2- 172.21.15.87:0/1300004071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581718416d0 0x55817184a1d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc71400a520 tx=0x7fc71401d010 comp rx=0 tx=0).stop 2024-05-08T18:32:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.572+0000 7fc72ce62800 1 -- 172.21.15.87:0/1300004071 shutdown_connections 2024-05-08T18:32:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.572+0000 7fc72ce62800 1 --2- 172.21.15.87:0/1300004071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581718416d0 0x55817184a1d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.572+0000 7fc72ce62800 1 -- 172.21.15.87:0/1300004071 >> 172.21.15.87:0/1300004071 conn(0x55817183b6b0 msgr2=0x55817183db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.572+0000 7fc72ce62800 1 -- 172.21.15.87:0/1300004071 shutdown_connections 2024-05-08T18:32:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.572+0000 7fc72ce62800 1 -- 172.21.15.87:0/1300004071 wait complete. 2024-05-08T18:32:22.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.586+0000 7fc72ce62800 1 Processor -- start 2024-05-08T18:32:22.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.586+0000 7fc72ce62800 1 -- start start 2024-05-08T18:32:22.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.586+0000 7fc72ce62800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817183fb90 0x558171934860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.586+0000 7fc72ce62800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55817178c5c0 con 0x55817183fb90 2024-05-08T18:32:22.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.587+0000 7fc72a95a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817183fb90 0x558171934860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.587+0000 7fc72a95a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817183fb90 0x558171934860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:43318/0 (socket says 172.21.15.87:43318) 2024-05-08T18:32:22.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.587+0000 7fc72a95a640 1 -- 172.21.15.87:0/787603877 learned_addr learned my addr 172.21.15.87:0/787603877 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.587+0000 7fc72a95a640 1 -- 172.21.15.87:0/787603877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558171934e30 con 0x55817183fb90 2024-05-08T18:32:22.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.587+0000 7fc72a95a640 1 --2- 172.21.15.87:0/787603877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817183fb90 0x558171934860 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc71c001e90 tx=0x7fc71c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34445b34166eb1f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.587+0000 7fc618e09640 1 -- 172.21.15.87:0/787603877 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc71c00e5c0 con 0x55817183fb90 2024-05-08T18:32:22.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.587+0000 7fc618e09640 1 -- 172.21.15.87:0/787603877 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc71c006070 con 0x55817183fb90 2024-05-08T18:32:22.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.587+0000 7fc618e09640 1 -- 172.21.15.87:0/787603877 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc71c00e890 con 0x55817183fb90 2024-05-08T18:32:22.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.588+0000 7fc72ce62800 1 -- 172.21.15.87:0/787603877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817183fb90 msgr2=0x558171934860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.588+0000 7fc72ce62800 1 --2- 172.21.15.87:0/787603877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817183fb90 0x558171934860 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc71c001e90 tx=0x7fc71c00b6c0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.588+0000 7fc72ce62800 1 -- 172.21.15.87:0/787603877 shutdown_connections 2024-05-08T18:32:22.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.588+0000 7fc72ce62800 1 --2- 172.21.15.87:0/787603877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817183fb90 0x558171934860 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.588+0000 7fc72ce62800 1 -- 172.21.15.87:0/787603877 >> 172.21.15.87:0/787603877 conn(0x55817183b6b0 msgr2=0x558171930180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.588+0000 7fc72ce62800 1 -- 172.21.15.87:0/787603877 shutdown_connections 2024-05-08T18:32:22.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.588+0000 7fc72ce62800 1 -- 172.21.15.87:0/787603877 wait complete. 2024-05-08T18:32:22.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.588+0000 7fc72ce62800 1 Processor -- start 2024-05-08T18:32:22.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.588+0000 7fc72ce62800 1 -- start start 2024-05-08T18:32:22.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.589+0000 7fc72ce62800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817183fb90 0x55817193c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.589+0000 7fc72ce62800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55817184a9e0 con 0x55817183fb90 2024-05-08T18:32:22.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.589+0000 7fc72a95a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817183fb90 0x55817193c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.589+0000 7fc72a95a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817183fb90 0x55817193c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:43320/0 (socket says 172.21.15.87:43320) 2024-05-08T18:32:22.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.589+0000 7fc72a95a640 1 -- 172.21.15.87:0/3862098680 learned_addr learned my addr 172.21.15.87:0/3862098680 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.589+0000 7fc72a95a640 1 -- 172.21.15.87:0/3862098680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55817193c940 con 0x55817183fb90 2024-05-08T18:32:22.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.589+0000 7fc72a95a640 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817183fb90 0x55817193c400 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc71c00c010 tx=0x7fc71c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.590+0000 7fc617606640 1 -- 172.21.15.87:0/3862098680 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc71c00f8d0 con 0x55817183fb90 2024-05-08T18:32:22.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.590+0000 7fc617606640 1 -- 172.21.15.87:0/3862098680 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc71c00fa90 con 0x55817183fb90 2024-05-08T18:32:22.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.590+0000 7fc72ce62800 1 -- 172.21.15.87:0/3862098680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55817193cbd0 con 0x55817183fb90 2024-05-08T18:32:22.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.590+0000 7fc617606640 1 -- 172.21.15.87:0/3862098680 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc71c00fdb0 con 0x55817183fb90 2024-05-08T18:32:22.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.590+0000 7fc72ce62800 1 -- 172.21.15.87:0/3862098680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55817193f880 con 0x55817183fb90 2024-05-08T18:32:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.591+0000 7fc617606640 1 -- 172.21.15.87:0/3862098680 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc71c017070 con 0x55817183fb90 2024-05-08T18:32:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.591+0000 7fc617606640 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc61003bb50 0x7fc61003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.591+0000 7fc617606640 1 -- 172.21.15.87:0/3862098680 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fc71c015020 con 0x55817183fb90 2024-05-08T18:32:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.591+0000 7fc723fff640 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc61003bb50 0x7fc61003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.591+0000 7fc72ce62800 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5581718416d0 0x558171943640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.591+0000 7fc72ce62800 1 -- 172.21.15.87:0/3862098680 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171943bc0 con 0x5581718416d0 2024-05-08T18:32:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.591+0000 7fc72b15b640 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5581718416d0 0x558171943640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.591+0000 7fc723fff640 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc61003bb50 0x7fc61003e010 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc714054000 tx=0x7fc71404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.592+0000 7fc72b15b640 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5581718416d0 0x558171943640 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.592+0000 7fc72b15b640 1 -- 172.21.15.87:0/3862098680 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc72400a4a0 con 0x5581718416d0 2024-05-08T18:32:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.592+0000 7fc72ce62800 1 -- 172.21.15.87:0/3862098680 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171940c10 con 0x5581718416d0 2024-05-08T18:32:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.592+0000 7fc72b15b640 1 -- 172.21.15.87:0/3862098680 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc72400a4a0 con 0x5581718416d0 2024-05-08T18:32:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.592+0000 7fc72ce62800 1 -- 172.21.15.87:0/3862098680 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171945a10 con 0x5581718416d0 2024-05-08T18:32:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.592+0000 7fc72b15b640 1 -- 172.21.15.87:0/3862098680 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc72400a4a0 con 0x5581718416d0 2024-05-08T18:32:22.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.592+0000 7fc72ce62800 1 -- 172.21.15.87:0/3862098680 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171944b50 con 0x5581718416d0 2024-05-08T18:32:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.593+0000 7fc72b15b640 1 -- 172.21.15.87:0/3862098680 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc72400a4a0 con 0x5581718416d0 2024-05-08T18:32:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.593+0000 7fc72ce62800 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558171945620 0x558171948e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.593+0000 7fc72ce62800 1 -- 172.21.15.87:0/3862098680 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719495f0 con 0x558171945620 2024-05-08T18:32:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.593+0000 7fc72a95a640 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558171945620 0x558171948e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.593+0000 7fc72a95a640 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558171945620 0x558171948e60 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.594+0000 7fc72a95a640 1 -- 172.21.15.87:0/3862098680 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc71c02e070 con 0x558171945620 2024-05-08T18:32:22.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.594+0000 7fc72ce62800 1 Processor -- start 2024-05-08T18:32:22.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.594+0000 7fc72ce62800 1 -- start start 2024-05-08T18:32:22.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.594+0000 7fc72ce62800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171957940 0x558171957d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.594+0000 7fc72ce62800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558171732fc0 con 0x558171957940 2024-05-08T18:32:22.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.595+0000 7fc72b15b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171957940 0x558171957d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.595+0000 7fc72b15b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171957940 0x558171957d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:43332/0 (socket says 172.21.15.87:43332) 2024-05-08T18:32:22.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.595+0000 7fc72b15b640 1 -- 172.21.15.87:0/2445455571 learned_addr learned my addr 172.21.15.87:0/2445455571 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.595+0000 7fc72b15b640 1 -- 172.21.15.87:0/2445455571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581719582a0 con 0x558171957940 2024-05-08T18:32:22.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.595+0000 7fc72b15b640 1 --2- 172.21.15.87:0/2445455571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171957940 0x558171957d60 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x558171943f80 tx=0x7fc7240178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.595+0000 7fc614e01640 1 -- 172.21.15.87:0/2445455571 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc724013440 con 0x558171957940 2024-05-08T18:32:22.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.595+0000 7fc614e01640 1 -- 172.21.15.87:0/2445455571 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7240135e0 con 0x558171957940 2024-05-08T18:32:22.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.595+0000 7fc72ce62800 1 -- 172.21.15.87:0/2445455571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558171958d10 con 0x558171957940 2024-05-08T18:32:22.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.595+0000 7fc614e01640 1 -- 172.21.15.87:0/2445455571 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7240138c0 con 0x558171957940 2024-05-08T18:32:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.595+0000 7fc72ce62800 1 -- 172.21.15.87:0/2445455571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558171959210 con 0x558171957940 2024-05-08T18:32:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.596+0000 7fc614e01640 1 -- 172.21.15.87:0/2445455571 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc724011040 con 0x558171957940 2024-05-08T18:32:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.596+0000 7fc614e01640 1 --2- 172.21.15.87:0/2445455571 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc60403bb50 0x7fc60403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.596+0000 7fc614e01640 1 -- 172.21.15.87:0/2445455571 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fc72401d070 con 0x558171957940 2024-05-08T18:32:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.596+0000 7fc72a95a640 1 --2- 172.21.15.87:0/2445455571 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc60403bb50 0x7fc60403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.597+0000 7fc72ce62800 1 Processor -- start 2024-05-08T18:32:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.597+0000 7fc72ce62800 1 -- start start 2024-05-08T18:32:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.597+0000 7fc72a95a640 1 --2- 172.21.15.87:0/2445455571 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc60403bb50 0x7fc60403e010 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc71c051950 tx=0x7fc71c021fb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.597+0000 7fc72ce62800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171964c40 0x558171965060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.597+0000 7fc72ce62800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5581719351b0 con 0x558171964c40 2024-05-08T18:32:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.597+0000 7fc72b15b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171964c40 0x558171965060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.597+0000 7fc72b15b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171964c40 0x558171965060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:43338/0 (socket says 172.21.15.87:43338) 2024-05-08T18:32:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.597+0000 7fc72b15b640 1 -- 172.21.15.87:0/723328048 learned_addr learned my addr 172.21.15.87:0/723328048 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.597+0000 7fc72b15b640 1 -- 172.21.15.87:0/723328048 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558171965630 con 0x558171964c40 2024-05-08T18:32:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.598+0000 7fc72b15b640 1 --2- 172.21.15.87:0/723328048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171964c40 0x558171965060 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc7240529e0 tx=0x7fc724021de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509c0f81290cd792 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.598+0000 7fc60e7fc640 1 -- 172.21.15.87:0/723328048 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc724015430 con 0x558171964c40 2024-05-08T18:32:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.598+0000 7fc60e7fc640 1 -- 172.21.15.87:0/723328048 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc724001310 con 0x558171964c40 2024-05-08T18:32:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.598+0000 7fc60e7fc640 1 -- 172.21.15.87:0/723328048 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7240155d0 con 0x558171964c40 2024-05-08T18:32:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.598+0000 7fc72ce62800 1 -- 172.21.15.87:0/723328048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171964c40 msgr2=0x558171965060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.598+0000 7fc72ce62800 1 --2- 172.21.15.87:0/723328048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171964c40 0x558171965060 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc7240529e0 tx=0x7fc724021de0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.598+0000 7fc72ce62800 1 -- 172.21.15.87:0/723328048 shutdown_connections 2024-05-08T18:32:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.598+0000 7fc72ce62800 1 --2- 172.21.15.87:0/723328048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171964c40 0x558171965060 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.598+0000 7fc72ce62800 1 -- 172.21.15.87:0/723328048 >> 172.21.15.87:0/723328048 conn(0x558171960f50 msgr2=0x55817195f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.598+0000 7fc72ce62800 1 -- 172.21.15.87:0/723328048 shutdown_connections 2024-05-08T18:32:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.598+0000 7fc72ce62800 1 -- 172.21.15.87:0/723328048 wait complete. 2024-05-08T18:32:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.598+0000 7fc72ce62800 1 Processor -- start 2024-05-08T18:32:22.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.599+0000 7fc72ce62800 1 -- start start 2024-05-08T18:32:22.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.599+0000 7fc72ce62800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171964c40 0x55817196c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.599+0000 7fc72ce62800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558171965e00 con 0x558171964c40 2024-05-08T18:32:22.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.599+0000 7fc72b15b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171964c40 0x55817196c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.599+0000 7fc72b15b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171964c40 0x55817196c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:43342/0 (socket says 172.21.15.87:43342) 2024-05-08T18:32:22.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.599+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 learned_addr learned my addr 172.21.15.87:0/441718575 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.599+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55817196c690 con 0x558171964c40 2024-05-08T18:32:22.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.599+0000 7fc72b15b640 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171964c40 0x55817196c150 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc724052910 tx=0x7fc724052940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.599+0000 7fc60cff9640 1 -- 172.21.15.87:0/441718575 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc724030020 con 0x558171964c40 2024-05-08T18:32:22.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.599+0000 7fc60cff9640 1 -- 172.21.15.87:0/441718575 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7240515e0 con 0x558171964c40 2024-05-08T18:32:22.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.599+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55817196c920 con 0x558171964c40 2024-05-08T18:32:22.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.599+0000 7fc60cff9640 1 -- 172.21.15.87:0/441718575 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc724013e30 con 0x558171964c40 2024-05-08T18:32:22.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.600+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55817196f5d0 con 0x558171964c40 2024-05-08T18:32:22.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.600+0000 7fc60cff9640 1 -- 172.21.15.87:0/441718575 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc724033020 con 0x558171964c40 2024-05-08T18:32:22.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.601+0000 7fc60cff9640 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc5f403bba0 0x7fc5f403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.601+0000 7fc60cff9640 1 -- 172.21.15.87:0/441718575 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fc72400e040 con 0x558171964c40 2024-05-08T18:32:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.601+0000 7fc72a95a640 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc5f403bba0 0x7fc5f403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.601+0000 7fc72ce62800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.601+0000 7fc72a95a640 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc5f403bba0 0x7fc5f403e060 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5581719499f0 tx=0x7fc71c042000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.601+0000 7fc72ce62800 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558171977e40 0x55817197a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.601+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55817197aa50 con 0x558171977e40 2024-05-08T18:32:22.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.601+0000 7fc723fff640 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558171977e40 0x55817197a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.601+0000 7fc723fff640 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558171977e40 0x55817197a300 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc72ce62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc72ce62800 20 realm 2024-05-08T18:32:22.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc72ce62800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55817197ae20 con 0x558171977e40 2024-05-08T18:32:22.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc72ce62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc72ce62800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:32:22.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc72ce62800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55817197b6f0 con 0x558171977e40 2024-05-08T18:32:22.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc72ce62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc72ce62800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55817197ba90 con 0x558171977e40 2024-05-08T18:32:22.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc72ce62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:22.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc72ce62800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.602+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55817197c2e0 con 0x558171977e40 2024-05-08T18:32:22.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.603+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.603+0000 7fc72ce62800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:32:22.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.603+0000 7fc72ce62800 20 searching for the correct realm 2024-05-08T18:32:22.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.603+0000 7fc72ce62800 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55817197e050 0x558171980440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.603+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x55817197e050 2024-05-08T18:32:22.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.603+0000 7fc72b15b640 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55817197e050 0x558171980440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.603+0000 7fc72b15b640 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55817197e050 0x558171980440 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.603+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.603+0000 7fc72b15b640 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc724035020 0x7fc7240409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.603+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x7fc724035020 2024-05-08T18:32:22.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.604+0000 7fc72a95a640 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc724035020 0x7fc7240409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.604+0000 7fc72a95a640 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc724035020 0x7fc7240409b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.604+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.604+0000 7fc72a95a640 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc71c00f070 0x7fc71c04a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.604+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x7fc71c00f070 2024-05-08T18:32:22.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.604+0000 7fc723fff640 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc71c00f070 0x7fc71c04a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.605+0000 7fc723fff640 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc71c00f070 0x7fc71c04a760 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.605+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.605+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x558171977e40 2024-05-08T18:32:22.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.605+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.605+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x558171977e40 2024-05-08T18:32:22.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.606+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.606+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x7fc71c00f070 2024-05-08T18:32:22.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.606+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.606+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x7fc71c00f070 2024-05-08T18:32:22.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.606+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.606+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x7fc724035020 2024-05-08T18:32:22.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.606+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.606+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x55817197e050 2024-05-08T18:32:22.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.607+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.607+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x558171977e40 2024-05-08T18:32:22.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.607+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.607+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x7fc71c00f070 2024-05-08T18:32:22.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.607+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.607+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x558171977e40 2024-05-08T18:32:22.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.607+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.607+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x7fc724035020 2024-05-08T18:32:22.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.608+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.608+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x55817197e050 2024-05-08T18:32:22.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.608+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.608+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x55817197e050 2024-05-08T18:32:22.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.608+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.608+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x7fc71c00f070 2024-05-08T18:32:22.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.608+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.608+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x55817197e050 2024-05-08T18:32:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.609+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.609+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x55817197e050 2024-05-08T18:32:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.609+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.609+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x558171977e40 2024-05-08T18:32:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.609+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.609+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x558171977e40 2024-05-08T18:32:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.609+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.609+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x7fc71c00f070 2024-05-08T18:32:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.610+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.610+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x55817197e050 2024-05-08T18:32:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.610+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.610+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x7fc724035020 2024-05-08T18:32:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.610+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.610+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x558171977e40 2024-05-08T18:32:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.610+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.610+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x7fc71c00f070 2024-05-08T18:32:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.611+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.611+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x55817197e050 2024-05-08T18:32:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.611+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.611+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x7fc724035020 2024-05-08T18:32:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.611+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.611+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x7fc724035020 2024-05-08T18:32:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.612+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.612+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x55817197e050 2024-05-08T18:32:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.612+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.612+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x7fc724035020 2024-05-08T18:32:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.612+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.612+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x558171977e40 2024-05-08T18:32:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.612+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.612+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5581719809d0 con 0x7fc724035020 2024-05-08T18:32:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.613+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.613+0000 7fc72ce62800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:32:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.613+0000 7fc72ce62800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:32:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.613+0000 7fc72ce62800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:32:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.613+0000 7fc72ce62800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:32:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.613+0000 7fc72ce62800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:32:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.613+0000 7fc72ce62800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:32:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.613+0000 7fc72ce62800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.613+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55817197cc30 con 0x558171977e40 2024-05-08T18:32:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.613+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.613+0000 7fc72ce62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.613+0000 7fc72ce62800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.613+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55817197d4d0 con 0x558171977e40 2024-05-08T18:32:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.613+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.613+0000 7fc72ce62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.613+0000 7fc72ce62800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.613+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171980e50 con 0x7fc71c00f070 2024-05-08T18:32:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.614+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.614+0000 7fc72ce62800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:32:22.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.614+0000 7fc72ce62800 20 zone default found 2024-05-08T18:32:22.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.614+0000 7fc72ce62800 4 Realm: () 2024-05-08T18:32:22.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.614+0000 7fc72ce62800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:32:22.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.614+0000 7fc72ce62800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:32:22.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.614+0000 7fc72ce62800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:32:22.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.614+0000 7fc72ce62800 20 zonegroup default 2024-05-08T18:32:22.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.614+0000 7fc72ce62800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.614+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171981300 con 0x7fc71c00f070 2024-05-08T18:32:22.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.614+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.614+0000 7fc72ce62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.614+0000 7fc72ce62800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.614+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171982ce0 con 0x55817197e050 2024-05-08T18:32:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.615+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.615+0000 7fc72ce62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.615+0000 7fc72ce62800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.615+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171983170 con 0x55817197e050 2024-05-08T18:32:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.615+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.615+0000 7fc72ce62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.615+0000 7fc72ce62800 20 started sync module instance, tier type = 2024-05-08T18:32:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.615+0000 7fc72ce62800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:32:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.615+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171982170 con 0x7fc724035020 2024-05-08T18:32:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.616+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.616+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94014444938592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171983a80 con 0x7fc724035020 2024-05-08T18:32:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.616+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719842d0 con 0x558171977e40 2024-05-08T18:32:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.617+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94014444938592] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.618+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.618+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94014444942800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171984330 con 0x558171977e40 2024-05-08T18:32:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.618+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171984e40 con 0x55817197e050 2024-05-08T18:32:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.619+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94014444942800] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.619+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.619+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94014444947696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171985230 con 0x55817197e050 2024-05-08T18:32:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.619+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171985c30 con 0x7fc724035020 2024-05-08T18:32:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.620+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.620+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94014444951360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719864d0 con 0x7fc724035020 2024-05-08T18:32:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.620+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171986fb0 con 0x558171977e40 2024-05-08T18:32:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.620+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94014444947696] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.621+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94014444951360] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.621+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.621+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94014444953632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171983e20 con 0x558171977e40 2024-05-08T18:32:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.621+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171987850 con 0x7fc71c00f070 2024-05-08T18:32:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.622+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94014444953632] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.622+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.622+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94014444956352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171987800 con 0x7fc71c00f070 2024-05-08T18:32:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.622+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171988200 con 0x7fc71c00f070 2024-05-08T18:32:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.623+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94014444956352] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.623+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.624+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94014444961040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719883e0 con 0x7fc71c00f070 2024-05-08T18:32:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.624+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171988c30 con 0x7fc71c00f070 2024-05-08T18:32:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.624+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94014444961040] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.624+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.625+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94014444962784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171988cb0 con 0x7fc71c00f070 2024-05-08T18:32:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.625+0000 7fc72ce62800 20 add_watcher() i=0 2024-05-08T18:32:22.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.625+0000 7fc72ce62800 20 add_watcher() i=1 2024-05-08T18:32:22.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.625+0000 7fc72ce62800 20 add_watcher() i=2 2024-05-08T18:32:22.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.625+0000 7fc72ce62800 20 add_watcher() i=3 2024-05-08T18:32:22.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.625+0000 7fc72ce62800 20 add_watcher() i=4 2024-05-08T18:32:22.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.625+0000 7fc72ce62800 20 add_watcher() i=5 2024-05-08T18:32:22.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.625+0000 7fc72ce62800 20 add_watcher() i=6 2024-05-08T18:32:22.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.626+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94014444962784] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.626+0000 7fc72ce62800 20 add_watcher() i=7 2024-05-08T18:32:22.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.626+0000 7fc72ce62800 2 all 8 watchers are set, enabling cache 2024-05-08T18:32:22.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.626+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55817198bfd0 con 0x558171977e40 2024-05-08T18:32:22.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.626+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.626+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94014444964208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171989240 con 0x558171977e40 2024-05-08T18:32:22.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.627+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94014444964208] v29'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.627+0000 7fc5e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:22.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.627+0000 7fc72ce62800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:32:22.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.627+0000 7fc72ce62800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:32:22.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.627+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55817198b730 con 0x558171977e40 2024-05-08T18:32:22.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.629+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.629+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171995090 con 0x7fc71c00f070 2024-05-08T18:32:22.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.630+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.630+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171995540 con 0x55817197e050 2024-05-08T18:32:22.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.631+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.631+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171995540 con 0x558171977e40 2024-05-08T18:32:22.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.632+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'220 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.632+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171995ab0 con 0x7fc724035020 2024-05-08T18:32:22.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.633+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.633+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171995e50 con 0x55817197e050 2024-05-08T18:32:22.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.634+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.634+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996460 con 0x558171977e40 2024-05-08T18:32:22.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.635+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.635+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996460 con 0x7fc71c00f070 2024-05-08T18:32:22.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.636+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.636+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996460 con 0x7fc724035020 2024-05-08T18:32:22.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.637+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.637+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996460 con 0x55817197e050 2024-05-08T18:32:22.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.638+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.638+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171995090 con 0x7fc724035020 2024-05-08T18:32:22.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.639+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.639+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171995090 con 0x7fc71c00f070 2024-05-08T18:32:22.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.640+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.640+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171995090 con 0x7fc724035020 2024-05-08T18:32:22.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.641+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.641+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171995090 con 0x7fc71c00f070 2024-05-08T18:32:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.642+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.642+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171995090 con 0x558171977e40 2024-05-08T18:32:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.643+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'221 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.643+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171995090 con 0x55817197e050 2024-05-08T18:32:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.645+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'62 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.645+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996860 con 0x7fc724035020 2024-05-08T18:32:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.646+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.646+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996860 con 0x55817197e050 2024-05-08T18:32:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.647+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.647+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996860 con 0x558171977e40 2024-05-08T18:32:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.648+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.648+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996860 con 0x558171977e40 2024-05-08T18:32:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.649+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'222 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.649+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996860 con 0x55817197e050 2024-05-08T18:32:22.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.650+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'63 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.650+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996860 con 0x7fc724035020 2024-05-08T18:32:22.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.651+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.651+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996860 con 0x55817197e050 2024-05-08T18:32:22.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.652+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.652+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996860 con 0x55817197e050 2024-05-08T18:32:22.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.653+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.653+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996860 con 0x55817197e050 2024-05-08T18:32:22.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.654+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'24 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.654+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996860 con 0x55817197e050 2024-05-08T18:32:22.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.655+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'47 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.655+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996860 con 0x7fc71c00f070 2024-05-08T18:32:22.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.656+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.656+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996860 con 0x55817197e050 2024-05-08T18:32:22.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.657+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.657+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996860 con 0x7fc71c00f070 2024-05-08T18:32:22.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.658+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.658+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996860 con 0x55817197e050 2024-05-08T18:32:22.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.659+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'64 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.659+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996860 con 0x7fc71c00f070 2024-05-08T18:32:22.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.660+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.660+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171996860 con 0x7fc724035020 2024-05-08T18:32:22.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.661+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.662+0000 7fc55bfff640 20 reqs_thread_entry: start 2024-05-08T18:32:22.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.662+0000 7fc72ce62800 20 init_complete bucket index max shards: 11 2024-05-08T18:32:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.662+0000 7fc72ce62800 20 Filter name: none 2024-05-08T18:32:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.662+0000 7fc559ffb640 20 reqs_thread_entry: start 2024-05-08T18:32:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.662+0000 7fc72ce62800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-08T18:32:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.662+0000 7fc72ce62800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.662+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719c15c0 con 0x7fc724035020 2024-05-08T18:32:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.662+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 20 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.662+0000 7fc72ce62800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:32:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.662+0000 7fc72ce62800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-05-08T18:32:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.662+0000 7fc72ce62800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:32:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.662+0000 7fc72ce62800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:32:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.662+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719c3ef0 con 0x558171977e40 2024-05-08T18:32:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.663+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.663+0000 7fc72ce62800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 : miss 2024-05-08T18:32:22.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.663+0000 7fc72ce62800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.663+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:96 8.9 8:92df33a4:root::.bucket.meta.myfoo6%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719c3df0 con 0x7fc724035020 2024-05-08T18:32:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.663+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 21 ==== osd_op_reply(96 .bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv46 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.663+0000 7fc72ce62800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:32:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.663+0000 7fc72ce62800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 info.flags=0x17 2024-05-08T18:32:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.663+0000 7fc72ce62800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 to cache LRU end 2024-05-08T18:32:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.663+0000 7fc72ce62800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:32:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.663+0000 7fc72ce62800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T18:32:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.663+0000 7fc72ce62800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 2024-05-08T18:32:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.663+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:97 4.1e 4:7b415115:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171a41300 con 0x7fc71c00f070 2024-05-08T18:32:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.664+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(97 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.664+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:98 4.16 4:6a8df259:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171a41300 con 0x55817197e050 2024-05-08T18:32:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.664+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(98 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.664+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:99 4.1a 4:5b420c27:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171a41300 con 0x7fc724035020 2024-05-08T18:32:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.665+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 22 ==== osd_op_reply(99 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.665+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:100 4.c 4:330988d5:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171a41850 con 0x558171977e40 2024-05-08T18:32:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.665+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(100 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.665+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:101 4.4 4:2127f00f:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171a41850 con 0x7fc71c00f070 2024-05-08T18:32:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.665+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(101 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.4 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.665+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:102 4.1d 4:bbf255d6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171a41850 con 0x55817197e050 2024-05-08T18:32:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.666+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 27 ==== osd_op_reply(102 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.666+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:103 4.37 4:ee670e45:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171a41850 con 0x7fc71c00f070 2024-05-08T18:32:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.666+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(103 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.666+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:104 4.25 4:a5cd330b:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171a41850 con 0x55817197e050 2024-05-08T18:32:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.666+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 28 ==== osd_op_reply(104 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.666+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:105 4.3d 4:be5fd071:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171a41850 con 0x55817197e050 2024-05-08T18:32:22.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.667+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 29 ==== osd_op_reply(105 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc724051020 con 0x55817197e050 2024-05-08T18:32:22.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.667+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:106 4.9 4:90dc4ef6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171a41850 con 0x558171977e40 2024-05-08T18:32:22.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.667+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(106 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9 [call out=289b] v0'0 uv5 ondisk = 0) ==== 194+0+289 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.667+0000 7fc72ce62800 10 cls_bucket_list_unordered: got thirteen 2024-05-08T18:32:22.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.667+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:107 4.33 4:ce4dc589:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171a41850 con 0x7fc71c00f070 2024-05-08T18:32:22.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.667+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(107 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.667+0000 7fc72ce62800 20 get_obj_state: octx=0x7fc714052ae0 obj=myfoo6:thirteen state=0x558171a3f578 s->prefetch_data=0 2024-05-08T18:32:22.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.667+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:108 3.23s0 3:c5a3df2c:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558171a40580 con 0x7fc71c00f070 2024-05-08T18:32:22.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.668+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(108 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+835 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.668+0000 7fc72ce62800 10 manifest: total_size = 8 2024-05-08T18:32:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.668+0000 7fc72ce62800 20 get_obj_state: setting s->obj_tag to _d-e2pOSJudswo5lBwN-79fENU4cOCC8 2024-05-08T18:32:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.668+0000 7fc72ce62800 20 get_obj_state: octx=0x7fc714052ae0 obj=myfoo6:thirteen state=0x558171a3f578 s->prefetch_data=0 2024-05-08T18:32:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.668+0000 7fc72ce62800 20 prepare_atomic_modification: state is not atomic. state=0x558171a3f578 2024-05-08T18:32:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.668+0000 7fc72ce62800 20 bucket index object: :.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9 2024-05-08T18:32:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.668+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:109 4.9 4:90dc4ef6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171a40580 con 0x558171977e40 2024-05-08T18:32:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.669+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(109 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9 [stat,call,call] v29'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.669+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:110 3.23s0 3:c5a3df2c:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171a40580 con 0x7fc71c00f070 2024-05-08T18:32:22.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.670+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(110 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9_thirteen [call] v29'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.670+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:111 4.9 4:90dc4ef6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719c8a20 con 0x558171977e40 2024-05-08T18:32:22.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.671+0000 7fc72ce62800 20 list_objects_ordered: starting attempt 1 2024-05-08T18:32:22.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.671+0000 7fc72ce62800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-08T18:32:22.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.671+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:112 4.1e 4:7b415115:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719c8a20 con 0x7fc71c00f070 2024-05-08T18:32:22.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.671+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:113 4.16 4:6a8df259:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719ccc90 con 0x55817197e050 2024-05-08T18:32:22.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.671+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:114 4.1a 4:5b420c27:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719c8a20 con 0x7fc724035020 2024-05-08T18:32:22.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.671+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:115 4.c 4:330988d5:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719ccc90 con 0x558171977e40 2024-05-08T18:32:22.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.671+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 29 ==== osd_op_reply(112 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.671+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:116 4.4 4:2127f00f:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719d1aa0 con 0x7fc71c00f070 2024-05-08T18:32:22.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.671+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:117 4.1d 4:bbf255d6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719d44f0 con 0x55817197e050 2024-05-08T18:32:22.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.671+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:118 4.37 4:ee670e45:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719d44f0 con 0x7fc71c00f070 2024-05-08T18:32:22.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.671+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:119 4.25 4:a5cd330b:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719d9840 con 0x55817197e050 2024-05-08T18:32:22.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.671+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:120 4.3d 4:be5fd071:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719d9840 con 0x55817197e050 2024-05-08T18:32:22.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.671+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 23 ==== osd_op_reply(114 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.671+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 30 ==== osd_op_reply(113 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc72406e040 con 0x55817197e050 2024-05-08T18:32:22.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.671+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:121 4.9 4:90dc4ef6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719ce5c0 con 0x558171977e40 2024-05-08T18:32:22.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.671+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:122 4.33 4:ce4dc589:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719cf000 con 0x7fc71c00f070 2024-05-08T18:32:22.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.671+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 30 ==== osd_op_reply(116 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.4 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(115 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 31 ==== osd_op_reply(118 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 31 ==== osd_op_reply(117 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc72406e040 con 0x55817197e050 2024-05-08T18:32:22.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 32 ==== osd_op_reply(119 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc72406e040 con 0x55817197e050 2024-05-08T18:32:22.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 33 ==== osd_op_reply(120 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc72406e040 con 0x55817197e050 2024-05-08T18:32:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 32 ==== osd_op_reply(122 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 33 ==== osd_op_reply(111 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9 [stat,call,call] v29'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc60dffb640 20 handle_completion(): completion ok for obj=thirteen 2024-05-08T18:32:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 34 ==== osd_op_reply(121 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc72ce62800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-08T18:32:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc72ce62800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-08T18:32:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc72ce62800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-08T18:32:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc72ce62800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-08T18:32:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc72ce62800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9])"; uploads.size()=0; is_truncated=0 2024-05-08T18:32:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:123 4.1e 4:7b415115:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719ce110 con 0x7fc71c00f070 2024-05-08T18:32:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:124 4.16 4:6a8df259:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719cea40 con 0x55817197e050 2024-05-08T18:32:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:125 4.1a 4:5b420c27:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719cee60 con 0x7fc724035020 2024-05-08T18:32:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:126 4.c 4:330988d5:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719ce110 con 0x558171977e40 2024-05-08T18:32:22.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.672+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:127 4.4 4:2127f00f:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719d1ef0 con 0x7fc71c00f070 2024-05-08T18:32:22.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:128 4.1d 4:bbf255d6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719cea40 con 0x55817197e050 2024-05-08T18:32:22.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:129 4.37 4:ee670e45:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719ce110 con 0x7fc71c00f070 2024-05-08T18:32:22.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:130 4.25 4:a5cd330b:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719d1ef0 con 0x55817197e050 2024-05-08T18:32:22.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:131 4.3d 4:be5fd071:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719ce110 con 0x55817197e050 2024-05-08T18:32:22.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:132 4.9 4:90dc4ef6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719cea40 con 0x558171977e40 2024-05-08T18:32:22.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 33 ==== osd_op_reply(129 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 24 ==== osd_op_reply(125 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 34 ==== osd_op_reply(127 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.4 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 35 ==== osd_op_reply(123 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 34 ==== osd_op_reply(124 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc72406e040 con 0x55817197e050 2024-05-08T18:32:22.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 35 ==== osd_op_reply(128 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc72406e040 con 0x55817197e050 2024-05-08T18:32:22.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:133 4.33 4:ce4dc589:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719cee60 con 0x7fc71c00f070 2024-05-08T18:32:22.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 35 ==== osd_op_reply(126 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 36 ==== osd_op_reply(130 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc72406e040 con 0x55817197e050 2024-05-08T18:32:22.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 36 ==== osd_op_reply(132 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 37 ==== osd_op_reply(131 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc72406e040 con 0x55817197e050 2024-05-08T18:32:22.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 36 ==== osd_op_reply(133 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.673+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719cee60 con 0x558171977e40 2024-05-08T18:32:22.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.674+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 37 ==== osd_op_reply(134 bud.buckets [call] v29'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.674+0000 7fc72ce62800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-05-08T18:32:22.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.674+0000 7fc72ce62800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.674+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719cee60 con 0x558171977e40 2024-05-08T18:32:22.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.675+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 38 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.675+0000 7fc72ce62800 20 rados_obj.operate() r=0 bl.length=166 2024-05-08T18:32:22.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.675+0000 7fc72ce62800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-05-08T18:32:22.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.675+0000 7fc72ce62800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-08T18:32:22.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.675+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719cee60 con 0x558171977e40 2024-05-08T18:32:22.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.676+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 39 ==== osd_op_reply(136 myfoo6 [call,call,delete] v29'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.676+0000 7fc72ce62800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-05-08T18:32:22.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.676+0000 7fc72ce62800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-05-08T18:32:22.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.676+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94014445248864 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719cee60 con 0x7fc724035020 2024-05-08T18:32:22.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.676+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 25 ==== watch-notify(notify (1) cookie 94014444951360 notify 124554051625 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5581719c3330 con 0x7fc724035020 2024-05-08T18:32:22.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.676+0000 7fc60e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051625 cookie 94014444951360 notifier 4746 bl.length()=150 2024-05-08T18:32:22.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.676+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 26 ==== osd_op_reply(137 notify.3 [notify cookie 94014445248864 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.676+0000 7fc60e7fc640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fc5f0003d60 con 0x7fc724035020 2024-05-08T18:32:22.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.677+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 27 ==== watch-notify(notify_complete (2) cookie 94014445248864 notify 124554051625 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc71c05a040 con 0x7fc724035020 2024-05-08T18:32:22.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.677+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 28 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.677+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:139 8.9 8:92df33a4:root::.bucket.meta.myfoo6%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719cee60 con 0x7fc724035020 2024-05-08T18:32:22.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.678+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 29 ==== osd_op_reply(139 .bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 [call,call,delete] v29'48 uv48 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.678+0000 7fc72ce62800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 from cache 2024-05-08T18:32:22.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.678+0000 7fc72ce62800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9, ofs0, ns] 2024-05-08T18:32:22.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.678+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [notify cookie 94014445206880 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719cee60 con 0x7fc724035020 2024-05-08T18:32:22.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.678+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 30 ==== watch-notify(notify (1) cookie 94014444951360 notify 124554051626 ret 0) ==== 249+0+0 (crc 0 0 0) 0x7fc71c05a040 con 0x7fc724035020 2024-05-08T18:32:22.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.678+0000 7fc60dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051626 cookie 94014444951360 notifier 4746 bl.length()=207 2024-05-08T18:32:22.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.678+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 31 ==== osd_op_reply(140 notify.3 [notify cookie 94014445206880 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.678+0000 7fc60dffb640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:141 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fc5600032c0 con 0x7fc724035020 2024-05-08T18:32:22.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.678+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 32 ==== watch-notify(notify_complete (2) cookie 94014445206880 notify 124554051626 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55817193f880 con 0x7fc724035020 2024-05-08T18:32:22.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.678+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 33 ==== osd_op_reply(141 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.678+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:142 4.1e 4:7b415115:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719cee60 con 0x7fc71c00f070 2024-05-08T18:32:22.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.678+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:143 4.16 4:6a8df259:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719ce610 con 0x55817197e050 2024-05-08T18:32:22.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.678+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:144 4.1a 4:5b420c27:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719cd590 con 0x7fc724035020 2024-05-08T18:32:22.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.678+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:145 4.c 4:330988d5:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719cee60 con 0x558171977e40 2024-05-08T18:32:22.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.678+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:146 4.4 4:2127f00f:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171a3f330 con 0x7fc71c00f070 2024-05-08T18:32:22.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.678+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:147 4.1d 4:bbf255d6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719cd590 con 0x55817197e050 2024-05-08T18:32:22.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.679+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:148 4.37 4:ee670e45:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719cee60 con 0x7fc71c00f070 2024-05-08T18:32:22.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.679+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:149 4.25 4:a5cd330b:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171a3f330 con 0x55817197e050 2024-05-08T18:32:22.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.679+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:150 4.3d 4:be5fd071:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719ce610 con 0x55817197e050 2024-05-08T18:32:22.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.679+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:151 4.9 4:90dc4ef6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719cee60 con 0x558171977e40 2024-05-08T18:32:22.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.679+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:152 4.33 4:ce4dc589:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719d2850 con 0x7fc71c00f070 2024-05-08T18:32:22.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.680+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 34 ==== osd_op_reply(144 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.2 [delete] v29'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.680+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 38 ==== osd_op_reply(143 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.1 [delete] v29'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc72406e040 con 0x55817197e050 2024-05-08T18:32:22.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.680+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 40 ==== osd_op_reply(151 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.9 [delete] v29'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.680+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 39 ==== osd_op_reply(149 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.7 [delete] v29'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc72406e040 con 0x55817197e050 2024-05-08T18:32:22.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.683+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 40 ==== osd_op_reply(147 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.5 [delete] v29'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc72406e040 con 0x55817197e050 2024-05-08T18:32:22.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.683+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 41 ==== osd_op_reply(150 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.8 [delete] v29'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc72406e040 con 0x55817197e050 2024-05-08T18:32:22.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.683+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 41 ==== osd_op_reply(145 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.3 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.683+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 37 ==== osd_op_reply(152 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.10 [delete] v29'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.683+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 38 ==== osd_op_reply(146 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.4 [delete] v29'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.683+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 39 ==== osd_op_reply(148 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.6 [delete] v29'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.683+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 40 ==== osd_op_reply(142 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9.0 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.683+0000 7fc72ce62800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 : miss 2024-05-08T18:32:22.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.683+0000 7fc72ce62800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.683+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:153 6.b 6:d51e2a3b:::pubsub..bucket.myfoo6%2fbe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719cedd0 con 0x55817197e050 2024-05-08T18:32:22.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.684+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 42 ==== osd_op_reply(153 pubsub..bucket.myfoo6/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fc72406e040 con 0x55817197e050 2024-05-08T18:32:22.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.684+0000 7fc72ce62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.684+0000 7fc72ce62800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 info.flags=0x0 2024-05-08T18:32:22.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.684+0000 7fc72ce62800 10 adding default.rgw.log++pubsub..bucket.myfoo6/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 to cache LRU end 2024-05-08T18:32:22.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.684+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:154 6.b 6:d51e2a3b:::pubsub..bucket.myfoo6%2fbe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719cedd0 con 0x55817197e050 2024-05-08T18:32:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.685+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 43 ==== osd_op_reply(154 pubsub..bucket.myfoo6/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.9 [delete] v29'27 uv21 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fc72406e040 con 0x55817197e050 2024-05-08T18:32:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.685+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719cedd0 con 0x558171977e40 2024-05-08T18:32:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.686+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 42 ==== osd_op_reply(155 bud.buckets [call] v29'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.686+0000 7fc72ce62800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-05-08T18:32:22.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.687+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719cedd0 con 0x558171977e40 2024-05-08T18:32:22.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.688+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 43 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v29'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.688+0000 7fc72ce62800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-08T18:32:22.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.688+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94014445252048 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719d3d30 con 0x7fc71c00f070 2024-05-08T18:32:22.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.689+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 41 ==== watch-notify(notify (1) cookie 94014444956352 notify 124554051607 ret 0) ==== 212+0+0 (crc 0 0 0) 0x558171995860 con 0x7fc71c00f070 2024-05-08T18:32:22.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.689+0000 7fc60e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051607 cookie 94014444956352 notifier 4746 bl.length()=170 2024-05-08T18:32:22.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.689+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 42 ==== osd_op_reply(157 notify.5 [notify cookie 94014445252048 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.689+0000 7fc60e7fc640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fc5f0003d60 con 0x7fc71c00f070 2024-05-08T18:32:22.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.689+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 43 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.689+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 44 ==== watch-notify(notify_complete (2) cookie 94014445252048 notify 124554051607 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55817196f5d0 con 0x7fc71c00f070 2024-05-08T18:32:22.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.689+0000 7fc72ce62800 10 removing email index: 2024-05-08T18:32:22.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.689+0000 7fc72ce62800 10 removing user buckets index 2024-05-08T18:32:22.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.689+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719cedd0 con 0x558171977e40 2024-05-08T18:32:22.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.690+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 44 ==== osd_op_reply(159 bud.buckets [delete] v29'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.690+0000 7fc72ce62800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-05-08T18:32:22.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.690+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94014445252048 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719d3d30 con 0x7fc71c00f070 2024-05-08T18:32:22.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.690+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 45 ==== watch-notify(notify (1) cookie 94014444961040 notify 124554051608 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55817196f5d0 con 0x7fc71c00f070 2024-05-08T18:32:22.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.690+0000 7fc60e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051608 cookie 94014444961040 notifier 4746 bl.length()=160 2024-05-08T18:32:22.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.690+0000 7fc60e7fc640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fc5f0003d60 con 0x7fc71c00f070 2024-05-08T18:32:22.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.690+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 46 ==== osd_op_reply(160 notify.6 [notify cookie 94014445252048 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.691+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 47 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.691+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 48 ==== watch-notify(notify_complete (2) cookie 94014445252048 notify 124554051608 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55817198b8a0 con 0x7fc71c00f070 2024-05-08T18:32:22.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.691+0000 7fc72ce62800 10 removing user index: bud 2024-05-08T18:32:22.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.691+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581719cedd0 con 0x7fc724035020 2024-05-08T18:32:22.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.692+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 35 ==== osd_op_reply(162 bud [call,call,delete] v29'5 uv5 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.692+0000 7fc72ce62800 10 removing default.rgw.meta+users.uid+bud from cache 2024-05-08T18:32:22.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.692+0000 7fc72ce62800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-08T18:32:22.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.692+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94014445252048 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581719ce160 con 0x7fc71c00f070 2024-05-08T18:32:22.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.692+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 49 ==== watch-notify(notify (1) cookie 94014444956352 notify 124554051609 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55817198b8a0 con 0x7fc71c00f070 2024-05-08T18:32:22.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.692+0000 7fc60dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051609 cookie 94014444956352 notifier 4746 bl.length()=152 2024-05-08T18:32:22.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.692+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 50 ==== osd_op_reply(163 notify.5 [notify cookie 94014445252048 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.692+0000 7fc60dffb640 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fc5600032c0 con 0x7fc71c00f070 2024-05-08T18:32:22.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.693+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 51 ==== watch-notify(notify_complete (2) cookie 94014445252048 notify 124554051609 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55817198b220 con 0x7fc71c00f070 2024-05-08T18:32:22.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.693+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 52 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.693+0000 7fc5e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:22.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.693+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94014444964208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171991840 con 0x558171977e40 2024-05-08T18:32:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.694+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 45 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94014444964208] v29'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.694+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94014444938592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171991840 con 0x7fc724035020 2024-05-08T18:32:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.695+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 36 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94014444938592] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.695+0000 7fc72ce62800 20 remove_watcher() i=0 2024-05-08T18:32:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.695+0000 7fc72ce62800 2 removed watcher, disabling cache 2024-05-08T18:32:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.695+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94014444942800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171991840 con 0x558171977e40 2024-05-08T18:32:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.696+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 46 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94014444942800] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.696+0000 7fc72ce62800 20 remove_watcher() i=1 2024-05-08T18:32:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.697+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94014444947696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171991840 con 0x55817197e050 2024-05-08T18:32:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.697+0000 7fc72b15b640 1 -- 172.21.15.87:0/441718575 <== osd.3 v2:172.21.15.87:6800/2929215285 44 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94014444947696] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72406e040 con 0x55817197e050 2024-05-08T18:32:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.697+0000 7fc72ce62800 20 remove_watcher() i=2 2024-05-08T18:32:22.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.698+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94014444951360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171991840 con 0x7fc724035020 2024-05-08T18:32:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.698+0000 7fc72a95a640 1 -- 172.21.15.87:0/441718575 <== osd.2 v2:172.21.15.87:6816/2108501615 37 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94014444951360] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c044d70 con 0x7fc724035020 2024-05-08T18:32:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.698+0000 7fc72ce62800 20 remove_watcher() i=3 2024-05-08T18:32:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.699+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94014444953632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171991840 con 0x558171977e40 2024-05-08T18:32:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.700+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.1 v2:172.21.15.87:6808/2448644045 47 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94014444953632] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x558171977e40 2024-05-08T18:32:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.700+0000 7fc72ce62800 20 remove_watcher() i=4 2024-05-08T18:32:22.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.700+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94014444956352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171991840 con 0x7fc71c00f070 2024-05-08T18:32:22.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.701+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 53 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94014444956352] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.701+0000 7fc72ce62800 20 remove_watcher() i=5 2024-05-08T18:32:22.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.701+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94014444961040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171991840 con 0x7fc71c00f070 2024-05-08T18:32:22.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.702+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 54 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94014444961040] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.702+0000 7fc72ce62800 20 remove_watcher() i=6 2024-05-08T18:32:22.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.702+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94014444962784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558171991840 con 0x7fc71c00f070 2024-05-08T18:32:22.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.703+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 <== osd.0 v2:172.21.15.53:6800/443747735 55 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94014444962784] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71405a040 con 0x7fc71c00f070 2024-05-08T18:32:22.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.703+0000 7fc72ce62800 20 remove_watcher() i=7 2024-05-08T18:32:22.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.703+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc71c00f070 msgr2=0x7fc71c04a760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.703+0000 7fc72ce62800 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fc71c00f070 0x7fc71c04a760 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.703+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558171977e40 msgr2=0x55817197a300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.703+0000 7fc72ce62800 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558171977e40 0x55817197a300 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.703+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc724035020 msgr2=0x7fc7240409b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.703+0000 7fc72ce62800 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fc724035020 0x7fc7240409b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.703+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55817197e050 msgr2=0x558171980440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.703+0000 7fc72ce62800 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55817197e050 0x558171980440 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.703+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc5f403bba0 msgr2=0x7fc5f403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.703+0000 7fc72ce62800 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc5f403bba0 0x7fc5f403e060 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5581719499f0 tx=0x7fc71c042000 comp rx=0 tx=0).stop 2024-05-08T18:32:22.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.703+0000 7fc723fff640 1 -- 172.21.15.87:0/441718575 reap_dead start 2024-05-08T18:32:22.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.703+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171964c40 msgr2=0x55817196c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.703+0000 7fc72ce62800 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171964c40 0x55817196c150 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc724052910 tx=0x7fc724052940 comp rx=0 tx=0).stop 2024-05-08T18:32:22.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.703+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 shutdown_connections 2024-05-08T18:32:22.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 --2- 172.21.15.87:0/441718575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171964c40 0x55817196c150 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 >> 172.21.15.87:0/441718575 conn(0x558171960f50 msgr2=0x55817195e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 shutdown_connections 2024-05-08T18:32:22.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 -- 172.21.15.87:0/441718575 wait complete. 2024-05-08T18:32:22.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 -- 172.21.15.87:0/2445455571 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc60403bb50 msgr2=0x7fc60403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 --2- 172.21.15.87:0/2445455571 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc60403bb50 0x7fc60403e010 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc71c051950 tx=0x7fc71c021fb0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 -- 172.21.15.87:0/2445455571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171957940 msgr2=0x558171957d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 --2- 172.21.15.87:0/2445455571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171957940 0x558171957d60 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x558171943f80 tx=0x7fc7240178e0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 -- 172.21.15.87:0/2445455571 shutdown_connections 2024-05-08T18:32:22.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 --2- 172.21.15.87:0/2445455571 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc60403bb50 0x7fc60403e010 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 --2- 172.21.15.87:0/2445455571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558171957940 0x558171957d60 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 -- 172.21.15.87:0/2445455571 >> 172.21.15.87:0/2445455571 conn(0x55817194b9e0 msgr2=0x55817194bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 -- 172.21.15.87:0/2445455571 shutdown_connections 2024-05-08T18:32:22.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 -- 172.21.15.87:0/2445455571 wait complete. 2024-05-08T18:32:22.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 -- 172.21.15.87:0/3862098680 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558171945620 msgr2=0x558171948e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558171945620 0x558171948e60 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 -- 172.21.15.87:0/3862098680 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5581718416d0 msgr2=0x558171943640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5581718416d0 0x558171943640 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 -- 172.21.15.87:0/3862098680 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc61003bb50 msgr2=0x7fc61003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc61003bb50 0x7fc61003e010 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc714054000 tx=0x7fc71404e000 comp rx=0 tx=0).stop 2024-05-08T18:32:22.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 -- 172.21.15.87:0/3862098680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817183fb90 msgr2=0x55817193c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.704+0000 7fc72ce62800 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817183fb90 0x55817193c400 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc71c00c010 tx=0x7fc71c000ed0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.705+0000 7fc72ce62800 1 -- 172.21.15.87:0/3862098680 shutdown_connections 2024-05-08T18:32:22.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.705+0000 7fc72ce62800 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5581718416d0 0x558171943640 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.705+0000 7fc72ce62800 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558171945620 0x558171948e60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.705+0000 7fc72ce62800 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc61003bb50 0x7fc61003e010 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.705+0000 7fc72ce62800 1 --2- 172.21.15.87:0/3862098680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817183fb90 0x55817193c400 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.705+0000 7fc72ce62800 1 -- 172.21.15.87:0/3862098680 >> 172.21.15.87:0/3862098680 conn(0x55817183b6b0 msgr2=0x55817192e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.705+0000 7fc72ce62800 1 -- 172.21.15.87:0/3862098680 shutdown_connections 2024-05-08T18:32:22.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.705+0000 7fc72ce62800 1 -- 172.21.15.87:0/3862098680 wait complete. 2024-05-08T18:32:22.712 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-05-08T18:32:22.712 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-05-08T18:32:22.713 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-05-08T18:32:22.757 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:32:22.757 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:32:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.760+0000 7f8dc292b800 1 Processor -- start 2024-05-08T18:32:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.760+0000 7f8dc292b800 1 -- start start 2024-05-08T18:32:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.760+0000 7f8dc292b800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5606ea4db2c0 0x5606ea4db6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.760+0000 7f8dc292b800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5606ea4dbd60 con 0x5606ea4dc480 2024-05-08T18:32:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.760+0000 7f8dc292b800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5606ea37be20 con 0x5606ea4db2c0 2024-05-08T18:32:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.760+0000 7f8dbe54b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5606ea4db2c0 0x5606ea4db6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.760+0000 7f8dbdd4a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5606ea4dc480 0x5606ea4dc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:40538/0 (socket says 172.21.15.87:40538) 2024-05-08T18:32:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.760+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/2800387032 learned_addr learned my addr 172.21.15.87:0/2800387032 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:32:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.760+0000 7f8dbe54b640 1 -- 172.21.15.87:0/2800387032 >> v1:172.21.15.53:6789/0 conn(0x5606ea4dc480 legacy=0x5606ea4dc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.760+0000 7f8dbe54b640 1 -- 172.21.15.87:0/2800387032 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606ea4dd040 con 0x5606ea4db2c0 2024-05-08T18:32:22.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.762+0000 7f8dbe54b640 1 --2- 172.21.15.87:0/2800387032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 0x5606ea4db6e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8db000a470 tx=0x7f8db001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc067524a7d3a059 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.762+0000 7f8dbd549640 1 -- 172.21.15.87:0/2800387032 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db0057070 con 0x5606ea4db2c0 2024-05-08T18:32:22.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.762+0000 7f8dbd549640 1 -- 172.21.15.87:0/2800387032 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db004adc0 con 0x5606ea4db2c0 2024-05-08T18:32:22.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.762+0000 7f8dbd549640 1 -- 172.21.15.87:0/2800387032 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db0052590 con 0x5606ea4db2c0 2024-05-08T18:32:22.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.763+0000 7f8dc292b800 1 -- 172.21.15.87:0/2800387032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 msgr2=0x5606ea4db6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.763+0000 7f8dc292b800 1 --2- 172.21.15.87:0/2800387032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 0x5606ea4db6e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8db000a470 tx=0x7f8db001ce90 comp rx=0 tx=0).stop 2024-05-08T18:32:22.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.763+0000 7f8dc292b800 1 -- 172.21.15.87:0/2800387032 shutdown_connections 2024-05-08T18:32:22.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.763+0000 7f8dc292b800 1 --2- 172.21.15.87:0/2800387032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 0x5606ea4db6e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.763+0000 7f8dc292b800 1 -- 172.21.15.87:0/2800387032 >> 172.21.15.87:0/2800387032 conn(0x5606ea4d6840 msgr2=0x5606ea4d8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.763+0000 7f8dc292b800 1 -- 172.21.15.87:0/2800387032 shutdown_connections 2024-05-08T18:32:22.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.763+0000 7f8dc292b800 1 -- 172.21.15.87:0/2800387032 wait complete. 2024-05-08T18:32:22.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.777+0000 7f8dc292b800 1 Processor -- start 2024-05-08T18:32:22.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.777+0000 7f8dc292b800 1 -- start start 2024-05-08T18:32:22.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.777+0000 7f8dc292b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 0x5606ea450c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.777+0000 7f8dc292b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5606ea4265c0 con 0x5606ea4db2c0 2024-05-08T18:32:22.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.777+0000 7f8dbe54b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 0x5606ea450c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.777+0000 7f8dbe54b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 0x5606ea450c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:43356/0 (socket says 172.21.15.87:43356) 2024-05-08T18:32:22.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.777+0000 7f8dbe54b640 1 -- 172.21.15.87:0/2209974581 learned_addr learned my addr 172.21.15.87:0/2209974581 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.777+0000 7f8dbe54b640 1 -- 172.21.15.87:0/2209974581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606ea44f240 con 0x5606ea4db2c0 2024-05-08T18:32:22.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.778+0000 7f8dbe54b640 1 --2- 172.21.15.87:0/2209974581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 0x5606ea450c80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8db001ced0 tx=0x7f8db004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a28c9c76f20cde server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.778+0000 7f8cac608640 1 -- 172.21.15.87:0/2209974581 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db0057040 con 0x5606ea4db2c0 2024-05-08T18:32:22.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.778+0000 7f8cac608640 1 -- 172.21.15.87:0/2209974581 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db0063070 con 0x5606ea4db2c0 2024-05-08T18:32:22.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.778+0000 7f8cac608640 1 -- 172.21.15.87:0/2209974581 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db0052800 con 0x5606ea4db2c0 2024-05-08T18:32:22.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.779+0000 7f8dc292b800 1 -- 172.21.15.87:0/2209974581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 msgr2=0x5606ea450c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.779+0000 7f8dc292b800 1 --2- 172.21.15.87:0/2209974581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 0x5606ea450c80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8db001ced0 tx=0x7f8db004c000 comp rx=0 tx=0).stop 2024-05-08T18:32:22.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.779+0000 7f8dc292b800 1 -- 172.21.15.87:0/2209974581 shutdown_connections 2024-05-08T18:32:22.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.779+0000 7f8dc292b800 1 --2- 172.21.15.87:0/2209974581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 0x5606ea450c80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.779+0000 7f8dc292b800 1 -- 172.21.15.87:0/2209974581 >> 172.21.15.87:0/2209974581 conn(0x5606ea4d6840 msgr2=0x5606ea5c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.779+0000 7f8dc292b800 1 -- 172.21.15.87:0/2209974581 shutdown_connections 2024-05-08T18:32:22.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.779+0000 7f8dc292b800 1 -- 172.21.15.87:0/2209974581 wait complete. 2024-05-08T18:32:22.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.779+0000 7f8dc292b800 1 Processor -- start 2024-05-08T18:32:22.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.779+0000 7f8dc292b800 1 -- start start 2024-05-08T18:32:22.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.779+0000 7f8dc292b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 0x5606ea5d63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.779+0000 7f8dc292b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5606ea4e4950 con 0x5606ea4db2c0 2024-05-08T18:32:22.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.779+0000 7f8dbe54b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 0x5606ea5d63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.779+0000 7f8dbe54b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 0x5606ea5d63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:43368/0 (socket says 172.21.15.87:43368) 2024-05-08T18:32:22.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.779+0000 7f8dbe54b640 1 -- 172.21.15.87:0/3738477086 learned_addr learned my addr 172.21.15.87:0/3738477086 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.780+0000 7f8dbe54b640 1 -- 172.21.15.87:0/3738477086 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606ea5d68e0 con 0x5606ea4db2c0 2024-05-08T18:32:22.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.780+0000 7f8dbe54b640 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 0x5606ea5d63a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8db001ced0 tx=0x7f8db0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.780+0000 7f8caae05640 1 -- 172.21.15.87:0/3738477086 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db006d070 con 0x5606ea4db2c0 2024-05-08T18:32:22.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.780+0000 7f8caae05640 1 -- 172.21.15.87:0/3738477086 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db0052d20 con 0x5606ea4db2c0 2024-05-08T18:32:22.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.780+0000 7f8dc292b800 1 -- 172.21.15.87:0/3738477086 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606ea5d6b70 con 0x5606ea4db2c0 2024-05-08T18:32:22.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.780+0000 7f8caae05640 1 -- 172.21.15.87:0/3738477086 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db0057050 con 0x5606ea4db2c0 2024-05-08T18:32:22.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.780+0000 7f8dc292b800 1 -- 172.21.15.87:0/3738477086 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606ea5d97d0 con 0x5606ea4db2c0 2024-05-08T18:32:22.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.781+0000 7f8caae05640 1 -- 172.21.15.87:0/3738477086 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8db005d470 con 0x5606ea4db2c0 2024-05-08T18:32:22.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.781+0000 7f8caae05640 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8ca403bb50 0x7f8ca403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.781+0000 7f8caae05640 1 -- 172.21.15.87:0/3738477086 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f8db0094200 con 0x5606ea4db2c0 2024-05-08T18:32:22.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.781+0000 7f8dbdd4a640 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8ca403bb50 0x7f8ca403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.781+0000 7f8dc292b800 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5606ea4dc480 0x5606ea5dd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.781+0000 7f8dc292b800 1 -- 172.21.15.87:0/3738477086 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea5ddb10 con 0x5606ea4dc480 2024-05-08T18:32:22.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.782+0000 7f8dbed4c640 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5606ea4dc480 0x5606ea5dd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.782+0000 7f8dbdd4a640 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8ca403bb50 0x7f8ca403e010 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8db4000f60 tx=0x7f8db40012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.782+0000 7f8dbed4c640 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5606ea4dc480 0x5606ea5dd590 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.782+0000 7f8dbed4c640 1 -- 172.21.15.87:0/3738477086 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8db800a4a0 con 0x5606ea4dc480 2024-05-08T18:32:22.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.782+0000 7f8dc292b800 1 -- 172.21.15.87:0/3738477086 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea5dab60 con 0x5606ea4dc480 2024-05-08T18:32:22.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.782+0000 7f8dbed4c640 1 -- 172.21.15.87:0/3738477086 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8db800a4a0 con 0x5606ea4dc480 2024-05-08T18:32:22.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.782+0000 7f8dc292b800 1 -- 172.21.15.87:0/3738477086 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea5df930 con 0x5606ea4dc480 2024-05-08T18:32:22.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.783+0000 7f8dbed4c640 1 -- 172.21.15.87:0/3738477086 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8db800a4a0 con 0x5606ea4dc480 2024-05-08T18:32:22.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.783+0000 7f8dc292b800 1 -- 172.21.15.87:0/3738477086 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea5deb60 con 0x5606ea4dc480 2024-05-08T18:32:22.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.783+0000 7f8dbed4c640 1 -- 172.21.15.87:0/3738477086 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8db800a4a0 con 0x5606ea4dc480 2024-05-08T18:32:22.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.783+0000 7f8dc292b800 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5606ea5e0ce0 0x5606ea5e30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.783+0000 7f8dc292b800 1 -- 172.21.15.87:0/3738477086 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea5e3610 con 0x5606ea5e0ce0 2024-05-08T18:32:22.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.783+0000 7f8dbe54b640 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5606ea5e0ce0 0x5606ea5e30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.783+0000 7f8dbe54b640 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5606ea5e0ce0 0x5606ea5e30d0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.784+0000 7f8dbe54b640 1 -- 172.21.15.87:0/3738477086 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8db0078070 con 0x5606ea5e0ce0 2024-05-08T18:32:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.784+0000 7f8dc292b800 1 Processor -- start 2024-05-08T18:32:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.784+0000 7f8dc292b800 1 -- start start 2024-05-08T18:32:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.784+0000 7f8dc292b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5f1850 0x5606ea5f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.784+0000 7f8dc292b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5606ea3ccfc0 con 0x5606ea5f1850 2024-05-08T18:32:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.784+0000 7f8dbed4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5f1850 0x5606ea5f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.784+0000 7f8dbed4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5f1850 0x5606ea5f1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:43384/0 (socket says 172.21.15.87:43384) 2024-05-08T18:32:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.784+0000 7f8dbed4c640 1 -- 172.21.15.87:0/2139095134 learned_addr learned my addr 172.21.15.87:0/2139095134 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.785+0000 7f8dbed4c640 1 -- 172.21.15.87:0/2139095134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606ea5f21b0 con 0x5606ea5f1850 2024-05-08T18:32:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.785+0000 7f8dbed4c640 1 --2- 172.21.15.87:0/2139095134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5f1850 0x5606ea5f1c70 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x5606ea5d7750 tx=0x7f8db80178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.785+0000 7f8ca3fff640 1 -- 172.21.15.87:0/2139095134 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db8013440 con 0x5606ea5f1850 2024-05-08T18:32:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.785+0000 7f8ca3fff640 1 -- 172.21.15.87:0/2139095134 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db80135e0 con 0x5606ea5f1850 2024-05-08T18:32:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.785+0000 7f8dc292b800 1 -- 172.21.15.87:0/2139095134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606ea5f2c20 con 0x5606ea5f1850 2024-05-08T18:32:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.785+0000 7f8ca3fff640 1 -- 172.21.15.87:0/2139095134 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db80138c0 con 0x5606ea5f1850 2024-05-08T18:32:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.785+0000 7f8dc292b800 1 -- 172.21.15.87:0/2139095134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606ea5f3120 con 0x5606ea5f1850 2024-05-08T18:32:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.786+0000 7f8ca3fff640 1 -- 172.21.15.87:0/2139095134 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8db8011040 con 0x5606ea5f1850 2024-05-08T18:32:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.786+0000 7f8ca3fff640 1 --2- 172.21.15.87:0/2139095134 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8c9803bb50 0x7f8c9803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.786+0000 7f8ca3fff640 1 -- 172.21.15.87:0/2139095134 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f8db801d070 con 0x5606ea5f1850 2024-05-08T18:32:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.786+0000 7f8dbe54b640 1 --2- 172.21.15.87:0/2139095134 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8c9803bb50 0x7f8c9803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.786+0000 7f8dc292b800 1 Processor -- start 2024-05-08T18:32:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.787+0000 7f8dbe54b640 1 --2- 172.21.15.87:0/2139095134 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8c9803bb50 0x7f8c9803e010 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8db0092660 tx=0x7f8db00925d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.787+0000 7f8dc292b800 1 -- start start 2024-05-08T18:32:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.787+0000 7f8dc292b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5feb40 0x5606ea5fef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.787+0000 7f8dc292b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5606ea44f500 con 0x5606ea5feb40 2024-05-08T18:32:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.787+0000 7f8dbed4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5feb40 0x5606ea5fef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.787+0000 7f8dbed4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5feb40 0x5606ea5fef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:43400/0 (socket says 172.21.15.87:43400) 2024-05-08T18:32:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.787+0000 7f8dbed4c640 1 -- 172.21.15.87:0/2906454342 learned_addr learned my addr 172.21.15.87:0/2906454342 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.787+0000 7f8dbed4c640 1 -- 172.21.15.87:0/2906454342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606ea5ff530 con 0x5606ea5feb40 2024-05-08T18:32:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.787+0000 7f8dbed4c640 1 --2- 172.21.15.87:0/2906454342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5feb40 0x5606ea5fef60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8db80529a0 tx=0x7f8db8001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e05f33d79318b32 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.787+0000 7f8ca1ffb640 1 -- 172.21.15.87:0/2906454342 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db80014f0 con 0x5606ea5feb40 2024-05-08T18:32:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.787+0000 7f8ca1ffb640 1 -- 172.21.15.87:0/2906454342 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db8001690 con 0x5606ea5feb40 2024-05-08T18:32:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.787+0000 7f8ca1ffb640 1 -- 172.21.15.87:0/2906454342 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db80157b0 con 0x5606ea5feb40 2024-05-08T18:32:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.788+0000 7f8dc292b800 1 -- 172.21.15.87:0/2906454342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5feb40 msgr2=0x5606ea5fef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.788+0000 7f8dc292b800 1 --2- 172.21.15.87:0/2906454342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5feb40 0x5606ea5fef60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8db80529a0 tx=0x7f8db8001e60 comp rx=0 tx=0).stop 2024-05-08T18:32:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.788+0000 7f8dc292b800 1 -- 172.21.15.87:0/2906454342 shutdown_connections 2024-05-08T18:32:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.788+0000 7f8dc292b800 1 --2- 172.21.15.87:0/2906454342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5feb40 0x5606ea5fef60 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.788+0000 7f8dc292b800 1 -- 172.21.15.87:0/2906454342 >> 172.21.15.87:0/2906454342 conn(0x5606ea5faef0 msgr2=0x5606ea5f8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.788+0000 7f8dc292b800 1 -- 172.21.15.87:0/2906454342 shutdown_connections 2024-05-08T18:32:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.788+0000 7f8dc292b800 1 -- 172.21.15.87:0/2906454342 wait complete. 2024-05-08T18:32:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.788+0000 7f8dc292b800 1 Processor -- start 2024-05-08T18:32:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.788+0000 7f8dc292b800 1 -- start start 2024-05-08T18:32:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.788+0000 7f8dc292b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5feb40 0x5606ea6060c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.788+0000 7f8dc292b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5606ea5ffc90 con 0x5606ea5feb40 2024-05-08T18:32:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.788+0000 7f8dbed4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5feb40 0x5606ea6060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.788+0000 7f8dbed4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5feb40 0x5606ea6060c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:43408/0 (socket says 172.21.15.87:43408) 2024-05-08T18:32:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.788+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 learned_addr learned my addr 172.21.15.87:0/4195299977 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:32:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.789+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606ea606600 con 0x5606ea5feb40 2024-05-08T18:32:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.789+0000 7f8dbed4c640 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5feb40 0x5606ea6060c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8db8015fd0 tx=0x7f8db8052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.789+0000 7f8c8ffff640 1 -- 172.21.15.87:0/4195299977 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db8030020 con 0x5606ea5feb40 2024-05-08T18:32:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.789+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606ea606890 con 0x5606ea5feb40 2024-05-08T18:32:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.789+0000 7f8c8ffff640 1 -- 172.21.15.87:0/4195299977 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db80513f0 con 0x5606ea5feb40 2024-05-08T18:32:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.789+0000 7f8c8ffff640 1 -- 172.21.15.87:0/4195299977 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db802ae60 con 0x5606ea5feb40 2024-05-08T18:32:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.789+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606ea609540 con 0x5606ea5feb40 2024-05-08T18:32:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.790+0000 7f8c8ffff640 1 -- 172.21.15.87:0/4195299977 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8db8033020 con 0x5606ea5feb40 2024-05-08T18:32:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.790+0000 7f8c8ffff640 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8c8803bb50 0x7f8c8803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.790+0000 7f8c8ffff640 1 -- 172.21.15.87:0/4195299977 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f8db800e040 con 0x5606ea5feb40 2024-05-08T18:32:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.790+0000 7f8dbe54b640 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8c8803bb50 0x7f8c8803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.790+0000 7f8dbe54b640 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8c8803bb50 0x7f8c8803e010 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8db0091270 tx=0x7f8db0081000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.791+0000 7f8dc292b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.791+0000 7f8dc292b800 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5606ea611d40 0x5606ea614200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.791+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea614950 con 0x5606ea611d40 2024-05-08T18:32:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.791+0000 7f8dbdd4a640 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5606ea611d40 0x5606ea614200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.791+0000 7f8dbdd4a640 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5606ea611d40 0x5606ea614200 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.791+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8db4009050 con 0x5606ea611d40 2024-05-08T18:32:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.791+0000 7f8dc292b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.791+0000 7f8dc292b800 20 realm 2024-05-08T18:32:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.791+0000 7f8dc292b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.791+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea611190 con 0x5606ea611d40 2024-05-08T18:32:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.791+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8db4009050 con 0x5606ea611d40 2024-05-08T18:32:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.791+0000 7f8dc292b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.791+0000 7f8dc292b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:32:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.791+0000 7f8dc292b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.791+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea615440 con 0x5606ea611d40 2024-05-08T18:32:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.792+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8db4009050 con 0x5606ea611d40 2024-05-08T18:32:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.792+0000 7f8dc292b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.792+0000 7f8dc292b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.792+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea615d10 con 0x5606ea611d40 2024-05-08T18:32:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.792+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8db4009050 con 0x5606ea611d40 2024-05-08T18:32:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.792+0000 7f8dc292b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.792+0000 7f8dc292b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.792+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6160b0 con 0x5606ea611d40 2024-05-08T18:32:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.792+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8db4009050 con 0x5606ea611d40 2024-05-08T18:32:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.792+0000 7f8dc292b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:32:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.792+0000 7f8dc292b800 20 searching for the correct realm 2024-05-08T18:32:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.792+0000 7f8dc292b800 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5606ea617f90 0x5606ea61a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.792+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x5606ea617f90 2024-05-08T18:32:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.792+0000 7f8dbed4c640 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5606ea617f90 0x5606ea61a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.793+0000 7f8dbed4c640 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5606ea617f90 0x5606ea61a3a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.793+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.793+0000 7f8dbed4c640 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8db8035020 0x7f8db802b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.793+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x7f8db8035020 2024-05-08T18:32:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.793+0000 7f8dbe54b640 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8db8035020 0x7f8db802b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.793+0000 7f8dbe54b640 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8db8035020 0x7f8db802b3e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.794+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.794+0000 7f8dbe54b640 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8db0087040 0x7f8db005b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:32:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.794+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x7f8db0087040 2024-05-08T18:32:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.794+0000 7f8dbdd4a640 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8db0087040 0x7f8db005b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:32:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.794+0000 7f8dbdd4a640 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8db0087040 0x7f8db005b370 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:32:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.795+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db4009050 con 0x7f8db0087040 2024-05-08T18:32:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.795+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x5606ea611d40 2024-05-08T18:32:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.795+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db4009050 con 0x5606ea611d40 2024-05-08T18:32:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.795+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x5606ea611d40 2024-05-08T18:32:22.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.795+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.795+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x7f8db0087040 2024-05-08T18:32:22.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.795+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.795+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x7f8db0087040 2024-05-08T18:32:22.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.796+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.796+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x7f8db8035020 2024-05-08T18:32:22.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.796+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.796+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x5606ea617f90 2024-05-08T18:32:22.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.796+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.796+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x5606ea611d40 2024-05-08T18:32:22.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.796+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.796+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x7f8db0087040 2024-05-08T18:32:22.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.796+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.797+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x5606ea611d40 2024-05-08T18:32:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.797+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.797+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x7f8db8035020 2024-05-08T18:32:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.797+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.797+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x5606ea617f90 2024-05-08T18:32:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.797+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.797+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x5606ea617f90 2024-05-08T18:32:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.797+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.797+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x7f8db0087040 2024-05-08T18:32:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.798+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.798+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x5606ea617f90 2024-05-08T18:32:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.798+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.798+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x5606ea617f90 2024-05-08T18:32:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.798+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.798+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x5606ea611d40 2024-05-08T18:32:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.798+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.798+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x5606ea611d40 2024-05-08T18:32:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.799+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.799+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x7f8db0087040 2024-05-08T18:32:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.799+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.799+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x5606ea617f90 2024-05-08T18:32:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.799+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.799+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x7f8db8035020 2024-05-08T18:32:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.799+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.799+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x5606ea611d40 2024-05-08T18:32:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.800+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.800+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x7f8db0087040 2024-05-08T18:32:22.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.800+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.800+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x5606ea617f90 2024-05-08T18:32:22.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.800+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.800+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x7f8db8035020 2024-05-08T18:32:22.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.800+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.800+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x7f8db8035020 2024-05-08T18:32:22.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.801+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.801+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x5606ea617f90 2024-05-08T18:32:22.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.801+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.801+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aa70 con 0x7f8db8035020 2024-05-08T18:32:22.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.801+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.801+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8db00ab040 con 0x5606ea611d40 2024-05-08T18:32:22.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.801+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.801+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8db00ab040 con 0x7f8db8035020 2024-05-08T18:32:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.802+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.802+0000 7f8dc292b800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:32:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.802+0000 7f8dc292b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:32:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.802+0000 7f8dc292b800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:32:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.802+0000 7f8dc292b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:32:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.802+0000 7f8dc292b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:32:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.802+0000 7f8dc292b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:32:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.802+0000 7f8dc292b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.802+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea616a00 con 0x5606ea611d40 2024-05-08T18:32:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.802+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.802+0000 7f8dc292b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.802+0000 7f8dc292b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.802+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6172a0 con 0x5606ea611d40 2024-05-08T18:32:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.802+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.802+0000 7f8dc292b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:32:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.802+0000 7f8dc292b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.802+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61aef0 con 0x7f8db0087040 2024-05-08T18:32:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dc292b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:32:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dc292b800 20 zone default found 2024-05-08T18:32:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dc292b800 4 Realm: () 2024-05-08T18:32:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dc292b800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:32:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dc292b800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:32:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dc292b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:32:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dc292b800 20 zonegroup default 2024-05-08T18:32:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dc292b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61b3a0 con 0x7f8db0087040 2024-05-08T18:32:22.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dc292b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dc292b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61cd80 con 0x5606ea617f90 2024-05-08T18:32:22.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dc292b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dc292b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61d200 con 0x5606ea617f90 2024-05-08T18:32:22.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.803+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.804+0000 7f8dc292b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.804+0000 7f8dc292b800 20 started sync module instance, tier type = 2024-05-08T18:32:22.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.804+0000 7f8dc292b800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:32:22.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.804+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61c210 con 0x7f8db8035020 2024-05-08T18:32:22.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.805+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.805+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94587702068736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61be70 con 0x7f8db8035020 2024-05-08T18:32:22.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.805+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61e130 con 0x5606ea611d40 2024-05-08T18:32:22.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.806+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94587702068736] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.806+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.806+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94587702074496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61e550 con 0x5606ea611d40 2024-05-08T18:32:22.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.806+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61ef10 con 0x5606ea617f90 2024-05-08T18:32:22.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.807+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94587702074496] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.807+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.807+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94587702075552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61e4c0 con 0x5606ea617f90 2024-05-08T18:32:22.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.807+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea61fdd0 con 0x7f8db8035020 2024-05-08T18:32:22.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.808+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94587702075552] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.808+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.809+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94587702081824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6201c0 con 0x7f8db8035020 2024-05-08T18:32:22.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.809+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea620bc0 con 0x5606ea611d40 2024-05-08T18:32:22.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.809+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94587702081824] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.810+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.810+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94587702080256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea620b80 con 0x5606ea611d40 2024-05-08T18:32:22.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.810+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea621650 con 0x7f8db0087040 2024-05-08T18:32:22.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.811+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.811+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94587702088064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea621650 con 0x7f8db0087040 2024-05-08T18:32:22.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.811+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6225a0 con 0x7f8db0087040 2024-05-08T18:32:22.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.811+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94587702080256] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.812+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94587702088064] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.812+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.812+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94587702090352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6206d0 con 0x7f8db0087040 2024-05-08T18:32:22.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.812+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea622a10 con 0x7f8db0087040 2024-05-08T18:32:22.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.813+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94587702090352] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.813+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.813+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94587702091920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea622a10 con 0x7f8db0087040 2024-05-08T18:32:22.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.813+0000 7f8dc292b800 20 add_watcher() i=0 2024-05-08T18:32:22.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.813+0000 7f8dc292b800 20 add_watcher() i=1 2024-05-08T18:32:22.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.813+0000 7f8dc292b800 20 add_watcher() i=2 2024-05-08T18:32:22.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.813+0000 7f8dc292b800 20 add_watcher() i=3 2024-05-08T18:32:22.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.813+0000 7f8dc292b800 20 add_watcher() i=4 2024-05-08T18:32:22.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.813+0000 7f8dc292b800 20 add_watcher() i=5 2024-05-08T18:32:22.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.813+0000 7f8dc292b800 20 add_watcher() i=6 2024-05-08T18:32:22.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.814+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94587702091920] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.814+0000 7f8dc292b800 20 add_watcher() i=7 2024-05-08T18:32:22.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.814+0000 7f8dc292b800 2 all 8 watchers are set, enabling cache 2024-05-08T18:32:22.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.814+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea625e70 con 0x5606ea611d40 2024-05-08T18:32:22.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.814+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.814+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94587702093616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6233c0 con 0x5606ea611d40 2024-05-08T18:32:22.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.815+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94587702093616] v29'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.815+0000 7f8c74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:22.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.815+0000 7f8dc292b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:32:22.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.815+0000 7f8dc292b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:32:22.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.815+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea62e800 con 0x5606ea611d40 2024-05-08T18:32:22.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.817+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.817+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea62ee50 con 0x7f8db0087040 2024-05-08T18:32:22.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.818+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.818+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea62f2b0 con 0x5606ea617f90 2024-05-08T18:32:22.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.819+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.819+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea62f1d0 con 0x5606ea611d40 2024-05-08T18:32:22.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.820+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'225 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.820+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea62f860 con 0x7f8db8035020 2024-05-08T18:32:22.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.821+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.821+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea62fdd0 con 0x5606ea617f90 2024-05-08T18:32:22.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.822+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'48 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.822+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea62fdd0 con 0x5606ea611d40 2024-05-08T18:32:22.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.823+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.823+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea62fdd0 con 0x7f8db0087040 2024-05-08T18:32:22.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.824+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.824+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea62fdd0 con 0x7f8db8035020 2024-05-08T18:32:22.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.825+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.825+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x5606ea617f90 2024-05-08T18:32:22.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.826+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.826+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x7f8db8035020 2024-05-08T18:32:22.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.827+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.827+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x7f8db0087040 2024-05-08T18:32:22.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.829+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.829+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x7f8db8035020 2024-05-08T18:32:22.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.830+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.830+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x7f8db0087040 2024-05-08T18:32:22.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.831+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.831+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x5606ea611d40 2024-05-08T18:32:22.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.832+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'226 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.832+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x5606ea617f90 2024-05-08T18:32:22.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.833+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'65 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.833+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x7f8db8035020 2024-05-08T18:32:22.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.834+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.834+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x5606ea617f90 2024-05-08T18:32:22.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.835+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.835+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x5606ea611d40 2024-05-08T18:32:22.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.836+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.836+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x5606ea611d40 2024-05-08T18:32:22.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.837+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'227 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.837+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x5606ea617f90 2024-05-08T18:32:22.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.838+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'66 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.838+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x7f8db8035020 2024-05-08T18:32:22.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.839+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.839+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x5606ea617f90 2024-05-08T18:32:22.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.840+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.840+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x5606ea617f90 2024-05-08T18:32:22.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.841+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.841+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x5606ea617f90 2024-05-08T18:32:22.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.842+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'25 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.842+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x5606ea617f90 2024-05-08T18:32:22.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.843+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'49 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.843+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x7f8db0087040 2024-05-08T18:32:22.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.844+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.844+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x5606ea617f90 2024-05-08T18:32:22.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.845+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.845+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x7f8db0087040 2024-05-08T18:32:22.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.846+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.846+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x5606ea617f90 2024-05-08T18:32:22.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.848+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'67 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.848+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x7f8db0087040 2024-05-08T18:32:22.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.849+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.849+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea630190 con 0x7f8db8035020 2024-05-08T18:32:22.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.850+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.850+0000 7f8bef7fe640 20 reqs_thread_entry: start 2024-05-08T18:32:22.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.850+0000 7f8dc292b800 20 init_complete bucket index max shards: 11 2024-05-08T18:32:22.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.850+0000 7f8dc292b800 20 Filter name: none 2024-05-08T18:32:22.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.850+0000 7f8bed7fa640 20 reqs_thread_entry: start 2024-05-08T18:32:22.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.850+0000 7f8dc292b800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:32:22.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.850+0000 7f8dc292b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.850+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea65b190 con 0x7f8db0087040 2024-05-08T18:32:22.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.851+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.851+0000 7f8dc292b800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:32:22.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.851+0000 7f8dc292b800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T18:32:22.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.851+0000 7f8dc292b800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:32:22.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.851+0000 7f8dc292b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:32:22.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.851+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea65dac0 con 0x7f8db0087040 2024-05-08T18:32:22.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.852+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.852+0000 7f8dc292b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10 : miss 2024-05-08T18:32:22.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.852+0000 7f8dc292b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.852+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:96 8.a 8:55ddffd5:root::.bucket.meta.myfoo7%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea65d980 con 0x5606ea611d40 2024-05-08T18:32:22.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.852+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(96 .bucket.meta.myfoo7:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.852+0000 7f8dc292b800 20 rados_obj.operate() r=0 bl.length=382 2024-05-08T18:32:22.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.852+0000 7f8dc292b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10 info.flags=0x17 2024-05-08T18:32:22.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.852+0000 7f8dc292b800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10 to cache LRU end 2024-05-08T18:32:22.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.852+0000 7f8dc292b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:32:22.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.852+0000 7f8dc292b800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:32:22.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.852+0000 7f8dc292b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10 2024-05-08T18:32:22.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.852+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:97 4.3 4:c30fcb03:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6dae70 con 0x5606ea611d40 2024-05-08T18:32:22.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.853+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(97 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db402a040 con 0x5606ea611d40 2024-05-08T18:32:22.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.853+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:98 4.1d 4:b8145890:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6daeb0 con 0x5606ea617f90 2024-05-08T18:32:22.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.853+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(98 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.1 [call out=85b] v0'0 uv8 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.853+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:99 4.5 4:a0f5b2b8:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6daeb0 con 0x5606ea617f90 2024-05-08T18:32:22.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.853+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 27 ==== osd_op_reply(99 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.853+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:100 4.b 4:d0a98406:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6daeb0 con 0x7f8db8035020 2024-05-08T18:32:22.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.854+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 20 ==== osd_op_reply(100 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.854+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:101 4.7 4:e2f50ecc:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6daeb0 con 0x7f8db0087040 2024-05-08T18:32:22.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.854+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(101 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db402a040 con 0x7f8db0087040 2024-05-08T18:32:22.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.854+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 4.26 4:66528ac6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6daeb0 con 0x7f8db0087040 2024-05-08T18:32:22.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.855+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(102 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.5 [call out=377b] v0'0 uv9 ondisk = 0) ==== 195+0+377 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.855+0000 7f8dc292b800 10 cls_bucket_list_unordered: got fourteen 2024-05-08T18:32:22.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.855+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:103 4.12 4:4a49c267:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6daeb0 con 0x5606ea611d40 2024-05-08T18:32:22.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.855+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(103 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.855+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:104 4.12 4:48da9e50:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6daeb0 con 0x5606ea611d40 2024-05-08T18:32:22.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.855+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(104 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.855+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:105 4.14 4:2adfdf3d:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6daeb0 con 0x5606ea617f90 2024-05-08T18:32:22.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.856+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 28 ==== osd_op_reply(105 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.8 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.856+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:106 4.a 4:53a32910:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6daeb0 con 0x7f8db8035020 2024-05-08T18:32:22.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.856+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 21 ==== osd_op_reply(106 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.856+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:107 4.2c 4:364ca808:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6daeb0 con 0x5606ea611d40 2024-05-08T18:32:22.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.856+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(107 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.856+0000 7f8dc292b800 20 get_obj_state: octx=0x7f8db400e510 obj=myfoo7:fourteen state=0x5606ea6d8ef8 s->prefetch_data=0 2024-05-08T18:32:22.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.856+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:108 3.25s0 3:a537ad77:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6d9d20 con 0x5606ea611d40 2024-05-08T18:32:22.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.856+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 33 ==== osd_op_reply(108 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+872 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.856+0000 7f8dc292b800 10 manifest: total_size = 8 2024-05-08T18:32:22.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.856+0000 7f8dc292b800 20 get_obj_state: setting s->obj_tag to be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.3874397763984048916 2024-05-08T18:32:22.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.856+0000 7f8dc292b800 20 get_obj_state: octx=0x7f8db400e510 obj=myfoo7:fourteen state=0x5606ea6d8ef8 s->prefetch_data=0 2024-05-08T18:32:22.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.856+0000 7f8dc292b800 20 prepare_atomic_modification: state is not atomic. state=0x5606ea6d8ef8 2024-05-08T18:32:22.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.857+0000 7f8dc292b800 20 bucket index object: :.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.5 2024-05-08T18:32:22.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.857+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:109 4.26 4:66528ac6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6da700 con 0x7f8db0087040 2024-05-08T18:32:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.858+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(109 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.5 [stat,call,call] v29'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.858+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:110 3.25s0 3:a537ad77:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6da700 con 0x5606ea611d40 2024-05-08T18:32:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.859+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 34 ==== osd_op_reply(110 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10_fourteen [call] v29'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.859+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:111 4.26 4:66528ac6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea662550 con 0x7f8db0087040 2024-05-08T18:32:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.859+0000 7f8dc292b800 20 list_objects_ordered: starting attempt 1 2024-05-08T18:32:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.859+0000 7f8dc292b800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-08T18:32:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.859+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:112 4.3 4:c30fcb03:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea663e70 con 0x5606ea611d40 2024-05-08T18:32:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.859+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:113 4.1d 4:b8145890:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea663e70 con 0x5606ea617f90 2024-05-08T18:32:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.859+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:114 4.5 4:a0f5b2b8:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea668c40 con 0x5606ea617f90 2024-05-08T18:32:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.859+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:115 4.b 4:d0a98406:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea66b710 con 0x7f8db8035020 2024-05-08T18:32:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.860+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 29 ==== osd_op_reply(113 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.1 [call out=85b] v0'0 uv8 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.860+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 30 ==== osd_op_reply(114 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.860+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:116 4.7 4:e2f50ecc:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea663e70 con 0x7f8db0087040 2024-05-08T18:32:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.860+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 22 ==== osd_op_reply(115 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.860+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 35 ==== osd_op_reply(112 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.860+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:117 4.26 4:66528ac6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea662550 con 0x7f8db0087040 2024-05-08T18:32:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.860+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:118 4.12 4:4a49c267:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6d8ef0 con 0x5606ea611d40 2024-05-08T18:32:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.860+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:119 4.12 4:48da9e50:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea668c40 con 0x5606ea611d40 2024-05-08T18:32:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.860+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:120 4.14 4:2adfdf3d:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6d93c0 con 0x5606ea617f90 2024-05-08T18:32:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.860+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:121 4.a 4:53a32910:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6715d0 con 0x7f8db8035020 2024-05-08T18:32:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.860+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:122 4.2c 4:364ca808:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673fa0 con 0x5606ea611d40 2024-05-08T18:32:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.860+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 36 ==== osd_op_reply(118 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.860+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(116 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.860+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 23 ==== osd_op_reply(121 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.860+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 29 ==== osd_op_reply(111 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.5 [stat,call,call] v29'11 uv11 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.860+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 31 ==== osd_op_reply(120 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.8 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8ca1ffb640 20 handle_completion(): completion ok for obj=fourteen 2024-05-08T18:32:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 37 ==== osd_op_reply(122 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 30 ==== osd_op_reply(117 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.5 [call out=124b] v0'0 uv11 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 38 ==== osd_op_reply(119 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dc292b800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-08T18:32:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dc292b800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-08T18:32:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dc292b800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-08T18:32:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dc292b800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-08T18:32:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dc292b800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10])"; uploads.size()=0; is_truncated=0 2024-05-08T18:32:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:123 4.3 4:c30fcb03:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6d8a20 con 0x5606ea611d40 2024-05-08T18:32:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:124 4.1d 4:b8145890:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6620a0 con 0x5606ea617f90 2024-05-08T18:32:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:125 4.5 4:a0f5b2b8:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea662480 con 0x5606ea617f90 2024-05-08T18:32:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:126 4.b 4:d0a98406:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673b00 con 0x7f8db8035020 2024-05-08T18:32:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:127 4.7 4:e2f50ecc:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6620a0 con 0x7f8db0087040 2024-05-08T18:32:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:128 4.26 4:66528ac6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f90 con 0x7f8db0087040 2024-05-08T18:32:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:129 4.12 4:4a49c267:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6620a0 con 0x5606ea611d40 2024-05-08T18:32:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:130 4.12 4:48da9e50:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f90 con 0x5606ea611d40 2024-05-08T18:32:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:131 4.14 4:2adfdf3d:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6749a0 con 0x5606ea617f90 2024-05-08T18:32:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:132 4.a 4:53a32910:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea677390 con 0x7f8db8035020 2024-05-08T18:32:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:133 4.2c 4:364ca808:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6749a0 con 0x5606ea611d40 2024-05-08T18:32:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 31 ==== osd_op_reply(128 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.5 [call out=124b] v0'0 uv11 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 32 ==== osd_op_reply(124 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.1 [call out=85b] v0'0 uv8 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 32 ==== osd_op_reply(127 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 33 ==== osd_op_reply(125 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 34 ==== osd_op_reply(131 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.8 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 39 ==== osd_op_reply(123 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 40 ==== osd_op_reply(129 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 41 ==== osd_op_reply(133 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 42 ==== osd_op_reply(130 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.861+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 24 ==== osd_op_reply(126 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.862+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 25 ==== osd_op_reply(132 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8db0078070 con 0x7f8db8035020 2024-05-08T18:32:22.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.862+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f90 con 0x7f8db0087040 2024-05-08T18:32:22.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.863+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 33 ==== osd_op_reply(134 fud.buckets [call] v29'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.863+0000 7f8dc292b800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-05-08T18:32:22.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.863+0000 7f8dc292b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.863+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f90 con 0x7f8db8035020 2024-05-08T18:32:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.863+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 26 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv47 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f8db00b2040 con 0x7f8db8035020 2024-05-08T18:32:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.863+0000 7f8dc292b800 20 rados_obj.operate() r=0 bl.length=168 2024-05-08T18:32:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.863+0000 7f8dc292b800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-05-08T18:32:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.863+0000 7f8dc292b800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-05-08T18:32:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.863+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f90 con 0x7f8db8035020 2024-05-08T18:32:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.864+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 27 ==== osd_op_reply(136 myfoo7 [call,call,delete] v29'49 uv49 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f8db00b2040 con 0x7f8db8035020 2024-05-08T18:32:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.864+0000 7f8dc292b800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-05-08T18:32:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.864+0000 7f8dc292b800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-05-08T18:32:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.864+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94587702428688 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f90 con 0x7f8db8035020 2024-05-08T18:32:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.865+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 28 ==== watch-notify(notify (1) cookie 94587702081824 notify 124554051627 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5606ea62f860 con 0x7f8db8035020 2024-05-08T18:32:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.865+0000 7f8ca17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051627 cookie 94587702081824 notifier 4753 bl.length()=150 2024-05-08T18:32:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.865+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 29 ==== osd_op_reply(137 notify.3 [notify cookie 94587702428688 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8db00b2040 con 0x7f8db8035020 2024-05-08T18:32:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.865+0000 7f8ca17fa640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8bf40032c0 con 0x7f8db8035020 2024-05-08T18:32:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.865+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 30 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db00b2040 con 0x7f8db8035020 2024-05-08T18:32:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.865+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 31 ==== watch-notify(notify_complete (2) cookie 94587702428688 notify 124554051627 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5606ea62f1d0 con 0x7f8db8035020 2024-05-08T18:32:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.865+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:139 8.a 8:55ddffd5:root::.bucket.meta.myfoo7%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f90 con 0x5606ea611d40 2024-05-08T18:32:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.866+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 43 ==== osd_op_reply(139 .bucket.meta.myfoo7:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10 [call,call,delete] v29'5 uv5 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.866+0000 7f8dc292b800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10 from cache 2024-05-08T18:32:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.866+0000 7f8dc292b800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10, ofs0, ns] 2024-05-08T18:32:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.866+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:140 7.15 7:a93a5511:::notify.2:head [notify cookie 94587702428688 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x5606ea617f90 2024-05-08T18:32:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.866+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 35 ==== watch-notify(notify (1) cookie 94587702075552 notify 124554051592 ret 0) ==== 250+0+0 (crc 0 0 0) 0x5606ea62e190 con 0x5606ea617f90 2024-05-08T18:32:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.866+0000 7f8ca1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051592 cookie 94587702075552 notifier 4753 bl.length()=208 2024-05-08T18:32:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.866+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 36 ==== osd_op_reply(140 notify.2 [notify cookie 94587702428688 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.866+0000 7f8ca1ffb640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:141 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8c84003d60 con 0x5606ea617f90 2024-05-08T18:32:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.867+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 37 ==== watch-notify(notify_complete (2) cookie 94587702428688 notify 124554051592 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5606ea606890 con 0x5606ea617f90 2024-05-08T18:32:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.867+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 38 ==== osd_op_reply(141 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.867+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:142 4.3 4:c30fcb03:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x5606ea611d40 2024-05-08T18:32:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.867+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:143 4.1d 4:b8145890:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6d8910 con 0x5606ea617f90 2024-05-08T18:32:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.867+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:144 4.5 4:a0f5b2b8:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6d9400 con 0x5606ea617f90 2024-05-08T18:32:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.867+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:145 4.b 4:d0a98406:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x7f8db8035020 2024-05-08T18:32:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.867+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:146 4.7 4:e2f50ecc:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea65c5b0 con 0x7f8db0087040 2024-05-08T18:32:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.867+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:147 4.26 4:66528ac6:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6d8910 con 0x7f8db0087040 2024-05-08T18:32:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.867+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:148 4.12 4:4a49c267:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6637c0 con 0x5606ea611d40 2024-05-08T18:32:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.867+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:149 4.12 4:48da9e50:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6d9400 con 0x5606ea611d40 2024-05-08T18:32:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.867+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:150 4.14 4:2adfdf3d:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6d8910 con 0x5606ea617f90 2024-05-08T18:32:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.868+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:151 4.a 4:53a32910:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea65c5b0 con 0x7f8db8035020 2024-05-08T18:32:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.868+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:152 4.2c 4:364ca808:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6637c0 con 0x5606ea611d40 2024-05-08T18:32:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.868+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 34 ==== osd_op_reply(147 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.5 [delete] v29'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.868+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 39 ==== osd_op_reply(150 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.8 [delete] v29'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.869+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 32 ==== osd_op_reply(145 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.3 [delete] v29'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f8db00b2040 con 0x7f8db8035020 2024-05-08T18:32:22.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.869+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 40 ==== osd_op_reply(143 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.1 [delete] v29'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.869+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 44 ==== osd_op_reply(148 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.6 [delete] v29'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.869+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 45 ==== osd_op_reply(142 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.0 [delete] v29'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.869+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 46 ==== osd_op_reply(152 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.10 [delete] v29'2 uv2 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.869+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 41 ==== osd_op_reply(144 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.2 [delete] v29'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.869+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 35 ==== osd_op_reply(146 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.4 [delete] v29'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.869+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 47 ==== osd_op_reply(149 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.7 [delete] v29'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.870+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 33 ==== osd_op_reply(151 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10.9 [delete] v29'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f8db00b2040 con 0x7f8db8035020 2024-05-08T18:32:22.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.870+0000 7f8dc292b800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10 : miss 2024-05-08T18:32:22.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.870+0000 7f8dc292b800 20 rados->read ofs=0 len=0 2024-05-08T18:32:22.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.870+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:153 6.11 6:89536d60:::pubsub..bucket.myfoo7%2fbe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6d8910 con 0x5606ea617f90 2024-05-08T18:32:22.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.870+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 42 ==== osd_op_reply(153 pubsub..bucket.myfoo7/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.870+0000 7f8dc292b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:32:22.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.870+0000 7f8dc292b800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10 info.flags=0x0 2024-05-08T18:32:22.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.870+0000 7f8dc292b800 10 adding default.rgw.log++pubsub..bucket.myfoo7/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10 to cache LRU end 2024-05-08T18:32:22.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.870+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:154 6.11 6:89536d60:::pubsub..bucket.myfoo7%2fbe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea6d9400 con 0x5606ea617f90 2024-05-08T18:32:22.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.871+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 43 ==== osd_op_reply(154 pubsub..bucket.myfoo7/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.10 [delete] v29'30 uv23 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.871+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x7f8db0087040 2024-05-08T18:32:22.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.872+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 36 ==== osd_op_reply(155 fud.buckets [call] v29'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.872+0000 7f8dc292b800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-08T18:32:22.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.872+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x7f8db0087040 2024-05-08T18:32:22.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.873+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 37 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v29'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.873+0000 7f8dc292b800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:32:22.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.873+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94587702381728 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x5606ea617f90 2024-05-08T18:32:22.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.873+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 44 ==== watch-notify(notify (1) cookie 94587702075552 notify 124554051593 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5606ea606890 con 0x5606ea617f90 2024-05-08T18:32:22.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.873+0000 7f8ca1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051593 cookie 94587702075552 notifier 4753 bl.length()=170 2024-05-08T18:32:22.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.873+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 45 ==== osd_op_reply(157 notify.2 [notify cookie 94587702381728 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.873+0000 7f8ca1ffb640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8c84003d60 con 0x5606ea617f90 2024-05-08T18:32:22.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.874+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 46 ==== watch-notify(notify_complete (2) cookie 94587702381728 notify 124554051593 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5606ea606600 con 0x5606ea617f90 2024-05-08T18:32:22.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.874+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 47 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.874+0000 7f8dc292b800 10 removing email index: 2024-05-08T18:32:22.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.874+0000 7f8dc292b800 10 removing user buckets index 2024-05-08T18:32:22.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.874+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x7f8db0087040 2024-05-08T18:32:22.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.875+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 38 ==== osd_op_reply(159 fud.buckets [delete] v29'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.875+0000 7f8dc292b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-05-08T18:32:22.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.875+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94587702381728 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x7f8db0087040 2024-05-08T18:32:22.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.875+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 39 ==== watch-notify(notify (1) cookie 94587702090352 notify 124554051610 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5606ea65cea0 con 0x7f8db0087040 2024-05-08T18:32:22.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.875+0000 7f8ca17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051610 cookie 94587702090352 notifier 4753 bl.length()=160 2024-05-08T18:32:22.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.875+0000 7f8ca17fa640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8bf40032c0 con 0x7f8db0087040 2024-05-08T18:32:22.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.875+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 40 ==== osd_op_reply(160 notify.6 [notify cookie 94587702381728 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.875+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 41 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.875+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 42 ==== watch-notify(notify_complete (2) cookie 94587702381728 notify 124554051610 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5606ea609540 con 0x7f8db0087040 2024-05-08T18:32:22.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.875+0000 7f8dc292b800 10 removing user index: fud 2024-05-08T18:32:22.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.875+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x7f8db0087040 2024-05-08T18:32:22.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.876+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 43 ==== osd_op_reply(162 fud [call,call,delete] v29'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.876+0000 7f8dc292b800 10 removing default.rgw.meta+users.uid+fud from cache 2024-05-08T18:32:22.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.876+0000 7f8dc292b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-08T18:32:22.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.876+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94587702381728 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x7f8db0087040 2024-05-08T18:32:22.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.877+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 44 ==== watch-notify(notify (1) cookie 94587702088064 notify 124554051611 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5606ea609540 con 0x7f8db0087040 2024-05-08T18:32:22.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.877+0000 7f8ca1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051611 cookie 94587702088064 notifier 4753 bl.length()=152 2024-05-08T18:32:22.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.877+0000 7f8ca1ffb640 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8c84003d60 con 0x7f8db0087040 2024-05-08T18:32:22.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.877+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 45 ==== osd_op_reply(163 notify.5 [notify cookie 94587702381728 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.877+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 46 ==== watch-notify(notify_complete (2) cookie 94587702381728 notify 124554051611 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5606ea62e9d0 con 0x7f8db0087040 2024-05-08T18:32:22.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.877+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 47 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.878+0000 7f8c74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:32:22.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.878+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94587702093616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x5606ea611d40 2024-05-08T18:32:22.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.879+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 48 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94587702093616] v29'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.879+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94587702068736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x7f8db8035020 2024-05-08T18:32:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.880+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 34 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94587702068736] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db00b2040 con 0x7f8db8035020 2024-05-08T18:32:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.880+0000 7f8dc292b800 20 remove_watcher() i=0 2024-05-08T18:32:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.880+0000 7f8dc292b800 2 removed watcher, disabling cache 2024-05-08T18:32:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.880+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94587702074496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x5606ea611d40 2024-05-08T18:32:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.881+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 49 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94587702074496] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.881+0000 7f8dc292b800 20 remove_watcher() i=1 2024-05-08T18:32:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.881+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94587702075552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x5606ea617f90 2024-05-08T18:32:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.882+0000 7f8dbed4c640 1 -- 172.21.15.87:0/4195299977 <== osd.3 v2:172.21.15.87:6800/2929215285 48 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94587702075552] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db8029070 con 0x5606ea617f90 2024-05-08T18:32:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.882+0000 7f8dc292b800 20 remove_watcher() i=2 2024-05-08T18:32:22.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.882+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94587702081824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x7f8db8035020 2024-05-08T18:32:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.883+0000 7f8dbe54b640 1 -- 172.21.15.87:0/4195299977 <== osd.2 v2:172.21.15.87:6816/2108501615 35 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94587702081824] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db00b2040 con 0x7f8db8035020 2024-05-08T18:32:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.883+0000 7f8dc292b800 20 remove_watcher() i=3 2024-05-08T18:32:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.883+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94587702080256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x5606ea611d40 2024-05-08T18:32:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.884+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.1 v2:172.21.15.87:6808/2448644045 50 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94587702080256] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x5606ea611d40 2024-05-08T18:32:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.884+0000 7f8dc292b800 20 remove_watcher() i=4 2024-05-08T18:32:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.884+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94587702088064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x7f8db0087040 2024-05-08T18:32:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.885+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 48 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94587702088064] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.885+0000 7f8dc292b800 20 remove_watcher() i=5 2024-05-08T18:32:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.885+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94587702090352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x7f8db0087040 2024-05-08T18:32:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.886+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 49 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94587702090352] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.886+0000 7f8dc292b800 20 remove_watcher() i=6 2024-05-08T18:32:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.886+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94587702091920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5606ea673f70 con 0x7f8db0087040 2024-05-08T18:32:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.887+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 <== osd.0 v2:172.21.15.53:6800/443747735 50 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94587702091920] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db404f040 con 0x7f8db0087040 2024-05-08T18:32:22.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.887+0000 7f8dc292b800 20 remove_watcher() i=7 2024-05-08T18:32:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.887+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8db0087040 msgr2=0x7f8db005b370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.887+0000 7f8dc292b800 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f8db0087040 0x7f8db005b370 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.887+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5606ea611d40 msgr2=0x5606ea614200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.887+0000 7f8dc292b800 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5606ea611d40 0x5606ea614200 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.887+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8db8035020 msgr2=0x7f8db802b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.887+0000 7f8dc292b800 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8db8035020 0x7f8db802b3e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.887+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5606ea617f90 msgr2=0x5606ea61a3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.887+0000 7f8dc292b800 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5606ea617f90 0x5606ea61a3a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8c8803bb50 msgr2=0x7f8c8803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8c8803bb50 0x7f8c8803e010 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8db0091270 tx=0x7f8db0081000 comp rx=0 tx=0).stop 2024-05-08T18:32:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5feb40 msgr2=0x5606ea6060c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dbdd4a640 1 -- 172.21.15.87:0/4195299977 reap_dead start 2024-05-08T18:32:22.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5feb40 0x5606ea6060c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8db8015fd0 tx=0x7f8db8052900 comp rx=0 tx=0).stop 2024-05-08T18:32:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 shutdown_connections 2024-05-08T18:32:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 --2- 172.21.15.87:0/4195299977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5feb40 0x5606ea6060c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 >> 172.21.15.87:0/4195299977 conn(0x5606ea5faef0 msgr2=0x5606ea6003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 shutdown_connections 2024-05-08T18:32:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 -- 172.21.15.87:0/4195299977 wait complete. 2024-05-08T18:32:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 -- 172.21.15.87:0/2139095134 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8c9803bb50 msgr2=0x7f8c9803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 --2- 172.21.15.87:0/2139095134 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8c9803bb50 0x7f8c9803e010 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8db0092660 tx=0x7f8db00925d0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 -- 172.21.15.87:0/2139095134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5f1850 msgr2=0x5606ea5f1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 --2- 172.21.15.87:0/2139095134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5f1850 0x5606ea5f1c70 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x5606ea5d7750 tx=0x7f8db80178e0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 -- 172.21.15.87:0/2139095134 shutdown_connections 2024-05-08T18:32:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 --2- 172.21.15.87:0/2139095134 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8c9803bb50 0x7f8c9803e010 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 --2- 172.21.15.87:0/2139095134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea5f1850 0x5606ea5f1c70 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 -- 172.21.15.87:0/2139095134 >> 172.21.15.87:0/2139095134 conn(0x5606ea5e58f0 msgr2=0x5606ea5e5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 -- 172.21.15.87:0/2139095134 shutdown_connections 2024-05-08T18:32:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 -- 172.21.15.87:0/2139095134 wait complete. 2024-05-08T18:32:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 -- 172.21.15.87:0/3738477086 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5606ea5e0ce0 msgr2=0x5606ea5e30d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5606ea5e0ce0 0x5606ea5e30d0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 -- 172.21.15.87:0/3738477086 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5606ea4dc480 msgr2=0x5606ea5dd590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5606ea4dc480 0x5606ea5dd590 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 -- 172.21.15.87:0/3738477086 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8ca403bb50 msgr2=0x7f8ca403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.888+0000 7f8dc292b800 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8ca403bb50 0x7f8ca403e010 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8db4000f60 tx=0x7f8db40012b0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.889+0000 7f8dc292b800 1 -- 172.21.15.87:0/3738477086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 msgr2=0x5606ea5d63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:32:22.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.889+0000 7f8dc292b800 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 0x5606ea5d63a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8db001ced0 tx=0x7f8db0002fb0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.889+0000 7f8dc292b800 1 -- 172.21.15.87:0/3738477086 shutdown_connections 2024-05-08T18:32:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.889+0000 7f8dc292b800 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5606ea4dc480 0x5606ea5dd590 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.889+0000 7f8dc292b800 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5606ea5e0ce0 0x5606ea5e30d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.889+0000 7f8dc292b800 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8ca403bb50 0x7f8ca403e010 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.889+0000 7f8dc292b800 1 --2- 172.21.15.87:0/3738477086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606ea4db2c0 0x5606ea5d63a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:32:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.889+0000 7f8dc292b800 1 -- 172.21.15.87:0/3738477086 >> 172.21.15.87:0/3738477086 conn(0x5606ea4d6840 msgr2=0x5606ea44fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:32:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.889+0000 7f8dc292b800 1 -- 172.21.15.87:0/3738477086 shutdown_connections 2024-05-08T18:32:22.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:32:22.889+0000 7f8dc292b800 1 -- 172.21.15.87:0/3738477086 wait complete. 2024-05-08T18:33:02.902 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-05-08T18:33:02.902 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-05-08T18:33:02.903 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-05-08T18:33:02.955 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:02.955 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.957+0000 7f3ec0a62800 1 Processor -- start 2024-05-08T18:33:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.957+0000 7f3ec0a62800 1 -- start start 2024-05-08T18:33:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.957+0000 7f3ec0a62800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b422bf06a0 0x55b422bf91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.957+0000 7f3ec0a62800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b422b63510 con 0x55b422beeb60 2024-05-08T18:33:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.957+0000 7f3ec0a62800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b422a90e20 con 0x55b422bf06a0 2024-05-08T18:33:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.958+0000 7f3eb5d59640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b422bf06a0 0x55b422bf91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.958+0000 7f3ebe55a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55b422beeb60 0x55b422beef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58092/0 (socket says 172.21.15.87:58092) 2024-05-08T18:33:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.958+0000 7f3eb5d59640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b422bf06a0 0x55b422bf91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:51932/0 (socket says 172.21.15.87:51932) 2024-05-08T18:33:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.958+0000 7f3ebe55a640 1 -- 172.21.15.87:0/4214523054 learned_addr learned my addr 172.21.15.87:0/4214523054 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:33:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.958+0000 7f3eb5d59640 1 -- 172.21.15.87:0/4214523054 >> v1:172.21.15.53:6789/0 conn(0x55b422beeb60 legacy=0x55b422beef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.958+0000 7f3eb5d59640 1 -- 172.21.15.87:0/4214523054 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b422bfa6f0 con 0x55b422bf06a0 2024-05-08T18:33:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.960+0000 7f3eb5d59640 1 --2- 172.21.15.87:0/4214523054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422bf06a0 0x55b422bf91a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800a470 tx=0x7f3ea801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0fc31b836627eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:02.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.960+0000 7f3ebdd59640 1 -- 172.21.15.87:0/4214523054 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ea8057070 con 0x55b422bf06a0 2024-05-08T18:33:02.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.960+0000 7f3ebdd59640 1 -- 172.21.15.87:0/4214523054 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ea804adc0 con 0x55b422bf06a0 2024-05-08T18:33:02.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.960+0000 7f3ebdd59640 1 -- 172.21.15.87:0/4214523054 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ea8052590 con 0x55b422bf06a0 2024-05-08T18:33:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.961+0000 7f3ec0a62800 1 -- 172.21.15.87:0/4214523054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422bf06a0 msgr2=0x55b422bf91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.961+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/4214523054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422bf06a0 0x55b422bf91a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800a470 tx=0x7f3ea801ce90 comp rx=0 tx=0).stop 2024-05-08T18:33:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.961+0000 7f3ec0a62800 1 -- 172.21.15.87:0/4214523054 shutdown_connections 2024-05-08T18:33:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.961+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/4214523054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422bf06a0 0x55b422bf91a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.961+0000 7f3ec0a62800 1 -- 172.21.15.87:0/4214523054 >> 172.21.15.87:0/4214523054 conn(0x55b422bea720 msgr2=0x55b422becb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.961+0000 7f3ec0a62800 1 -- 172.21.15.87:0/4214523054 shutdown_connections 2024-05-08T18:33:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.961+0000 7f3ec0a62800 1 -- 172.21.15.87:0/4214523054 wait complete. 2024-05-08T18:33:02.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.976+0000 7f3ec0a62800 1 Processor -- start 2024-05-08T18:33:02.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.977+0000 7f3ec0a62800 1 -- start start 2024-05-08T18:33:02.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.977+0000 7f3ec0a62800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422beeb60 0x55b422ce3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:02.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.977+0000 7f3ec0a62800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b422b3b5b0 con 0x55b422beeb60 2024-05-08T18:33:02.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.977+0000 7f3ebe55a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422beeb60 0x55b422ce3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:02.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.977+0000 7f3ebe55a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422beeb60 0x55b422ce3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:51938/0 (socket says 172.21.15.87:51938) 2024-05-08T18:33:02.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.977+0000 7f3ebe55a640 1 -- 172.21.15.87:0/2300433540 learned_addr learned my addr 172.21.15.87:0/2300433540 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:02.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.978+0000 7f3ebe55a640 1 -- 172.21.15.87:0/2300433540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b422ce3f30 con 0x55b422beeb60 2024-05-08T18:33:02.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.978+0000 7f3ebe55a640 1 --2- 172.21.15.87:0/2300433540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422beeb60 0x55b422ce3960 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0001de0 tx=0x7f3eb000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344a8d38c3d1b66a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:02.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.978+0000 7f3dac608640 1 -- 172.21.15.87:0/2300433540 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb0012020 con 0x55b422beeb60 2024-05-08T18:33:02.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.978+0000 7f3dac608640 1 -- 172.21.15.87:0/2300433540 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb000e5a0 con 0x55b422beeb60 2024-05-08T18:33:02.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.978+0000 7f3dac608640 1 -- 172.21.15.87:0/2300433540 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb000e8c0 con 0x55b422beeb60 2024-05-08T18:33:02.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.979+0000 7f3ec0a62800 1 -- 172.21.15.87:0/2300433540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422beeb60 msgr2=0x55b422ce3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:02.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.979+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/2300433540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422beeb60 0x55b422ce3960 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0001de0 tx=0x7f3eb000b6c0 comp rx=0 tx=0).stop 2024-05-08T18:33:02.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.979+0000 7f3ec0a62800 1 -- 172.21.15.87:0/2300433540 shutdown_connections 2024-05-08T18:33:02.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.979+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/2300433540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422beeb60 0x55b422ce3960 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:02.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.979+0000 7f3ec0a62800 1 -- 172.21.15.87:0/2300433540 >> 172.21.15.87:0/2300433540 conn(0x55b422bea720 msgr2=0x55b422cdf280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:02.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.979+0000 7f3ec0a62800 1 -- 172.21.15.87:0/2300433540 shutdown_connections 2024-05-08T18:33:02.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.979+0000 7f3ec0a62800 1 -- 172.21.15.87:0/2300433540 wait complete. 2024-05-08T18:33:02.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.979+0000 7f3ec0a62800 1 Processor -- start 2024-05-08T18:33:02.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.979+0000 7f3ec0a62800 1 -- start start 2024-05-08T18:33:02.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.979+0000 7f3ec0a62800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422beeb60 0x55b422ceb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:02.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.979+0000 7f3ec0a62800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b422bf99b0 con 0x55b422beeb60 2024-05-08T18:33:02.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.980+0000 7f3ebe55a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422beeb60 0x55b422ceb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:02.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.980+0000 7f3ebe55a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422beeb60 0x55b422ceb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:51952/0 (socket says 172.21.15.87:51952) 2024-05-08T18:33:02.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.980+0000 7f3ebe55a640 1 -- 172.21.15.87:0/768359284 learned_addr learned my addr 172.21.15.87:0/768359284 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:02.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.980+0000 7f3ebe55a640 1 -- 172.21.15.87:0/768359284 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b422ceb9f0 con 0x55b422beeb60 2024-05-08T18:33:02.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.980+0000 7f3ebe55a640 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422beeb60 0x55b422ceb4b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0001de0 tx=0x7f3eb0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:02.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.980+0000 7f3daae05640 1 -- 172.21.15.87:0/768359284 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb0012030 con 0x55b422beeb60 2024-05-08T18:33:02.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.980+0000 7f3daae05640 1 -- 172.21.15.87:0/768359284 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb001a7a0 con 0x55b422beeb60 2024-05-08T18:33:02.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.980+0000 7f3ec0a62800 1 -- 172.21.15.87:0/768359284 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b422cebc80 con 0x55b422beeb60 2024-05-08T18:33:02.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.980+0000 7f3daae05640 1 -- 172.21.15.87:0/768359284 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb001aac0 con 0x55b422beeb60 2024-05-08T18:33:02.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.981+0000 7f3ec0a62800 1 -- 172.21.15.87:0/768359284 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b422cee930 con 0x55b422beeb60 2024-05-08T18:33:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.981+0000 7f3daae05640 1 -- 172.21.15.87:0/768359284 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3eb0015020 con 0x55b422beeb60 2024-05-08T18:33:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.982+0000 7f3daae05640 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3da403bb50 0x7f3da403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.982+0000 7f3daae05640 1 -- 172.21.15.87:0/768359284 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3eb0020070 con 0x55b422beeb60 2024-05-08T18:33:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.982+0000 7f3eb5d59640 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3da403bb50 0x7f3da403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.982+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b422bf06a0 0x55b422cf26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.982+0000 7f3ec0a62800 1 -- 172.21.15.87:0/768359284 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422cf2c30 con 0x55b422bf06a0 2024-05-08T18:33:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.982+0000 7f3ebed5b640 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b422bf06a0 0x55b422cf26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.982+0000 7f3eb5d59640 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3da403bb50 0x7f3da403e010 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8054000 tx=0x7f3ea804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.982+0000 7f3ebed5b640 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b422bf06a0 0x55b422cf26f0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.983+0000 7f3ebed5b640 1 -- 172.21.15.87:0/768359284 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3eb800a4a0 con 0x55b422bf06a0 2024-05-08T18:33:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.983+0000 7f3ec0a62800 1 -- 172.21.15.87:0/768359284 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422cefcc0 con 0x55b422bf06a0 2024-05-08T18:33:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.983+0000 7f3ebed5b640 1 -- 172.21.15.87:0/768359284 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3eb800a4a0 con 0x55b422bf06a0 2024-05-08T18:33:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.983+0000 7f3ec0a62800 1 -- 172.21.15.87:0/768359284 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422cf4a70 con 0x55b422bf06a0 2024-05-08T18:33:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.983+0000 7f3ebed5b640 1 -- 172.21.15.87:0/768359284 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3eb800a4a0 con 0x55b422bf06a0 2024-05-08T18:33:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.983+0000 7f3ec0a62800 1 -- 172.21.15.87:0/768359284 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422cf3ca0 con 0x55b422bf06a0 2024-05-08T18:33:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.984+0000 7f3ebed5b640 1 -- 172.21.15.87:0/768359284 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3eb800a4a0 con 0x55b422bf06a0 2024-05-08T18:33:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.984+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b422cf5e20 0x55b422cf8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.984+0000 7f3ec0a62800 1 -- 172.21.15.87:0/768359284 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422cf8750 con 0x55b422cf5e20 2024-05-08T18:33:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.984+0000 7f3ebe55a640 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b422cf5e20 0x55b422cf8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.984+0000 7f3ebe55a640 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b422cf5e20 0x55b422cf8210 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.985+0000 7f3ebe55a640 1 -- 172.21.15.87:0/768359284 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3eb0024460 con 0x55b422cf5e20 2024-05-08T18:33:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.985+0000 7f3ec0a62800 1 Processor -- start 2024-05-08T18:33:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.985+0000 7f3ec0a62800 1 -- start start 2024-05-08T18:33:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.985+0000 7f3ec0a62800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d06a20 0x55b422d06e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.985+0000 7f3ec0a62800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b422ae1fc0 con 0x55b422d06a20 2024-05-08T18:33:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.986+0000 7f3ebed5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d06a20 0x55b422d06e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.986+0000 7f3ebed5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d06a20 0x55b422d06e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:51960/0 (socket says 172.21.15.87:51960) 2024-05-08T18:33:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.986+0000 7f3ebed5b640 1 -- 172.21.15.87:0/1653327333 learned_addr learned my addr 172.21.15.87:0/1653327333 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.986+0000 7f3ebed5b640 1 -- 172.21.15.87:0/1653327333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b422d07380 con 0x55b422d06a20 2024-05-08T18:33:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.986+0000 7f3ebed5b640 1 --2- 172.21.15.87:0/1653327333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d06a20 0x55b422d06e40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x55b422cec8b0 tx=0x7f3eb80178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.986+0000 7f3da3fff640 1 -- 172.21.15.87:0/1653327333 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb8013440 con 0x55b422d06a20 2024-05-08T18:33:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.986+0000 7f3da3fff640 1 -- 172.21.15.87:0/1653327333 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb80135e0 con 0x55b422d06a20 2024-05-08T18:33:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.986+0000 7f3ec0a62800 1 -- 172.21.15.87:0/1653327333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b422d07df0 con 0x55b422d06a20 2024-05-08T18:33:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.986+0000 7f3da3fff640 1 -- 172.21.15.87:0/1653327333 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb80138c0 con 0x55b422d06a20 2024-05-08T18:33:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.986+0000 7f3ec0a62800 1 -- 172.21.15.87:0/1653327333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b422d082f0 con 0x55b422d06a20 2024-05-08T18:33:02.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.987+0000 7f3da3fff640 1 -- 172.21.15.87:0/1653327333 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3eb8011040 con 0x55b422d06a20 2024-05-08T18:33:02.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.987+0000 7f3da3fff640 1 --2- 172.21.15.87:0/1653327333 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d9803bba0 0x7f3d9803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.988+0000 7f3da3fff640 1 -- 172.21.15.87:0/1653327333 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3eb801d070 con 0x55b422d06a20 2024-05-08T18:33:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.988+0000 7f3ebe55a640 1 --2- 172.21.15.87:0/1653327333 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d9803bba0 0x7f3d9803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.988+0000 7f3ec0a62800 1 Processor -- start 2024-05-08T18:33:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.988+0000 7f3ec0a62800 1 -- start start 2024-05-08T18:33:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.988+0000 7f3ebe55a640 1 --2- 172.21.15.87:0/1653327333 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d9803bba0 0x7f3d9803e060 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00510a0 tx=0x7f3eb00510d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.988+0000 7f3ec0a62800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d13d90 0x55b422d141b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.988+0000 7f3ec0a62800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b422ce42b0 con 0x55b422d13d90 2024-05-08T18:33:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.988+0000 7f3ebed5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d13d90 0x55b422d141b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.988+0000 7f3ebed5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d13d90 0x55b422d141b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:51964/0 (socket says 172.21.15.87:51964) 2024-05-08T18:33:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.988+0000 7f3ebed5b640 1 -- 172.21.15.87:0/604942365 learned_addr learned my addr 172.21.15.87:0/604942365 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.989+0000 7f3ebed5b640 1 -- 172.21.15.87:0/604942365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b422d14780 con 0x55b422d13d90 2024-05-08T18:33:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.989+0000 7f3ebed5b640 1 --2- 172.21.15.87:0/604942365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d13d90 0x55b422d141b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8052930 tx=0x7f3eb8001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e5a87401977057 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:02.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.989+0000 7f3da1ffb640 1 -- 172.21.15.87:0/604942365 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb80540d0 con 0x55b422d13d90 2024-05-08T18:33:02.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.989+0000 7f3da1ffb640 1 -- 172.21.15.87:0/604942365 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb8054270 con 0x55b422d13d90 2024-05-08T18:33:02.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.989+0000 7f3da1ffb640 1 -- 172.21.15.87:0/604942365 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb80014f0 con 0x55b422d13d90 2024-05-08T18:33:02.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.990+0000 7f3ec0a62800 1 -- 172.21.15.87:0/604942365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d13d90 msgr2=0x55b422d141b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:02.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.990+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/604942365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d13d90 0x55b422d141b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8052930 tx=0x7f3eb8001e60 comp rx=0 tx=0).stop 2024-05-08T18:33:02.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.990+0000 7f3ec0a62800 1 -- 172.21.15.87:0/604942365 shutdown_connections 2024-05-08T18:33:02.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.990+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/604942365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d13d90 0x55b422d141b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:02.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.990+0000 7f3ec0a62800 1 -- 172.21.15.87:0/604942365 >> 172.21.15.87:0/604942365 conn(0x55b422d10010 msgr2=0x55b422d0e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:02.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.990+0000 7f3ec0a62800 1 -- 172.21.15.87:0/604942365 shutdown_connections 2024-05-08T18:33:02.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.990+0000 7f3ec0a62800 1 -- 172.21.15.87:0/604942365 wait complete. 2024-05-08T18:33:02.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.990+0000 7f3ec0a62800 1 Processor -- start 2024-05-08T18:33:02.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.990+0000 7f3ec0a62800 1 -- start start 2024-05-08T18:33:02.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.990+0000 7f3ec0a62800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d13d90 0x55b422d1b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.990+0000 7f3ec0a62800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b422d14eb0 con 0x55b422d13d90 2024-05-08T18:33:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.990+0000 7f3ebed5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d13d90 0x55b422d1b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.990+0000 7f3ebed5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d13d90 0x55b422d1b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:51974/0 (socket says 172.21.15.87:51974) 2024-05-08T18:33:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.990+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 learned_addr learned my addr 172.21.15.87:0/3724154369 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.991+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b422d1b880 con 0x55b422d13d90 2024-05-08T18:33:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.991+0000 7f3ebed5b640 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d13d90 0x55b422d1b340 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8015fd0 tx=0x7f3eb8052890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.991+0000 7f3d8ffff640 1 -- 172.21.15.87:0/3724154369 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb8030070 con 0x55b422d13d90 2024-05-08T18:33:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.991+0000 7f3d8ffff640 1 -- 172.21.15.87:0/3724154369 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb8015ad0 con 0x55b422d13d90 2024-05-08T18:33:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.991+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b422d1bb10 con 0x55b422d13d90 2024-05-08T18:33:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.991+0000 7f3d8ffff640 1 -- 172.21.15.87:0/3724154369 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb80540d0 con 0x55b422d13d90 2024-05-08T18:33:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.991+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b422d1e7c0 con 0x55b422d13d90 2024-05-08T18:33:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.992+0000 7f3d8ffff640 1 -- 172.21.15.87:0/3724154369 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3eb8033070 con 0x55b422d13d90 2024-05-08T18:33:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.992+0000 7f3d8ffff640 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d8803bbf0 0x7f3d8803e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.992+0000 7f3d8ffff640 1 -- 172.21.15.87:0/3724154369 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3eb800e040 con 0x55b422d13d90 2024-05-08T18:33:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.992+0000 7f3ebe55a640 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d8803bbf0 0x7f3d8803e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.993+0000 7f3ebe55a640 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d8803bbf0 0x7f3d8803e0b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0001250 tx=0x7f3eb0046000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.993+0000 7f3ec0a62800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.993+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b422d26fe0 0x55b422d294a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.993+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422d29bf0 con 0x55b422d26fe0 2024-05-08T18:33:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.993+0000 7f3eb5d59640 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b422d26fe0 0x55b422d294a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.993+0000 7f3eb5d59640 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b422d26fe0 0x55b422d294a0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3ec0a62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3ec0a62800 20 realm 2024-05-08T18:33:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3ec0a62800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2a020 con 0x55b422d26fe0 2024-05-08T18:33:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3ec0a62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3ec0a62800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3ec0a62800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2a8f0 con 0x55b422d26fe0 2024-05-08T18:33:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3ec0a62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3ec0a62800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2ac90 con 0x55b422d26fe0 2024-05-08T18:33:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3ec0a62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3ec0a62800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.994+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x55b422d26fe0 2024-05-08T18:33:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.995+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.995+0000 7f3ec0a62800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.995+0000 7f3ec0a62800 20 searching for the correct realm 2024-05-08T18:33:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.995+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b422d2d250 0x55b422d2f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.995+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2fc70 con 0x55b422d2d250 2024-05-08T18:33:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.995+0000 7f3ebed5b640 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b422d2d250 0x55b422d2f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.995+0000 7f3ebed5b640 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b422d2d250 0x55b422d2f640 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.996+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb8032030 con 0x55b422d2d250 2024-05-08T18:33:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.996+0000 7f3ebed5b640 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f3eb8035070 0x7f3eb8029980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.996+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2fc70 con 0x7f3eb8035070 2024-05-08T18:33:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.996+0000 7f3ebe55a640 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f3eb8035070 0x7f3eb8029980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.996+0000 7f3ebe55a640 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f3eb8035070 0x7f3eb8029980 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.996+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb0024460 con 0x7f3eb8035070 2024-05-08T18:33:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.996+0000 7f3ebe55a640 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f3eb0017050 0x7f3eb0052560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.996+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2fc70 con 0x7f3eb0017050 2024-05-08T18:33:03.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.997+0000 7f3eb5d59640 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f3eb0017050 0x7f3eb0052560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.997+0000 7f3eb5d59640 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f3eb0017050 0x7f3eb0052560 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.998+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.998+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x55b422d26fe0 2024-05-08T18:33:03.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.998+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.998+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x55b422d26fe0 2024-05-08T18:33:03.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.998+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.998+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x7f3eb0017050 2024-05-08T18:33:03.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.998+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.998+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x7f3eb0017050 2024-05-08T18:33:03.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.999+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.999+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x7f3eb8035070 2024-05-08T18:33:03.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.999+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb0024460 con 0x7f3eb8035070 2024-05-08T18:33:03.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.999+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x55b422d2d250 2024-05-08T18:33:03.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.999+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb8032030 con 0x55b422d2d250 2024-05-08T18:33:03.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.999+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x55b422d26fe0 2024-05-08T18:33:03.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.999+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:02.999+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x7f3eb0017050 2024-05-08T18:33:03.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.000+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.000+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x55b422d26fe0 2024-05-08T18:33:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.000+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.000+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x7f3eb8035070 2024-05-08T18:33:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.000+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3eb0024460 con 0x7f3eb8035070 2024-05-08T18:33:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.000+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x55b422d2d250 2024-05-08T18:33:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.001+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb8032030 con 0x55b422d2d250 2024-05-08T18:33:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.001+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x55b422d2d250 2024-05-08T18:33:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.001+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb8032030 con 0x55b422d2d250 2024-05-08T18:33:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.001+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x7f3eb0017050 2024-05-08T18:33:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.001+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.001+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x55b422d2d250 2024-05-08T18:33:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.002+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb8032030 con 0x55b422d2d250 2024-05-08T18:33:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.002+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x55b422d2d250 2024-05-08T18:33:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.002+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb8032030 con 0x55b422d2d250 2024-05-08T18:33:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.002+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x55b422d26fe0 2024-05-08T18:33:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.002+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.002+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x55b422d26fe0 2024-05-08T18:33:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.002+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.002+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x7f3eb0017050 2024-05-08T18:33:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.003+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.003+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x55b422d2d250 2024-05-08T18:33:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.003+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb8032030 con 0x55b422d2d250 2024-05-08T18:33:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.003+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x7f3eb8035070 2024-05-08T18:33:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.003+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb0024460 con 0x7f3eb8035070 2024-05-08T18:33:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.003+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x55b422d26fe0 2024-05-08T18:33:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.003+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.003+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x7f3eb0017050 2024-05-08T18:33:03.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.004+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.004+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x55b422d2d250 2024-05-08T18:33:03.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.004+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb8032030 con 0x55b422d2d250 2024-05-08T18:33:03.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.004+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x7f3eb8035070 2024-05-08T18:33:03.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.004+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb0024460 con 0x7f3eb8035070 2024-05-08T18:33:03.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.004+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x7f3eb8035070 2024-05-08T18:33:03.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.005+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb0024460 con 0x7f3eb8035070 2024-05-08T18:33:03.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.005+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x55b422d2d250 2024-05-08T18:33:03.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.005+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb8032030 con 0x55b422d2d250 2024-05-08T18:33:03.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.005+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x7f3eb8035070 2024-05-08T18:33:03.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.005+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb0024460 con 0x7f3eb8035070 2024-05-08T18:33:03.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.005+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x55b422d26fe0 2024-05-08T18:33:03.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.005+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.005+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2b4e0 con 0x7f3eb8035070 2024-05-08T18:33:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.006+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb0024460 con 0x7f3eb8035070 2024-05-08T18:33:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.006+0000 7f3ec0a62800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.006+0000 7f3ec0a62800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.006+0000 7f3ec0a62800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.006+0000 7f3ec0a62800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.006+0000 7f3ec0a62800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.006+0000 7f3ec0a62800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.006+0000 7f3ec0a62800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.006+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2bd30 con 0x55b422d26fe0 2024-05-08T18:33:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.006+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.006+0000 7f3ec0a62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.006+0000 7f3ec0a62800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.006+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2c120 con 0x55b422d26fe0 2024-05-08T18:33:03.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.006+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.006+0000 7f3ec0a62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:03.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.006+0000 7f3ec0a62800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.006+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422d2c120 con 0x7f3eb0017050 2024-05-08T18:33:03.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.007+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.007+0000 7f3ec0a62800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:03.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.007+0000 7f3ec0a62800 20 zone default found 2024-05-08T18:33:03.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.007+0000 7f3ec0a62800 4 Realm: () 2024-05-08T18:33:03.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.007+0000 7f3ec0a62800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:03.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.007+0000 7f3ec0a62800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:03.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.007+0000 7f3ec0a62800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:03.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.007+0000 7f3ec0a62800 20 zonegroup default 2024-05-08T18:33:03.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.007+0000 7f3ec0a62800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.007+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422d300f0 con 0x7f3eb0017050 2024-05-08T18:33:03.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.007+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.007+0000 7f3ec0a62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.007+0000 7f3ec0a62800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.007+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422d31ad0 con 0x55b422d2d250 2024-05-08T18:33:03.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.008+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3eb8032030 con 0x55b422d2d250 2024-05-08T18:33:03.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.008+0000 7f3ec0a62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.008+0000 7f3ec0a62800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.008+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422d31e70 con 0x55b422d2d250 2024-05-08T18:33:03.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.008+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3eb8032030 con 0x55b422d2d250 2024-05-08T18:33:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.008+0000 7f3ec0a62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.008+0000 7f3ec0a62800 20 started sync module instance, tier type = 2024-05-08T18:33:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.008+0000 7f3ec0a62800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.008+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d30f70 con 0x7f3eb8035070 2024-05-08T18:33:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.009+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb0024460 con 0x7f3eb8035070 2024-05-08T18:33:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.009+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94232166732688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d30bd0 con 0x7f3eb8035070 2024-05-08T18:33:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.009+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d32b70 con 0x55b422d26fe0 2024-05-08T18:33:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.010+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94232166732688] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb0024460 con 0x7f3eb8035070 2024-05-08T18:33:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.011+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.011+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94232166736880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d32dc0 con 0x55b422d26fe0 2024-05-08T18:33:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.011+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d338e0 con 0x55b422d2d250 2024-05-08T18:33:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.012+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94232166736880] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.012+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb8032030 con 0x55b422d2d250 2024-05-08T18:33:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.012+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94232166740912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d33cd0 con 0x55b422d2d250 2024-05-08T18:33:03.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.012+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d34710 con 0x7f3eb8035070 2024-05-08T18:33:03.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.013+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb0024460 con 0x7f3eb8035070 2024-05-08T18:33:03.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.013+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94232166744544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d34fb0 con 0x7f3eb8035070 2024-05-08T18:33:03.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.013+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d35ad0 con 0x55b422d26fe0 2024-05-08T18:33:03.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.014+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94232166740912] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb8032030 con 0x55b422d2d250 2024-05-08T18:33:03.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.015+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.015+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94232166744544] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb0024460 con 0x7f3eb8035070 2024-05-08T18:33:03.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.015+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94232166749600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d35ec0 con 0x55b422d26fe0 2024-05-08T18:33:03.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.015+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d34b20 con 0x7f3eb0017050 2024-05-08T18:33:03.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.016+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.016+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94232166753232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d35e70 con 0x7f3eb0017050 2024-05-08T18:33:03.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.016+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d372c0 con 0x7f3eb0017050 2024-05-08T18:33:03.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.016+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94232166749600] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.017+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(56 notify.6 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.017+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94232166737936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d372c0 con 0x7f3eb0017050 2024-05-08T18:33:03.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.017+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d37cc0 con 0x7f3eb0017050 2024-05-08T18:33:03.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.017+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94232166753232] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.018+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94232166737936] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.018+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.018+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94232166754288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d36e10 con 0x7f3eb0017050 2024-05-08T18:33:03.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.018+0000 7f3ec0a62800 20 add_watcher() i=0 2024-05-08T18:33:03.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.018+0000 7f3ec0a62800 20 add_watcher() i=1 2024-05-08T18:33:03.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.018+0000 7f3ec0a62800 20 add_watcher() i=2 2024-05-08T18:33:03.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.018+0000 7f3ec0a62800 20 add_watcher() i=3 2024-05-08T18:33:03.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.018+0000 7f3ec0a62800 20 add_watcher() i=4 2024-05-08T18:33:03.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.018+0000 7f3ec0a62800 20 add_watcher() i=5 2024-05-08T18:33:03.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.018+0000 7f3ec0a62800 20 add_watcher() i=6 2024-05-08T18:33:03.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.020+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94232166754288] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.020+0000 7f3ec0a62800 20 add_watcher() i=7 2024-05-08T18:33:03.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.020+0000 7f3ec0a62800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:03.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.020+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422d3adc0 con 0x55b422d26fe0 2024-05-08T18:33:03.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.020+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.020+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94232166758352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d38240 con 0x55b422d26fe0 2024-05-08T18:33:03.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.021+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94232166758352] v29'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.021+0000 7f3d74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:03.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.021+0000 7f3ec0a62800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:03.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.021+0000 7f3ec0a62800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:03.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.021+0000 7f3ec0a62800 5 note: GC not initialized 2024-05-08T18:33:03.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.022+0000 7f3cef7fe640 20 reqs_thread_entry: start 2024-05-08T18:33:03.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.022+0000 7f3ec0a62800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:03.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.022+0000 7f3ec0a62800 20 Filter name: none 2024-05-08T18:33:03.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.022+0000 7f3ced7fa640 20 reqs_thread_entry: start 2024-05-08T18:33:03.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.022+0000 7f3ec0a62800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:33:03.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.022+0000 7f3ec0a62800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.022+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b422d6df90 con 0x55b422d26fe0 2024-05-08T18:33:03.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.022+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.022+0000 7f3ec0a62800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:33:03.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.022+0000 7f3ec0a62800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:33:03.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.022+0000 7f3ec0a62800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:33:03.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.022+0000 7f3ec0a62800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:33:03.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.023+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d708c0 con 0x7f3eb0017050 2024-05-08T18:33:03.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.024+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(63 usage.10 [call] v29'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.024+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d708c0 con 0x7f3eb0017050 2024-05-08T18:33:03.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.025+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(64 usage.10 [call] v29'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.026+0000 7f3d74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:03.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.026+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94232166758352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d23490 con 0x55b422d26fe0 2024-05-08T18:33:03.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.027+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94232166758352] v29'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.027+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94232166732688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d377d0 con 0x7f3eb8035070 2024-05-08T18:33:03.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.030+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94232166732688] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb0024460 con 0x7f3eb8035070 2024-05-08T18:33:03.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.031+0000 7f3ec0a62800 20 remove_watcher() i=0 2024-05-08T18:33:03.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.031+0000 7f3ec0a62800 2 removed watcher, disabling cache 2024-05-08T18:33:03.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.031+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94232166736880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d6db30 con 0x55b422d26fe0 2024-05-08T18:33:03.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.032+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94232166736880] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.032+0000 7f3ec0a62800 20 remove_watcher() i=1 2024-05-08T18:33:03.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.032+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94232166740912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d6db30 con 0x55b422d2d250 2024-05-08T18:33:03.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.033+0000 7f3ebed5b640 1 -- 172.21.15.87:0/3724154369 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94232166740912] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb8032030 con 0x55b422d2d250 2024-05-08T18:33:03.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.033+0000 7f3ec0a62800 20 remove_watcher() i=2 2024-05-08T18:33:03.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.033+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94232166744544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d6db30 con 0x7f3eb8035070 2024-05-08T18:33:03.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.034+0000 7f3ebe55a640 1 -- 172.21.15.87:0/3724154369 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94232166744544] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb0024460 con 0x7f3eb8035070 2024-05-08T18:33:03.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.034+0000 7f3ec0a62800 20 remove_watcher() i=3 2024-05-08T18:33:03.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.034+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94232166749600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d6db30 con 0x55b422d26fe0 2024-05-08T18:33:03.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.036+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94232166749600] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x55b422d26fe0 2024-05-08T18:33:03.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.036+0000 7f3ec0a62800 20 remove_watcher() i=4 2024-05-08T18:33:03.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.036+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94232166753232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d6db30 con 0x7f3eb0017050 2024-05-08T18:33:03.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.037+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94232166753232] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.037+0000 7f3ec0a62800 20 remove_watcher() i=5 2024-05-08T18:33:03.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.037+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94232166737936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d6db30 con 0x7f3eb0017050 2024-05-08T18:33:03.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.038+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94232166737936] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.038+0000 7f3ec0a62800 20 remove_watcher() i=6 2024-05-08T18:33:03.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.038+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94232166754288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b422d6db30 con 0x7f3eb0017050 2024-05-08T18:33:03.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.039+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94232166754288] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ea805a040 con 0x7f3eb0017050 2024-05-08T18:33:03.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.039+0000 7f3ec0a62800 20 remove_watcher() i=7 2024-05-08T18:33:03.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f3eb0017050 msgr2=0x7f3eb0052560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f3eb0017050 0x7f3eb0052560 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b422d26fe0 msgr2=0x55b422d294a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b422d26fe0 0x55b422d294a0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f3eb8035070 msgr2=0x7f3eb8029980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f3eb8035070 0x7f3eb8029980 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b422d2d250 msgr2=0x55b422d2f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b422d2d250 0x55b422d2f640 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d8803bbf0 msgr2=0x7f3d8803e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d8803bbf0 0x7f3d8803e0b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0001250 tx=0x7f3eb0046000 comp rx=0 tx=0).stop 2024-05-08T18:33:03.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d13d90 msgr2=0x55b422d1b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/3724154369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d13d90 0x55b422d1b340 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8015fd0 tx=0x7f3eb8052890 comp rx=0 tx=0).stop 2024-05-08T18:33:03.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3eb5d59640 1 -- 172.21.15.87:0/3724154369 reap_dead start 2024-05-08T18:33:03.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 shutdown_connections 2024-05-08T18:33:03.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 >> 172.21.15.87:0/3724154369 conn(0x55b422d10010 msgr2=0x55b422d0d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 shutdown_connections 2024-05-08T18:33:03.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 -- 172.21.15.87:0/3724154369 wait complete. 2024-05-08T18:33:03.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 -- 172.21.15.87:0/1653327333 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d9803bba0 msgr2=0x7f3d9803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/1653327333 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d9803bba0 0x7f3d9803e060 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00510a0 tx=0x7f3eb00510d0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 -- 172.21.15.87:0/1653327333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d06a20 msgr2=0x55b422d06e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/1653327333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d06a20 0x55b422d06e40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x55b422cec8b0 tx=0x7f3eb80178e0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 -- 172.21.15.87:0/1653327333 shutdown_connections 2024-05-08T18:33:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/1653327333 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3d9803bba0 0x7f3d9803e060 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/1653327333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422d06a20 0x55b422d06e40 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 -- 172.21.15.87:0/1653327333 >> 172.21.15.87:0/1653327333 conn(0x55b422cfaac0 msgr2=0x55b422cfaec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 -- 172.21.15.87:0/1653327333 shutdown_connections 2024-05-08T18:33:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.040+0000 7f3ec0a62800 1 -- 172.21.15.87:0/1653327333 wait complete. 2024-05-08T18:33:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.041+0000 7f3ec0a62800 1 -- 172.21.15.87:0/768359284 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b422cf5e20 msgr2=0x55b422cf8210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.041+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b422cf5e20 0x55b422cf8210 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.041+0000 7f3ec0a62800 1 -- 172.21.15.87:0/768359284 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b422bf06a0 msgr2=0x55b422cf26f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.041+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b422bf06a0 0x55b422cf26f0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.041+0000 7f3ec0a62800 1 -- 172.21.15.87:0/768359284 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3da403bb50 msgr2=0x7f3da403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.041+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3da403bb50 0x7f3da403e010 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8054000 tx=0x7f3ea804e000 comp rx=0 tx=0).stop 2024-05-08T18:33:03.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.041+0000 7f3ec0a62800 1 -- 172.21.15.87:0/768359284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422beeb60 msgr2=0x55b422ceb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.041+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422beeb60 0x55b422ceb4b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0001de0 tx=0x7f3eb0000ed0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.041+0000 7f3ec0a62800 1 -- 172.21.15.87:0/768359284 shutdown_connections 2024-05-08T18:33:03.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.041+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b422bf06a0 0x55b422cf26f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.041+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b422cf5e20 0x55b422cf8210 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.041+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3da403bb50 0x7f3da403e010 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.041+0000 7f3ec0a62800 1 --2- 172.21.15.87:0/768359284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b422beeb60 0x55b422ceb4b0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.041+0000 7f3ec0a62800 1 -- 172.21.15.87:0/768359284 >> 172.21.15.87:0/768359284 conn(0x55b422bea720 msgr2=0x55b422cdda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.041+0000 7f3ec0a62800 1 -- 172.21.15.87:0/768359284 shutdown_connections 2024-05-08T18:33:03.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.041+0000 7f3ec0a62800 1 -- 172.21.15.87:0/768359284 wait complete. 2024-05-08T18:33:03.048 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-05-08T18:33:03.048 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-05-08T18:33:03.048 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-05-08T18:33:03.092 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:03.092 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:03.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.095+0000 7f7b2e72f800 1 Processor -- start 2024-05-08T18:33:03.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.095+0000 7f7b2e72f800 1 -- start start 2024-05-08T18:33:03.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.095+0000 7f7b2e72f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561cb2103880 0x561cb2105c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.095+0000 7f7b2e72f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561cb21061b0 con 0x561cb20ffd70 2024-05-08T18:33:03.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.095+0000 7f7b2e72f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x561cb1f9fe20 con 0x561cb2103880 2024-05-08T18:33:03.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.095+0000 7f7b23fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561cb2103880 0x561cb2105c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.096+0000 7f7b23fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561cb2103880 0x561cb2105c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:51988/0 (socket says 172.21.15.87:51988) 2024-05-08T18:33:03.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.096+0000 7f7b2a3ee640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x561cb20ffd70 0x561cb2102160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58094/0 (socket says 172.21.15.87:58094) 2024-05-08T18:33:03.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.096+0000 7f7b23fff640 1 -- 172.21.15.87:0/2029823122 learned_addr learned my addr 172.21.15.87:0/2029823122 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.096+0000 7f7b23fff640 1 -- 172.21.15.87:0/2029823122 >> v1:172.21.15.53:6789/0 conn(0x561cb20ffd70 legacy=0x561cb2102160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.096+0000 7f7b23fff640 1 -- 172.21.15.87:0/2029823122 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cb2107390 con 0x561cb2103880 2024-05-08T18:33:03.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.098+0000 7f7b23fff640 1 --2- 172.21.15.87:0/2029823122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb2103880 0x561cb2105c70 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400a520 tx=0x7f7b1401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2a31934f933ceb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.098+0000 7f7b29bed640 1 -- 172.21.15.87:0/2029823122 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b14057070 con 0x561cb2103880 2024-05-08T18:33:03.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.098+0000 7f7b29bed640 1 -- 172.21.15.87:0/2029823122 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b14052570 con 0x561cb2103880 2024-05-08T18:33:03.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.098+0000 7f7b29bed640 1 -- 172.21.15.87:0/2029823122 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1404ae60 con 0x561cb2103880 2024-05-08T18:33:03.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.098+0000 7f7b2e72f800 1 -- 172.21.15.87:0/2029823122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb2103880 msgr2=0x561cb2105c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.098+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/2029823122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb2103880 0x561cb2105c70 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400a520 tx=0x7f7b1401d010 comp rx=0 tx=0).stop 2024-05-08T18:33:03.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.098+0000 7f7b2e72f800 1 -- 172.21.15.87:0/2029823122 shutdown_connections 2024-05-08T18:33:03.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.098+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/2029823122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb2103880 0x561cb2105c70 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.098+0000 7f7b2e72f800 1 -- 172.21.15.87:0/2029823122 >> 172.21.15.87:0/2029823122 conn(0x561cb20f96a0 msgr2=0x561cb20fbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.098+0000 7f7b2e72f800 1 -- 172.21.15.87:0/2029823122 shutdown_connections 2024-05-08T18:33:03.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.099+0000 7f7b2e72f800 1 -- 172.21.15.87:0/2029823122 wait complete. 2024-05-08T18:33:03.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.112+0000 7f7b2e72f800 1 Processor -- start 2024-05-08T18:33:03.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.112+0000 7f7b2e72f800 1 -- start start 2024-05-08T18:33:03.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.112+0000 7f7b2e72f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb20ffd70 0x561cb21f0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.112+0000 7f7b2e72f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561cb204a5b0 con 0x561cb20ffd70 2024-05-08T18:33:03.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.112+0000 7f7b2a3ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb20ffd70 0x561cb21f0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.113+0000 7f7b2a3ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb20ffd70 0x561cb21f0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52000/0 (socket says 172.21.15.87:52000) 2024-05-08T18:33:03.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.113+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1259558419 learned_addr learned my addr 172.21.15.87:0/1259558419 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.113+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1259558419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cb21f0bf0 con 0x561cb20ffd70 2024-05-08T18:33:03.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.113+0000 7f7b2a3ee640 1 --2- 172.21.15.87:0/1259558419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb20ffd70 0x561cb21f0620 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c001e10 tx=0x7f7b1c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181398977cbffca4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.113+0000 7f7a18608640 1 -- 172.21.15.87:0/1259558419 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c00e5c0 con 0x561cb20ffd70 2024-05-08T18:33:03.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.113+0000 7f7a18608640 1 -- 172.21.15.87:0/1259558419 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c006070 con 0x561cb20ffd70 2024-05-08T18:33:03.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.113+0000 7f7a18608640 1 -- 172.21.15.87:0/1259558419 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c00e930 con 0x561cb20ffd70 2024-05-08T18:33:03.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.114+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1259558419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb20ffd70 msgr2=0x561cb21f0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.114+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1259558419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb20ffd70 0x561cb21f0620 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c001e10 tx=0x7f7b1c00b6c0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.114+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1259558419 shutdown_connections 2024-05-08T18:33:03.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.114+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1259558419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb20ffd70 0x561cb21f0620 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.114+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1259558419 >> 172.21.15.87:0/1259558419 conn(0x561cb20f96a0 msgr2=0x561cb21ebf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.114+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1259558419 shutdown_connections 2024-05-08T18:33:03.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.114+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1259558419 wait complete. 2024-05-08T18:33:03.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.114+0000 7f7b2e72f800 1 Processor -- start 2024-05-08T18:33:03.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.114+0000 7f7b2e72f800 1 -- start start 2024-05-08T18:33:03.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.114+0000 7f7b2e72f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb20ffd70 0x561cb21f81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.114+0000 7f7b2e72f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561cb2106680 con 0x561cb20ffd70 2024-05-08T18:33:03.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.115+0000 7f7b2a3ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb20ffd70 0x561cb21f81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.115+0000 7f7b2a3ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb20ffd70 0x561cb21f81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52008/0 (socket says 172.21.15.87:52008) 2024-05-08T18:33:03.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.115+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1600188196 learned_addr learned my addr 172.21.15.87:0/1600188196 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.115+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1600188196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cb21f8700 con 0x561cb20ffd70 2024-05-08T18:33:03.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.115+0000 7f7b2a3ee640 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb20ffd70 0x561cb21f81c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00b700 tx=0x7f7b1c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.115+0000 7f7a16e05640 1 -- 172.21.15.87:0/1600188196 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c00f8d0 con 0x561cb20ffd70 2024-05-08T18:33:03.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.115+0000 7f7a16e05640 1 -- 172.21.15.87:0/1600188196 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c00fa70 con 0x561cb20ffd70 2024-05-08T18:33:03.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.115+0000 7f7a16e05640 1 -- 172.21.15.87:0/1600188196 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c00fd50 con 0x561cb20ffd70 2024-05-08T18:33:03.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.115+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1600188196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cb21f8990 con 0x561cb20ffd70 2024-05-08T18:33:03.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.116+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1600188196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cb21fb5f0 con 0x561cb20ffd70 2024-05-08T18:33:03.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.116+0000 7f7a16e05640 1 -- 172.21.15.87:0/1600188196 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7b1c017070 con 0x561cb20ffd70 2024-05-08T18:33:03.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.117+0000 7f7a16e05640 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a1003bb50 0x7f7a1003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.117+0000 7f7a16e05640 1 -- 172.21.15.87:0/1600188196 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7b1c015020 con 0x561cb20ffd70 2024-05-08T18:33:03.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.117+0000 7f7b23fff640 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a1003bb50 0x7f7a1003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.117+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561cb2103880 0x561cb21ff3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.117+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1600188196 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb21ff930 con 0x561cb2103880 2024-05-08T18:33:03.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.117+0000 7f7b2abef640 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561cb2103880 0x561cb21ff3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.117+0000 7f7b23fff640 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a1003bb50 0x7f7a1003e010 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7b14054000 tx=0x7f7b1404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.117+0000 7f7b2abef640 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561cb2103880 0x561cb21ff3b0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.118+0000 7f7b2abef640 1 -- 172.21.15.87:0/1600188196 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b2400a4a0 con 0x561cb2103880 2024-05-08T18:33:03.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.118+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1600188196 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb21fc930 con 0x561cb2103880 2024-05-08T18:33:03.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.118+0000 7f7b2abef640 1 -- 172.21.15.87:0/1600188196 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b2400a4a0 con 0x561cb2103880 2024-05-08T18:33:03.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.118+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1600188196 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb2201720 con 0x561cb2103880 2024-05-08T18:33:03.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.118+0000 7f7b2abef640 1 -- 172.21.15.87:0/1600188196 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7b2400a4a0 con 0x561cb2103880 2024-05-08T18:33:03.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.118+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1600188196 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb2200950 con 0x561cb2103880 2024-05-08T18:33:03.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.118+0000 7f7b2abef640 1 -- 172.21.15.87:0/1600188196 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b2400a4a0 con 0x561cb2103880 2024-05-08T18:33:03.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.118+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561cb2202ad0 0x561cb2204ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.118+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1600188196 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb2205400 con 0x561cb2202ad0 2024-05-08T18:33:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.119+0000 7f7b2a3ee640 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561cb2202ad0 0x561cb2204ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.119+0000 7f7b2a3ee640 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561cb2202ad0 0x561cb2204ec0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.119+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1600188196 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b1c02e070 con 0x561cb2202ad0 2024-05-08T18:33:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.120+0000 7f7b2e72f800 1 Processor -- start 2024-05-08T18:33:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.120+0000 7f7b2e72f800 1 -- start start 2024-05-08T18:33:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.120+0000 7f7b2e72f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb2213680 0x561cb2213aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.120+0000 7f7b2e72f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561cb1ff0fc0 con 0x561cb2213680 2024-05-08T18:33:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.120+0000 7f7b2abef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb2213680 0x561cb2213aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.120+0000 7f7b2abef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb2213680 0x561cb2213aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52010/0 (socket says 172.21.15.87:52010) 2024-05-08T18:33:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.120+0000 7f7b2abef640 1 -- 172.21.15.87:0/4080344219 learned_addr learned my addr 172.21.15.87:0/4080344219 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.120+0000 7f7b2abef640 1 -- 172.21.15.87:0/4080344219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cb2213fe0 con 0x561cb2213680 2024-05-08T18:33:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.121+0000 7f7b2abef640 1 --2- 172.21.15.87:0/4080344219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb2213680 0x561cb2213aa0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x561cb21f9570 tx=0x7f7b240178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.121+0000 7f7a0ffff640 1 -- 172.21.15.87:0/4080344219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b24013440 con 0x561cb2213680 2024-05-08T18:33:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.121+0000 7f7a0ffff640 1 -- 172.21.15.87:0/4080344219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b240135e0 con 0x561cb2213680 2024-05-08T18:33:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.121+0000 7f7b2e72f800 1 -- 172.21.15.87:0/4080344219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cb2214a50 con 0x561cb2213680 2024-05-08T18:33:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.121+0000 7f7a0ffff640 1 -- 172.21.15.87:0/4080344219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b240138c0 con 0x561cb2213680 2024-05-08T18:33:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.121+0000 7f7b2e72f800 1 -- 172.21.15.87:0/4080344219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cb2214f50 con 0x561cb2213680 2024-05-08T18:33:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.122+0000 7f7a0ffff640 1 -- 172.21.15.87:0/4080344219 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7b24011040 con 0x561cb2213680 2024-05-08T18:33:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.122+0000 7f7a0ffff640 1 --2- 172.21.15.87:0/4080344219 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a0403bb50 0x7f7a0403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.122+0000 7f7a0ffff640 1 -- 172.21.15.87:0/4080344219 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7b2401d070 con 0x561cb2213680 2024-05-08T18:33:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.122+0000 7f7b2a3ee640 1 --2- 172.21.15.87:0/4080344219 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a0403bb50 0x7f7a0403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.122+0000 7f7b2e72f800 1 Processor -- start 2024-05-08T18:33:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.122+0000 7f7b2a3ee640 1 --2- 172.21.15.87:0/4080344219 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a0403bb50 0x7f7a0403e010 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x561cb2200cf0 tx=0x7f7b1c051820 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.122+0000 7f7b2e72f800 1 -- start start 2024-05-08T18:33:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.122+0000 7f7b2e72f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb22209a0 0x561cb2220dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.122+0000 7f7b2e72f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561cb21f0f70 con 0x561cb22209a0 2024-05-08T18:33:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.123+0000 7f7b2abef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb22209a0 0x561cb2220dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.123+0000 7f7b2abef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb22209a0 0x561cb2220dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52026/0 (socket says 172.21.15.87:52026) 2024-05-08T18:33:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.123+0000 7f7b2abef640 1 -- 172.21.15.87:0/2696888650 learned_addr learned my addr 172.21.15.87:0/2696888650 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.123+0000 7f7b2abef640 1 -- 172.21.15.87:0/2696888650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cb2221390 con 0x561cb22209a0 2024-05-08T18:33:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.123+0000 7f7b2abef640 1 --2- 172.21.15.87:0/2696888650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb22209a0 0x561cb2220dc0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7b240529e0 tx=0x7f7b24001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1ce71ecaa0befc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.123+0000 7f7a0dffb640 1 -- 172.21.15.87:0/2696888650 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b2402ac50 con 0x561cb22209a0 2024-05-08T18:33:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.123+0000 7f7a0dffb640 1 -- 172.21.15.87:0/2696888650 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b2402adf0 con 0x561cb22209a0 2024-05-08T18:33:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.123+0000 7f7a0dffb640 1 -- 172.21.15.87:0/2696888650 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b240158e0 con 0x561cb22209a0 2024-05-08T18:33:03.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.124+0000 7f7b2e72f800 1 -- 172.21.15.87:0/2696888650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb22209a0 msgr2=0x561cb2220dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.124+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/2696888650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb22209a0 0x561cb2220dc0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7b240529e0 tx=0x7f7b24001b10 comp rx=0 tx=0).stop 2024-05-08T18:33:03.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.124+0000 7f7b2e72f800 1 -- 172.21.15.87:0/2696888650 shutdown_connections 2024-05-08T18:33:03.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.124+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/2696888650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb22209a0 0x561cb2220dc0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.124+0000 7f7b2e72f800 1 -- 172.21.15.87:0/2696888650 >> 172.21.15.87:0/2696888650 conn(0x561cb221cd00 msgr2=0x561cb221ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.124+0000 7f7b2e72f800 1 -- 172.21.15.87:0/2696888650 shutdown_connections 2024-05-08T18:33:03.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.124+0000 7f7b2e72f800 1 -- 172.21.15.87:0/2696888650 wait complete. 2024-05-08T18:33:03.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.124+0000 7f7b2e72f800 1 Processor -- start 2024-05-08T18:33:03.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.124+0000 7f7b2e72f800 1 -- start start 2024-05-08T18:33:03.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.124+0000 7f7b2e72f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb22209a0 0x561cb20ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.124+0000 7f7b2e72f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561cb2221b00 con 0x561cb22209a0 2024-05-08T18:33:03.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.124+0000 7f7b2abef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb22209a0 0x561cb20ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.124+0000 7f7b2abef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb22209a0 0x561cb20ff6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52042/0 (socket says 172.21.15.87:52042) 2024-05-08T18:33:03.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.124+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 learned_addr learned my addr 172.21.15.87:0/1661607462 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.125+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cb20fdda0 con 0x561cb22209a0 2024-05-08T18:33:03.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.125+0000 7f7b2abef640 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb22209a0 0x561cb20ff6b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7b24052910 tx=0x7f7b24052940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.125+0000 7f79fbfff640 1 -- 172.21.15.87:0/1661607462 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b2402ac50 con 0x561cb22209a0 2024-05-08T18:33:03.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.125+0000 7f79fbfff640 1 -- 172.21.15.87:0/1661607462 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b24031070 con 0x561cb22209a0 2024-05-08T18:33:03.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.125+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cb20fe030 con 0x561cb22209a0 2024-05-08T18:33:03.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.125+0000 7f79fbfff640 1 -- 172.21.15.87:0/1661607462 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b24054430 con 0x561cb22209a0 2024-05-08T18:33:03.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.125+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cb20fe470 con 0x561cb22209a0 2024-05-08T18:33:03.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.126+0000 7f79fbfff640 1 -- 172.21.15.87:0/1661607462 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7b24013a60 con 0x561cb22209a0 2024-05-08T18:33:03.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.126+0000 7f7b2e72f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.126+0000 7f79fbfff640 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f79f403bba0 0x7f79f403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.126+0000 7f79fbfff640 1 -- 172.21.15.87:0/1661607462 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7b2400e040 con 0x561cb22209a0 2024-05-08T18:33:03.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.127+0000 7f7b2a3ee640 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f79f403bba0 0x7f79f403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.127+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561cb2235e20 0x561cb22382e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.127+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb2238a30 con 0x561cb2235e20 2024-05-08T18:33:03.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.127+0000 7f7b23fff640 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561cb2235e20 0x561cb22382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.127+0000 7f7b2a3ee640 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f79f403bba0 0x7f79f403e060 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c019f70 tx=0x7f7b1c045070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.127+0000 7f7b23fff640 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561cb2235e20 0x561cb22382e0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.127+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.127+0000 7f7b2e72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.127+0000 7f7b2e72f800 20 realm 2024-05-08T18:33:03.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.127+0000 7f7b2e72f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.127+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb2238e00 con 0x561cb2235e20 2024-05-08T18:33:03.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b2e72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b2e72f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:03.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b2e72f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb22396a0 con 0x561cb2235e20 2024-05-08T18:33:03.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b2e72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b2e72f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb2239a40 con 0x561cb2235e20 2024-05-08T18:33:03.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b2e72f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:03.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b2e72f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb22392f0 con 0x561cb2235e20 2024-05-08T18:33:03.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b2e72f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:03.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b2e72f800 20 searching for the correct realm 2024-05-08T18:33:03.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561cb223bef0 0x561cb223e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.128+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x561cb223bef0 2024-05-08T18:33:03.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.129+0000 7f7b2abef640 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561cb223bef0 0x561cb223e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.129+0000 7f7b2abef640 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561cb223bef0 0x561cb223e2e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.129+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b24029070 con 0x561cb223bef0 2024-05-08T18:33:03.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.129+0000 7f7b2abef640 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f7b24054800 0x7f7b2402c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.129+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x7f7b24054800 2024-05-08T18:33:03.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.129+0000 7f7b2a3ee640 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f7b24054800 0x7f7b2402c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.130+0000 7f7b2a3ee640 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f7b24054800 0x7f7b2402c480 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.130+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c02e070 con 0x7f7b24054800 2024-05-08T18:33:03.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.130+0000 7f7b2a3ee640 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7b1c00f070 0x7f7b1c01a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.130+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x7f7b1c00f070 2024-05-08T18:33:03.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.130+0000 7f7b23fff640 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7b1c00f070 0x7f7b1c01a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.131+0000 7f7b23fff640 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7b1c00f070 0x7f7b1c01a480 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.131+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.131+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x561cb2235e20 2024-05-08T18:33:03.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.131+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.131+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x561cb2235e20 2024-05-08T18:33:03.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.131+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.131+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x7f7b1c00f070 2024-05-08T18:33:03.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.132+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.132+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x7f7b1c00f070 2024-05-08T18:33:03.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.132+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.132+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x7f7b24054800 2024-05-08T18:33:03.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.132+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c02e070 con 0x7f7b24054800 2024-05-08T18:33:03.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.132+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x561cb223bef0 2024-05-08T18:33:03.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.132+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b24029070 con 0x561cb223bef0 2024-05-08T18:33:03.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.132+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x561cb2235e20 2024-05-08T18:33:03.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.133+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.133+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x7f7b1c00f070 2024-05-08T18:33:03.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.133+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.133+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x561cb2235e20 2024-05-08T18:33:03.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.133+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.133+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x7f7b24054800 2024-05-08T18:33:03.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.133+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7b1c02e070 con 0x7f7b24054800 2024-05-08T18:33:03.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.133+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x561cb223bef0 2024-05-08T18:33:03.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.134+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b24029070 con 0x561cb223bef0 2024-05-08T18:33:03.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.134+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x561cb223bef0 2024-05-08T18:33:03.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.134+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b24029070 con 0x561cb223bef0 2024-05-08T18:33:03.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.134+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x7f7b1c00f070 2024-05-08T18:33:03.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.134+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.134+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x561cb223bef0 2024-05-08T18:33:03.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.135+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b24029070 con 0x561cb223bef0 2024-05-08T18:33:03.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.135+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x561cb223bef0 2024-05-08T18:33:03.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.135+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b24029070 con 0x561cb223bef0 2024-05-08T18:33:03.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.135+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x561cb2235e20 2024-05-08T18:33:03.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.135+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.135+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x561cb2235e20 2024-05-08T18:33:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.135+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.135+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x7f7b1c00f070 2024-05-08T18:33:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.136+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.136+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x561cb223bef0 2024-05-08T18:33:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.136+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b24029070 con 0x561cb223bef0 2024-05-08T18:33:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.136+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x7f7b24054800 2024-05-08T18:33:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.136+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c02e070 con 0x7f7b24054800 2024-05-08T18:33:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.136+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x561cb2235e20 2024-05-08T18:33:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.136+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.136+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x7f7b1c00f070 2024-05-08T18:33:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.137+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.137+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x561cb223bef0 2024-05-08T18:33:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.137+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b24029070 con 0x561cb223bef0 2024-05-08T18:33:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.137+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x7f7b24054800 2024-05-08T18:33:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.137+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c02e070 con 0x7f7b24054800 2024-05-08T18:33:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.137+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x7f7b24054800 2024-05-08T18:33:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.137+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c02e070 con 0x7f7b24054800 2024-05-08T18:33:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.137+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x561cb223bef0 2024-05-08T18:33:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.137+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b24029070 con 0x561cb223bef0 2024-05-08T18:33:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.137+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x7f7b24054800 2024-05-08T18:33:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.138+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c02e070 con 0x7f7b24054800 2024-05-08T18:33:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.138+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x561cb2235e20 2024-05-08T18:33:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.138+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.138+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cb223e9b0 con 0x7f7b24054800 2024-05-08T18:33:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.138+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c02e070 con 0x7f7b24054800 2024-05-08T18:33:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.138+0000 7f7b2e72f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.138+0000 7f7b2e72f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:03.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.138+0000 7f7b2e72f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:03.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.138+0000 7f7b2e72f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:03.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.138+0000 7f7b2e72f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:03.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.138+0000 7f7b2e72f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:03.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.138+0000 7f7b2e72f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.138+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb223a960 con 0x561cb2235e20 2024-05-08T18:33:03.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.138+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.138+0000 7f7b2e72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.138+0000 7f7b2e72f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.138+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb223a5a0 con 0x561cb2235e20 2024-05-08T18:33:03.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b2e72f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:03.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b2e72f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb223b2c0 con 0x7f7b1c00f070 2024-05-08T18:33:03.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b2e72f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:03.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b2e72f800 20 zone default found 2024-05-08T18:33:03.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b2e72f800 4 Realm: () 2024-05-08T18:33:03.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b2e72f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:03.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b2e72f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:03.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b2e72f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:03.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b2e72f800 20 zonegroup default 2024-05-08T18:33:03.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b2e72f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb223f330 con 0x7f7b1c00f070 2024-05-08T18:33:03.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b2e72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b2e72f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.139+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb2240d70 con 0x561cb223bef0 2024-05-08T18:33:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.140+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b24029070 con 0x561cb223bef0 2024-05-08T18:33:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.140+0000 7f7b2e72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.140+0000 7f7b2e72f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.140+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb2241200 con 0x561cb223bef0 2024-05-08T18:33:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.140+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b24029070 con 0x561cb223bef0 2024-05-08T18:33:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.140+0000 7f7b2e72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.140+0000 7f7b2e72f800 20 started sync module instance, tier type = 2024-05-08T18:33:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.140+0000 7f7b2e72f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.140+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb22401a0 con 0x7f7b24054800 2024-05-08T18:33:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.141+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c02e070 con 0x7f7b24054800 2024-05-08T18:33:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.141+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94681247778192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb22409b0 con 0x7f7b24054800 2024-05-08T18:33:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.141+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2242190 con 0x561cb2235e20 2024-05-08T18:33:03.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.142+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94681247778192] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c02e070 con 0x7f7b24054800 2024-05-08T18:33:03.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.142+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.142+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94681247784064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2242580 con 0x561cb2235e20 2024-05-08T18:33:03.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.142+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2242fe0 con 0x561cb223bef0 2024-05-08T18:33:03.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.144+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b24029070 con 0x561cb223bef0 2024-05-08T18:33:03.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.144+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94681247784064] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.144+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94681247787712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2243880 con 0x561cb223bef0 2024-05-08T18:33:03.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.144+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb22416a0 con 0x7f7b24054800 2024-05-08T18:33:03.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.145+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c02e070 con 0x7f7b24054800 2024-05-08T18:33:03.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.145+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94681247792752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2244740 con 0x7f7b24054800 2024-05-08T18:33:03.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.145+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2245180 con 0x561cb2235e20 2024-05-08T18:33:03.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.145+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94681247787712] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b24029070 con 0x561cb223bef0 2024-05-08T18:33:03.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.146+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94681247792752] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c02e070 con 0x7f7b24054800 2024-05-08T18:33:03.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.146+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.146+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94681247793808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb22433d0 con 0x561cb2235e20 2024-05-08T18:33:03.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.146+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2245a60 con 0x7f7b1c00f070 2024-05-08T18:33:03.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.147+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94681247793808] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.147+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.147+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94681247796304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb22459a0 con 0x7f7b1c00f070 2024-05-08T18:33:03.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.147+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2246470 con 0x7f7b1c00f070 2024-05-08T18:33:03.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.148+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(56 notify.6 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.148+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94681247801280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2246890 con 0x7f7b1c00f070 2024-05-08T18:33:03.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.148+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2247340 con 0x7f7b1c00f070 2024-05-08T18:33:03.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.148+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94681247796304] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.149+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94681247801280] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.149+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.150+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94681247798512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2246e50 con 0x7f7b1c00f070 2024-05-08T18:33:03.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.150+0000 7f7b2e72f800 20 add_watcher() i=0 2024-05-08T18:33:03.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.150+0000 7f7b2e72f800 20 add_watcher() i=1 2024-05-08T18:33:03.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.150+0000 7f7b2e72f800 20 add_watcher() i=2 2024-05-08T18:33:03.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.150+0000 7f7b2e72f800 20 add_watcher() i=3 2024-05-08T18:33:03.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.150+0000 7f7b2e72f800 20 add_watcher() i=4 2024-05-08T18:33:03.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.150+0000 7f7b2e72f800 20 add_watcher() i=5 2024-05-08T18:33:03.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.150+0000 7f7b2e72f800 20 add_watcher() i=6 2024-05-08T18:33:03.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.151+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94681247798512] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.151+0000 7f7b2e72f800 20 add_watcher() i=7 2024-05-08T18:33:03.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.151+0000 7f7b2e72f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:03.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.151+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb224a250 con 0x561cb2235e20 2024-05-08T18:33:03.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.151+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.151+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94681247802336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2247770 con 0x561cb2235e20 2024-05-08T18:33:03.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.152+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94681247802336] v29'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.152+0000 7f79e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:03.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.152+0000 7f7b2e72f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:03.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.152+0000 7f7b2e72f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:03.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.152+0000 7f7b2e72f800 5 note: GC not initialized 2024-05-08T18:33:03.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.152+0000 7f795b7fe640 20 reqs_thread_entry: start 2024-05-08T18:33:03.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.152+0000 7f7b2e72f800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:03.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.153+0000 7f7b2e72f800 20 Filter name: none 2024-05-08T18:33:03.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.153+0000 7f79597fa640 20 reqs_thread_entry: start 2024-05-08T18:33:03.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.153+0000 7f7b2e72f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.153+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb227d1a0 con 0x561cb2235e20 2024-05-08T18:33:03.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.153+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.153+0000 7f7b2e72f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:33:03.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.153+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cb227e590 con 0x7f7b1c00f070 2024-05-08T18:33:03.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.154+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.155+0000 7f79e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:03.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.155+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94681247802336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2247700 con 0x561cb2235e20 2024-05-08T18:33:03.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.156+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94681247802336] v29'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.156+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94681247778192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb22463e0 con 0x7f7b24054800 2024-05-08T18:33:03.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.157+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94681247778192] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c02e070 con 0x7f7b24054800 2024-05-08T18:33:03.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.157+0000 7f7b2e72f800 20 remove_watcher() i=0 2024-05-08T18:33:03.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.157+0000 7f7b2e72f800 2 removed watcher, disabling cache 2024-05-08T18:33:03.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.157+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94681247784064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2240590 con 0x561cb2235e20 2024-05-08T18:33:03.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.158+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94681247784064] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.158+0000 7f7b2e72f800 20 remove_watcher() i=1 2024-05-08T18:33:03.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.158+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94681247787712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2240590 con 0x561cb223bef0 2024-05-08T18:33:03.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.159+0000 7f7b2abef640 1 -- 172.21.15.87:0/1661607462 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94681247787712] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b24029070 con 0x561cb223bef0 2024-05-08T18:33:03.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.159+0000 7f7b2e72f800 20 remove_watcher() i=2 2024-05-08T18:33:03.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.159+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94681247792752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2240590 con 0x7f7b24054800 2024-05-08T18:33:03.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.160+0000 7f7b2a3ee640 1 -- 172.21.15.87:0/1661607462 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94681247792752] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c02e070 con 0x7f7b24054800 2024-05-08T18:33:03.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.160+0000 7f7b2e72f800 20 remove_watcher() i=3 2024-05-08T18:33:03.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.160+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94681247793808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2243e70 con 0x561cb2235e20 2024-05-08T18:33:03.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.162+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94681247793808] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x561cb2235e20 2024-05-08T18:33:03.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.162+0000 7f7b2e72f800 20 remove_watcher() i=4 2024-05-08T18:33:03.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.162+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94681247796304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2240590 con 0x7f7b1c00f070 2024-05-08T18:33:03.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.163+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94681247796304] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.163+0000 7f7b2e72f800 20 remove_watcher() i=5 2024-05-08T18:33:03.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.163+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94681247801280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2240590 con 0x7f7b1c00f070 2024-05-08T18:33:03.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.164+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94681247801280] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.164+0000 7f7b2e72f800 20 remove_watcher() i=6 2024-05-08T18:33:03.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.164+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94681247798512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cb2240590 con 0x7f7b1c00f070 2024-05-08T18:33:03.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94681247798512] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1405a040 con 0x7f7b1c00f070 2024-05-08T18:33:03.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 20 remove_watcher() i=7 2024-05-08T18:33:03.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7b1c00f070 msgr2=0x7f7b1c01a480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7b1c00f070 0x7f7b1c01a480 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561cb2235e20 msgr2=0x561cb22382e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561cb2235e20 0x561cb22382e0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f7b24054800 msgr2=0x7f7b2402c480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f7b24054800 0x7f7b2402c480 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561cb223bef0 msgr2=0x561cb223e2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561cb223bef0 0x561cb223e2e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f79f403bba0 msgr2=0x7f79f403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f79f403bba0 0x7f79f403e060 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c019f70 tx=0x7f7b1c045070 comp rx=0 tx=0).stop 2024-05-08T18:33:03.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb22209a0 msgr2=0x561cb20ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb22209a0 0x561cb20ff6b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7b24052910 tx=0x7f7b24052940 comp rx=0 tx=0).stop 2024-05-08T18:33:03.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b23fff640 1 -- 172.21.15.87:0/1661607462 reap_dead start 2024-05-08T18:33:03.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 shutdown_connections 2024-05-08T18:33:03.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1661607462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb22209a0 0x561cb20ff6b0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 >> 172.21.15.87:0/1661607462 conn(0x561cb221cd00 msgr2=0x561cb221a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 shutdown_connections 2024-05-08T18:33:03.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.165+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1661607462 wait complete. 2024-05-08T18:33:03.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 -- 172.21.15.87:0/4080344219 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a0403bb50 msgr2=0x7f7a0403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/4080344219 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a0403bb50 0x7f7a0403e010 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x561cb2200cf0 tx=0x7f7b1c051820 comp rx=0 tx=0).stop 2024-05-08T18:33:03.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 -- 172.21.15.87:0/4080344219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb2213680 msgr2=0x561cb2213aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/4080344219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb2213680 0x561cb2213aa0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x561cb21f9570 tx=0x7f7b240178e0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 -- 172.21.15.87:0/4080344219 shutdown_connections 2024-05-08T18:33:03.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/4080344219 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a0403bb50 0x7f7a0403e010 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/4080344219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb2213680 0x561cb2213aa0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 -- 172.21.15.87:0/4080344219 >> 172.21.15.87:0/4080344219 conn(0x561cb2207720 msgr2=0x561cb2207b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 -- 172.21.15.87:0/4080344219 shutdown_connections 2024-05-08T18:33:03.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 -- 172.21.15.87:0/4080344219 wait complete. 2024-05-08T18:33:03.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1600188196 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561cb2202ad0 msgr2=0x561cb2204ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561cb2202ad0 0x561cb2204ec0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1600188196 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561cb2103880 msgr2=0x561cb21ff3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561cb2103880 0x561cb21ff3b0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1600188196 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a1003bb50 msgr2=0x7f7a1003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a1003bb50 0x7f7a1003e010 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7b14054000 tx=0x7f7b1404e000 comp rx=0 tx=0).stop 2024-05-08T18:33:03.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1600188196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb20ffd70 msgr2=0x561cb21f81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb20ffd70 0x561cb21f81c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00b700 tx=0x7f7b1c000bc0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1600188196 shutdown_connections 2024-05-08T18:33:03.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561cb2103880 0x561cb21ff3b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561cb2202ad0 0x561cb2204ec0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a1003bb50 0x7f7a1003e010 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 --2- 172.21.15.87:0/1600188196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cb20ffd70 0x561cb21f81c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1600188196 >> 172.21.15.87:0/1600188196 conn(0x561cb20f96a0 msgr2=0x561cb21ea740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1600188196 shutdown_connections 2024-05-08T18:33:03.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.166+0000 7f7b2e72f800 1 -- 172.21.15.87:0/1600188196 wait complete. 2024-05-08T18:33:03.173 INFO:teuthology.orchestra.run.smithi087.stdout:{"entries":[],"summary":[]} 2024-05-08T18:33:03.173 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-05-08T18:33:03.173 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-05-08T18:33:03.173 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-05-08T18:33:03.174 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-05-08T18:33:03.218 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:03.218 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:03.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.221+0000 7ff7e07a2800 1 Processor -- start 2024-05-08T18:33:03.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.221+0000 7ff7e07a2800 1 -- start start 2024-05-08T18:33:03.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.221+0000 7ff7e07a2800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55bde38f76b0 0x55bde39001b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.221+0000 7ff7e07a2800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bde386adb0 con 0x55bde38f5b70 2024-05-08T18:33:03.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.221+0000 7ff7e07a2800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55bde3797e20 con 0x55bde38f76b0 2024-05-08T18:33:03.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.221+0000 7ff7dda99640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55bde38f76b0 0x55bde39001b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.221+0000 7ff7de29a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55bde38f5b70 0x55bde38f5f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58100/0 (socket says 172.21.15.87:58100) 2024-05-08T18:33:03.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.221+0000 7ff7de29a640 1 -- 172.21.15.87:0/1533588037 learned_addr learned my addr 172.21.15.87:0/1533588037 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:33:03.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.221+0000 7ff7dda99640 1 --2- 172.21.15.87:0/1533588037 >> v2:172.21.15.53:3300/0 conn(0x55bde38f76b0 0x55bde39001b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52058/0 (socket says 172.21.15.87:52058) 2024-05-08T18:33:03.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.222+0000 7ff7dda99640 1 -- 172.21.15.87:0/1533588037 >> v1:172.21.15.53:6789/0 conn(0x55bde38f5b70 legacy=0x55bde38f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.222+0000 7ff7dda99640 1 -- 172.21.15.87:0/1533588037 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bde3901700 con 0x55bde38f76b0 2024-05-08T18:33:03.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.224+0000 7ff7dda99640 1 --2- 172.21.15.87:0/1533588037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f76b0 0x55bde39001b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800a470 tx=0x7ff7c801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658a3df917ae0560 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.224+0000 7ff7dd298640 1 -- 172.21.15.87:0/1533588037 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7c8057070 con 0x55bde38f76b0 2024-05-08T18:33:03.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.224+0000 7ff7dd298640 1 -- 172.21.15.87:0/1533588037 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7c804adc0 con 0x55bde38f76b0 2024-05-08T18:33:03.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.224+0000 7ff7dd298640 1 -- 172.21.15.87:0/1533588037 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7c8052590 con 0x55bde38f76b0 2024-05-08T18:33:03.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.224+0000 7ff7e07a2800 1 -- 172.21.15.87:0/1533588037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f76b0 msgr2=0x55bde39001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.224+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/1533588037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f76b0 0x55bde39001b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800a470 tx=0x7ff7c801ce90 comp rx=0 tx=0).stop 2024-05-08T18:33:03.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.224+0000 7ff7e07a2800 1 -- 172.21.15.87:0/1533588037 shutdown_connections 2024-05-08T18:33:03.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.224+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/1533588037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f76b0 0x55bde39001b0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.224+0000 7ff7e07a2800 1 -- 172.21.15.87:0/1533588037 >> 172.21.15.87:0/1533588037 conn(0x55bde38f16b0 msgr2=0x55bde38f3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.224+0000 7ff7e07a2800 1 -- 172.21.15.87:0/1533588037 shutdown_connections 2024-05-08T18:33:03.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.224+0000 7ff7e07a2800 1 -- 172.21.15.87:0/1533588037 wait complete. 2024-05-08T18:33:03.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.237+0000 7ff7e07a2800 1 Processor -- start 2024-05-08T18:33:03.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.238+0000 7ff7e07a2800 1 -- start start 2024-05-08T18:33:03.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.238+0000 7ff7e07a2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f5b70 0x55bde39ea980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.238+0000 7ff7e07a2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bde38425c0 con 0x55bde38f5b70 2024-05-08T18:33:03.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.238+0000 7ff7de29a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f5b70 0x55bde39ea980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.238+0000 7ff7de29a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f5b70 0x55bde39ea980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52070/0 (socket says 172.21.15.87:52070) 2024-05-08T18:33:03.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.238+0000 7ff7de29a640 1 -- 172.21.15.87:0/645582759 learned_addr learned my addr 172.21.15.87:0/645582759 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.238+0000 7ff7de29a640 1 -- 172.21.15.87:0/645582759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bde39eaf50 con 0x55bde38f5b70 2024-05-08T18:33:03.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.239+0000 7ff7de29a640 1 --2- 172.21.15.87:0/645582759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f5b70 0x55bde39ea980 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80017a0 tx=0x7ff7d8001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8b12aad6c249e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.239+0000 7ff6cc608640 1 -- 172.21.15.87:0/645582759 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7d8004520 con 0x55bde38f5b70 2024-05-08T18:33:03.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.239+0000 7ff6cc608640 1 -- 172.21.15.87:0/645582759 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d80046c0 con 0x55bde38f5b70 2024-05-08T18:33:03.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.239+0000 7ff6cc608640 1 -- 172.21.15.87:0/645582759 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7d8004a00 con 0x55bde38f5b70 2024-05-08T18:33:03.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.240+0000 7ff7e07a2800 1 -- 172.21.15.87:0/645582759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f5b70 msgr2=0x55bde39ea980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.240+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/645582759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f5b70 0x55bde39ea980 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80017a0 tx=0x7ff7d8001c60 comp rx=0 tx=0).stop 2024-05-08T18:33:03.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.240+0000 7ff7e07a2800 1 -- 172.21.15.87:0/645582759 shutdown_connections 2024-05-08T18:33:03.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.240+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/645582759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f5b70 0x55bde39ea980 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.240+0000 7ff7e07a2800 1 -- 172.21.15.87:0/645582759 >> 172.21.15.87:0/645582759 conn(0x55bde38f16b0 msgr2=0x55bde39e62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.240+0000 7ff7e07a2800 1 -- 172.21.15.87:0/645582759 shutdown_connections 2024-05-08T18:33:03.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.240+0000 7ff7e07a2800 1 -- 172.21.15.87:0/645582759 wait complete. 2024-05-08T18:33:03.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.240+0000 7ff7e07a2800 1 Processor -- start 2024-05-08T18:33:03.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.240+0000 7ff7e07a2800 1 -- start start 2024-05-08T18:33:03.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.240+0000 7ff7e07a2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f5b70 0x55bde39f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.240+0000 7ff7e07a2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bde39009c0 con 0x55bde38f5b70 2024-05-08T18:33:03.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.240+0000 7ff7de29a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f5b70 0x55bde39f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.240+0000 7ff7de29a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f5b70 0x55bde39f2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52078/0 (socket says 172.21.15.87:52078) 2024-05-08T18:33:03.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.240+0000 7ff7de29a640 1 -- 172.21.15.87:0/2804817545 learned_addr learned my addr 172.21.15.87:0/2804817545 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.241+0000 7ff7de29a640 1 -- 172.21.15.87:0/2804817545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bde39f2a60 con 0x55bde38f5b70 2024-05-08T18:33:03.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.241+0000 7ff7de29a640 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f5b70 0x55bde39f2520 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8000f80 tx=0x7ff7d8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.241+0000 7ff6cae05640 1 -- 172.21.15.87:0/2804817545 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7d8022020 con 0x55bde38f5b70 2024-05-08T18:33:03.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.241+0000 7ff6cae05640 1 -- 172.21.15.87:0/2804817545 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d8014870 con 0x55bde38f5b70 2024-05-08T18:33:03.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.241+0000 7ff7e07a2800 1 -- 172.21.15.87:0/2804817545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bde39f2cf0 con 0x55bde38f5b70 2024-05-08T18:33:03.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.241+0000 7ff6cae05640 1 -- 172.21.15.87:0/2804817545 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7d8014bb0 con 0x55bde38f5b70 2024-05-08T18:33:03.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.241+0000 7ff7e07a2800 1 -- 172.21.15.87:0/2804817545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bde39f5950 con 0x55bde38f5b70 2024-05-08T18:33:03.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.242+0000 7ff6cae05640 1 -- 172.21.15.87:0/2804817545 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff7d8025020 con 0x55bde38f5b70 2024-05-08T18:33:03.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.242+0000 7ff6cae05640 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6c403bb50 0x7ff6c403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.242+0000 7ff6cae05640 1 -- 172.21.15.87:0/2804817545 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff7d8018030 con 0x55bde38f5b70 2024-05-08T18:33:03.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.242+0000 7ff7dda99640 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6c403bb50 0x7ff6c403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.242+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bde38f76b0 0x55bde39f9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.242+0000 7ff7e07a2800 1 -- 172.21.15.87:0/2804817545 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde39f9ca0 con 0x55bde38f76b0 2024-05-08T18:33:03.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.243+0000 7ff7dea9b640 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bde38f76b0 0x55bde39f9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.243+0000 7ff7dda99640 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6c403bb50 0x7ff6c403e010 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8054000 tx=0x7ff7c804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.243+0000 7ff7dea9b640 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bde38f76b0 0x55bde39f9710 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.243+0000 7ff7dea9b640 1 -- 172.21.15.87:0/2804817545 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7d00083e0 con 0x55bde38f76b0 2024-05-08T18:33:03.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.243+0000 7ff7e07a2800 1 -- 172.21.15.87:0/2804817545 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde39f6cc0 con 0x55bde38f76b0 2024-05-08T18:33:03.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.243+0000 7ff7dea9b640 1 -- 172.21.15.87:0/2804817545 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff7d00083e0 con 0x55bde38f76b0 2024-05-08T18:33:03.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.243+0000 7ff7e07a2800 1 -- 172.21.15.87:0/2804817545 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde39fbac0 con 0x55bde38f76b0 2024-05-08T18:33:03.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.244+0000 7ff7dea9b640 1 -- 172.21.15.87:0/2804817545 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff7d00083e0 con 0x55bde38f76b0 2024-05-08T18:33:03.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.244+0000 7ff7e07a2800 1 -- 172.21.15.87:0/2804817545 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde39facf0 con 0x55bde38f76b0 2024-05-08T18:33:03.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.244+0000 7ff7dea9b640 1 -- 172.21.15.87:0/2804817545 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff7d00083e0 con 0x55bde38f76b0 2024-05-08T18:33:03.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.244+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55bde39fce70 0x55bde39ff260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.244+0000 7ff7e07a2800 1 -- 172.21.15.87:0/2804817545 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde39ff7a0 con 0x55bde39fce70 2024-05-08T18:33:03.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.244+0000 7ff7de29a640 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55bde39fce70 0x55bde39ff260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.245+0000 7ff7de29a640 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55bde39fce70 0x55bde39ff260 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.245+0000 7ff7de29a640 1 -- 172.21.15.87:0/2804817545 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff7d801b070 con 0x55bde39fce70 2024-05-08T18:33:03.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.245+0000 7ff7e07a2800 1 Processor -- start 2024-05-08T18:33:03.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.245+0000 7ff7e07a2800 1 -- start start 2024-05-08T18:33:03.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.245+0000 7ff7e07a2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a0da20 0x55bde3a0de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.245+0000 7ff7e07a2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bde37e8fc0 con 0x55bde3a0da20 2024-05-08T18:33:03.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.246+0000 7ff7dea9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a0da20 0x55bde3a0de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.246+0000 7ff7dea9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a0da20 0x55bde3a0de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52082/0 (socket says 172.21.15.87:52082) 2024-05-08T18:33:03.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.246+0000 7ff7dea9b640 1 -- 172.21.15.87:0/449967839 learned_addr learned my addr 172.21.15.87:0/449967839 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.246+0000 7ff7dea9b640 1 -- 172.21.15.87:0/449967839 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bde3a0e380 con 0x55bde3a0da20 2024-05-08T18:33:03.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.246+0000 7ff7dea9b640 1 --2- 172.21.15.87:0/449967839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a0da20 0x55bde3a0de40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x55bde39f38d0 tx=0x7ff7d000ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.246+0000 7ff6c3fff640 1 -- 172.21.15.87:0/449967839 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7d001c070 con 0x55bde3a0da20 2024-05-08T18:33:03.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.246+0000 7ff6c3fff640 1 -- 172.21.15.87:0/449967839 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d000bdc0 con 0x55bde3a0da20 2024-05-08T18:33:03.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.246+0000 7ff7e07a2800 1 -- 172.21.15.87:0/449967839 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bde3a0edf0 con 0x55bde3a0da20 2024-05-08T18:33:03.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.246+0000 7ff6c3fff640 1 -- 172.21.15.87:0/449967839 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7d0018540 con 0x55bde3a0da20 2024-05-08T18:33:03.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.246+0000 7ff7e07a2800 1 -- 172.21.15.87:0/449967839 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bde3a0f2f0 con 0x55bde3a0da20 2024-05-08T18:33:03.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.247+0000 7ff6c3fff640 1 -- 172.21.15.87:0/449967839 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff7d001f070 con 0x55bde3a0da20 2024-05-08T18:33:03.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.247+0000 7ff6c3fff640 1 --2- 172.21.15.87:0/449967839 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6b803bb50 0x7ff6b803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.248+0000 7ff6c3fff640 1 -- 172.21.15.87:0/449967839 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff7d0054710 con 0x55bde3a0da20 2024-05-08T18:33:03.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.248+0000 7ff7de29a640 1 --2- 172.21.15.87:0/449967839 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6b803bb50 0x7ff6b803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.248+0000 7ff7e07a2800 1 Processor -- start 2024-05-08T18:33:03.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.248+0000 7ff7de29a640 1 --2- 172.21.15.87:0/449967839 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6b803bb50 0x7ff6b803e010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800d010 tx=0x7ff7d804c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.248+0000 7ff7e07a2800 1 -- start start 2024-05-08T18:33:03.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.248+0000 7ff7e07a2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a1ae10 0x55bde3a1b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.248+0000 7ff7e07a2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bde39eb2d0 con 0x55bde3a1ae10 2024-05-08T18:33:03.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.248+0000 7ff7dea9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a1ae10 0x55bde3a1b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.248+0000 7ff7dea9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a1ae10 0x55bde3a1b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52086/0 (socket says 172.21.15.87:52086) 2024-05-08T18:33:03.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.248+0000 7ff7dea9b640 1 -- 172.21.15.87:0/106541854 learned_addr learned my addr 172.21.15.87:0/106541854 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.249+0000 7ff7dea9b640 1 -- 172.21.15.87:0/106541854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bde3a1b800 con 0x55bde3a1ae10 2024-05-08T18:33:03.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.249+0000 7ff7dea9b640 1 --2- 172.21.15.87:0/106541854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a1ae10 0x55bde3a1b230 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0040420 tx=0x7ff7d0040450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32dbb45a20cce77b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.249+0000 7ff6c1ffb640 1 -- 172.21.15.87:0/106541854 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7d004f070 con 0x55bde3a1ae10 2024-05-08T18:33:03.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.249+0000 7ff6c1ffb640 1 -- 172.21.15.87:0/106541854 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d0052db0 con 0x55bde3a1ae10 2024-05-08T18:33:03.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.249+0000 7ff6c1ffb640 1 -- 172.21.15.87:0/106541854 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7d00173a0 con 0x55bde3a1ae10 2024-05-08T18:33:03.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.250+0000 7ff7e07a2800 1 -- 172.21.15.87:0/106541854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a1ae10 msgr2=0x55bde3a1b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.250+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/106541854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a1ae10 0x55bde3a1b230 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0040420 tx=0x7ff7d0040450 comp rx=0 tx=0).stop 2024-05-08T18:33:03.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.250+0000 7ff7e07a2800 1 -- 172.21.15.87:0/106541854 shutdown_connections 2024-05-08T18:33:03.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.250+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/106541854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a1ae10 0x55bde3a1b230 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.250+0000 7ff7e07a2800 1 -- 172.21.15.87:0/106541854 >> 172.21.15.87:0/106541854 conn(0x55bde3a170e0 msgr2=0x55bde3a15140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.250+0000 7ff7e07a2800 1 -- 172.21.15.87:0/106541854 shutdown_connections 2024-05-08T18:33:03.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.250+0000 7ff7e07a2800 1 -- 172.21.15.87:0/106541854 wait complete. 2024-05-08T18:33:03.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.250+0000 7ff7e07a2800 1 Processor -- start 2024-05-08T18:33:03.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.250+0000 7ff7e07a2800 1 -- start start 2024-05-08T18:33:03.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.250+0000 7ff7e07a2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a1ae10 0x55bde3a22290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.250+0000 7ff7e07a2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bde3a1bf50 con 0x55bde3a1ae10 2024-05-08T18:33:03.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.250+0000 7ff7dea9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a1ae10 0x55bde3a22290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.250+0000 7ff7dea9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a1ae10 0x55bde3a22290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52100/0 (socket says 172.21.15.87:52100) 2024-05-08T18:33:03.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.250+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 learned_addr learned my addr 172.21.15.87:0/254430200 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.251+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bde3a227d0 con 0x55bde3a1ae10 2024-05-08T18:33:03.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.251+0000 7ff7dea9b640 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a1ae10 0x55bde3a22290 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0051930 tx=0x7ff7d00529f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.251+0000 7ff6affff640 1 -- 172.21.15.87:0/254430200 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7d0029c70 con 0x55bde3a1ae10 2024-05-08T18:33:03.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.251+0000 7ff6affff640 1 -- 172.21.15.87:0/254430200 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d004a040 con 0x55bde3a1ae10 2024-05-08T18:33:03.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.251+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bde3a22a60 con 0x55bde3a1ae10 2024-05-08T18:33:03.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.251+0000 7ff6affff640 1 -- 172.21.15.87:0/254430200 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7d0054070 con 0x55bde3a1ae10 2024-05-08T18:33:03.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.251+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bde3a25710 con 0x55bde3a1ae10 2024-05-08T18:33:03.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.252+0000 7ff6affff640 1 -- 172.21.15.87:0/254430200 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff7d0054210 con 0x55bde3a1ae10 2024-05-08T18:33:03.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.252+0000 7ff6affff640 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6a803bba0 0x7ff6a803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.252+0000 7ff6affff640 1 -- 172.21.15.87:0/254430200 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff7d0034d20 con 0x55bde3a1ae10 2024-05-08T18:33:03.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.252+0000 7ff7de29a640 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6a803bba0 0x7ff6a803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.252+0000 7ff7de29a640 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6a803bba0 0x7ff6a803e060 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8026780 tx=0x7ff7d804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.253+0000 7ff7e07a2800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.253+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bde3a2dd50 0x55bde3a30210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.253+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a30960 con 0x55bde3a2dd50 2024-05-08T18:33:03.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.253+0000 7ff7dda99640 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bde3a2dd50 0x55bde3a30210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.253+0000 7ff7dda99640 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bde3a2dd50 0x55bde3a30210 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.253+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.253+0000 7ff7e07a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.253+0000 7ff7e07a2800 20 realm 2024-05-08T18:33:03.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.253+0000 7ff7e07a2800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.253+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a30d90 con 0x55bde3a2dd50 2024-05-08T18:33:03.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.253+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.253+0000 7ff7e07a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.253+0000 7ff7e07a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:03.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.253+0000 7ff7e07a2800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.253+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a31660 con 0x55bde3a2dd50 2024-05-08T18:33:03.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.254+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.254+0000 7ff7e07a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.254+0000 7ff7e07a2800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.254+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a31a00 con 0x55bde3a2dd50 2024-05-08T18:33:03.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.254+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.254+0000 7ff7e07a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:03.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.254+0000 7ff7e07a2800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.254+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a32250 con 0x55bde3a2dd50 2024-05-08T18:33:03.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.254+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.254+0000 7ff7e07a2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.254+0000 7ff7e07a2800 20 searching for the correct realm 2024-05-08T18:33:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.254+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55bde3a33fc0 0x55bde3a363b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.254+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a369e0 con 0x55bde3a33fc0 2024-05-08T18:33:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.254+0000 7ff7dea9b640 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55bde3a33fc0 0x55bde3a363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.255+0000 7ff7dea9b640 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55bde3a33fc0 0x55bde3a363b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.255+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.255+0000 7ff7dea9b640 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff7d0021070 0x7ff7d0054ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.255+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a369e0 con 0x7ff7d0021070 2024-05-08T18:33:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.255+0000 7ff7de29a640 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff7d0021070 0x7ff7d0054ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.255+0000 7ff7de29a640 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff7d0021070 0x7ff7d0054ab0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.256+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.256+0000 7ff7de29a640 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff7d8027020 0x7ff7d80267f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.256+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a369e0 con 0x7ff7d8027020 2024-05-08T18:33:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.256+0000 7ff7dda99640 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff7d8027020 0x7ff7d80267f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.256+0000 7ff7dda99640 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff7d8027020 0x7ff7d80267f0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.257+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.257+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a32250 con 0x55bde3a2dd50 2024-05-08T18:33:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.257+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.257+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a32250 con 0x55bde3a2dd50 2024-05-08T18:33:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.257+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.257+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a32250 con 0x7ff7d8027020 2024-05-08T18:33:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.258+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.258+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a32250 con 0x7ff7d8027020 2024-05-08T18:33:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.258+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.258+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a32250 con 0x7ff7d0021070 2024-05-08T18:33:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.258+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.258+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a32250 con 0x55bde3a33fc0 2024-05-08T18:33:03.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.258+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.258+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a32250 con 0x55bde3a2dd50 2024-05-08T18:33:03.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.259+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.259+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a32250 con 0x7ff7d8027020 2024-05-08T18:33:03.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.259+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.259+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a32250 con 0x55bde3a2dd50 2024-05-08T18:33:03.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.259+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.259+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a32250 con 0x7ff7d0021070 2024-05-08T18:33:03.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.259+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.259+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a32250 con 0x55bde3a33fc0 2024-05-08T18:33:03.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.260+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.260+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a32250 con 0x55bde3a33fc0 2024-05-08T18:33:03.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.260+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.260+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff7d0060040 con 0x7ff7d8027020 2024-05-08T18:33:03.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.260+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.260+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff7d0060040 con 0x55bde3a33fc0 2024-05-08T18:33:03.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.260+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.260+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff7d0060040 con 0x55bde3a33fc0 2024-05-08T18:33:03.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.261+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.261+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff7d0060040 con 0x55bde3a2dd50 2024-05-08T18:33:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.261+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.261+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff7d0060040 con 0x55bde3a2dd50 2024-05-08T18:33:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.261+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.261+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff7d0060040 con 0x7ff7d8027020 2024-05-08T18:33:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.262+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.262+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff7d0060040 con 0x55bde3a33fc0 2024-05-08T18:33:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.262+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.262+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff7d0060040 con 0x7ff7d0021070 2024-05-08T18:33:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.262+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.262+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff7d0060040 con 0x55bde3a2dd50 2024-05-08T18:33:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.262+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.262+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff7d0060040 con 0x7ff7d8027020 2024-05-08T18:33:03.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.263+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.263+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff7d0060040 con 0x55bde3a33fc0 2024-05-08T18:33:03.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.263+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.263+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff7d0060040 con 0x7ff7d0021070 2024-05-08T18:33:03.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.263+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.263+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff7d0060040 con 0x7ff7d0021070 2024-05-08T18:33:03.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.263+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.263+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff7d0060040 con 0x55bde3a33fc0 2024-05-08T18:33:03.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff7d0060040 con 0x7ff7d0021070 2024-05-08T18:33:03.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff7d0060040 con 0x55bde3a2dd50 2024-05-08T18:33:03.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff7d0060040 con 0x7ff7d0021070 2024-05-08T18:33:03.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7e07a2800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:03.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7e07a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:03.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7e07a2800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:03.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7e07a2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:03.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7e07a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:03.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7e07a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:03.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7e07a2800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a32aa0 con 0x55bde3a2dd50 2024-05-08T18:33:03.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7e07a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7e07a2800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.264+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a32e90 con 0x55bde3a2dd50 2024-05-08T18:33:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.265+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.265+0000 7ff7e07a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.265+0000 7ff7e07a2800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.265+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a32e90 con 0x7ff7d8027020 2024-05-08T18:33:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.265+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.265+0000 7ff7e07a2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.265+0000 7ff7e07a2800 20 zone default found 2024-05-08T18:33:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.265+0000 7ff7e07a2800 4 Realm: () 2024-05-08T18:33:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.265+0000 7ff7e07a2800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.265+0000 7ff7e07a2800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.265+0000 7ff7e07a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.265+0000 7ff7e07a2800 20 zonegroup default 2024-05-08T18:33:03.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.265+0000 7ff7e07a2800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.265+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a326a0 con 0x7ff7d8027020 2024-05-08T18:33:03.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.266+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.266+0000 7ff7e07a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.266+0000 7ff7e07a2800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.266+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a38840 con 0x55bde3a33fc0 2024-05-08T18:33:03.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.266+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.266+0000 7ff7e07a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.266+0000 7ff7e07a2800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.266+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a38be0 con 0x55bde3a33fc0 2024-05-08T18:33:03.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.266+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.266+0000 7ff7e07a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.266+0000 7ff7e07a2800 20 started sync module instance, tier type = 2024-05-08T18:33:03.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.266+0000 7ff7e07a2800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:03.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.266+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a37ce0 con 0x7ff7d0021070 2024-05-08T18:33:03.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.268+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.268+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94274056321072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a38be0 con 0x7ff7d0021070 2024-05-08T18:33:03.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.268+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a39470 con 0x55bde3a2dd50 2024-05-08T18:33:03.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.269+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94274056321072] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.269+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.269+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94274056323280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a39860 con 0x55bde3a2dd50 2024-05-08T18:33:03.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.269+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a3a2c0 con 0x55bde3a33fc0 2024-05-08T18:33:03.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.270+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94274056323280] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.270+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.270+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94274056327040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a3a2c0 con 0x55bde3a33fc0 2024-05-08T18:33:03.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.270+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a3ad30 con 0x7ff7d0021070 2024-05-08T18:33:03.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.271+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.271+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94274056333344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a3b600 con 0x7ff7d0021070 2024-05-08T18:33:03.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.272+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a3c0e0 con 0x55bde3a2dd50 2024-05-08T18:33:03.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.272+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94274056327040] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.273+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.273+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94274056333344] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.273+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94274056338416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a3c4d0 con 0x55bde3a2dd50 2024-05-08T18:33:03.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.273+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a3b150 con 0x7ff7d8027020 2024-05-08T18:33:03.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.273+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94274056338416] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.274+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.274+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94274056335696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a3c9e0 con 0x7ff7d8027020 2024-05-08T18:33:03.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.274+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a3c9e0 con 0x7ff7d8027020 2024-05-08T18:33:03.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.275+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94274056335696] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.275+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.275+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94274056330656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a3d3a0 con 0x7ff7d8027020 2024-05-08T18:33:03.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.275+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a3dd60 con 0x7ff7d8027020 2024-05-08T18:33:03.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.276+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94274056330656] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.276+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.276+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94274056343760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a3dd60 con 0x7ff7d8027020 2024-05-08T18:33:03.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.276+0000 7ff7e07a2800 20 add_watcher() i=0 2024-05-08T18:33:03.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.276+0000 7ff7e07a2800 20 add_watcher() i=1 2024-05-08T18:33:03.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.276+0000 7ff7e07a2800 20 add_watcher() i=2 2024-05-08T18:33:03.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.276+0000 7ff7e07a2800 20 add_watcher() i=3 2024-05-08T18:33:03.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.276+0000 7ff7e07a2800 20 add_watcher() i=4 2024-05-08T18:33:03.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.276+0000 7ff7e07a2800 20 add_watcher() i=5 2024-05-08T18:33:03.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.276+0000 7ff7e07a2800 20 add_watcher() i=6 2024-05-08T18:33:03.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.277+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94274056343760] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.277+0000 7ff7e07a2800 20 add_watcher() i=7 2024-05-08T18:33:03.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.277+0000 7ff7e07a2800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:03.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.277+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a411c0 con 0x55bde3a2dd50 2024-05-08T18:33:03.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.277+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.277+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94274056358768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a3df80 con 0x55bde3a2dd50 2024-05-08T18:33:03.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.278+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94274056358768] v29'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.279+0000 7ff694fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:03.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.279+0000 7ff7e07a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:03.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.279+0000 7ff7e07a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:03.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.279+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a402e0 con 0x55bde3a2dd50 2024-05-08T18:33:03.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.280+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.280+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4a280 con 0x7ff7d8027020 2024-05-08T18:33:03.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.281+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.281+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4a730 con 0x55bde3a33fc0 2024-05-08T18:33:03.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.282+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.282+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4a730 con 0x55bde3a2dd50 2024-05-08T18:33:03.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.283+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'234 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.283+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4aca0 con 0x7ff7d0021070 2024-05-08T18:33:03.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.284+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.284+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4a6a0 con 0x55bde3a33fc0 2024-05-08T18:33:03.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.285+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'50 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.285+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4b340 con 0x55bde3a2dd50 2024-05-08T18:33:03.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.286+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.286+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4aec0 con 0x7ff7d8027020 2024-05-08T18:33:03.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.287+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.287+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4aec0 con 0x7ff7d0021070 2024-05-08T18:33:03.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.289+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.289+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4b340 con 0x55bde3a33fc0 2024-05-08T18:33:03.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.289+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.290+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4b340 con 0x7ff7d0021070 2024-05-08T18:33:03.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.290+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.290+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4b340 con 0x7ff7d8027020 2024-05-08T18:33:03.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.292+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.292+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4b340 con 0x7ff7d0021070 2024-05-08T18:33:03.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.293+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.293+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4b340 con 0x7ff7d8027020 2024-05-08T18:33:03.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.294+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.294+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4b340 con 0x55bde3a2dd50 2024-05-08T18:33:03.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.295+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'235 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.295+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4b340 con 0x55bde3a33fc0 2024-05-08T18:33:03.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.296+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'68 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.296+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4b3d0 con 0x7ff7d0021070 2024-05-08T18:33:03.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.297+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.297+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4b3d0 con 0x55bde3a33fc0 2024-05-08T18:33:03.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.298+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.298+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4b3d0 con 0x55bde3a2dd50 2024-05-08T18:33:03.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.300+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.300+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4b3d0 con 0x55bde3a2dd50 2024-05-08T18:33:03.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.301+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'236 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.301+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4b3d0 con 0x55bde3a33fc0 2024-05-08T18:33:03.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.302+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'69 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.302+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4b440 con 0x7ff7d0021070 2024-05-08T18:33:03.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.303+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.303+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4ba20 con 0x55bde3a33fc0 2024-05-08T18:33:03.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.303+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.304+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4ba20 con 0x55bde3a33fc0 2024-05-08T18:33:03.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.305+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.305+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4ba20 con 0x55bde3a33fc0 2024-05-08T18:33:03.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.305+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'26 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.305+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4b440 con 0x55bde3a33fc0 2024-05-08T18:33:03.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.306+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'51 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.306+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4b440 con 0x7ff7d8027020 2024-05-08T18:33:03.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.308+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.308+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4a4a0 con 0x55bde3a33fc0 2024-05-08T18:33:03.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.309+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.309+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4a4a0 con 0x7ff7d8027020 2024-05-08T18:33:03.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.310+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.310+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4a4a0 con 0x55bde3a33fc0 2024-05-08T18:33:03.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.311+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'70 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.311+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4a4a0 con 0x7ff7d8027020 2024-05-08T18:33:03.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.312+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.312+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a4a4a0 con 0x7ff7d0021070 2024-05-08T18:33:03.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.313+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.314+0000 7ff60f7fe640 20 reqs_thread_entry: start 2024-05-08T18:33:03.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.314+0000 7ff7e07a2800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:03.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.314+0000 7ff7e07a2800 20 Filter name: none 2024-05-08T18:33:03.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.314+0000 7ff60d7fa640 20 reqs_thread_entry: start 2024-05-08T18:33:03.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.314+0000 7ff7e07a2800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:33:03.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.314+0000 7ff7e07a2800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.314+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a76790 con 0x55bde3a2dd50 2024-05-08T18:33:03.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.314+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.314+0000 7ff7e07a2800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:33:03.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.314+0000 7ff7e07a2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:33:03.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.314+0000 7ff7e07a2800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:33:03.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.314+0000 7ff7e07a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:33:03.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.315+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a78bd0 con 0x7ff7d0021070 2024-05-08T18:33:03.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.315+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.315+0000 7ff7e07a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7 : miss 2024-05-08T18:33:03.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.315+0000 7ff7e07a2800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.315+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:96 8.16 8:6e08115c:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a79000 con 0x55bde3a33fc0 2024-05-08T18:33:03.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.315+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(96 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.315+0000 7ff7e07a2800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:33:03.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.315+0000 7ff7e07a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7 info.flags=0x17 2024-05-08T18:33:03.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.315+0000 7ff7e07a2800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7 to cache LRU end 2024-05-08T18:33:03.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.315+0000 7ff7e07a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:33:03.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.315+0000 7ff7e07a2800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:33:03.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.315+0000 7ff7e07a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7 2024-05-08T18:33:03.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.315+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:97 4.3d 4:bf2b5f2f:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3af6410 con 0x55bde3a33fc0 2024-05-08T18:33:03.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.316+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 27 ==== osd_op_reply(97 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.316+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:98 4.2a 4:57ae38dd:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3af6450 con 0x55bde3a2dd50 2024-05-08T18:33:03.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.316+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(98 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.316+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:99 4.23 4:c69c0711:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3af6450 con 0x7ff7d8027020 2024-05-08T18:33:03.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.317+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(99 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.317+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:100 4.1f 4:fa062e78:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3af6450 con 0x7ff7d0021070 2024-05-08T18:33:03.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.317+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 21 ==== osd_op_reply(100 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.317+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:101 4.2f 4:f44b83b0:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3af6450 con 0x55bde3a2dd50 2024-05-08T18:33:03.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.317+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(101 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.4 [call out=426b] v0'0 uv3 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.317+0000 7ff7e07a2800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-05-08T18:33:03.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.317+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:102 4.4 4:20f56938:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3af6450 con 0x7ff7d8027020 2024-05-08T18:33:03.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.318+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(102 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.318+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:103 4.37 4:ed176da9:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3af6aa0 con 0x7ff7d8027020 2024-05-08T18:33:03.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.318+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(103 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.318+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:104 4.3d 4:bfed2cf7:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3af6aa0 con 0x55bde3a33fc0 2024-05-08T18:33:03.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.319+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 28 ==== osd_op_reply(104 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.319+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:105 4.37 4:ed747004:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3af6aa0 con 0x7ff7d8027020 2024-05-08T18:33:03.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.319+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(105 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.319+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:106 4.6 4:62baa1db:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3af6aa0 con 0x55bde3a33fc0 2024-05-08T18:33:03.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.320+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 29 ==== osd_op_reply(106 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.320+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:107 4.3f 4:fe207108:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3af6aa0 con 0x7ff7d0021070 2024-05-08T18:33:03.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.320+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 22 ==== osd_op_reply(107 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.320+0000 7ff7e07a2800 20 get_obj_state: octx=0x7ff7c8052590 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55bde3af4688 s->prefetch_data=0 2024-05-08T18:33:03.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.320+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:108 3.17s0 3:e85bcfc3:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3af5570 con 0x55bde3a2dd50 2024-05-08T18:33:03.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.320+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(108 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.320+0000 7ff7e07a2800 10 manifest: total_size = 6 2024-05-08T18:33:03.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.320+0000 7ff7e07a2800 20 get_obj_state: setting s->obj_tag to be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.14422578382574112779 2024-05-08T18:33:03.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.320+0000 7ff7e07a2800 20 get_obj_state: octx=0x7ff7c8052590 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55bde3af4688 s->prefetch_data=0 2024-05-08T18:33:03.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.320+0000 7ff7e07a2800 20 prepare_atomic_modification: state is not atomic. state=0x55bde3af4688 2024-05-08T18:33:03.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.320+0000 7ff7e07a2800 20 bucket index object: :.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.4 2024-05-08T18:33:03.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.320+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:109 4.2f 4:f44b83b0:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a7d570 con 0x55bde3a2dd50 2024-05-08T18:33:03.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.321+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(109 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.4 [stat,call,call] v29'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.321+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:110 3.17s0 3:e85bcfc3:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a7b550 con 0x55bde3a2dd50 2024-05-08T18:33:03.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.323+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 33 ==== osd_op_reply(110 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7_15f6f8dc036519d7fe15b39338f6e5db [call] v29'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.323+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:111 4.2f 4:f44b83b0:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a7db50 con 0x55bde3a2dd50 2024-05-08T18:33:03.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.323+0000 7ff7e07a2800 20 list_objects_ordered: starting attempt 1 2024-05-08T18:33:03.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.323+0000 7ff7e07a2800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-08T18:33:03.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.323+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:112 4.3d 4:bf2b5f2f:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a7f490 con 0x55bde3a33fc0 2024-05-08T18:33:03.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.323+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:113 4.2a 4:57ae38dd:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a81d00 con 0x55bde3a2dd50 2024-05-08T18:33:03.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.323+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:114 4.23 4:c69c0711:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a84660 con 0x7ff7d8027020 2024-05-08T18:33:03.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.323+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:115 4.1f 4:fa062e78:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a87150 con 0x7ff7d0021070 2024-05-08T18:33:03.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.323+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:116 4.2f 4:f44b83b0:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a89ed0 con 0x55bde3a2dd50 2024-05-08T18:33:03.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.323+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:117 4.4 4:20f56938:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a8ccd0 con 0x7ff7d8027020 2024-05-08T18:33:03.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.323+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:118 4.37 4:ed176da9:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a8f640 con 0x7ff7d8027020 2024-05-08T18:33:03.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.323+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:119 4.3d 4:bfed2cf7:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a92450 con 0x55bde3a33fc0 2024-05-08T18:33:03.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.323+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:120 4.37 4:ed747004:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a95280 con 0x7ff7d8027020 2024-05-08T18:33:03.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.323+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:121 4.6 4:62baa1db:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a98100 con 0x55bde3a33fc0 2024-05-08T18:33:03.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.323+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:122 4.3f 4:fe207108:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a9af30 con 0x7ff7d0021070 2024-05-08T18:33:03.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.323+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 30 ==== osd_op_reply(112 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.324+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 23 ==== osd_op_reply(115 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.324+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 31 ==== osd_op_reply(119 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.324+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 32 ==== osd_op_reply(121 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.324+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 24 ==== osd_op_reply(122 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff7d801b070 con 0x7ff7d0021070 2024-05-08T18:33:03.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.324+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 34 ==== osd_op_reply(113 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.324+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 35 ==== osd_op_reply(111 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.4 [stat,call,call] v29'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.324+0000 7ff6c17fa640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-05-08T18:33:03.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.324+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(117 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.324+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(114 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.324+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 36 ==== osd_op_reply(116 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.4 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.324+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 29 ==== osd_op_reply(118 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 30 ==== osd_op_reply(120 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7e07a2800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-08T18:33:03.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7e07a2800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-08T18:33:03.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7e07a2800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-08T18:33:03.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7e07a2800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-08T18:33:03.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7e07a2800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7])"; uploads.size()=0; is_truncated=0 2024-05-08T18:33:03.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:123 4.3d 4:bf2b5f2f:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a87150 con 0x55bde3a33fc0 2024-05-08T18:33:03.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:124 4.2a 4:57ae38dd:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a98100 con 0x55bde3a2dd50 2024-05-08T18:33:03.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:125 4.23 4:c69c0711:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a95280 con 0x7ff7d8027020 2024-05-08T18:33:03.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:126 4.1f 4:fa062e78:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a7de00 con 0x7ff7d0021070 2024-05-08T18:33:03.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:127 4.2f 4:f44b83b0:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a92450 con 0x55bde3a2dd50 2024-05-08T18:33:03.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:128 4.4 4:20f56938:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a87150 con 0x7ff7d8027020 2024-05-08T18:33:03.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:129 4.37 4:ed176da9:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a92450 con 0x7ff7d8027020 2024-05-08T18:33:03.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:130 4.3d 4:bfed2cf7:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a87150 con 0x55bde3a33fc0 2024-05-08T18:33:03.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:131 4.37 4:ed747004:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a92450 con 0x7ff7d8027020 2024-05-08T18:33:03.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:132 4.6 4:62baa1db:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a87150 con 0x55bde3a33fc0 2024-05-08T18:33:03.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:133 4.3f 4:fe207108:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a95280 con 0x7ff7d0021070 2024-05-08T18:33:03.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 37 ==== osd_op_reply(124 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 38 ==== osd_op_reply(127 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.4 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 31 ==== osd_op_reply(128 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 32 ==== osd_op_reply(129 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 25 ==== osd_op_reply(126 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7d8066060 con 0x7ff7d0021070 2024-05-08T18:33:03.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 33 ==== osd_op_reply(125 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 33 ==== osd_op_reply(123 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 34 ==== osd_op_reply(131 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 34 ==== osd_op_reply(130 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.325+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 35 ==== osd_op_reply(132 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.326+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 26 ==== osd_op_reply(133 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff7d8066060 con 0x7ff7d0021070 2024-05-08T18:33:03.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.326+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a95280 con 0x7ff7d0021070 2024-05-08T18:33:03.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.327+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 27 ==== osd_op_reply(134 foo.buckets [call] v29'50 uv50 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff7d8066060 con 0x7ff7d0021070 2024-05-08T18:33:03.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.327+0000 7ff7e07a2800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:33:03.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.327+0000 7ff7e07a2800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.327+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a95280 con 0x7ff7d0021070 2024-05-08T18:33:03.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.327+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 28 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff7d8066060 con 0x7ff7d0021070 2024-05-08T18:33:03.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.327+0000 7ff7e07a2800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:33:03.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.327+0000 7ff7e07a2800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:33:03.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.327+0000 7ff7e07a2800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:33:03.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.327+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a87150 con 0x7ff7d0021070 2024-05-08T18:33:03.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.328+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 29 ==== osd_op_reply(136 myfoo [call,call,delete] v29'51 uv51 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7ff7d8066060 con 0x7ff7d0021070 2024-05-08T18:33:03.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.328+0000 7ff7e07a2800 10 removing default.rgw.meta+root+myfoo from cache 2024-05-08T18:33:03.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.328+0000 7ff7e07a2800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:33:03.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.328+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94274056646992 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a91cf0 con 0x7ff7d8027020 2024-05-08T18:33:03.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.328+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 35 ==== watch-notify(notify (1) cookie 94274056330656 notify 124554051612 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55bde3a4bbf0 con 0x7ff7d8027020 2024-05-08T18:33:03.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.328+0000 7ff6c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051612 cookie 94274056330656 notifier 4774 bl.length()=149 2024-05-08T18:33:03.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.328+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 36 ==== osd_op_reply(137 notify.6 [notify cookie 94274056646992 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.328+0000 7ff6c1ffb640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7ff6a4003d60 con 0x7ff7d8027020 2024-05-08T18:33:03.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.329+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 37 ==== watch-notify(notify_complete (2) cookie 94274056646992 notify 124554051612 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bde3a22a60 con 0x7ff7d8027020 2024-05-08T18:33:03.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.329+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 38 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.329+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:139 8.16 8:6e08115c:root::.bucket.meta.myfoo%3abe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a91cf0 con 0x55bde3a33fc0 2024-05-08T18:33:03.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.330+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 36 ==== osd_op_reply(139 .bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7 [call,call,delete] v29'4 uv4 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.330+0000 7ff7e07a2800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7 from cache 2024-05-08T18:33:03.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.330+0000 7ff7e07a2800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7, ofs0, ns] 2024-05-08T18:33:03.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.330+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94274057099632 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a91cf0 con 0x7ff7d0021070 2024-05-08T18:33:03.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.330+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 30 ==== watch-notify(notify (1) cookie 94274056321072 notify 124554051628 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55bde3a4b440 con 0x7ff7d0021070 2024-05-08T18:33:03.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.330+0000 7ff6c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051628 cookie 94274056321072 notifier 4774 bl.length()=206 2024-05-08T18:33:03.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.330+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 31 ==== osd_op_reply(140 notify.0 [notify cookie 94274057099632 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff7d8066060 con 0x7ff7d0021070 2024-05-08T18:33:03.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.330+0000 7ff6c17fa640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7ff6140032c0 con 0x7ff7d0021070 2024-05-08T18:33:03.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.330+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 32 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7d8066060 con 0x7ff7d0021070 2024-05-08T18:33:03.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.331+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 33 ==== watch-notify(notify_complete (2) cookie 94274057099632 notify 124554051628 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff7d805b040 con 0x7ff7d0021070 2024-05-08T18:33:03.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.331+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:142 4.3d 4:bf2b5f2f:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a91cf0 con 0x55bde3a33fc0 2024-05-08T18:33:03.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.331+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:143 4.2a 4:57ae38dd:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a7de00 con 0x55bde3a2dd50 2024-05-08T18:33:03.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.331+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:144 4.23 4:c69c0711:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a771b0 con 0x7ff7d8027020 2024-05-08T18:33:03.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.331+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:145 4.1f 4:fa062e78:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a957a0 con 0x7ff7d0021070 2024-05-08T18:33:03.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.331+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:146 4.2f 4:f44b83b0:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a91cf0 con 0x55bde3a2dd50 2024-05-08T18:33:03.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.331+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:147 4.4 4:20f56938:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a7de00 con 0x7ff7d8027020 2024-05-08T18:33:03.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.331+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:148 4.37 4:ed176da9:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a771b0 con 0x7ff7d8027020 2024-05-08T18:33:03.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.331+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:149 4.3d 4:bfed2cf7:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a91cf0 con 0x55bde3a33fc0 2024-05-08T18:33:03.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.331+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:150 4.37 4:ed747004:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a957a0 con 0x7ff7d8027020 2024-05-08T18:33:03.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.331+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:151 4.6 4:62baa1db:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a7de00 con 0x55bde3a33fc0 2024-05-08T18:33:03.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.331+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:152 4.3f 4:fe207108:::.dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a771b0 con 0x7ff7d0021070 2024-05-08T18:33:03.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.332+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 39 ==== osd_op_reply(143 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.1 [delete] v29'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.332+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 40 ==== osd_op_reply(146 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.4 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.332+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 39 ==== osd_op_reply(147 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.5 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.332+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 34 ==== osd_op_reply(145 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.3 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff7d8066060 con 0x7ff7d0021070 2024-05-08T18:33:03.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.333+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 40 ==== osd_op_reply(144 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.2 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.333+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 41 ==== osd_op_reply(148 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.6 [delete] v29'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.333+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 37 ==== osd_op_reply(142 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.0 [delete] v29'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.333+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 38 ==== osd_op_reply(151 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.9 [delete] v29'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.333+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 35 ==== osd_op_reply(152 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.10 [delete] v29'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff7d8066060 con 0x7ff7d0021070 2024-05-08T18:33:03.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.333+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 39 ==== osd_op_reply(149 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.7 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.333+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 42 ==== osd_op_reply(150 .dir.be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7.8 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.333+0000 7ff7e07a2800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7 : miss 2024-05-08T18:33:03.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.333+0000 7ff7e07a2800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.333+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:153 6.1b 6:dbe31f77:::pubsub..bucket.myfoo%2fbe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a7de00 con 0x55bde3a33fc0 2024-05-08T18:33:03.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.333+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 40 ==== osd_op_reply(153 pubsub..bucket.myfoo/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.333+0000 7ff7e07a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.333+0000 7ff7e07a2800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7 info.flags=0x0 2024-05-08T18:33:03.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.333+0000 7ff7e07a2800 10 adding default.rgw.log++pubsub..bucket.myfoo/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7 to cache LRU end 2024-05-08T18:33:03.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.333+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:154 6.1b 6:dbe31f77:::pubsub..bucket.myfoo%2fbe5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a957a0 con 0x55bde3a33fc0 2024-05-08T18:33:03.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.334+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 41 ==== osd_op_reply(154 pubsub..bucket.myfoo/be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.7 [delete] v29'27 uv19 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.334+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a91cf0 con 0x7ff7d0021070 2024-05-08T18:33:03.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.335+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 36 ==== osd_op_reply(155 foo.buckets [call] v29'52 uv52 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff7d8066060 con 0x7ff7d0021070 2024-05-08T18:33:03.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.335+0000 7ff7e07a2800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-05-08T18:33:03.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.335+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a91cf0 con 0x7ff7d8027020 2024-05-08T18:33:03.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.336+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 43 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v29'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.336+0000 7ff7e07a2800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-05-08T18:33:03.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.336+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94274056705824 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a91cf0 con 0x7ff7d0021070 2024-05-08T18:33:03.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.336+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 37 ==== watch-notify(notify (1) cookie 94274056333344 notify 124554051629 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7ff7d805b040 con 0x7ff7d0021070 2024-05-08T18:33:03.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.336+0000 7ff6c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051629 cookie 94274056333344 notifier 4774 bl.length()=170 2024-05-08T18:33:03.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.336+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 38 ==== osd_op_reply(157 notify.3 [notify cookie 94274056705824 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff7d8066060 con 0x7ff7d0021070 2024-05-08T18:33:03.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.336+0000 7ff6c1ffb640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7ff6a4003d60 con 0x7ff7d0021070 2024-05-08T18:33:03.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.337+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 39 ==== watch-notify(notify_complete (2) cookie 94274056705824 notify 124554051629 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bde39f5950 con 0x7ff7d0021070 2024-05-08T18:33:03.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.337+0000 7ff7e07a2800 10 removing email index: foo@foo.com 2024-05-08T18:33:03.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.337+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 40 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7d8066060 con 0x7ff7d0021070 2024-05-08T18:33:03.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.337+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a91cf0 con 0x55bde3a2dd50 2024-05-08T18:33:03.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.338+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 41 ==== osd_op_reply(159 foo@foo.com [delete] v29'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.338+0000 7ff7e07a2800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-05-08T18:33:03.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.338+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94274057099312 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a91cf0 con 0x7ff7d0021070 2024-05-08T18:33:03.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.338+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 41 ==== watch-notify(notify (1) cookie 94274056333344 notify 124554051630 ret 0) ==== 204+0+0 (crc 0 0 0) 0x55bde39f5950 con 0x7ff7d0021070 2024-05-08T18:33:03.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.338+0000 7ff6c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051630 cookie 94274056333344 notifier 4774 bl.length()=162 2024-05-08T18:33:03.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.338+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 42 ==== osd_op_reply(160 notify.3 [notify cookie 94274057099312 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff7d8066060 con 0x7ff7d0021070 2024-05-08T18:33:03.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.338+0000 7ff6c17fa640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7ff6140032c0 con 0x7ff7d0021070 2024-05-08T18:33:03.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.338+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 43 ==== watch-notify(notify_complete (2) cookie 94274057099312 notify 124554051630 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bde39f2cf0 con 0x7ff7d0021070 2024-05-08T18:33:03.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.338+0000 7ff7e07a2800 10 removing user buckets index 2024-05-08T18:33:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.338+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 44 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7d8066060 con 0x7ff7d0021070 2024-05-08T18:33:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.338+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a91cf0 con 0x7ff7d0021070 2024-05-08T18:33:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.339+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 45 ==== osd_op_reply(162 foo.buckets [delete] v29'53 uv53 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff7d8066060 con 0x7ff7d0021070 2024-05-08T18:33:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.339+0000 7ff7e07a2800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-05-08T18:33:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.340+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94274057099312 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a91cf0 con 0x7ff7d8027020 2024-05-08T18:33:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.340+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 44 ==== watch-notify(notify (1) cookie 94274056335696 notify 124554051613 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55bde3a22a60 con 0x7ff7d8027020 2024-05-08T18:33:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.340+0000 7ff6c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051613 cookie 94274056335696 notifier 4774 bl.length()=160 2024-05-08T18:33:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.340+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 45 ==== osd_op_reply(163 notify.5 [notify cookie 94274057099312 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.340+0000 7ff6c1ffb640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7ff6a4003d60 con 0x7ff7d8027020 2024-05-08T18:33:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.340+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 46 ==== watch-notify(notify_complete (2) cookie 94274057099312 notify 124554051613 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bde3a40450 con 0x7ff7d8027020 2024-05-08T18:33:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.340+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 47 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.340+0000 7ff7e07a2800 10 removing user index: foo 2024-05-08T18:33:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.340+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a91cf0 con 0x55bde3a2dd50 2024-05-08T18:33:03.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.341+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 42 ==== osd_op_reply(165 foo [call,call,delete] v29'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.341+0000 7ff7e07a2800 10 removing default.rgw.meta+users.uid+foo from cache 2024-05-08T18:33:03.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.341+0000 7ff7e07a2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:33:03.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.341+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94274057099312 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a91cf0 con 0x55bde3a2dd50 2024-05-08T18:33:03.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.341+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 43 ==== watch-notify(notify (1) cookie 94274056338416 notify 124554051602 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55bde3a40450 con 0x55bde3a2dd50 2024-05-08T18:33:03.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.341+0000 7ff6c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051602 cookie 94274056338416 notifier 4774 bl.length()=152 2024-05-08T18:33:03.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.341+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 44 ==== osd_op_reply(166 notify.4 [notify cookie 94274057099312 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.341+0000 7ff6c17fa640 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7ff6140032c0 con 0x55bde3a2dd50 2024-05-08T18:33:03.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.342+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 45 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.342+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 46 ==== watch-notify(notify_complete (2) cookie 94274057099312 notify 124554051602 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bde3a3fdd0 con 0x55bde3a2dd50 2024-05-08T18:33:03.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.343+0000 7ff694fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:03.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.343+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94274056358768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a48620 con 0x55bde3a2dd50 2024-05-08T18:33:03.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.344+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 47 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94274056358768] v29'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.344+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94274056321072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a40b70 con 0x7ff7d0021070 2024-05-08T18:33:03.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.345+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 46 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94274056321072] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7d8066060 con 0x7ff7d0021070 2024-05-08T18:33:03.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.345+0000 7ff7e07a2800 20 remove_watcher() i=0 2024-05-08T18:33:03.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.345+0000 7ff7e07a2800 2 removed watcher, disabling cache 2024-05-08T18:33:03.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.345+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94274056323280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a40b70 con 0x55bde3a2dd50 2024-05-08T18:33:03.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.346+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 48 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94274056323280] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.346+0000 7ff7e07a2800 20 remove_watcher() i=1 2024-05-08T18:33:03.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.346+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94274056327040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a40b70 con 0x55bde3a33fc0 2024-05-08T18:33:03.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.347+0000 7ff7dea9b640 1 -- 172.21.15.87:0/254430200 <== osd.3 v2:172.21.15.87:6800/2929215285 42 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94274056327040] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7d0028070 con 0x55bde3a33fc0 2024-05-08T18:33:03.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.347+0000 7ff7e07a2800 20 remove_watcher() i=2 2024-05-08T18:33:03.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.347+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94274056333344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a40b70 con 0x7ff7d0021070 2024-05-08T18:33:03.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.348+0000 7ff7de29a640 1 -- 172.21.15.87:0/254430200 <== osd.2 v2:172.21.15.87:6816/2108501615 47 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94274056333344] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7d8066060 con 0x7ff7d0021070 2024-05-08T18:33:03.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.348+0000 7ff7e07a2800 20 remove_watcher() i=3 2024-05-08T18:33:03.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.348+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94274056338416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a40b70 con 0x55bde3a2dd50 2024-05-08T18:33:03.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.349+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.1 v2:172.21.15.87:6808/2448644045 49 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94274056338416] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x55bde3a2dd50 2024-05-08T18:33:03.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.349+0000 7ff7e07a2800 20 remove_watcher() i=4 2024-05-08T18:33:03.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.349+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94274056335696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a3bbf0 con 0x7ff7d8027020 2024-05-08T18:33:03.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.350+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 48 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94274056335696] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.350+0000 7ff7e07a2800 20 remove_watcher() i=5 2024-05-08T18:33:03.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.350+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94274056330656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a40b70 con 0x7ff7d8027020 2024-05-08T18:33:03.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.351+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 49 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94274056330656] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.351+0000 7ff7e07a2800 20 remove_watcher() i=6 2024-05-08T18:33:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.351+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94274056343760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bde3a39da0 con 0x7ff7d8027020 2024-05-08T18:33:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.352+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 <== osd.0 v2:172.21.15.53:6800/443747735 50 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94274056343760] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7c805a040 con 0x7ff7d8027020 2024-05-08T18:33:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.352+0000 7ff7e07a2800 20 remove_watcher() i=7 2024-05-08T18:33:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff7d8027020 msgr2=0x7ff7d80267f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff7d8027020 0x7ff7d80267f0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bde3a2dd50 msgr2=0x55bde3a30210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bde3a2dd50 0x55bde3a30210 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff7d0021070 msgr2=0x7ff7d0054ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff7d0021070 0x7ff7d0054ab0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55bde3a33fc0 msgr2=0x55bde3a363b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55bde3a33fc0 0x55bde3a363b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6a803bba0 msgr2=0x7ff6a803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6a803bba0 0x7ff6a803e060 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8026780 tx=0x7ff7d804e000 comp rx=0 tx=0).stop 2024-05-08T18:33:03.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a1ae10 msgr2=0x55bde3a22290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7dda99640 1 -- 172.21.15.87:0/254430200 reap_dead start 2024-05-08T18:33:03.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a1ae10 0x55bde3a22290 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0051930 tx=0x7ff7d00529f0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 shutdown_connections 2024-05-08T18:33:03.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/254430200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a1ae10 0x55bde3a22290 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 >> 172.21.15.87:0/254430200 conn(0x55bde3a170e0 msgr2=0x55bde3a14740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 shutdown_connections 2024-05-08T18:33:03.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 -- 172.21.15.87:0/254430200 wait complete. 2024-05-08T18:33:03.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 -- 172.21.15.87:0/449967839 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6b803bb50 msgr2=0x7ff6b803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/449967839 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6b803bb50 0x7ff6b803e010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800d010 tx=0x7ff7d804c040 comp rx=0 tx=0).stop 2024-05-08T18:33:03.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 -- 172.21.15.87:0/449967839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a0da20 msgr2=0x55bde3a0de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/449967839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a0da20 0x55bde3a0de40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x55bde39f38d0 tx=0x7ff7d000ef30 comp rx=0 tx=0).stop 2024-05-08T18:33:03.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 -- 172.21.15.87:0/449967839 shutdown_connections 2024-05-08T18:33:03.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/449967839 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6b803bb50 0x7ff6b803e010 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/449967839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde3a0da20 0x55bde3a0de40 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 -- 172.21.15.87:0/449967839 >> 172.21.15.87:0/449967839 conn(0x55bde3a01ac0 msgr2=0x55bde3a01ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 -- 172.21.15.87:0/449967839 shutdown_connections 2024-05-08T18:33:03.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.353+0000 7ff7e07a2800 1 -- 172.21.15.87:0/449967839 wait complete. 2024-05-08T18:33:03.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.354+0000 7ff7e07a2800 1 -- 172.21.15.87:0/2804817545 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55bde39fce70 msgr2=0x55bde39ff260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.354+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55bde39fce70 0x55bde39ff260 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.354+0000 7ff7e07a2800 1 -- 172.21.15.87:0/2804817545 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bde38f76b0 msgr2=0x55bde39f9710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.354+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bde38f76b0 0x55bde39f9710 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.354+0000 7ff7e07a2800 1 -- 172.21.15.87:0/2804817545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6c403bb50 msgr2=0x7ff6c403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.354+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6c403bb50 0x7ff6c403e010 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8054000 tx=0x7ff7c804e000 comp rx=0 tx=0).stop 2024-05-08T18:33:03.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.354+0000 7ff7e07a2800 1 -- 172.21.15.87:0/2804817545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f5b70 msgr2=0x55bde39f2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.354+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f5b70 0x55bde39f2520 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8000f80 tx=0x7ff7d8001250 comp rx=0 tx=0).stop 2024-05-08T18:33:03.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.354+0000 7ff7e07a2800 1 -- 172.21.15.87:0/2804817545 shutdown_connections 2024-05-08T18:33:03.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.354+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55bde38f76b0 0x55bde39f9710 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.354+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55bde39fce70 0x55bde39ff260 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.354+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff6c403bb50 0x7ff6c403e010 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.354+0000 7ff7e07a2800 1 --2- 172.21.15.87:0/2804817545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bde38f5b70 0x55bde39f2520 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.354+0000 7ff7e07a2800 1 -- 172.21.15.87:0/2804817545 >> 172.21.15.87:0/2804817545 conn(0x55bde38f16b0 msgr2=0x55bde39e4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.354+0000 7ff7e07a2800 1 -- 172.21.15.87:0/2804817545 shutdown_connections 2024-05-08T18:33:03.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.354+0000 7ff7e07a2800 1 -- 172.21.15.87:0/2804817545 wait complete. 2024-05-08T18:33:03.361 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:33:03.361 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:33:03.361 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:33:03.404 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:03.404 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:03.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.407+0000 7f4c69927800 1 Processor -- start 2024-05-08T18:33:03.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.407+0000 7f4c69927800 1 -- start start 2024-05-08T18:33:03.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.407+0000 7f4c69927800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559c60e7ddc0 0x559c60e7c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.407+0000 7f4c69927800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559c60e7cd10 con 0x559c60e7c860 2024-05-08T18:33:03.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.407+0000 7f4c69927800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x559c60da8e20 con 0x559c60e7ddc0 2024-05-08T18:33:03.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.407+0000 7f4c65659640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559c60e7ddc0 0x559c60e7c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.407+0000 7f4c65659640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559c60e7ddc0 0x559c60e7c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52116/0 (socket says 172.21.15.87:52116) 2024-05-08T18:33:03.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.407+0000 7f4c65659640 1 -- 172.21.15.87:0/1448819485 learned_addr learned my addr 172.21.15.87:0/1448819485 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.407+0000 7f4c5ce58640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x559c60e7c860 0x559c60f10160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58116/0 (socket says 172.21.15.87:58116) 2024-05-08T18:33:03.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.408+0000 7f4c65659640 1 -- 172.21.15.87:0/1448819485 >> v1:172.21.15.53:6789/0 conn(0x559c60e7c860 legacy=0x559c60f10160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.408+0000 7f4c65659640 1 -- 172.21.15.87:0/1448819485 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c60e7cf30 con 0x559c60e7ddc0 2024-05-08T18:33:03.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.410+0000 7f4c65659640 1 --2- 172.21.15.87:0/1448819485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7ddc0 0x559c60e7c320 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4c5800a520 tx=0x7f4c5801d0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647e8b74cdf29c80 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.410+0000 7f4c64e58640 1 -- 172.21.15.87:0/1448819485 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c58057070 con 0x559c60e7ddc0 2024-05-08T18:33:03.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.410+0000 7f4c64e58640 1 -- 172.21.15.87:0/1448819485 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c58052570 con 0x559c60e7ddc0 2024-05-08T18:33:03.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.410+0000 7f4c64e58640 1 -- 172.21.15.87:0/1448819485 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c58052870 con 0x559c60e7ddc0 2024-05-08T18:33:03.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.410+0000 7f4c69927800 1 -- 172.21.15.87:0/1448819485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7ddc0 msgr2=0x559c60e7c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.410+0000 7f4c69927800 1 --2- 172.21.15.87:0/1448819485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7ddc0 0x559c60e7c320 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4c5800a520 tx=0x7f4c5801d0a0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.410+0000 7f4c69927800 1 -- 172.21.15.87:0/1448819485 shutdown_connections 2024-05-08T18:33:03.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.410+0000 7f4c69927800 1 --2- 172.21.15.87:0/1448819485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7ddc0 0x559c60e7c320 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.410+0000 7f4c69927800 1 -- 172.21.15.87:0/1448819485 >> 172.21.15.87:0/1448819485 conn(0x559c60f03830 msgr2=0x559c60f05c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.410+0000 7f4c69927800 1 -- 172.21.15.87:0/1448819485 shutdown_connections 2024-05-08T18:33:03.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.410+0000 7f4c69927800 1 -- 172.21.15.87:0/1448819485 wait complete. 2024-05-08T18:33:03.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.424+0000 7f4c69927800 1 Processor -- start 2024-05-08T18:33:03.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.424+0000 7f4c69927800 1 -- start start 2024-05-08T18:33:03.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.424+0000 7f4c69927800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7c860 0x559c60ffb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.424+0000 7f4c69927800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559c60e535b0 con 0x559c60e7c860 2024-05-08T18:33:03.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.424+0000 7f4c65659640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7c860 0x559c60ffb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.424+0000 7f4c65659640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7c860 0x559c60ffb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52126/0 (socket says 172.21.15.87:52126) 2024-05-08T18:33:03.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.424+0000 7f4c65659640 1 -- 172.21.15.87:0/4268854976 learned_addr learned my addr 172.21.15.87:0/4268854976 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.425+0000 7f4c65659640 1 -- 172.21.15.87:0/4268854976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c60ffbea0 con 0x559c60e7c860 2024-05-08T18:33:03.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.425+0000 7f4c65659640 1 --2- 172.21.15.87:0/4268854976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7c860 0x559c60ffb8d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f4c5801d0e0 tx=0x7f4c5804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246b5b2bf6b08760 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.425+0000 7f4b53606640 1 -- 172.21.15.87:0/4268854976 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c58057040 con 0x559c60e7c860 2024-05-08T18:33:03.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.425+0000 7f4b53606640 1 -- 172.21.15.87:0/4268854976 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c58052850 con 0x559c60e7c860 2024-05-08T18:33:03.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.425+0000 7f4b53606640 1 -- 172.21.15.87:0/4268854976 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c58052b70 con 0x559c60e7c860 2024-05-08T18:33:03.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.426+0000 7f4c69927800 1 -- 172.21.15.87:0/4268854976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7c860 msgr2=0x559c60ffb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.426+0000 7f4c69927800 1 --2- 172.21.15.87:0/4268854976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7c860 0x559c60ffb8d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f4c5801d0e0 tx=0x7f4c5804c000 comp rx=0 tx=0).stop 2024-05-08T18:33:03.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.426+0000 7f4c69927800 1 -- 172.21.15.87:0/4268854976 shutdown_connections 2024-05-08T18:33:03.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.426+0000 7f4c69927800 1 --2- 172.21.15.87:0/4268854976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7c860 0x559c60ffb8d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.426+0000 7f4c69927800 1 -- 172.21.15.87:0/4268854976 >> 172.21.15.87:0/4268854976 conn(0x559c60f03830 msgr2=0x559c60ff71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.426+0000 7f4c69927800 1 -- 172.21.15.87:0/4268854976 shutdown_connections 2024-05-08T18:33:03.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.426+0000 7f4c69927800 1 -- 172.21.15.87:0/4268854976 wait complete. 2024-05-08T18:33:03.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.426+0000 7f4c69927800 1 Processor -- start 2024-05-08T18:33:03.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.426+0000 7f4c69927800 1 -- start start 2024-05-08T18:33:03.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.426+0000 7f4c69927800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7c860 0x559c61003290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.426+0000 7f4c69927800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559c60f13b30 con 0x559c60e7c860 2024-05-08T18:33:03.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.427+0000 7f4c65659640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7c860 0x559c61003290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.427+0000 7f4c65659640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7c860 0x559c61003290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52138/0 (socket says 172.21.15.87:52138) 2024-05-08T18:33:03.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.427+0000 7f4c65659640 1 -- 172.21.15.87:0/1024536468 learned_addr learned my addr 172.21.15.87:0/1024536468 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.427+0000 7f4c65659640 1 -- 172.21.15.87:0/1024536468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c610037d0 con 0x559c60e7c860 2024-05-08T18:33:03.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.427+0000 7f4c65659640 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7c860 0x559c61003290 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f4c5801d0e0 tx=0x7f4c58003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.427+0000 7f4b51e03640 1 -- 172.21.15.87:0/1024536468 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c58073070 con 0x559c60e7c860 2024-05-08T18:33:03.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.427+0000 7f4b51e03640 1 -- 172.21.15.87:0/1024536468 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c5805d650 con 0x559c60e7c860 2024-05-08T18:33:03.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.427+0000 7f4b51e03640 1 -- 172.21.15.87:0/1024536468 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c58057070 con 0x559c60e7c860 2024-05-08T18:33:03.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.427+0000 7f4c69927800 1 -- 172.21.15.87:0/1024536468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c61003a60 con 0x559c60e7c860 2024-05-08T18:33:03.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.427+0000 7f4c69927800 1 -- 172.21.15.87:0/1024536468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c61006710 con 0x559c60e7c860 2024-05-08T18:33:03.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.428+0000 7f4b51e03640 1 -- 172.21.15.87:0/1024536468 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4c58076070 con 0x559c60e7c860 2024-05-08T18:33:03.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.428+0000 7f4b51e03640 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b4c03bb50 0x7f4b4c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.428+0000 7f4b51e03640 1 -- 172.21.15.87:0/1024536468 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f4c580943c0 con 0x559c60e7c860 2024-05-08T18:33:03.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.428+0000 7f4c5ce58640 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b4c03bb50 0x7f4b4c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.428+0000 7f4c69927800 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559c60e7ddc0 0x559c6100a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.429+0000 7f4c69927800 1 -- 172.21.15.87:0/1024536468 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c6100aab0 con 0x559c60e7ddc0 2024-05-08T18:33:03.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.429+0000 7f4c65e5a640 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559c60e7ddc0 0x559c6100a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.429+0000 7f4c5ce58640 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b4c03bb50 0x7f4b4c03e010 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4c50000f60 tx=0x7f4c50001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.429+0000 7f4c65e5a640 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559c60e7ddc0 0x559c6100a4d0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.429+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1024536468 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c6000a4a0 con 0x559c60e7ddc0 2024-05-08T18:33:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.429+0000 7f4c69927800 1 -- 172.21.15.87:0/1024536468 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c61007aa0 con 0x559c60e7ddc0 2024-05-08T18:33:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.429+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1024536468 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c6000a4a0 con 0x559c60e7ddc0 2024-05-08T18:33:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.430+0000 7f4c69927800 1 -- 172.21.15.87:0/1024536468 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c6100c8f0 con 0x559c60e7ddc0 2024-05-08T18:33:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.430+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1024536468 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4c6000a4a0 con 0x559c60e7ddc0 2024-05-08T18:33:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.430+0000 7f4c69927800 1 -- 172.21.15.87:0/1024536468 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c6100bb20 con 0x559c60e7ddc0 2024-05-08T18:33:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.430+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1024536468 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c6000a4a0 con 0x559c60e7ddc0 2024-05-08T18:33:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.430+0000 7f4c69927800 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559c6100dca0 0x559c61010090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.430+0000 7f4c69927800 1 -- 172.21.15.87:0/1024536468 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c610105d0 con 0x559c6100dca0 2024-05-08T18:33:03.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.430+0000 7f4c65659640 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559c6100dca0 0x559c61010090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.431+0000 7f4c65659640 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559c6100dca0 0x559c61010090 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.431+0000 7f4c65659640 1 -- 172.21.15.87:0/1024536468 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4c58075030 con 0x559c6100dca0 2024-05-08T18:33:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.431+0000 7f4c69927800 1 Processor -- start 2024-05-08T18:33:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.432+0000 7f4c69927800 1 -- start start 2024-05-08T18:33:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.432+0000 7f4c69927800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6101e810 0x559c6101ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.432+0000 7f4c69927800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559c60df9fc0 con 0x559c6101e810 2024-05-08T18:33:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.432+0000 7f4c65e5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6101e810 0x559c6101ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.432+0000 7f4c65e5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6101e810 0x559c6101ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52154/0 (socket says 172.21.15.87:52154) 2024-05-08T18:33:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.432+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1047495050 learned_addr learned my addr 172.21.15.87:0/1047495050 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.432+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1047495050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c6101f170 con 0x559c6101e810 2024-05-08T18:33:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.432+0000 7f4c65e5a640 1 --2- 172.21.15.87:0/1047495050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6101e810 0x559c6101ec30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x559c61004690 tx=0x7f4c600178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.432+0000 7f4b4affd640 1 -- 172.21.15.87:0/1047495050 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c60013440 con 0x559c6101e810 2024-05-08T18:33:03.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.432+0000 7f4b4affd640 1 -- 172.21.15.87:0/1047495050 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c600135e0 con 0x559c6101e810 2024-05-08T18:33:03.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.432+0000 7f4b4affd640 1 -- 172.21.15.87:0/1047495050 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c600138c0 con 0x559c6101e810 2024-05-08T18:33:03.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.433+0000 7f4c69927800 1 -- 172.21.15.87:0/1047495050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c6101fbe0 con 0x559c6101e810 2024-05-08T18:33:03.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.433+0000 7f4c69927800 1 -- 172.21.15.87:0/1047495050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c610200e0 con 0x559c6101e810 2024-05-08T18:33:03.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.433+0000 7f4b4affd640 1 -- 172.21.15.87:0/1047495050 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4c60011040 con 0x559c6101e810 2024-05-08T18:33:03.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.433+0000 7f4b4affd640 1 --2- 172.21.15.87:0/1047495050 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b4003bb50 0x7f4b4003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.434+0000 7f4b4affd640 1 -- 172.21.15.87:0/1047495050 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f4c6001d070 con 0x559c6101e810 2024-05-08T18:33:03.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.434+0000 7f4c65659640 1 --2- 172.21.15.87:0/1047495050 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b4003bb50 0x7f4b4003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.434+0000 7f4c69927800 1 Processor -- start 2024-05-08T18:33:03.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.434+0000 7f4c69927800 1 -- start start 2024-05-08T18:33:03.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.434+0000 7f4c65659640 1 --2- 172.21.15.87:0/1047495050 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b4003bb50 0x7f4b4003e010 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4c58092970 tx=0x7f4c58006a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.434+0000 7f4c69927800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6102bb30 0x559c6102bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.434+0000 7f4c69927800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559c60ffc160 con 0x559c6102bb30 2024-05-08T18:33:03.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.434+0000 7f4c65e5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6102bb30 0x559c6102bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.434+0000 7f4c65e5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6102bb30 0x559c6102bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52170/0 (socket says 172.21.15.87:52170) 2024-05-08T18:33:03.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.434+0000 7f4c65e5a640 1 -- 172.21.15.87:0/2570321509 learned_addr learned my addr 172.21.15.87:0/2570321509 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.434+0000 7f4c65e5a640 1 -- 172.21.15.87:0/2570321509 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c6102c520 con 0x559c6102bb30 2024-05-08T18:33:03.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.435+0000 7f4c65e5a640 1 --2- 172.21.15.87:0/2570321509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6102bb30 0x559c6102bf50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4c600529a0 tx=0x7f4c60001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac35c96f4dac839 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.435+0000 7f4b48ff9640 1 -- 172.21.15.87:0/2570321509 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c600014f0 con 0x559c6102bb30 2024-05-08T18:33:03.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.435+0000 7f4b48ff9640 1 -- 172.21.15.87:0/2570321509 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c60001690 con 0x559c6102bb30 2024-05-08T18:33:03.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.435+0000 7f4b48ff9640 1 -- 172.21.15.87:0/2570321509 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c600157b0 con 0x559c6102bb30 2024-05-08T18:33:03.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.435+0000 7f4c69927800 1 -- 172.21.15.87:0/2570321509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6102bb30 msgr2=0x559c6102bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.435+0000 7f4c69927800 1 --2- 172.21.15.87:0/2570321509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6102bb30 0x559c6102bf50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4c600529a0 tx=0x7f4c60001e60 comp rx=0 tx=0).stop 2024-05-08T18:33:03.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.435+0000 7f4c69927800 1 -- 172.21.15.87:0/2570321509 shutdown_connections 2024-05-08T18:33:03.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.435+0000 7f4c69927800 1 --2- 172.21.15.87:0/2570321509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6102bb30 0x559c6102bf50 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.435+0000 7f4c69927800 1 -- 172.21.15.87:0/2570321509 >> 172.21.15.87:0/2570321509 conn(0x559c61027e90 msgr2=0x559c61025ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.435+0000 7f4c69927800 1 -- 172.21.15.87:0/2570321509 shutdown_connections 2024-05-08T18:33:03.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.435+0000 7f4c69927800 1 -- 172.21.15.87:0/2570321509 wait complete. 2024-05-08T18:33:03.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.436+0000 7f4c69927800 1 Processor -- start 2024-05-08T18:33:03.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.436+0000 7f4c69927800 1 -- start start 2024-05-08T18:33:03.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.436+0000 7f4c69927800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6102bb30 0x559c61033160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.436+0000 7f4c69927800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559c6102cc90 con 0x559c6102bb30 2024-05-08T18:33:03.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.436+0000 7f4c65e5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6102bb30 0x559c61033160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.436+0000 7f4c65e5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6102bb30 0x559c61033160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52180/0 (socket says 172.21.15.87:52180) 2024-05-08T18:33:03.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.436+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 learned_addr learned my addr 172.21.15.87:0/1376774228 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.436+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c610336a0 con 0x559c6102bb30 2024-05-08T18:33:03.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.436+0000 7f4c65e5a640 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6102bb30 0x559c61033160 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4c6004d010 tx=0x7f4c60052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.436+0000 7f4b36ffd640 1 -- 172.21.15.87:0/1376774228 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c60030020 con 0x559c6102bb30 2024-05-08T18:33:03.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.436+0000 7f4b36ffd640 1 -- 172.21.15.87:0/1376774228 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c600513f0 con 0x559c6102bb30 2024-05-08T18:33:03.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.437+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c61033930 con 0x559c6102bb30 2024-05-08T18:33:03.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.437+0000 7f4b36ffd640 1 -- 172.21.15.87:0/1376774228 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c6004b070 con 0x559c6102bb30 2024-05-08T18:33:03.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.437+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c610365e0 con 0x559c6102bb30 2024-05-08T18:33:03.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.437+0000 7f4b36ffd640 1 -- 172.21.15.87:0/1376774228 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4c60033020 con 0x559c6102bb30 2024-05-08T18:33:03.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.438+0000 7f4b36ffd640 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b3003bba0 0x7f4b3003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.438+0000 7f4b36ffd640 1 -- 172.21.15.87:0/1376774228 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f4c6000e040 con 0x559c6102bb30 2024-05-08T18:33:03.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.438+0000 7f4c69927800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.438+0000 7f4c65659640 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b3003bba0 0x7f4b3003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.438+0000 7f4c69927800 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559c6103ede0 0x559c61041280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.438+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c610419d0 con 0x559c6103ede0 2024-05-08T18:33:03.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.438+0000 7f4c5ce58640 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559c6103ede0 0x559c61041280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.438+0000 7f4c65659640 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b3003bba0 0x7f4b3003e060 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4c5805cc00 tx=0x7f4c58086000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.438+0000 7f4c5ce58640 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559c6103ede0 0x559c61041280 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.438+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.438+0000 7f4c69927800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.438+0000 7f4c69927800 20 realm 2024-05-08T18:33:03.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.438+0000 7f4c69927800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.438+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c6103e2b0 con 0x559c6103ede0 2024-05-08T18:33:03.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c69927800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c69927800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:03.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c69927800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c610424b0 con 0x559c6103ede0 2024-05-08T18:33:03.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c69927800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c69927800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c61042d80 con 0x559c6103ede0 2024-05-08T18:33:03.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c69927800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:03.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c69927800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c61043120 con 0x559c6103ede0 2024-05-08T18:33:03.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c69927800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:03.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c69927800 20 searching for the correct realm 2024-05-08T18:33:03.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c69927800 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x559c61045000 0x559c610473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.439+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559c61047aa0 con 0x559c61045000 2024-05-08T18:33:03.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.440+0000 7f4c65e5a640 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x559c61045000 0x559c610473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.440+0000 7f4c65e5a640 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x559c61045000 0x559c610473f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.440+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c60029070 con 0x559c61045000 2024-05-08T18:33:03.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.440+0000 7f4c65e5a640 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c60035020 0x7f4c600229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.440+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559c61047aa0 con 0x7f4c60035020 2024-05-08T18:33:03.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.440+0000 7f4c65659640 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c60035020 0x7f4c600229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.441+0000 7f4c65659640 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c60035020 0x7f4c600229f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.441+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c58075030 con 0x7f4c60035020 2024-05-08T18:33:03.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.441+0000 7f4c65659640 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c580a1040 0x7f4c580946e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.441+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559c61047aa0 con 0x7f4c580a1040 2024-05-08T18:33:03.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.441+0000 7f4c5ce58640 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c580a1040 0x7f4c580946e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.442+0000 7f4c5ce58640 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c580a1040 0x7f4c580946e0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.442+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.442+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559c61047aa0 con 0x559c6103ede0 2024-05-08T18:33:03.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.442+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.442+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559c61047aa0 con 0x559c6103ede0 2024-05-08T18:33:03.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.442+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.442+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559c61047aa0 con 0x7f4c580a1040 2024-05-08T18:33:03.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.443+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.443+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559c61047aa0 con 0x7f4c580a1040 2024-05-08T18:33:03.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.443+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.443+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559c61047aa0 con 0x7f4c60035020 2024-05-08T18:33:03.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.443+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c58075030 con 0x7f4c60035020 2024-05-08T18:33:03.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.443+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559c61047aa0 con 0x559c61045000 2024-05-08T18:33:03.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.443+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c60029070 con 0x559c61045000 2024-05-08T18:33:03.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.443+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559c61047aa0 con 0x559c6103ede0 2024-05-08T18:33:03.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.444+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.444+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559c61047aa0 con 0x7f4c580a1040 2024-05-08T18:33:03.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.444+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.444+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559c61047aa0 con 0x559c6103ede0 2024-05-08T18:33:03.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.444+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.444+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559c61047aa0 con 0x7f4c60035020 2024-05-08T18:33:03.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.445+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4c58075030 con 0x7f4c60035020 2024-05-08T18:33:03.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.445+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559c61047aa0 con 0x559c61045000 2024-05-08T18:33:03.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.445+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c60029070 con 0x559c61045000 2024-05-08T18:33:03.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.445+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559c61047aa0 con 0x559c61045000 2024-05-08T18:33:03.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.445+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c60029070 con 0x559c61045000 2024-05-08T18:33:03.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.445+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c60061040 con 0x7f4c580a1040 2024-05-08T18:33:03.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.446+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.446+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c60061040 con 0x559c61045000 2024-05-08T18:33:03.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.446+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c60029070 con 0x559c61045000 2024-05-08T18:33:03.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.446+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c60061040 con 0x559c61045000 2024-05-08T18:33:03.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.446+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c60029070 con 0x559c61045000 2024-05-08T18:33:03.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.446+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c60061040 con 0x559c6103ede0 2024-05-08T18:33:03.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.447+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.447+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c60061040 con 0x559c6103ede0 2024-05-08T18:33:03.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.447+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.447+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c60061040 con 0x7f4c580a1040 2024-05-08T18:33:03.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.447+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.447+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c60061040 con 0x559c61045000 2024-05-08T18:33:03.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.447+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c60029070 con 0x559c61045000 2024-05-08T18:33:03.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.447+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c60061040 con 0x7f4c60035020 2024-05-08T18:33:03.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.448+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c58075030 con 0x7f4c60035020 2024-05-08T18:33:03.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.448+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c60061040 con 0x559c6103ede0 2024-05-08T18:33:03.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.448+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.448+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c60061040 con 0x7f4c580a1040 2024-05-08T18:33:03.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.448+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.448+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c60061040 con 0x559c61045000 2024-05-08T18:33:03.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.448+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c60029070 con 0x559c61045000 2024-05-08T18:33:03.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.448+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c60061040 con 0x7f4c60035020 2024-05-08T18:33:03.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.449+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c58075030 con 0x7f4c60035020 2024-05-08T18:33:03.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.449+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c60061040 con 0x7f4c60035020 2024-05-08T18:33:03.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.449+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c58075030 con 0x7f4c60035020 2024-05-08T18:33:03.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.449+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c60061040 con 0x559c61045000 2024-05-08T18:33:03.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.449+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c60029070 con 0x559c61045000 2024-05-08T18:33:03.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.449+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c60061040 con 0x7f4c60035020 2024-05-08T18:33:03.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.449+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c58075030 con 0x7f4c60035020 2024-05-08T18:33:03.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.449+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c60061040 con 0x559c6103ede0 2024-05-08T18:33:03.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c60061040 con 0x7f4c60035020 2024-05-08T18:33:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c58075030 con 0x7f4c60035020 2024-05-08T18:33:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c69927800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c69927800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c69927800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c69927800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c69927800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c69927800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c69927800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c61043aa0 con 0x559c6103ede0 2024-05-08T18:33:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c69927800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c69927800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c61044340 con 0x559c6103ede0 2024-05-08T18:33:03.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c69927800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:03.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c69927800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.450+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c610436e0 con 0x7f4c580a1040 2024-05-08T18:33:03.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c69927800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:03.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c69927800 20 zone default found 2024-05-08T18:33:03.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c69927800 4 Realm: () 2024-05-08T18:33:03.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c69927800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:03.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c69927800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c69927800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c69927800 20 zonegroup default 2024-05-08T18:33:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c69927800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c61047f20 con 0x7f4c580a1040 2024-05-08T18:33:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c69927800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c69927800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c61049db0 con 0x559c61045000 2024-05-08T18:33:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c60029070 con 0x559c61045000 2024-05-08T18:33:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c69927800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c69927800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.451+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c6104a150 con 0x559c61045000 2024-05-08T18:33:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.452+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c60029070 con 0x559c61045000 2024-05-08T18:33:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.452+0000 7f4c69927800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.452+0000 7f4c69927800 20 started sync module instance, tier type = 2024-05-08T18:33:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.452+0000 7f4c69927800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.452+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c610491f0 con 0x7f4c60035020 2024-05-08T18:33:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.453+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c58075030 con 0x7f4c60035020 2024-05-08T18:33:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.453+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94130130949648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104a9a0 con 0x7f4c60035020 2024-05-08T18:33:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.453+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104b1f0 con 0x559c6103ede0 2024-05-08T18:33:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.454+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94130130949648] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c58075030 con 0x7f4c60035020 2024-05-08T18:33:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.454+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.454+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94130130953456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104b250 con 0x559c6103ede0 2024-05-08T18:33:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.454+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104bd30 con 0x559c61045000 2024-05-08T18:33:03.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.455+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94130130953456] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.455+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c60029070 con 0x559c61045000 2024-05-08T18:33:03.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.455+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94130130958304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104bcf0 con 0x559c61045000 2024-05-08T18:33:03.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.455+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104c7a0 con 0x7f4c60035020 2024-05-08T18:33:03.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.456+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c58075030 con 0x7f4c60035020 2024-05-08T18:33:03.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.456+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94130130961136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104d070 con 0x7f4c60035020 2024-05-08T18:33:03.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.456+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104db50 con 0x559c6103ede0 2024-05-08T18:33:03.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.457+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94130130958304] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c60029070 con 0x559c61045000 2024-05-08T18:33:03.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.457+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94130130961136] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c58075030 con 0x7f4c60035020 2024-05-08T18:33:03.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.458+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.458+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94130130963392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104ad40 con 0x559c6103ede0 2024-05-08T18:33:03.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.458+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104e3f0 con 0x7f4c580a1040 2024-05-08T18:33:03.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.459+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.459+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94130130963392] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.459+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94130130968304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104e310 con 0x7f4c580a1040 2024-05-08T18:33:03.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.459+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104ee00 con 0x7f4c580a1040 2024-05-08T18:33:03.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.460+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94130130968304] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.460+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.460+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94130130966112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104ee00 con 0x7f4c580a1040 2024-05-08T18:33:03.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.460+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104f740 con 0x7f4c580a1040 2024-05-08T18:33:03.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.461+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94130130966112] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.461+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.461+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94130130973168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104f700 con 0x7f4c580a1040 2024-05-08T18:33:03.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.461+0000 7f4c69927800 20 add_watcher() i=0 2024-05-08T18:33:03.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.461+0000 7f4c69927800 20 add_watcher() i=1 2024-05-08T18:33:03.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.461+0000 7f4c69927800 20 add_watcher() i=2 2024-05-08T18:33:03.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.461+0000 7f4c69927800 20 add_watcher() i=3 2024-05-08T18:33:03.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.461+0000 7f4c69927800 20 add_watcher() i=4 2024-05-08T18:33:03.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.461+0000 7f4c69927800 20 add_watcher() i=5 2024-05-08T18:33:03.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.461+0000 7f4c69927800 20 add_watcher() i=6 2024-05-08T18:33:03.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.462+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94130130973168] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.462+0000 7f4c69927800 20 add_watcher() i=7 2024-05-08T18:33:03.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.462+0000 7f4c69927800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:03.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.462+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c61052b90 con 0x559c6103ede0 2024-05-08T18:33:03.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.463+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.463+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94130130970512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c610500e0 con 0x559c6103ede0 2024-05-08T18:33:03.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.464+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94130130970512] v29'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.464+0000 7f4b1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:03.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.464+0000 7f4c69927800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:03.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.464+0000 7f4c69927800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:03.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.464+0000 7f4c69927800 5 note: GC not initialized 2024-05-08T18:33:03.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.464+0000 7f4b1a7e4640 20 reqs_thread_entry: start 2024-05-08T18:33:03.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.464+0000 7f4c69927800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:03.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.464+0000 7f4c69927800 20 Filter name: none 2024-05-08T18:33:03.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.465+0000 7f4a8bfff640 20 reqs_thread_entry: start 2024-05-08T18:33:03.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.465+0000 7f4c69927800 20 rados->read ofs=0 len=0 2024-05-08T18:33:03.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.465+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559c61085be0 con 0x559c6103ede0 2024-05-08T18:33:03.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.465+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.465+0000 7f4c69927800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:03.486 INFO:teuthology.orchestra.run.smithi087.stderr:could not fetch user info: no user info saved 2024-05-08T18:33:03.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.466+0000 7f4b1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:03.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.466+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94130130970512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c61085ba0 con 0x559c6103ede0 2024-05-08T18:33:03.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.467+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94130130970512] v29'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.467+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94130130949648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c61085ba0 con 0x7f4c60035020 2024-05-08T18:33:03.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.468+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94130130949648] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c58075030 con 0x7f4c60035020 2024-05-08T18:33:03.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.468+0000 7f4c69927800 20 remove_watcher() i=0 2024-05-08T18:33:03.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.468+0000 7f4c69927800 2 removed watcher, disabling cache 2024-05-08T18:33:03.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.468+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94130130953456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c61049610 con 0x559c6103ede0 2024-05-08T18:33:03.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.469+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94130130953456] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.469+0000 7f4c69927800 20 remove_watcher() i=1 2024-05-08T18:33:03.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.469+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94130130958304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c61049610 con 0x559c61045000 2024-05-08T18:33:03.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.470+0000 7f4c65e5a640 1 -- 172.21.15.87:0/1376774228 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94130130958304] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c60029070 con 0x559c61045000 2024-05-08T18:33:03.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.470+0000 7f4c69927800 20 remove_watcher() i=2 2024-05-08T18:33:03.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.470+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94130130961136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104b7e0 con 0x7f4c60035020 2024-05-08T18:33:03.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.471+0000 7f4c65659640 1 -- 172.21.15.87:0/1376774228 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94130130961136] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c58075030 con 0x7f4c60035020 2024-05-08T18:33:03.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.471+0000 7f4c69927800 20 remove_watcher() i=3 2024-05-08T18:33:03.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.471+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94130130963392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104b7e0 con 0x559c6103ede0 2024-05-08T18:33:03.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.473+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94130130963392] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x559c6103ede0 2024-05-08T18:33:03.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.473+0000 7f4c69927800 20 remove_watcher() i=4 2024-05-08T18:33:03.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.473+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94130130968304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104cbc0 con 0x7f4c580a1040 2024-05-08T18:33:03.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.474+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94130130968304] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.474+0000 7f4c69927800 20 remove_watcher() i=5 2024-05-08T18:33:03.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.474+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94130130966112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104b7e0 con 0x7f4c580a1040 2024-05-08T18:33:03.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.475+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94130130966112] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.475+0000 7f4c69927800 20 remove_watcher() i=6 2024-05-08T18:33:03.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.475+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94130130973168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559c6104b7e0 con 0x7f4c580a1040 2024-05-08T18:33:03.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94130130973168] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5000f610 con 0x7f4c580a1040 2024-05-08T18:33:03.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 20 remove_watcher() i=7 2024-05-08T18:33:03.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c580a1040 msgr2=0x7f4c580946e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c580a1040 0x7f4c580946e0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559c6103ede0 msgr2=0x559c61041280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559c6103ede0 0x559c61041280 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c60035020 msgr2=0x7f4c600229f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c60035020 0x7f4c600229f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x559c61045000 msgr2=0x559c610473f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x559c61045000 0x559c610473f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b3003bba0 msgr2=0x7f4b3003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b3003bba0 0x7f4b3003e060 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4c5805cc00 tx=0x7f4c58086000 comp rx=0 tx=0).stop 2024-05-08T18:33:03.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6102bb30 msgr2=0x559c61033160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c5ce58640 1 -- 172.21.15.87:0/1376774228 reap_dead start 2024-05-08T18:33:03.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6102bb30 0x559c61033160 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4c6004d010 tx=0x7f4c60052900 comp rx=0 tx=0).stop 2024-05-08T18:33:03.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 shutdown_connections 2024-05-08T18:33:03.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 --2- 172.21.15.87:0/1376774228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6102bb30 0x559c61033160 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 >> 172.21.15.87:0/1376774228 conn(0x559c61027e90 msgr2=0x559c610254f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 shutdown_connections 2024-05-08T18:33:03.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 -- 172.21.15.87:0/1376774228 wait complete. 2024-05-08T18:33:03.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 -- 172.21.15.87:0/1047495050 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b4003bb50 msgr2=0x7f4b4003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 --2- 172.21.15.87:0/1047495050 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b4003bb50 0x7f4b4003e010 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4c58092970 tx=0x7f4c58006a30 comp rx=0 tx=0).stop 2024-05-08T18:33:03.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 -- 172.21.15.87:0/1047495050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6101e810 msgr2=0x559c6101ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 --2- 172.21.15.87:0/1047495050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6101e810 0x559c6101ec30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x559c61004690 tx=0x7f4c600178e0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 -- 172.21.15.87:0/1047495050 shutdown_connections 2024-05-08T18:33:03.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 --2- 172.21.15.87:0/1047495050 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b4003bb50 0x7f4b4003e010 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 --2- 172.21.15.87:0/1047495050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c6101e810 0x559c6101ec30 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 -- 172.21.15.87:0/1047495050 >> 172.21.15.87:0/1047495050 conn(0x559c610128b0 msgr2=0x559c61012cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 -- 172.21.15.87:0/1047495050 shutdown_connections 2024-05-08T18:33:03.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.476+0000 7f4c69927800 1 -- 172.21.15.87:0/1047495050 wait complete. 2024-05-08T18:33:03.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.477+0000 7f4c69927800 1 -- 172.21.15.87:0/1024536468 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559c6100dca0 msgr2=0x559c61010090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.477+0000 7f4c69927800 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559c6100dca0 0x559c61010090 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.477+0000 7f4c69927800 1 -- 172.21.15.87:0/1024536468 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559c60e7ddc0 msgr2=0x559c6100a4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.477+0000 7f4c69927800 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559c60e7ddc0 0x559c6100a4d0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.477+0000 7f4c69927800 1 -- 172.21.15.87:0/1024536468 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b4c03bb50 msgr2=0x7f4b4c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.477+0000 7f4c69927800 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b4c03bb50 0x7f4b4c03e010 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4c50000f60 tx=0x7f4c50001370 comp rx=0 tx=0).stop 2024-05-08T18:33:03.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.477+0000 7f4c69927800 1 -- 172.21.15.87:0/1024536468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7c860 msgr2=0x559c61003290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.477+0000 7f4c69927800 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7c860 0x559c61003290 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f4c5801d0e0 tx=0x7f4c58003020 comp rx=0 tx=0).stop 2024-05-08T18:33:03.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.477+0000 7f4c69927800 1 -- 172.21.15.87:0/1024536468 shutdown_connections 2024-05-08T18:33:03.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.477+0000 7f4c69927800 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x559c60e7ddc0 0x559c6100a4d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.477+0000 7f4c69927800 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x559c6100dca0 0x559c61010090 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.477+0000 7f4c69927800 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b4c03bb50 0x7f4b4c03e010 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.477+0000 7f4c69927800 1 --2- 172.21.15.87:0/1024536468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559c60e7c860 0x559c61003290 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.477+0000 7f4c69927800 1 -- 172.21.15.87:0/1024536468 >> 172.21.15.87:0/1024536468 conn(0x559c60f03830 msgr2=0x559c60ff59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.477+0000 7f4c69927800 1 -- 172.21.15.87:0/1024536468 shutdown_connections 2024-05-08T18:33:03.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.477+0000 7f4c69927800 1 -- 172.21.15.87:0/1024536468 wait complete. 2024-05-08T18:33:03.493 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-08T18:33:03.494 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-05-08T18:33:03.494 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-05-08T18:33:03.494 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-05-08T18:33:03.577 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:03.577 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:03.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.579+0000 7ff20813f800 1 Processor -- start 2024-05-08T18:33:03.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.580+0000 7ff20813f800 1 -- start start 2024-05-08T18:33:03.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.580+0000 7ff20813f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556c568f81a0 0x556c568f85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.580+0000 7ff20813f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556c568f8c40 con 0x556c568f9400 2024-05-08T18:33:03.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.580+0000 7ff20813f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x556c56799e20 con 0x556c568f81a0 2024-05-08T18:33:03.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.580+0000 7ff203e94640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556c568f81a0 0x556c568f85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.580+0000 7ff203e94640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556c568f81a0 0x556c568f85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52194/0 (socket says 172.21.15.87:52194) 2024-05-08T18:33:03.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.580+0000 7ff1fb693640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x556c568f9400 0x556c568f9880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58130/0 (socket says 172.21.15.87:58130) 2024-05-08T18:33:03.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.580+0000 7ff203e94640 1 -- 172.21.15.87:0/1066980461 learned_addr learned my addr 172.21.15.87:0/1066980461 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.580+0000 7ff203e94640 1 -- 172.21.15.87:0/1066980461 >> v1:172.21.15.53:6789/0 conn(0x556c568f9400 legacy=0x556c568f9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.580+0000 7ff203e94640 1 -- 172.21.15.87:0/1066980461 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c568f9fc0 con 0x556c568f81a0 2024-05-08T18:33:03.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.582+0000 7ff203e94640 1 --2- 172.21.15.87:0/1066980461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 0x556c568f85c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400a520 tx=0x7ff1f401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd6e8d0cd460791 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.582+0000 7ff203693640 1 -- 172.21.15.87:0/1066980461 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1f4057070 con 0x556c568f81a0 2024-05-08T18:33:03.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.582+0000 7ff203693640 1 -- 172.21.15.87:0/1066980461 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f4052570 con 0x556c568f81a0 2024-05-08T18:33:03.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.582+0000 7ff203693640 1 -- 172.21.15.87:0/1066980461 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1f4052870 con 0x556c568f81a0 2024-05-08T18:33:03.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.583+0000 7ff20813f800 1 -- 172.21.15.87:0/1066980461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 msgr2=0x556c568f85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.583+0000 7ff20813f800 1 --2- 172.21.15.87:0/1066980461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 0x556c568f85c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400a520 tx=0x7ff1f401d010 comp rx=0 tx=0).stop 2024-05-08T18:33:03.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.583+0000 7ff20813f800 1 -- 172.21.15.87:0/1066980461 shutdown_connections 2024-05-08T18:33:03.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.583+0000 7ff20813f800 1 --2- 172.21.15.87:0/1066980461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 0x556c568f85c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.583+0000 7ff20813f800 1 -- 172.21.15.87:0/1066980461 >> 172.21.15.87:0/1066980461 conn(0x556c568f37a0 msgr2=0x556c568f5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.583+0000 7ff20813f800 1 -- 172.21.15.87:0/1066980461 shutdown_connections 2024-05-08T18:33:03.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.583+0000 7ff20813f800 1 -- 172.21.15.87:0/1066980461 wait complete. 2024-05-08T18:33:03.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.596+0000 7ff20813f800 1 Processor -- start 2024-05-08T18:33:03.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.596+0000 7ff20813f800 1 -- start start 2024-05-08T18:33:03.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.597+0000 7ff20813f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 0x556c569e8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.597+0000 7ff20813f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556c568445b0 con 0x556c568f81a0 2024-05-08T18:33:03.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.597+0000 7ff203e94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 0x556c569e8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.597+0000 7ff203e94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 0x556c569e8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52202/0 (socket says 172.21.15.87:52202) 2024-05-08T18:33:03.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.597+0000 7ff203e94640 1 -- 172.21.15.87:0/1499054270 learned_addr learned my addr 172.21.15.87:0/1499054270 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.597+0000 7ff203e94640 1 -- 172.21.15.87:0/1499054270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c569e8c00 con 0x556c568f81a0 2024-05-08T18:33:03.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.598+0000 7ff203e94640 1 --2- 172.21.15.87:0/1499054270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 0x556c569e8630 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4055040 tx=0x7ff1f404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1c9cf262994d6a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.598+0000 7ff0f1e0b640 1 -- 172.21.15.87:0/1499054270 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1f4057040 con 0x556c568f81a0 2024-05-08T18:33:03.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.598+0000 7ff0f1e0b640 1 -- 172.21.15.87:0/1499054270 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f4052850 con 0x556c568f81a0 2024-05-08T18:33:03.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.598+0000 7ff0f1e0b640 1 -- 172.21.15.87:0/1499054270 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1f4052b50 con 0x556c568f81a0 2024-05-08T18:33:03.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.598+0000 7ff20813f800 1 -- 172.21.15.87:0/1499054270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 msgr2=0x556c569e8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.598+0000 7ff20813f800 1 --2- 172.21.15.87:0/1499054270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 0x556c569e8630 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4055040 tx=0x7ff1f404c000 comp rx=0 tx=0).stop 2024-05-08T18:33:03.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.598+0000 7ff20813f800 1 -- 172.21.15.87:0/1499054270 shutdown_connections 2024-05-08T18:33:03.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.598+0000 7ff20813f800 1 --2- 172.21.15.87:0/1499054270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 0x556c569e8630 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.598+0000 7ff20813f800 1 -- 172.21.15.87:0/1499054270 >> 172.21.15.87:0/1499054270 conn(0x556c568f37a0 msgr2=0x556c569e3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.598+0000 7ff20813f800 1 -- 172.21.15.87:0/1499054270 shutdown_connections 2024-05-08T18:33:03.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.598+0000 7ff20813f800 1 -- 172.21.15.87:0/1499054270 wait complete. 2024-05-08T18:33:03.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.599+0000 7ff20813f800 1 Processor -- start 2024-05-08T18:33:03.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.599+0000 7ff20813f800 1 -- start start 2024-05-08T18:33:03.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.599+0000 7ff20813f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 0x556c569f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.599+0000 7ff20813f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556c5686bae0 con 0x556c568f81a0 2024-05-08T18:33:03.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.599+0000 7ff203e94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 0x556c569f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.599+0000 7ff203e94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 0x556c569f4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52208/0 (socket says 172.21.15.87:52208) 2024-05-08T18:33:03.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.599+0000 7ff203e94640 1 -- 172.21.15.87:0/200320603 learned_addr learned my addr 172.21.15.87:0/200320603 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.599+0000 7ff203e94640 1 -- 172.21.15.87:0/200320603 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c569f4a40 con 0x556c568f81a0 2024-05-08T18:33:03.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.600+0000 7ff203e94640 1 --2- 172.21.15.87:0/200320603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 0x556c569f4500 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400a520 tx=0x7ff1f4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.600+0000 7ff0ebfff640 1 -- 172.21.15.87:0/200320603 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1f4073070 con 0x556c568f81a0 2024-05-08T18:33:03.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.600+0000 7ff0ebfff640 1 -- 172.21.15.87:0/200320603 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f405d650 con 0x556c568f81a0 2024-05-08T18:33:03.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.600+0000 7ff0ebfff640 1 -- 172.21.15.87:0/200320603 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1f4057070 con 0x556c568f81a0 2024-05-08T18:33:03.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.600+0000 7ff20813f800 1 -- 172.21.15.87:0/200320603 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c569f4cd0 con 0x556c568f81a0 2024-05-08T18:33:03.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.600+0000 7ff20813f800 1 -- 172.21.15.87:0/200320603 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c569f78e0 con 0x556c568f81a0 2024-05-08T18:33:03.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.600+0000 7ff20813f800 1 Processor -- start 2024-05-08T18:33:03.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.600+0000 7ff20813f800 1 -- start start 2024-05-08T18:33:03.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.601+0000 7ff20813f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a01af0 0x556c56a01f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.601+0000 7ff20813f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556c567eafc0 con 0x556c56a01af0 2024-05-08T18:33:03.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.601+0000 7ff0ebfff640 1 -- 172.21.15.87:0/200320603 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff1f4076070 con 0x556c568f81a0 2024-05-08T18:33:03.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.601+0000 7ff204695640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a01af0 0x556c56a01f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.601+0000 7ff204695640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a01af0 0x556c56a01f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52212/0 (socket says 172.21.15.87:52212) 2024-05-08T18:33:03.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.601+0000 7ff204695640 1 -- 172.21.15.87:0/2611479965 learned_addr learned my addr 172.21.15.87:0/2611479965 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.601+0000 7ff0ebfff640 1 --2- 172.21.15.87:0/200320603 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff0ec03bb50 0x7ff0ec03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.601+0000 7ff0ebfff640 1 -- 172.21.15.87:0/200320603 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff1f4094370 con 0x556c568f81a0 2024-05-08T18:33:03.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.601+0000 7ff203e94640 1 --2- 172.21.15.87:0/200320603 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff0ec03bb50 0x7ff0ec03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.601+0000 7ff204695640 1 -- 172.21.15.87:0/2611479965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c56a02450 con 0x556c56a01af0 2024-05-08T18:33:03.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.601+0000 7ff204695640 1 --2- 172.21.15.87:0/2611479965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a01af0 0x556c56a01f10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00a430 tx=0x7ff1fc00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecb6c785f505bc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.601+0000 7ff203e94640 1 --2- 172.21.15.87:0/200320603 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff0ec03bb50 0x7ff0ec03e010 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff1f406d000 tx=0x7ff1f404acb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.601+0000 7ff0e9ffb640 1 -- 172.21.15.87:0/2611479965 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1fc015070 con 0x556c56a01af0 2024-05-08T18:33:03.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.602+0000 7ff0e9ffb640 1 -- 172.21.15.87:0/2611479965 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1fc001670 con 0x556c56a01af0 2024-05-08T18:33:03.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.602+0000 7ff0e9ffb640 1 -- 172.21.15.87:0/2611479965 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1fc001990 con 0x556c56a01af0 2024-05-08T18:33:03.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.602+0000 7ff20813f800 1 -- 172.21.15.87:0/2611479965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a01af0 msgr2=0x556c56a01f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.602+0000 7ff20813f800 1 --2- 172.21.15.87:0/2611479965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a01af0 0x556c56a01f10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00a430 tx=0x7ff1fc00a8f0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.602+0000 7ff20813f800 1 -- 172.21.15.87:0/2611479965 shutdown_connections 2024-05-08T18:33:03.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.602+0000 7ff20813f800 1 --2- 172.21.15.87:0/2611479965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a01af0 0x556c56a01f10 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.602+0000 7ff20813f800 1 -- 172.21.15.87:0/2611479965 >> 172.21.15.87:0/2611479965 conn(0x556c568f9400 msgr2=0x556c569fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.602+0000 7ff20813f800 1 -- 172.21.15.87:0/2611479965 shutdown_connections 2024-05-08T18:33:03.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.602+0000 7ff20813f800 1 -- 172.21.15.87:0/2611479965 wait complete. 2024-05-08T18:33:03.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.602+0000 7ff20813f800 1 Processor -- start 2024-05-08T18:33:03.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.602+0000 7ff20813f800 1 -- start start 2024-05-08T18:33:03.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.602+0000 7ff20813f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a01af0 0x556c56a09040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.602+0000 7ff20813f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556c56a02de0 con 0x556c56a01af0 2024-05-08T18:33:03.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.603+0000 7ff204695640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a01af0 0x556c56a09040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.603+0000 7ff204695640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a01af0 0x556c56a09040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52220/0 (socket says 172.21.15.87:52220) 2024-05-08T18:33:03.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.603+0000 7ff204695640 1 -- 172.21.15.87:0/103166299 learned_addr learned my addr 172.21.15.87:0/103166299 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.603+0000 7ff204695640 1 -- 172.21.15.87:0/103166299 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c56a09580 con 0x556c56a01af0 2024-05-08T18:33:03.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.603+0000 7ff204695640 1 --2- 172.21.15.87:0/103166299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a01af0 0x556c56a09040 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00a930 tx=0x7ff1fc003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.603+0000 7ff0e3fff640 1 -- 172.21.15.87:0/103166299 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1fc020020 con 0x556c56a01af0 2024-05-08T18:33:03.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.603+0000 7ff0e3fff640 1 -- 172.21.15.87:0/103166299 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1fc0108b0 con 0x556c56a01af0 2024-05-08T18:33:03.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.603+0000 7ff0e3fff640 1 -- 172.21.15.87:0/103166299 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1fc015040 con 0x556c56a01af0 2024-05-08T18:33:03.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.603+0000 7ff20813f800 1 -- 172.21.15.87:0/103166299 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c56a09810 con 0x556c56a01af0 2024-05-08T18:33:03.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.603+0000 7ff20813f800 1 -- 172.21.15.87:0/103166299 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c56a0c4c0 con 0x556c56a01af0 2024-05-08T18:33:03.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.604+0000 7ff0e3fff640 1 -- 172.21.15.87:0/103166299 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff1fc023020 con 0x556c56a01af0 2024-05-08T18:33:03.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.604+0000 7ff0e3fff640 1 --2- 172.21.15.87:0/103166299 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff0dc03bba0 0x7ff0dc03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.605+0000 7ff0e3fff640 1 -- 172.21.15.87:0/103166299 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff1fc052390 con 0x556c56a01af0 2024-05-08T18:33:03.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.605+0000 7ff1fb693640 1 --2- 172.21.15.87:0/103166299 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff0dc03bba0 0x7ff0dc03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.605+0000 7ff20813f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:03.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.605+0000 7ff20813f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:03.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.605+0000 7ff20813f800 1 Processor -- start 2024-05-08T18:33:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.605+0000 7ff1fb693640 1 --2- 172.21.15.87:0/103166299 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff0dc03bba0 0x7ff0dc03e060 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec000f60 tx=0x7ff1ec0012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.605+0000 7ff20813f800 1 -- start start 2024-05-08T18:33:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.605+0000 7ff20813f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a236c0 0x556c56a23ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.605+0000 7ff20813f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556c569e8ec0 con 0x556c56a236c0 2024-05-08T18:33:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.606+0000 7ff203e94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a236c0 0x556c56a23ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.606+0000 7ff203e94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a236c0 0x556c56a23ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52222/0 (socket says 172.21.15.87:52222) 2024-05-08T18:33:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.606+0000 7ff203e94640 1 -- 172.21.15.87:0/1803797827 learned_addr learned my addr 172.21.15.87:0/1803797827 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.606+0000 7ff203e94640 1 -- 172.21.15.87:0/1803797827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c56a24020 con 0x556c56a236c0 2024-05-08T18:33:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.606+0000 7ff203e94640 1 --2- 172.21.15.87:0/1803797827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a236c0 0x556c56a23ae0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4092630 tx=0x7ff1f4076df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.606+0000 7ff0c8fe1640 1 -- 172.21.15.87:0/1803797827 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1f4091020 con 0x556c56a236c0 2024-05-08T18:33:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.606+0000 7ff0c8fe1640 1 -- 172.21.15.87:0/1803797827 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f4092350 con 0x556c56a236c0 2024-05-08T18:33:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.607+0000 7ff0c8fe1640 1 -- 172.21.15.87:0/1803797827 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1f4089040 con 0x556c56a236c0 2024-05-08T18:33:03.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.607+0000 7ff20813f800 1 -- 172.21.15.87:0/1803797827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c56a24a90 con 0x556c56a236c0 2024-05-08T18:33:03.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.607+0000 7ff20813f800 1 -- 172.21.15.87:0/1803797827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c56a24f90 con 0x556c56a236c0 2024-05-08T18:33:03.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.608+0000 7ff0c8fe1640 1 -- 172.21.15.87:0/1803797827 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff1f405bbf0 con 0x556c56a236c0 2024-05-08T18:33:03.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.608+0000 7ff0c8fe1640 1 --2- 172.21.15.87:0/1803797827 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff03c03bae0 0x7ff03c03dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.608+0000 7ff0c8fe1640 1 -- 172.21.15.87:0/1803797827 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff1f40073e0 con 0x556c56a236c0 2024-05-08T18:33:03.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.608+0000 7ff1fb693640 1 --2- 172.21.15.87:0/1803797827 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff03c03bae0 0x7ff03c03dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.608+0000 7ff0c27fc640 20 reqs_thread_entry: start 2024-05-08T18:33:03.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.608+0000 7ff1fb693640 1 --2- 172.21.15.87:0/1803797827 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff03c03bae0 0x7ff03c03dfa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec001ed0 tx=0x7ff1ec00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.608+0000 7ff20813f800 1 --2- 172.21.15.87:0/200320603 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556c56a31180 0x556c56a33620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.608+0000 7ff20813f800 1 -- 172.21.15.87:0/200320603 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556c56a33cf0 con 0x556c56a31180 2024-05-08T18:33:03.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.609+0000 7ff204695640 1 --2- 172.21.15.87:0/200320603 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556c56a31180 0x556c56a33620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.609+0000 7ff204695640 1 --2- 172.21.15.87:0/200320603 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556c56a31180 0x556c56a33620 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.609+0000 7ff204695640 1 -- 172.21.15.87:0/200320603 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1fc010d70 con 0x556c56a31180 2024-05-08T18:33:03.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.609+0000 7ff20813f800 1 -- 172.21.15.87:0/200320603 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556c56a35650 con 0x556c56a31180 2024-05-08T18:33:03.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.610+0000 7ff204695640 1 -- 172.21.15.87:0/200320603 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff1fc010d70 con 0x556c56a31180 2024-05-08T18:33:03.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.610+0000 7ff20813f800 1 -- 172.21.15.87:0/103166299 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff0dc03bba0 msgr2=0x7ff0dc03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.610+0000 7ff20813f800 1 --2- 172.21.15.87:0/103166299 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff0dc03bba0 0x7ff0dc03e060 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec000f60 tx=0x7ff1ec0012f0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.610+0000 7ff20813f800 1 -- 172.21.15.87:0/103166299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a01af0 msgr2=0x556c56a09040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.610+0000 7ff20813f800 1 --2- 172.21.15.87:0/103166299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a01af0 0x556c56a09040 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00a930 tx=0x7ff1fc003370 comp rx=0 tx=0).stop 2024-05-08T18:33:03.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.610+0000 7ff20813f800 1 -- 172.21.15.87:0/103166299 shutdown_connections 2024-05-08T18:33:03.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.610+0000 7ff20813f800 1 --2- 172.21.15.87:0/103166299 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff0dc03bba0 0x7ff0dc03e060 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.610+0000 7ff20813f800 1 --2- 172.21.15.87:0/103166299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a01af0 0x556c56a09040 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.610+0000 7ff20813f800 1 -- 172.21.15.87:0/103166299 >> 172.21.15.87:0/103166299 conn(0x556c568f9400 msgr2=0x556c569fbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.610+0000 7ff20813f800 1 -- 172.21.15.87:0/103166299 shutdown_connections 2024-05-08T18:33:03.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.610+0000 7ff20813f800 1 -- 172.21.15.87:0/103166299 wait complete. 2024-05-08T18:33:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 -- 172.21.15.87:0/1803797827 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff03c03bae0 msgr2=0x7ff03c03dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 --2- 172.21.15.87:0/1803797827 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff03c03bae0 0x7ff03c03dfa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec001ed0 tx=0x7ff1ec00f000 comp rx=0 tx=0).stop 2024-05-08T18:33:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 -- 172.21.15.87:0/1803797827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a236c0 msgr2=0x556c56a23ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 --2- 172.21.15.87:0/1803797827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a236c0 0x556c56a23ae0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4092630 tx=0x7ff1f4076df0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 -- 172.21.15.87:0/1803797827 shutdown_connections 2024-05-08T18:33:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 --2- 172.21.15.87:0/1803797827 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff03c03bae0 0x7ff03c03dfa0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 --2- 172.21.15.87:0/1803797827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c56a236c0 0x556c56a23ae0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 -- 172.21.15.87:0/1803797827 >> 172.21.15.87:0/1803797827 conn(0x556c56a18170 msgr2=0x556c56a18b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 -- 172.21.15.87:0/1803797827 shutdown_connections 2024-05-08T18:33:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 -- 172.21.15.87:0/1803797827 wait complete. 2024-05-08T18:33:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 -- 172.21.15.87:0/200320603 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556c56a31180 msgr2=0x556c56a33620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 --2- 172.21.15.87:0/200320603 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556c56a31180 0x556c56a33620 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 -- 172.21.15.87:0/200320603 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff0ec03bb50 msgr2=0x7ff0ec03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 --2- 172.21.15.87:0/200320603 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff0ec03bb50 0x7ff0ec03e010 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff1f406d000 tx=0x7ff1f404acb0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 -- 172.21.15.87:0/200320603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 msgr2=0x556c569f4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 --2- 172.21.15.87:0/200320603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 0x556c569f4500 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400a520 tx=0x7ff1f4003020 comp rx=0 tx=0).stop 2024-05-08T18:33:03.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 -- 172.21.15.87:0/200320603 shutdown_connections 2024-05-08T18:33:03.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 --2- 172.21.15.87:0/200320603 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x556c56a31180 0x556c56a33620 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 --2- 172.21.15.87:0/200320603 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff0ec03bb50 0x7ff0ec03e010 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 --2- 172.21.15.87:0/200320603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c568f81a0 0x556c569f4500 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 -- 172.21.15.87:0/200320603 >> 172.21.15.87:0/200320603 conn(0x556c568f37a0 msgr2=0x556c569e2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 -- 172.21.15.87:0/200320603 shutdown_connections 2024-05-08T18:33:03.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.611+0000 7ff20813f800 1 -- 172.21.15.87:0/200320603 wait complete. 2024-05-08T18:33:03.618 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"be5b96a9-27d9-41bc-99e2-d41218f7be5a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-08T18:33:03.618 DEBUG:tasks.util.rgw: json result: {'id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-08T18:33:03.619 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-05-08T18:33:03.619 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-05-08T18:33:03.619 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-05-08T18:33:03.700 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:03.700 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:03.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.703+0000 7f245b52b800 1 Processor -- start 2024-05-08T18:33:03.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.703+0000 7f245b52b800 1 -- start start 2024-05-08T18:33:03.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.703+0000 7f245b52b800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f6d4678850 0x55f6d467ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.703+0000 7f245b52b800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f6d467b180 con 0x55f6d4674d40 2024-05-08T18:33:03.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.703+0000 7f245b52b800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f6d4514e20 con 0x55f6d4678850 2024-05-08T18:33:03.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.703+0000 7f2456ae7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f6d4678850 0x55f6d467ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.703+0000 7f2456ae7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f6d4678850 0x55f6d467ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52228/0 (socket says 172.21.15.87:52228) 2024-05-08T18:33:03.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.703+0000 7f2456ae7640 1 -- 172.21.15.87:0/2074355297 learned_addr learned my addr 172.21.15.87:0/2074355297 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.703+0000 7f24572e8640 1 --1- 172.21.15.87:0/2074355297 >> v1:172.21.15.53:6789/0 conn(0x55f6d4674d40 0x55f6d4677130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58142/0 (socket says 172.21.15.87:58142) 2024-05-08T18:33:03.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.703+0000 7f2456ae7640 1 -- 172.21.15.87:0/2074355297 >> v1:172.21.15.53:6789/0 conn(0x55f6d4674d40 legacy=0x55f6d4677130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.703+0000 7f2456ae7640 1 -- 172.21.15.87:0/2074355297 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6d467c360 con 0x55f6d4678850 2024-05-08T18:33:03.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.705+0000 7f2456ae7640 1 --2- 172.21.15.87:0/2074355297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4678850 0x55f6d467ac40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f244800a520 tx=0x7f244801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ab87c8cc138d81 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.706+0000 7f24562e6640 1 -- 172.21.15.87:0/2074355297 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2448057070 con 0x55f6d4678850 2024-05-08T18:33:03.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.706+0000 7f24562e6640 1 -- 172.21.15.87:0/2074355297 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2448052570 con 0x55f6d4678850 2024-05-08T18:33:03.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.706+0000 7f24562e6640 1 -- 172.21.15.87:0/2074355297 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f244804ae60 con 0x55f6d4678850 2024-05-08T18:33:03.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.706+0000 7f245b52b800 1 -- 172.21.15.87:0/2074355297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4678850 msgr2=0x55f6d467ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.706+0000 7f245b52b800 1 --2- 172.21.15.87:0/2074355297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4678850 0x55f6d467ac40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f244800a520 tx=0x7f244801d010 comp rx=0 tx=0).stop 2024-05-08T18:33:03.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.706+0000 7f245b52b800 1 -- 172.21.15.87:0/2074355297 shutdown_connections 2024-05-08T18:33:03.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.706+0000 7f245b52b800 1 --2- 172.21.15.87:0/2074355297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4678850 0x55f6d467ac40 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.706+0000 7f245b52b800 1 -- 172.21.15.87:0/2074355297 >> 172.21.15.87:0/2074355297 conn(0x55f6d466e710 msgr2=0x55f6d4670b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.706+0000 7f245b52b800 1 -- 172.21.15.87:0/2074355297 shutdown_connections 2024-05-08T18:33:03.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.706+0000 7f245b52b800 1 -- 172.21.15.87:0/2074355297 wait complete. 2024-05-08T18:33:03.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.720+0000 7f245b52b800 1 Processor -- start 2024-05-08T18:33:03.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.720+0000 7f245b52b800 1 -- start start 2024-05-08T18:33:03.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.720+0000 7f245b52b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4674d40 0x55f6d4765660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.720+0000 7f245b52b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f6d45bf5a0 con 0x55f6d4674d40 2024-05-08T18:33:03.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.720+0000 7f24572e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4674d40 0x55f6d4765660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.720+0000 7f24572e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4674d40 0x55f6d4765660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52240/0 (socket says 172.21.15.87:52240) 2024-05-08T18:33:03.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.720+0000 7f24572e8640 1 -- 172.21.15.87:0/2582518762 learned_addr learned my addr 172.21.15.87:0/2582518762 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.721+0000 7f24572e8640 1 -- 172.21.15.87:0/2582518762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6d4765c30 con 0x55f6d4674d40 2024-05-08T18:33:03.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.721+0000 7f24572e8640 1 --2- 172.21.15.87:0/2582518762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4674d40 0x55f6d4765660 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2440001e90 tx=0x7f244000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3594765a75aecb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.721+0000 7f234560a640 1 -- 172.21.15.87:0/2582518762 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f244000e5c0 con 0x55f6d4674d40 2024-05-08T18:33:03.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.721+0000 7f234560a640 1 -- 172.21.15.87:0/2582518762 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2440006070 con 0x55f6d4674d40 2024-05-08T18:33:03.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.721+0000 7f234560a640 1 -- 172.21.15.87:0/2582518762 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f244000e890 con 0x55f6d4674d40 2024-05-08T18:33:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.722+0000 7f245b52b800 1 -- 172.21.15.87:0/2582518762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4674d40 msgr2=0x55f6d4765660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.722+0000 7f245b52b800 1 --2- 172.21.15.87:0/2582518762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4674d40 0x55f6d4765660 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2440001e90 tx=0x7f244000b6c0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.722+0000 7f245b52b800 1 -- 172.21.15.87:0/2582518762 shutdown_connections 2024-05-08T18:33:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.722+0000 7f245b52b800 1 --2- 172.21.15.87:0/2582518762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4674d40 0x55f6d4765660 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.722+0000 7f245b52b800 1 -- 172.21.15.87:0/2582518762 >> 172.21.15.87:0/2582518762 conn(0x55f6d466e710 msgr2=0x55f6d4760f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.722+0000 7f245b52b800 1 -- 172.21.15.87:0/2582518762 shutdown_connections 2024-05-08T18:33:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.722+0000 7f245b52b800 1 -- 172.21.15.87:0/2582518762 wait complete. 2024-05-08T18:33:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.722+0000 7f245b52b800 1 Processor -- start 2024-05-08T18:33:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.722+0000 7f245b52b800 1 -- start start 2024-05-08T18:33:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.722+0000 7f245b52b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4674d40 0x55f6d476d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.722+0000 7f245b52b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f6d467b650 con 0x55f6d4674d40 2024-05-08T18:33:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.722+0000 7f24572e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4674d40 0x55f6d476d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.722+0000 7f24572e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4674d40 0x55f6d476d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52244/0 (socket says 172.21.15.87:52244) 2024-05-08T18:33:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.722+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 learned_addr learned my addr 172.21.15.87:0/1507740550 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.723+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6d476d720 con 0x55f6d4674d40 2024-05-08T18:33:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.723+0000 7f24572e8640 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4674d40 0x55f6d476d1e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f244000c010 tx=0x7f2440000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.723+0000 7f2343e07640 1 -- 172.21.15.87:0/1507740550 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f244000f8d0 con 0x55f6d4674d40 2024-05-08T18:33:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.723+0000 7f2343e07640 1 -- 172.21.15.87:0/1507740550 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f244000fa90 con 0x55f6d4674d40 2024-05-08T18:33:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.723+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6d476d9b0 con 0x55f6d4674d40 2024-05-08T18:33:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.723+0000 7f2343e07640 1 -- 172.21.15.87:0/1507740550 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f244000fdb0 con 0x55f6d4674d40 2024-05-08T18:33:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.723+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6d4770660 con 0x55f6d4674d40 2024-05-08T18:33:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.724+0000 7f245b52b800 1 Processor -- start 2024-05-08T18:33:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.724+0000 7f245b52b800 1 -- start start 2024-05-08T18:33:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.724+0000 7f245b52b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d477a870 0x55f6d477ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.724+0000 7f245b52b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f6d4565fc0 con 0x55f6d477a870 2024-05-08T18:33:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.724+0000 7f2343e07640 1 -- 172.21.15.87:0/1507740550 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2440017070 con 0x55f6d4674d40 2024-05-08T18:33:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.724+0000 7f2457ae9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d477a870 0x55f6d477ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.724+0000 7f2457ae9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d477a870 0x55f6d477ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52258/0 (socket says 172.21.15.87:52258) 2024-05-08T18:33:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.724+0000 7f2457ae9640 1 -- 172.21.15.87:0/3201451654 learned_addr learned my addr 172.21.15.87:0/3201451654 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.724+0000 7f2343e07640 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f233c03bba0 0x7f233c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.725+0000 7f2343e07640 1 -- 172.21.15.87:0/1507740550 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f2440015020 con 0x55f6d4674d40 2024-05-08T18:33:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.725+0000 7f24572e8640 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f233c03bba0 0x7f233c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.725+0000 7f2457ae9640 1 -- 172.21.15.87:0/3201451654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6d477b1d0 con 0x55f6d477a870 2024-05-08T18:33:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.725+0000 7f2457ae9640 1 --2- 172.21.15.87:0/3201451654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d477a870 0x55f6d477ac90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f245000a430 tx=0x7f245000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b77c9571ca90c28 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.725+0000 7f24572e8640 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f233c03bba0 0x7f233c03e060 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f244000b6e0 tx=0x7f2440033040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.725+0000 7f2341e03640 1 -- 172.21.15.87:0/3201451654 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2450015070 con 0x55f6d477a870 2024-05-08T18:33:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.725+0000 7f2341e03640 1 -- 172.21.15.87:0/3201451654 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2450001670 con 0x55f6d477a870 2024-05-08T18:33:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.725+0000 7f2341e03640 1 -- 172.21.15.87:0/3201451654 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2450001990 con 0x55f6d477a870 2024-05-08T18:33:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.725+0000 7f245b52b800 1 -- 172.21.15.87:0/3201451654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d477a870 msgr2=0x55f6d477ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.725+0000 7f245b52b800 1 --2- 172.21.15.87:0/3201451654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d477a870 0x55f6d477ac90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f245000a430 tx=0x7f245000a8f0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.725+0000 7f245b52b800 1 -- 172.21.15.87:0/3201451654 shutdown_connections 2024-05-08T18:33:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.725+0000 7f245b52b800 1 --2- 172.21.15.87:0/3201451654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d477a870 0x55f6d477ac90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.725+0000 7f245b52b800 1 -- 172.21.15.87:0/3201451654 >> 172.21.15.87:0/3201451654 conn(0x55f6d4678850 msgr2=0x55f6d4777310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.726+0000 7f245b52b800 1 -- 172.21.15.87:0/3201451654 shutdown_connections 2024-05-08T18:33:03.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.726+0000 7f245b52b800 1 -- 172.21.15.87:0/3201451654 wait complete. 2024-05-08T18:33:03.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.726+0000 7f245b52b800 1 Processor -- start 2024-05-08T18:33:03.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.726+0000 7f245b52b800 1 -- start start 2024-05-08T18:33:03.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.726+0000 7f245b52b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d477a870 0x55f6d4781e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.726+0000 7f245b52b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f6d477bb60 con 0x55f6d477a870 2024-05-08T18:33:03.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.726+0000 7f2457ae9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d477a870 0x55f6d4781e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.726+0000 7f2457ae9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d477a870 0x55f6d4781e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52274/0 (socket says 172.21.15.87:52274) 2024-05-08T18:33:03.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.726+0000 7f2457ae9640 1 -- 172.21.15.87:0/4201420370 learned_addr learned my addr 172.21.15.87:0/4201420370 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.727+0000 7f2457ae9640 1 -- 172.21.15.87:0/4201420370 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6d4782340 con 0x55f6d477a870 2024-05-08T18:33:03.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.727+0000 7f2457ae9640 1 --2- 172.21.15.87:0/4201420370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d477a870 0x55f6d4781e00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f245000a930 tx=0x7f2450003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.727+0000 7f2333fff640 1 -- 172.21.15.87:0/4201420370 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2450020020 con 0x55f6d477a870 2024-05-08T18:33:03.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.727+0000 7f2333fff640 1 -- 172.21.15.87:0/4201420370 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24500108b0 con 0x55f6d477a870 2024-05-08T18:33:03.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.727+0000 7f245b52b800 1 -- 172.21.15.87:0/4201420370 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6d47825d0 con 0x55f6d477a870 2024-05-08T18:33:03.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.727+0000 7f2333fff640 1 -- 172.21.15.87:0/4201420370 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2450015040 con 0x55f6d477a870 2024-05-08T18:33:03.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.727+0000 7f245b52b800 1 -- 172.21.15.87:0/4201420370 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6d4785280 con 0x55f6d477a870 2024-05-08T18:33:03.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.728+0000 7f2333fff640 1 -- 172.21.15.87:0/4201420370 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2450023020 con 0x55f6d477a870 2024-05-08T18:33:03.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.728+0000 7f2333fff640 1 --2- 172.21.15.87:0/4201420370 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f233803bba0 0x7f233803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.728+0000 7f2333fff640 1 -- 172.21.15.87:0/4201420370 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f2450052390 con 0x55f6d477a870 2024-05-08T18:33:03.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.728+0000 7f2456ae7640 1 --2- 172.21.15.87:0/4201420370 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f233803bba0 0x7f233803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.728+0000 7f245b52b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:03.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.728+0000 7f245b52b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:03.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.729+0000 7f2456ae7640 1 --2- 172.21.15.87:0/4201420370 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f233803bba0 0x7f233803e060 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2448054000 tx=0x7f244804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.729+0000 7f245b52b800 1 Processor -- start 2024-05-08T18:33:03.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.729+0000 7f245b52b800 1 -- start start 2024-05-08T18:33:03.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.729+0000 7f245b52b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d46748e0 0x55f6d4672d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.729+0000 7f245b52b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f6d4765fb0 con 0x55f6d46748e0 2024-05-08T18:33:03.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.729+0000 7f24572e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d46748e0 0x55f6d4672d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.729+0000 7f24572e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d46748e0 0x55f6d4672d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52276/0 (socket says 172.21.15.87:52276) 2024-05-08T18:33:03.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.729+0000 7f24572e8640 1 -- 172.21.15.87:0/4019389829 learned_addr learned my addr 172.21.15.87:0/4019389829 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.730+0000 7f24572e8640 1 -- 172.21.15.87:0/4019389829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6d4673290 con 0x55f6d46748e0 2024-05-08T18:33:03.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.730+0000 7f24572e8640 1 --2- 172.21.15.87:0/4019389829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d46748e0 0x55f6d4672d50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2440000fb0 tx=0x7f244001a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.730+0000 7f22c7fff640 1 -- 172.21.15.87:0/4019389829 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2440047020 con 0x55f6d46748e0 2024-05-08T18:33:03.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.730+0000 7f22c7fff640 1 -- 172.21.15.87:0/4019389829 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f244004e8b0 con 0x55f6d46748e0 2024-05-08T18:33:03.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.730+0000 7f245b52b800 1 -- 172.21.15.87:0/4019389829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6d4673520 con 0x55f6d46748e0 2024-05-08T18:33:03.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.730+0000 7f22c7fff640 1 -- 172.21.15.87:0/4019389829 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f244004eb90 con 0x55f6d46748e0 2024-05-08T18:33:03.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.730+0000 7f245b52b800 1 -- 172.21.15.87:0/4019389829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6d4673a20 con 0x55f6d46748e0 2024-05-08T18:33:03.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.731+0000 7f22c7fff640 1 -- 172.21.15.87:0/4019389829 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f244004e0b0 con 0x55f6d46748e0 2024-05-08T18:33:03.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.731+0000 7f22c7fff640 1 --2- 172.21.15.87:0/4019389829 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f229803bb50 0x7f229803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.731+0000 7f22c7fff640 1 -- 172.21.15.87:0/4019389829 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f2440054e40 con 0x55f6d46748e0 2024-05-08T18:33:03.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.731+0000 7f2456ae7640 1 --2- 172.21.15.87:0/4019389829 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f229803bb50 0x7f229803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.731+0000 7f22c5ffb640 20 reqs_thread_entry: start 2024-05-08T18:33:03.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.731+0000 7f2456ae7640 1 --2- 172.21.15.87:0/4019389829 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f229803bb50 0x7f229803e010 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f244804b010 tx=0x7f2448005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.731+0000 7f245b52b800 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f6d47ac0a0 0x55f6d47ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.731+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47aeb70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.732+0000 7f2457ae9640 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f6d47ac0a0 0x55f6d47ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.732+0000 7f2457ae9640 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f6d47ac0a0 0x55f6d47ae4f0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.732+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2450010d70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.732+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47af450 con 0x55f6d47ac0a0 2024-05-08T18:33:03.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.732+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2450010d70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.732+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b0800 con 0x55f6d47ac0a0 2024-05-08T18:33:03.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.733+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2450010d70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.733+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47bd700 con 0x55f6d47ac0a0 2024-05-08T18:33:03.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.733+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2450010d70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.746 INFO:teuthology.orchestra.run.smithi087.stderr:NOTICE: set zone's realm_id= 2024-05-08T18:33:03.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.733+0000 7f245b52b800 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f6d47b4b00 0x55f6d47b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.733+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b75b0 con 0x55f6d47b4b00 2024-05-08T18:33:03.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.733+0000 7f24572e8640 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f6d47b4b00 0x55f6d47b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.733+0000 7f24572e8640 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f6d47b4b00 0x55f6d47b7a30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.734+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(5 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2440049020 con 0x55f6d47b4b00 2024-05-08T18:33:03.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.734+0000 7f24572e8640 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f244004c020 0x7f244003c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.734+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b75b0 con 0x7f244004c020 2024-05-08T18:33:03.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.734+0000 7f2456ae7640 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f244004c020 0x7f244003c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.734+0000 7f2456ae7640 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f244004c020 0x7f244003c890 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.734+0000 7f2456ae7640 1 -- 172.21.15.87:0/1507740550 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2448066030 con 0x7f244004c020 2024-05-08T18:33:03.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.734+0000 7f2456ae7640 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f244806a040 0x7f244806b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.734+0000 7f2456ae7640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b75b0 con 0x7f244806a040 2024-05-08T18:33:03.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.735+0000 7f2457ae9640 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f244806a040 0x7f244806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.735+0000 7f2457ae9640 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f244806a040 0x7f244806b940 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.735+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2450010d70 con 0x7f244806a040 2024-05-08T18:33:03.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.735+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b75b0 con 0x55f6d47ac0a0 2024-05-08T18:33:03.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.736+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2450010d70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.736+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b75b0 con 0x55f6d47ac0a0 2024-05-08T18:33:03.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.736+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2450010d70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.736+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b75b0 con 0x7f244806a040 2024-05-08T18:33:03.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.736+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(10 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2450010d70 con 0x7f244806a040 2024-05-08T18:33:03.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.736+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b75b0 con 0x7f244806a040 2024-05-08T18:33:03.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.736+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2450010d70 con 0x7f244806a040 2024-05-08T18:33:03.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.736+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b75b0 con 0x7f244004c020 2024-05-08T18:33:03.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.737+0000 7f2456ae7640 1 -- 172.21.15.87:0/1507740550 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2448066030 con 0x7f244004c020 2024-05-08T18:33:03.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.737+0000 7f2456ae7640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b75b0 con 0x55f6d47b4b00 2024-05-08T18:33:03.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.737+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2440049020 con 0x55f6d47b4b00 2024-05-08T18:33:03.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.737+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b75b0 con 0x55f6d47ac0a0 2024-05-08T18:33:03.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.737+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2450010d70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.737+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b75b0 con 0x7f244806a040 2024-05-08T18:33:03.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.737+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2450010d70 con 0x7f244806a040 2024-05-08T18:33:03.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.737+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b75b0 con 0x55f6d47ac0a0 2024-05-08T18:33:03.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.738+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2450010d70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.738+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b75b0 con 0x7f244004c020 2024-05-08T18:33:03.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.738+0000 7f2456ae7640 1 -- 172.21.15.87:0/1507740550 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(17 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2448066030 con 0x7f244004c020 2024-05-08T18:33:03.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.738+0000 7f2456ae7640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x55f6d47b4b00 2024-05-08T18:33:03.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.738+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2440049020 con 0x55f6d47b4b00 2024-05-08T18:33:03.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.738+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x55f6d47b4b00 2024-05-08T18:33:03.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.738+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2440049020 con 0x55f6d47b4b00 2024-05-08T18:33:03.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.738+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x7f244806a040 2024-05-08T18:33:03.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.739+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2450010d70 con 0x7f244806a040 2024-05-08T18:33:03.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.739+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x55f6d47b4b00 2024-05-08T18:33:03.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.739+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2440049020 con 0x55f6d47b4b00 2024-05-08T18:33:03.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.739+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x55f6d47b4b00 2024-05-08T18:33:03.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.739+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2440049020 con 0x55f6d47b4b00 2024-05-08T18:33:03.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.739+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x55f6d47ac0a0 2024-05-08T18:33:03.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.739+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2450010d70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.739+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x55f6d47ac0a0 2024-05-08T18:33:03.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.739+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=132b] v27'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f2450010d70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.740+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x7f244806a040 2024-05-08T18:33:03.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.740+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(25 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2450010d70 con 0x7f244806a040 2024-05-08T18:33:03.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.740+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x55f6d47b4b00 2024-05-08T18:33:03.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.740+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2440049020 con 0x55f6d47b4b00 2024-05-08T18:33:03.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.740+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x7f244004c020 2024-05-08T18:33:03.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.740+0000 7f2456ae7640 1 -- 172.21.15.87:0/1507740550 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2448066030 con 0x7f244004c020 2024-05-08T18:33:03.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.740+0000 7f2456ae7640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x55f6d47ac0a0 2024-05-08T18:33:03.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.741+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2450010d70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.741+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x7f244806a040 2024-05-08T18:33:03.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.741+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2450010d70 con 0x7f244806a040 2024-05-08T18:33:03.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.741+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x55f6d47b4b00 2024-05-08T18:33:03.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.741+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2440049020 con 0x55f6d47b4b00 2024-05-08T18:33:03.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.741+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x7f244004c020 2024-05-08T18:33:03.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.741+0000 7f2456ae7640 1 -- 172.21.15.87:0/1507740550 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2448066030 con 0x7f244004c020 2024-05-08T18:33:03.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.741+0000 7f2456ae7640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x7f244004c020 2024-05-08T18:33:03.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.742+0000 7f2456ae7640 1 -- 172.21.15.87:0/1507740550 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2448066030 con 0x7f244004c020 2024-05-08T18:33:03.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.742+0000 7f2456ae7640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x55f6d47b4b00 2024-05-08T18:33:03.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.742+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2440049020 con 0x55f6d47b4b00 2024-05-08T18:33:03.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.742+0000 7f24572e8640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x7f244004c020 2024-05-08T18:33:03.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.742+0000 7f2456ae7640 1 -- 172.21.15.87:0/1507740550 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2448066030 con 0x7f244004c020 2024-05-08T18:33:03.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.742+0000 7f2456ae7640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x55f6d47ac0a0 2024-05-08T18:33:03.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.742+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(35 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2450010d70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.742+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2448078060 con 0x7f244004c020 2024-05-08T18:33:03.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.743+0000 7f2456ae7640 1 -- 172.21.15.87:0/1507740550 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(36 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2448066030 con 0x7f244004c020 2024-05-08T18:33:03.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.743+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47bb610 con 0x55f6d47ac0a0 2024-05-08T18:33:03.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.743+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2450010d70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.743+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b0ba0 con 0x55f6d47ac0a0 2024-05-08T18:33:03.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.743+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2450010d70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.743+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b6e40 con 0x55f6d47ac0a0 2024-05-08T18:33:03.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.744+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [create,call,writefull 0~1155] v29'4 uv4 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f2450010d70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.744+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b6e40 con 0x55f6d47ac0a0 2024-05-08T18:33:03.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.747+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v29'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f2450010d70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.747+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f6d47b6e40 con 0x55f6d47ac0a0 2024-05-08T18:33:03.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.750+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v29'5 uv2 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f2450010d70 con 0x55f6d47ac0a0 2024-05-08T18:33:03.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 -- 172.21.15.87:0/4201420370 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f233803bba0 msgr2=0x7f233803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 --2- 172.21.15.87:0/4201420370 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f233803bba0 0x7f233803e060 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2448054000 tx=0x7f244804e000 comp rx=0 tx=0).stop 2024-05-08T18:33:03.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 -- 172.21.15.87:0/4201420370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d477a870 msgr2=0x55f6d4781e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 --2- 172.21.15.87:0/4201420370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d477a870 0x55f6d4781e00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f245000a930 tx=0x7f2450003370 comp rx=0 tx=0).stop 2024-05-08T18:33:03.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 -- 172.21.15.87:0/4201420370 shutdown_connections 2024-05-08T18:33:03.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 --2- 172.21.15.87:0/4201420370 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f233803bba0 0x7f233803e060 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 --2- 172.21.15.87:0/4201420370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d477a870 0x55f6d4781e00 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 -- 172.21.15.87:0/4201420370 >> 172.21.15.87:0/4201420370 conn(0x55f6d4678850 msgr2=0x55f6d4774950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 -- 172.21.15.87:0/4201420370 shutdown_connections 2024-05-08T18:33:03.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 -- 172.21.15.87:0/4201420370 wait complete. 2024-05-08T18:33:03.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 -- 172.21.15.87:0/4019389829 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f229803bb50 msgr2=0x7f229803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 --2- 172.21.15.87:0/4019389829 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f229803bb50 0x7f229803e010 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f244804b010 tx=0x7f2448005ac0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 -- 172.21.15.87:0/4019389829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d46748e0 msgr2=0x55f6d4672d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 --2- 172.21.15.87:0/4019389829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d46748e0 0x55f6d4672d50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2440000fb0 tx=0x7f244001a480 comp rx=0 tx=0).stop 2024-05-08T18:33:03.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 -- 172.21.15.87:0/4019389829 shutdown_connections 2024-05-08T18:33:03.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 --2- 172.21.15.87:0/4019389829 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f229803bb50 0x7f229803e010 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 --2- 172.21.15.87:0/4019389829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d46748e0 0x55f6d4672d50 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 -- 172.21.15.87:0/4019389829 >> 172.21.15.87:0/4019389829 conn(0x55f6d4790f30 msgr2=0x55f6d4791950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 -- 172.21.15.87:0/4019389829 shutdown_connections 2024-05-08T18:33:03.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 -- 172.21.15.87:0/4019389829 wait complete. 2024-05-08T18:33:03.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f244806a040 msgr2=0x7f244806b940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f244806a040 0x7f244806b940 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f6d47ac0a0 msgr2=0x55f6d47ae4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f6d47ac0a0 0x55f6d47ae4f0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f244004c020 msgr2=0x7f244003c890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f244004c020 0x7f244003c890 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f6d47b4b00 msgr2=0x55f6d47b7a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.751+0000 7f245b52b800 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f6d47b4b00 0x55f6d47b7a30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.752+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f233c03bba0 msgr2=0x7f233c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.752+0000 7f245b52b800 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f233c03bba0 0x7f233c03e060 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f244000b6e0 tx=0x7f2440033040 comp rx=0 tx=0).stop 2024-05-08T18:33:03.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.752+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4674d40 msgr2=0x55f6d476d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.752+0000 7f2457ae9640 1 -- 172.21.15.87:0/1507740550 reap_dead start 2024-05-08T18:33:03.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.752+0000 7f245b52b800 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4674d40 0x55f6d476d1e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f244000c010 tx=0x7f2440000ed0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.752+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 shutdown_connections 2024-05-08T18:33:03.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.752+0000 7f245b52b800 1 --2- 172.21.15.87:0/1507740550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d4674d40 0x55f6d476d1e0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.752+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 >> 172.21.15.87:0/1507740550 conn(0x55f6d466e710 msgr2=0x55f6d475f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.752+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 shutdown_connections 2024-05-08T18:33:03.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.752+0000 7f245b52b800 1 -- 172.21.15.87:0/1507740550 wait complete. 2024-05-08T18:33:03.759 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"be5b96a9-27d9-41bc-99e2-d41218f7be5a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-05-08T18:33:03.759 DEBUG:tasks.util.rgw: json result: {'id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-05-08T18:33:03.759 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-05-08T18:33:03.759 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-05-08T18:33:03.759 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-05-08T18:33:03.841 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:03.841 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:03.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.843+0000 7f3726c3e800 1 Processor -- start 2024-05-08T18:33:03.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.843+0000 7f3726c3e800 1 -- start start 2024-05-08T18:33:03.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.844+0000 7f3726c3e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560143033d60 0x560143036150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.844+0000 7f3726c3e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56014303a1a0 con 0x560143036690 2024-05-08T18:33:03.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.844+0000 7f3726c3e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x560142ed3e20 con 0x560143033d60 2024-05-08T18:33:03.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.844+0000 7f37218ce640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560143033d60 0x560143036150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.844+0000 7f37218ce640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560143033d60 0x560143036150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52282/0 (socket says 172.21.15.87:52282) 2024-05-08T18:33:03.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.844+0000 7f37218ce640 1 -- 172.21.15.87:0/1670730949 learned_addr learned my addr 172.21.15.87:0/1670730949 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.844+0000 7f37218ce640 1 -- 172.21.15.87:0/1670730949 >> v1:172.21.15.53:6789/0 conn(0x560143036690 legacy=0x560143038a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.844+0000 7f37218ce640 1 -- 172.21.15.87:0/1670730949 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56014303b380 con 0x560143033d60 2024-05-08T18:33:03.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.846+0000 7f37218ce640 1 --2- 172.21.15.87:0/1670730949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 0x560143036150 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f371400a520 tx=0x7f371401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfee2cd2fbfd905 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.846+0000 7f37208cc640 1 -- 172.21.15.87:0/1670730949 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3714057070 con 0x560143033d60 2024-05-08T18:33:03.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.846+0000 7f37208cc640 1 -- 172.21.15.87:0/1670730949 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3714052570 con 0x560143033d60 2024-05-08T18:33:03.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.846+0000 7f37208cc640 1 -- 172.21.15.87:0/1670730949 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f371404ae60 con 0x560143033d60 2024-05-08T18:33:03.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.847+0000 7f3726c3e800 1 -- 172.21.15.87:0/1670730949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 msgr2=0x560143036150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.847+0000 7f3726c3e800 1 --2- 172.21.15.87:0/1670730949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 0x560143036150 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f371400a520 tx=0x7f371401d010 comp rx=0 tx=0).stop 2024-05-08T18:33:03.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.847+0000 7f3726c3e800 1 -- 172.21.15.87:0/1670730949 shutdown_connections 2024-05-08T18:33:03.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.847+0000 7f3726c3e800 1 --2- 172.21.15.87:0/1670730949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 0x560143036150 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.847+0000 7f3726c3e800 1 -- 172.21.15.87:0/1670730949 >> 172.21.15.87:0/1670730949 conn(0x56014302d690 msgr2=0x56014302faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.847+0000 7f3726c3e800 1 -- 172.21.15.87:0/1670730949 shutdown_connections 2024-05-08T18:33:03.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.847+0000 7f3726c3e800 1 -- 172.21.15.87:0/1670730949 wait complete. 2024-05-08T18:33:03.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.861+0000 7f3726c3e800 1 Processor -- start 2024-05-08T18:33:03.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.861+0000 7f3726c3e800 1 -- start start 2024-05-08T18:33:03.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.861+0000 7f3726c3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 0x5601430336a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.861+0000 7f3726c3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560142f7e5a0 con 0x560143033d60 2024-05-08T18:33:03.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.861+0000 7f37218ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 0x5601430336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.861+0000 7f37218ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 0x5601430336a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52296/0 (socket says 172.21.15.87:52296) 2024-05-08T18:33:03.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.861+0000 7f37218ce640 1 -- 172.21.15.87:0/3621256137 learned_addr learned my addr 172.21.15.87:0/3621256137 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.862+0000 7f37218ce640 1 -- 172.21.15.87:0/3621256137 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560143031c60 con 0x560143033d60 2024-05-08T18:33:03.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.862+0000 7f37218ce640 1 --2- 172.21.15.87:0/3621256137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 0x5601430336a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3714055040 tx=0x7f371404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea16c3fc50e25d18 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.862+0000 7f360fe07640 1 -- 172.21.15.87:0/3621256137 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3714057040 con 0x560143033d60 2024-05-08T18:33:03.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.862+0000 7f360fe07640 1 -- 172.21.15.87:0/3621256137 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3714052720 con 0x560143033d60 2024-05-08T18:33:03.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.862+0000 7f360fe07640 1 -- 172.21.15.87:0/3621256137 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3714052a20 con 0x560143033d60 2024-05-08T18:33:03.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.863+0000 7f3726c3e800 1 -- 172.21.15.87:0/3621256137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 msgr2=0x5601430336a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.863+0000 7f3726c3e800 1 --2- 172.21.15.87:0/3621256137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 0x5601430336a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3714055040 tx=0x7f371404c000 comp rx=0 tx=0).stop 2024-05-08T18:33:03.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.863+0000 7f3726c3e800 1 -- 172.21.15.87:0/3621256137 shutdown_connections 2024-05-08T18:33:03.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.863+0000 7f3726c3e800 1 --2- 172.21.15.87:0/3621256137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 0x5601430336a0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.863+0000 7f3726c3e800 1 -- 172.21.15.87:0/3621256137 >> 172.21.15.87:0/3621256137 conn(0x56014302d690 msgr2=0x56014311ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.863+0000 7f3726c3e800 1 -- 172.21.15.87:0/3621256137 shutdown_connections 2024-05-08T18:33:03.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.863+0000 7f3726c3e800 1 -- 172.21.15.87:0/3621256137 wait complete. 2024-05-08T18:33:03.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.863+0000 7f3726c3e800 1 Processor -- start 2024-05-08T18:33:03.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.863+0000 7f3726c3e800 1 -- start start 2024-05-08T18:33:03.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.863+0000 7f3726c3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 0x56014312e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.863+0000 7f3726c3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56014303a610 con 0x560143033d60 2024-05-08T18:33:03.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.863+0000 7f37218ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 0x56014312e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.863+0000 7f37218ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 0x56014312e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52298/0 (socket says 172.21.15.87:52298) 2024-05-08T18:33:03.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.863+0000 7f37218ce640 1 -- 172.21.15.87:0/4041157108 learned_addr learned my addr 172.21.15.87:0/4041157108 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.864+0000 7f37218ce640 1 -- 172.21.15.87:0/4041157108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56014312e820 con 0x560143033d60 2024-05-08T18:33:03.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.864+0000 7f37218ce640 1 --2- 172.21.15.87:0/4041157108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 0x56014312e2e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3714052540 tx=0x7f3714003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.864+0000 7f360e604640 1 -- 172.21.15.87:0/4041157108 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3714073070 con 0x560143033d60 2024-05-08T18:33:03.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.864+0000 7f3726c3e800 1 -- 172.21.15.87:0/4041157108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56014312eab0 con 0x560143033d60 2024-05-08T18:33:03.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.864+0000 7f360e604640 1 -- 172.21.15.87:0/4041157108 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f371405d440 con 0x560143033d60 2024-05-08T18:33:03.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.864+0000 7f360e604640 1 -- 172.21.15.87:0/4041157108 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3714057070 con 0x560143033d60 2024-05-08T18:33:03.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.864+0000 7f3726c3e800 1 -- 172.21.15.87:0/4041157108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560143131760 con 0x560143033d60 2024-05-08T18:33:03.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.865+0000 7f3726c3e800 1 Processor -- start 2024-05-08T18:33:03.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.865+0000 7f3726c3e800 1 -- start start 2024-05-08T18:33:03.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.865+0000 7f3726c3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014313b970 0x56014313bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.865+0000 7f3726c3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560142f24fc0 con 0x56014313b970 2024-05-08T18:33:03.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.865+0000 7f360e604640 1 -- 172.21.15.87:0/4041157108 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f371405d5f0 con 0x560143033d60 2024-05-08T18:33:03.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.865+0000 7f37220cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014313b970 0x56014313bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.865+0000 7f37220cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014313b970 0x56014313bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52304/0 (socket says 172.21.15.87:52304) 2024-05-08T18:33:03.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.865+0000 7f37220cf640 1 -- 172.21.15.87:0/248191713 learned_addr learned my addr 172.21.15.87:0/248191713 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.866+0000 7f360e604640 1 --2- 172.21.15.87:0/4041157108 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f360803bb50 0x7f360803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.866+0000 7f360e604640 1 -- 172.21.15.87:0/4041157108 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3714093f40 con 0x560143033d60 2024-05-08T18:33:03.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.866+0000 7f37218ce640 1 --2- 172.21.15.87:0/4041157108 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f360803bb50 0x7f360803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.866+0000 7f37220cf640 1 -- 172.21.15.87:0/248191713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56014313c2d0 con 0x56014313b970 2024-05-08T18:33:03.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.866+0000 7f37220cf640 1 --2- 172.21.15.87:0/248191713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014313b970 0x56014313bd90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f371c00a430 tx=0x7f371c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9fb400ab4957e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.866+0000 7f37218ce640 1 --2- 172.21.15.87:0/4041157108 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f360803bb50 0x7f360803e010 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3714092350 tx=0x7f3714079040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.866+0000 7f3607fff640 1 -- 172.21.15.87:0/248191713 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f371c015070 con 0x56014313b970 2024-05-08T18:33:03.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.866+0000 7f3607fff640 1 -- 172.21.15.87:0/248191713 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f371c001670 con 0x56014313b970 2024-05-08T18:33:03.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.866+0000 7f3607fff640 1 -- 172.21.15.87:0/248191713 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f371c001990 con 0x56014313b970 2024-05-08T18:33:03.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.867+0000 7f3726c3e800 1 -- 172.21.15.87:0/248191713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014313b970 msgr2=0x56014313bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.867+0000 7f3726c3e800 1 --2- 172.21.15.87:0/248191713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014313b970 0x56014313bd90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f371c00a430 tx=0x7f371c00a8f0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.867+0000 7f3726c3e800 1 -- 172.21.15.87:0/248191713 shutdown_connections 2024-05-08T18:33:03.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.867+0000 7f3726c3e800 1 --2- 172.21.15.87:0/248191713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014313b970 0x56014313bd90 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.867+0000 7f3726c3e800 1 -- 172.21.15.87:0/248191713 >> 172.21.15.87:0/248191713 conn(0x560143036690 msgr2=0x560143138410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.867+0000 7f3726c3e800 1 -- 172.21.15.87:0/248191713 shutdown_connections 2024-05-08T18:33:03.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.867+0000 7f3726c3e800 1 -- 172.21.15.87:0/248191713 wait complete. 2024-05-08T18:33:03.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.867+0000 7f3726c3e800 1 Processor -- start 2024-05-08T18:33:03.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.867+0000 7f3726c3e800 1 -- start start 2024-05-08T18:33:03.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.867+0000 7f3726c3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014313b970 0x560143142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.867+0000 7f3726c3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56014313cc60 con 0x56014313b970 2024-05-08T18:33:03.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.867+0000 7f37220cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014313b970 0x560143142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.867+0000 7f37220cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014313b970 0x560143142e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52312/0 (socket says 172.21.15.87:52312) 2024-05-08T18:33:03.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.867+0000 7f37220cf640 1 -- 172.21.15.87:0/3246773871 learned_addr learned my addr 172.21.15.87:0/3246773871 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.868+0000 7f37220cf640 1 -- 172.21.15.87:0/3246773871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560143143390 con 0x56014313b970 2024-05-08T18:33:03.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.868+0000 7f37220cf640 1 --2- 172.21.15.87:0/3246773871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014313b970 0x560143142e50 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f371c00a930 tx=0x7f371c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.868+0000 7f36067fc640 1 -- 172.21.15.87:0/3246773871 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f371c020020 con 0x56014313b970 2024-05-08T18:33:03.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.868+0000 7f36067fc640 1 -- 172.21.15.87:0/3246773871 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f371c0108b0 con 0x56014313b970 2024-05-08T18:33:03.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.868+0000 7f3726c3e800 1 -- 172.21.15.87:0/3246773871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560143143620 con 0x56014313b970 2024-05-08T18:33:03.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.868+0000 7f36067fc640 1 -- 172.21.15.87:0/3246773871 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f371c015040 con 0x56014313b970 2024-05-08T18:33:03.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.868+0000 7f3726c3e800 1 -- 172.21.15.87:0/3246773871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601431462d0 con 0x56014313b970 2024-05-08T18:33:03.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.869+0000 7f36067fc640 1 -- 172.21.15.87:0/3246773871 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f371c023020 con 0x56014313b970 2024-05-08T18:33:03.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.869+0000 7f36067fc640 1 --2- 172.21.15.87:0/3246773871 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f35fc03bb50 0x7f35fc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.869+0000 7f36067fc640 1 -- 172.21.15.87:0/3246773871 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f371c052400 con 0x56014313b970 2024-05-08T18:33:03.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.869+0000 7f37210cd640 1 --2- 172.21.15.87:0/3246773871 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f35fc03bb50 0x7f35fc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.870+0000 7f3726c3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:03.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.870+0000 7f3726c3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:03.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.870+0000 7f37210cd640 1 --2- 172.21.15.87:0/3246773871 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f35fc03bb50 0x7f35fc03e010 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x560143137890 tx=0x7f3718001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.870+0000 7f3726c3e800 1 Processor -- start 2024-05-08T18:33:03.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.870+0000 7f3726c3e800 1 -- start start 2024-05-08T18:33:03.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.870+0000 7f3726c3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014315d550 0x56014315d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.870+0000 7f3726c3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560143031f20 con 0x56014315d550 2024-05-08T18:33:03.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.870+0000 7f37218ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014315d550 0x56014315d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.870+0000 7f37218ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014315d550 0x56014315d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52320/0 (socket says 172.21.15.87:52320) 2024-05-08T18:33:03.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.870+0000 7f37218ce640 1 -- 172.21.15.87:0/2819422140 learned_addr learned my addr 172.21.15.87:0/2819422140 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.871+0000 7f37218ce640 1 -- 172.21.15.87:0/2819422140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56014315deb0 con 0x56014315d550 2024-05-08T18:33:03.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.871+0000 7f37218ce640 1 --2- 172.21.15.87:0/2819422140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014315d550 0x56014315d970 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f37140922c0 tx=0x7f371405cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.871+0000 7f35e67e4640 1 -- 172.21.15.87:0/2819422140 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f371405da10 con 0x56014315d550 2024-05-08T18:33:03.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.871+0000 7f35e67e4640 1 -- 172.21.15.87:0/2819422140 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f371408d070 con 0x56014315d550 2024-05-08T18:33:03.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.871+0000 7f3726c3e800 1 -- 172.21.15.87:0/2819422140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56014315e920 con 0x56014315d550 2024-05-08T18:33:03.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.871+0000 7f35e67e4640 1 -- 172.21.15.87:0/2819422140 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f371406e5a0 con 0x56014315d550 2024-05-08T18:33:03.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.871+0000 7f3726c3e800 1 -- 172.21.15.87:0/2819422140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56014315ee20 con 0x56014315d550 2024-05-08T18:33:03.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.872+0000 7f35e67e4640 1 -- 172.21.15.87:0/2819422140 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f371405dc10 con 0x56014315d550 2024-05-08T18:33:03.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.872+0000 7f35e67e4640 1 --2- 172.21.15.87:0/2819422140 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f356403bca0 0x7f356403e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.872+0000 7f35e67e4640 1 -- 172.21.15.87:0/2819422140 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3714098d40 con 0x56014315d550 2024-05-08T18:33:03.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.872+0000 7f37210cd640 1 --2- 172.21.15.87:0/2819422140 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f356403bca0 0x7f356403e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.872+0000 7f3557fff640 20 reqs_thread_entry: start 2024-05-08T18:33:03.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.872+0000 7f3726c3e800 1 --2- 172.21.15.87:0/4041157108 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56014316b010 0x56014316d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.872+0000 7f37210cd640 1 --2- 172.21.15.87:0/2819422140 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f356403bca0 0x7f356403e160 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3718003f10 tx=0x7f3718006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.872+0000 7f3726c3e800 1 -- 172.21.15.87:0/4041157108 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56014316da60 con 0x56014316b010 2024-05-08T18:33:03.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.873+0000 7f37220cf640 1 --2- 172.21.15.87:0/4041157108 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56014316b010 0x56014316d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.873+0000 7f37220cf640 1 --2- 172.21.15.87:0/4041157108 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56014316b010 0x56014316d400 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.873+0000 7f37220cf640 1 -- 172.21.15.87:0/4041157108 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f371c00e070 con 0x56014316b010 2024-05-08T18:33:03.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.873+0000 7f3726c3e800 1 -- 172.21.15.87:0/4041157108 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56014316e320 con 0x56014316b010 2024-05-08T18:33:03.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.873+0000 7f37220cf640 1 -- 172.21.15.87:0/4041157108 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f371c00e070 con 0x56014316b010 2024-05-08T18:33:03.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.873+0000 7f3726c3e800 1 -- 172.21.15.87:0/4041157108 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56014316f6d0 con 0x56014316b010 2024-05-08T18:33:03.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.874+0000 7f37220cf640 1 -- 172.21.15.87:0/4041157108 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~1155 out=1155b] v0'0 uv4 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f371c00e070 con 0x56014316b010 2024-05-08T18:33:03.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.874+0000 7f3726c3e800 1 -- 172.21.15.87:0/3246773871 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f35fc03bb50 msgr2=0x7f35fc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.874+0000 7f3726c3e800 1 --2- 172.21.15.87:0/3246773871 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f35fc03bb50 0x7f35fc03e010 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x560143137890 tx=0x7f3718001310 comp rx=0 tx=0).stop 2024-05-08T18:33:03.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.874+0000 7f3726c3e800 1 -- 172.21.15.87:0/3246773871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014313b970 msgr2=0x560143142e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.874+0000 7f3726c3e800 1 --2- 172.21.15.87:0/3246773871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014313b970 0x560143142e50 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f371c00a930 tx=0x7f371c003370 comp rx=0 tx=0).stop 2024-05-08T18:33:03.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.874+0000 7f3726c3e800 1 -- 172.21.15.87:0/3246773871 shutdown_connections 2024-05-08T18:33:03.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.874+0000 7f3726c3e800 1 --2- 172.21.15.87:0/3246773871 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f35fc03bb50 0x7f35fc03e010 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.874+0000 7f3726c3e800 1 --2- 172.21.15.87:0/3246773871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014313b970 0x560143142e50 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.874+0000 7f3726c3e800 1 -- 172.21.15.87:0/3246773871 >> 172.21.15.87:0/3246773871 conn(0x560143036690 msgr2=0x560143135a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.874+0000 7f3726c3e800 1 -- 172.21.15.87:0/3246773871 shutdown_connections 2024-05-08T18:33:03.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 -- 172.21.15.87:0/3246773871 wait complete. 2024-05-08T18:33:03.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 -- 172.21.15.87:0/2819422140 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f356403bca0 msgr2=0x7f356403e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 --2- 172.21.15.87:0/2819422140 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f356403bca0 0x7f356403e160 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3718003f10 tx=0x7f3718006000 comp rx=0 tx=0).stop 2024-05-08T18:33:03.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 -- 172.21.15.87:0/2819422140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014315d550 msgr2=0x56014315d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 --2- 172.21.15.87:0/2819422140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014315d550 0x56014315d970 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f37140922c0 tx=0x7f371405cf70 comp rx=0 tx=0).stop 2024-05-08T18:33:03.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 -- 172.21.15.87:0/2819422140 shutdown_connections 2024-05-08T18:33:03.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 --2- 172.21.15.87:0/2819422140 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f356403bca0 0x7f356403e160 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 --2- 172.21.15.87:0/2819422140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014315d550 0x56014315d970 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 -- 172.21.15.87:0/2819422140 >> 172.21.15.87:0/2819422140 conn(0x560143151fe0 msgr2=0x560143152a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 -- 172.21.15.87:0/2819422140 shutdown_connections 2024-05-08T18:33:03.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 -- 172.21.15.87:0/2819422140 wait complete. 2024-05-08T18:33:03.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 -- 172.21.15.87:0/4041157108 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56014316b010 msgr2=0x56014316d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 --2- 172.21.15.87:0/4041157108 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56014316b010 0x56014316d400 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 -- 172.21.15.87:0/4041157108 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f360803bb50 msgr2=0x7f360803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 --2- 172.21.15.87:0/4041157108 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f360803bb50 0x7f360803e010 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3714092350 tx=0x7f3714079040 comp rx=0 tx=0).stop 2024-05-08T18:33:03.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 -- 172.21.15.87:0/4041157108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 msgr2=0x56014312e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 --2- 172.21.15.87:0/4041157108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 0x56014312e2e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3714052540 tx=0x7f3714003020 comp rx=0 tx=0).stop 2024-05-08T18:33:03.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 -- 172.21.15.87:0/4041157108 shutdown_connections 2024-05-08T18:33:03.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 --2- 172.21.15.87:0/4041157108 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x56014316b010 0x56014316d400 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 --2- 172.21.15.87:0/4041157108 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f360803bb50 0x7f360803e010 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 --2- 172.21.15.87:0/4041157108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560143033d60 0x56014312e2e0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 -- 172.21.15.87:0/4041157108 >> 172.21.15.87:0/4041157108 conn(0x56014302d690 msgr2=0x560143032480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 -- 172.21.15.87:0/4041157108 shutdown_connections 2024-05-08T18:33:03.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.875+0000 7f3726c3e800 1 -- 172.21.15.87:0/4041157108 wait complete. 2024-05-08T18:33:03.897 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"be5b96a9-27d9-41bc-99e2-d41218f7be5a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-05-08T18:33:03.897 DEBUG:tasks.util.rgw: json result: {'id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-05-08T18:33:03.897 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-08T18:33:03.897 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-08T18:33:03.897 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-05-08T18:33:03.983 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:03.983 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:03.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.986+0000 7f2387f2b800 1 Processor -- start 2024-05-08T18:33:03.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.986+0000 7f2387f2b800 1 -- start start 2024-05-08T18:33:03.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.986+0000 7f2387f2b800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5637e6c1c790 0x5637e6c1eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:03.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.986+0000 7f2387f2b800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5637e6c1f150 con 0x5637e6c183a0 2024-05-08T18:33:03.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.986+0000 7f2387f2b800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5637e6ab8e20 con 0x5637e6c1c790 2024-05-08T18:33:03.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.986+0000 7f237b3a3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5637e6c1c790 0x5637e6c1eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:03.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.986+0000 7f237b3a3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5637e6c1c790 0x5637e6c1eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52322/0 (socket says 172.21.15.87:52322) 2024-05-08T18:33:03.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.986+0000 7f237b3a3640 1 -- 172.21.15.87:0/1458330483 learned_addr learned my addr 172.21.15.87:0/1458330483 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:03.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.987+0000 7f237b3a3640 1 -- 172.21.15.87:0/1458330483 >> v1:172.21.15.53:6789/0 conn(0x5637e6c183a0 legacy=0x5637e6c187c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.987+0000 7f237b3a3640 1 -- 172.21.15.87:0/1458330483 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637e6c20380 con 0x5637e6c1c790 2024-05-08T18:33:03.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.988+0000 7f237b3a3640 1 --2- 172.21.15.87:0/1458330483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c1c790 0x5637e6c1eb80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f236c00a520 tx=0x7f236c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7f2015762e19cc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:03.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.989+0000 7f23833a3640 1 -- 172.21.15.87:0/1458330483 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f236c057070 con 0x5637e6c1c790 2024-05-08T18:33:03.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.989+0000 7f23833a3640 1 -- 172.21.15.87:0/1458330483 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f236c052570 con 0x5637e6c1c790 2024-05-08T18:33:03.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.989+0000 7f23833a3640 1 -- 172.21.15.87:0/1458330483 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f236c04ae60 con 0x5637e6c1c790 2024-05-08T18:33:03.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.989+0000 7f2387f2b800 1 -- 172.21.15.87:0/1458330483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c1c790 msgr2=0x5637e6c1eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:03.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.989+0000 7f2387f2b800 1 --2- 172.21.15.87:0/1458330483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c1c790 0x5637e6c1eb80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f236c00a520 tx=0x7f236c01d010 comp rx=0 tx=0).stop 2024-05-08T18:33:03.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.989+0000 7f2387f2b800 1 -- 172.21.15.87:0/1458330483 shutdown_connections 2024-05-08T18:33:03.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.989+0000 7f2387f2b800 1 --2- 172.21.15.87:0/1458330483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c1c790 0x5637e6c1eb80 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:03.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.989+0000 7f2387f2b800 1 -- 172.21.15.87:0/1458330483 >> 172.21.15.87:0/1458330483 conn(0x5637e6c13920 msgr2=0x5637e6c15d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:03.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.989+0000 7f2387f2b800 1 -- 172.21.15.87:0/1458330483 shutdown_connections 2024-05-08T18:33:03.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:03.989+0000 7f2387f2b800 1 -- 172.21.15.87:0/1458330483 wait complete. 2024-05-08T18:33:04.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.003+0000 7f2387f2b800 1 Processor -- start 2024-05-08T18:33:04.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.003+0000 7f2387f2b800 1 -- start start 2024-05-08T18:33:04.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.003+0000 7f2387f2b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c183a0 0x5637e6d09700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.003+0000 7f2387f2b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5637e6b635d0 con 0x5637e6c183a0 2024-05-08T18:33:04.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.003+0000 7f2383ba4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c183a0 0x5637e6d09700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.003+0000 7f2383ba4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c183a0 0x5637e6d09700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52330/0 (socket says 172.21.15.87:52330) 2024-05-08T18:33:04.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.003+0000 7f2383ba4640 1 -- 172.21.15.87:0/2067689143 learned_addr learned my addr 172.21.15.87:0/2067689143 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.004+0000 7f2383ba4640 1 -- 172.21.15.87:0/2067689143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637e6d09cd0 con 0x5637e6c183a0 2024-05-08T18:33:04.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.004+0000 7f2383ba4640 1 --2- 172.21.15.87:0/2067689143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c183a0 0x5637e6d09700 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f2374001d50 tx=0x7f237400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6a1ae1d6703bd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.004+0000 7f2271e0b640 1 -- 172.21.15.87:0/2067689143 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237400f400 con 0x5637e6c183a0 2024-05-08T18:33:04.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.004+0000 7f2271e0b640 1 -- 172.21.15.87:0/2067689143 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237400f5a0 con 0x5637e6c183a0 2024-05-08T18:33:04.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.004+0000 7f2271e0b640 1 -- 172.21.15.87:0/2067689143 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237400f7d0 con 0x5637e6c183a0 2024-05-08T18:33:04.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.005+0000 7f2387f2b800 1 -- 172.21.15.87:0/2067689143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c183a0 msgr2=0x5637e6d09700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.005+0000 7f2387f2b800 1 --2- 172.21.15.87:0/2067689143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c183a0 0x5637e6d09700 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f2374001d50 tx=0x7f237400b5b0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.005+0000 7f2387f2b800 1 -- 172.21.15.87:0/2067689143 shutdown_connections 2024-05-08T18:33:04.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.005+0000 7f2387f2b800 1 --2- 172.21.15.87:0/2067689143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c183a0 0x5637e6d09700 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.005+0000 7f2387f2b800 1 -- 172.21.15.87:0/2067689143 >> 172.21.15.87:0/2067689143 conn(0x5637e6c13920 msgr2=0x5637e6d05020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.005+0000 7f2387f2b800 1 -- 172.21.15.87:0/2067689143 shutdown_connections 2024-05-08T18:33:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.005+0000 7f2387f2b800 1 -- 172.21.15.87:0/2067689143 wait complete. 2024-05-08T18:33:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.005+0000 7f2387f2b800 1 Processor -- start 2024-05-08T18:33:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.005+0000 7f2387f2b800 1 -- start start 2024-05-08T18:33:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.005+0000 7f2387f2b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c183a0 0x5637e6d112e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.005+0000 7f2387f2b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5637e6c1f620 con 0x5637e6c183a0 2024-05-08T18:33:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.005+0000 7f2383ba4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c183a0 0x5637e6d112e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.005+0000 7f2383ba4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c183a0 0x5637e6d112e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52346/0 (socket says 172.21.15.87:52346) 2024-05-08T18:33:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.005+0000 7f2383ba4640 1 -- 172.21.15.87:0/2328955445 learned_addr learned my addr 172.21.15.87:0/2328955445 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.006+0000 7f2383ba4640 1 -- 172.21.15.87:0/2328955445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637e6d11820 con 0x5637e6c183a0 2024-05-08T18:33:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.006+0000 7f2383ba4640 1 --2- 172.21.15.87:0/2328955445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c183a0 0x5637e6d112e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f237400b5f0 tx=0x7f2374000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.006+0000 7f226bfff640 1 -- 172.21.15.87:0/2328955445 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237401a7c0 con 0x5637e6c183a0 2024-05-08T18:33:04.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.006+0000 7f226bfff640 1 -- 172.21.15.87:0/2328955445 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237401a960 con 0x5637e6c183a0 2024-05-08T18:33:04.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.006+0000 7f2387f2b800 1 -- 172.21.15.87:0/2328955445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637e6d11ab0 con 0x5637e6c183a0 2024-05-08T18:33:04.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.006+0000 7f226bfff640 1 -- 172.21.15.87:0/2328955445 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237401ac40 con 0x5637e6c183a0 2024-05-08T18:33:04.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.006+0000 7f2387f2b800 1 -- 172.21.15.87:0/2328955445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637e6d14710 con 0x5637e6c183a0 2024-05-08T18:33:04.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.007+0000 7f2387f2b800 1 Processor -- start 2024-05-08T18:33:04.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.007+0000 7f2387f2b800 1 -- start start 2024-05-08T18:33:04.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.007+0000 7f2387f2b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d1e980 0x5637e6d1eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.007+0000 7f2387f2b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5637e6b09fc0 con 0x5637e6d1e980 2024-05-08T18:33:04.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.007+0000 7f226bfff640 1 -- 172.21.15.87:0/2328955445 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2374017070 con 0x5637e6c183a0 2024-05-08T18:33:04.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.007+0000 7f226bfff640 1 --2- 172.21.15.87:0/2328955445 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f226c03bba0 0x7f226c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.007+0000 7f23843a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d1e980 0x5637e6d1eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.007+0000 7f23843a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d1e980 0x5637e6d1eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52350/0 (socket says 172.21.15.87:52350) 2024-05-08T18:33:04.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.007+0000 7f23843a5640 1 -- 172.21.15.87:0/279787111 learned_addr learned my addr 172.21.15.87:0/279787111 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.007+0000 7f226bfff640 1 -- 172.21.15.87:0/2328955445 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f2374015020 con 0x5637e6c183a0 2024-05-08T18:33:04.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.007+0000 7f2383ba4640 1 --2- 172.21.15.87:0/2328955445 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f226c03bba0 0x7f226c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.008+0000 7f23843a5640 1 -- 172.21.15.87:0/279787111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637e6d1f2e0 con 0x5637e6d1e980 2024-05-08T18:33:04.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.008+0000 7f2383ba4640 1 --2- 172.21.15.87:0/2328955445 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f226c03bba0 0x7f226c03e060 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f237400f9a0 tx=0x7f237401bf50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.008+0000 7f23843a5640 1 --2- 172.21.15.87:0/279787111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d1e980 0x5637e6d1eda0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f237c00a430 tx=0x7f237c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b270a70d3a3425b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.008+0000 7f2269ffb640 1 -- 172.21.15.87:0/279787111 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237c015070 con 0x5637e6d1e980 2024-05-08T18:33:04.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.008+0000 7f2269ffb640 1 -- 172.21.15.87:0/279787111 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237c001670 con 0x5637e6d1e980 2024-05-08T18:33:04.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.008+0000 7f2269ffb640 1 -- 172.21.15.87:0/279787111 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237c001990 con 0x5637e6d1e980 2024-05-08T18:33:04.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.008+0000 7f2387f2b800 1 -- 172.21.15.87:0/279787111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d1e980 msgr2=0x5637e6d1eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.008+0000 7f2387f2b800 1 --2- 172.21.15.87:0/279787111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d1e980 0x5637e6d1eda0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f237c00a430 tx=0x7f237c00a8f0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.008+0000 7f2387f2b800 1 -- 172.21.15.87:0/279787111 shutdown_connections 2024-05-08T18:33:04.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.008+0000 7f2387f2b800 1 --2- 172.21.15.87:0/279787111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d1e980 0x5637e6d1eda0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.008+0000 7f2387f2b800 1 -- 172.21.15.87:0/279787111 >> 172.21.15.87:0/279787111 conn(0x5637e6c1c790 msgr2=0x5637e6d1b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.009+0000 7f2387f2b800 1 -- 172.21.15.87:0/279787111 shutdown_connections 2024-05-08T18:33:04.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.009+0000 7f2387f2b800 1 -- 172.21.15.87:0/279787111 wait complete. 2024-05-08T18:33:04.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.009+0000 7f2387f2b800 1 Processor -- start 2024-05-08T18:33:04.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.009+0000 7f2387f2b800 1 -- start start 2024-05-08T18:33:04.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.009+0000 7f2387f2b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d1e980 0x5637e6d25df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.009+0000 7f2387f2b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5637e6d0a050 con 0x5637e6d1e980 2024-05-08T18:33:04.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.009+0000 7f23843a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d1e980 0x5637e6d25df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.009+0000 7f23843a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d1e980 0x5637e6d25df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52354/0 (socket says 172.21.15.87:52354) 2024-05-08T18:33:04.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.009+0000 7f23843a5640 1 -- 172.21.15.87:0/3720001358 learned_addr learned my addr 172.21.15.87:0/3720001358 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.010+0000 7f23843a5640 1 -- 172.21.15.87:0/3720001358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637e6d26330 con 0x5637e6d1e980 2024-05-08T18:33:04.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.010+0000 7f23843a5640 1 --2- 172.21.15.87:0/3720001358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d1e980 0x5637e6d25df0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f237c00a930 tx=0x7f237c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.010+0000 7f2263fff640 1 -- 172.21.15.87:0/3720001358 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237c020020 con 0x5637e6d1e980 2024-05-08T18:33:04.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.010+0000 7f2263fff640 1 -- 172.21.15.87:0/3720001358 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237c0108b0 con 0x5637e6d1e980 2024-05-08T18:33:04.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.010+0000 7f2387f2b800 1 -- 172.21.15.87:0/3720001358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637e6d265c0 con 0x5637e6d1e980 2024-05-08T18:33:04.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.010+0000 7f2263fff640 1 -- 172.21.15.87:0/3720001358 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237c015040 con 0x5637e6d1e980 2024-05-08T18:33:04.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.010+0000 7f2387f2b800 1 -- 172.21.15.87:0/3720001358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637e6d29270 con 0x5637e6d1e980 2024-05-08T18:33:04.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.011+0000 7f2263fff640 1 -- 172.21.15.87:0/3720001358 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f237c023020 con 0x5637e6d1e980 2024-05-08T18:33:04.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.011+0000 7f2263fff640 1 --2- 172.21.15.87:0/3720001358 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f225c03bba0 0x7f225c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.011+0000 7f2387f2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:04.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.011+0000 7f2387f2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:04.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.011+0000 7f2263fff640 1 -- 172.21.15.87:0/3720001358 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f237c052390 con 0x5637e6d1e980 2024-05-08T18:33:04.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.011+0000 7f237b3a3640 1 --2- 172.21.15.87:0/3720001358 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f225c03bba0 0x7f225c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.012+0000 7f2387f2b800 1 Processor -- start 2024-05-08T18:33:04.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.012+0000 7f2387f2b800 1 -- start start 2024-05-08T18:33:04.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.012+0000 7f237b3a3640 1 --2- 172.21.15.87:0/3720001358 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f225c03bba0 0x7f225c03e060 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f236c054000 tx=0x7f236c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.012+0000 7f2387f2b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d40480 0x5637e6d408a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.012+0000 7f2387f2b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5637e6d1fc70 con 0x5637e6d40480 2024-05-08T18:33:04.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.012+0000 7f2383ba4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d40480 0x5637e6d408a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.012+0000 7f2383ba4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d40480 0x5637e6d408a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52362/0 (socket says 172.21.15.87:52362) 2024-05-08T18:33:04.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.012+0000 7f2383ba4640 1 -- 172.21.15.87:0/833897735 learned_addr learned my addr 172.21.15.87:0/833897735 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.012+0000 7f2383ba4640 1 -- 172.21.15.87:0/833897735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637e6d40de0 con 0x5637e6d40480 2024-05-08T18:33:04.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.013+0000 7f2383ba4640 1 --2- 172.21.15.87:0/833897735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d40480 0x5637e6d408a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2374001310 tx=0x7f23740512d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.013+0000 7f2248fe1640 1 -- 172.21.15.87:0/833897735 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2374040070 con 0x5637e6d40480 2024-05-08T18:33:04.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.013+0000 7f2248fe1640 1 -- 172.21.15.87:0/833897735 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2374051d60 con 0x5637e6d40480 2024-05-08T18:33:04.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.013+0000 7f2387f2b800 1 -- 172.21.15.87:0/833897735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637e6d41850 con 0x5637e6d40480 2024-05-08T18:33:04.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.013+0000 7f2248fe1640 1 -- 172.21.15.87:0/833897735 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237402c040 con 0x5637e6d40480 2024-05-08T18:33:04.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.013+0000 7f2387f2b800 1 -- 172.21.15.87:0/833897735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637e6d41850 con 0x5637e6d40480 2024-05-08T18:33:04.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.014+0000 7f2248fe1640 1 -- 172.21.15.87:0/833897735 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2374043070 con 0x5637e6d40480 2024-05-08T18:33:04.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.014+0000 7f2248fe1640 1 --2- 172.21.15.87:0/833897735 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f21bc03bba0 0x7f21bc03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.014+0000 7f2248fe1640 1 -- 172.21.15.87:0/833897735 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f2374046d70 con 0x5637e6d40480 2024-05-08T18:33:04.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.014+0000 7f237b3a3640 1 --2- 172.21.15.87:0/833897735 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f21bc03bba0 0x7f21bc03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.014+0000 7f22427fc640 20 reqs_thread_entry: start 2024-05-08T18:33:04.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.014+0000 7f237b3a3640 1 --2- 172.21.15.87:0/833897735 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f21bc03bba0 0x7f21bc03e060 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f236c04b010 tx=0x7f236c005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.014+0000 7f2387f2b800 1 --2- 172.21.15.87:0/2328955445 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5637e6d4dcf0 0x5637e6d50120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.014+0000 7f2387f2b800 1 -- 172.21.15.87:0/2328955445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637e6d507f0 con 0x5637e6d4dcf0 2024-05-08T18:33:04.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.014+0000 7f23843a5640 1 --2- 172.21.15.87:0/2328955445 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5637e6d4dcf0 0x5637e6d50120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.015+0000 7f23843a5640 1 --2- 172.21.15.87:0/2328955445 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5637e6d4dcf0 0x5637e6d50120 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.015+0000 7f23843a5640 1 -- 172.21.15.87:0/2328955445 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f237c010d70 con 0x5637e6d4dcf0 2024-05-08T18:33:04.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.015+0000 7f2387f2b800 1 -- 172.21.15.87:0/2328955445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637e6d520b0 con 0x5637e6d4dcf0 2024-05-08T18:33:04.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.015+0000 7f23843a5640 1 -- 172.21.15.87:0/2328955445 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~1155 out=1155b] v0'0 uv4 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f237c010d70 con 0x5637e6d4dcf0 2024-05-08T18:33:04.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.015+0000 7f2387f2b800 1 -- 172.21.15.87:0/2328955445 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637e6d519e0 con 0x5637e6d4dcf0 2024-05-08T18:33:04.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.016+0000 7f23843a5640 1 -- 172.21.15.87:0/2328955445 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [stat,call,call,writefull 0~993] v29'6 uv6 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f237c010d70 con 0x5637e6d4dcf0 2024-05-08T18:33:04.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.017+0000 7f2387f2b800 1 -- 172.21.15.87:0/3720001358 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f225c03bba0 msgr2=0x7f225c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.017+0000 7f2387f2b800 1 --2- 172.21.15.87:0/3720001358 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f225c03bba0 0x7f225c03e060 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f236c054000 tx=0x7f236c04e000 comp rx=0 tx=0).stop 2024-05-08T18:33:04.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.017+0000 7f2387f2b800 1 -- 172.21.15.87:0/3720001358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d1e980 msgr2=0x5637e6d25df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.017+0000 7f2387f2b800 1 --2- 172.21.15.87:0/3720001358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d1e980 0x5637e6d25df0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f237c00a930 tx=0x7f237c003370 comp rx=0 tx=0).stop 2024-05-08T18:33:04.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.017+0000 7f2387f2b800 1 -- 172.21.15.87:0/3720001358 shutdown_connections 2024-05-08T18:33:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.017+0000 7f2387f2b800 1 --2- 172.21.15.87:0/3720001358 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f225c03bba0 0x7f225c03e060 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.017+0000 7f2387f2b800 1 --2- 172.21.15.87:0/3720001358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d1e980 0x5637e6d25df0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.017+0000 7f2387f2b800 1 -- 172.21.15.87:0/3720001358 >> 172.21.15.87:0/3720001358 conn(0x5637e6c1c790 msgr2=0x5637e6d18a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.017+0000 7f2387f2b800 1 -- 172.21.15.87:0/3720001358 shutdown_connections 2024-05-08T18:33:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.017+0000 7f2387f2b800 1 -- 172.21.15.87:0/3720001358 wait complete. 2024-05-08T18:33:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 -- 172.21.15.87:0/833897735 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f21bc03bba0 msgr2=0x7f21bc03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 --2- 172.21.15.87:0/833897735 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f21bc03bba0 0x7f21bc03e060 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f236c04b010 tx=0x7f236c005ac0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 -- 172.21.15.87:0/833897735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d40480 msgr2=0x5637e6d408a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 --2- 172.21.15.87:0/833897735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d40480 0x5637e6d408a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2374001310 tx=0x7f23740512d0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 -- 172.21.15.87:0/833897735 shutdown_connections 2024-05-08T18:33:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 --2- 172.21.15.87:0/833897735 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f21bc03bba0 0x7f21bc03e060 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 --2- 172.21.15.87:0/833897735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6d40480 0x5637e6d408a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 -- 172.21.15.87:0/833897735 >> 172.21.15.87:0/833897735 conn(0x5637e6d34f50 msgr2=0x5637e6d35970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 -- 172.21.15.87:0/833897735 shutdown_connections 2024-05-08T18:33:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 -- 172.21.15.87:0/833897735 wait complete. 2024-05-08T18:33:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 -- 172.21.15.87:0/2328955445 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5637e6d4dcf0 msgr2=0x5637e6d50120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 --2- 172.21.15.87:0/2328955445 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5637e6d4dcf0 0x5637e6d50120 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 -- 172.21.15.87:0/2328955445 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f226c03bba0 msgr2=0x7f226c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 --2- 172.21.15.87:0/2328955445 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f226c03bba0 0x7f226c03e060 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f237400f9a0 tx=0x7f237401bf50 comp rx=0 tx=0).stop 2024-05-08T18:33:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 -- 172.21.15.87:0/2328955445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c183a0 msgr2=0x5637e6d112e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 --2- 172.21.15.87:0/2328955445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c183a0 0x5637e6d112e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f237400b5f0 tx=0x7f2374000ed0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 -- 172.21.15.87:0/2328955445 shutdown_connections 2024-05-08T18:33:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 --2- 172.21.15.87:0/2328955445 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5637e6d4dcf0 0x5637e6d50120 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 --2- 172.21.15.87:0/2328955445 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f226c03bba0 0x7f226c03e060 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 --2- 172.21.15.87:0/2328955445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637e6c183a0 0x5637e6d112e0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 -- 172.21.15.87:0/2328955445 >> 172.21.15.87:0/2328955445 conn(0x5637e6c13920 msgr2=0x5637e6d03820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 -- 172.21.15.87:0/2328955445 shutdown_connections 2024-05-08T18:33:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.018+0000 7f2387f2b800 1 -- 172.21.15.87:0/2328955445 wait complete. 2024-05-08T18:33:04.027 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"be5b96a9-27d9-41bc-99e2-d41218f7be5a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-08T18:33:04.027 DEBUG:tasks.util.rgw: json result: {'id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-08T18:33:04.027 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-05-08T18:33:04.027 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-05-08T18:33:04.028 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-05-08T18:33:04.069 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:04.069 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:04.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.072+0000 7f1c4772d800 1 Processor -- start 2024-05-08T18:33:04.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.072+0000 7f1c4772d800 1 -- start start 2024-05-08T18:33:04.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.072+0000 7f1c4772d800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55886cbbeb90 0x55886cbbefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.072+0000 7f1c4772d800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55886cb33600 con 0x55886cbbf4f0 2024-05-08T18:33:04.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.072+0000 7f1c4772d800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55886ca60e20 con 0x55886cbbeb90 2024-05-08T18:33:04.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.073+0000 7f1c433ca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55886cbbeb90 0x55886cbbefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.073+0000 7f1c433ca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55886cbbeb90 0x55886cbbefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52376/0 (socket says 172.21.15.87:52376) 2024-05-08T18:33:04.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.073+0000 7f1c433ca640 1 -- 172.21.15.87:0/4198915589 learned_addr learned my addr 172.21.15.87:0/4198915589 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.073+0000 7f1c433ca640 1 -- 172.21.15.87:0/4198915589 >> v1:172.21.15.53:6789/0 conn(0x55886cbbf4f0 legacy=0x55886cbbf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.073+0000 7f1c433ca640 1 -- 172.21.15.87:0/4198915589 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55886cbc00b0 con 0x55886cbbeb90 2024-05-08T18:33:04.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.075+0000 7f1c433ca640 1 --2- 172.21.15.87:0/4198915589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 0x55886cbbefb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400a520 tx=0x7f1c3401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6070690b6a0107 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.075+0000 7f1c42bc9640 1 -- 172.21.15.87:0/4198915589 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c34057070 con 0x55886cbbeb90 2024-05-08T18:33:04.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.075+0000 7f1c42bc9640 1 -- 172.21.15.87:0/4198915589 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c34052570 con 0x55886cbbeb90 2024-05-08T18:33:04.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.075+0000 7f1c42bc9640 1 -- 172.21.15.87:0/4198915589 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c3404ae60 con 0x55886cbbeb90 2024-05-08T18:33:04.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.075+0000 7f1c4772d800 1 -- 172.21.15.87:0/4198915589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 msgr2=0x55886cbbefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.075+0000 7f1c4772d800 1 --2- 172.21.15.87:0/4198915589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 0x55886cbbefb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400a520 tx=0x7f1c3401d010 comp rx=0 tx=0).stop 2024-05-08T18:33:04.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.075+0000 7f1c4772d800 1 -- 172.21.15.87:0/4198915589 shutdown_connections 2024-05-08T18:33:04.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.075+0000 7f1c4772d800 1 --2- 172.21.15.87:0/4198915589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 0x55886cbbefb0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.075+0000 7f1c4772d800 1 -- 172.21.15.87:0/4198915589 >> 172.21.15.87:0/4198915589 conn(0x55886cbba710 msgr2=0x55886cbbcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.075+0000 7f1c4772d800 1 -- 172.21.15.87:0/4198915589 shutdown_connections 2024-05-08T18:33:04.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.075+0000 7f1c4772d800 1 -- 172.21.15.87:0/4198915589 wait complete. 2024-05-08T18:33:04.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.089+0000 7f1c4772d800 1 Processor -- start 2024-05-08T18:33:04.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.089+0000 7f1c4772d800 1 -- start start 2024-05-08T18:33:04.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.089+0000 7f1c4772d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 0x55886ccb3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.089+0000 7f1c4772d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55886cb0b5a0 con 0x55886cbbeb90 2024-05-08T18:33:04.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.089+0000 7f1c433ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 0x55886ccb3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.089+0000 7f1c433ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 0x55886ccb3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52390/0 (socket says 172.21.15.87:52390) 2024-05-08T18:33:04.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.089+0000 7f1c433ca640 1 -- 172.21.15.87:0/396069374 learned_addr learned my addr 172.21.15.87:0/396069374 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.090+0000 7f1c433ca640 1 -- 172.21.15.87:0/396069374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55886ccb40c0 con 0x55886cbbeb90 2024-05-08T18:33:04.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.090+0000 7f1c433ca640 1 --2- 172.21.15.87:0/396069374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 0x55886ccb3af0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1c34055040 tx=0x7f1c3404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39fd10e5c2cd5344 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.090+0000 7f1b3160a640 1 -- 172.21.15.87:0/396069374 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c34057040 con 0x55886cbbeb90 2024-05-08T18:33:04.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.090+0000 7f1b3160a640 1 -- 172.21.15.87:0/396069374 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c34052720 con 0x55886cbbeb90 2024-05-08T18:33:04.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.090+0000 7f1b3160a640 1 -- 172.21.15.87:0/396069374 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c34052a20 con 0x55886cbbeb90 2024-05-08T18:33:04.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.091+0000 7f1c4772d800 1 -- 172.21.15.87:0/396069374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 msgr2=0x55886ccb3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.091+0000 7f1c4772d800 1 --2- 172.21.15.87:0/396069374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 0x55886ccb3af0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1c34055040 tx=0x7f1c3404c000 comp rx=0 tx=0).stop 2024-05-08T18:33:04.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.091+0000 7f1c4772d800 1 -- 172.21.15.87:0/396069374 shutdown_connections 2024-05-08T18:33:04.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.091+0000 7f1c4772d800 1 --2- 172.21.15.87:0/396069374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 0x55886ccb3af0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.091+0000 7f1c4772d800 1 -- 172.21.15.87:0/396069374 >> 172.21.15.87:0/396069374 conn(0x55886cbba710 msgr2=0x55886ccaf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.091+0000 7f1c4772d800 1 -- 172.21.15.87:0/396069374 shutdown_connections 2024-05-08T18:33:04.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.091+0000 7f1c4772d800 1 -- 172.21.15.87:0/396069374 wait complete. 2024-05-08T18:33:04.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.091+0000 7f1c4772d800 1 Processor -- start 2024-05-08T18:33:04.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.091+0000 7f1c4772d800 1 -- start start 2024-05-08T18:33:04.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.091+0000 7f1c4772d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 0x55886ccbb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.091+0000 7f1c4772d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55886cbc0580 con 0x55886cbbeb90 2024-05-08T18:33:04.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.092+0000 7f1c433ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 0x55886ccbb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.092+0000 7f1c433ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 0x55886ccbb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52404/0 (socket says 172.21.15.87:52404) 2024-05-08T18:33:04.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.092+0000 7f1c433ca640 1 -- 172.21.15.87:0/900274932 learned_addr learned my addr 172.21.15.87:0/900274932 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.092+0000 7f1c433ca640 1 -- 172.21.15.87:0/900274932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55886ccbba80 con 0x55886cbbeb90 2024-05-08T18:33:04.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.092+0000 7f1c433ca640 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 0x55886ccbb540 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1c340524f0 tx=0x7f1c34003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.092+0000 7f1b2fe07640 1 -- 172.21.15.87:0/900274932 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c34073070 con 0x55886cbbeb90 2024-05-08T18:33:04.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.092+0000 7f1b2fe07640 1 -- 172.21.15.87:0/900274932 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c3405d440 con 0x55886cbbeb90 2024-05-08T18:33:04.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.092+0000 7f1b2fe07640 1 -- 172.21.15.87:0/900274932 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c34057070 con 0x55886cbbeb90 2024-05-08T18:33:04.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.092+0000 7f1c4772d800 1 -- 172.21.15.87:0/900274932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55886ccbbd10 con 0x55886cbbeb90 2024-05-08T18:33:04.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.092+0000 7f1c4772d800 1 -- 172.21.15.87:0/900274932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55886ccbe9c0 con 0x55886cbbeb90 2024-05-08T18:33:04.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.093+0000 7f1c4772d800 1 Processor -- start 2024-05-08T18:33:04.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.093+0000 7f1c4772d800 1 -- start start 2024-05-08T18:33:04.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.093+0000 7f1c4772d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccc8bd0 0x55886ccc8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.093+0000 7f1c4772d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55886cab1fc0 con 0x55886ccc8bd0 2024-05-08T18:33:04.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.093+0000 7f1b2fe07640 1 -- 172.21.15.87:0/900274932 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1c34076070 con 0x55886cbbeb90 2024-05-08T18:33:04.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.093+0000 7f1c43bcb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccc8bd0 0x55886ccc8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.093+0000 7f1c43bcb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccc8bd0 0x55886ccc8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52410/0 (socket says 172.21.15.87:52410) 2024-05-08T18:33:04.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.093+0000 7f1c43bcb640 1 -- 172.21.15.87:0/1174160288 learned_addr learned my addr 172.21.15.87:0/1174160288 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.093+0000 7f1b2fe07640 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1b2803bba0 0x7f1b2803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.093+0000 7f1b2fe07640 1 -- 172.21.15.87:0/900274932 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f1c34094170 con 0x55886cbbeb90 2024-05-08T18:33:04.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.094+0000 7f1c433ca640 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1b2803bba0 0x7f1b2803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.094+0000 7f1c43bcb640 1 -- 172.21.15.87:0/1174160288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55886ccc9530 con 0x55886ccc8bd0 2024-05-08T18:33:04.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.094+0000 7f1c433ca640 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1b2803bba0 0x7f1b2803e060 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1c3405d8b0 tx=0x7f1c3405d800 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.094+0000 7f1c43bcb640 1 --2- 172.21.15.87:0/1174160288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccc8bd0 0x55886ccc8ff0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00a430 tx=0x7f1c3c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca60302bb88cd80 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.094+0000 7f1b2de03640 1 -- 172.21.15.87:0/1174160288 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c3c015070 con 0x55886ccc8bd0 2024-05-08T18:33:04.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.094+0000 7f1b2de03640 1 -- 172.21.15.87:0/1174160288 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c3c001670 con 0x55886ccc8bd0 2024-05-08T18:33:04.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.094+0000 7f1b2de03640 1 -- 172.21.15.87:0/1174160288 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c3c001990 con 0x55886ccc8bd0 2024-05-08T18:33:04.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.095+0000 7f1c4772d800 1 -- 172.21.15.87:0/1174160288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccc8bd0 msgr2=0x55886ccc8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.095+0000 7f1c4772d800 1 --2- 172.21.15.87:0/1174160288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccc8bd0 0x55886ccc8ff0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00a430 tx=0x7f1c3c00a8f0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.095+0000 7f1c4772d800 1 -- 172.21.15.87:0/1174160288 shutdown_connections 2024-05-08T18:33:04.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.095+0000 7f1c4772d800 1 --2- 172.21.15.87:0/1174160288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccc8bd0 0x55886ccc8ff0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.095+0000 7f1c4772d800 1 -- 172.21.15.87:0/1174160288 >> 172.21.15.87:0/1174160288 conn(0x55886cbbf4f0 msgr2=0x55886ccc5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.095+0000 7f1c4772d800 1 -- 172.21.15.87:0/1174160288 shutdown_connections 2024-05-08T18:33:04.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.095+0000 7f1c4772d800 1 -- 172.21.15.87:0/1174160288 wait complete. 2024-05-08T18:33:04.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.095+0000 7f1c4772d800 1 Processor -- start 2024-05-08T18:33:04.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.095+0000 7f1c4772d800 1 -- start start 2024-05-08T18:33:04.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.095+0000 7f1c4772d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccc8bd0 0x55886ccd0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.095+0000 7f1c4772d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55886ccc9ec0 con 0x55886ccc8bd0 2024-05-08T18:33:04.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.095+0000 7f1c43bcb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccc8bd0 0x55886ccd0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.095+0000 7f1c43bcb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccc8bd0 0x55886ccd0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52426/0 (socket says 172.21.15.87:52426) 2024-05-08T18:33:04.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.095+0000 7f1c43bcb640 1 -- 172.21.15.87:0/310050472 learned_addr learned my addr 172.21.15.87:0/310050472 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.096+0000 7f1c43bcb640 1 -- 172.21.15.87:0/310050472 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55886ccd0640 con 0x55886ccc8bd0 2024-05-08T18:33:04.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.096+0000 7f1c43bcb640 1 --2- 172.21.15.87:0/310050472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccc8bd0 0x55886ccd0100 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00a930 tx=0x7f1c3c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.096+0000 7f1b1ffff640 1 -- 172.21.15.87:0/310050472 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c3c020020 con 0x55886ccc8bd0 2024-05-08T18:33:04.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.096+0000 7f1b1ffff640 1 -- 172.21.15.87:0/310050472 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c3c0108b0 con 0x55886ccc8bd0 2024-05-08T18:33:04.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.096+0000 7f1c4772d800 1 -- 172.21.15.87:0/310050472 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55886ccd08d0 con 0x55886ccc8bd0 2024-05-08T18:33:04.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.096+0000 7f1b1ffff640 1 -- 172.21.15.87:0/310050472 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c3c015040 con 0x55886ccc8bd0 2024-05-08T18:33:04.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.096+0000 7f1c4772d800 1 -- 172.21.15.87:0/310050472 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55886ccd3580 con 0x55886ccc8bd0 2024-05-08T18:33:04.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.097+0000 7f1b1ffff640 1 -- 172.21.15.87:0/310050472 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1c3c023020 con 0x55886ccc8bd0 2024-05-08T18:33:04.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.098+0000 7f1c4772d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:04.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.098+0000 7f1c4772d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:04.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.098+0000 7f1b1ffff640 1 --2- 172.21.15.87:0/310050472 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1b2403bba0 0x7f1b2403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.098+0000 7f1b1ffff640 1 -- 172.21.15.87:0/310050472 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f1c3c052390 con 0x55886ccc8bd0 2024-05-08T18:33:04.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.098+0000 7f1c3bfff640 1 --2- 172.21.15.87:0/310050472 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1b2403bba0 0x7f1b2403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.098+0000 7f1c4772d800 1 Processor -- start 2024-05-08T18:33:04.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.098+0000 7f1c4772d800 1 -- start start 2024-05-08T18:33:04.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.098+0000 7f1c4772d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccea7a0 0x55886cceabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.098+0000 7f1c4772d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55886ccb4380 con 0x55886ccea7a0 2024-05-08T18:33:04.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.098+0000 7f1c3bfff640 1 --2- 172.21.15.87:0/310050472 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1b2403bba0 0x7f1b2403e060 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55886ccc4af0 tx=0x7f1c2c001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.098+0000 7f1c433ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccea7a0 0x55886cceabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.098+0000 7f1c433ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccea7a0 0x55886cceabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52428/0 (socket says 172.21.15.87:52428) 2024-05-08T18:33:04.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.098+0000 7f1c433ca640 1 -- 172.21.15.87:0/4224181528 learned_addr learned my addr 172.21.15.87:0/4224181528 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.099+0000 7f1c433ca640 1 -- 172.21.15.87:0/4224181528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55886cceb100 con 0x55886ccea7a0 2024-05-08T18:33:04.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.099+0000 7f1c433ca640 1 --2- 172.21.15.87:0/4224181528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccea7a0 0x55886cceabc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1c34092430 tx=0x7f1c3405de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.099+0000 7f1b08fe1640 1 -- 172.21.15.87:0/4224181528 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c34089050 con 0x55886ccea7a0 2024-05-08T18:33:04.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.099+0000 7f1b08fe1640 1 -- 172.21.15.87:0/4224181528 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c3408a040 con 0x55886ccea7a0 2024-05-08T18:33:04.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.099+0000 7f1b08fe1640 1 -- 172.21.15.87:0/4224181528 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c34077cd0 con 0x55886ccea7a0 2024-05-08T18:33:04.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.099+0000 7f1c4772d800 1 -- 172.21.15.87:0/4224181528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55886ccebb70 con 0x55886ccea7a0 2024-05-08T18:33:04.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.099+0000 7f1c4772d800 1 -- 172.21.15.87:0/4224181528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55886ccec070 con 0x55886ccea7a0 2024-05-08T18:33:04.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.100+0000 7f1b08fe1640 1 -- 172.21.15.87:0/4224181528 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1c3405c8f0 con 0x55886ccea7a0 2024-05-08T18:33:04.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.100+0000 7f1b08fe1640 1 --2- 172.21.15.87:0/4224181528 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1a7c03bb50 0x7f1a7c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.100+0000 7f1b08fe1640 1 -- 172.21.15.87:0/4224181528 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f1c34096d80 con 0x55886ccea7a0 2024-05-08T18:33:04.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.100+0000 7f1c3bfff640 1 --2- 172.21.15.87:0/4224181528 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1a7c03bb50 0x7f1a7c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.100+0000 7f1b027fc640 20 reqs_thread_entry: start 2024-05-08T18:33:04.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.100+0000 7f1c3bfff640 1 --2- 172.21.15.87:0/4224181528 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1a7c03bb50 0x7f1a7c03e010 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c003f10 tx=0x7f1c2c006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.101+0000 7f1c4772d800 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55886ccf81a0 0x55886ccfa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.101+0000 7f1c4772d800 1 -- 172.21.15.87:0/900274932 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55886ccfac80 con 0x55886ccf81a0 2024-05-08T18:33:04.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.101+0000 7f1c43bcb640 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55886ccf81a0 0x55886ccfa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.101+0000 7f1c43bcb640 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55886ccf81a0 0x55886ccfa5d0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.101+0000 7f1c43bcb640 1 -- 172.21.15.87:0/900274932 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c3c010d70 con 0x55886ccf81a0 2024-05-08T18:33:04.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.101+0000 7f1c4772d800 1 -- 172.21.15.87:0/900274932 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55886ccfb560 con 0x55886ccf81a0 2024-05-08T18:33:04.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.101+0000 7f1c43bcb640 1 -- 172.21.15.87:0/900274932 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c3c010d70 con 0x55886ccf81a0 2024-05-08T18:33:04.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.101+0000 7f1c4772d800 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55886ccfce70 0x55886ccff300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.101+0000 7f1c4772d800 1 -- 172.21.15.87:0/900274932 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:3 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55886ccffa60 con 0x55886ccfce70 2024-05-08T18:33:04.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.102+0000 7f1c433ca640 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55886ccfce70 0x55886ccff300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.102+0000 7f1c433ca640 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55886ccfce70 0x55886ccff300 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.102+0000 7f1c433ca640 1 -- 172.21.15.87:0/900274932 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(3 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1c3408c070 con 0x55886ccfce70 2024-05-08T18:33:04.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.103+0000 7f1c4772d800 1 -- 172.21.15.87:0/310050472 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1b2403bba0 msgr2=0x7f1b2403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.103+0000 7f1c4772d800 1 --2- 172.21.15.87:0/310050472 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1b2403bba0 0x7f1b2403e060 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55886ccc4af0 tx=0x7f1c2c001310 comp rx=0 tx=0).stop 2024-05-08T18:33:04.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.103+0000 7f1c4772d800 1 -- 172.21.15.87:0/310050472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccc8bd0 msgr2=0x55886ccd0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.103+0000 7f1c4772d800 1 --2- 172.21.15.87:0/310050472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccc8bd0 0x55886ccd0100 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00a930 tx=0x7f1c3c003370 comp rx=0 tx=0).stop 2024-05-08T18:33:04.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.103+0000 7f1c4772d800 1 -- 172.21.15.87:0/310050472 shutdown_connections 2024-05-08T18:33:04.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.103+0000 7f1c4772d800 1 --2- 172.21.15.87:0/310050472 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1b2403bba0 0x7f1b2403e060 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.103+0000 7f1c4772d800 1 --2- 172.21.15.87:0/310050472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccc8bd0 0x55886ccd0100 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.103+0000 7f1c4772d800 1 -- 172.21.15.87:0/310050472 >> 172.21.15.87:0/310050472 conn(0x55886cbbf4f0 msgr2=0x55886ccc2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.103+0000 7f1c4772d800 1 -- 172.21.15.87:0/310050472 shutdown_connections 2024-05-08T18:33:04.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.103+0000 7f1c4772d800 1 -- 172.21.15.87:0/310050472 wait complete. 2024-05-08T18:33:04.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 -- 172.21.15.87:0/4224181528 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1a7c03bb50 msgr2=0x7f1a7c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 --2- 172.21.15.87:0/4224181528 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1a7c03bb50 0x7f1a7c03e010 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c003f10 tx=0x7f1c2c006000 comp rx=0 tx=0).stop 2024-05-08T18:33:04.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 -- 172.21.15.87:0/4224181528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccea7a0 msgr2=0x55886cceabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 --2- 172.21.15.87:0/4224181528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccea7a0 0x55886cceabc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1c34092430 tx=0x7f1c3405de80 comp rx=0 tx=0).stop 2024-05-08T18:33:04.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 -- 172.21.15.87:0/4224181528 shutdown_connections 2024-05-08T18:33:04.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 --2- 172.21.15.87:0/4224181528 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1a7c03bb50 0x7f1a7c03e010 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 --2- 172.21.15.87:0/4224181528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886ccea7a0 0x55886cceabc0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 -- 172.21.15.87:0/4224181528 >> 172.21.15.87:0/4224181528 conn(0x55886ccdf2e0 msgr2=0x55886ccdfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 -- 172.21.15.87:0/4224181528 shutdown_connections 2024-05-08T18:33:04.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 -- 172.21.15.87:0/4224181528 wait complete. 2024-05-08T18:33:04.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 -- 172.21.15.87:0/900274932 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55886ccfce70 msgr2=0x55886ccff300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55886ccfce70 0x55886ccff300 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 -- 172.21.15.87:0/900274932 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55886ccf81a0 msgr2=0x55886ccfa5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55886ccf81a0 0x55886ccfa5d0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 -- 172.21.15.87:0/900274932 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1b2803bba0 msgr2=0x7f1b2803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1b2803bba0 0x7f1b2803e060 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1c3405d8b0 tx=0x7f1c3405d800 comp rx=0 tx=0).stop 2024-05-08T18:33:04.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 -- 172.21.15.87:0/900274932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 msgr2=0x55886ccbb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 0x55886ccbb540 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1c340524f0 tx=0x7f1c34003020 comp rx=0 tx=0).stop 2024-05-08T18:33:04.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 -- 172.21.15.87:0/900274932 shutdown_connections 2024-05-08T18:33:04.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55886ccf81a0 0x55886ccfa5d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55886ccfce70 0x55886ccff300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1b2803bba0 0x7f1b2803e060 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 --2- 172.21.15.87:0/900274932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55886cbbeb90 0x55886ccbb540 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 -- 172.21.15.87:0/900274932 >> 172.21.15.87:0/900274932 conn(0x55886cbba710 msgr2=0x55886ccadc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 -- 172.21.15.87:0/900274932 shutdown_connections 2024-05-08T18:33:04.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.104+0000 7f1c4772d800 1 -- 172.21.15.87:0/900274932 wait complete. 2024-05-08T18:33:04.115 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"603f2301-f6d0-4df6-aa57-6b1659110044","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"be5b96a9-27d9-41bc-99e2-d41218f7be5a","zones":[{"id":"be5b96a9-27d9-41bc-99e2-d41218f7be5a","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-05-08T18:33:04.115 DEBUG:tasks.util.rgw: json result: {'id': '603f2301-f6d0-4df6-aa57-6b1659110044', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a', 'zones': [{'id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-05-08T18:33:04.118 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-05-08T18:33:04.137 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-05-08T18:33:04.138 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-05-08T18:33:04.138 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-05-08T18:33:04.209 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:04.209 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:04.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.211+0000 7f6c4f43e800 1 Processor -- start 2024-05-08T18:33:04.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.211+0000 7f6c4f43e800 1 -- start start 2024-05-08T18:33:04.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.211+0000 7f6c4f43e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55be0d8ea180 0x55be0d8ea5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.212+0000 7f6c4f43e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55be0d8eac20 con 0x55be0d8eb3e0 2024-05-08T18:33:04.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.212+0000 7f6c4f43e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55be0d78be20 con 0x55be0d8ea180 2024-05-08T18:33:04.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.212+0000 7f6c4a0ce640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55be0d8ea180 0x55be0d8ea5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.212+0000 7f6c4a0ce640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55be0d8ea180 0x55be0d8ea5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52438/0 (socket says 172.21.15.87:52438) 2024-05-08T18:33:04.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.212+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/3228002534 learned_addr learned my addr 172.21.15.87:0/3228002534 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.212+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/3228002534 >> v1:172.21.15.53:6789/0 conn(0x55be0d8eb3e0 legacy=0x55be0d8eb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.212+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/3228002534 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be0d8ebfa0 con 0x55be0d8ea180 2024-05-08T18:33:04.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.214+0000 7f6c4a0ce640 1 --2- 172.21.15.87:0/3228002534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 0x55be0d8ea5a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00a520 tx=0x7f6c3c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a86c1093fe103f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.214+0000 7f6c498cd640 1 -- 172.21.15.87:0/3228002534 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c3c057070 con 0x55be0d8ea180 2024-05-08T18:33:04.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.214+0000 7f6c498cd640 1 -- 172.21.15.87:0/3228002534 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c052570 con 0x55be0d8ea180 2024-05-08T18:33:04.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.214+0000 7f6c498cd640 1 -- 172.21.15.87:0/3228002534 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c3c052870 con 0x55be0d8ea180 2024-05-08T18:33:04.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.215+0000 7f6c4f43e800 1 -- 172.21.15.87:0/3228002534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 msgr2=0x55be0d8ea5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.215+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/3228002534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 0x55be0d8ea5a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00a520 tx=0x7f6c3c01d010 comp rx=0 tx=0).stop 2024-05-08T18:33:04.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.215+0000 7f6c4f43e800 1 -- 172.21.15.87:0/3228002534 shutdown_connections 2024-05-08T18:33:04.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.215+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/3228002534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 0x55be0d8ea5a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.215+0000 7f6c4f43e800 1 -- 172.21.15.87:0/3228002534 >> 172.21.15.87:0/3228002534 conn(0x55be0d8e5760 msgr2=0x55be0d8e7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.215+0000 7f6c4f43e800 1 -- 172.21.15.87:0/3228002534 shutdown_connections 2024-05-08T18:33:04.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.215+0000 7f6c4f43e800 1 -- 172.21.15.87:0/3228002534 wait complete. 2024-05-08T18:33:04.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.228+0000 7f6c4f43e800 1 Processor -- start 2024-05-08T18:33:04.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.228+0000 7f6c4f43e800 1 -- start start 2024-05-08T18:33:04.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.228+0000 7f6c4f43e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 0x55be0d9db7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.228+0000 7f6c4f43e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55be0d8366b0 con 0x55be0d8ea180 2024-05-08T18:33:04.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.229+0000 7f6c4a0ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 0x55be0d9db7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.229+0000 7f6c4a0ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 0x55be0d9db7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52440/0 (socket says 172.21.15.87:52440) 2024-05-08T18:33:04.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.229+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/1464991513 learned_addr learned my addr 172.21.15.87:0/1464991513 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.229+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/1464991513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be0d9dbda0 con 0x55be0d8ea180 2024-05-08T18:33:04.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.229+0000 7f6c4a0ce640 1 --2- 172.21.15.87:0/1464991513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 0x55be0d9db7d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c01d050 tx=0x7f6c3c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83229cea9e87117 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.229+0000 7f6b38608640 1 -- 172.21.15.87:0/1464991513 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c3c057040 con 0x55be0d8ea180 2024-05-08T18:33:04.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.229+0000 7f6b38608640 1 -- 172.21.15.87:0/1464991513 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c052850 con 0x55be0d8ea180 2024-05-08T18:33:04.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.229+0000 7f6b38608640 1 -- 172.21.15.87:0/1464991513 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c3c052b70 con 0x55be0d8ea180 2024-05-08T18:33:04.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.230+0000 7f6c4f43e800 1 -- 172.21.15.87:0/1464991513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 msgr2=0x55be0d9db7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.230+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/1464991513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 0x55be0d9db7d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c01d050 tx=0x7f6c3c04c000 comp rx=0 tx=0).stop 2024-05-08T18:33:04.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.230+0000 7f6c4f43e800 1 -- 172.21.15.87:0/1464991513 shutdown_connections 2024-05-08T18:33:04.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.230+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/1464991513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 0x55be0d9db7d0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.230+0000 7f6c4f43e800 1 -- 172.21.15.87:0/1464991513 >> 172.21.15.87:0/1464991513 conn(0x55be0d8e5760 msgr2=0x55be0d9d70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.230+0000 7f6c4f43e800 1 -- 172.21.15.87:0/1464991513 shutdown_connections 2024-05-08T18:33:04.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.230+0000 7f6c4f43e800 1 -- 172.21.15.87:0/1464991513 wait complete. 2024-05-08T18:33:04.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.230+0000 7f6c4f43e800 1 Processor -- start 2024-05-08T18:33:04.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.230+0000 7f6c4f43e800 1 -- start start 2024-05-08T18:33:04.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.231+0000 7f6c4f43e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 0x55be0d85e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.231+0000 7f6c4f43e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55be0d8f38b0 con 0x55be0d8ea180 2024-05-08T18:33:04.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.231+0000 7f6c4a0ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 0x55be0d85e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.231+0000 7f6c4a0ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 0x55be0d85e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52442/0 (socket says 172.21.15.87:52442) 2024-05-08T18:33:04.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.231+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/2464773319 learned_addr learned my addr 172.21.15.87:0/2464773319 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.231+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/2464773319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be0d9e6ee0 con 0x55be0d8ea180 2024-05-08T18:33:04.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.231+0000 7f6c4a0ce640 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 0x55be0d85e340 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c01d050 tx=0x7f6c3c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.232+0000 7f6b36e05640 1 -- 172.21.15.87:0/2464773319 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c3c073070 con 0x55be0d8ea180 2024-05-08T18:33:04.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.232+0000 7f6b36e05640 1 -- 172.21.15.87:0/2464773319 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c05d650 con 0x55be0d8ea180 2024-05-08T18:33:04.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.232+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2464773319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be0d9e70b0 con 0x55be0d8ea180 2024-05-08T18:33:04.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.232+0000 7f6b36e05640 1 -- 172.21.15.87:0/2464773319 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c3c057070 con 0x55be0d8ea180 2024-05-08T18:33:04.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.232+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2464773319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be0d9e7630 con 0x55be0d8ea180 2024-05-08T18:33:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.233+0000 7f6b36e05640 1 -- 172.21.15.87:0/2464773319 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6c3c076070 con 0x55be0d8ea180 2024-05-08T18:33:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.233+0000 7f6b36e05640 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6b3003bb50 0x7f6b3003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.233+0000 7f6b36e05640 1 -- 172.21.15.87:0/2464773319 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f6c3c094380 con 0x55be0d8ea180 2024-05-08T18:33:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.233+0000 7f6c418cd640 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6b3003bb50 0x7f6b3003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.233+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55be0d8eb3e0 0x55be0d9eb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.233+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2464773319 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0d9ebaf0 con 0x55be0d8eb3e0 2024-05-08T18:33:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.233+0000 7f6c4a8cf640 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55be0d8eb3e0 0x55be0d9eb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.233+0000 7f6c418cd640 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6b3003bb50 0x7f6b3003e010 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6c34001e10 tx=0x7f6c34001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.233+0000 7f6c4a8cf640 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55be0d8eb3e0 0x55be0d9eb4d0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.234+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/2464773319 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c4400a4a0 con 0x55be0d8eb3e0 2024-05-08T18:33:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.234+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2464773319 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0d9ec3b0 con 0x55be0d8eb3e0 2024-05-08T18:33:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.234+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/2464773319 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c4400a4a0 con 0x55be0d8eb3e0 2024-05-08T18:33:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.234+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2464773319 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0d9ed760 con 0x55be0d8eb3e0 2024-05-08T18:33:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.234+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/2464773319 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6c4400a4a0 con 0x55be0d8eb3e0 2024-05-08T18:33:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.234+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2464773319 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0d9ecc00 con 0x55be0d8eb3e0 2024-05-08T18:33:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.234+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/2464773319 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c4400a4a0 con 0x55be0d8eb3e0 2024-05-08T18:33:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.234+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55be0d9eeb10 0x55be0d9f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.234+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2464773319 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0d9f1510 con 0x55be0d9eeb10 2024-05-08T18:33:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.235+0000 7f6c4a0ce640 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55be0d9eeb10 0x55be0d9f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.235+0000 7f6c4a0ce640 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55be0d9eeb10 0x55be0d9f0f00 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.235+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/2464773319 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6c3c075030 con 0x55be0d9eeb10 2024-05-08T18:33:04.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.236+0000 7f6c4f43e800 1 Processor -- start 2024-05-08T18:33:04.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.236+0000 7f6c4f43e800 1 -- start start 2024-05-08T18:33:04.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.236+0000 7f6c4f43e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9ff880 0x55be0d9ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.236+0000 7f6c4f43e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55be0d7dcfc0 con 0x55be0d9ff880 2024-05-08T18:33:04.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.236+0000 7f6c4a8cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9ff880 0x55be0d9ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.236+0000 7f6c4a8cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9ff880 0x55be0d9ffca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52456/0 (socket says 172.21.15.87:52456) 2024-05-08T18:33:04.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.236+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/2855091912 learned_addr learned my addr 172.21.15.87:0/2855091912 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.236+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/2855091912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be0da001e0 con 0x55be0d9ff880 2024-05-08T18:33:04.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.237+0000 7f6c4a8cf640 1 --2- 172.21.15.87:0/2855091912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9ff880 0x55be0d9ffca0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x55be0d9ebed0 tx=0x7f6c440178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.237+0000 7f6b2ffff640 1 -- 172.21.15.87:0/2855091912 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c44013440 con 0x55be0d9ff880 2024-05-08T18:33:04.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.237+0000 7f6b2ffff640 1 -- 172.21.15.87:0/2855091912 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c440135e0 con 0x55be0d9ff880 2024-05-08T18:33:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.237+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2855091912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be0da00c50 con 0x55be0d9ff880 2024-05-08T18:33:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.237+0000 7f6b2ffff640 1 -- 172.21.15.87:0/2855091912 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c440138c0 con 0x55be0d9ff880 2024-05-08T18:33:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.237+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2855091912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be0da01150 con 0x55be0d9ff880 2024-05-08T18:33:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.238+0000 7f6b2ffff640 1 -- 172.21.15.87:0/2855091912 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6c44011040 con 0x55be0d9ff880 2024-05-08T18:33:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.238+0000 7f6b2ffff640 1 --2- 172.21.15.87:0/2855091912 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6b2403bba0 0x7f6b2403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.238+0000 7f6b2ffff640 1 -- 172.21.15.87:0/2855091912 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f6c4401d070 con 0x55be0d9ff880 2024-05-08T18:33:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.238+0000 7f6c4a0ce640 1 --2- 172.21.15.87:0/2855091912 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6b2403bba0 0x7f6b2403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.238+0000 7f6c4f43e800 1 Processor -- start 2024-05-08T18:33:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.238+0000 7f6c4a0ce640 1 --2- 172.21.15.87:0/2855091912 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6b2403bba0 0x7f6b2403e060 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55be0d9ecfa0 tx=0x7f6c3c006a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.238+0000 7f6c4f43e800 1 -- start start 2024-05-08T18:33:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.238+0000 7f6c4f43e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9e44c0 0x55be0d9e48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.238+0000 7f6c4f43e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55be0d9dc060 con 0x55be0d9e44c0 2024-05-08T18:33:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.239+0000 7f6c4a8cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9e44c0 0x55be0d9e48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.239+0000 7f6c4a8cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9e44c0 0x55be0d9e48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52466/0 (socket says 172.21.15.87:52466) 2024-05-08T18:33:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.239+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/2090593162 learned_addr learned my addr 172.21.15.87:0/2090593162 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.239+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/2090593162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be0d9e2cc0 con 0x55be0d9e44c0 2024-05-08T18:33:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.239+0000 7f6c4a8cf640 1 --2- 172.21.15.87:0/2090593162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9e44c0 0x55be0d9e48e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f6c44052a60 tx=0x7f6c44052c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9518c024c4bba0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.239+0000 7f6b2dffb640 1 -- 172.21.15.87:0/2090593162 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c4402a350 con 0x55be0d9e44c0 2024-05-08T18:33:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.239+0000 7f6b2dffb640 1 -- 172.21.15.87:0/2090593162 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c4404f030 con 0x55be0d9e44c0 2024-05-08T18:33:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.239+0000 7f6b2dffb640 1 -- 172.21.15.87:0/2090593162 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c44012ca0 con 0x55be0d9e44c0 2024-05-08T18:33:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.240+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2090593162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9e44c0 msgr2=0x55be0d9e48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.240+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/2090593162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9e44c0 0x55be0d9e48e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f6c44052a60 tx=0x7f6c44052c60 comp rx=0 tx=0).stop 2024-05-08T18:33:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.240+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2090593162 shutdown_connections 2024-05-08T18:33:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.240+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/2090593162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9e44c0 0x55be0d9e48e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.240+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2090593162 >> 172.21.15.87:0/2090593162 conn(0x55be0da08e80 msgr2=0x55be0da06ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.240+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2090593162 shutdown_connections 2024-05-08T18:33:04.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.240+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2090593162 wait complete. 2024-05-08T18:33:04.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.240+0000 7f6c4f43e800 1 Processor -- start 2024-05-08T18:33:04.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.240+0000 7f6c4f43e800 1 -- start start 2024-05-08T18:33:04.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.240+0000 7f6c4f43e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9e44c0 0x55be0da16250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.240+0000 7f6c4f43e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55be0d9e3190 con 0x55be0d9e44c0 2024-05-08T18:33:04.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.240+0000 7f6c4a8cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9e44c0 0x55be0da16250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.240+0000 7f6c4a8cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9e44c0 0x55be0da16250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52472/0 (socket says 172.21.15.87:52472) 2024-05-08T18:33:04.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.240+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 learned_addr learned my addr 172.21.15.87:0/945074808 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.241+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be0da16790 con 0x55be0d9e44c0 2024-05-08T18:33:04.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.241+0000 7f6c4a8cf640 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9e44c0 0x55be0da16250 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6c44052ca0 tx=0x7f6c440529f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.241+0000 7f6b1bfff640 1 -- 172.21.15.87:0/945074808 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c4402a800 con 0x55be0d9e44c0 2024-05-08T18:33:04.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.241+0000 7f6b1bfff640 1 -- 172.21.15.87:0/945074808 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c440512d0 con 0x55be0d9e44c0 2024-05-08T18:33:04.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.241+0000 7f6b1bfff640 1 -- 172.21.15.87:0/945074808 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c4402aa00 con 0x55be0d9e44c0 2024-05-08T18:33:04.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.241+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be0da16a20 con 0x55be0d9e44c0 2024-05-08T18:33:04.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.241+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be0da196d0 con 0x55be0d9e44c0 2024-05-08T18:33:04.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.242+0000 7f6b1bfff640 1 -- 172.21.15.87:0/945074808 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6c44013a60 con 0x55be0d9e44c0 2024-05-08T18:33:04.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.242+0000 7f6b1bfff640 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6b1403bba0 0x7f6b1403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.242+0000 7f6b1bfff640 1 -- 172.21.15.87:0/945074808 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f6c4400e040 con 0x55be0d9e44c0 2024-05-08T18:33:04.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.242+0000 7f6c4a0ce640 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6b1403bba0 0x7f6b1403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.243+0000 7f6c4a0ce640 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6b1403bba0 0x7f6b1403e060 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c094330 tx=0x7f6c3c086000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.243+0000 7f6c4f43e800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.243+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55be0da21d20 0x55be0da241e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.243+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0da24930 con 0x55be0da21d20 2024-05-08T18:33:04.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.243+0000 7f6c418cd640 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55be0da21d20 0x55be0da241e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.243+0000 7f6c418cd640 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55be0da21d20 0x55be0da241e0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.243+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c3400bdb0 con 0x55be0da21d20 2024-05-08T18:33:04.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.243+0000 7f6c4f43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.243+0000 7f6c4f43e800 20 realm 2024-05-08T18:33:04.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.243+0000 7f6c4f43e800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.243+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0da21170 con 0x55be0da21d20 2024-05-08T18:33:04.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c3400bdb0 con 0x55be0da21d20 2024-05-08T18:33:04.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c4f43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c4f43e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:04.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c4f43e800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0da25420 con 0x55be0da21d20 2024-05-08T18:33:04.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c3400bdb0 con 0x55be0da21d20 2024-05-08T18:33:04.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c4f43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c4f43e800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0da25cf0 con 0x55be0da21d20 2024-05-08T18:33:04.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c3400bdb0 con 0x55be0da21d20 2024-05-08T18:33:04.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c4f43e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:04.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c4f43e800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0da26090 con 0x55be0da21d20 2024-05-08T18:33:04.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6c3400bdb0 con 0x55be0da21d20 2024-05-08T18:33:04.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c4f43e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:04.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c4f43e800 20 searching for the correct realm 2024-05-08T18:33:04.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55be0da27f70 0x55be0da2a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.244+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x55be0da27f70 2024-05-08T18:33:04.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.245+0000 7f6c4a8cf640 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55be0da27f70 0x55be0da2a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.245+0000 7f6c4a8cf640 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55be0da27f70 0x55be0da2a3a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.245+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4400a4a0 con 0x55be0da27f70 2024-05-08T18:33:04.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.245+0000 7f6c4a8cf640 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6c44040560 0x7f6c440409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.245+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x7f6c44040560 2024-05-08T18:33:04.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.245+0000 7f6c4a0ce640 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6c44040560 0x7f6c440409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.246+0000 7f6c4a0ce640 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6c44040560 0x7f6c440409e0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.246+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c075030 con 0x7f6c44040560 2024-05-08T18:33:04.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.246+0000 7f6c4a0ce640 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6c3c0a1040 0x7f6c3c0946e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.246+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x7f6c3c0a1040 2024-05-08T18:33:04.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.246+0000 7f6c418cd640 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6c3c0a1040 0x7f6c3c0946e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.247+0000 7f6c418cd640 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6c3c0a1040 0x7f6c3c0946e0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.247+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3400bdb0 con 0x7f6c3c0a1040 2024-05-08T18:33:04.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.247+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x55be0da21d20 2024-05-08T18:33:04.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.247+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3400bdb0 con 0x55be0da21d20 2024-05-08T18:33:04.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.247+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x55be0da21d20 2024-05-08T18:33:04.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.247+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.247+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x7f6c3c0a1040 2024-05-08T18:33:04.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.248+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.248+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x7f6c3c0a1040 2024-05-08T18:33:04.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.248+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.248+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x7f6c44040560 2024-05-08T18:33:04.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.248+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c075030 con 0x7f6c44040560 2024-05-08T18:33:04.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.248+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x55be0da27f70 2024-05-08T18:33:04.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.248+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4405f040 con 0x55be0da27f70 2024-05-08T18:33:04.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.248+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x55be0da21d20 2024-05-08T18:33:04.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.249+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.249+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x7f6c3c0a1040 2024-05-08T18:33:04.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.249+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.249+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x55be0da21d20 2024-05-08T18:33:04.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.249+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.249+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x7f6c44040560 2024-05-08T18:33:04.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.249+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6c3c075030 con 0x7f6c44040560 2024-05-08T18:33:04.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.249+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x55be0da27f70 2024-05-08T18:33:04.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.250+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4405f040 con 0x55be0da27f70 2024-05-08T18:33:04.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.250+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x55be0da27f70 2024-05-08T18:33:04.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.250+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4405f040 con 0x55be0da27f70 2024-05-08T18:33:04.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.250+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x7f6c3c0a1040 2024-05-08T18:33:04.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.250+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.250+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x55be0da27f70 2024-05-08T18:33:04.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.251+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4405f040 con 0x55be0da27f70 2024-05-08T18:33:04.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.251+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x55be0da27f70 2024-05-08T18:33:04.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.251+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4405f040 con 0x55be0da27f70 2024-05-08T18:33:04.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.251+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x55be0da21d20 2024-05-08T18:33:04.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.251+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.251+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x55be0da21d20 2024-05-08T18:33:04.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.251+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v29'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.251+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x7f6c3c0a1040 2024-05-08T18:33:04.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.252+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.252+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x55be0da27f70 2024-05-08T18:33:04.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.252+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4405f040 con 0x55be0da27f70 2024-05-08T18:33:04.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.252+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x7f6c44040560 2024-05-08T18:33:04.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.252+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c075030 con 0x7f6c44040560 2024-05-08T18:33:04.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.252+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x55be0da21d20 2024-05-08T18:33:04.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.252+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.252+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x7f6c3c0a1040 2024-05-08T18:33:04.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.253+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.253+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x55be0da27f70 2024-05-08T18:33:04.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.253+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4405f040 con 0x55be0da27f70 2024-05-08T18:33:04.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.253+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x7f6c44040560 2024-05-08T18:33:04.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.253+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c075030 con 0x7f6c44040560 2024-05-08T18:33:04.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.253+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x7f6c44040560 2024-05-08T18:33:04.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.253+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c075030 con 0x7f6c44040560 2024-05-08T18:33:04.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.253+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x55be0da27f70 2024-05-08T18:33:04.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.253+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4405f040 con 0x55be0da27f70 2024-05-08T18:33:04.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.253+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x7f6c44040560 2024-05-08T18:33:04.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.254+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c075030 con 0x7f6c44040560 2024-05-08T18:33:04.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.254+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x55be0da21d20 2024-05-08T18:33:04.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.254+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.254+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aa70 con 0x7f6c44040560 2024-05-08T18:33:04.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.254+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c075030 con 0x7f6c44040560 2024-05-08T18:33:04.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.254+0000 7f6c4f43e800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:04.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.254+0000 7f6c4f43e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:04.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.254+0000 7f6c4f43e800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:04.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.254+0000 7f6c4f43e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:04.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.254+0000 7f6c4f43e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:04.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.254+0000 7f6c4f43e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:04.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.254+0000 7f6c4f43e800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.254+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0da26a10 con 0x55be0da21d20 2024-05-08T18:33:04.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.254+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.254+0000 7f6c4f43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.254+0000 7f6c4f43e800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.254+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0da272b0 con 0x55be0da21d20 2024-05-08T18:33:04.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c4f43e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:04.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c4f43e800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2aef0 con 0x7f6c3c0a1040 2024-05-08T18:33:04.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c4f43e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:04.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c4f43e800 20 zone default found 2024-05-08T18:33:04.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c4f43e800 4 Realm: () 2024-05-08T18:33:04.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c4f43e800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:04.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c4f43e800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:04.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c4f43e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:04.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c4f43e800 20 zonegroup default 2024-05-08T18:33:04.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c4f43e800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2b3a0 con 0x7f6c3c0a1040 2024-05-08T18:33:04.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c4f43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c4f43e800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.255+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2cd80 con 0x55be0da27f70 2024-05-08T18:33:04.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.256+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c4405f040 con 0x55be0da27f70 2024-05-08T18:33:04.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.256+0000 7f6c4f43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.256+0000 7f6c4f43e800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.256+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2d200 con 0x55be0da27f70 2024-05-08T18:33:04.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.256+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c4405f040 con 0x55be0da27f70 2024-05-08T18:33:04.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.256+0000 7f6c4f43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.256+0000 7f6c4f43e800 20 started sync module instance, tier type = 2024-05-08T18:33:04.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.256+0000 7f6c4f43e800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:04.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.256+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2c210 con 0x7f6c44040560 2024-05-08T18:33:04.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.257+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3c075030 con 0x7f6c44040560 2024-05-08T18:33:04.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.257+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94274760918528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2be70 con 0x7f6c44040560 2024-05-08T18:33:04.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.257+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2e130 con 0x55be0da21d20 2024-05-08T18:33:04.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.258+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94274760918528] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3c075030 con 0x7f6c44040560 2024-05-08T18:33:04.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.259+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.259+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94274760924288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2e550 con 0x55be0da21d20 2024-05-08T18:33:04.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.259+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2ef10 con 0x55be0da27f70 2024-05-08T18:33:04.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.260+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94274760924288] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.260+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4405f040 con 0x55be0da27f70 2024-05-08T18:33:04.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.260+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94274760925344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2e4c0 con 0x55be0da27f70 2024-05-08T18:33:04.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.260+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2fdd0 con 0x7f6c44040560 2024-05-08T18:33:04.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.261+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94274760925344] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4405f040 con 0x55be0da27f70 2024-05-08T18:33:04.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.261+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3c075030 con 0x7f6c44040560 2024-05-08T18:33:04.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.261+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94274760931616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da301c0 con 0x7f6c44040560 2024-05-08T18:33:04.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.261+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da30c00 con 0x55be0da21d20 2024-05-08T18:33:04.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.262+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94274760931616] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3c075030 con 0x7f6c44040560 2024-05-08T18:33:04.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.262+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.262+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94274760935120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da30ff0 con 0x55be0da21d20 2024-05-08T18:33:04.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.262+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da31a10 con 0x7f6c3c0a1040 2024-05-08T18:33:04.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.263+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94274760935120] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.263+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.263+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94274760938752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da319d0 con 0x7f6c3c0a1040 2024-05-08T18:33:04.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.263+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da32420 con 0x7f6c3c0a1040 2024-05-08T18:33:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.264+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94274760938752] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.264+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.264+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94274760930048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da32420 con 0x7f6c3c0a1040 2024-05-08T18:33:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.265+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da32de0 con 0x7f6c3c0a1040 2024-05-08T18:33:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.266+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94274760930048] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.266+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.266+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94274760941904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da32de0 con 0x7f6c3c0a1040 2024-05-08T18:33:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.266+0000 7f6c4f43e800 20 add_watcher() i=0 2024-05-08T18:33:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.266+0000 7f6c4f43e800 20 add_watcher() i=1 2024-05-08T18:33:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.266+0000 7f6c4f43e800 20 add_watcher() i=2 2024-05-08T18:33:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.266+0000 7f6c4f43e800 20 add_watcher() i=3 2024-05-08T18:33:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.266+0000 7f6c4f43e800 20 add_watcher() i=4 2024-05-08T18:33:04.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.266+0000 7f6c4f43e800 20 add_watcher() i=5 2024-05-08T18:33:04.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.266+0000 7f6c4f43e800 20 add_watcher() i=6 2024-05-08T18:33:04.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.267+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94274760941904] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.267+0000 7f6c4f43e800 20 add_watcher() i=7 2024-05-08T18:33:04.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.267+0000 7f6c4f43e800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:04.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.267+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0da361e0 con 0x55be0da21d20 2024-05-08T18:33:04.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.267+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.267+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94274760944384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da336a0 con 0x55be0da21d20 2024-05-08T18:33:04.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.268+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94274760944384] v29'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.268+0000 7f6b00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:04.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.268+0000 7f6c4f43e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:04.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.268+0000 7f6c4f43e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:04.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.268+0000 7f6c4f43e800 5 note: GC not initialized 2024-05-08T18:33:04.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.268+0000 7f6a7b7fe640 20 reqs_thread_entry: start 2024-05-08T18:33:04.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.268+0000 7f6c4f43e800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:04.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.269+0000 7f6c4f43e800 20 Filter name: none 2024-05-08T18:33:04.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.269+0000 7f6a797fa640 20 reqs_thread_entry: start 2024-05-08T18:33:04.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.269+0000 7f6c4f43e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:33:04.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.269+0000 7f6c4f43e800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.269+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0da69770 con 0x7f6c3c0a1040 2024-05-08T18:33:04.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.269+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.269+0000 7f6c4f43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.269+0000 7f6c4f43e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-05-08T18:33:04.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.269+0000 7f6c4f43e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:04.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.269+0000 7f6c4f43e800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-05-08T18:33:04.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.269+0000 7f6c4f43e800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.269+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0da67f10 con 0x55be0da21d20 2024-05-08T18:33:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.270+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.270+0000 7f6c4f43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.270+0000 7f6c4f43e800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-05-08T18:33:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.270+0000 7f6c4f43e800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-08T18:33:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.270+0000 7f6c4f43e800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-05-08T18:33:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.270+0000 7f6c4f43e800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-05-08T18:33:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.270+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da68820 con 0x7f6c3c0a1040 2024-05-08T18:33:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.271+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v29'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.271+0000 7f6c4f43e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.271+0000 7f6c4f43e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.271+0000 7f6c4f43e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:33:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.271+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94274761163520 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0da6d0b0 con 0x55be0da21d20 2024-05-08T18:33:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.271+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== watch-notify(notify (1) cookie 94274760935120 notify 124554051603 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55be0da68bc0 con 0x55be0da21d20 2024-05-08T18:33:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.271+0000 7f6b2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051603 cookie 94274760935120 notifier 4823 bl.length()=649 2024-05-08T18:33:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.271+0000 7f6b2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.271+0000 7f6b2dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.271+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.4 [notify cookie 94274761163520 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.271+0000 7f6b2dffb640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6b10003ea0 con 0x55be0da21d20 2024-05-08T18:33:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.272+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.272+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== watch-notify(notify_complete (2) cookie 94274761163520 notify 124554051603 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55be0da69290 con 0x55be0da21d20 2024-05-08T18:33:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.272+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da682b0 con 0x55be0da21d20 2024-05-08T18:33:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.273+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v29'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.273+0000 7f6c4f43e800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-05-08T18:33:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.273+0000 7f6c4f43e800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-08T18:33:04.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.273+0000 7f6c4f43e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-05-08T18:33:04.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.273+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94274761163440 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be0da6d4e0 con 0x55be0da27f70 2024-05-08T18:33:04.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.273+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== watch-notify(notify (1) cookie 94274760925344 notify 124554051594 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55be0da16a20 con 0x55be0da27f70 2024-05-08T18:33:04.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.273+0000 7f6b2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051594 cookie 94274760925344 notifier 4823 bl.length()=177 2024-05-08T18:33:04.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.273+0000 7f6b2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-05-08T18:33:04.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.273+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(68 notify.2 [notify cookie 94274761163440 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c4405f040 con 0x55be0da27f70 2024-05-08T18:33:04.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.273+0000 7f6b2dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-08T18:33:04.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.273+0000 7f6b2dffb640 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6b10003ea0 con 0x55be0da27f70 2024-05-08T18:33:04.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.273+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4405f040 con 0x55be0da27f70 2024-05-08T18:33:04.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.273+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== watch-notify(notify_complete (2) cookie 94274761163440 notify 124554051594 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6c44068020 con 0x55be0da27f70 2024-05-08T18:33:04.292 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:33:04.270799Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:33:04.270781Z","tags":[],"group_ids":[]} 2024-05-08T18:33:04.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.274+0000 7f6b00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:04.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.274+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94274760944384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da6aa50 con 0x55be0da21d20 2024-05-08T18:33:04.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.275+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94274760944384] v29'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.275+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94274760918528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da32ad0 con 0x7f6c44040560 2024-05-08T18:33:04.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.276+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94274760918528] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3c075030 con 0x7f6c44040560 2024-05-08T18:33:04.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.276+0000 7f6c4f43e800 20 remove_watcher() i=0 2024-05-08T18:33:04.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.276+0000 7f6c4f43e800 2 removed watcher, disabling cache 2024-05-08T18:33:04.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.276+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94274760924288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2c600 con 0x55be0da21d20 2024-05-08T18:33:04.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.278+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94274760924288] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.278+0000 7f6c4f43e800 20 remove_watcher() i=1 2024-05-08T18:33:04.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.278+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94274760925344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2c600 con 0x55be0da27f70 2024-05-08T18:33:04.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.279+0000 7f6c4a8cf640 1 -- 172.21.15.87:0/945074808 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94274760925344] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4406a040 con 0x55be0da27f70 2024-05-08T18:33:04.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.279+0000 7f6c4f43e800 20 remove_watcher() i=2 2024-05-08T18:33:04.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.279+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94274760931616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2c600 con 0x7f6c44040560 2024-05-08T18:33:04.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.280+0000 7f6c4a0ce640 1 -- 172.21.15.87:0/945074808 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94274760931616] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3c075030 con 0x7f6c44040560 2024-05-08T18:33:04.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.280+0000 7f6c4f43e800 20 remove_watcher() i=3 2024-05-08T18:33:04.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.280+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94274760935120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2c600 con 0x55be0da21d20 2024-05-08T18:33:04.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.281+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94274760935120] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x55be0da21d20 2024-05-08T18:33:04.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.281+0000 7f6c4f43e800 20 remove_watcher() i=4 2024-05-08T18:33:04.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.281+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94274760938752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2c600 con 0x7f6c3c0a1040 2024-05-08T18:33:04.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.282+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94274760938752] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.282+0000 7f6c4f43e800 20 remove_watcher() i=5 2024-05-08T18:33:04.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.282+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94274760930048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2c600 con 0x7f6c3c0a1040 2024-05-08T18:33:04.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.283+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94274760930048] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.283+0000 7f6c4f43e800 20 remove_watcher() i=6 2024-05-08T18:33:04.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.283+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94274760941904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be0da2f300 con 0x7f6c3c0a1040 2024-05-08T18:33:04.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.284+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94274760941904] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3402b040 con 0x7f6c3c0a1040 2024-05-08T18:33:04.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.284+0000 7f6c4f43e800 20 remove_watcher() i=7 2024-05-08T18:33:04.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.284+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6c3c0a1040 msgr2=0x7f6c3c0946e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.284+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6c3c0a1040 0x7f6c3c0946e0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.284+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55be0da21d20 msgr2=0x55be0da241e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.284+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55be0da21d20 0x55be0da241e0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.284+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6c44040560 msgr2=0x7f6c440409e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.284+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f6c44040560 0x7f6c440409e0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.284+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55be0da27f70 msgr2=0x55be0da2a3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.284+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55be0da27f70 0x55be0da2a3a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6b1403bba0 msgr2=0x7f6b1403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6b1403bba0 0x7f6b1403e060 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c094330 tx=0x7f6c3c086000 comp rx=0 tx=0).stop 2024-05-08T18:33:04.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9e44c0 msgr2=0x55be0da16250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/945074808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9e44c0 0x55be0da16250 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6c44052ca0 tx=0x7f6c440529f0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 reap_dead start 2024-05-08T18:33:04.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c418cd640 1 -- 172.21.15.87:0/945074808 reap_dead start 2024-05-08T18:33:04.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 shutdown_connections 2024-05-08T18:33:04.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 >> 172.21.15.87:0/945074808 conn(0x55be0da08e80 msgr2=0x55be0da064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 shutdown_connections 2024-05-08T18:33:04.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 -- 172.21.15.87:0/945074808 wait complete. 2024-05-08T18:33:04.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2855091912 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6b2403bba0 msgr2=0x7f6b2403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/2855091912 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6b2403bba0 0x7f6b2403e060 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55be0d9ecfa0 tx=0x7f6c3c006a30 comp rx=0 tx=0).stop 2024-05-08T18:33:04.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2855091912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9ff880 msgr2=0x55be0d9ffca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/2855091912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9ff880 0x55be0d9ffca0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x55be0d9ebed0 tx=0x7f6c440178e0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2855091912 shutdown_connections 2024-05-08T18:33:04.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/2855091912 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6b2403bba0 0x7f6b2403e060 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/2855091912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d9ff880 0x55be0d9ffca0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2855091912 >> 172.21.15.87:0/2855091912 conn(0x55be0d9f3920 msgr2=0x55be0d9f3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2855091912 shutdown_connections 2024-05-08T18:33:04.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2855091912 wait complete. 2024-05-08T18:33:04.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2464773319 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55be0d9eeb10 msgr2=0x55be0d9f0f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55be0d9eeb10 0x55be0d9f0f00 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2464773319 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55be0d8eb3e0 msgr2=0x55be0d9eb4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55be0d8eb3e0 0x55be0d9eb4d0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2464773319 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6b3003bb50 msgr2=0x7f6b3003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6b3003bb50 0x7f6b3003e010 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6c34001e10 tx=0x7f6c34001390 comp rx=0 tx=0).stop 2024-05-08T18:33:04.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2464773319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 msgr2=0x55be0d85e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.285+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 0x55be0d85e340 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c01d050 tx=0x7f6c3c003020 comp rx=0 tx=0).stop 2024-05-08T18:33:04.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.286+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2464773319 shutdown_connections 2024-05-08T18:33:04.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.286+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55be0d8eb3e0 0x55be0d9eb4d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.286+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55be0d9eeb10 0x55be0d9f0f00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.286+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f6b3003bb50 0x7f6b3003e010 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.286+0000 7f6c4f43e800 1 --2- 172.21.15.87:0/2464773319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be0d8ea180 0x55be0d85e340 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.286+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2464773319 >> 172.21.15.87:0/2464773319 conn(0x55be0d8e5760 msgr2=0x55be0d9d58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.286+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2464773319 shutdown_connections 2024-05-08T18:33:04.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.286+0000 7f6c4f43e800 1 -- 172.21.15.87:0/2464773319 wait complete. 2024-05-08T18:33:04.304 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:04.304 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:04.304 ERROR:root:0 2024-05-08T18:33:04.305 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:33:04.312 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000003f897ecf39a39af3-00663bc560-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:33:04.312 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-05-08T18:33:04.323 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:04.324 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-05-08T18:33:04.337 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-05-08T18:33:04.338 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-05-08T18:33:04.354 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-05-08T18:33:04.354 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-05-08T18:33:04.363 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-05-08T18:33:04.364 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:33:04.367 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:04.367 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-05-08T18:33:04.371 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:04.371 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:33:04.372 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:33:04.372 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-05-08T18:33:04.418 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:04.418 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:04.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.421+0000 7f14ed40f800 1 Processor -- start 2024-05-08T18:33:04.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.421+0000 7f14ed40f800 1 -- start start 2024-05-08T18:33:04.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.421+0000 7f14ed40f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563ff727e760 0x563ff7280b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.421+0000 7f14ed40f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563ff7281120 con 0x563ff7278540 2024-05-08T18:33:04.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.421+0000 7f14ed40f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x563ff711ae20 con 0x563ff727e760 2024-05-08T18:33:04.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.421+0000 7f14e81d4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563ff727e760 0x563ff7280b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.421+0000 7f14e89d5640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x563ff7278540 0x563ff7278960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58190/0 (socket says 172.21.15.87:58190) 2024-05-08T18:33:04.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.421+0000 7f14e89d5640 1 -- 172.21.15.87:0/1876167323 learned_addr learned my addr 172.21.15.87:0/1876167323 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:33:04.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.421+0000 7f14e81d4640 1 --2- 172.21.15.87:0/1876167323 >> v2:172.21.15.53:3300/0 conn(0x563ff727e760 0x563ff7280b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52486/0 (socket says 172.21.15.87:52486) 2024-05-08T18:33:04.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.421+0000 7f14e81d4640 1 -- 172.21.15.87:0/1876167323 >> v1:172.21.15.53:6789/0 conn(0x563ff7278540 legacy=0x563ff7278960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.421+0000 7f14e81d4640 1 -- 172.21.15.87:0/1876167323 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff7282300 con 0x563ff727e760 2024-05-08T18:33:04.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.423+0000 7f14e81d4640 1 --2- 172.21.15.87:0/1876167323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff727e760 0x563ff7280b50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00a470 tx=0x7f14dc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b20473c3bc99f00 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.423+0000 7f14e79d3640 1 -- 172.21.15.87:0/1876167323 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14dc057070 con 0x563ff727e760 2024-05-08T18:33:04.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.424+0000 7f14e79d3640 1 -- 172.21.15.87:0/1876167323 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14dc052570 con 0x563ff727e760 2024-05-08T18:33:04.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.424+0000 7f14e79d3640 1 -- 172.21.15.87:0/1876167323 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14dc052870 con 0x563ff727e760 2024-05-08T18:33:04.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.424+0000 7f14ed40f800 1 -- 172.21.15.87:0/1876167323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff727e760 msgr2=0x563ff7280b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.424+0000 7f14ed40f800 1 --2- 172.21.15.87:0/1876167323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff727e760 0x563ff7280b50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00a470 tx=0x7f14dc01ce90 comp rx=0 tx=0).stop 2024-05-08T18:33:04.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.424+0000 7f14ed40f800 1 -- 172.21.15.87:0/1876167323 shutdown_connections 2024-05-08T18:33:04.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.424+0000 7f14ed40f800 1 --2- 172.21.15.87:0/1876167323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff727e760 0x563ff7280b50 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.424+0000 7f14ed40f800 1 -- 172.21.15.87:0/1876167323 >> 172.21.15.87:0/1876167323 conn(0x563ff7273eb0 msgr2=0x563ff72762d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.424+0000 7f14ed40f800 1 -- 172.21.15.87:0/1876167323 shutdown_connections 2024-05-08T18:33:04.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.424+0000 7f14ed40f800 1 -- 172.21.15.87:0/1876167323 wait complete. 2024-05-08T18:33:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.438+0000 7f14ed40f800 1 Processor -- start 2024-05-08T18:33:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.438+0000 7f14ed40f800 1 -- start start 2024-05-08T18:33:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.438+0000 7f14ed40f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff7278540 0x563ff736b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.438+0000 7f14ed40f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563ff71c55c0 con 0x563ff7278540 2024-05-08T18:33:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.438+0000 7f14e89d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff7278540 0x563ff736b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.438+0000 7f14e89d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff7278540 0x563ff736b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52496/0 (socket says 172.21.15.87:52496) 2024-05-08T18:33:04.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.438+0000 7f14e89d5640 1 -- 172.21.15.87:0/591737903 learned_addr learned my addr 172.21.15.87:0/591737903 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.439+0000 7f14e89d5640 1 -- 172.21.15.87:0/591737903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff736bc20 con 0x563ff7278540 2024-05-08T18:33:04.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.439+0000 7f14e89d5640 1 --2- 172.21.15.87:0/591737903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff7278540 0x563ff736b650 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f14d8001d50 tx=0x7f14d800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe1b589572697d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.439+0000 7f13d6e0d640 1 -- 172.21.15.87:0/591737903 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14d8013030 con 0x563ff7278540 2024-05-08T18:33:04.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.439+0000 7f13d6e0d640 1 -- 172.21.15.87:0/591737903 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d800e470 con 0x563ff7278540 2024-05-08T18:33:04.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.439+0000 7f13d6e0d640 1 -- 172.21.15.87:0/591737903 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14d800e810 con 0x563ff7278540 2024-05-08T18:33:04.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.440+0000 7f14ed40f800 1 -- 172.21.15.87:0/591737903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff7278540 msgr2=0x563ff736b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.440+0000 7f14ed40f800 1 --2- 172.21.15.87:0/591737903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff7278540 0x563ff736b650 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f14d8001d50 tx=0x7f14d800b6c0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.440+0000 7f14ed40f800 1 -- 172.21.15.87:0/591737903 shutdown_connections 2024-05-08T18:33:04.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.440+0000 7f14ed40f800 1 --2- 172.21.15.87:0/591737903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff7278540 0x563ff736b650 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.440+0000 7f14ed40f800 1 -- 172.21.15.87:0/591737903 >> 172.21.15.87:0/591737903 conn(0x563ff7273eb0 msgr2=0x563ff7366f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.440+0000 7f14ed40f800 1 -- 172.21.15.87:0/591737903 shutdown_connections 2024-05-08T18:33:04.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.440+0000 7f14ed40f800 1 -- 172.21.15.87:0/591737903 wait complete. 2024-05-08T18:33:04.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.440+0000 7f14ed40f800 1 Processor -- start 2024-05-08T18:33:04.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.440+0000 7f14ed40f800 1 -- start start 2024-05-08T18:33:04.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.440+0000 7f14ed40f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff7278540 0x563ff7373190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.440+0000 7f14ed40f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563ff72815c0 con 0x563ff7278540 2024-05-08T18:33:04.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.440+0000 7f14e89d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff7278540 0x563ff7373190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.441+0000 7f14e89d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff7278540 0x563ff7373190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52504/0 (socket says 172.21.15.87:52504) 2024-05-08T18:33:04.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.441+0000 7f14e89d5640 1 -- 172.21.15.87:0/109264881 learned_addr learned my addr 172.21.15.87:0/109264881 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.441+0000 7f14e89d5640 1 -- 172.21.15.87:0/109264881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff73736d0 con 0x563ff7278540 2024-05-08T18:33:04.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.441+0000 7f14e89d5640 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff7278540 0x563ff7373190 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x563ff736c3e0 tx=0x7f14d8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.441+0000 7f13d560a640 1 -- 172.21.15.87:0/109264881 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14d8027070 con 0x563ff7278540 2024-05-08T18:33:04.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.441+0000 7f14ed40f800 1 -- 172.21.15.87:0/109264881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ff7373960 con 0x563ff7278540 2024-05-08T18:33:04.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.441+0000 7f13d560a640 1 -- 172.21.15.87:0/109264881 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d8019900 con 0x563ff7278540 2024-05-08T18:33:04.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.441+0000 7f14ed40f800 1 -- 172.21.15.87:0/109264881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff7376610 con 0x563ff7278540 2024-05-08T18:33:04.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.441+0000 7f13d560a640 1 -- 172.21.15.87:0/109264881 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14d8019c20 con 0x563ff7278540 2024-05-08T18:33:04.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.442+0000 7f13d560a640 1 -- 172.21.15.87:0/109264881 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f14d802a070 con 0x563ff7278540 2024-05-08T18:33:04.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.442+0000 7f13d560a640 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13d003bb50 0x7f13d003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.442+0000 7f13d560a640 1 -- 172.21.15.87:0/109264881 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f14d801f070 con 0x563ff7278540 2024-05-08T18:33:04.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.442+0000 7f14e81d4640 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13d003bb50 0x7f13d003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.443+0000 7f14ed40f800 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563ff727e760 0x563ff737a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.443+0000 7f14ed40f800 1 -- 172.21.15.87:0/109264881 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff737a910 con 0x563ff727e760 2024-05-08T18:33:04.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.443+0000 7f14e91d6640 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563ff727e760 0x563ff737a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.443+0000 7f14e81d4640 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13d003bb50 0x7f13d003e010 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f14dc054000 tx=0x7f14dc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.443+0000 7f14e91d6640 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563ff727e760 0x563ff737a3d0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.443+0000 7f14e91d6640 1 -- 172.21.15.87:0/109264881 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14e000a4a0 con 0x563ff727e760 2024-05-08T18:33:04.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.443+0000 7f14ed40f800 1 -- 172.21.15.87:0/109264881 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff73779a0 con 0x563ff727e760 2024-05-08T18:33:04.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.444+0000 7f14e91d6640 1 -- 172.21.15.87:0/109264881 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f14e000a4a0 con 0x563ff727e760 2024-05-08T18:33:04.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.444+0000 7f14ed40f800 1 -- 172.21.15.87:0/109264881 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff737c780 con 0x563ff727e760 2024-05-08T18:33:04.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.444+0000 7f14e91d6640 1 -- 172.21.15.87:0/109264881 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f14e000a4a0 con 0x563ff727e760 2024-05-08T18:33:04.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.444+0000 7f14ed40f800 1 -- 172.21.15.87:0/109264881 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff737b8c0 con 0x563ff727e760 2024-05-08T18:33:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.444+0000 7f14e91d6640 1 -- 172.21.15.87:0/109264881 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f14e000a4a0 con 0x563ff727e760 2024-05-08T18:33:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.444+0000 7f14ed40f800 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563ff737c390 0x563ff737fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.444+0000 7f14ed40f800 1 -- 172.21.15.87:0/109264881 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff73803a0 con 0x563ff737c390 2024-05-08T18:33:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.444+0000 7f14e89d5640 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563ff737c390 0x563ff737fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.445+0000 7f14e89d5640 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563ff737c390 0x563ff737fc10 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.445+0000 7f14e89d5640 1 -- 172.21.15.87:0/109264881 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f14d8029030 con 0x563ff737c390 2024-05-08T18:33:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.446+0000 7f14ed40f800 1 Processor -- start 2024-05-08T18:33:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.446+0000 7f14ed40f800 1 -- start start 2024-05-08T18:33:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.446+0000 7f14ed40f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff738e6d0 0x563ff738eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.446+0000 7f14ed40f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563ff716bfc0 con 0x563ff738e6d0 2024-05-08T18:33:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.446+0000 7f14e91d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff738e6d0 0x563ff738eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.446+0000 7f14e91d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff738e6d0 0x563ff738eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52508/0 (socket says 172.21.15.87:52508) 2024-05-08T18:33:04.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.446+0000 7f14e91d6640 1 -- 172.21.15.87:0/1695948966 learned_addr learned my addr 172.21.15.87:0/1695948966 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.446+0000 7f14e91d6640 1 -- 172.21.15.87:0/1695948966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff738f030 con 0x563ff738e6d0 2024-05-08T18:33:04.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.446+0000 7f14e91d6640 1 --2- 172.21.15.87:0/1695948966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff738e6d0 0x563ff738eaf0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x563ff737acf0 tx=0x7f14e00178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.447+0000 7f13ce7fc640 1 -- 172.21.15.87:0/1695948966 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14e0013440 con 0x563ff738e6d0 2024-05-08T18:33:04.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.447+0000 7f13ce7fc640 1 -- 172.21.15.87:0/1695948966 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e00135e0 con 0x563ff738e6d0 2024-05-08T18:33:04.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.447+0000 7f14ed40f800 1 -- 172.21.15.87:0/1695948966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ff738faa0 con 0x563ff738e6d0 2024-05-08T18:33:04.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.447+0000 7f13ce7fc640 1 -- 172.21.15.87:0/1695948966 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14e00138c0 con 0x563ff738e6d0 2024-05-08T18:33:04.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.447+0000 7f14ed40f800 1 -- 172.21.15.87:0/1695948966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff738ffa0 con 0x563ff738e6d0 2024-05-08T18:33:04.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.447+0000 7f13ce7fc640 1 -- 172.21.15.87:0/1695948966 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f14e0011040 con 0x563ff738e6d0 2024-05-08T18:33:04.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.448+0000 7f13ce7fc640 1 --2- 172.21.15.87:0/1695948966 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13c003bba0 0x7f13c003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.448+0000 7f13ce7fc640 1 -- 172.21.15.87:0/1695948966 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f14e001d070 con 0x563ff738e6d0 2024-05-08T18:33:04.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.448+0000 7f14e89d5640 1 --2- 172.21.15.87:0/1695948966 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13c003bba0 0x7f13c003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.448+0000 7f14ed40f800 1 Processor -- start 2024-05-08T18:33:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.448+0000 7f14e89d5640 1 --2- 172.21.15.87:0/1695948966 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13c003bba0 0x7f13c003e060 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f14d800efd0 tx=0x7f14d802ae80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.448+0000 7f14ed40f800 1 -- start start 2024-05-08T18:33:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.448+0000 7f14ed40f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff739b920 0x563ff739bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.448+0000 7f14ed40f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563ff736bfa0 con 0x563ff739b920 2024-05-08T18:33:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.448+0000 7f14e91d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff739b920 0x563ff739bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.448+0000 7f14e91d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff739b920 0x563ff739bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52510/0 (socket says 172.21.15.87:52510) 2024-05-08T18:33:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.448+0000 7f14e91d6640 1 -- 172.21.15.87:0/1457012349 learned_addr learned my addr 172.21.15.87:0/1457012349 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.449+0000 7f14e91d6640 1 -- 172.21.15.87:0/1457012349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff739c310 con 0x563ff739b920 2024-05-08T18:33:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.449+0000 7f14e91d6640 1 --2- 172.21.15.87:0/1457012349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff739b920 0x563ff739bd40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f14e00528c0 tx=0x7f14e0001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2135ab60106b22c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.449+0000 7f13bffff640 1 -- 172.21.15.87:0/1457012349 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14e004f020 con 0x563ff739b920 2024-05-08T18:33:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.449+0000 7f13bffff640 1 -- 172.21.15.87:0/1457012349 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e0021c40 con 0x563ff739b920 2024-05-08T18:33:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.449+0000 7f13bffff640 1 -- 172.21.15.87:0/1457012349 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14e00512c0 con 0x563ff739b920 2024-05-08T18:33:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.449+0000 7f14ed40f800 1 -- 172.21.15.87:0/1457012349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff739b920 msgr2=0x563ff739bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.449+0000 7f14ed40f800 1 --2- 172.21.15.87:0/1457012349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff739b920 0x563ff739bd40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f14e00528c0 tx=0x7f14e0001e60 comp rx=0 tx=0).stop 2024-05-08T18:33:04.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.449+0000 7f14ed40f800 1 -- 172.21.15.87:0/1457012349 shutdown_connections 2024-05-08T18:33:04.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.449+0000 7f14ed40f800 1 --2- 172.21.15.87:0/1457012349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff739b920 0x563ff739bd40 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.449+0000 7f14ed40f800 1 -- 172.21.15.87:0/1457012349 >> 172.21.15.87:0/1457012349 conn(0x563ff7397c30 msgr2=0x563ff7395ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.449+0000 7f14ed40f800 1 -- 172.21.15.87:0/1457012349 shutdown_connections 2024-05-08T18:33:04.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.449+0000 7f14ed40f800 1 -- 172.21.15.87:0/1457012349 wait complete. 2024-05-08T18:33:04.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.450+0000 7f14ed40f800 1 Processor -- start 2024-05-08T18:33:04.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.450+0000 7f14ed40f800 1 -- start start 2024-05-08T18:33:04.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.450+0000 7f14ed40f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff739b920 0x563ff727ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.450+0000 7f14ed40f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563ff739cae0 con 0x563ff739b920 2024-05-08T18:33:04.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.450+0000 7f14e91d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff739b920 0x563ff727ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.450+0000 7f14e91d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff739b920 0x563ff727ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52512/0 (socket says 172.21.15.87:52512) 2024-05-08T18:33:04.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.450+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 learned_addr learned my addr 172.21.15.87:0/4025791538 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.450+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff7279560 con 0x563ff739b920 2024-05-08T18:33:04.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.451+0000 7f14e91d6640 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff739b920 0x563ff727ae70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f14e0001990 tx=0x7f14e0018f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.451+0000 7f13be7fc640 1 -- 172.21.15.87:0/4025791538 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14e0030070 con 0x563ff739b920 2024-05-08T18:33:04.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.451+0000 7f13be7fc640 1 -- 172.21.15.87:0/4025791538 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e0013a60 con 0x563ff739b920 2024-05-08T18:33:04.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.451+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ff72797f0 con 0x563ff739b920 2024-05-08T18:33:04.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.451+0000 7f13be7fc640 1 -- 172.21.15.87:0/4025791538 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14e0015af0 con 0x563ff739b920 2024-05-08T18:33:04.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.451+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff7279c90 con 0x563ff739b920 2024-05-08T18:33:04.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.452+0000 7f13be7fc640 1 -- 172.21.15.87:0/4025791538 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f14e0033070 con 0x563ff739b920 2024-05-08T18:33:04.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.452+0000 7f13be7fc640 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13b403bba0 0x7f13b403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.452+0000 7f13be7fc640 1 -- 172.21.15.87:0/4025791538 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f14e000e040 con 0x563ff739b920 2024-05-08T18:33:04.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.452+0000 7f14e89d5640 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13b403bba0 0x7f13b403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.452+0000 7f14e89d5640 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13b403bba0 0x7f13b403e060 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f14d804a790 tx=0x7f14d8046000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.452+0000 7f14ed40f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.452+0000 7f14ed40f800 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563ff73b0d60 0x563ff73b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.452+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b3970 con 0x563ff73b0d60 2024-05-08T18:33:04.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.452+0000 7f14e81d4640 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563ff73b0d60 0x563ff73b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.453+0000 7f14e81d4640 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563ff73b0d60 0x563ff73b3220 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.453+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.453+0000 7f14ed40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.453+0000 7f14ed40f800 20 realm 2024-05-08T18:33:04.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.453+0000 7f14ed40f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.453+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b3d40 con 0x563ff73b0d60 2024-05-08T18:33:04.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.453+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.453+0000 7f14ed40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.453+0000 7f14ed40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:04.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.453+0000 7f14ed40f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.453+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b4610 con 0x563ff73b0d60 2024-05-08T18:33:04.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.453+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.453+0000 7f14ed40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.453+0000 7f14ed40f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.453+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b49b0 con 0x563ff73b0d60 2024-05-08T18:33:04.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.454+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.454+0000 7f14ed40f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:04.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.454+0000 7f14ed40f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.454+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b5200 con 0x563ff73b0d60 2024-05-08T18:33:04.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.454+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.454+0000 7f14ed40f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:04.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.454+0000 7f14ed40f800 20 searching for the correct realm 2024-05-08T18:33:04.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.454+0000 7f14ed40f800 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563ff73b6f70 0x563ff73b9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.454+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x563ff73b6f70 2024-05-08T18:33:04.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.454+0000 7f14e91d6640 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563ff73b6f70 0x563ff73b9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.454+0000 7f14e91d6640 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563ff73b6f70 0x563ff73b9360 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.455+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e003c070 con 0x563ff73b6f70 2024-05-08T18:33:04.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.455+0000 7f14e91d6640 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f14e0035070 0x7f14e0022420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.455+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x7f14e0035070 2024-05-08T18:33:04.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.455+0000 7f14e89d5640 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f14e0035070 0x7f14e0022420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.455+0000 7f14e89d5640 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f14e0035070 0x7f14e0022420 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.455+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14d8029030 con 0x7f14e0035070 2024-05-08T18:33:04.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.455+0000 7f14e89d5640 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f14d802c060 0x7f14d802a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.455+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x7f14d802c060 2024-05-08T18:33:04.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.456+0000 7f14e81d4640 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f14d802c060 0x7f14d802a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.456+0000 7f14e81d4640 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f14d802c060 0x7f14d802a580 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.456+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.456+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x563ff73b0d60 2024-05-08T18:33:04.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.457+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.457+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x563ff73b0d60 2024-05-08T18:33:04.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.457+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.457+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x7f14d802c060 2024-05-08T18:33:04.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.457+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.457+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x7f14d802c060 2024-05-08T18:33:04.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.457+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.457+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x7f14e0035070 2024-05-08T18:33:04.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.458+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14d8029030 con 0x7f14e0035070 2024-05-08T18:33:04.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.458+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x563ff73b6f70 2024-05-08T18:33:04.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.458+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e003c070 con 0x563ff73b6f70 2024-05-08T18:33:04.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.458+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x563ff73b0d60 2024-05-08T18:33:04.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.458+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.458+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x7f14d802c060 2024-05-08T18:33:04.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.458+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.458+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x563ff73b0d60 2024-05-08T18:33:04.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.459+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.459+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x7f14e0035070 2024-05-08T18:33:04.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.459+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f14d8029030 con 0x7f14e0035070 2024-05-08T18:33:04.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.459+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x563ff73b6f70 2024-05-08T18:33:04.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.459+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e003c070 con 0x563ff73b6f70 2024-05-08T18:33:04.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.459+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x563ff73b6f70 2024-05-08T18:33:04.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.459+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e003c070 con 0x563ff73b6f70 2024-05-08T18:33:04.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.459+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x7f14d802c060 2024-05-08T18:33:04.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.460+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.460+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x563ff73b6f70 2024-05-08T18:33:04.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.460+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e003c070 con 0x563ff73b6f70 2024-05-08T18:33:04.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.460+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x563ff73b6f70 2024-05-08T18:33:04.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.460+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e003c070 con 0x563ff73b6f70 2024-05-08T18:33:04.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.460+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x563ff73b0d60 2024-05-08T18:33:04.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.460+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.460+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x563ff73b0d60 2024-05-08T18:33:04.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.461+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v29'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.461+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x7f14d802c060 2024-05-08T18:33:04.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.461+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.461+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x563ff73b6f70 2024-05-08T18:33:04.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.461+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e003c070 con 0x563ff73b6f70 2024-05-08T18:33:04.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.461+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x7f14e0035070 2024-05-08T18:33:04.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.461+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14d8029030 con 0x7f14e0035070 2024-05-08T18:33:04.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.461+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x563ff73b0d60 2024-05-08T18:33:04.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.462+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.462+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x7f14d802c060 2024-05-08T18:33:04.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.462+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.462+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x563ff73b6f70 2024-05-08T18:33:04.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.462+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e003c070 con 0x563ff73b6f70 2024-05-08T18:33:04.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.462+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x7f14e0035070 2024-05-08T18:33:04.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.462+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14d8029030 con 0x7f14e0035070 2024-05-08T18:33:04.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.462+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x7f14e0035070 2024-05-08T18:33:04.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.463+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14d8029030 con 0x7f14e0035070 2024-05-08T18:33:04.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.463+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x563ff73b6f70 2024-05-08T18:33:04.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.463+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e003c070 con 0x563ff73b6f70 2024-05-08T18:33:04.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.463+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x7f14e0035070 2024-05-08T18:33:04.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.463+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14d8029030 con 0x7f14e0035070 2024-05-08T18:33:04.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.463+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x563ff73b0d60 2024-05-08T18:33:04.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.463+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.463+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b98f0 con 0x7f14e0035070 2024-05-08T18:33:04.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14d8029030 con 0x7f14e0035070 2024-05-08T18:33:04.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:04.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:04.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:04.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:04.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:04.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:04.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b5b80 con 0x563ff73b0d60 2024-05-08T18:33:04.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b6420 con 0x563ff73b0d60 2024-05-08T18:33:04.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:04.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff73b9d70 con 0x7f14d802c060 2024-05-08T18:33:04.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:04.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 20 zone default found 2024-05-08T18:33:04.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 4 Realm: () 2024-05-08T18:33:04.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:04.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:04.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:04.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 20 zonegroup default 2024-05-08T18:33:04.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.464+0000 7f14ed40f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.465+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff73ba220 con 0x7f14d802c060 2024-05-08T18:33:04.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.465+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.465+0000 7f14ed40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.465+0000 7f14ed40f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.465+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff73bbc00 con 0x563ff73b6f70 2024-05-08T18:33:04.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.465+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f14e003c070 con 0x563ff73b6f70 2024-05-08T18:33:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.465+0000 7f14ed40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.465+0000 7f14ed40f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.465+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff73bc0a0 con 0x563ff73b6f70 2024-05-08T18:33:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.465+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f14e003c070 con 0x563ff73b6f70 2024-05-08T18:33:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.465+0000 7f14ed40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.465+0000 7f14ed40f800 20 started sync module instance, tier type = 2024-05-08T18:33:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.465+0000 7f14ed40f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.465+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73bb090 con 0x7f14e0035070 2024-05-08T18:33:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.466+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14d8029030 con 0x7f14e0035070 2024-05-08T18:33:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.466+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94832730813568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73bacf0 con 0x7f14e0035070 2024-05-08T18:33:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.466+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73bcfd0 con 0x563ff73b0d60 2024-05-08T18:33:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.467+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94832730813568] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14d8029030 con 0x7f14e0035070 2024-05-08T18:33:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.468+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.468+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94832730819360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73bcf40 con 0x563ff73b0d60 2024-05-08T18:33:04.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.468+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73bde90 con 0x563ff73b6f70 2024-05-08T18:33:04.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.469+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14e003c070 con 0x563ff73b6f70 2024-05-08T18:33:04.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.469+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94832730823136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73bde40 con 0x563ff73b6f70 2024-05-08T18:33:04.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.469+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73bee30 con 0x7f14e0035070 2024-05-08T18:33:04.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.469+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94832730819360] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.470+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94832730823136] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14e003c070 con 0x563ff73b6f70 2024-05-08T18:33:04.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.470+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14d8029030 con 0x7f14e0035070 2024-05-08T18:33:04.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.470+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94832730827008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73be280 con 0x7f14e0035070 2024-05-08T18:33:04.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.470+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73bf710 con 0x563ff73b0d60 2024-05-08T18:33:04.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.471+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94832730827008] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14d8029030 con 0x7f14e0035070 2024-05-08T18:33:04.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.471+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.471+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94832730829344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73bfb00 con 0x563ff73b0d60 2024-05-08T18:33:04.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.471+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73c0500 con 0x7f14d802c060 2024-05-08T18:33:04.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.472+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.472+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94832730829344] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.472+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94832730832912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73c0430 con 0x7f14d802c060 2024-05-08T18:33:04.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.472+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73c0f10 con 0x7f14d802c060 2024-05-08T18:33:04.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.473+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94832730832912] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.474+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.474+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94832730821488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73c0f10 con 0x7f14d802c060 2024-05-08T18:33:04.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.474+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73c1910 con 0x7f14d802c060 2024-05-08T18:33:04.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.475+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94832730821488] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.475+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.475+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94832730838048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73c1af0 con 0x7f14d802c060 2024-05-08T18:33:04.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.475+0000 7f14ed40f800 20 add_watcher() i=0 2024-05-08T18:33:04.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.475+0000 7f14ed40f800 20 add_watcher() i=1 2024-05-08T18:33:04.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.475+0000 7f14ed40f800 20 add_watcher() i=2 2024-05-08T18:33:04.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.475+0000 7f14ed40f800 20 add_watcher() i=3 2024-05-08T18:33:04.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.475+0000 7f14ed40f800 20 add_watcher() i=4 2024-05-08T18:33:04.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.475+0000 7f14ed40f800 20 add_watcher() i=5 2024-05-08T18:33:04.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.475+0000 7f14ed40f800 20 add_watcher() i=6 2024-05-08T18:33:04.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.475+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94832730838048] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.476+0000 7f14ed40f800 20 add_watcher() i=7 2024-05-08T18:33:04.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.476+0000 7f14ed40f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:04.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.476+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff73c4ec0 con 0x563ff73b0d60 2024-05-08T18:33:04.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.476+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.476+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94832730839520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73c22b0 con 0x563ff73b0d60 2024-05-08T18:33:04.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.477+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94832730839520] v29'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.477+0000 7f139f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:04.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.477+0000 7f14ed40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:04.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.477+0000 7f14ed40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:04.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.477+0000 7f14ed40f800 5 note: GC not initialized 2024-05-08T18:33:04.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.477+0000 7f139e7e4640 20 reqs_thread_entry: start 2024-05-08T18:33:04.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.478+0000 7f14ed40f800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:04.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.478+0000 7f14ed40f800 20 Filter name: none 2024-05-08T18:33:04.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.478+0000 7f1397fff640 20 reqs_thread_entry: start 2024-05-08T18:33:04.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.478+0000 7f14ed40f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:33:04.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.478+0000 7f14ed40f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.478+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff73f81a0 con 0x7f14d802c060 2024-05-08T18:33:04.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.479+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.479+0000 7f14ed40f800 20 rados_obj.operate() r=0 bl.length=473 2024-05-08T18:33:04.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.479+0000 7f14ed40f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:33:04.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.479+0000 7f14ed40f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:04.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.479+0000 7f14ed40f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:33:04.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.479+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73fea00 con 0x7f14d802c060 2024-05-08T18:33:04.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.480+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v29'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.480+0000 7f14ed40f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:04.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.480+0000 7f14ed40f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:04.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.480+0000 7f14ed40f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:33:04.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.480+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94832731087808 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563ff73fa000 con 0x563ff73b0d60 2024-05-08T18:33:04.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.480+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== watch-notify(notify (1) cookie 94832730829344 notify 124554051605 ret 0) ==== 678+0+0 (crc 0 0 0) 0x563ff7282300 con 0x563ff73b0d60 2024-05-08T18:33:04.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.480+0000 7f13bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051605 cookie 94832730829344 notifier 4830 bl.length()=636 2024-05-08T18:33:04.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.480+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 notify.4 [notify cookie 94832731087808 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.480+0000 7f13bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:04.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.480+0000 7f13bffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:04.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.480+0000 7f13bffff640 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f13ac003ea0 con 0x563ff73b0d60 2024-05-08T18:33:04.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.480+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.480+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== watch-notify(notify_complete (2) cookie 94832731087808 notify 124554051605 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f14dc05de00 con 0x563ff73b0d60 2024-05-08T18:33:04.496 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:33:04.270799Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:33:04.270781Z","tags":[],"group_ids":[]} 2024-05-08T18:33:04.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.481+0000 7f139f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:04.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.481+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94832730839520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73fcff0 con 0x563ff73b0d60 2024-05-08T18:33:04.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.482+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94832730839520] v29'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.482+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94832730813568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73c19e0 con 0x7f14e0035070 2024-05-08T18:33:04.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.483+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94832730813568] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14d8029030 con 0x7f14e0035070 2024-05-08T18:33:04.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.483+0000 7f14ed40f800 20 remove_watcher() i=0 2024-05-08T18:33:04.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.483+0000 7f14ed40f800 2 removed watcher, disabling cache 2024-05-08T18:33:04.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.483+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94832730819360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73c19e0 con 0x563ff73b0d60 2024-05-08T18:33:04.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.484+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94832730819360] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.484+0000 7f14ed40f800 20 remove_watcher() i=1 2024-05-08T18:33:04.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.484+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94832730823136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73bcb20 con 0x563ff73b6f70 2024-05-08T18:33:04.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.485+0000 7f14e91d6640 1 -- 172.21.15.87:0/4025791538 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94832730823136] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14e003c070 con 0x563ff73b6f70 2024-05-08T18:33:04.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.485+0000 7f14ed40f800 20 remove_watcher() i=2 2024-05-08T18:33:04.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.485+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94832730827008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73c19e0 con 0x7f14e0035070 2024-05-08T18:33:04.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.486+0000 7f14e89d5640 1 -- 172.21.15.87:0/4025791538 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94832730827008] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14d8029030 con 0x7f14e0035070 2024-05-08T18:33:04.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.486+0000 7f14ed40f800 20 remove_watcher() i=3 2024-05-08T18:33:04.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.486+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94832730829344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73bd9e0 con 0x563ff73b0d60 2024-05-08T18:33:04.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.488+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94832730829344] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x563ff73b0d60 2024-05-08T18:33:04.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.488+0000 7f14ed40f800 20 remove_watcher() i=4 2024-05-08T18:33:04.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.488+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94832730832912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73bcb20 con 0x7f14d802c060 2024-05-08T18:33:04.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.489+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94832730832912] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.489+0000 7f14ed40f800 20 remove_watcher() i=5 2024-05-08T18:33:04.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.489+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94832730821488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73c19e0 con 0x7f14d802c060 2024-05-08T18:33:04.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.490+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94832730821488] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.490+0000 7f14ed40f800 20 remove_watcher() i=6 2024-05-08T18:33:04.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.490+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94832730838048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563ff73bf220 con 0x7f14d802c060 2024-05-08T18:33:04.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.491+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94832730838048] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14dc05a040 con 0x7f14d802c060 2024-05-08T18:33:04.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.491+0000 7f14ed40f800 20 remove_watcher() i=7 2024-05-08T18:33:04.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.491+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f14d802c060 msgr2=0x7f14d802a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.491+0000 7f14ed40f800 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f14d802c060 0x7f14d802a580 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.491+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563ff73b0d60 msgr2=0x563ff73b3220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.491+0000 7f14ed40f800 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563ff73b0d60 0x563ff73b3220 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.491+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f14e0035070 msgr2=0x7f14e0022420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.491+0000 7f14ed40f800 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f14e0035070 0x7f14e0022420 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.491+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563ff73b6f70 msgr2=0x563ff73b9360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.491+0000 7f14ed40f800 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563ff73b6f70 0x563ff73b9360 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.491+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13b403bba0 msgr2=0x7f13b403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.491+0000 7f14ed40f800 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13b403bba0 0x7f13b403e060 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f14d804a790 tx=0x7f14d8046000 comp rx=0 tx=0).stop 2024-05-08T18:33:04.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.491+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff739b920 msgr2=0x563ff727ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.491+0000 7f14ed40f800 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff739b920 0x563ff727ae70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f14e0001990 tx=0x7f14e0018f90 comp rx=0 tx=0).stop 2024-05-08T18:33:04.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.491+0000 7f14e81d4640 1 -- 172.21.15.87:0/4025791538 reap_dead start 2024-05-08T18:33:04.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 shutdown_connections 2024-05-08T18:33:04.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 --2- 172.21.15.87:0/4025791538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff739b920 0x563ff727ae70 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 >> 172.21.15.87:0/4025791538 conn(0x563ff7397c30 msgr2=0x563ff73952e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 shutdown_connections 2024-05-08T18:33:04.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 -- 172.21.15.87:0/4025791538 wait complete. 2024-05-08T18:33:04.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 -- 172.21.15.87:0/1695948966 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13c003bba0 msgr2=0x7f13c003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 --2- 172.21.15.87:0/1695948966 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13c003bba0 0x7f13c003e060 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f14d800efd0 tx=0x7f14d802ae80 comp rx=0 tx=0).stop 2024-05-08T18:33:04.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 -- 172.21.15.87:0/1695948966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff738e6d0 msgr2=0x563ff738eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 --2- 172.21.15.87:0/1695948966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff738e6d0 0x563ff738eaf0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x563ff737acf0 tx=0x7f14e00178e0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 -- 172.21.15.87:0/1695948966 shutdown_connections 2024-05-08T18:33:04.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 --2- 172.21.15.87:0/1695948966 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13c003bba0 0x7f13c003e060 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 --2- 172.21.15.87:0/1695948966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff738e6d0 0x563ff738eaf0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 -- 172.21.15.87:0/1695948966 >> 172.21.15.87:0/1695948966 conn(0x563ff7382770 msgr2=0x563ff7382b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 -- 172.21.15.87:0/1695948966 shutdown_connections 2024-05-08T18:33:04.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 -- 172.21.15.87:0/1695948966 wait complete. 2024-05-08T18:33:04.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 -- 172.21.15.87:0/109264881 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563ff737c390 msgr2=0x563ff737fc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563ff737c390 0x563ff737fc10 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 -- 172.21.15.87:0/109264881 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563ff727e760 msgr2=0x563ff737a3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563ff727e760 0x563ff737a3d0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 -- 172.21.15.87:0/109264881 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13d003bb50 msgr2=0x7f13d003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13d003bb50 0x7f13d003e010 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f14dc054000 tx=0x7f14dc04e000 comp rx=0 tx=0).stop 2024-05-08T18:33:04.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 -- 172.21.15.87:0/109264881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff7278540 msgr2=0x563ff7373190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff7278540 0x563ff7373190 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x563ff736c3e0 tx=0x7f14d8000bc0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 -- 172.21.15.87:0/109264881 shutdown_connections 2024-05-08T18:33:04.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563ff727e760 0x563ff737a3d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563ff737c390 0x563ff737fc10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13d003bb50 0x7f13d003e010 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 --2- 172.21.15.87:0/109264881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff7278540 0x563ff7373190 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.492+0000 7f14ed40f800 1 -- 172.21.15.87:0/109264881 >> 172.21.15.87:0/109264881 conn(0x563ff7273eb0 msgr2=0x563ff7365770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.493+0000 7f14ed40f800 1 -- 172.21.15.87:0/109264881 shutdown_connections 2024-05-08T18:33:04.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.493+0000 7f14ed40f800 1 -- 172.21.15.87:0/109264881 wait complete. 2024-05-08T18:33:04.508 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:04.508 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:04.508 ERROR:root:0 2024-05-08T18:33:04.508 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-05-08T18:33:04.508 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-05-08T18:33:04.509 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-05-08T18:33:04.561 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:04.561 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:04.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.564+0000 7f81a0344800 1 Processor -- start 2024-05-08T18:33:04.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.564+0000 7f81a0344800 1 -- start start 2024-05-08T18:33:04.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.564+0000 7f81a0344800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5559dd9dad10 0x5559dd9dd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.564+0000 7f81a0344800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5559dd9e1150 con 0x5559dd9dd640 2024-05-08T18:33:04.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.564+0000 7f81a0344800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5559dd87ae20 con 0x5559dd9dad10 2024-05-08T18:33:04.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.564+0000 7f819de3c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5559dd9dad10 0x5559dd9dd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.564+0000 7f819de3c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5559dd9dad10 0x5559dd9dd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52528/0 (socket says 172.21.15.87:52528) 2024-05-08T18:33:04.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.564+0000 7f819d63b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5559dd9dd640 0x5559dd9dfa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58192/0 (socket says 172.21.15.87:58192) 2024-05-08T18:33:04.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.564+0000 7f819de3c640 1 -- 172.21.15.87:0/3243612516 learned_addr learned my addr 172.21.15.87:0/3243612516 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.564+0000 7f819de3c640 1 -- 172.21.15.87:0/3243612516 >> v1:172.21.15.53:6789/0 conn(0x5559dd9dd640 legacy=0x5559dd9dfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.564+0000 7f819de3c640 1 -- 172.21.15.87:0/3243612516 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559dd9e2330 con 0x5559dd9dad10 2024-05-08T18:33:04.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.566+0000 7f819de3c640 1 --2- 172.21.15.87:0/3243612516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 0x5559dd9dd100 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f819000a520 tx=0x7f819001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b558161e7ecac785 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.566+0000 7f819ce3a640 1 -- 172.21.15.87:0/3243612516 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8190057070 con 0x5559dd9dad10 2024-05-08T18:33:04.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.566+0000 7f819ce3a640 1 -- 172.21.15.87:0/3243612516 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8190052570 con 0x5559dd9dad10 2024-05-08T18:33:04.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.566+0000 7f819ce3a640 1 -- 172.21.15.87:0/3243612516 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f819004ae60 con 0x5559dd9dad10 2024-05-08T18:33:04.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.567+0000 7f81a0344800 1 -- 172.21.15.87:0/3243612516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 msgr2=0x5559dd9dd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.567+0000 7f81a0344800 1 --2- 172.21.15.87:0/3243612516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 0x5559dd9dd100 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f819000a520 tx=0x7f819001d010 comp rx=0 tx=0).stop 2024-05-08T18:33:04.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.567+0000 7f81a0344800 1 -- 172.21.15.87:0/3243612516 shutdown_connections 2024-05-08T18:33:04.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.567+0000 7f81a0344800 1 --2- 172.21.15.87:0/3243612516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 0x5559dd9dd100 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.567+0000 7f81a0344800 1 -- 172.21.15.87:0/3243612516 >> 172.21.15.87:0/3243612516 conn(0x5559dd9d46e0 msgr2=0x5559dd9d6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.567+0000 7f81a0344800 1 -- 172.21.15.87:0/3243612516 shutdown_connections 2024-05-08T18:33:04.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.567+0000 7f81a0344800 1 -- 172.21.15.87:0/3243612516 wait complete. 2024-05-08T18:33:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.580+0000 7f81a0344800 1 Processor -- start 2024-05-08T18:33:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.580+0000 7f81a0344800 1 -- start start 2024-05-08T18:33:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.581+0000 7f81a0344800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 0x5559dd9da650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.581+0000 7f81a0344800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5559dd9256b0 con 0x5559dd9dad10 2024-05-08T18:33:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.581+0000 7f819de3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 0x5559dd9da650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.581+0000 7f819de3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 0x5559dd9da650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52540/0 (socket says 172.21.15.87:52540) 2024-05-08T18:33:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.581+0000 7f819de3c640 1 -- 172.21.15.87:0/345226257 learned_addr learned my addr 172.21.15.87:0/345226257 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.581+0000 7f819de3c640 1 -- 172.21.15.87:0/345226257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559dd9d8c10 con 0x5559dd9dad10 2024-05-08T18:33:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.581+0000 7f819de3c640 1 --2- 172.21.15.87:0/345226257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 0x5559dd9da650 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f819001d050 tx=0x7f819004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622ea6df40e2066a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.581+0000 7f808be07640 1 -- 172.21.15.87:0/345226257 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8190057040 con 0x5559dd9dad10 2024-05-08T18:33:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.581+0000 7f808be07640 1 -- 172.21.15.87:0/345226257 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8190052720 con 0x5559dd9dad10 2024-05-08T18:33:04.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.581+0000 7f808be07640 1 -- 172.21.15.87:0/345226257 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8190052a40 con 0x5559dd9dad10 2024-05-08T18:33:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.582+0000 7f81a0344800 1 -- 172.21.15.87:0/345226257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 msgr2=0x5559dd9da650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.582+0000 7f81a0344800 1 --2- 172.21.15.87:0/345226257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 0x5559dd9da650 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f819001d050 tx=0x7f819004c000 comp rx=0 tx=0).stop 2024-05-08T18:33:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.582+0000 7f81a0344800 1 -- 172.21.15.87:0/345226257 shutdown_connections 2024-05-08T18:33:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.582+0000 7f81a0344800 1 --2- 172.21.15.87:0/345226257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 0x5559dd9da650 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.582+0000 7f81a0344800 1 -- 172.21.15.87:0/345226257 >> 172.21.15.87:0/345226257 conn(0x5559dd9d46e0 msgr2=0x5559ddac6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.582+0000 7f81a0344800 1 -- 172.21.15.87:0/345226257 shutdown_connections 2024-05-08T18:33:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.582+0000 7f81a0344800 1 -- 172.21.15.87:0/345226257 wait complete. 2024-05-08T18:33:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.582+0000 7f81a0344800 1 Processor -- start 2024-05-08T18:33:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.583+0000 7f81a0344800 1 -- start start 2024-05-08T18:33:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.583+0000 7f81a0344800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 0x5559ddad5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.583+0000 7f81a0344800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5559dd9e15c0 con 0x5559dd9dad10 2024-05-08T18:33:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.583+0000 7f819de3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 0x5559ddad5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.583+0000 7f819de3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 0x5559ddad5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52554/0 (socket says 172.21.15.87:52554) 2024-05-08T18:33:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.583+0000 7f819de3c640 1 -- 172.21.15.87:0/3520712900 learned_addr learned my addr 172.21.15.87:0/3520712900 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.583+0000 7f819de3c640 1 -- 172.21.15.87:0/3520712900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559ddad57c0 con 0x5559dd9dad10 2024-05-08T18:33:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.583+0000 7f819de3c640 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 0x5559ddad5280 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f8190005930 tx=0x7f8190003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.583+0000 7f808a604640 1 -- 172.21.15.87:0/3520712900 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8190073070 con 0x5559dd9dad10 2024-05-08T18:33:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.583+0000 7f808a604640 1 -- 172.21.15.87:0/3520712900 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f819005d570 con 0x5559dd9dad10 2024-05-08T18:33:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.583+0000 7f81a0344800 1 -- 172.21.15.87:0/3520712900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559ddad5a50 con 0x5559dd9dad10 2024-05-08T18:33:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.583+0000 7f808a604640 1 -- 172.21.15.87:0/3520712900 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8190057070 con 0x5559dd9dad10 2024-05-08T18:33:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.584+0000 7f81a0344800 1 -- 172.21.15.87:0/3520712900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559ddad86b0 con 0x5559dd9dad10 2024-05-08T18:33:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.584+0000 7f808a604640 1 -- 172.21.15.87:0/3520712900 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8190076070 con 0x5559dd9dad10 2024-05-08T18:33:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.585+0000 7f808a604640 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f808403bb50 0x7f808403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.585+0000 7f808a604640 1 -- 172.21.15.87:0/3520712900 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f81900942a0 con 0x5559dd9dad10 2024-05-08T18:33:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.585+0000 7f819d63b640 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f808403bb50 0x7f808403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.585+0000 7f81a0344800 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5559dd9dd640 0x5559ddadc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.585+0000 7f81a0344800 1 -- 172.21.15.87:0/3520712900 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddadc9f0 con 0x5559dd9dd640 2024-05-08T18:33:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.585+0000 7f819e63d640 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5559dd9dd640 0x5559ddadc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.585+0000 7f819d63b640 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f808403bb50 0x7f808403e010 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8194000f60 tx=0x7f8194001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.585+0000 7f819e63d640 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5559dd9dd640 0x5559ddadc470 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.585+0000 7f819e63d640 1 -- 172.21.15.87:0/3520712900 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f819800a4a0 con 0x5559dd9dd640 2024-05-08T18:33:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.586+0000 7f81a0344800 1 -- 172.21.15.87:0/3520712900 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddad9a40 con 0x5559dd9dd640 2024-05-08T18:33:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.586+0000 7f819e63d640 1 -- 172.21.15.87:0/3520712900 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f819800a4a0 con 0x5559dd9dd640 2024-05-08T18:33:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.586+0000 7f81a0344800 1 -- 172.21.15.87:0/3520712900 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddade830 con 0x5559dd9dd640 2024-05-08T18:33:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.586+0000 7f819e63d640 1 -- 172.21.15.87:0/3520712900 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f819800a4a0 con 0x5559dd9dd640 2024-05-08T18:33:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.586+0000 7f81a0344800 1 -- 172.21.15.87:0/3520712900 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddadda60 con 0x5559dd9dd640 2024-05-08T18:33:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.586+0000 7f819e63d640 1 -- 172.21.15.87:0/3520712900 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f819800a4a0 con 0x5559dd9dd640 2024-05-08T18:33:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.586+0000 7f81a0344800 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5559ddadfbe0 0x5559ddae1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.586+0000 7f81a0344800 1 -- 172.21.15.87:0/3520712900 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddae2510 con 0x5559ddadfbe0 2024-05-08T18:33:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.587+0000 7f819de3c640 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5559ddadfbe0 0x5559ddae1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.587+0000 7f819de3c640 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5559ddadfbe0 0x5559ddae1fd0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.587+0000 7f819de3c640 1 -- 172.21.15.87:0/3520712900 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8190075030 con 0x5559ddadfbe0 2024-05-08T18:33:04.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.588+0000 7f81a0344800 1 Processor -- start 2024-05-08T18:33:04.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.588+0000 7f81a0344800 1 -- start start 2024-05-08T18:33:04.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.588+0000 7f81a0344800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddaf0750 0x5559ddaf0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.588+0000 7f81a0344800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5559dd8cbfc0 con 0x5559ddaf0750 2024-05-08T18:33:04.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.588+0000 7f819e63d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddaf0750 0x5559ddaf0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.588+0000 7f819e63d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddaf0750 0x5559ddaf0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52558/0 (socket says 172.21.15.87:52558) 2024-05-08T18:33:04.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.588+0000 7f819e63d640 1 -- 172.21.15.87:0/1919622389 learned_addr learned my addr 172.21.15.87:0/1919622389 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.588+0000 7f819e63d640 1 -- 172.21.15.87:0/1919622389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559ddaf10b0 con 0x5559ddaf0750 2024-05-08T18:33:04.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.588+0000 7f819e63d640 1 --2- 172.21.15.87:0/1919622389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddaf0750 0x5559ddaf0b70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x5559ddad6630 tx=0x7f81980178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.589+0000 7f80837fe640 1 -- 172.21.15.87:0/1919622389 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8198013440 con 0x5559ddaf0750 2024-05-08T18:33:04.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.589+0000 7f80837fe640 1 -- 172.21.15.87:0/1919622389 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81980135e0 con 0x5559ddaf0750 2024-05-08T18:33:04.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.589+0000 7f80837fe640 1 -- 172.21.15.87:0/1919622389 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81980138c0 con 0x5559ddaf0750 2024-05-08T18:33:04.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.589+0000 7f81a0344800 1 -- 172.21.15.87:0/1919622389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559ddaf1b20 con 0x5559ddaf0750 2024-05-08T18:33:04.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.589+0000 7f81a0344800 1 -- 172.21.15.87:0/1919622389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559ddaf2020 con 0x5559ddaf0750 2024-05-08T18:33:04.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.589+0000 7f80837fe640 1 -- 172.21.15.87:0/1919622389 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8198011040 con 0x5559ddaf0750 2024-05-08T18:33:04.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.590+0000 7f80837fe640 1 --2- 172.21.15.87:0/1919622389 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f807803bba0 0x7f807803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.590+0000 7f80837fe640 1 -- 172.21.15.87:0/1919622389 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f819801d070 con 0x5559ddaf0750 2024-05-08T18:33:04.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.590+0000 7f819de3c640 1 --2- 172.21.15.87:0/1919622389 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f807803bba0 0x7f807803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.590+0000 7f81a0344800 1 Processor -- start 2024-05-08T18:33:04.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.590+0000 7f81a0344800 1 -- start start 2024-05-08T18:33:04.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.590+0000 7f819de3c640 1 --2- 172.21.15.87:0/1919622389 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f807803bba0 0x7f807803e060 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f819005b730 tx=0x7f819001d010 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.590+0000 7f81a0344800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddafdac0 0x5559ddafdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.590+0000 7f81a0344800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5559dd9d8ed0 con 0x5559ddafdac0 2024-05-08T18:33:04.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.590+0000 7f819e63d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddafdac0 0x5559ddafdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.590+0000 7f819e63d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddafdac0 0x5559ddafdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52570/0 (socket says 172.21.15.87:52570) 2024-05-08T18:33:04.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.590+0000 7f819e63d640 1 -- 172.21.15.87:0/2624082776 learned_addr learned my addr 172.21.15.87:0/2624082776 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.591+0000 7f819e63d640 1 -- 172.21.15.87:0/2624082776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559ddafe4b0 con 0x5559ddafdac0 2024-05-08T18:33:04.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.591+0000 7f819e63d640 1 --2- 172.21.15.87:0/2624082776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddafdac0 0x5559ddafdee0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f81980103f0 tx=0x7f8198029430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f218edd6bd06f2d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.591+0000 7f80817fa640 1 -- 172.21.15.87:0/2624082776 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f819802ad80 con 0x5559ddafdac0 2024-05-08T18:33:04.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.591+0000 7f80817fa640 1 -- 172.21.15.87:0/2624082776 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81980014f0 con 0x5559ddafdac0 2024-05-08T18:33:04.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.591+0000 7f80817fa640 1 -- 172.21.15.87:0/2624082776 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81980157b0 con 0x5559ddafdac0 2024-05-08T18:33:04.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.591+0000 7f81a0344800 1 -- 172.21.15.87:0/2624082776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddafdac0 msgr2=0x5559ddafdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.591+0000 7f81a0344800 1 --2- 172.21.15.87:0/2624082776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddafdac0 0x5559ddafdee0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f81980103f0 tx=0x7f8198029430 comp rx=0 tx=0).stop 2024-05-08T18:33:04.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.591+0000 7f81a0344800 1 -- 172.21.15.87:0/2624082776 shutdown_connections 2024-05-08T18:33:04.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.591+0000 7f81a0344800 1 --2- 172.21.15.87:0/2624082776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddafdac0 0x5559ddafdee0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.591+0000 7f81a0344800 1 -- 172.21.15.87:0/2624082776 >> 172.21.15.87:0/2624082776 conn(0x5559ddaf9d90 msgr2=0x5559ddaf7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.592+0000 7f81a0344800 1 -- 172.21.15.87:0/2624082776 shutdown_connections 2024-05-08T18:33:04.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.592+0000 7f81a0344800 1 -- 172.21.15.87:0/2624082776 wait complete. 2024-05-08T18:33:04.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.592+0000 7f81a0344800 1 Processor -- start 2024-05-08T18:33:04.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.592+0000 7f81a0344800 1 -- start start 2024-05-08T18:33:04.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.592+0000 7f81a0344800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddafdac0 0x5559ddb05030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.592+0000 7f81a0344800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5559ddafec00 con 0x5559ddafdac0 2024-05-08T18:33:04.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.592+0000 7f819e63d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddafdac0 0x5559ddb05030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.592+0000 7f819e63d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddafdac0 0x5559ddb05030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52574/0 (socket says 172.21.15.87:52574) 2024-05-08T18:33:04.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.592+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 learned_addr learned my addr 172.21.15.87:0/2673276972 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.593+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559ddb05570 con 0x5559ddafdac0 2024-05-08T18:33:04.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.593+0000 7f819e63d640 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddafdac0 0x5559ddb05030 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8198001f40 tx=0x7f81980528f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.593+0000 7f806f7fe640 1 -- 172.21.15.87:0/2673276972 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8198030020 con 0x5559ddafdac0 2024-05-08T18:33:04.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.593+0000 7f806f7fe640 1 -- 172.21.15.87:0/2673276972 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8198013b90 con 0x5559ddafdac0 2024-05-08T18:33:04.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.593+0000 7f806f7fe640 1 -- 172.21.15.87:0/2673276972 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81980540d0 con 0x5559ddafdac0 2024-05-08T18:33:04.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.593+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559ddb05800 con 0x5559ddafdac0 2024-05-08T18:33:04.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.593+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559ddb084b0 con 0x5559ddafdac0 2024-05-08T18:33:04.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.594+0000 7f806f7fe640 1 -- 172.21.15.87:0/2673276972 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8198033020 con 0x5559ddafdac0 2024-05-08T18:33:04.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.594+0000 7f806f7fe640 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f806803bba0 0x7f806803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.594+0000 7f806f7fe640 1 -- 172.21.15.87:0/2673276972 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f819800e040 con 0x5559ddafdac0 2024-05-08T18:33:04.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.594+0000 7f819de3c640 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f806803bba0 0x7f806803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.594+0000 7f819de3c640 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f806803bba0 0x7f806803e060 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8190092810 tx=0x7f819008c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.595+0000 7f81a0344800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.595+0000 7f81a0344800 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5559ddb10b80 0x5559ddb13040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.595+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb13790 con 0x5559ddb10b80 2024-05-08T18:33:04.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.595+0000 7f819d63b640 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5559ddb10b80 0x5559ddb13040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.595+0000 7f819d63b640 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5559ddb10b80 0x5559ddb13040 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.595+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.595+0000 7f81a0344800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.595+0000 7f81a0344800 20 realm 2024-05-08T18:33:04.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.595+0000 7f81a0344800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.595+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb0ffd0 con 0x5559ddb10b80 2024-05-08T18:33:04.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f81a0344800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f81a0344800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:04.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f81a0344800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb14280 con 0x5559ddb10b80 2024-05-08T18:33:04.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f81a0344800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f81a0344800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb14b50 con 0x5559ddb10b80 2024-05-08T18:33:04.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f81a0344800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:04.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f81a0344800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb14ef0 con 0x5559ddb10b80 2024-05-08T18:33:04.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f81a0344800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:04.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f81a0344800 20 searching for the correct realm 2024-05-08T18:33:04.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f81a0344800 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5559ddb16dd0 0x5559ddb19200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x5559ddb16dd0 2024-05-08T18:33:04.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.596+0000 7f819e63d640 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5559ddb16dd0 0x5559ddb19200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.597+0000 7f819e63d640 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5559ddb16dd0 0x5559ddb19200 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.597+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8198052d70 con 0x5559ddb16dd0 2024-05-08T18:33:04.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.597+0000 7f819e63d640 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8198035020 0x7f819802c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.597+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x7f8198035020 2024-05-08T18:33:04.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.597+0000 7f819de3c640 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8198035020 0x7f819802c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.597+0000 7f819de3c640 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8198035020 0x7f819802c480 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.598+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819008a030 con 0x7f8198035020 2024-05-08T18:33:04.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.598+0000 7f819de3c640 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f81900a1040 0x7f819005b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.598+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x7f81900a1040 2024-05-08T18:33:04.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.598+0000 7f819d63b640 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f81900a1040 0x7f819005b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.598+0000 7f819d63b640 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f81900a1040 0x7f819005b7a0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.599+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.599+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x5559ddb10b80 2024-05-08T18:33:04.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.599+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.599+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x5559ddb10b80 2024-05-08T18:33:04.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.599+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.599+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x7f81900a1040 2024-05-08T18:33:04.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.599+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.599+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x7f81900a1040 2024-05-08T18:33:04.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.600+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.600+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x7f8198035020 2024-05-08T18:33:04.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.600+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819008a030 con 0x7f8198035020 2024-05-08T18:33:04.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.600+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x5559ddb16dd0 2024-05-08T18:33:04.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.600+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8198052d70 con 0x5559ddb16dd0 2024-05-08T18:33:04.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.600+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x5559ddb10b80 2024-05-08T18:33:04.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.600+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.600+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x7f81900a1040 2024-05-08T18:33:04.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.601+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.601+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x5559ddb10b80 2024-05-08T18:33:04.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.601+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.601+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x7f8198035020 2024-05-08T18:33:04.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.601+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f819008a030 con 0x7f8198035020 2024-05-08T18:33:04.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.601+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x5559ddb16dd0 2024-05-08T18:33:04.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.601+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8198052d70 con 0x5559ddb16dd0 2024-05-08T18:33:04.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.601+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x5559ddb16dd0 2024-05-08T18:33:04.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.602+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8198052d70 con 0x5559ddb16dd0 2024-05-08T18:33:04.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.602+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x7f81900a1040 2024-05-08T18:33:04.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.602+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.602+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x5559ddb16dd0 2024-05-08T18:33:04.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.602+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8198052d70 con 0x5559ddb16dd0 2024-05-08T18:33:04.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.602+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x5559ddb16dd0 2024-05-08T18:33:04.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.602+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8198052d70 con 0x5559ddb16dd0 2024-05-08T18:33:04.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.602+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x5559ddb10b80 2024-05-08T18:33:04.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.603+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.603+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x5559ddb10b80 2024-05-08T18:33:04.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.603+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v29'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.603+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x7f81900a1040 2024-05-08T18:33:04.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.603+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.603+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x5559ddb16dd0 2024-05-08T18:33:04.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.604+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8198052d70 con 0x5559ddb16dd0 2024-05-08T18:33:04.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.604+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x7f8198035020 2024-05-08T18:33:04.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.604+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819008a030 con 0x7f8198035020 2024-05-08T18:33:04.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.604+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x5559ddb10b80 2024-05-08T18:33:04.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.604+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.604+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x7f81900a1040 2024-05-08T18:33:04.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.604+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.604+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x5559ddb16dd0 2024-05-08T18:33:04.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.605+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8198052d70 con 0x5559ddb16dd0 2024-05-08T18:33:04.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.605+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x7f8198035020 2024-05-08T18:33:04.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.605+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819008a030 con 0x7f8198035020 2024-05-08T18:33:04.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.605+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x7f8198035020 2024-05-08T18:33:04.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.605+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819008a030 con 0x7f8198035020 2024-05-08T18:33:04.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.605+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x5559ddb16dd0 2024-05-08T18:33:04.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.605+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8198052d70 con 0x5559ddb16dd0 2024-05-08T18:33:04.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.605+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x7f8198035020 2024-05-08T18:33:04.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819008a030 con 0x7f8198035020 2024-05-08T18:33:04.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x5559ddb10b80 2024-05-08T18:33:04.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb198d0 con 0x7f8198035020 2024-05-08T18:33:04.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819008a030 con 0x7f8198035020 2024-05-08T18:33:04.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f81a0344800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:04.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f81a0344800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f81a0344800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f81a0344800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f81a0344800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f81a0344800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f81a0344800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb15870 con 0x5559ddb10b80 2024-05-08T18:33:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f81a0344800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f81a0344800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb16110 con 0x5559ddb10b80 2024-05-08T18:33:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.606+0000 7f81a0344800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.607+0000 7f81a0344800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.607+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb19d50 con 0x7f81900a1040 2024-05-08T18:33:04.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.607+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.607+0000 7f81a0344800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:04.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.607+0000 7f81a0344800 20 zone default found 2024-05-08T18:33:04.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.607+0000 7f81a0344800 4 Realm: () 2024-05-08T18:33:04.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.607+0000 7f81a0344800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:04.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.607+0000 7f81a0344800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:04.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.607+0000 7f81a0344800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:04.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.607+0000 7f81a0344800 20 zonegroup default 2024-05-08T18:33:04.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.607+0000 7f81a0344800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.607+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb15d70 con 0x7f81900a1040 2024-05-08T18:33:04.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.607+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.607+0000 7f81a0344800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.607+0000 7f81a0344800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.607+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1bc60 con 0x5559ddb16dd0 2024-05-08T18:33:04.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.607+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8198052d70 con 0x5559ddb16dd0 2024-05-08T18:33:04.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.608+0000 7f81a0344800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.608+0000 7f81a0344800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.608+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1c020 con 0x5559ddb16dd0 2024-05-08T18:33:04.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.608+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8198052d70 con 0x5559ddb16dd0 2024-05-08T18:33:04.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.608+0000 7f81a0344800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.608+0000 7f81a0344800 20 started sync module instance, tier type = 2024-05-08T18:33:04.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.608+0000 7f81a0344800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:04.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.608+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1b100 con 0x7f8198035020 2024-05-08T18:33:04.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.609+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819008a030 con 0x7f8198035020 2024-05-08T18:33:04.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.609+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93844459861280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1ad60 con 0x7f8198035020 2024-05-08T18:33:04.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.609+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1cf50 con 0x5559ddb10b80 2024-05-08T18:33:04.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.610+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93844459861280] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819008a030 con 0x7f8198035020 2024-05-08T18:33:04.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.610+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.610+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93844459866784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1d370 con 0x5559ddb10b80 2024-05-08T18:33:04.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.610+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1dd70 con 0x5559ddb16dd0 2024-05-08T18:33:04.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.611+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93844459866784] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.611+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8198052d70 con 0x5559ddb16dd0 2024-05-08T18:33:04.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.611+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93844459867840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1d2e0 con 0x5559ddb16dd0 2024-05-08T18:33:04.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.611+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1ec30 con 0x7f8198035020 2024-05-08T18:33:04.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.612+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93844459867840] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8198052d70 con 0x5559ddb16dd0 2024-05-08T18:33:04.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.612+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819008a030 con 0x7f8198035020 2024-05-08T18:33:04.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.612+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93844459874176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1efd0 con 0x7f8198035020 2024-05-08T18:33:04.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.612+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1f990 con 0x5559ddb10b80 2024-05-08T18:33:04.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.613+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93844459874176] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819008a030 con 0x7f8198035020 2024-05-08T18:33:04.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.614+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.614+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93844459877600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1f900 con 0x5559ddb10b80 2024-05-08T18:33:04.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.614+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb20850 con 0x7f81900a1040 2024-05-08T18:33:04.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.615+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93844459877600] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.615+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.615+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93844459879728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb20850 con 0x7f81900a1040 2024-05-08T18:33:04.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.615+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb21210 con 0x7f81900a1040 2024-05-08T18:33:04.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.616+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93844459879728] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.616+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.616+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93844459881856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb21210 con 0x7f81900a1040 2024-05-08T18:33:04.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.616+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb21bd0 con 0x7f81900a1040 2024-05-08T18:33:04.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.617+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93844459881856] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.617+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.617+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93844459886848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb21210 con 0x7f81900a1040 2024-05-08T18:33:04.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.617+0000 7f81a0344800 20 add_watcher() i=0 2024-05-08T18:33:04.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.617+0000 7f81a0344800 20 add_watcher() i=1 2024-05-08T18:33:04.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.617+0000 7f81a0344800 20 add_watcher() i=2 2024-05-08T18:33:04.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.617+0000 7f81a0344800 20 add_watcher() i=3 2024-05-08T18:33:04.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.617+0000 7f81a0344800 20 add_watcher() i=4 2024-05-08T18:33:04.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.617+0000 7f81a0344800 20 add_watcher() i=5 2024-05-08T18:33:04.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.617+0000 7f81a0344800 20 add_watcher() i=6 2024-05-08T18:33:04.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.618+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93844459886848] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.618+0000 7f81a0344800 20 add_watcher() i=7 2024-05-08T18:33:04.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.618+0000 7f81a0344800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:04.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.618+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb24ff0 con 0x5559ddb10b80 2024-05-08T18:33:04.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.619+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.619+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93844459884288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb22490 con 0x5559ddb10b80 2024-05-08T18:33:04.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.620+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93844459884288] v29'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.620+0000 7f804f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:04.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.620+0000 7f81a0344800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:04.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.620+0000 7f81a0344800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:04.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.620+0000 7f81a0344800 5 note: GC not initialized 2024-05-08T18:33:04.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.620+0000 7f804e7fc640 20 reqs_thread_entry: start 2024-05-08T18:33:04.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.620+0000 7f81a0344800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:04.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.620+0000 7f81a0344800 20 Filter name: none 2024-05-08T18:33:04.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.620+0000 7f7fbffff640 20 reqs_thread_entry: start 2024-05-08T18:33:04.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.620+0000 7f81a0344800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-05-08T18:33:04.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.620+0000 7f81a0344800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.620+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb585a0 con 0x7f81900a1040 2024-05-08T18:33:04.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.621+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.621+0000 7f81a0344800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.621+0000 7f81a0344800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-05-08T18:33:04.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.621+0000 7f81a0344800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-08T18:33:04.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.621+0000 7f81a0344800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-05-08T18:33:04.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.621+0000 7f81a0344800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.621+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb56d40 con 0x5559ddb16dd0 2024-05-08T18:33:04.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.621+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f8198052d70 con 0x5559ddb16dd0 2024-05-08T18:33:04.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.621+0000 7f81a0344800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.621+0000 7f81a0344800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-05-08T18:33:04.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.621+0000 7f81a0344800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-08T18:33:04.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.621+0000 7f81a0344800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-05-08T18:33:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.621+0000 7f81a0344800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-05-08T18:33:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.621+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb575e0 con 0x7f81900a1040 2024-05-08T18:33:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.622+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v29'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.623+0000 7f81a0344800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-05-08T18:33:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.623+0000 7f81a0344800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-08T18:33:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.623+0000 7f81a0344800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-05-08T18:33:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.623+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93844460106032 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb5bee0 con 0x7f8198035020 2024-05-08T18:33:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.623+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== watch-notify(notify (1) cookie 93844459861280 notify 124554051633 ret 0) ==== 575+0+0 (crc 0 0 0) 0x5559ddad86b0 con 0x7f8198035020 2024-05-08T18:33:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.623+0000 7f80817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051633 cookie 93844459861280 notifier 4837 bl.length()=533 2024-05-08T18:33:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.623+0000 7f80817fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-05-08T18:33:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.623+0000 7f80817fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-08T18:33:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.623+0000 7f80817fa640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8060003ea0 con 0x7f8198035020 2024-05-08T18:33:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.623+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(65 notify.0 [notify cookie 93844460106032 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f819008a030 con 0x7f8198035020 2024-05-08T18:33:04.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.623+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819008a030 con 0x7f8198035020 2024-05-08T18:33:04.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.623+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== watch-notify(notify_complete (2) cookie 93844460106032 notify 124554051633 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5559ddad5a50 con 0x7f8198035020 2024-05-08T18:33:04.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.623+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb57130 con 0x5559ddb16dd0 2024-05-08T18:33:04.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.624+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v29'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f8198052d70 con 0x5559ddb16dd0 2024-05-08T18:33:04.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.624+0000 7f81a0344800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-05-08T18:33:04.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.624+0000 7f81a0344800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-08T18:33:04.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.624+0000 7f81a0344800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-05-08T18:33:04.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.624+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 93844460106032 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb5bee0 con 0x5559ddb10b80 2024-05-08T18:33:04.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.625+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== watch-notify(notify (1) cookie 93844459866784 notify 124554051606 ret 0) ==== 218+0+0 (crc 0 0 0) 0x5559ddb57980 con 0x5559ddb10b80 2024-05-08T18:33:04.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.625+0000 7f8080ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051606 cookie 93844459866784 notifier 4837 bl.length()=176 2024-05-08T18:33:04.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.625+0000 7f8080ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-05-08T18:33:04.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.625+0000 7f8080ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-08T18:33:04.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.625+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(68 notify.1 [notify cookie 93844460106032 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.625+0000 7f8080ff9640 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7fc8003400 con 0x5559ddb10b80 2024-05-08T18:33:04.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.625+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.625+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== watch-notify(notify_complete (2) cookie 93844460106032 notify 124554051606 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5559ddb57ff0 con 0x5559ddb10b80 2024-05-08T18:33:04.635 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-05-08T18:33:04.622373Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:33:04.622354Z","tags":[],"group_ids":[]} 2024-05-08T18:33:04.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.626+0000 7f804f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:04.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.626+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93844459884288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb24be0 con 0x5559ddb10b80 2024-05-08T18:33:04.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.627+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93844459884288] v29'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.627+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93844459861280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb20ed0 con 0x7f8198035020 2024-05-08T18:33:04.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.628+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93844459861280] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819008a030 con 0x7f8198035020 2024-05-08T18:33:04.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.628+0000 7f81a0344800 20 remove_watcher() i=0 2024-05-08T18:33:04.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.628+0000 7f81a0344800 2 removed watcher, disabling cache 2024-05-08T18:33:04.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.628+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93844459866784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1b520 con 0x5559ddb10b80 2024-05-08T18:33:04.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.629+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93844459866784] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.629+0000 7f81a0344800 20 remove_watcher() i=1 2024-05-08T18:33:04.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.629+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93844459867840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1caa0 con 0x5559ddb16dd0 2024-05-08T18:33:04.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.630+0000 7f819e63d640 1 -- 172.21.15.87:0/2673276972 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93844459867840] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8198052d70 con 0x5559ddb16dd0 2024-05-08T18:33:04.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.630+0000 7f81a0344800 20 remove_watcher() i=2 2024-05-08T18:33:04.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.630+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93844459874176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb20ed0 con 0x7f8198035020 2024-05-08T18:33:04.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.631+0000 7f819de3c640 1 -- 172.21.15.87:0/2673276972 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93844459874176] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819008a030 con 0x7f8198035020 2024-05-08T18:33:04.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.631+0000 7f81a0344800 20 remove_watcher() i=3 2024-05-08T18:33:04.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.631+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93844459877600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1e780 con 0x5559ddb10b80 2024-05-08T18:33:04.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.632+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93844459877600] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819400f610 con 0x5559ddb10b80 2024-05-08T18:33:04.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.632+0000 7f81a0344800 20 remove_watcher() i=4 2024-05-08T18:33:04.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.632+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93844459879728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1f4e0 con 0x7f81900a1040 2024-05-08T18:33:04.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.633+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93844459879728] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.633+0000 7f81a0344800 20 remove_watcher() i=5 2024-05-08T18:33:04.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.633+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93844459881856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1f4e0 con 0x7f81900a1040 2024-05-08T18:33:04.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.634+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93844459881856] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.634+0000 7f81a0344800 20 remove_watcher() i=6 2024-05-08T18:33:04.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.634+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93844459886848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559ddb1f4e0 con 0x7f81900a1040 2024-05-08T18:33:04.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.635+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93844459886848] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819400f610 con 0x7f81900a1040 2024-05-08T18:33:04.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.635+0000 7f81a0344800 20 remove_watcher() i=7 2024-05-08T18:33:04.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.635+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f81900a1040 msgr2=0x7f819005b7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.635+0000 7f81a0344800 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f81900a1040 0x7f819005b7a0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.635+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5559ddb10b80 msgr2=0x5559ddb13040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.635+0000 7f81a0344800 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5559ddb10b80 0x5559ddb13040 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.635+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8198035020 msgr2=0x7f819802c480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.635+0000 7f81a0344800 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f8198035020 0x7f819802c480 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.635+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5559ddb16dd0 msgr2=0x5559ddb19200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.635+0000 7f81a0344800 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5559ddb16dd0 0x5559ddb19200 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.635+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f806803bba0 msgr2=0x7f806803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f806803bba0 0x7f806803e060 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8190092810 tx=0x7f819008c000 comp rx=0 tx=0).stop 2024-05-08T18:33:04.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f819d63b640 1 -- 172.21.15.87:0/2673276972 reap_dead start 2024-05-08T18:33:04.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddafdac0 msgr2=0x5559ddb05030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddafdac0 0x5559ddb05030 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8198001f40 tx=0x7f81980528f0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 shutdown_connections 2024-05-08T18:33:04.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 --2- 172.21.15.87:0/2673276972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddafdac0 0x5559ddb05030 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 >> 172.21.15.87:0/2673276972 conn(0x5559ddaf9d90 msgr2=0x5559ddaf73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 shutdown_connections 2024-05-08T18:33:04.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 -- 172.21.15.87:0/2673276972 wait complete. 2024-05-08T18:33:04.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 -- 172.21.15.87:0/1919622389 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f807803bba0 msgr2=0x7f807803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 --2- 172.21.15.87:0/1919622389 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f807803bba0 0x7f807803e060 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f819005b730 tx=0x7f819001d010 comp rx=0 tx=0).stop 2024-05-08T18:33:04.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 -- 172.21.15.87:0/1919622389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddaf0750 msgr2=0x5559ddaf0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 --2- 172.21.15.87:0/1919622389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddaf0750 0x5559ddaf0b70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x5559ddad6630 tx=0x7f81980178e0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 -- 172.21.15.87:0/1919622389 shutdown_connections 2024-05-08T18:33:04.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 --2- 172.21.15.87:0/1919622389 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f807803bba0 0x7f807803e060 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 --2- 172.21.15.87:0/1919622389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559ddaf0750 0x5559ddaf0b70 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 -- 172.21.15.87:0/1919622389 >> 172.21.15.87:0/1919622389 conn(0x5559ddae47f0 msgr2=0x5559ddae4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 -- 172.21.15.87:0/1919622389 shutdown_connections 2024-05-08T18:33:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 -- 172.21.15.87:0/1919622389 wait complete. 2024-05-08T18:33:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 -- 172.21.15.87:0/3520712900 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5559ddadfbe0 msgr2=0x5559ddae1fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5559ddadfbe0 0x5559ddae1fd0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 -- 172.21.15.87:0/3520712900 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5559dd9dd640 msgr2=0x5559ddadc470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5559dd9dd640 0x5559ddadc470 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 -- 172.21.15.87:0/3520712900 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f808403bb50 msgr2=0x7f808403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f808403bb50 0x7f808403e010 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8194000f60 tx=0x7f8194001370 comp rx=0 tx=0).stop 2024-05-08T18:33:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 -- 172.21.15.87:0/3520712900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 msgr2=0x5559ddad5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.636+0000 7f81a0344800 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 0x5559ddad5280 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f8190005930 tx=0x7f8190003020 comp rx=0 tx=0).stop 2024-05-08T18:33:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.637+0000 7f81a0344800 1 -- 172.21.15.87:0/3520712900 shutdown_connections 2024-05-08T18:33:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.637+0000 7f81a0344800 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5559dd9dd640 0x5559ddadc470 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.637+0000 7f81a0344800 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5559ddadfbe0 0x5559ddae1fd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.637+0000 7f81a0344800 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f808403bb50 0x7f808403e010 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.637+0000 7f81a0344800 1 --2- 172.21.15.87:0/3520712900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559dd9dad10 0x5559ddad5280 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.637+0000 7f81a0344800 1 -- 172.21.15.87:0/3520712900 >> 172.21.15.87:0/3520712900 conn(0x5559dd9d46e0 msgr2=0x5559ddac6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.637+0000 7f81a0344800 1 -- 172.21.15.87:0/3520712900 shutdown_connections 2024-05-08T18:33:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.637+0000 7f81a0344800 1 -- 172.21.15.87:0/3520712900 wait complete. 2024-05-08T18:33:04.647 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-05-08T18:33:04.622373Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.622354Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:04.647 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-05-08T18:33:04.622373Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.622354Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:04.647 ERROR:root:0 2024-05-08T18:33:04.648 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:33:04.652 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:04.652 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-05-08T18:33:04.652 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-05-08T18:33:04.653 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-05-08T18:33:04.696 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:04.696 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:04.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.699+0000 7ff5c4d33800 1 Processor -- start 2024-05-08T18:33:04.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.699+0000 7ff5c4d33800 1 -- start start 2024-05-08T18:33:04.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.699+0000 7ff5c4d33800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c1539dd860 0x55c1539dfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.699+0000 7ff5c4d33800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c1539e0190 con 0x55c1539d9d50 2024-05-08T18:33:04.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.699+0000 7ff5c4d33800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55c153879e20 con 0x55c1539dd860 2024-05-08T18:33:04.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.699+0000 7ff5bbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c1539dd860 0x55c1539dfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.699+0000 7ff5bbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c1539dd860 0x55c1539dfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52580/0 (socket says 172.21.15.87:52580) 2024-05-08T18:33:04.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.699+0000 7ff5bbfff640 1 -- 172.21.15.87:0/453111527 learned_addr learned my addr 172.21.15.87:0/453111527 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.700+0000 7ff5bbfff640 1 -- 172.21.15.87:0/453111527 >> v1:172.21.15.53:6789/0 conn(0x55c1539d9d50 legacy=0x55c1539dc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.700+0000 7ff5bbfff640 1 -- 172.21.15.87:0/453111527 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1539e1370 con 0x55c1539dd860 2024-05-08T18:33:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.701+0000 7ff5bbfff640 1 --2- 172.21.15.87:0/453111527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539dd860 0x55c1539dfc50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00a520 tx=0x7ff5ac01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d78532d778b699 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.702+0000 7ff5bb7fe640 1 -- 172.21.15.87:0/453111527 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5ac057070 con 0x55c1539dd860 2024-05-08T18:33:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.702+0000 7ff5bb7fe640 1 -- 172.21.15.87:0/453111527 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ac052570 con 0x55c1539dd860 2024-05-08T18:33:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.702+0000 7ff5bb7fe640 1 -- 172.21.15.87:0/453111527 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5ac04ae60 con 0x55c1539dd860 2024-05-08T18:33:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.702+0000 7ff5c4d33800 1 -- 172.21.15.87:0/453111527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539dd860 msgr2=0x55c1539dfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.702+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/453111527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539dd860 0x55c1539dfc50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00a520 tx=0x7ff5ac01d010 comp rx=0 tx=0).stop 2024-05-08T18:33:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.702+0000 7ff5c4d33800 1 -- 172.21.15.87:0/453111527 shutdown_connections 2024-05-08T18:33:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.702+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/453111527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539dd860 0x55c1539dfc50 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.702+0000 7ff5c4d33800 1 -- 172.21.15.87:0/453111527 >> 172.21.15.87:0/453111527 conn(0x55c1539d3720 msgr2=0x55c1539d5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.702+0000 7ff5c4d33800 1 -- 172.21.15.87:0/453111527 shutdown_connections 2024-05-08T18:33:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.702+0000 7ff5c4d33800 1 -- 172.21.15.87:0/453111527 wait complete. 2024-05-08T18:33:04.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.716+0000 7ff5c4d33800 1 Processor -- start 2024-05-08T18:33:04.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.716+0000 7ff5c4d33800 1 -- start start 2024-05-08T18:33:04.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.716+0000 7ff5c4d33800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539d9d50 0x55c153aca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.716+0000 7ff5c4d33800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c1539245b0 con 0x55c1539d9d50 2024-05-08T18:33:04.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.716+0000 7ff5c09ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539d9d50 0x55c153aca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.716+0000 7ff5c09ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539d9d50 0x55c153aca5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52586/0 (socket says 172.21.15.87:52586) 2024-05-08T18:33:04.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.716+0000 7ff5c09ee640 1 -- 172.21.15.87:0/3898727719 learned_addr learned my addr 172.21.15.87:0/3898727719 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.717+0000 7ff5c09ee640 1 -- 172.21.15.87:0/3898727719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c153acabb0 con 0x55c1539d9d50 2024-05-08T18:33:04.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.717+0000 7ff5c09ee640 1 --2- 172.21.15.87:0/3898727719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539d9d50 0x55c153aca5e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4001cd0 tx=0x7ff5b400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fc1c3c935689f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.717+0000 7ff4aee05640 1 -- 172.21.15.87:0/3898727719 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b400be10 con 0x55c1539d9d50 2024-05-08T18:33:04.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.717+0000 7ff4aee05640 1 -- 172.21.15.87:0/3898727719 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b400f400 con 0x55c1539d9d50 2024-05-08T18:33:04.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.717+0000 7ff4aee05640 1 -- 172.21.15.87:0/3898727719 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b400f720 con 0x55c1539d9d50 2024-05-08T18:33:04.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.718+0000 7ff5c4d33800 1 -- 172.21.15.87:0/3898727719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539d9d50 msgr2=0x55c153aca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.718+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/3898727719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539d9d50 0x55c153aca5e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4001cd0 tx=0x7ff5b400b5b0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.718+0000 7ff5c4d33800 1 -- 172.21.15.87:0/3898727719 shutdown_connections 2024-05-08T18:33:04.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.718+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/3898727719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539d9d50 0x55c153aca5e0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.718+0000 7ff5c4d33800 1 -- 172.21.15.87:0/3898727719 >> 172.21.15.87:0/3898727719 conn(0x55c1539d3720 msgr2=0x55c153ac5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.718+0000 7ff5c4d33800 1 -- 172.21.15.87:0/3898727719 shutdown_connections 2024-05-08T18:33:04.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.718+0000 7ff5c4d33800 1 -- 172.21.15.87:0/3898727719 wait complete. 2024-05-08T18:33:04.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.718+0000 7ff5c4d33800 1 Processor -- start 2024-05-08T18:33:04.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.718+0000 7ff5c4d33800 1 -- start start 2024-05-08T18:33:04.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.718+0000 7ff5c4d33800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539d9d50 0x55c153ad2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.718+0000 7ff5c4d33800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c1539e0660 con 0x55c1539d9d50 2024-05-08T18:33:04.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.718+0000 7ff5c09ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539d9d50 0x55c153ad2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.719+0000 7ff5c09ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539d9d50 0x55c153ad2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52596/0 (socket says 172.21.15.87:52596) 2024-05-08T18:33:04.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.719+0000 7ff5c09ee640 1 -- 172.21.15.87:0/887852113 learned_addr learned my addr 172.21.15.87:0/887852113 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.719+0000 7ff5c09ee640 1 -- 172.21.15.87:0/887852113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c153ad26c0 con 0x55c1539d9d50 2024-05-08T18:33:04.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.719+0000 7ff5c09ee640 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539d9d50 0x55c153ad2180 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400b5f0 tx=0x7ff5b4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.719+0000 7ff4ad602640 1 -- 172.21.15.87:0/887852113 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b401a7c0 con 0x55c1539d9d50 2024-05-08T18:33:04.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.719+0000 7ff4ad602640 1 -- 172.21.15.87:0/887852113 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b401a960 con 0x55c1539d9d50 2024-05-08T18:33:04.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.719+0000 7ff5c4d33800 1 -- 172.21.15.87:0/887852113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c153ad2950 con 0x55c1539d9d50 2024-05-08T18:33:04.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.719+0000 7ff4ad602640 1 -- 172.21.15.87:0/887852113 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b401ac60 con 0x55c1539d9d50 2024-05-08T18:33:04.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.719+0000 7ff5c4d33800 1 -- 172.21.15.87:0/887852113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c153ad5600 con 0x55c1539d9d50 2024-05-08T18:33:04.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.720+0000 7ff4ad602640 1 -- 172.21.15.87:0/887852113 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff5b4017070 con 0x55c1539d9d50 2024-05-08T18:33:04.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.720+0000 7ff4ad602640 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff4a803bb50 0x7ff4a803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.720+0000 7ff4ad602640 1 -- 172.21.15.87:0/887852113 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff5b4015020 con 0x55c1539d9d50 2024-05-08T18:33:04.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.721+0000 7ff5bbfff640 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff4a803bb50 0x7ff4a803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.721+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c1539dd860 0x55c153ad93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.721+0000 7ff5c4d33800 1 -- 172.21.15.87:0/887852113 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153ad9990 con 0x55c1539dd860 2024-05-08T18:33:04.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.721+0000 7ff5c11ef640 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c1539dd860 0x55c153ad93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.721+0000 7ff5bbfff640 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff4a803bb50 0x7ff4a803e010 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac054000 tx=0x7ff5ac04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.721+0000 7ff5c11ef640 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c1539dd860 0x55c153ad93c0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.721+0000 7ff5c11ef640 1 -- 172.21.15.87:0/887852113 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5bc00a4a0 con 0x55c1539dd860 2024-05-08T18:33:04.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.721+0000 7ff5c4d33800 1 -- 172.21.15.87:0/887852113 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153ad6990 con 0x55c1539dd860 2024-05-08T18:33:04.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.722+0000 7ff5c11ef640 1 -- 172.21.15.87:0/887852113 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff5bc00a4a0 con 0x55c1539dd860 2024-05-08T18:33:04.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.722+0000 7ff5c4d33800 1 -- 172.21.15.87:0/887852113 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153adb7b0 con 0x55c1539dd860 2024-05-08T18:33:04.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.722+0000 7ff5c11ef640 1 -- 172.21.15.87:0/887852113 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff5bc00a4a0 con 0x55c1539dd860 2024-05-08T18:33:04.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.722+0000 7ff5c4d33800 1 -- 172.21.15.87:0/887852113 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153ada9e0 con 0x55c1539dd860 2024-05-08T18:33:04.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.722+0000 7ff5c11ef640 1 -- 172.21.15.87:0/887852113 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff5bc00a4a0 con 0x55c1539dd860 2024-05-08T18:33:04.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.722+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55c153adcb60 0x55c153adef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.722+0000 7ff5c4d33800 1 -- 172.21.15.87:0/887852113 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153adf490 con 0x55c153adcb60 2024-05-08T18:33:04.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.722+0000 7ff5c09ee640 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55c153adcb60 0x55c153adef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.723+0000 7ff5c09ee640 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55c153adcb60 0x55c153adef50 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.723+0000 7ff5c09ee640 1 -- 172.21.15.87:0/887852113 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff5b402e070 con 0x55c153adcb60 2024-05-08T18:33:04.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.723+0000 7ff5c4d33800 1 Processor -- start 2024-05-08T18:33:04.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.723+0000 7ff5c4d33800 1 -- start start 2024-05-08T18:33:04.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.723+0000 7ff5c4d33800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153aed6d0 0x55c153aedaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.723+0000 7ff5c4d33800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c1538cafc0 con 0x55c153aed6d0 2024-05-08T18:33:04.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.724+0000 7ff5c11ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153aed6d0 0x55c153aedaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.724+0000 7ff5c11ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153aed6d0 0x55c153aedaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52612/0 (socket says 172.21.15.87:52612) 2024-05-08T18:33:04.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.724+0000 7ff5c11ef640 1 -- 172.21.15.87:0/3517771671 learned_addr learned my addr 172.21.15.87:0/3517771671 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.724+0000 7ff5c11ef640 1 -- 172.21.15.87:0/3517771671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c153aee030 con 0x55c153aed6d0 2024-05-08T18:33:04.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.724+0000 7ff5c11ef640 1 --2- 172.21.15.87:0/3517771671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153aed6d0 0x55c153aedaf0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x55c153ad3580 tx=0x7ff5bc0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.724+0000 7ff4a6ffd640 1 -- 172.21.15.87:0/3517771671 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5bc013440 con 0x55c153aed6d0 2024-05-08T18:33:04.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.724+0000 7ff4a6ffd640 1 -- 172.21.15.87:0/3517771671 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5bc0135e0 con 0x55c153aed6d0 2024-05-08T18:33:04.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.724+0000 7ff5c4d33800 1 -- 172.21.15.87:0/3517771671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c153aeeaa0 con 0x55c153aed6d0 2024-05-08T18:33:04.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.724+0000 7ff4a6ffd640 1 -- 172.21.15.87:0/3517771671 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5bc0138c0 con 0x55c153aed6d0 2024-05-08T18:33:04.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.724+0000 7ff5c4d33800 1 -- 172.21.15.87:0/3517771671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c153aeefa0 con 0x55c153aed6d0 2024-05-08T18:33:04.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.725+0000 7ff4a6ffd640 1 -- 172.21.15.87:0/3517771671 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff5bc011040 con 0x55c153aed6d0 2024-05-08T18:33:04.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.725+0000 7ff4a6ffd640 1 --2- 172.21.15.87:0/3517771671 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff49803bba0 0x7ff49803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.725+0000 7ff4a6ffd640 1 -- 172.21.15.87:0/3517771671 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff5bc01d070 con 0x55c153aed6d0 2024-05-08T18:33:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.725+0000 7ff5c09ee640 1 --2- 172.21.15.87:0/3517771671 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff49803bba0 0x7ff49803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.726+0000 7ff5c4d33800 1 Processor -- start 2024-05-08T18:33:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.726+0000 7ff5c09ee640 1 --2- 172.21.15.87:0/3517771671 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff49803bba0 0x7ff49803e060 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff5b401dfd0 tx=0x7ff5b4005f20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.726+0000 7ff5c4d33800 1 -- start start 2024-05-08T18:33:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.726+0000 7ff5c4d33800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153afa9b0 0x55c153afadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.726+0000 7ff5c4d33800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c153acaf30 con 0x55c153afa9b0 2024-05-08T18:33:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.726+0000 7ff5c11ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153afa9b0 0x55c153afadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.726+0000 7ff5c11ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153afa9b0 0x55c153afadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52628/0 (socket says 172.21.15.87:52628) 2024-05-08T18:33:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.726+0000 7ff5c11ef640 1 -- 172.21.15.87:0/2740381502 learned_addr learned my addr 172.21.15.87:0/2740381502 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.726+0000 7ff5c11ef640 1 -- 172.21.15.87:0/2740381502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c153afb3a0 con 0x55c153afa9b0 2024-05-08T18:33:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.727+0000 7ff5c11ef640 1 --2- 172.21.15.87:0/2740381502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153afa9b0 0x55c153afadd0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc052990 tx=0x7ff5bc029430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36dc24bd827052d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.727+0000 7ff4a4ff9640 1 -- 172.21.15.87:0/2740381502 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5bc02ad80 con 0x55c153afa9b0 2024-05-08T18:33:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.727+0000 7ff4a4ff9640 1 -- 172.21.15.87:0/2740381502 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5bc0014f0 con 0x55c153afa9b0 2024-05-08T18:33:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.727+0000 7ff4a4ff9640 1 -- 172.21.15.87:0/2740381502 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5bc001810 con 0x55c153afa9b0 2024-05-08T18:33:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.727+0000 7ff5c4d33800 1 -- 172.21.15.87:0/2740381502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153afa9b0 msgr2=0x55c153afadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.727+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/2740381502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153afa9b0 0x55c153afadd0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc052990 tx=0x7ff5bc029430 comp rx=0 tx=0).stop 2024-05-08T18:33:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.727+0000 7ff5c4d33800 1 -- 172.21.15.87:0/2740381502 shutdown_connections 2024-05-08T18:33:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.727+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/2740381502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153afa9b0 0x55c153afadd0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.727+0000 7ff5c4d33800 1 -- 172.21.15.87:0/2740381502 >> 172.21.15.87:0/2740381502 conn(0x55c153af6d10 msgr2=0x55c153af4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.727+0000 7ff5c4d33800 1 -- 172.21.15.87:0/2740381502 shutdown_connections 2024-05-08T18:33:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.727+0000 7ff5c4d33800 1 -- 172.21.15.87:0/2740381502 wait complete. 2024-05-08T18:33:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.728+0000 7ff5c4d33800 1 Processor -- start 2024-05-08T18:33:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.728+0000 7ff5c4d33800 1 -- start start 2024-05-08T18:33:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.728+0000 7ff5c4d33800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153afa9b0 0x55c153b02010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.728+0000 7ff5c4d33800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c153afbb10 con 0x55c153afa9b0 2024-05-08T18:33:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.728+0000 7ff5c11ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153afa9b0 0x55c153b02010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.728+0000 7ff5c11ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153afa9b0 0x55c153b02010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52630/0 (socket says 172.21.15.87:52630) 2024-05-08T18:33:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.728+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 learned_addr learned my addr 172.21.15.87:0/1479090590 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.728+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c153b02550 con 0x55c153afa9b0 2024-05-08T18:33:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.729+0000 7ff5c11ef640 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153afa9b0 0x55c153b02010 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc001f40 tx=0x7ff5bc0528f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.729+0000 7ff49e7fc640 1 -- 172.21.15.87:0/1479090590 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5bc030020 con 0x55c153afa9b0 2024-05-08T18:33:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.729+0000 7ff49e7fc640 1 -- 172.21.15.87:0/1479090590 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5bc013b90 con 0x55c153afa9b0 2024-05-08T18:33:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.729+0000 7ff49e7fc640 1 -- 172.21.15.87:0/1479090590 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5bc0540d0 con 0x55c153afa9b0 2024-05-08T18:33:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.729+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c153b027e0 con 0x55c153afa9b0 2024-05-08T18:33:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.729+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c153b05490 con 0x55c153afa9b0 2024-05-08T18:33:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.730+0000 7ff49e7fc640 1 -- 172.21.15.87:0/1479090590 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff5bc033020 con 0x55c153afa9b0 2024-05-08T18:33:04.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.730+0000 7ff49e7fc640 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff48803bb50 0x7ff48803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.730+0000 7ff49e7fc640 1 -- 172.21.15.87:0/1479090590 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff5bc00e040 con 0x55c153afa9b0 2024-05-08T18:33:04.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.730+0000 7ff5c09ee640 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff48803bb50 0x7ff48803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.730+0000 7ff5c09ee640 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff48803bb50 0x7ff48803e010 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4005fd0 tx=0x7ff5b4032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.730+0000 7ff5c4d33800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.730+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c153b0dac0 0x55c153b0ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.730+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153b106d0 con 0x55c153b0dac0 2024-05-08T18:33:04.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.731+0000 7ff5bbfff640 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c153b0dac0 0x55c153b0ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.731+0000 7ff5bbfff640 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c153b0dac0 0x55c153b0ff80 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.731+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.731+0000 7ff5c4d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.731+0000 7ff5c4d33800 20 realm 2024-05-08T18:33:04.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.731+0000 7ff5c4d33800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.731+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153b10aa0 con 0x55c153b0dac0 2024-05-08T18:33:04.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.731+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.731+0000 7ff5c4d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.731+0000 7ff5c4d33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:04.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.731+0000 7ff5c4d33800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.731+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153b11370 con 0x55c153b0dac0 2024-05-08T18:33:04.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.732+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.732+0000 7ff5c4d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.732+0000 7ff5c4d33800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.732+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153b11710 con 0x55c153b0dac0 2024-05-08T18:33:04.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.732+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.732+0000 7ff5c4d33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:04.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.732+0000 7ff5c4d33800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.732+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153b11f60 con 0x55c153b0dac0 2024-05-08T18:33:04.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.732+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.732+0000 7ff5c4d33800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:04.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.732+0000 7ff5c4d33800 20 searching for the correct realm 2024-05-08T18:33:04.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.732+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55c153b13cd0 0x55c153b160c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.732+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x55c153b13cd0 2024-05-08T18:33:04.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.732+0000 7ff5c11ef640 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55c153b13cd0 0x55c153b160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.733+0000 7ff5c11ef640 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55c153b13cd0 0x55c153b160c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.733+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.733+0000 7ff5c11ef640 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff5bc035020 0x7ff5bc01a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.733+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x7ff5bc035020 2024-05-08T18:33:04.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.733+0000 7ff5c09ee640 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff5bc035020 0x7ff5bc01a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.733+0000 7ff5c09ee640 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff5bc035020 0x7ff5bc01a970 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.734+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.734+0000 7ff5c09ee640 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff5b4043be0 0x7ff5b4051610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.734+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x7ff5b4043be0 2024-05-08T18:33:04.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.734+0000 7ff5bbfff640 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff5b4043be0 0x7ff5b4051610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.734+0000 7ff5bbfff640 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff5b4043be0 0x7ff5b4051610 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.735+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.735+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x55c153b0dac0 2024-05-08T18:33:04.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.735+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.735+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x55c153b0dac0 2024-05-08T18:33:04.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.735+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.735+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x7ff5b4043be0 2024-05-08T18:33:04.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.735+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.735+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x7ff5b4043be0 2024-05-08T18:33:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.736+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.736+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x7ff5bc035020 2024-05-08T18:33:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.736+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.736+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x55c153b13cd0 2024-05-08T18:33:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.736+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.736+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x55c153b0dac0 2024-05-08T18:33:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.736+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.736+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x7ff5b4043be0 2024-05-08T18:33:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.737+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.737+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x55c153b0dac0 2024-05-08T18:33:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.737+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.737+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x7ff5bc035020 2024-05-08T18:33:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.737+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.737+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x55c153b13cd0 2024-05-08T18:33:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.737+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.737+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x55c153b13cd0 2024-05-08T18:33:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.737+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.737+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x7ff5b4043be0 2024-05-08T18:33:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.738+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.738+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x55c153b13cd0 2024-05-08T18:33:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.738+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.738+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x55c153b13cd0 2024-05-08T18:33:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.738+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.738+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x55c153b0dac0 2024-05-08T18:33:04.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.738+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.738+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x55c153b0dac0 2024-05-08T18:33:04.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.739+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v29'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.739+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x7ff5b4043be0 2024-05-08T18:33:04.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.739+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.739+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x55c153b13cd0 2024-05-08T18:33:04.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.739+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.740+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x7ff5bc035020 2024-05-08T18:33:04.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.740+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.740+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x55c153b0dac0 2024-05-08T18:33:04.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.740+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.740+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x7ff5b4043be0 2024-05-08T18:33:04.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.740+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.740+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x55c153b13cd0 2024-05-08T18:33:04.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.740+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.741+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x7ff5bc035020 2024-05-08T18:33:04.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.741+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.741+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x7ff5bc035020 2024-05-08T18:33:04.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.741+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.741+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x55c153b13cd0 2024-05-08T18:33:04.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.741+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.741+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x7ff5bc035020 2024-05-08T18:33:04.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.741+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.741+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x55c153b0dac0 2024-05-08T18:33:04.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16650 con 0x7ff5bc035020 2024-05-08T18:33:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5c4d33800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5c4d33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5c4d33800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5c4d33800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5c4d33800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5c4d33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5c4d33800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153b128e0 con 0x55c153b0dac0 2024-05-08T18:33:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5c4d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5c4d33800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153b13180 con 0x55c153b0dac0 2024-05-08T18:33:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5c4d33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5c4d33800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.742+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16ad0 con 0x7ff5b4043be0 2024-05-08T18:33:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5c4d33800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5c4d33800 20 zone default found 2024-05-08T18:33:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5c4d33800 4 Realm: () 2024-05-08T18:33:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5c4d33800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5c4d33800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5c4d33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5c4d33800 20 zonegroup default 2024-05-08T18:33:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5c4d33800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153b16f80 con 0x7ff5b4043be0 2024-05-08T18:33:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5c4d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5c4d33800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153b18960 con 0x55c153b13cd0 2024-05-08T18:33:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5c4d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5c4d33800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.743+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153b18e00 con 0x55c153b13cd0 2024-05-08T18:33:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.744+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.744+0000 7ff5c4d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.744+0000 7ff5c4d33800 20 started sync module instance, tier type = 2024-05-08T18:33:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.744+0000 7ff5c4d33800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.744+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b17df0 con 0x7ff5bc035020 2024-05-08T18:33:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.745+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.745+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94288821191136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b19710 con 0x7ff5bc035020 2024-05-08T18:33:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.745+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b19f60 con 0x55c153b0dac0 2024-05-08T18:33:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.746+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94288821191136] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.746+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.746+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94288821195360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b19fc0 con 0x55c153b0dac0 2024-05-08T18:33:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.746+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1aab0 con 0x55c153b13cd0 2024-05-08T18:33:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.747+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94288821195360] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.747+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.747+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94288821200256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1aed0 con 0x55c153b13cd0 2024-05-08T18:33:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.747+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1b8f0 con 0x7ff5bc035020 2024-05-08T18:33:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.748+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94288821200256] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.748+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.748+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94288821203936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1bce0 con 0x7ff5bc035020 2024-05-08T18:33:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.748+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1c740 con 0x55c153b0dac0 2024-05-08T18:33:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.750+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94288821203936] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.750+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.750+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94288821197488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1cb30 con 0x55c153b0dac0 2024-05-08T18:33:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.750+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1d4f0 con 0x7ff5b4043be0 2024-05-08T18:33:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.751+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.751+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94288821197488] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.751+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94288821211200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1d950 con 0x7ff5b4043be0 2024-05-08T18:33:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.751+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1c260 con 0x7ff5b4043be0 2024-05-08T18:33:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.752+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94288821211200] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.752+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.752+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94288821212256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1d880 con 0x7ff5b4043be0 2024-05-08T18:33:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.752+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1e8b0 con 0x7ff5b4043be0 2024-05-08T18:33:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.753+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(58 notify.7 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.753+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94288821216192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1ecd0 con 0x7ff5b4043be0 2024-05-08T18:33:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.753+0000 7ff5c4d33800 20 add_watcher() i=0 2024-05-08T18:33:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.753+0000 7ff5c4d33800 20 add_watcher() i=1 2024-05-08T18:33:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.753+0000 7ff5c4d33800 20 add_watcher() i=2 2024-05-08T18:33:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.753+0000 7ff5c4d33800 20 add_watcher() i=3 2024-05-08T18:33:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.753+0000 7ff5c4d33800 20 add_watcher() i=4 2024-05-08T18:33:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.753+0000 7ff5c4d33800 20 add_watcher() i=5 2024-05-08T18:33:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.753+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94288821212256] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.753+0000 7ff5c4d33800 20 add_watcher() i=6 2024-05-08T18:33:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.754+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94288821216192] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.754+0000 7ff5c4d33800 20 add_watcher() i=7 2024-05-08T18:33:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.754+0000 7ff5c4d33800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.754+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1df10 con 0x55c153b0dac0 2024-05-08T18:33:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.754+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.754+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94288821217248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1df10 con 0x55c153b0dac0 2024-05-08T18:33:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.755+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94288821217248] v29'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.755+0000 7ff4777de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.755+0000 7ff5c4d33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:04.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.755+0000 7ff5c4d33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:04.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.755+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2a690 con 0x55c153b0dac0 2024-05-08T18:33:04.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.756+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.756+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2ad60 con 0x7ff5b4043be0 2024-05-08T18:33:04.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.758+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.758+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2b180 con 0x55c153b13cd0 2024-05-08T18:33:04.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.759+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.759+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2b560 con 0x55c153b0dac0 2024-05-08T18:33:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.760+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'247 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.760+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b284d0 con 0x7ff5bc035020 2024-05-08T18:33:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.761+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.761+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c060 con 0x55c153b13cd0 2024-05-08T18:33:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.762+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'52 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.762+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c060 con 0x55c153b0dac0 2024-05-08T18:33:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.763+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.763+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2bfd0 con 0x7ff5b4043be0 2024-05-08T18:33:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.764+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.764+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2bfd0 con 0x7ff5bc035020 2024-05-08T18:33:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.765+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.765+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x55c153b13cd0 2024-05-08T18:33:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.766+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.766+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x7ff5bc035020 2024-05-08T18:33:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.767+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.767+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x7ff5b4043be0 2024-05-08T18:33:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.768+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'35 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.768+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x7ff5bc035020 2024-05-08T18:33:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.769+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.769+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x7ff5b4043be0 2024-05-08T18:33:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.770+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.770+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x55c153b0dac0 2024-05-08T18:33:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.771+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'248 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.771+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x55c153b13cd0 2024-05-08T18:33:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.772+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'71 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.772+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x7ff5bc035020 2024-05-08T18:33:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.773+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.773+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x55c153b13cd0 2024-05-08T18:33:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.774+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.774+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x55c153b0dac0 2024-05-08T18:33:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.775+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.775+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x55c153b0dac0 2024-05-08T18:33:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.776+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'249 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.776+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x55c153b13cd0 2024-05-08T18:33:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.777+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'72 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.777+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x7ff5bc035020 2024-05-08T18:33:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.778+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.778+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x55c153b13cd0 2024-05-08T18:33:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.779+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.779+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x55c153b13cd0 2024-05-08T18:33:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.780+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.780+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x55c153b13cd0 2024-05-08T18:33:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.781+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'28 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.781+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x55c153b13cd0 2024-05-08T18:33:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.782+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'53 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.782+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x7ff5b4043be0 2024-05-08T18:33:04.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.783+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.783+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x55c153b13cd0 2024-05-08T18:33:04.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.784+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.784+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x7ff5b4043be0 2024-05-08T18:33:04.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.785+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.785+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x55c153b13cd0 2024-05-08T18:33:04.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.786+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'73 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.787+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x7ff5b4043be0 2024-05-08T18:33:04.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.788+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.788+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b2c450 con 0x7ff5bc035020 2024-05-08T18:33:04.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.789+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.789+0000 7ff4767dc640 20 reqs_thread_entry: start 2024-05-08T18:33:04.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.789+0000 7ff5c4d33800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:04.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.789+0000 7ff5c4d33800 20 Filter name: none 2024-05-08T18:33:04.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.789+0000 7ff3e7fff640 20 reqs_thread_entry: start 2024-05-08T18:33:04.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.790+0000 7ff5c4d33800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-05-08T18:33:04.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.790+0000 7ff5c4d33800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.790+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153b573e0 con 0x7ff5b4043be0 2024-05-08T18:33:04.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.790+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.790+0000 7ff5c4d33800 20 rados_obj.operate() r=0 bl.length=349 2024-05-08T18:33:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.790+0000 7ff5c4d33800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-05-08T18:33:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.790+0000 7ff5c4d33800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-08T18:33:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.790+0000 7ff5c4d33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:33:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.790+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153b573d0 con 0x7ff5b4043be0 2024-05-08T18:33:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.790+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.790+0000 7ff5c4d33800 10 removing key index: system_akey 2024-05-08T18:33:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.790+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b573d0 con 0x55c153b13cd0 2024-05-08T18:33:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.791+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(96 system_akey [delete] v29'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.791+0000 7ff5c4d33800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-05-08T18:33:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.792+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94288821454896 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153b5a1d0 con 0x55c153b0dac0 2024-05-08T18:33:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.792+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== watch-notify(notify (1) cookie 94288821195360 notify 124554051607 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55c153b28870 con 0x55c153b0dac0 2024-05-08T18:33:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.792+0000 7ff4a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051607 cookie 94288821195360 notifier 4844 bl.length()=161 2024-05-08T18:33:04.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.792+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(97 notify.1 [notify cookie 94288821454896 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.792+0000 7ff4a4ff9640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7ff48c003d60 con 0x55c153b0dac0 2024-05-08T18:33:04.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.792+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.792+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== watch-notify(notify_complete (2) cookie 94288821454896 notify 124554051607 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c153b2a040 con 0x55c153b0dac0 2024-05-08T18:33:04.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.792+0000 7ff5c4d33800 10 removing email index: 2024-05-08T18:33:04.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.792+0000 7ff5c4d33800 10 removing user buckets index 2024-05-08T18:33:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.792+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b57c80 con 0x7ff5b4043be0 2024-05-08T18:33:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.793+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(99 system_user.buckets [delete] v29'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.793+0000 7ff5c4d33800 10 removing user index: system_user 2024-05-08T18:33:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.793+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b57c80 con 0x7ff5b4043be0 2024-05-08T18:33:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.794+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(100 system_user [call,call,delete] v29'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.794+0000 7ff5c4d33800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-05-08T18:33:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.794+0000 7ff5c4d33800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-05-08T18:33:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.794+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94288821450704 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c153b57bf0 con 0x7ff5bc035020 2024-05-08T18:33:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.795+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 20 ==== watch-notify(notify (1) cookie 94288821191136 notify 124554051634 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55c153b2a210 con 0x7ff5bc035020 2024-05-08T18:33:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.795+0000 7ff49f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051634 cookie 94288821191136 notifier 4844 bl.length()=160 2024-05-08T18:33:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.795+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 21 ==== osd_op_reply(101 notify.0 [notify cookie 94288821450704 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.795+0000 7ff49f7fe640 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7ff3f40032c0 con 0x7ff5bc035020 2024-05-08T18:33:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.795+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 22 ==== watch-notify(notify_complete (2) cookie 94288821450704 notify 124554051634 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c153ad5600 con 0x7ff5bc035020 2024-05-08T18:33:04.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.795+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 23 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.796+0000 7ff4777de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:04.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.796+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94288821217248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153ac1d30 con 0x55c153b0dac0 2024-05-08T18:33:04.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.797+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94288821217248] v29'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.797+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94288821191136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1e7e0 con 0x7ff5bc035020 2024-05-08T18:33:04.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.798+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 24 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94288821191136] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.798+0000 7ff5c4d33800 20 remove_watcher() i=0 2024-05-08T18:33:04.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.798+0000 7ff5c4d33800 2 removed watcher, disabling cache 2024-05-08T18:33:04.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.798+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94288821195360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1e7e0 con 0x55c153b0dac0 2024-05-08T18:33:04.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.799+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94288821195360] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.799+0000 7ff5c4d33800 20 remove_watcher() i=1 2024-05-08T18:33:04.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.799+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94288821200256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b19260 con 0x55c153b13cd0 2024-05-08T18:33:04.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.800+0000 7ff5c11ef640 1 -- 172.21.15.87:0/1479090590 <== osd.3 v2:172.21.15.87:6800/2929215285 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94288821200256] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc052d70 con 0x55c153b13cd0 2024-05-08T18:33:04.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.800+0000 7ff5c4d33800 20 remove_watcher() i=2 2024-05-08T18:33:04.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.800+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94288821203936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1e7e0 con 0x7ff5bc035020 2024-05-08T18:33:04.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.801+0000 7ff5c09ee640 1 -- 172.21.15.87:0/1479090590 <== osd.2 v2:172.21.15.87:6816/2108501615 25 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94288821203936] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5b402e070 con 0x7ff5bc035020 2024-05-08T18:33:04.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.801+0000 7ff5c4d33800 20 remove_watcher() i=3 2024-05-08T18:33:04.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.801+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94288821197488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b19260 con 0x55c153b0dac0 2024-05-08T18:33:04.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.802+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.1 v2:172.21.15.87:6808/2448644045 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94288821197488] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x55c153b0dac0 2024-05-08T18:33:04.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.802+0000 7ff5c4d33800 20 remove_watcher() i=4 2024-05-08T18:33:04.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.802+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94288821211200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1b3e0 con 0x7ff5b4043be0 2024-05-08T18:33:04.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.803+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94288821211200] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.803+0000 7ff5c4d33800 20 remove_watcher() i=5 2024-05-08T18:33:04.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.803+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94288821212256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b19260 con 0x7ff5b4043be0 2024-05-08T18:33:04.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.804+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94288821212256] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.804+0000 7ff5c4d33800 20 remove_watcher() i=6 2024-05-08T18:33:04.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.804+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94288821216192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c153b1b3e0 con 0x7ff5b4043be0 2024-05-08T18:33:04.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.805+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 <== osd.0 v2:172.21.15.53:6800/443747735 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94288821216192] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5ac05a040 con 0x7ff5b4043be0 2024-05-08T18:33:04.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.805+0000 7ff5c4d33800 20 remove_watcher() i=7 2024-05-08T18:33:04.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.805+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff5b4043be0 msgr2=0x7ff5b4051610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.805+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff5b4043be0 0x7ff5b4051610 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.805+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c153b0dac0 msgr2=0x55c153b0ff80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.805+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c153b0dac0 0x55c153b0ff80 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.805+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff5bc035020 msgr2=0x7ff5bc01a970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.805+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff5bc035020 0x7ff5bc01a970 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.805+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55c153b13cd0 msgr2=0x55c153b160c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.805+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55c153b13cd0 0x55c153b160c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.805+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff48803bb50 msgr2=0x7ff48803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.805+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff48803bb50 0x7ff48803e010 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4005fd0 tx=0x7ff5b4032000 comp rx=0 tx=0).stop 2024-05-08T18:33:04.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.805+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153afa9b0 msgr2=0x55c153b02010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.805+0000 7ff5bbfff640 1 -- 172.21.15.87:0/1479090590 reap_dead start 2024-05-08T18:33:04.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.805+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153afa9b0 0x55c153b02010 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc001f40 tx=0x7ff5bc0528f0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.805+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 shutdown_connections 2024-05-08T18:33:04.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.805+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/1479090590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153afa9b0 0x55c153b02010 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 >> 172.21.15.87:0/1479090590 conn(0x55c153af6d10 msgr2=0x55c153af4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 shutdown_connections 2024-05-08T18:33:04.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 -- 172.21.15.87:0/1479090590 wait complete. 2024-05-08T18:33:04.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 -- 172.21.15.87:0/3517771671 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff49803bba0 msgr2=0x7ff49803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/3517771671 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff49803bba0 0x7ff49803e060 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff5b401dfd0 tx=0x7ff5b4005f20 comp rx=0 tx=0).stop 2024-05-08T18:33:04.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 -- 172.21.15.87:0/3517771671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153aed6d0 msgr2=0x55c153aedaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/3517771671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153aed6d0 0x55c153aedaf0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x55c153ad3580 tx=0x7ff5bc0178e0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 -- 172.21.15.87:0/3517771671 shutdown_connections 2024-05-08T18:33:04.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/3517771671 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff49803bba0 0x7ff49803e060 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/3517771671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c153aed6d0 0x55c153aedaf0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 -- 172.21.15.87:0/3517771671 >> 172.21.15.87:0/3517771671 conn(0x55c153ae1770 msgr2=0x55c153ae1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 -- 172.21.15.87:0/3517771671 shutdown_connections 2024-05-08T18:33:04.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 -- 172.21.15.87:0/3517771671 wait complete. 2024-05-08T18:33:04.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 -- 172.21.15.87:0/887852113 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55c153adcb60 msgr2=0x55c153adef50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55c153adcb60 0x55c153adef50 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 -- 172.21.15.87:0/887852113 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c1539dd860 msgr2=0x55c153ad93c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c1539dd860 0x55c153ad93c0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 -- 172.21.15.87:0/887852113 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff4a803bb50 msgr2=0x7ff4a803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff4a803bb50 0x7ff4a803e010 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac054000 tx=0x7ff5ac04e000 comp rx=0 tx=0).stop 2024-05-08T18:33:04.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 -- 172.21.15.87:0/887852113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539d9d50 msgr2=0x55c153ad2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539d9d50 0x55c153ad2180 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400b5f0 tx=0x7ff5b4000bc0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 -- 172.21.15.87:0/887852113 shutdown_connections 2024-05-08T18:33:04.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55c1539dd860 0x55c153ad93c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55c153adcb60 0x55c153adef50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff4a803bb50 0x7ff4a803e010 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 --2- 172.21.15.87:0/887852113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1539d9d50 0x55c153ad2180 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 -- 172.21.15.87:0/887852113 >> 172.21.15.87:0/887852113 conn(0x55c1539d3720 msgr2=0x55c153ac4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.806+0000 7ff5c4d33800 1 -- 172.21.15.87:0/887852113 shutdown_connections 2024-05-08T18:33:04.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.807+0000 7ff5c4d33800 1 -- 172.21.15.87:0/887852113 wait complete. 2024-05-08T18:33:04.813 ERROR:root:None 2024-05-08T18:33:04.813 ERROR:root:0 2024-05-08T18:33:04.814 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-05-08T18:33:04.814 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-05-08T18:33:04.814 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-05-08T18:33:04.870 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:04.870 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:04.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.869+0000 7f4c90f1f800 1 Processor -- start 2024-05-08T18:33:04.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.869+0000 7f4c90f1f800 1 -- start start 2024-05-08T18:33:04.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.869+0000 7f4c90f1f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b0076bae00 0x55b0076b9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.870+0000 7f4c90f1f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b0076b9d50 con 0x55b0076b98a0 2024-05-08T18:33:04.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.870+0000 7f4c90f1f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b0075e5e20 con 0x55b0076bae00 2024-05-08T18:33:04.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.870+0000 7f4c8cbc3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b0076bae00 0x55b0076b9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.870+0000 7f4c8cbc3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b0076bae00 0x55b0076b9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52644/0 (socket says 172.21.15.87:52644) 2024-05-08T18:33:04.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.870+0000 7f4c843c2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55b0076b98a0 0x55b00774d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58206/0 (socket says 172.21.15.87:58206) 2024-05-08T18:33:04.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.870+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/287748212 learned_addr learned my addr 172.21.15.87:0/287748212 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.870+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/287748212 >> v1:172.21.15.53:6789/0 conn(0x55b0076b98a0 legacy=0x55b00774d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.870+0000 7f4c87fff640 1 -- 172.21.15.87:0/287748212 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1971065917 0 0) 0x55b0076b9d50 con 0x55b0076b98a0 2024-05-08T18:33:04.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.870+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/287748212 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0076b9f70 con 0x55b0076bae00 2024-05-08T18:33:04.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.872+0000 7f4c8cbc3640 1 --2- 172.21.15.87:0/287748212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076bae00 0x55b0076b9360 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00a520 tx=0x7f4c7c01d0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1bc6db36cae0f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.872+0000 7f4c87fff640 1 -- 172.21.15.87:0/287748212 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7c057070 con 0x55b0076bae00 2024-05-08T18:33:04.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.872+0000 7f4c87fff640 1 -- 172.21.15.87:0/287748212 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7c052570 con 0x55b0076bae00 2024-05-08T18:33:04.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.872+0000 7f4c87fff640 1 -- 172.21.15.87:0/287748212 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7c052870 con 0x55b0076bae00 2024-05-08T18:33:04.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.873+0000 7f4c90f1f800 1 -- 172.21.15.87:0/287748212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076bae00 msgr2=0x55b0076b9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.873+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/287748212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076bae00 0x55b0076b9360 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00a520 tx=0x7f4c7c01d0a0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.873+0000 7f4c90f1f800 1 -- 172.21.15.87:0/287748212 shutdown_connections 2024-05-08T18:33:04.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.873+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/287748212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076bae00 0x55b0076b9360 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.873+0000 7f4c90f1f800 1 -- 172.21.15.87:0/287748212 >> 172.21.15.87:0/287748212 conn(0x55b007740870 msgr2=0x55b007742cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.873+0000 7f4c90f1f800 1 -- 172.21.15.87:0/287748212 shutdown_connections 2024-05-08T18:33:04.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.873+0000 7f4c90f1f800 1 -- 172.21.15.87:0/287748212 wait complete. 2024-05-08T18:33:04.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.886+0000 7f4c90f1f800 1 Processor -- start 2024-05-08T18:33:04.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.886+0000 7f4c90f1f800 1 -- start start 2024-05-08T18:33:04.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.886+0000 7f4c90f1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076b98a0 0x55b007838720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.886+0000 7f4c90f1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b0076906b0 con 0x55b0076b98a0 2024-05-08T18:33:04.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.886+0000 7f4c8cbc3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076b98a0 0x55b007838720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.886+0000 7f4c8cbc3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076b98a0 0x55b007838720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52648/0 (socket says 172.21.15.87:52648) 2024-05-08T18:33:04.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.886+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2517900440 learned_addr learned my addr 172.21.15.87:0/2517900440 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.887+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2517900440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b007838cf0 con 0x55b0076b98a0 2024-05-08T18:33:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.887+0000 7f4c8cbc3640 1 --2- 172.21.15.87:0/2517900440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076b98a0 0x55b007838720 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00a520 tx=0x7f4c7c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e3b585dbb9217c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.887+0000 7f4b7ae0d640 1 -- 172.21.15.87:0/2517900440 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7c062070 con 0x55b0076b98a0 2024-05-08T18:33:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.887+0000 7f4b7ae0d640 1 -- 172.21.15.87:0/2517900440 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7c052850 con 0x55b0076b98a0 2024-05-08T18:33:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.887+0000 7f4b7ae0d640 1 -- 172.21.15.87:0/2517900440 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7c057040 con 0x55b0076b98a0 2024-05-08T18:33:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.888+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2517900440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076b98a0 msgr2=0x55b007838720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.888+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/2517900440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076b98a0 0x55b007838720 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00a520 tx=0x7f4c7c04c000 comp rx=0 tx=0).stop 2024-05-08T18:33:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.888+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2517900440 shutdown_connections 2024-05-08T18:33:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.888+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/2517900440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076b98a0 0x55b007838720 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.888+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2517900440 >> 172.21.15.87:0/2517900440 conn(0x55b007740870 msgr2=0x55b007834040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.888+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2517900440 shutdown_connections 2024-05-08T18:33:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.888+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2517900440 wait complete. 2024-05-08T18:33:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.888+0000 7f4c90f1f800 1 Processor -- start 2024-05-08T18:33:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.888+0000 7f4c90f1f800 1 -- start start 2024-05-08T18:33:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.888+0000 7f4c90f1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076b98a0 0x55b0078401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.888+0000 7f4c90f1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b007750b70 con 0x55b0076b98a0 2024-05-08T18:33:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.888+0000 7f4c8cbc3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076b98a0 0x55b0078401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.888+0000 7f4c8cbc3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076b98a0 0x55b0078401d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52654/0 (socket says 172.21.15.87:52654) 2024-05-08T18:33:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.888+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/3672208395 learned_addr learned my addr 172.21.15.87:0/3672208395 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.889+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/3672208395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b007840710 con 0x55b0076b98a0 2024-05-08T18:33:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.889+0000 7f4c8cbc3640 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076b98a0 0x55b0078401d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00a520 tx=0x7f4c7c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.889+0000 7f4b7960a640 1 -- 172.21.15.87:0/3672208395 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7c057050 con 0x55b0076b98a0 2024-05-08T18:33:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.889+0000 7f4b7960a640 1 -- 172.21.15.87:0/3672208395 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7c067660 con 0x55b0076b98a0 2024-05-08T18:33:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.889+0000 7f4c90f1f800 1 -- 172.21.15.87:0/3672208395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0078409a0 con 0x55b0076b98a0 2024-05-08T18:33:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.889+0000 7f4b7960a640 1 -- 172.21.15.87:0/3672208395 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7c062040 con 0x55b0076b98a0 2024-05-08T18:33:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.889+0000 7f4c90f1f800 1 -- 172.21.15.87:0/3672208395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b007843650 con 0x55b0076b98a0 2024-05-08T18:33:04.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.890+0000 7f4b7960a640 1 -- 172.21.15.87:0/3672208395 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4c7c067960 con 0x55b0076b98a0 2024-05-08T18:33:04.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.890+0000 7f4b7960a640 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b7403bba0 0x7f4b7403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.890+0000 7f4b7960a640 1 -- 172.21.15.87:0/3672208395 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f4c7c0946f0 con 0x55b0076b98a0 2024-05-08T18:33:04.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.890+0000 7f4c843c2640 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b7403bba0 0x7f4b7403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.890+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b0076bae00 0x55b007847410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.890+0000 7f4c90f1f800 1 -- 172.21.15.87:0/3672208395 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b007847950 con 0x55b0076bae00 2024-05-08T18:33:04.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.891+0000 7f4c8d3c4640 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b0076bae00 0x55b007847410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.891+0000 7f4c843c2640 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b7403bba0 0x7f4b7403e060 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4c74000c00 tx=0x7f4c740013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.891+0000 7f4c8d3c4640 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b0076bae00 0x55b007847410 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.891+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/3672208395 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c8800a4a0 con 0x55b0076bae00 2024-05-08T18:33:04.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.891+0000 7f4c90f1f800 1 -- 172.21.15.87:0/3672208395 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b007844990 con 0x55b0076bae00 2024-05-08T18:33:04.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.891+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/3672208395 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c8800a4a0 con 0x55b0076bae00 2024-05-08T18:33:04.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.891+0000 7f4c90f1f800 1 -- 172.21.15.87:0/3672208395 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b0078496b0 con 0x55b0076bae00 2024-05-08T18:33:04.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.892+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/3672208395 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4c8800a4a0 con 0x55b0076bae00 2024-05-08T18:33:04.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.892+0000 7f4c90f1f800 1 -- 172.21.15.87:0/3672208395 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b007848910 con 0x55b0076bae00 2024-05-08T18:33:04.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.892+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/3672208395 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c8800a4a0 con 0x55b0076bae00 2024-05-08T18:33:04.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.892+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b00784aa60 0x55b00784ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.892+0000 7f4c90f1f800 1 -- 172.21.15.87:0/3672208395 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b00784d390 con 0x55b00784aa60 2024-05-08T18:33:04.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.892+0000 7f4c8cbc3640 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b00784aa60 0x55b00784ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.893+0000 7f4c8cbc3640 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b00784aa60 0x55b00784ce50 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.893+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/3672208395 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4c7c064070 con 0x55b00784aa60 2024-05-08T18:33:04.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.893+0000 7f4c90f1f800 1 Processor -- start 2024-05-08T18:33:04.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.893+0000 7f4c90f1f800 1 -- start start 2024-05-08T18:33:04.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.893+0000 7f4c90f1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b00785b5d0 0x55b00785b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.893+0000 7f4c90f1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b007636fc0 con 0x55b00785b5d0 2024-05-08T18:33:04.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.894+0000 7f4c8d3c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b00785b5d0 0x55b00785b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.894+0000 7f4c8d3c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b00785b5d0 0x55b00785b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52656/0 (socket says 172.21.15.87:52656) 2024-05-08T18:33:04.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.894+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2490269941 learned_addr learned my addr 172.21.15.87:0/2490269941 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.894+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2490269941 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b00785bf30 con 0x55b00785b5d0 2024-05-08T18:33:04.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.894+0000 7f4c8d3c4640 1 --2- 172.21.15.87:0/2490269941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b00785b5d0 0x55b00785b9f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x55b007840ff0 tx=0x7f4c880178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.894+0000 7f4b727fc640 1 -- 172.21.15.87:0/2490269941 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c88013440 con 0x55b00785b5d0 2024-05-08T18:33:04.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.894+0000 7f4b727fc640 1 -- 172.21.15.87:0/2490269941 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c880135e0 con 0x55b00785b5d0 2024-05-08T18:33:04.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.894+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2490269941 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b00785c9a0 con 0x55b00785b5d0 2024-05-08T18:33:04.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.894+0000 7f4b727fc640 1 -- 172.21.15.87:0/2490269941 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c880138c0 con 0x55b00785b5d0 2024-05-08T18:33:04.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.894+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2490269941 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b00785cea0 con 0x55b00785b5d0 2024-05-08T18:33:04.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.895+0000 7f4b727fc640 1 -- 172.21.15.87:0/2490269941 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4c88011040 con 0x55b00785b5d0 2024-05-08T18:33:04.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.895+0000 7f4b727fc640 1 --2- 172.21.15.87:0/2490269941 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b6403bba0 0x7f4b6403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.895+0000 7f4b727fc640 1 -- 172.21.15.87:0/2490269941 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f4c8801d070 con 0x55b00785b5d0 2024-05-08T18:33:04.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.895+0000 7f4c8cbc3640 1 --2- 172.21.15.87:0/2490269941 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b6403bba0 0x7f4b6403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.896+0000 7f4c90f1f800 1 Processor -- start 2024-05-08T18:33:04.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.896+0000 7f4c8cbc3640 1 --2- 172.21.15.87:0/2490269941 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b6403bba0 0x7f4b6403e060 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55b007848cb0 tx=0x7f4c7c0929d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.896+0000 7f4c90f1f800 1 -- start start 2024-05-08T18:33:04.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.896+0000 7f4c90f1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0078688b0 0x55b007868cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.896+0000 7f4c90f1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b007838fb0 con 0x55b0078688b0 2024-05-08T18:33:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.896+0000 7f4c8d3c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0078688b0 0x55b007868cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.896+0000 7f4c8d3c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0078688b0 0x55b007868cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52662/0 (socket says 172.21.15.87:52662) 2024-05-08T18:33:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.896+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/1691855381 learned_addr learned my addr 172.21.15.87:0/1691855381 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.896+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/1691855381 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0078692a0 con 0x55b0078688b0 2024-05-08T18:33:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.897+0000 7f4c8d3c4640 1 --2- 172.21.15.87:0/1691855381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0078688b0 0x55b007868cd0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800b010 tx=0x7f4c88029430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc06c0e10eb07dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.897+0000 7f4b63fff640 1 -- 172.21.15.87:0/1691855381 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c88021d70 con 0x55b0078688b0 2024-05-08T18:33:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.897+0000 7f4b63fff640 1 -- 172.21.15.87:0/1691855381 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c8802ac50 con 0x55b0078688b0 2024-05-08T18:33:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.897+0000 7f4b63fff640 1 -- 172.21.15.87:0/1691855381 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c880157b0 con 0x55b0078688b0 2024-05-08T18:33:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.897+0000 7f4c90f1f800 1 -- 172.21.15.87:0/1691855381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0078688b0 msgr2=0x55b007868cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.897+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/1691855381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0078688b0 0x55b007868cd0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800b010 tx=0x7f4c88029430 comp rx=0 tx=0).stop 2024-05-08T18:33:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.897+0000 7f4c90f1f800 1 -- 172.21.15.87:0/1691855381 shutdown_connections 2024-05-08T18:33:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.897+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/1691855381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0078688b0 0x55b007868cd0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.897+0000 7f4c90f1f800 1 -- 172.21.15.87:0/1691855381 >> 172.21.15.87:0/1691855381 conn(0x55b007864c10 msgr2=0x55b007862c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.897+0000 7f4c90f1f800 1 -- 172.21.15.87:0/1691855381 shutdown_connections 2024-05-08T18:33:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.897+0000 7f4c90f1f800 1 -- 172.21.15.87:0/1691855381 wait complete. 2024-05-08T18:33:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.898+0000 7f4c90f1f800 1 Processor -- start 2024-05-08T18:33:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.898+0000 7f4c90f1f800 1 -- start start 2024-05-08T18:33:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.898+0000 7f4c90f1f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0078688b0 0x55b00786ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.898+0000 7f4c90f1f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b007869a10 con 0x55b0078688b0 2024-05-08T18:33:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.898+0000 7f4c8d3c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0078688b0 0x55b00786ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.898+0000 7f4c8d3c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0078688b0 0x55b00786ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52664/0 (socket says 172.21.15.87:52664) 2024-05-08T18:33:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.898+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 learned_addr learned my addr 172.21.15.87:0/2662191646 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.898+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b007870450 con 0x55b0078688b0 2024-05-08T18:33:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.898+0000 7f4c8d3c4640 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0078688b0 0x55b00786ff10 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f4c88051880 tx=0x7f4c8800a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.898+0000 7f4b627fc640 1 -- 172.21.15.87:0/2662191646 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c88030070 con 0x55b0078688b0 2024-05-08T18:33:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.899+0000 7f4b627fc640 1 -- 172.21.15.87:0/2662191646 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c880542e0 con 0x55b0078688b0 2024-05-08T18:33:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.899+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0078706e0 con 0x55b0078688b0 2024-05-08T18:33:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.899+0000 7f4b627fc640 1 -- 172.21.15.87:0/2662191646 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c88013a60 con 0x55b0078688b0 2024-05-08T18:33:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.899+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b007873390 con 0x55b0078688b0 2024-05-08T18:33:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.899+0000 7f4b627fc640 1 -- 172.21.15.87:0/2662191646 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4c88033070 con 0x55b0078688b0 2024-05-08T18:33:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.900+0000 7f4b627fc640 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b5803bba0 0x7f4b5803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.900+0000 7f4b627fc640 1 -- 172.21.15.87:0/2662191646 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f4c88040050 con 0x55b0078688b0 2024-05-08T18:33:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.900+0000 7f4c8cbc3640 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b5803bba0 0x7f4b5803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.900+0000 7f4c8cbc3640 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b5803bba0 0x7f4b5803e060 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c005400 tx=0x7f4c7c08f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.900+0000 7f4c90f1f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.900+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b00787b970 0x55b00787de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.900+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b00787e580 con 0x55b00787b970 2024-05-08T18:33:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.900+0000 7f4c843c2640 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b00787b970 0x55b00787de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.901+0000 7f4c843c2640 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b00787b970 0x55b00787de30 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.901+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c7400f5f0 con 0x55b00787b970 2024-05-08T18:33:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.901+0000 7f4c90f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.901+0000 7f4c90f1f800 20 realm 2024-05-08T18:33:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.901+0000 7f4c90f1f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.901+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b00787adc0 con 0x55b00787b970 2024-05-08T18:33:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.901+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c7400f5f0 con 0x55b00787b970 2024-05-08T18:33:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.901+0000 7f4c90f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.901+0000 7f4c90f1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.901+0000 7f4c90f1f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.901+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b00787f070 con 0x55b00787b970 2024-05-08T18:33:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.901+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c7400f5f0 con 0x55b00787b970 2024-05-08T18:33:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.901+0000 7f4c90f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.901+0000 7f4c90f1f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.901+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b00787f940 con 0x55b00787b970 2024-05-08T18:33:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.902+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c7400f5f0 con 0x55b00787b970 2024-05-08T18:33:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.902+0000 7f4c90f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.902+0000 7f4c90f1f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.902+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b00787fce0 con 0x55b00787b970 2024-05-08T18:33:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.902+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4c7400f5f0 con 0x55b00787b970 2024-05-08T18:33:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.902+0000 7f4c90f1f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:04.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.902+0000 7f4c90f1f800 20 searching for the correct realm 2024-05-08T18:33:04.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.902+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b007881c10 0x55b007884020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.902+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x55b007881c10 2024-05-08T18:33:04.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.902+0000 7f4c8d3c4640 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b007881c10 0x55b007884020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.902+0000 7f4c8d3c4640 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b007881c10 0x55b007884020 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.903+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.903+0000 7f4c8d3c4640 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c88035070 0x7f4c880123a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.903+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x7f4c88035070 2024-05-08T18:33:04.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.903+0000 7f4c8cbc3640 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c88035070 0x7f4c880123a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.903+0000 7f4c8cbc3640 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c88035070 0x7f4c880123a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.904+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c064070 con 0x7f4c88035070 2024-05-08T18:33:04.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.904+0000 7f4c8cbc3640 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c7c05b7a0 0x7f4c7c05c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:04.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.904+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.904+0000 7f4c843c2640 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c7c05b7a0 0x7f4c7c05c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.904+0000 7f4c843c2640 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c7c05b7a0 0x7f4c7c05c600 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.905+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7400f5f0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.905+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x55b00787b970 2024-05-08T18:33:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.905+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7400f5f0 con 0x55b00787b970 2024-05-08T18:33:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.905+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x55b00787b970 2024-05-08T18:33:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.905+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7400f5f0 con 0x55b00787b970 2024-05-08T18:33:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.905+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.905+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4c7400f5f0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.905+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.906+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7400f5f0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.906+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x7f4c88035070 2024-05-08T18:33:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.906+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c064070 con 0x7f4c88035070 2024-05-08T18:33:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.906+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x55b007881c10 2024-05-08T18:33:04.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.906+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.906+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x55b00787b970 2024-05-08T18:33:04.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.906+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7400f5f0 con 0x55b00787b970 2024-05-08T18:33:04.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.906+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.906+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7400f5f0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.906+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x55b00787b970 2024-05-08T18:33:04.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.907+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7400f5f0 con 0x55b00787b970 2024-05-08T18:33:04.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.907+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x7f4c88035070 2024-05-08T18:33:04.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.907+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4c7c064070 con 0x7f4c88035070 2024-05-08T18:33:04.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.907+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x55b007881c10 2024-05-08T18:33:04.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.907+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.907+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x55b007881c10 2024-05-08T18:33:04.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.907+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.907+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.908+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7400f5f0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.908+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x55b007881c10 2024-05-08T18:33:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.908+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.908+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x55b007881c10 2024-05-08T18:33:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.908+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.908+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x55b00787b970 2024-05-08T18:33:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.908+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7400f5f0 con 0x55b00787b970 2024-05-08T18:33:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.908+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x55b00787b970 2024-05-08T18:33:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.909+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v29'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f4c7400f5f0 con 0x55b00787b970 2024-05-08T18:33:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.909+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.909+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7400f5f0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.909+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x55b007881c10 2024-05-08T18:33:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.910+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.910+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x7f4c88035070 2024-05-08T18:33:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.910+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c064070 con 0x7f4c88035070 2024-05-08T18:33:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.910+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x55b00787b970 2024-05-08T18:33:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.910+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7400f5f0 con 0x55b00787b970 2024-05-08T18:33:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.910+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.910+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7403b040 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.910+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x55b007881c10 2024-05-08T18:33:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.911+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.911+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x7f4c88035070 2024-05-08T18:33:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.911+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c064070 con 0x7f4c88035070 2024-05-08T18:33:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.911+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x7f4c88035070 2024-05-08T18:33:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.911+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c064070 con 0x7f4c88035070 2024-05-08T18:33:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.911+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x55b007881c10 2024-05-08T18:33:04.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.911+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.911+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x7f4c88035070 2024-05-08T18:33:04.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.911+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c064070 con 0x7f4c88035070 2024-05-08T18:33:04.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.911+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x55b00787b970 2024-05-08T18:33:04.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4c7403b040 con 0x55b00787b970 2024-05-08T18:33:04.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b0078846f0 con 0x7f4c88035070 2024-05-08T18:33:04.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c064070 con 0x7f4c88035070 2024-05-08T18:33:04.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c90f1f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:04.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c90f1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:04.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c90f1f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:04.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c90f1f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:04.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c90f1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:04.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c90f1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:04.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c90f1f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b007880680 con 0x55b00787b970 2024-05-08T18:33:04.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x55b00787b970 2024-05-08T18:33:04.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c90f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c90f1f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b007880f20 con 0x55b00787b970 2024-05-08T18:33:04.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c7403b040 con 0x55b00787b970 2024-05-08T18:33:04.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c90f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:04.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c90f1f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.912+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b007884b70 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4c7403b040 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c90f1f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c90f1f800 20 zone default found 2024-05-08T18:33:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c90f1f800 4 Realm: () 2024-05-08T18:33:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c90f1f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c90f1f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c90f1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c90f1f800 20 zonegroup default 2024-05-08T18:33:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c90f1f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b007880b60 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c90f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c90f1f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b007886a80 con 0x55b007881c10 2024-05-08T18:33:04.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c90f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c90f1f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.913+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b007886e20 con 0x55b007881c10 2024-05-08T18:33:04.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.914+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.914+0000 7f4c90f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.914+0000 7f4c90f1f800 20 started sync module instance, tier type = 2024-05-08T18:33:04.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.914+0000 7f4c90f1f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:04.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.914+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b007885f20 con 0x7f4c88035070 2024-05-08T18:33:04.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.915+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c064070 con 0x7f4c88035070 2024-05-08T18:33:04.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.915+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94214528983824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b007887760 con 0x7f4c88035070 2024-05-08T18:33:04.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.915+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b007887fb0 con 0x55b00787b970 2024-05-08T18:33:04.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.916+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94214528983824] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c064070 con 0x7f4c88035070 2024-05-08T18:33:04.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.916+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x55b00787b970 2024-05-08T18:33:04.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.916+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94214528987824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b007887fb0 con 0x55b00787b970 2024-05-08T18:33:04.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.916+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b007888ad0 con 0x55b007881c10 2024-05-08T18:33:04.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.917+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94214528987824] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x55b00787b970 2024-05-08T18:33:04.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.917+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.917+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94214528989952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b007887f20 con 0x55b007881c10 2024-05-08T18:33:04.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.917+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b007889990 con 0x7f4c88035070 2024-05-08T18:33:04.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.918+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94214528989952] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.918+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c064070 con 0x7f4c88035070 2024-05-08T18:33:04.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.918+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94214528996576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b007889d30 con 0x7f4c88035070 2024-05-08T18:33:04.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.918+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b00788a750 con 0x55b00787b970 2024-05-08T18:33:04.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.919+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94214528996576] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c064070 con 0x7f4c88035070 2024-05-08T18:33:04.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.919+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x55b00787b970 2024-05-08T18:33:04.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.919+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94214529000000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b00788ab40 con 0x55b00787b970 2024-05-08T18:33:04.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.919+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b00788b500 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.920+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94214529000000] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x55b00787b970 2024-05-08T18:33:04.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.920+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.920+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94214528995008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b00788b500 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.920+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b00788bf40 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.921+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94214528995008] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.921+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.921+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94214529003600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b00788bf40 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.922+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b00788c900 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.922+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94214529003600] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.923+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.923+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94214529009200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b00788bf40 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.923+0000 7f4c90f1f800 20 add_watcher() i=0 2024-05-08T18:33:04.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.923+0000 7f4c90f1f800 20 add_watcher() i=1 2024-05-08T18:33:04.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.923+0000 7f4c90f1f800 20 add_watcher() i=2 2024-05-08T18:33:04.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.923+0000 7f4c90f1f800 20 add_watcher() i=3 2024-05-08T18:33:04.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.923+0000 7f4c90f1f800 20 add_watcher() i=4 2024-05-08T18:33:04.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.923+0000 7f4c90f1f800 20 add_watcher() i=5 2024-05-08T18:33:04.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.923+0000 7f4c90f1f800 20 add_watcher() i=6 2024-05-08T18:33:04.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.925+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94214529009200] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.925+0000 7f4c90f1f800 20 add_watcher() i=7 2024-05-08T18:33:04.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.925+0000 7f4c90f1f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:04.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.925+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b00788fd50 con 0x55b00787b970 2024-05-08T18:33:04.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.926+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4c7403b040 con 0x55b00787b970 2024-05-08T18:33:04.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.926+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94214529006688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b00788d250 con 0x55b00787b970 2024-05-08T18:33:04.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.927+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94214529006688] v29'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x55b00787b970 2024-05-08T18:33:04.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.927+0000 7f4b42fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:04.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.927+0000 7f4c90f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:04.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.927+0000 7f4c90f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:04.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.927+0000 7f4c90f1f800 5 note: GC not initialized 2024-05-08T18:33:04.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.927+0000 7f4b41fe3640 20 reqs_thread_entry: start 2024-05-08T18:33:04.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.927+0000 7f4c90f1f800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:04.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.927+0000 7f4c90f1f800 20 Filter name: none 2024-05-08T18:33:04.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4ab37fe640 20 reqs_thread_entry: start 2024-05-08T18:33:04.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4c90f1f800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-05-08T18:33:04.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4c90f1f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b0078c3290 con 0x55b007881c10 2024-05-08T18:33:04.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4c90f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4c90f1f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-05-08T18:33:04.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4c90f1f800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-08T18:33:04.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4c90f1f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-05-08T18:33:04.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4c90f1f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:04.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b0078c1a30 con 0x55b007881c10 2024-05-08T18:33:04.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4c90f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:04.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4c90f1f800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-05-08T18:33:04.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4c90f1f800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-08T18:33:04.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4c90f1f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-05-08T18:33:04.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4c90f1f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-05-08T18:33:04.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.928+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b0078c22d0 con 0x55b007881c10 2024-05-08T18:33:04.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.929+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v29'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.929+0000 7f4c90f1f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-05-08T18:33:04.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.929+0000 7f4c90f1f800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-08T18:33:04.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.929+0000 7f4c90f1f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-05-08T18:33:04.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.929+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94214529228320 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b0078c6720 con 0x55b007881c10 2024-05-08T18:33:04.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.929+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== watch-notify(notify (1) cookie 94214528989952 notify 124554051595 ret 0) ==== 584+0+0 (crc 0 0 0) 0x55b0078c2ce0 con 0x55b007881c10 2024-05-08T18:33:04.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.929+0000 7f4b63fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051595 cookie 94214528989952 notifier 4851 bl.length()=542 2024-05-08T18:33:04.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.929+0000 7f4b63fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-05-08T18:33:04.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.929+0000 7f4b63fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-08T18:33:04.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.929+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(65 notify.2 [notify cookie 94214529228320 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.929+0000 7f4b63fff640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f4b50003ea0 con 0x55b007881c10 2024-05-08T18:33:04.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.930+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.930+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== watch-notify(notify_complete (2) cookie 94214529228320 notify 124554051595 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b007870450 con 0x55b007881c10 2024-05-08T18:33:04.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.930+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b0078c1dd0 con 0x55b007881c10 2024-05-08T18:33:04.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.931+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v29'5 uv5 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.931+0000 7f4c90f1f800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-05-08T18:33:04.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.931+0000 7f4c90f1f800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-08T18:33:04.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.931+0000 7f4c90f1f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-05-08T18:33:04.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.931+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94214529228240 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b0078c6b50 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.931+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== watch-notify(notify (1) cookie 94214528995008 notify 124554051614 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7f4c74018040 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.931+0000 7f4b63fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051614 cookie 94214528995008 notifier 4851 bl.length()=175 2024-05-08T18:33:04.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.931+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(68 notify.5 [notify cookie 94214529228240 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4c7403b040 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.931+0000 7f4b63fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-05-08T18:33:04.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.931+0000 7f4b63fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-08T18:33:04.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.931+0000 7f4b63fff640 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f4b50003ea0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.932+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.932+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== watch-notify(notify_complete (2) cookie 94214529228240 notify 124554051614 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4c7403f9c0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.941 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-05-08T18:33:04.929345Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:33:04.929332Z","tags":[],"group_ids":[]} 2024-05-08T18:33:04.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.932+0000 7f4b42fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:04.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.933+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94214529006688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b00788f930 con 0x55b00787b970 2024-05-08T18:33:04.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.934+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94214529006688] v29'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x55b00787b970 2024-05-08T18:33:04.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.934+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94214528983824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b00788bc30 con 0x7f4c88035070 2024-05-08T18:33:04.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.935+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94214528983824] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c064070 con 0x7f4c88035070 2024-05-08T18:33:04.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.935+0000 7f4c90f1f800 20 remove_watcher() i=0 2024-05-08T18:33:04.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.935+0000 7f4c90f1f800 2 removed watcher, disabling cache 2024-05-08T18:33:04.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.935+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94214528987824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b007886310 con 0x55b00787b970 2024-05-08T18:33:04.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.936+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94214528987824] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x55b00787b970 2024-05-08T18:33:04.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.936+0000 7f4c90f1f800 20 remove_watcher() i=1 2024-05-08T18:33:04.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.936+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94214528989952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b0078872b0 con 0x55b007881c10 2024-05-08T18:33:04.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.937+0000 7f4c8d3c4640 1 -- 172.21.15.87:0/2662191646 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94214528989952] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c88032030 con 0x55b007881c10 2024-05-08T18:33:04.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.937+0000 7f4c90f1f800 20 remove_watcher() i=2 2024-05-08T18:33:04.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.937+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94214528996576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b0078872b0 con 0x7f4c88035070 2024-05-08T18:33:04.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.938+0000 7f4c8cbc3640 1 -- 172.21.15.87:0/2662191646 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94214528996576] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c064070 con 0x7f4c88035070 2024-05-08T18:33:04.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.938+0000 7f4c90f1f800 20 remove_watcher() i=3 2024-05-08T18:33:04.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.938+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94214529000000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b0078894e0 con 0x55b00787b970 2024-05-08T18:33:04.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.939+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94214529000000] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x55b00787b970 2024-05-08T18:33:04.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.939+0000 7f4c90f1f800 20 remove_watcher() i=4 2024-05-08T18:33:04.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.939+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94214528995008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b0078872b0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.940+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94214528995008] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.940+0000 7f4c90f1f800 20 remove_watcher() i=5 2024-05-08T18:33:04.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.940+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94214529003600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b0078894e0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.940+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94214529003600] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.940+0000 7f4c90f1f800 20 remove_watcher() i=6 2024-05-08T18:33:04.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.941+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94214529009200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b0078872b0 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94214529009200] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7403b040 con 0x7f4c7c05b7a0 2024-05-08T18:33:04.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 20 remove_watcher() i=7 2024-05-08T18:33:04.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c7c05b7a0 msgr2=0x7f4c7c05c600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f4c7c05b7a0 0x7f4c7c05c600 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b00787b970 msgr2=0x55b00787de30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b00787b970 0x55b00787de30 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c88035070 msgr2=0x7f4c880123a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f4c88035070 0x7f4c880123a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b007881c10 msgr2=0x55b007884020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55b007881c10 0x55b007884020 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b5803bba0 msgr2=0x7f4b5803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b5803bba0 0x7f4b5803e060 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c005400 tx=0x7f4c7c08f000 comp rx=0 tx=0).stop 2024-05-08T18:33:04.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0078688b0 msgr2=0x55b00786ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0078688b0 0x55b00786ff10 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f4c88051880 tx=0x7f4c8800a0e0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c843c2640 1 -- 172.21.15.87:0/2662191646 reap_dead start 2024-05-08T18:33:04.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 shutdown_connections 2024-05-08T18:33:04.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/2662191646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0078688b0 0x55b00786ff10 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 >> 172.21.15.87:0/2662191646 conn(0x55b007864c10 msgr2=0x55b007862270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 shutdown_connections 2024-05-08T18:33:04.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.942+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2662191646 wait complete. 2024-05-08T18:33:04.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2490269941 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b6403bba0 msgr2=0x7f4b6403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/2490269941 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b6403bba0 0x7f4b6403e060 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55b007848cb0 tx=0x7f4c7c0929d0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2490269941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b00785b5d0 msgr2=0x55b00785b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/2490269941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b00785b5d0 0x55b00785b9f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x55b007840ff0 tx=0x7f4c880178e0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2490269941 shutdown_connections 2024-05-08T18:33:04.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/2490269941 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b6403bba0 0x7f4b6403e060 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/2490269941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b00785b5d0 0x55b00785b9f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2490269941 >> 172.21.15.87:0/2490269941 conn(0x55b00784f670 msgr2=0x55b00784fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2490269941 shutdown_connections 2024-05-08T18:33:04.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 -- 172.21.15.87:0/2490269941 wait complete. 2024-05-08T18:33:04.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 -- 172.21.15.87:0/3672208395 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b00784aa60 msgr2=0x55b00784ce50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b00784aa60 0x55b00784ce50 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 -- 172.21.15.87:0/3672208395 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b0076bae00 msgr2=0x55b007847410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b0076bae00 0x55b007847410 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 -- 172.21.15.87:0/3672208395 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b7403bba0 msgr2=0x7f4b7403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b7403bba0 0x7f4b7403e060 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4c74000c00 tx=0x7f4c740013b0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 -- 172.21.15.87:0/3672208395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076b98a0 msgr2=0x55b0078401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:04.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076b98a0 0x55b0078401d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00a520 tx=0x7f4c7c002fb0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 -- 172.21.15.87:0/3672208395 shutdown_connections 2024-05-08T18:33:04.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55b0076bae00 0x55b007847410 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55b00784aa60 0x55b00784ce50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f4b7403bba0 0x7f4b7403e060 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 --2- 172.21.15.87:0/3672208395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0076b98a0 0x55b0078401d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:04.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 -- 172.21.15.87:0/3672208395 >> 172.21.15.87:0/3672208395 conn(0x55b007740870 msgr2=0x55b007832840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:04.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 -- 172.21.15.87:0/3672208395 shutdown_connections 2024-05-08T18:33:04.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:04.943+0000 7f4c90f1f800 1 -- 172.21.15.87:0/3672208395 wait complete. 2024-05-08T18:33:04.952 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-05-08T18:33:04.929345Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.929332Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:04.953 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-05-08T18:33:04.929345Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.929332Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:04.953 ERROR:root:0 2024-05-08T18:33:04.953 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:33:04.957 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:04.958 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-05-08T18:33:04.958 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-05-08T18:33:04.958 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-05-08T18:33:05.002 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:05.002 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:05.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.004+0000 7ff6d1005800 1 Processor -- start 2024-05-08T18:33:05.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.004+0000 7ff6d1005800 1 -- start start 2024-05-08T18:33:05.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.005+0000 7ff6d1005800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562d31436490 0x562d314c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.005+0000 7ff6d1005800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562d314ca0c0 con 0x562d314c6370 2024-05-08T18:33:05.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.005+0000 7ff6d1005800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x562d31363e20 con 0x562d31436490 2024-05-08T18:33:05.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.005+0000 7ff6ceafd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562d31436490 0x562d314c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.005+0000 7ff6ce2fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x562d314c6370 0x562d314c8830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58216/0 (socket says 172.21.15.87:58216) 2024-05-08T18:33:05.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.005+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/1381015477 learned_addr learned my addr 172.21.15.87:0/1381015477 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:33:05.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.005+0000 7ff6ceafd640 1 -- 172.21.15.87:0/1381015477 >> v1:172.21.15.53:6789/0 conn(0x562d314c6370 legacy=0x562d314c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.005+0000 7ff6cdafb640 1 -- 172.21.15.87:0/1381015477 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4072945836 0 0) 0x562d314ca0c0 con 0x562d314c6370 2024-05-08T18:33:05.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.005+0000 7ff6ceafd640 1 -- 172.21.15.87:0/1381015477 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d314cb2f0 con 0x562d31436490 2024-05-08T18:33:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.007+0000 7ff6ceafd640 1 --2- 172.21.15.87:0/1381015477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 0x562d314c5e00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0005fd0 tx=0x7ff6c001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5980b9fc3e635ae5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.007+0000 7ff6cdafb640 1 -- 172.21.15.87:0/1381015477 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c0052560 con 0x562d31436490 2024-05-08T18:33:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.007+0000 7ff6cdafb640 1 -- 172.21.15.87:0/1381015477 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c0052700 con 0x562d31436490 2024-05-08T18:33:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.007+0000 7ff6cdafb640 1 -- 172.21.15.87:0/1381015477 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c0052a20 con 0x562d31436490 2024-05-08T18:33:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.008+0000 7ff6d1005800 1 -- 172.21.15.87:0/1381015477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 msgr2=0x562d314c5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.008+0000 7ff6d1005800 1 --2- 172.21.15.87:0/1381015477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 0x562d314c5e00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0005fd0 tx=0x7ff6c001ccc0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.008+0000 7ff6d1005800 1 -- 172.21.15.87:0/1381015477 shutdown_connections 2024-05-08T18:33:05.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.008+0000 7ff6d1005800 1 --2- 172.21.15.87:0/1381015477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 0x562d314c5e00 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.008+0000 7ff6d1005800 1 -- 172.21.15.87:0/1381015477 >> 172.21.15.87:0/1381015477 conn(0x562d314bd720 msgr2=0x562d314bfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.008+0000 7ff6d1005800 1 -- 172.21.15.87:0/1381015477 shutdown_connections 2024-05-08T18:33:05.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.008+0000 7ff6d1005800 1 -- 172.21.15.87:0/1381015477 wait complete. 2024-05-08T18:33:05.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.022+0000 7ff6d1005800 1 Processor -- start 2024-05-08T18:33:05.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.022+0000 7ff6d1005800 1 -- start start 2024-05-08T18:33:05.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.022+0000 7ff6d1005800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 0x562d315b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.022+0000 7ff6d1005800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562d3140e5b0 con 0x562d31436490 2024-05-08T18:33:05.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.022+0000 7ff6ceafd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 0x562d315b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.022+0000 7ff6ceafd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 0x562d315b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52680/0 (socket says 172.21.15.87:52680) 2024-05-08T18:33:05.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.022+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3504786324 learned_addr learned my addr 172.21.15.87:0/3504786324 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.022+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3504786324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d315b49a0 con 0x562d31436490 2024-05-08T18:33:05.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.023+0000 7ff6ceafd640 1 --2- 172.21.15.87:0/3504786324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 0x562d315b43d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0007000 tx=0x7ff6c004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9083fb82cfdd1ca6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.023+0000 7ff5bce09640 1 -- 172.21.15.87:0/3504786324 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c00529e0 con 0x562d31436490 2024-05-08T18:33:05.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.023+0000 7ff5bce09640 1 -- 172.21.15.87:0/3504786324 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c0052b80 con 0x562d31436490 2024-05-08T18:33:05.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.023+0000 7ff5bce09640 1 -- 172.21.15.87:0/3504786324 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c005c430 con 0x562d31436490 2024-05-08T18:33:05.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.023+0000 7ff6d1005800 1 -- 172.21.15.87:0/3504786324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 msgr2=0x562d315b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.023+0000 7ff6d1005800 1 --2- 172.21.15.87:0/3504786324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 0x562d315b43d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0007000 tx=0x7ff6c004c000 comp rx=0 tx=0).stop 2024-05-08T18:33:05.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.024+0000 7ff6d1005800 1 -- 172.21.15.87:0/3504786324 shutdown_connections 2024-05-08T18:33:05.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.024+0000 7ff6d1005800 1 --2- 172.21.15.87:0/3504786324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 0x562d315b43d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.024+0000 7ff6d1005800 1 -- 172.21.15.87:0/3504786324 >> 172.21.15.87:0/3504786324 conn(0x562d314bd720 msgr2=0x562d315afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.024+0000 7ff6d1005800 1 -- 172.21.15.87:0/3504786324 shutdown_connections 2024-05-08T18:33:05.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.024+0000 7ff6d1005800 1 -- 172.21.15.87:0/3504786324 wait complete. 2024-05-08T18:33:05.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.024+0000 7ff6d1005800 1 Processor -- start 2024-05-08T18:33:05.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.024+0000 7ff6d1005800 1 -- start start 2024-05-08T18:33:05.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.024+0000 7ff6d1005800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 0x562d315bbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.024+0000 7ff6d1005800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562d314ca590 con 0x562d31436490 2024-05-08T18:33:05.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.024+0000 7ff6ceafd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 0x562d315bbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.024+0000 7ff6ceafd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 0x562d315bbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52692/0 (socket says 172.21.15.87:52692) 2024-05-08T18:33:05.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.024+0000 7ff6ceafd640 1 -- 172.21.15.87:0/652727984 learned_addr learned my addr 172.21.15.87:0/652727984 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.025+0000 7ff6ceafd640 1 -- 172.21.15.87:0/652727984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d315bc410 con 0x562d31436490 2024-05-08T18:33:05.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.025+0000 7ff6ceafd640 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 0x562d315bbed0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff6c00526d0 tx=0x7ff6c0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.025+0000 7ff5bb606640 1 -- 172.21.15.87:0/652727984 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c0075070 con 0x562d31436490 2024-05-08T18:33:05.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.025+0000 7ff5bb606640 1 -- 172.21.15.87:0/652727984 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c0070410 con 0x562d31436490 2024-05-08T18:33:05.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.025+0000 7ff6d1005800 1 -- 172.21.15.87:0/652727984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d315bc6a0 con 0x562d31436490 2024-05-08T18:33:05.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.025+0000 7ff5bb606640 1 -- 172.21.15.87:0/652727984 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c00529e0 con 0x562d31436490 2024-05-08T18:33:05.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.025+0000 7ff6d1005800 1 -- 172.21.15.87:0/652727984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d315bf350 con 0x562d31436490 2024-05-08T18:33:05.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.026+0000 7ff5bb606640 1 -- 172.21.15.87:0/652727984 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff6c0078070 con 0x562d31436490 2024-05-08T18:33:05.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.026+0000 7ff5bb606640 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff5b403bba0 0x7ff5b403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.026+0000 7ff5bb606640 1 -- 172.21.15.87:0/652727984 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff6c006d070 con 0x562d31436490 2024-05-08T18:33:05.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.026+0000 7ff6ce2fc640 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff5b403bba0 0x7ff5b403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.026+0000 7ff6d1005800 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562d314c6370 0x562d315c3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.026+0000 7ff6d1005800 1 -- 172.21.15.87:0/652727984 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d315c3650 con 0x562d314c6370 2024-05-08T18:33:05.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.026+0000 7ff6cf2fe640 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562d314c6370 0x562d315c3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.026+0000 7ff6ce2fc640 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff5b403bba0 0x7ff5b403e060 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4000c00 tx=0x7ff6c40013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.027+0000 7ff6cf2fe640 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562d314c6370 0x562d315c3110 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.027+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/652727984 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6c80083e0 con 0x562d314c6370 2024-05-08T18:33:05.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.027+0000 7ff6d1005800 1 -- 172.21.15.87:0/652727984 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d315c06a0 con 0x562d314c6370 2024-05-08T18:33:05.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.027+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/652727984 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff6c80083e0 con 0x562d314c6370 2024-05-08T18:33:05.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.027+0000 7ff6d1005800 1 -- 172.21.15.87:0/652727984 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d315c5480 con 0x562d314c6370 2024-05-08T18:33:05.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.027+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/652727984 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff6c80083e0 con 0x562d314c6370 2024-05-08T18:33:05.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.027+0000 7ff6d1005800 1 -- 172.21.15.87:0/652727984 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d315c46b0 con 0x562d314c6370 2024-05-08T18:33:05.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.028+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/652727984 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff6c80083e0 con 0x562d314c6370 2024-05-08T18:33:05.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.028+0000 7ff6d1005800 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562d315c6830 0x562d315c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.028+0000 7ff6d1005800 1 -- 172.21.15.87:0/652727984 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d315c9160 con 0x562d315c6830 2024-05-08T18:33:05.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.028+0000 7ff6ceafd640 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562d315c6830 0x562d315c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.028+0000 7ff6ceafd640 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562d315c6830 0x562d315c8c20 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.028+0000 7ff6ceafd640 1 -- 172.21.15.87:0/652727984 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff6c0077030 con 0x562d315c6830 2024-05-08T18:33:05.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.029+0000 7ff6d1005800 1 Processor -- start 2024-05-08T18:33:05.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.029+0000 7ff6d1005800 1 -- start start 2024-05-08T18:33:05.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.029+0000 7ff6d1005800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d315d73c0 0x562d315d77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.029+0000 7ff6d1005800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562d313b4fc0 con 0x562d315d73c0 2024-05-08T18:33:05.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.029+0000 7ff6cf2fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d315d73c0 0x562d315d77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.029+0000 7ff6cf2fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d315d73c0 0x562d315d77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52708/0 (socket says 172.21.15.87:52708) 2024-05-08T18:33:05.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.029+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/1051455714 learned_addr learned my addr 172.21.15.87:0/1051455714 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.029+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/1051455714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d315d7d20 con 0x562d315d73c0 2024-05-08T18:33:05.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.030+0000 7ff6cf2fe640 1 --2- 172.21.15.87:0/1051455714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d315d73c0 0x562d315d77e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x562d315bd2d0 tx=0x7ff6c800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.030+0000 7ff5b8e01640 1 -- 172.21.15.87:0/1051455714 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c801c070 con 0x562d315d73c0 2024-05-08T18:33:05.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.030+0000 7ff5b8e01640 1 -- 172.21.15.87:0/1051455714 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c800bdc0 con 0x562d315d73c0 2024-05-08T18:33:05.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.030+0000 7ff6d1005800 1 -- 172.21.15.87:0/1051455714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d315d8790 con 0x562d315d73c0 2024-05-08T18:33:05.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.030+0000 7ff5b8e01640 1 -- 172.21.15.87:0/1051455714 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c8018540 con 0x562d315d73c0 2024-05-08T18:33:05.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.030+0000 7ff6d1005800 1 -- 172.21.15.87:0/1051455714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d315d8c90 con 0x562d315d73c0 2024-05-08T18:33:05.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.031+0000 7ff5b8e01640 1 -- 172.21.15.87:0/1051455714 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff6c801f070 con 0x562d315d73c0 2024-05-08T18:33:05.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.031+0000 7ff5b8e01640 1 --2- 172.21.15.87:0/1051455714 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff5a803bb50 0x7ff5a803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.031+0000 7ff5b8e01640 1 -- 172.21.15.87:0/1051455714 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff6c8054710 con 0x562d315d73c0 2024-05-08T18:33:05.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.031+0000 7ff6ceafd640 1 --2- 172.21.15.87:0/1051455714 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff5a803bb50 0x7ff5a803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.031+0000 7ff6d1005800 1 Processor -- start 2024-05-08T18:33:05.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.031+0000 7ff6ceafd640 1 --2- 172.21.15.87:0/1051455714 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff5a803bb50 0x7ff5a803e010 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff6c006f000 tx=0x7ff6c005df10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.031+0000 7ff6d1005800 1 -- start start 2024-05-08T18:33:05.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.031+0000 7ff6d1005800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d314c3420 0x562d314c3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.031+0000 7ff6d1005800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562d315b4cc0 con 0x562d314c3420 2024-05-08T18:33:05.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.032+0000 7ff6cf2fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d314c3420 0x562d314c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.032+0000 7ff6cf2fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d314c3420 0x562d314c3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52724/0 (socket says 172.21.15.87:52724) 2024-05-08T18:33:05.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.032+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/2748025817 learned_addr learned my addr 172.21.15.87:0/2748025817 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.032+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/2748025817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d314c1c70 con 0x562d314c3420 2024-05-08T18:33:05.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.032+0000 7ff6cf2fe640 1 --2- 172.21.15.87:0/2748025817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d314c3420 0x562d314c3840 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8052a60 tx=0x7ff6c80405b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de93565fbbd01d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.032+0000 7ff5b27fc640 1 -- 172.21.15.87:0/2748025817 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c804f070 con 0x562d314c3420 2024-05-08T18:33:05.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.032+0000 7ff5b27fc640 1 -- 172.21.15.87:0/2748025817 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c8052db0 con 0x562d314c3420 2024-05-08T18:33:05.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.032+0000 7ff5b27fc640 1 -- 172.21.15.87:0/2748025817 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c8017510 con 0x562d314c3420 2024-05-08T18:33:05.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.033+0000 7ff6d1005800 1 -- 172.21.15.87:0/2748025817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d314c3420 msgr2=0x562d314c3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.033+0000 7ff6d1005800 1 --2- 172.21.15.87:0/2748025817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d314c3420 0x562d314c3840 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8052a60 tx=0x7ff6c80405b0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.033+0000 7ff6d1005800 1 -- 172.21.15.87:0/2748025817 shutdown_connections 2024-05-08T18:33:05.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.033+0000 7ff6d1005800 1 --2- 172.21.15.87:0/2748025817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d314c3420 0x562d314c3840 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.033+0000 7ff6d1005800 1 -- 172.21.15.87:0/2748025817 >> 172.21.15.87:0/2748025817 conn(0x562d315e0a30 msgr2=0x562d315deae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.033+0000 7ff6d1005800 1 -- 172.21.15.87:0/2748025817 shutdown_connections 2024-05-08T18:33:05.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.033+0000 7ff6d1005800 1 -- 172.21.15.87:0/2748025817 wait complete. 2024-05-08T18:33:05.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.033+0000 7ff6d1005800 1 Processor -- start 2024-05-08T18:33:05.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.033+0000 7ff6d1005800 1 -- start start 2024-05-08T18:33:05.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.033+0000 7ff6d1005800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d314c3420 0x562d315edec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.033+0000 7ff6d1005800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562d314c2140 con 0x562d314c3420 2024-05-08T18:33:05.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.033+0000 7ff6cf2fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d314c3420 0x562d315edec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.033+0000 7ff6cf2fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d314c3420 0x562d315edec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52730/0 (socket says 172.21.15.87:52730) 2024-05-08T18:33:05.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.033+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 learned_addr learned my addr 172.21.15.87:0/3934475937 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.034+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d315ee400 con 0x562d314c3420 2024-05-08T18:33:05.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.034+0000 7ff6cf2fe640 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d314c3420 0x562d315edec0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x562d315df820 tx=0x7ff6c80529f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.034+0000 7ff5b0ff9640 1 -- 172.21.15.87:0/3934475937 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c8051560 con 0x562d314c3420 2024-05-08T18:33:05.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.034+0000 7ff5b0ff9640 1 -- 172.21.15.87:0/3934475937 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c804a040 con 0x562d314c3420 2024-05-08T18:33:05.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.034+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d315ee690 con 0x562d314c3420 2024-05-08T18:33:05.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.034+0000 7ff5b0ff9640 1 -- 172.21.15.87:0/3934475937 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c8054070 con 0x562d314c3420 2024-05-08T18:33:05.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.034+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d315f1340 con 0x562d314c3420 2024-05-08T18:33:05.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.035+0000 7ff5b0ff9640 1 -- 172.21.15.87:0/3934475937 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff6c8054210 con 0x562d314c3420 2024-05-08T18:33:05.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.035+0000 7ff5b0ff9640 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff59803bba0 0x7ff59803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.035+0000 7ff5b0ff9640 1 -- 172.21.15.87:0/3934475937 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff6c8001040 con 0x562d314c3420 2024-05-08T18:33:05.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.035+0000 7ff6ceafd640 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff59803bba0 0x7ff59803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.035+0000 7ff6ceafd640 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff59803bba0 0x7ff59803e060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0093230 tx=0x7ff6c008d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.036+0000 7ff6d1005800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.036+0000 7ff6d1005800 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562d315f9930 0x562d315fbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.036+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d315fc540 con 0x562d315f9930 2024-05-08T18:33:05.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.036+0000 7ff6ce2fc640 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562d315f9930 0x562d315fbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.036+0000 7ff6ce2fc640 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562d315f9930 0x562d315fbdf0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.036+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6c400f5f0 con 0x562d315f9930 2024-05-08T18:33:05.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.036+0000 7ff6d1005800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.036+0000 7ff6d1005800 20 realm 2024-05-08T18:33:05.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.036+0000 7ff6d1005800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.036+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d315f8d80 con 0x562d315f9930 2024-05-08T18:33:05.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6c400f5f0 con 0x562d315f9930 2024-05-08T18:33:05.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6d1005800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6d1005800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:05.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6d1005800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d315fd030 con 0x562d315f9930 2024-05-08T18:33:05.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6c400f5f0 con 0x562d315f9930 2024-05-08T18:33:05.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6d1005800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6d1005800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d315fd900 con 0x562d315f9930 2024-05-08T18:33:05.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff6c400f5f0 con 0x562d315f9930 2024-05-08T18:33:05.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6d1005800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:05.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6d1005800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d315fdca0 con 0x562d315f9930 2024-05-08T18:33:05.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff6c400f5f0 con 0x562d315f9930 2024-05-08T18:33:05.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6d1005800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:05.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6d1005800 20 searching for the correct realm 2024-05-08T18:33:05.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6d1005800 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562d315ffbd0 0x562d31601fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.037+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x562d315ffbd0 2024-05-08T18:33:05.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.038+0000 7ff6cf2fe640 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562d315ffbd0 0x562d31601fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.038+0000 7ff6cf2fe640 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562d315ffbd0 0x562d31601fe0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.038+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.038+0000 7ff6cf2fe640 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff6c8021070 0x7ff6c80339d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.038+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x7ff6c8021070 2024-05-08T18:33:05.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.038+0000 7ff6ceafd640 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff6c8021070 0x7ff6c80339d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.039+0000 7ff6ceafd640 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff6c8021070 0x7ff6c80339d0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.039+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.039+0000 7ff6ceafd640 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff6c00a2040 0x7ff6c005b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.039+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x7ff6c00a2040 2024-05-08T18:33:05.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.039+0000 7ff6ce2fc640 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff6c00a2040 0x7ff6c005b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.040+0000 7ff6ce2fc640 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff6c00a2040 0x7ff6c005b7c0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.040+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c400f5f0 con 0x7ff6c00a2040 2024-05-08T18:33:05.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.040+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x562d315f9930 2024-05-08T18:33:05.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.040+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c400f5f0 con 0x562d315f9930 2024-05-08T18:33:05.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.040+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x562d315f9930 2024-05-08T18:33:05.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.040+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c400f5f0 con 0x562d315f9930 2024-05-08T18:33:05.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.040+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x7ff6c00a2040 2024-05-08T18:33:05.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.041+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff6c400f5f0 con 0x7ff6c00a2040 2024-05-08T18:33:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.041+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x7ff6c00a2040 2024-05-08T18:33:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.041+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c400f5f0 con 0x7ff6c00a2040 2024-05-08T18:33:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.041+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x7ff6c8021070 2024-05-08T18:33:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.041+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.041+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x562d315ffbd0 2024-05-08T18:33:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.041+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.041+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x562d315f9930 2024-05-08T18:33:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.042+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c400f5f0 con 0x562d315f9930 2024-05-08T18:33:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.042+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x7ff6c00a2040 2024-05-08T18:33:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.042+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c400f5f0 con 0x7ff6c00a2040 2024-05-08T18:33:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.042+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x562d315f9930 2024-05-08T18:33:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.042+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c400f5f0 con 0x562d315f9930 2024-05-08T18:33:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.042+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x7ff6c8021070 2024-05-08T18:33:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.042+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.042+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x562d315ffbd0 2024-05-08T18:33:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.043+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.043+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x562d315ffbd0 2024-05-08T18:33:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.043+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.043+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x7ff6c00a2040 2024-05-08T18:33:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.043+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c400f5f0 con 0x7ff6c00a2040 2024-05-08T18:33:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.043+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x562d315ffbd0 2024-05-08T18:33:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.043+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.043+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x562d315ffbd0 2024-05-08T18:33:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.044+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.044+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x562d315f9930 2024-05-08T18:33:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.044+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c400f5f0 con 0x562d315f9930 2024-05-08T18:33:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.044+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x562d315f9930 2024-05-08T18:33:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.044+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v29'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7ff6c400f5f0 con 0x562d315f9930 2024-05-08T18:33:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.044+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x7ff6c00a2040 2024-05-08T18:33:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.044+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c400f5f0 con 0x7ff6c00a2040 2024-05-08T18:33:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.044+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x562d315ffbd0 2024-05-08T18:33:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.045+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.045+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x7ff6c8021070 2024-05-08T18:33:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.045+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.045+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x562d315f9930 2024-05-08T18:33:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.045+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c400f5f0 con 0x562d315f9930 2024-05-08T18:33:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.045+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x7ff6c00a2040 2024-05-08T18:33:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.045+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.045+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x562d315ffbd0 2024-05-08T18:33:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.046+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.046+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x7ff6c8021070 2024-05-08T18:33:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.046+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.046+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x7ff6c8021070 2024-05-08T18:33:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.046+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.046+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x562d315ffbd0 2024-05-08T18:33:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.046+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.046+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x7ff6c8021070 2024-05-08T18:33:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.047+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.047+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x562d315f9930 2024-05-08T18:33:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.047+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.047+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d316026b0 con 0x7ff6c8021070 2024-05-08T18:33:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.047+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.047+0000 7ff6d1005800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.047+0000 7ff6d1005800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.047+0000 7ff6d1005800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.047+0000 7ff6d1005800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.047+0000 7ff6d1005800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.047+0000 7ff6d1005800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.047+0000 7ff6d1005800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.047+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d315fe670 con 0x562d315f9930 2024-05-08T18:33:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.047+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.047+0000 7ff6d1005800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.047+0000 7ff6d1005800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.047+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d315fef10 con 0x562d315f9930 2024-05-08T18:33:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6d1005800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6d1005800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d31602b30 con 0x7ff6c00a2040 2024-05-08T18:33:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6d1005800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6d1005800 20 zone default found 2024-05-08T18:33:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6d1005800 4 Realm: () 2024-05-08T18:33:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6d1005800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6d1005800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6d1005800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6d1005800 20 zonegroup default 2024-05-08T18:33:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6d1005800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d31602fe0 con 0x7ff6c00a2040 2024-05-08T18:33:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6d1005800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6d1005800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.048+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d316049c0 con 0x562d315ffbd0 2024-05-08T18:33:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.049+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.049+0000 7ff6d1005800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.049+0000 7ff6d1005800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.049+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d31604e30 con 0x562d315ffbd0 2024-05-08T18:33:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.049+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.049+0000 7ff6d1005800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.049+0000 7ff6d1005800 20 started sync module instance, tier type = 2024-05-08T18:33:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.049+0000 7ff6d1005800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.049+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31603e00 con 0x7ff6c8021070 2024-05-08T18:33:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.050+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.050+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94752101906768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31605290 con 0x7ff6c8021070 2024-05-08T18:33:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.050+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31605ae0 con 0x562d315f9930 2024-05-08T18:33:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.051+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94752101906768] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.051+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.052+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94752101914160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31605f00 con 0x562d315f9930 2024-05-08T18:33:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.052+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31606750 con 0x562d315ffbd0 2024-05-08T18:33:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.053+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.053+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94752101916896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31606bb0 con 0x562d315ffbd0 2024-05-08T18:33:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.053+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d316076b0 con 0x7ff6c8021070 2024-05-08T18:33:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.053+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94752101914160] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.054+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94752101916896] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.054+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.054+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94752101921184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31606600 con 0x7ff6c8021070 2024-05-08T18:33:05.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.054+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d316080f0 con 0x562d315f9930 2024-05-08T18:33:05.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.055+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.055+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94752101924176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31608760 con 0x562d315f9930 2024-05-08T18:33:05.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.055+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31609280 con 0x7ff6c00a2040 2024-05-08T18:33:05.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.055+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94752101921184] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.056+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.056+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94752101928272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31609240 con 0x7ff6c00a2040 2024-05-08T18:33:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.056+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31609cd0 con 0x7ff6c00a2040 2024-05-08T18:33:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.056+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94752101924176] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.057+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94752101928272] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.057+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.057+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94752101915216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d316081b0 con 0x7ff6c00a2040 2024-05-08T18:33:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.057+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d3160a180 con 0x7ff6c00a2040 2024-05-08T18:33:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.058+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94752101915216] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.058+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.058+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94752101930976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d3160a180 con 0x7ff6c00a2040 2024-05-08T18:33:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.058+0000 7ff6d1005800 20 add_watcher() i=0 2024-05-08T18:33:05.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.058+0000 7ff6d1005800 20 add_watcher() i=1 2024-05-08T18:33:05.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.058+0000 7ff6d1005800 20 add_watcher() i=2 2024-05-08T18:33:05.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.058+0000 7ff6d1005800 20 add_watcher() i=3 2024-05-08T18:33:05.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.058+0000 7ff6d1005800 20 add_watcher() i=4 2024-05-08T18:33:05.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.058+0000 7ff6d1005800 20 add_watcher() i=5 2024-05-08T18:33:05.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.058+0000 7ff6d1005800 20 add_watcher() i=6 2024-05-08T18:33:05.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.059+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94752101930976] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.059+0000 7ff6d1005800 20 add_watcher() i=7 2024-05-08T18:33:05.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.059+0000 7ff6d1005800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:05.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.059+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d3160d4e0 con 0x562d315f9930 2024-05-08T18:33:05.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.059+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.059+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94752101932608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d3160a710 con 0x562d315f9930 2024-05-08T18:33:05.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.060+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94752101932608] v29'253 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.061+0000 7ff5857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.061+0000 7ff6d1005800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.061+0000 7ff6d1005800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.061+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d3160cca0 con 0x562d315f9930 2024-05-08T18:33:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.062+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.062+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d316165a0 con 0x7ff6c00a2040 2024-05-08T18:33:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.063+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.063+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d3160c8c0 con 0x562d315ffbd0 2024-05-08T18:33:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.064+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.064+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d316165a0 con 0x562d315f9930 2024-05-08T18:33:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.065+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'254 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.065+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31616fc0 con 0x7ff6c8021070 2024-05-08T18:33:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.066+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.066+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d316173e0 con 0x562d315ffbd0 2024-05-08T18:33:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.067+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'54 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.067+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d316173e0 con 0x562d315f9930 2024-05-08T18:33:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.068+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'33 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.068+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d316173e0 con 0x7ff6c00a2040 2024-05-08T18:33:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.069+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.069+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d316173e0 con 0x7ff6c8021070 2024-05-08T18:33:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.070+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.070+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617890 con 0x562d315ffbd0 2024-05-08T18:33:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.071+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.071+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d316165a0 con 0x7ff6c8021070 2024-05-08T18:33:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.072+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.072+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617890 con 0x7ff6c00a2040 2024-05-08T18:33:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.073+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'36 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.073+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617890 con 0x7ff6c8021070 2024-05-08T18:33:05.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.074+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.074+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617890 con 0x7ff6c00a2040 2024-05-08T18:33:05.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.075+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.075+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617890 con 0x562d315f9930 2024-05-08T18:33:05.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.076+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'255 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.076+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617890 con 0x562d315ffbd0 2024-05-08T18:33:05.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.078+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'74 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.078+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617c50 con 0x7ff6c8021070 2024-05-08T18:33:05.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.078+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.079+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617c30 con 0x562d315ffbd0 2024-05-08T18:33:05.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.079+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.079+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617920 con 0x562d315f9930 2024-05-08T18:33:05.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.081+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.081+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617920 con 0x562d315f9930 2024-05-08T18:33:05.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.082+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'256 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.082+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617920 con 0x562d315ffbd0 2024-05-08T18:33:05.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.083+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'75 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.083+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617950 con 0x7ff6c8021070 2024-05-08T18:33:05.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.084+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.084+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617950 con 0x562d315ffbd0 2024-05-08T18:33:05.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.085+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.085+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617920 con 0x562d315ffbd0 2024-05-08T18:33:05.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.086+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.086+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617990 con 0x562d315ffbd0 2024-05-08T18:33:05.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.087+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'29 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.087+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617990 con 0x562d315ffbd0 2024-05-08T18:33:05.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.088+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'55 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.088+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617990 con 0x7ff6c00a2040 2024-05-08T18:33:05.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.089+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.089+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617990 con 0x562d315ffbd0 2024-05-08T18:33:05.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.090+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.090+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617990 con 0x7ff6c00a2040 2024-05-08T18:33:05.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.091+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.091+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617990 con 0x562d315ffbd0 2024-05-08T18:33:05.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.093+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'76 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.093+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617990 con 0x7ff6c00a2040 2024-05-08T18:33:05.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.094+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.094+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31617990 con 0x7ff6c8021070 2024-05-08T18:33:05.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.095+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.095+0000 7ff4fffff640 20 reqs_thread_entry: start 2024-05-08T18:33:05.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.095+0000 7ff6d1005800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:05.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.095+0000 7ff6d1005800 20 Filter name: none 2024-05-08T18:33:05.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.095+0000 7ff4fdffb640 20 reqs_thread_entry: start 2024-05-08T18:33:05.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.095+0000 7ff6d1005800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-05-08T18:33:05.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.095+0000 7ff6d1005800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.095+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d31642b10 con 0x562d315ffbd0 2024-05-08T18:33:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.096+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.096+0000 7ff6d1005800 20 rados_obj.operate() r=0 bl.length=363 2024-05-08T18:33:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.096+0000 7ff6d1005800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-05-08T18:33:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.096+0000 7ff6d1005800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-08T18:33:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.096+0000 7ff6d1005800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:33:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.096+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d31645440 con 0x562d315ffbd0 2024-05-08T18:33:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.097+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7ff6c8028070 con 0x562d315ffbd0 2024-05-08T18:33:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.097+0000 7ff6d1005800 10 removing key index: true_admin_akey 2024-05-08T18:33:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.097+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31643420 con 0x562d315ffbd0 2024-05-08T18:33:05.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.098+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 28 ==== osd_op_reply(96 true_admin_akey [delete] v29'6 uv6 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7ff6c8070040 con 0x562d315ffbd0 2024-05-08T18:33:05.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.098+0000 7ff6d1005800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-05-08T18:33:05.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.098+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94752102170416 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d31645970 con 0x7ff6c00a2040 2024-05-08T18:33:05.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.098+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== watch-notify(notify (1) cookie 94752101928272 notify 124554051615 ret 0) ==== 207+0+0 (crc 0 0 0) 0x562d3160c6f0 con 0x7ff6c00a2040 2024-05-08T18:33:05.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.098+0000 7ff5b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051615 cookie 94752101928272 notifier 4858 bl.length()=165 2024-05-08T18:33:05.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.098+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(97 notify.5 [notify cookie 94752102170416 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.098+0000 7ff5b27fc640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7ff594003d60 con 0x7ff6c00a2040 2024-05-08T18:33:05.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.098+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.099+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== watch-notify(notify_complete (2) cookie 94752102170416 notify 124554051615 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d3160c8c0 con 0x7ff6c00a2040 2024-05-08T18:33:05.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.099+0000 7ff6d1005800 10 removing email index: 2024-05-08T18:33:05.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.099+0000 7ff6d1005800 10 removing user buckets index 2024-05-08T18:33:05.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.099+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d316458d0 con 0x562d315ffbd0 2024-05-08T18:33:05.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.099+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 29 ==== osd_op_reply(99 a_user.buckets [delete] v29'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7ff6c8070040 con 0x562d315ffbd0 2024-05-08T18:33:05.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.099+0000 7ff6d1005800 10 removing user index: a_user 2024-05-08T18:33:05.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.099+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d316458d0 con 0x562d315ffbd0 2024-05-08T18:33:05.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.100+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 30 ==== osd_op_reply(100 a_user [call,call,delete] v29'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7ff6c8070040 con 0x562d315ffbd0 2024-05-08T18:33:05.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.100+0000 7ff6d1005800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-05-08T18:33:05.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.100+0000 7ff6d1005800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-05-08T18:33:05.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.100+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94752102176976 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d31643f30 con 0x562d315ffbd0 2024-05-08T18:33:05.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.101+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 31 ==== watch-notify(notify (1) cookie 94752101916896 notify 124554051596 ret 0) ==== 197+0+0 (crc 0 0 0) 0x562d31616b60 con 0x562d315ffbd0 2024-05-08T18:33:05.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.101+0000 7ff5b1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051596 cookie 94752101916896 notifier 4858 bl.length()=155 2024-05-08T18:33:05.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.101+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 32 ==== osd_op_reply(101 notify.2 [notify cookie 94752102176976 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff6c8070040 con 0x562d315ffbd0 2024-05-08T18:33:05.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.101+0000 7ff5b1ffb640 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7ff5040032c0 con 0x562d315ffbd0 2024-05-08T18:33:05.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.101+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 33 ==== watch-notify(notify_complete (2) cookie 94752102176976 notify 124554051596 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d315ee400 con 0x562d315ffbd0 2024-05-08T18:33:05.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.101+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c8070040 con 0x562d315ffbd0 2024-05-08T18:33:05.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.102+0000 7ff5857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:05.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.102+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94752101932608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d316458d0 con 0x562d315f9930 2024-05-08T18:33:05.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.103+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94752101932608] v29'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.103+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94752101906768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31609e40 con 0x7ff6c8021070 2024-05-08T18:33:05.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.104+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 20 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94752101906768] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.104+0000 7ff6d1005800 20 remove_watcher() i=0 2024-05-08T18:33:05.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.104+0000 7ff6d1005800 2 removed watcher, disabling cache 2024-05-08T18:33:05.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.104+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94752101914160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31609e40 con 0x562d315f9930 2024-05-08T18:33:05.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.105+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94752101914160] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.105+0000 7ff6d1005800 20 remove_watcher() i=1 2024-05-08T18:33:05.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.105+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94752101916896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31605630 con 0x562d315ffbd0 2024-05-08T18:33:05.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.106+0000 7ff6cf2fe640 1 -- 172.21.15.87:0/3934475937 <== osd.3 v2:172.21.15.87:6800/2929215285 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94752101916896] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c8070040 con 0x562d315ffbd0 2024-05-08T18:33:05.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.106+0000 7ff6d1005800 20 remove_watcher() i=2 2024-05-08T18:33:05.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.106+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94752101921184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31609e40 con 0x7ff6c8021070 2024-05-08T18:33:05.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.107+0000 7ff6ceafd640 1 -- 172.21.15.87:0/3934475937 <== osd.2 v2:172.21.15.87:6816/2108501615 21 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94752101921184] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c0088040 con 0x7ff6c8021070 2024-05-08T18:33:05.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.107+0000 7ff6d1005800 20 remove_watcher() i=3 2024-05-08T18:33:05.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.107+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94752101924176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31605630 con 0x562d315f9930 2024-05-08T18:33:05.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.108+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94752101924176] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x562d315f9930 2024-05-08T18:33:05.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.108+0000 7ff6d1005800 20 remove_watcher() i=4 2024-05-08T18:33:05.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.108+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94752101928272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31609e40 con 0x7ff6c00a2040 2024-05-08T18:33:05.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.109+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94752101928272] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.109+0000 7ff6d1005800 20 remove_watcher() i=5 2024-05-08T18:33:05.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.109+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94752101915216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31605630 con 0x7ff6c00a2040 2024-05-08T18:33:05.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.110+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94752101915216] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.110+0000 7ff6d1005800 20 remove_watcher() i=6 2024-05-08T18:33:05.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.110+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94752101930976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d31608d50 con 0x7ff6c00a2040 2024-05-08T18:33:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.111+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 <== osd.0 v2:172.21.15.53:6800/443747735 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94752101930976] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c403b040 con 0x7ff6c00a2040 2024-05-08T18:33:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.111+0000 7ff6d1005800 20 remove_watcher() i=7 2024-05-08T18:33:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.111+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff6c00a2040 msgr2=0x7ff6c005b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.111+0000 7ff6d1005800 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7ff6c00a2040 0x7ff6c005b7c0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.111+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562d315f9930 msgr2=0x562d315fbdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.111+0000 7ff6d1005800 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562d315f9930 0x562d315fbdf0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.111+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff6c8021070 msgr2=0x7ff6c80339d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.111+0000 7ff6d1005800 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7ff6c8021070 0x7ff6c80339d0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.111+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562d315ffbd0 msgr2=0x562d31601fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.111+0000 7ff6d1005800 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x562d315ffbd0 0x562d31601fe0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.111+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff59803bba0 msgr2=0x7ff59803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.111+0000 7ff6d1005800 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff59803bba0 0x7ff59803e060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0093230 tx=0x7ff6c008d000 comp rx=0 tx=0).stop 2024-05-08T18:33:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.111+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d314c3420 msgr2=0x562d315edec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.111+0000 7ff6ce2fc640 1 -- 172.21.15.87:0/3934475937 reap_dead start 2024-05-08T18:33:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.111+0000 7ff6d1005800 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d314c3420 0x562d315edec0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x562d315df820 tx=0x7ff6c80529f0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.111+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 shutdown_connections 2024-05-08T18:33:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 --2- 172.21.15.87:0/3934475937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d314c3420 0x562d315edec0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 >> 172.21.15.87:0/3934475937 conn(0x562d315e0a30 msgr2=0x562d315de0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 shutdown_connections 2024-05-08T18:33:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 -- 172.21.15.87:0/3934475937 wait complete. 2024-05-08T18:33:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 -- 172.21.15.87:0/1051455714 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff5a803bb50 msgr2=0x7ff5a803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 --2- 172.21.15.87:0/1051455714 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff5a803bb50 0x7ff5a803e010 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff6c006f000 tx=0x7ff6c005df10 comp rx=0 tx=0).stop 2024-05-08T18:33:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 -- 172.21.15.87:0/1051455714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d315d73c0 msgr2=0x562d315d77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 --2- 172.21.15.87:0/1051455714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d315d73c0 0x562d315d77e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x562d315bd2d0 tx=0x7ff6c800ef30 comp rx=0 tx=0).stop 2024-05-08T18:33:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 -- 172.21.15.87:0/1051455714 shutdown_connections 2024-05-08T18:33:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 --2- 172.21.15.87:0/1051455714 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff5a803bb50 0x7ff5a803e010 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 --2- 172.21.15.87:0/1051455714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d315d73c0 0x562d315d77e0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 -- 172.21.15.87:0/1051455714 >> 172.21.15.87:0/1051455714 conn(0x562d315cb460 msgr2=0x562d315cb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 -- 172.21.15.87:0/1051455714 shutdown_connections 2024-05-08T18:33:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 -- 172.21.15.87:0/1051455714 wait complete. 2024-05-08T18:33:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 -- 172.21.15.87:0/652727984 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562d315c6830 msgr2=0x562d315c8c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562d315c6830 0x562d315c8c20 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 -- 172.21.15.87:0/652727984 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562d314c6370 msgr2=0x562d315c3110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562d314c6370 0x562d315c3110 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 -- 172.21.15.87:0/652727984 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff5b403bba0 msgr2=0x7ff5b403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff5b403bba0 0x7ff5b403e060 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4000c00 tx=0x7ff6c40013b0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 -- 172.21.15.87:0/652727984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 msgr2=0x562d315bbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.112+0000 7ff6d1005800 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 0x562d315bbed0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff6c00526d0 tx=0x7ff6c0003330 comp rx=0 tx=0).stop 2024-05-08T18:33:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.113+0000 7ff6d1005800 1 -- 172.21.15.87:0/652727984 shutdown_connections 2024-05-08T18:33:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.113+0000 7ff6d1005800 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x562d314c6370 0x562d315c3110 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.113+0000 7ff6d1005800 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x562d315c6830 0x562d315c8c20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.113+0000 7ff6d1005800 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff5b403bba0 0x7ff5b403e060 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.113+0000 7ff6d1005800 1 --2- 172.21.15.87:0/652727984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d31436490 0x562d315bbed0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.113+0000 7ff6d1005800 1 -- 172.21.15.87:0/652727984 >> 172.21.15.87:0/652727984 conn(0x562d314bd720 msgr2=0x562d315ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.113+0000 7ff6d1005800 1 -- 172.21.15.87:0/652727984 shutdown_connections 2024-05-08T18:33:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.113+0000 7ff6d1005800 1 -- 172.21.15.87:0/652727984 wait complete. 2024-05-08T18:33:05.119 ERROR:root:None 2024-05-08T18:33:05.120 ERROR:root:0 2024-05-08T18:33:05.120 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-05-08T18:33:05.120 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-05-08T18:33:05.120 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-05-08T18:33:05.165 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:05.165 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:05.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.168+0000 7fbed843c800 1 Processor -- start 2024-05-08T18:33:05.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.168+0000 7fbed843c800 1 -- start start 2024-05-08T18:33:05.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.168+0000 7fbed843c800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564d7a9cf2c0 0x564d7a9cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.168+0000 7fbed843c800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564d7a9cfd60 con 0x564d7a9d0480 2024-05-08T18:33:05.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.168+0000 7fbed843c800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x564d7a86fe20 con 0x564d7a9cf2c0 2024-05-08T18:33:05.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.168+0000 7fbed30ce640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564d7a9cf2c0 0x564d7a9cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.169+0000 7fbed30ce640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564d7a9cf2c0 0x564d7a9cf6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52736/0 (socket says 172.21.15.87:52736) 2024-05-08T18:33:05.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.169+0000 7fbed28cd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x564d7a9d0480 0x564d7a9d0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58226/0 (socket says 172.21.15.87:58226) 2024-05-08T18:33:05.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.169+0000 7fbed30ce640 1 -- 172.21.15.87:0/2362318150 learned_addr learned my addr 172.21.15.87:0/2362318150 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.169+0000 7fbed30ce640 1 -- 172.21.15.87:0/2362318150 >> v1:172.21.15.53:6789/0 conn(0x564d7a9d0480 legacy=0x564d7a9d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.169+0000 7fbed30ce640 1 -- 172.21.15.87:0/2362318150 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d7a9d1040 con 0x564d7a9cf2c0 2024-05-08T18:33:05.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.171+0000 7fbed30ce640 1 --2- 172.21.15.87:0/2362318150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 0x564d7a9cf6e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00a520 tx=0x7fbecc01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e38225415fe617 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.171+0000 7fbed20cc640 1 -- 172.21.15.87:0/2362318150 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbecc057070 con 0x564d7a9cf2c0 2024-05-08T18:33:05.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.171+0000 7fbed20cc640 1 -- 172.21.15.87:0/2362318150 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbecc052570 con 0x564d7a9cf2c0 2024-05-08T18:33:05.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.171+0000 7fbed20cc640 1 -- 172.21.15.87:0/2362318150 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbecc052870 con 0x564d7a9cf2c0 2024-05-08T18:33:05.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.171+0000 7fbed843c800 1 -- 172.21.15.87:0/2362318150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 msgr2=0x564d7a9cf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.171+0000 7fbed843c800 1 --2- 172.21.15.87:0/2362318150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 0x564d7a9cf6e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00a520 tx=0x7fbecc01d010 comp rx=0 tx=0).stop 2024-05-08T18:33:05.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.171+0000 7fbed843c800 1 -- 172.21.15.87:0/2362318150 shutdown_connections 2024-05-08T18:33:05.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.171+0000 7fbed843c800 1 --2- 172.21.15.87:0/2362318150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 0x564d7a9cf6e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.171+0000 7fbed843c800 1 -- 172.21.15.87:0/2362318150 >> 172.21.15.87:0/2362318150 conn(0x564d7a9ca840 msgr2=0x564d7a9ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.171+0000 7fbed843c800 1 -- 172.21.15.87:0/2362318150 shutdown_connections 2024-05-08T18:33:05.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.171+0000 7fbed843c800 1 -- 172.21.15.87:0/2362318150 wait complete. 2024-05-08T18:33:05.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.185+0000 7fbed843c800 1 Processor -- start 2024-05-08T18:33:05.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.185+0000 7fbed843c800 1 -- start start 2024-05-08T18:33:05.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.185+0000 7fbed843c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 0x564d7a944c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.185+0000 7fbed843c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564d7a91a5c0 con 0x564d7a9cf2c0 2024-05-08T18:33:05.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.185+0000 7fbed30ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 0x564d7a944c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.185+0000 7fbed30ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 0x564d7a944c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52748/0 (socket says 172.21.15.87:52748) 2024-05-08T18:33:05.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.185+0000 7fbed30ce640 1 -- 172.21.15.87:0/600115011 learned_addr learned my addr 172.21.15.87:0/600115011 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.186+0000 7fbed30ce640 1 -- 172.21.15.87:0/600115011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d7a943240 con 0x564d7a9cf2c0 2024-05-08T18:33:05.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.186+0000 7fbed30ce640 1 --2- 172.21.15.87:0/600115011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 0x564d7a944c80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbecc055040 tx=0x7fbecc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3da90d2b55db9c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.186+0000 7fbdc160a640 1 -- 172.21.15.87:0/600115011 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbecc057040 con 0x564d7a9cf2c0 2024-05-08T18:33:05.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.186+0000 7fbdc160a640 1 -- 172.21.15.87:0/600115011 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbecc052850 con 0x564d7a9cf2c0 2024-05-08T18:33:05.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.186+0000 7fbdc160a640 1 -- 172.21.15.87:0/600115011 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbecc052b50 con 0x564d7a9cf2c0 2024-05-08T18:33:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.187+0000 7fbed843c800 1 -- 172.21.15.87:0/600115011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 msgr2=0x564d7a944c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.187+0000 7fbed843c800 1 --2- 172.21.15.87:0/600115011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 0x564d7a944c80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbecc055040 tx=0x7fbecc04c000 comp rx=0 tx=0).stop 2024-05-08T18:33:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.187+0000 7fbed843c800 1 -- 172.21.15.87:0/600115011 shutdown_connections 2024-05-08T18:33:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.187+0000 7fbed843c800 1 --2- 172.21.15.87:0/600115011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 0x564d7a944c80 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.187+0000 7fbed843c800 1 -- 172.21.15.87:0/600115011 >> 172.21.15.87:0/600115011 conn(0x564d7a9ca840 msgr2=0x564d7aabc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.187+0000 7fbed843c800 1 -- 172.21.15.87:0/600115011 shutdown_connections 2024-05-08T18:33:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.187+0000 7fbed843c800 1 -- 172.21.15.87:0/600115011 wait complete. 2024-05-08T18:33:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.187+0000 7fbed843c800 1 Processor -- start 2024-05-08T18:33:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.187+0000 7fbed843c800 1 -- start start 2024-05-08T18:33:05.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.187+0000 7fbed843c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 0x564d7aaca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.187+0000 7fbed843c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564d7a9d8950 con 0x564d7a9cf2c0 2024-05-08T18:33:05.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.187+0000 7fbed30ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 0x564d7aaca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.187+0000 7fbed30ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 0x564d7aaca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52762/0 (socket says 172.21.15.87:52762) 2024-05-08T18:33:05.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.187+0000 7fbed30ce640 1 -- 172.21.15.87:0/3589256661 learned_addr learned my addr 172.21.15.87:0/3589256661 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.188+0000 7fbed30ce640 1 -- 172.21.15.87:0/3589256661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d7aaca9b0 con 0x564d7a9cf2c0 2024-05-08T18:33:05.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.188+0000 7fbed30ce640 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 0x564d7aaca470 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00a520 tx=0x7fbecc003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.188+0000 7fbdbfe07640 1 -- 172.21.15.87:0/3589256661 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbecc073070 con 0x564d7a9cf2c0 2024-05-08T18:33:05.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.188+0000 7fbdbfe07640 1 -- 172.21.15.87:0/3589256661 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbecc05d570 con 0x564d7a9cf2c0 2024-05-08T18:33:05.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.188+0000 7fbdbfe07640 1 -- 172.21.15.87:0/3589256661 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbecc057070 con 0x564d7a9cf2c0 2024-05-08T18:33:05.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.188+0000 7fbed843c800 1 -- 172.21.15.87:0/3589256661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d7aacac40 con 0x564d7a9cf2c0 2024-05-08T18:33:05.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.188+0000 7fbed843c800 1 -- 172.21.15.87:0/3589256661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d7aacd8f0 con 0x564d7a9cf2c0 2024-05-08T18:33:05.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.189+0000 7fbdbfe07640 1 -- 172.21.15.87:0/3589256661 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbecc076070 con 0x564d7a9cf2c0 2024-05-08T18:33:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.189+0000 7fbdbfe07640 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbdb803bba0 0x7fbdb803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.189+0000 7fbdbfe07640 1 -- 172.21.15.87:0/3589256661 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fbecc094200 con 0x564d7a9cf2c0 2024-05-08T18:33:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.189+0000 7fbed28cd640 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbdb803bba0 0x7fbdb803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.189+0000 7fbed843c800 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x564d7a9d0480 0x564d7aad16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.189+0000 7fbed843c800 1 -- 172.21.15.87:0/3589256661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7aad1bf0 con 0x564d7a9d0480 2024-05-08T18:33:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.189+0000 7fbed38cf640 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x564d7a9d0480 0x564d7aad16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.190+0000 7fbed28cd640 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbdb803bba0 0x7fbdb803e060 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbebc000f60 tx=0x7fbebc001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.190+0000 7fbed38cf640 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x564d7a9d0480 0x564d7aad16b0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.190+0000 7fbed38cf640 1 -- 172.21.15.87:0/3589256661 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbec400a4a0 con 0x564d7a9d0480 2024-05-08T18:33:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.190+0000 7fbed843c800 1 -- 172.21.15.87:0/3589256661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7aacec60 con 0x564d7a9d0480 2024-05-08T18:33:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.190+0000 7fbed38cf640 1 -- 172.21.15.87:0/3589256661 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbec400a4a0 con 0x564d7a9d0480 2024-05-08T18:33:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.190+0000 7fbed843c800 1 -- 172.21.15.87:0/3589256661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7aad3a00 con 0x564d7a9d0480 2024-05-08T18:33:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.191+0000 7fbed38cf640 1 -- 172.21.15.87:0/3589256661 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbec400a4a0 con 0x564d7a9d0480 2024-05-08T18:33:05.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.191+0000 7fbed843c800 1 -- 172.21.15.87:0/3589256661 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7aad2c30 con 0x564d7a9d0480 2024-05-08T18:33:05.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.191+0000 7fbed38cf640 1 -- 172.21.15.87:0/3589256661 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbec400a4a0 con 0x564d7a9d0480 2024-05-08T18:33:05.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.191+0000 7fbed843c800 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x564d7aad4db0 0x564d7aad71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.191+0000 7fbed843c800 1 -- 172.21.15.87:0/3589256661 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7aad76e0 con 0x564d7aad4db0 2024-05-08T18:33:05.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.191+0000 7fbed30ce640 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x564d7aad4db0 0x564d7aad71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.192+0000 7fbed30ce640 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x564d7aad4db0 0x564d7aad71a0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.192+0000 7fbed30ce640 1 -- 172.21.15.87:0/3589256661 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbecc075030 con 0x564d7aad4db0 2024-05-08T18:33:05.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.192+0000 7fbed843c800 1 Processor -- start 2024-05-08T18:33:05.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.192+0000 7fbed843c800 1 -- start start 2024-05-08T18:33:05.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.192+0000 7fbed843c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aae5920 0x564d7aae5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.192+0000 7fbed843c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564d7a8c0fc0 con 0x564d7aae5920 2024-05-08T18:33:05.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.193+0000 7fbed38cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aae5920 0x564d7aae5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.193+0000 7fbed38cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aae5920 0x564d7aae5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52776/0 (socket says 172.21.15.87:52776) 2024-05-08T18:33:05.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.193+0000 7fbed38cf640 1 -- 172.21.15.87:0/3240033545 learned_addr learned my addr 172.21.15.87:0/3240033545 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.193+0000 7fbed38cf640 1 -- 172.21.15.87:0/3240033545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d7aae6280 con 0x564d7aae5920 2024-05-08T18:33:05.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.193+0000 7fbed38cf640 1 --2- 172.21.15.87:0/3240033545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aae5920 0x564d7aae5d40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x564d7aacb870 tx=0x7fbec40178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.193+0000 7fbdbd602640 1 -- 172.21.15.87:0/3240033545 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec4013440 con 0x564d7aae5920 2024-05-08T18:33:05.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.193+0000 7fbdbd602640 1 -- 172.21.15.87:0/3240033545 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec40135e0 con 0x564d7aae5920 2024-05-08T18:33:05.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.193+0000 7fbed843c800 1 -- 172.21.15.87:0/3240033545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d7aae6cf0 con 0x564d7aae5920 2024-05-08T18:33:05.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.193+0000 7fbdbd602640 1 -- 172.21.15.87:0/3240033545 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec40138c0 con 0x564d7aae5920 2024-05-08T18:33:05.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.193+0000 7fbed843c800 1 -- 172.21.15.87:0/3240033545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d7aae71f0 con 0x564d7aae5920 2024-05-08T18:33:05.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.194+0000 7fbdbd602640 1 -- 172.21.15.87:0/3240033545 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbec4011040 con 0x564d7aae5920 2024-05-08T18:33:05.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.194+0000 7fbdbd602640 1 --2- 172.21.15.87:0/3240033545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbdac03bba0 0x7fbdac03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.194+0000 7fbdbd602640 1 -- 172.21.15.87:0/3240033545 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fbec401d070 con 0x564d7aae5920 2024-05-08T18:33:05.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.194+0000 7fbed30ce640 1 --2- 172.21.15.87:0/3240033545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbdac03bba0 0x7fbdac03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.195+0000 7fbed843c800 1 Processor -- start 2024-05-08T18:33:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.195+0000 7fbed843c800 1 -- start start 2024-05-08T18:33:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.195+0000 7fbed30ce640 1 --2- 172.21.15.87:0/3240033545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbdac03bba0 0x7fbdac03e060 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbecc044830 tx=0x7fbecc066750 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.195+0000 7fbed843c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aaf2c00 0x564d7aaf3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.195+0000 7fbed843c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564d7a943500 con 0x564d7aaf2c00 2024-05-08T18:33:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.195+0000 7fbed38cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aaf2c00 0x564d7aaf3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.195+0000 7fbed38cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aaf2c00 0x564d7aaf3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52788/0 (socket says 172.21.15.87:52788) 2024-05-08T18:33:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.195+0000 7fbed38cf640 1 -- 172.21.15.87:0/2917057739 learned_addr learned my addr 172.21.15.87:0/2917057739 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.195+0000 7fbed38cf640 1 -- 172.21.15.87:0/2917057739 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d7aaf35f0 con 0x564d7aaf2c00 2024-05-08T18:33:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.195+0000 7fbed38cf640 1 --2- 172.21.15.87:0/2917057739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aaf2c00 0x564d7aaf3020 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbec40103f0 tx=0x7fbec4029430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa4dea3b196b4cd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.195+0000 7fbdb6ffd640 1 -- 172.21.15.87:0/2917057739 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec40014f0 con 0x564d7aaf2c00 2024-05-08T18:33:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.195+0000 7fbdb6ffd640 1 -- 172.21.15.87:0/2917057739 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec4001690 con 0x564d7aaf2c00 2024-05-08T18:33:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.196+0000 7fbdb6ffd640 1 -- 172.21.15.87:0/2917057739 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec40157b0 con 0x564d7aaf2c00 2024-05-08T18:33:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.196+0000 7fbed843c800 1 -- 172.21.15.87:0/2917057739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aaf2c00 msgr2=0x564d7aaf3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.196+0000 7fbed843c800 1 --2- 172.21.15.87:0/2917057739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aaf2c00 0x564d7aaf3020 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbec40103f0 tx=0x7fbec4029430 comp rx=0 tx=0).stop 2024-05-08T18:33:05.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.196+0000 7fbed843c800 1 -- 172.21.15.87:0/2917057739 shutdown_connections 2024-05-08T18:33:05.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.196+0000 7fbed843c800 1 --2- 172.21.15.87:0/2917057739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aaf2c00 0x564d7aaf3020 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.196+0000 7fbed843c800 1 -- 172.21.15.87:0/2917057739 >> 172.21.15.87:0/2917057739 conn(0x564d7aaeef60 msgr2=0x564d7aaecfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.196+0000 7fbed843c800 1 -- 172.21.15.87:0/2917057739 shutdown_connections 2024-05-08T18:33:05.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.196+0000 7fbed843c800 1 -- 172.21.15.87:0/2917057739 wait complete. 2024-05-08T18:33:05.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.196+0000 7fbed843c800 1 Processor -- start 2024-05-08T18:33:05.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.196+0000 7fbed843c800 1 -- start start 2024-05-08T18:33:05.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.196+0000 7fbed843c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aaf2c00 0x564d7aafa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.196+0000 7fbed843c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564d7aaf3d60 con 0x564d7aaf2c00 2024-05-08T18:33:05.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.197+0000 7fbed38cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aaf2c00 0x564d7aafa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.197+0000 7fbed38cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aaf2c00 0x564d7aafa260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52798/0 (socket says 172.21.15.87:52798) 2024-05-08T18:33:05.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.197+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 learned_addr learned my addr 172.21.15.87:0/868722226 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.197+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d7aafa7a0 con 0x564d7aaf2c00 2024-05-08T18:33:05.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.197+0000 7fbed38cf640 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aaf2c00 0x564d7aafa260 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fbec4001f40 tx=0x7fbec40528f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.197+0000 7fbdb57fa640 1 -- 172.21.15.87:0/868722226 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec4030020 con 0x564d7aaf2c00 2024-05-08T18:33:05.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.197+0000 7fbdb57fa640 1 -- 172.21.15.87:0/868722226 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec40513f0 con 0x564d7aaf2c00 2024-05-08T18:33:05.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.197+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d7aafaa30 con 0x564d7aaf2c00 2024-05-08T18:33:05.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.197+0000 7fbdb57fa640 1 -- 172.21.15.87:0/868722226 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbec40014f0 con 0x564d7aaf2c00 2024-05-08T18:33:05.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.197+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d7aafd6e0 con 0x564d7aaf2c00 2024-05-08T18:33:05.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.198+0000 7fbdb57fa640 1 -- 172.21.15.87:0/868722226 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbec4033020 con 0x564d7aaf2c00 2024-05-08T18:33:05.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.198+0000 7fbdb57fa640 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbd9c03bb50 0x7fbd9c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.198+0000 7fbdb57fa640 1 -- 172.21.15.87:0/868722226 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fbec400e040 con 0x564d7aaf2c00 2024-05-08T18:33:05.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.199+0000 7fbed30ce640 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbd9c03bb50 0x7fbd9c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.199+0000 7fbed30ce640 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbd9c03bb50 0x7fbd9c03e010 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0927f0 tx=0x7fbecc080000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.199+0000 7fbed843c800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.199+0000 7fbed843c800 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x564d7ab05d40 0x564d7ab08200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.199+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab08950 con 0x564d7ab05d40 2024-05-08T18:33:05.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.199+0000 7fbed28cd640 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x564d7ab05d40 0x564d7ab08200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.199+0000 7fbed28cd640 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x564d7ab05d40 0x564d7ab08200 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed843c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed843c800 20 realm 2024-05-08T18:33:05.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed843c800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab05190 con 0x564d7ab05d40 2024-05-08T18:33:05.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed843c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed843c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:05.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed843c800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab09440 con 0x564d7ab05d40 2024-05-08T18:33:05.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed843c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed843c800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab09d10 con 0x564d7ab05d40 2024-05-08T18:33:05.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed843c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:05.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed843c800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.200+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0a0b0 con 0x564d7ab05d40 2024-05-08T18:33:05.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.201+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.201+0000 7fbed843c800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:05.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.201+0000 7fbed843c800 20 searching for the correct realm 2024-05-08T18:33:05.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.201+0000 7fbed843c800 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x564d7ab0bf90 0x564d7ab0e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.201+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x564d7ab0bf90 2024-05-08T18:33:05.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.201+0000 7fbed38cf640 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x564d7ab0bf90 0x564d7ab0e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.201+0000 7fbed38cf640 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x564d7ab0bf90 0x564d7ab0e3c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.202+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec4029070 con 0x564d7ab0bf90 2024-05-08T18:33:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.202+0000 7fbed38cf640 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fbec4035020 0x7fbec402b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.202+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x7fbec4035020 2024-05-08T18:33:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.202+0000 7fbed30ce640 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fbec4035020 0x7fbec402b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.202+0000 7fbed30ce640 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fbec4035020 0x7fbec402b3e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.202+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc075030 con 0x7fbec4035020 2024-05-08T18:33:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.202+0000 7fbed30ce640 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fbecc078060 0x7fbecc076360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.202+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x7fbecc078060 2024-05-08T18:33:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.202+0000 7fbed28cd640 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fbecc078060 0x7fbecc076360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.203+0000 7fbed28cd640 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fbecc078060 0x7fbecc076360 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.203+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.203+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x564d7ab05d40 2024-05-08T18:33:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.203+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.203+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x564d7ab05d40 2024-05-08T18:33:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.204+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.204+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x7fbecc078060 2024-05-08T18:33:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.204+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.204+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x7fbecc078060 2024-05-08T18:33:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.204+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.204+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x7fbec4035020 2024-05-08T18:33:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.204+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc075030 con 0x7fbec4035020 2024-05-08T18:33:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.204+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x564d7ab0bf90 2024-05-08T18:33:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.205+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec4029070 con 0x564d7ab0bf90 2024-05-08T18:33:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.205+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x564d7ab05d40 2024-05-08T18:33:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.205+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.205+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x7fbecc078060 2024-05-08T18:33:05.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.205+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.205+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x564d7ab05d40 2024-05-08T18:33:05.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.205+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.205+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x7fbec4035020 2024-05-08T18:33:05.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.206+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbecc075030 con 0x7fbec4035020 2024-05-08T18:33:05.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.206+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x564d7ab0bf90 2024-05-08T18:33:05.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.206+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec4029070 con 0x564d7ab0bf90 2024-05-08T18:33:05.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.206+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x564d7ab0bf90 2024-05-08T18:33:05.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.206+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec4029070 con 0x564d7ab0bf90 2024-05-08T18:33:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.206+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x7fbecc078060 2024-05-08T18:33:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.206+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.206+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x564d7ab0bf90 2024-05-08T18:33:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.207+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec4029070 con 0x564d7ab0bf90 2024-05-08T18:33:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.207+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x564d7ab0bf90 2024-05-08T18:33:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.207+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec4029070 con 0x564d7ab0bf90 2024-05-08T18:33:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.207+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x564d7ab05d40 2024-05-08T18:33:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.207+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.207+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x564d7ab05d40 2024-05-08T18:33:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.207+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v29'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.207+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x7fbecc078060 2024-05-08T18:33:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.208+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.208+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x564d7ab0bf90 2024-05-08T18:33:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.208+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec4029070 con 0x564d7ab0bf90 2024-05-08T18:33:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.208+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x7fbec4035020 2024-05-08T18:33:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.208+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc075030 con 0x7fbec4035020 2024-05-08T18:33:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.208+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x564d7ab05d40 2024-05-08T18:33:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.208+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.208+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x7fbecc078060 2024-05-08T18:33:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.209+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.209+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x564d7ab0bf90 2024-05-08T18:33:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.209+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec4029070 con 0x564d7ab0bf90 2024-05-08T18:33:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.209+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x7fbec4035020 2024-05-08T18:33:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.209+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc075030 con 0x7fbec4035020 2024-05-08T18:33:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.209+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x7fbec4035020 2024-05-08T18:33:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.209+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc075030 con 0x7fbec4035020 2024-05-08T18:33:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.209+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x564d7ab0bf90 2024-05-08T18:33:05.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.209+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbec4029070 con 0x564d7ab0bf90 2024-05-08T18:33:05.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x7fbec4035020 2024-05-08T18:33:05.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc075030 con 0x7fbec4035020 2024-05-08T18:33:05.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x564d7ab05d40 2024-05-08T18:33:05.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ea90 con 0x7fbec4035020 2024-05-08T18:33:05.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbecc075030 con 0x7fbec4035020 2024-05-08T18:33:05.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed843c800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:05.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed843c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:05.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed843c800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:05.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed843c800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:05.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed843c800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:05.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed843c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:05.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed843c800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0aa00 con 0x564d7ab05d40 2024-05-08T18:33:05.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed843c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed843c800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.210+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0b2a0 con 0x564d7ab05d40 2024-05-08T18:33:05.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.211+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.211+0000 7fbed843c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:05.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.211+0000 7fbed843c800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.211+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0ef10 con 0x7fbecc078060 2024-05-08T18:33:05.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.211+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.211+0000 7fbed843c800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:05.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.211+0000 7fbed843c800 20 zone default found 2024-05-08T18:33:05.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.211+0000 7fbed843c800 4 Realm: () 2024-05-08T18:33:05.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.211+0000 7fbed843c800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:05.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.211+0000 7fbed843c800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:05.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.211+0000 7fbed843c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:05.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.211+0000 7fbed843c800 20 zonegroup default 2024-05-08T18:33:05.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.211+0000 7fbed843c800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.211+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab0aef0 con 0x7fbecc078060 2024-05-08T18:33:05.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.212+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.212+0000 7fbed843c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.212+0000 7fbed843c800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.212+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab112f0 con 0x564d7ab0bf90 2024-05-08T18:33:05.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.212+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbec4029070 con 0x564d7ab0bf90 2024-05-08T18:33:05.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.212+0000 7fbed843c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.212+0000 7fbed843c800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.212+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab11690 con 0x564d7ab0bf90 2024-05-08T18:33:05.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.212+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbec4029070 con 0x564d7ab0bf90 2024-05-08T18:33:05.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.212+0000 7fbed843c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.212+0000 7fbed843c800 20 started sync module instance, tier type = 2024-05-08T18:33:05.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.212+0000 7fbed843c800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:05.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.212+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab10780 con 0x7fbec4035020 2024-05-08T18:33:05.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.213+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbecc075030 con 0x7fbec4035020 2024-05-08T18:33:05.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.213+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94890770893680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab11ee0 con 0x7fbec4035020 2024-05-08T18:33:05.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.213+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab12730 con 0x564d7ab05d40 2024-05-08T18:33:05.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.214+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94890770893680] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbecc075030 con 0x7fbec4035020 2024-05-08T18:33:05.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.214+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.214+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94890770897456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab12770 con 0x564d7ab05d40 2024-05-08T18:33:05.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.214+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab13280 con 0x564d7ab0bf90 2024-05-08T18:33:05.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.216+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec4029070 con 0x564d7ab0bf90 2024-05-08T18:33:05.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.216+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94890770902320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab13b10 con 0x564d7ab0bf90 2024-05-08T18:33:05.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.216+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab145e0 con 0x7fbec4035020 2024-05-08T18:33:05.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.216+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94890770897456] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.217+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94890770902320] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec4029070 con 0x564d7ab0bf90 2024-05-08T18:33:05.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.217+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbecc075030 con 0x7fbec4035020 2024-05-08T18:33:05.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.217+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94890770907344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab13620 con 0x7fbec4035020 2024-05-08T18:33:05.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.217+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab14fa0 con 0x564d7ab05d40 2024-05-08T18:33:05.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.218+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.218+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94890770910416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab156e0 con 0x564d7ab05d40 2024-05-08T18:33:05.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.218+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab16200 con 0x7fbecc078060 2024-05-08T18:33:05.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.218+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94890770907344] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbecc075030 con 0x7fbec4035020 2024-05-08T18:33:05.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.221+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94890770910416] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.221+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.221+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94890770914512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab161c0 con 0x7fbecc078060 2024-05-08T18:33:05.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.221+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab16aa0 con 0x7fbecc078060 2024-05-08T18:33:05.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.222+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94890770914512] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.222+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.222+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94890770899584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab161c0 con 0x7fbecc078060 2024-05-08T18:33:05.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.222+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab170c0 con 0x7fbecc078060 2024-05-08T18:33:05.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.223+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94890770899584] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.223+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.223+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94890770916768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab170c0 con 0x7fbecc078060 2024-05-08T18:33:05.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.223+0000 7fbed843c800 20 add_watcher() i=0 2024-05-08T18:33:05.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.223+0000 7fbed843c800 20 add_watcher() i=1 2024-05-08T18:33:05.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.223+0000 7fbed843c800 20 add_watcher() i=2 2024-05-08T18:33:05.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.223+0000 7fbed843c800 20 add_watcher() i=3 2024-05-08T18:33:05.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.223+0000 7fbed843c800 20 add_watcher() i=4 2024-05-08T18:33:05.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.223+0000 7fbed843c800 20 add_watcher() i=5 2024-05-08T18:33:05.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.223+0000 7fbed843c800 20 add_watcher() i=6 2024-05-08T18:33:05.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.224+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94890770916768] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.224+0000 7fbed843c800 20 add_watcher() i=7 2024-05-08T18:33:05.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.224+0000 7fbed843c800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:05.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.224+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab1a3f0 con 0x564d7ab05d40 2024-05-08T18:33:05.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.225+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.225+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94890770918784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab17650 con 0x564d7ab05d40 2024-05-08T18:33:05.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.226+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94890770918784] v29'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.226+0000 7fbd89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:05.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.226+0000 7fbed843c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:05.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.226+0000 7fbed843c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:05.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.226+0000 7fbed843c800 5 note: GC not initialized 2024-05-08T18:33:05.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.226+0000 7fbd88fe1640 20 reqs_thread_entry: start 2024-05-08T18:33:05.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.226+0000 7fbed843c800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:05.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.226+0000 7fbed843c800 20 Filter name: none 2024-05-08T18:33:05.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.226+0000 7fbd027fc640 20 reqs_thread_entry: start 2024-05-08T18:33:05.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.226+0000 7fbed843c800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:33:05.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.226+0000 7fbed843c800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.226+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab4d9f0 con 0x7fbecc078060 2024-05-08T18:33:05.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.227+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.227+0000 7fbed843c800 20 rados_obj.operate() r=0 bl.length=460 2024-05-08T18:33:05.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.227+0000 7fbed843c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:33:05.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.227+0000 7fbed843c800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.227+0000 7fbed843c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:33:05.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.227+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab53ee0 con 0x7fbecc078060 2024-05-08T18:33:05.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.228+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v29'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.228+0000 7fbed843c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:05.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.228+0000 7fbed843c800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.228+0000 7fbed843c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:33:05.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.228+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94890771167392 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab4f4c0 con 0x564d7ab05d40 2024-05-08T18:33:05.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.229+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== watch-notify(notify (1) cookie 94890770910416 notify 124554051608 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fbebc018040 con 0x564d7ab05d40 2024-05-08T18:33:05.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.229+0000 7fbdb6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051608 cookie 94890770910416 notifier 4865 bl.length()=666 2024-05-08T18:33:05.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.229+0000 7fbdb6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:05.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.229+0000 7fbdb6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.229+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 notify.4 [notify cookie 94890771167392 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.229+0000 7fbdb6ffd640 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fbd98003ea0 con 0x564d7ab05d40 2024-05-08T18:33:05.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.229+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.229+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== watch-notify(notify_complete (2) cookie 94890771167392 notify 124554051608 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbebc009050 con 0x564d7ab05d40 2024-05-08T18:33:05.237 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:33:04.270799Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:33:04.270781Z","tags":[],"group_ids":[]} 2024-05-08T18:33:05.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.230+0000 7fbd89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:05.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.230+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94890770918784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab524d0 con 0x564d7ab05d40 2024-05-08T18:33:05.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.231+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94890770918784] v29'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.231+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94890770893680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab524d0 con 0x7fbec4035020 2024-05-08T18:33:05.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.232+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94890770893680] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbecc075030 con 0x7fbec4035020 2024-05-08T18:33:05.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.232+0000 7fbed843c800 20 remove_watcher() i=0 2024-05-08T18:33:05.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.232+0000 7fbed843c800 2 removed watcher, disabling cache 2024-05-08T18:33:05.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.232+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94890770897456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab10b70 con 0x564d7ab05d40 2024-05-08T18:33:05.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.234+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94890770897456] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.234+0000 7fbed843c800 20 remove_watcher() i=1 2024-05-08T18:33:05.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.234+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94890770902320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab11a30 con 0x564d7ab0bf90 2024-05-08T18:33:05.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.235+0000 7fbed38cf640 1 -- 172.21.15.87:0/868722226 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94890770902320] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbec4029070 con 0x564d7ab0bf90 2024-05-08T18:33:05.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.235+0000 7fbed843c800 20 remove_watcher() i=2 2024-05-08T18:33:05.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.235+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94890770907344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab11a30 con 0x7fbec4035020 2024-05-08T18:33:05.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.235+0000 7fbed30ce640 1 -- 172.21.15.87:0/868722226 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94890770907344] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbecc075030 con 0x7fbec4035020 2024-05-08T18:33:05.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.235+0000 7fbed843c800 20 remove_watcher() i=3 2024-05-08T18:33:05.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.236+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94890770910416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab11a30 con 0x564d7ab05d40 2024-05-08T18:33:05.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.237+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94890770910416] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x564d7ab05d40 2024-05-08T18:33:05.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.237+0000 7fbed843c800 20 remove_watcher() i=4 2024-05-08T18:33:05.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.237+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94890770914512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab14cd0 con 0x7fbecc078060 2024-05-08T18:33:05.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.238+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94890770914512] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.238+0000 7fbed843c800 20 remove_watcher() i=5 2024-05-08T18:33:05.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.238+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94890770899584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab15cd0 con 0x7fbecc078060 2024-05-08T18:33:05.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.239+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94890770899584] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.239+0000 7fbed843c800 20 remove_watcher() i=6 2024-05-08T18:33:05.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.239+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94890770916768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564d7ab12280 con 0x7fbecc078060 2024-05-08T18:33:05.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94890770916768] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbebc00f610 con 0x7fbecc078060 2024-05-08T18:33:05.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 20 remove_watcher() i=7 2024-05-08T18:33:05.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fbecc078060 msgr2=0x7fbecc076360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fbecc078060 0x7fbecc076360 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x564d7ab05d40 msgr2=0x564d7ab08200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x564d7ab05d40 0x564d7ab08200 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fbec4035020 msgr2=0x7fbec402b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fbec4035020 0x7fbec402b3e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x564d7ab0bf90 msgr2=0x564d7ab0e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x564d7ab0bf90 0x564d7ab0e3c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbd9c03bb50 msgr2=0x7fbd9c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbd9c03bb50 0x7fbd9c03e010 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0927f0 tx=0x7fbecc080000 comp rx=0 tx=0).stop 2024-05-08T18:33:05.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aaf2c00 msgr2=0x564d7aafa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed28cd640 1 -- 172.21.15.87:0/868722226 reap_dead start 2024-05-08T18:33:05.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aaf2c00 0x564d7aafa260 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fbec4001f40 tx=0x7fbec40528f0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 shutdown_connections 2024-05-08T18:33:05.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 --2- 172.21.15.87:0/868722226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aaf2c00 0x564d7aafa260 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 >> 172.21.15.87:0/868722226 conn(0x564d7aaeef60 msgr2=0x564d7aaec5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 shutdown_connections 2024-05-08T18:33:05.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 -- 172.21.15.87:0/868722226 wait complete. 2024-05-08T18:33:05.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 -- 172.21.15.87:0/3240033545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbdac03bba0 msgr2=0x7fbdac03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 --2- 172.21.15.87:0/3240033545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbdac03bba0 0x7fbdac03e060 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbecc044830 tx=0x7fbecc066750 comp rx=0 tx=0).stop 2024-05-08T18:33:05.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 -- 172.21.15.87:0/3240033545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aae5920 msgr2=0x564d7aae5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.240+0000 7fbed843c800 1 --2- 172.21.15.87:0/3240033545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aae5920 0x564d7aae5d40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x564d7aacb870 tx=0x7fbec40178e0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 -- 172.21.15.87:0/3240033545 shutdown_connections 2024-05-08T18:33:05.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 --2- 172.21.15.87:0/3240033545 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbdac03bba0 0x7fbdac03e060 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 --2- 172.21.15.87:0/3240033545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7aae5920 0x564d7aae5d40 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 -- 172.21.15.87:0/3240033545 >> 172.21.15.87:0/3240033545 conn(0x564d7aad99c0 msgr2=0x564d7aad9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 -- 172.21.15.87:0/3240033545 shutdown_connections 2024-05-08T18:33:05.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 -- 172.21.15.87:0/3240033545 wait complete. 2024-05-08T18:33:05.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 -- 172.21.15.87:0/3589256661 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x564d7aad4db0 msgr2=0x564d7aad71a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x564d7aad4db0 0x564d7aad71a0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 -- 172.21.15.87:0/3589256661 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x564d7a9d0480 msgr2=0x564d7aad16b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x564d7a9d0480 0x564d7aad16b0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 -- 172.21.15.87:0/3589256661 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbdb803bba0 msgr2=0x7fbdb803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbdb803bba0 0x7fbdb803e060 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbebc000f60 tx=0x7fbebc001370 comp rx=0 tx=0).stop 2024-05-08T18:33:05.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 -- 172.21.15.87:0/3589256661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 msgr2=0x564d7aaca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 0x564d7aaca470 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00a520 tx=0x7fbecc003020 comp rx=0 tx=0).stop 2024-05-08T18:33:05.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 -- 172.21.15.87:0/3589256661 shutdown_connections 2024-05-08T18:33:05.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x564d7a9d0480 0x564d7aad16b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x564d7aad4db0 0x564d7aad71a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fbdb803bba0 0x7fbdb803e060 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 --2- 172.21.15.87:0/3589256661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d7a9cf2c0 0x564d7aaca470 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 -- 172.21.15.87:0/3589256661 >> 172.21.15.87:0/3589256661 conn(0x564d7a9ca840 msgr2=0x564d7a943a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 -- 172.21.15.87:0/3589256661 shutdown_connections 2024-05-08T18:33:05.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.241+0000 7fbed843c800 1 -- 172.21.15.87:0/3589256661 wait complete. 2024-05-08T18:33:05.249 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:05.249 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:05.249 ERROR:root:0 2024-05-08T18:33:05.249 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:33:05.254 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:05.254 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-05-08T18:33:05.254 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-05-08T18:33:05.254 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-05-08T18:33:05.300 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:05.300 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:05.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.302+0000 7f7b4581f800 1 Processor -- start 2024-05-08T18:33:05.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.303+0000 7f7b4581f800 1 -- start start 2024-05-08T18:33:05.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.303+0000 7f7b4581f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55dc1a4852c0 0x55dc1a4856e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.303+0000 7f7b4581f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dc1a485d60 con 0x55dc1a486480 2024-05-08T18:33:05.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.303+0000 7f7b4581f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55dc1a325e20 con 0x55dc1a4852c0 2024-05-08T18:33:05.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.303+0000 7f7b4331e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55dc1a4852c0 0x55dc1a4856e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.303+0000 7f7b42b1d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55dc1a486480 0x55dc1a486900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58232/0 (socket says 172.21.15.87:58232) 2024-05-08T18:33:05.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.303+0000 7f7b4331e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55dc1a4852c0 0x55dc1a4856e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52808/0 (socket says 172.21.15.87:52808) 2024-05-08T18:33:05.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.303+0000 7f7b42b1d640 1 -- 172.21.15.87:0/296274043 learned_addr learned my addr 172.21.15.87:0/296274043 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:33:05.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.303+0000 7f7b4331e640 1 -- 172.21.15.87:0/296274043 >> v1:172.21.15.53:6789/0 conn(0x55dc1a486480 legacy=0x55dc1a486900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.303+0000 7f7b4331e640 1 -- 172.21.15.87:0/296274043 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc1a487040 con 0x55dc1a4852c0 2024-05-08T18:33:05.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.305+0000 7f7b4331e640 1 --2- 172.21.15.87:0/296274043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 0x55dc1a4856e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7b34005fd0 tx=0x7f7b3401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cca6362635e8e58 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.305+0000 7f7b4231c640 1 -- 172.21.15.87:0/296274043 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b34052560 con 0x55dc1a4852c0 2024-05-08T18:33:05.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.305+0000 7f7b4231c640 1 -- 172.21.15.87:0/296274043 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b34052700 con 0x55dc1a4852c0 2024-05-08T18:33:05.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.305+0000 7f7b4231c640 1 -- 172.21.15.87:0/296274043 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b34052a60 con 0x55dc1a4852c0 2024-05-08T18:33:05.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.306+0000 7f7b4581f800 1 -- 172.21.15.87:0/296274043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 msgr2=0x55dc1a4856e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.306+0000 7f7b4581f800 1 --2- 172.21.15.87:0/296274043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 0x55dc1a4856e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7b34005fd0 tx=0x7f7b3401ccc0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.306+0000 7f7b4581f800 1 -- 172.21.15.87:0/296274043 shutdown_connections 2024-05-08T18:33:05.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.306+0000 7f7b4581f800 1 --2- 172.21.15.87:0/296274043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 0x55dc1a4856e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.306+0000 7f7b4581f800 1 -- 172.21.15.87:0/296274043 >> 172.21.15.87:0/296274043 conn(0x55dc1a480840 msgr2=0x55dc1a482c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.306+0000 7f7b4581f800 1 -- 172.21.15.87:0/296274043 shutdown_connections 2024-05-08T18:33:05.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.306+0000 7f7b4581f800 1 -- 172.21.15.87:0/296274043 wait complete. 2024-05-08T18:33:05.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.319+0000 7f7b4581f800 1 Processor -- start 2024-05-08T18:33:05.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.320+0000 7f7b4581f800 1 -- start start 2024-05-08T18:33:05.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.320+0000 7f7b4581f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 0x55dc1a576780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.320+0000 7f7b4581f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dc1a3d05c0 con 0x55dc1a4852c0 2024-05-08T18:33:05.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.320+0000 7f7b4331e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 0x55dc1a576780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.320+0000 7f7b4331e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 0x55dc1a576780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52820/0 (socket says 172.21.15.87:52820) 2024-05-08T18:33:05.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.320+0000 7f7b4331e640 1 -- 172.21.15.87:0/446310420 learned_addr learned my addr 172.21.15.87:0/446310420 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.320+0000 7f7b4331e640 1 -- 172.21.15.87:0/446310420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc1a576d50 con 0x55dc1a4852c0 2024-05-08T18:33:05.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.320+0000 7f7b4331e640 1 --2- 172.21.15.87:0/446310420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 0x55dc1a576780 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7b34007000 tx=0x7f7b3404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fbbe4a57283bfc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.321+0000 7f7a3160a640 1 -- 172.21.15.87:0/446310420 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b340529e0 con 0x55dc1a4852c0 2024-05-08T18:33:05.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.321+0000 7f7a3160a640 1 -- 172.21.15.87:0/446310420 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b34052b80 con 0x55dc1a4852c0 2024-05-08T18:33:05.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.321+0000 7f7a3160a640 1 -- 172.21.15.87:0/446310420 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b3405c430 con 0x55dc1a4852c0 2024-05-08T18:33:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.321+0000 7f7b4581f800 1 -- 172.21.15.87:0/446310420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 msgr2=0x55dc1a576780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.321+0000 7f7b4581f800 1 --2- 172.21.15.87:0/446310420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 0x55dc1a576780 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7b34007000 tx=0x7f7b3404c000 comp rx=0 tx=0).stop 2024-05-08T18:33:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.321+0000 7f7b4581f800 1 -- 172.21.15.87:0/446310420 shutdown_connections 2024-05-08T18:33:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.321+0000 7f7b4581f800 1 --2- 172.21.15.87:0/446310420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 0x55dc1a576780 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.321+0000 7f7b4581f800 1 -- 172.21.15.87:0/446310420 >> 172.21.15.87:0/446310420 conn(0x55dc1a480840 msgr2=0x55dc1a5720a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.321+0000 7f7b4581f800 1 -- 172.21.15.87:0/446310420 shutdown_connections 2024-05-08T18:33:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.321+0000 7f7b4581f800 1 -- 172.21.15.87:0/446310420 wait complete. 2024-05-08T18:33:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.322+0000 7f7b4581f800 1 Processor -- start 2024-05-08T18:33:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.322+0000 7f7b4581f800 1 -- start start 2024-05-08T18:33:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.322+0000 7f7b4581f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 0x55dc1a57e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.322+0000 7f7b4581f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dc1a48e950 con 0x55dc1a4852c0 2024-05-08T18:33:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.322+0000 7f7b4331e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 0x55dc1a57e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.322+0000 7f7b4331e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 0x55dc1a57e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52824/0 (socket says 172.21.15.87:52824) 2024-05-08T18:33:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.322+0000 7f7b4331e640 1 -- 172.21.15.87:0/2951461804 learned_addr learned my addr 172.21.15.87:0/2951461804 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.322+0000 7f7b4331e640 1 -- 172.21.15.87:0/2951461804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc1a57e780 con 0x55dc1a4852c0 2024-05-08T18:33:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.322+0000 7f7b4331e640 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 0x55dc1a57e240 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7b340526d0 tx=0x7f7b34003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.323+0000 7f7a2fe07640 1 -- 172.21.15.87:0/2951461804 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b34075070 con 0x55dc1a4852c0 2024-05-08T18:33:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.323+0000 7f7a2fe07640 1 -- 172.21.15.87:0/2951461804 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b34070410 con 0x55dc1a4852c0 2024-05-08T18:33:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.323+0000 7f7b4581f800 1 -- 172.21.15.87:0/2951461804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc1a57ea10 con 0x55dc1a4852c0 2024-05-08T18:33:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.323+0000 7f7a2fe07640 1 -- 172.21.15.87:0/2951461804 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b340529e0 con 0x55dc1a4852c0 2024-05-08T18:33:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.323+0000 7f7b4581f800 1 -- 172.21.15.87:0/2951461804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc1a5816c0 con 0x55dc1a4852c0 2024-05-08T18:33:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.323+0000 7f7a2fe07640 1 -- 172.21.15.87:0/2951461804 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7b34078070 con 0x55dc1a4852c0 2024-05-08T18:33:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.324+0000 7f7a2fe07640 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a2803bba0 0x7f7a2803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.324+0000 7f7a2fe07640 1 -- 172.21.15.87:0/2951461804 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7b3406d070 con 0x55dc1a4852c0 2024-05-08T18:33:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.324+0000 7f7b42b1d640 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a2803bba0 0x7f7a2803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.324+0000 7f7b4581f800 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dc1a486480 0x55dc1a585480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.324+0000 7f7b4581f800 1 -- 172.21.15.87:0/2951461804 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5859c0 con 0x55dc1a486480 2024-05-08T18:33:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.324+0000 7f7b43b1f640 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dc1a486480 0x55dc1a585480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.324+0000 7f7b42b1d640 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a2803bba0 0x7f7a2803e060 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7b38001d90 tx=0x7f7b380012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.324+0000 7f7b43b1f640 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dc1a486480 0x55dc1a585480 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.325+0000 7f7b43b1f640 1 -- 172.21.15.87:0/2951461804 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b3c0083e0 con 0x55dc1a486480 2024-05-08T18:33:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.325+0000 7f7b4581f800 1 -- 172.21.15.87:0/2951461804 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a582a50 con 0x55dc1a486480 2024-05-08T18:33:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.325+0000 7f7b43b1f640 1 -- 172.21.15.87:0/2951461804 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b3c0083e0 con 0x55dc1a486480 2024-05-08T18:33:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.325+0000 7f7b4581f800 1 -- 172.21.15.87:0/2951461804 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a587810 con 0x55dc1a486480 2024-05-08T18:33:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.325+0000 7f7b43b1f640 1 -- 172.21.15.87:0/2951461804 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7b3c0083e0 con 0x55dc1a486480 2024-05-08T18:33:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.325+0000 7f7b4581f800 1 -- 172.21.15.87:0/2951461804 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a586a40 con 0x55dc1a486480 2024-05-08T18:33:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.325+0000 7f7b43b1f640 1 -- 172.21.15.87:0/2951461804 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b3c0083e0 con 0x55dc1a486480 2024-05-08T18:33:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.325+0000 7f7b4581f800 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55dc1a588bc0 0x55dc1a58afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.325+0000 7f7b4581f800 1 -- 172.21.15.87:0/2951461804 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a58b4f0 con 0x55dc1a588bc0 2024-05-08T18:33:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.326+0000 7f7b4331e640 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55dc1a588bc0 0x55dc1a58afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.326+0000 7f7b4331e640 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55dc1a588bc0 0x55dc1a58afb0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.326+0000 7f7b4331e640 1 -- 172.21.15.87:0/2951461804 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b34077030 con 0x55dc1a588bc0 2024-05-08T18:33:05.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.327+0000 7f7b4581f800 1 Processor -- start 2024-05-08T18:33:05.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.327+0000 7f7b4581f800 1 -- start start 2024-05-08T18:33:05.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.327+0000 7f7b4581f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a599770 0x55dc1a599b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.327+0000 7f7b4581f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dc1a376fc0 con 0x55dc1a599770 2024-05-08T18:33:05.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.327+0000 7f7b43b1f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a599770 0x55dc1a599b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.327+0000 7f7b43b1f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a599770 0x55dc1a599b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52834/0 (socket says 172.21.15.87:52834) 2024-05-08T18:33:05.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.327+0000 7f7b43b1f640 1 -- 172.21.15.87:0/290394840 learned_addr learned my addr 172.21.15.87:0/290394840 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.327+0000 7f7b43b1f640 1 -- 172.21.15.87:0/290394840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc1a59a0d0 con 0x55dc1a599770 2024-05-08T18:33:05.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.327+0000 7f7b43b1f640 1 --2- 172.21.15.87:0/290394840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a599770 0x55dc1a599b90 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x55dc1a57f640 tx=0x7f7b3c00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.328+0000 7f7a2d602640 1 -- 172.21.15.87:0/290394840 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b3c01c070 con 0x55dc1a599770 2024-05-08T18:33:05.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.328+0000 7f7a2d602640 1 -- 172.21.15.87:0/290394840 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3c00bdc0 con 0x55dc1a599770 2024-05-08T18:33:05.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.328+0000 7f7b4581f800 1 -- 172.21.15.87:0/290394840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc1a59ab40 con 0x55dc1a599770 2024-05-08T18:33:05.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.328+0000 7f7a2d602640 1 -- 172.21.15.87:0/290394840 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b3c018540 con 0x55dc1a599770 2024-05-08T18:33:05.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.328+0000 7f7b4581f800 1 -- 172.21.15.87:0/290394840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc1a59b040 con 0x55dc1a599770 2024-05-08T18:33:05.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.328+0000 7f7a2d602640 1 -- 172.21.15.87:0/290394840 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7b3c01f070 con 0x55dc1a599770 2024-05-08T18:33:05.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.329+0000 7f7a2d602640 1 --2- 172.21.15.87:0/290394840 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a1c03bba0 0x7f7a1c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.329+0000 7f7a2d602640 1 -- 172.21.15.87:0/290394840 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7b3c054740 con 0x55dc1a599770 2024-05-08T18:33:05.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.329+0000 7f7b4331e640 1 --2- 172.21.15.87:0/290394840 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a1c03bba0 0x7f7a1c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.329+0000 7f7b4581f800 1 Processor -- start 2024-05-08T18:33:05.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.329+0000 7f7b4581f800 1 -- start start 2024-05-08T18:33:05.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.329+0000 7f7b4331e640 1 --2- 172.21.15.87:0/290394840 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a1c03bba0 0x7f7a1c03e060 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7b34078b20 tx=0x7f7b34051480 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.329+0000 7f7b4581f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a3fa920 0x55dc1a3fad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.329+0000 7f7b4581f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dc1a577070 con 0x55dc1a3fa920 2024-05-08T18:33:05.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.329+0000 7f7b43b1f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a3fa920 0x55dc1a3fad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.329+0000 7f7b43b1f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a3fa920 0x55dc1a3fad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52844/0 (socket says 172.21.15.87:52844) 2024-05-08T18:33:05.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.329+0000 7f7b43b1f640 1 -- 172.21.15.87:0/3906500257 learned_addr learned my addr 172.21.15.87:0/3906500257 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.330+0000 7f7b43b1f640 1 -- 172.21.15.87:0/3906500257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc1a3f9130 con 0x55dc1a3fa920 2024-05-08T18:33:05.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.330+0000 7f7b43b1f640 1 --2- 172.21.15.87:0/3906500257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a3fa920 0x55dc1a3fad40 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c052a40 tx=0x7f7b3c014bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a155d8679256e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.330+0000 7f7a26ffd640 1 -- 172.21.15.87:0/3906500257 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b3c0173a0 con 0x55dc1a3fa920 2024-05-08T18:33:05.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.330+0000 7f7a26ffd640 1 -- 172.21.15.87:0/3906500257 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3c017540 con 0x55dc1a3fa920 2024-05-08T18:33:05.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.330+0000 7f7a26ffd640 1 -- 172.21.15.87:0/3906500257 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b3c051300 con 0x55dc1a3fa920 2024-05-08T18:33:05.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.330+0000 7f7b4581f800 1 -- 172.21.15.87:0/3906500257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a3fa920 msgr2=0x55dc1a3fad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.330+0000 7f7b4581f800 1 --2- 172.21.15.87:0/3906500257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a3fa920 0x55dc1a3fad40 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c052a40 tx=0x7f7b3c014bb0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.330+0000 7f7b4581f800 1 -- 172.21.15.87:0/3906500257 shutdown_connections 2024-05-08T18:33:05.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.330+0000 7f7b4581f800 1 --2- 172.21.15.87:0/3906500257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a3fa920 0x55dc1a3fad40 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.330+0000 7f7b4581f800 1 -- 172.21.15.87:0/3906500257 >> 172.21.15.87:0/3906500257 conn(0x55dc1a5a2d80 msgr2=0x55dc1a5a0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.330+0000 7f7b4581f800 1 -- 172.21.15.87:0/3906500257 shutdown_connections 2024-05-08T18:33:05.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.330+0000 7f7b4581f800 1 -- 172.21.15.87:0/3906500257 wait complete. 2024-05-08T18:33:05.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.331+0000 7f7b4581f800 1 Processor -- start 2024-05-08T18:33:05.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.331+0000 7f7b4581f800 1 -- start start 2024-05-08T18:33:05.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.331+0000 7f7b4581f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a3fa920 0x55dc1a5b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.331+0000 7f7b4581f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dc1a3f9600 con 0x55dc1a3fa920 2024-05-08T18:33:05.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.331+0000 7f7b43b1f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a3fa920 0x55dc1a5b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.331+0000 7f7b43b1f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a3fa920 0x55dc1a5b0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52860/0 (socket says 172.21.15.87:52860) 2024-05-08T18:33:05.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.331+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 learned_addr learned my addr 172.21.15.87:0/72599052 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.331+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc1a5b0750 con 0x55dc1a3fa920 2024-05-08T18:33:05.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.331+0000 7f7b43b1f640 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a3fa920 0x55dc1a5b0210 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x55dc1a5a22a0 tx=0x7f7b3c0529a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.332+0000 7f7a257fa640 1 -- 172.21.15.87:0/72599052 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b3c049040 con 0x55dc1a3fa920 2024-05-08T18:33:05.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.332+0000 7f7a257fa640 1 -- 172.21.15.87:0/72599052 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3c054070 con 0x55dc1a3fa920 2024-05-08T18:33:05.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.332+0000 7f7a257fa640 1 -- 172.21.15.87:0/72599052 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b3c0173a0 con 0x55dc1a3fa920 2024-05-08T18:33:05.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.332+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc1a5b09e0 con 0x55dc1a3fa920 2024-05-08T18:33:05.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.332+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc1a5b3690 con 0x55dc1a3fa920 2024-05-08T18:33:05.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.332+0000 7f7a257fa640 1 -- 172.21.15.87:0/72599052 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7b3c054370 con 0x55dc1a3fa920 2024-05-08T18:33:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.333+0000 7f7a257fa640 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a0c03bba0 0x7f7a0c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.333+0000 7f7a257fa640 1 -- 172.21.15.87:0/72599052 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7b3c035d10 con 0x55dc1a3fa920 2024-05-08T18:33:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.333+0000 7f7b4331e640 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a0c03bba0 0x7f7a0c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.333+0000 7f7b4331e640 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a0c03bba0 0x7f7a0c03e060 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7b34052450 tx=0x7f7b3408d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.333+0000 7f7b4581f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.333+0000 7f7b4581f800 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dc1a5bbd00 0x55dc1a5be1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.333+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5be910 con 0x55dc1a5bbd00 2024-05-08T18:33:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.333+0000 7f7b42b1d640 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dc1a5bbd00 0x55dc1a5be1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.334+0000 7f7b42b1d640 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dc1a5bbd00 0x55dc1a5be1c0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.334+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b38009050 con 0x55dc1a5bbd00 2024-05-08T18:33:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.334+0000 7f7b4581f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.334+0000 7f7b4581f800 20 realm 2024-05-08T18:33:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.334+0000 7f7b4581f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.334+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5bb150 con 0x55dc1a5bbd00 2024-05-08T18:33:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.334+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b38009050 con 0x55dc1a5bbd00 2024-05-08T18:33:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.334+0000 7f7b4581f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.334+0000 7f7b4581f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.334+0000 7f7b4581f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.334+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5bf400 con 0x55dc1a5bbd00 2024-05-08T18:33:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.334+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b38009050 con 0x55dc1a5bbd00 2024-05-08T18:33:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.334+0000 7f7b4581f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.334+0000 7f7b4581f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.334+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5bfcd0 con 0x55dc1a5bbd00 2024-05-08T18:33:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.334+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b38009050 con 0x55dc1a5bbd00 2024-05-08T18:33:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.335+0000 7f7b4581f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.335+0000 7f7b4581f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.335+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c0070 con 0x55dc1a5bbd00 2024-05-08T18:33:05.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.335+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7b38009050 con 0x55dc1a5bbd00 2024-05-08T18:33:05.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.335+0000 7f7b4581f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:05.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.335+0000 7f7b4581f800 20 searching for the correct realm 2024-05-08T18:33:05.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.335+0000 7f7b4581f800 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55dc1a5c1f50 0x55dc1a5c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.335+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x55dc1a5c1f50 2024-05-08T18:33:05.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.335+0000 7f7b43b1f640 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55dc1a5c1f50 0x55dc1a5c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.335+0000 7f7b43b1f640 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55dc1a5c1f50 0x55dc1a5c43a0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.336+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c03b070 con 0x55dc1a5c1f50 2024-05-08T18:33:05.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.336+0000 7f7b43b1f640 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f7b3c021070 0x7f7b3c0559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.336+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x7f7b3c021070 2024-05-08T18:33:05.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.336+0000 7f7b4331e640 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f7b3c021070 0x7f7b3c0559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.336+0000 7f7b4331e640 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f7b3c021070 0x7f7b3c0559f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.336+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b34088040 con 0x7f7b3c021070 2024-05-08T18:33:05.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.336+0000 7f7b4331e640 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7b340a2040 0x7f7b3405b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.336+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x7f7b340a2040 2024-05-08T18:33:05.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.336+0000 7f7b42b1d640 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7b340a2040 0x7f7b3405b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.337+0000 7f7b42b1d640 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7b340a2040 0x7f7b3405b7f0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.337+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b38009050 con 0x7f7b340a2040 2024-05-08T18:33:05.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.337+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x55dc1a5bbd00 2024-05-08T18:33:05.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.337+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b38009050 con 0x55dc1a5bbd00 2024-05-08T18:33:05.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.337+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x55dc1a5bbd00 2024-05-08T18:33:05.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.337+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.338+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x7f7b340a2040 2024-05-08T18:33:05.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.338+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.338+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x7f7b340a2040 2024-05-08T18:33:05.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.338+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.338+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x7f7b3c021070 2024-05-08T18:33:05.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.338+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b34088040 con 0x7f7b3c021070 2024-05-08T18:33:05.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.338+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x55dc1a5c1f50 2024-05-08T18:33:05.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.339+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c03b070 con 0x55dc1a5c1f50 2024-05-08T18:33:05.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.339+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x55dc1a5bbd00 2024-05-08T18:33:05.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.339+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.339+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x7f7b340a2040 2024-05-08T18:33:05.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.339+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.339+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x55dc1a5bbd00 2024-05-08T18:33:05.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.339+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.339+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x7f7b3c021070 2024-05-08T18:33:05.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.340+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7b34088040 con 0x7f7b3c021070 2024-05-08T18:33:05.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.340+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x55dc1a5c1f50 2024-05-08T18:33:05.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.340+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c03b070 con 0x55dc1a5c1f50 2024-05-08T18:33:05.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.340+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x55dc1a5c1f50 2024-05-08T18:33:05.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.340+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c03b070 con 0x55dc1a5c1f50 2024-05-08T18:33:05.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.340+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x7f7b340a2040 2024-05-08T18:33:05.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.340+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.340+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x55dc1a5c1f50 2024-05-08T18:33:05.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.341+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c03b070 con 0x55dc1a5c1f50 2024-05-08T18:33:05.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.341+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x55dc1a5c1f50 2024-05-08T18:33:05.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.341+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c03b070 con 0x55dc1a5c1f50 2024-05-08T18:33:05.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.341+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x55dc1a5bbd00 2024-05-08T18:33:05.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.341+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.341+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x55dc1a5bbd00 2024-05-08T18:33:05.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.341+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v29'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.341+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x7f7b340a2040 2024-05-08T18:33:05.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.342+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.342+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x55dc1a5c1f50 2024-05-08T18:33:05.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.342+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c03b070 con 0x55dc1a5c1f50 2024-05-08T18:33:05.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.342+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x7f7b3c021070 2024-05-08T18:33:05.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.342+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b34088040 con 0x7f7b3c021070 2024-05-08T18:33:05.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.342+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x55dc1a5bbd00 2024-05-08T18:33:05.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.342+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.342+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x7f7b340a2040 2024-05-08T18:33:05.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.343+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.343+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x55dc1a5c1f50 2024-05-08T18:33:05.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.343+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c03b070 con 0x55dc1a5c1f50 2024-05-08T18:33:05.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.343+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x7f7b3c021070 2024-05-08T18:33:05.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.343+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b34088040 con 0x7f7b3c021070 2024-05-08T18:33:05.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.343+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x7f7b3c021070 2024-05-08T18:33:05.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.343+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b34088040 con 0x7f7b3c021070 2024-05-08T18:33:05.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.343+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x55dc1a5c1f50 2024-05-08T18:33:05.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c03b070 con 0x55dc1a5c1f50 2024-05-08T18:33:05.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x7f7b3c021070 2024-05-08T18:33:05.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b34088040 con 0x7f7b3c021070 2024-05-08T18:33:05.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x55dc1a5bbd00 2024-05-08T18:33:05.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4a70 con 0x7f7b3c021070 2024-05-08T18:33:05.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b34088040 con 0x7f7b3c021070 2024-05-08T18:33:05.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b4581f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:05.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b4581f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:05.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b4581f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:05.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b4581f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:05.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b4581f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:05.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b4581f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:05.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b4581f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c0a20 con 0x55dc1a5bbd00 2024-05-08T18:33:05.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b4581f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.344+0000 7f7b4581f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c12c0 con 0x55dc1a5bbd00 2024-05-08T18:33:05.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b4581f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:05.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b4581f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c4ef0 con 0x7f7b340a2040 2024-05-08T18:33:05.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b4581f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:05.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b4581f800 20 zone default found 2024-05-08T18:33:05.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b4581f800 4 Realm: () 2024-05-08T18:33:05.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b4581f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:05.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b4581f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:05.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b4581f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:05.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b4581f800 20 zonegroup default 2024-05-08T18:33:05.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b4581f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c53a0 con 0x7f7b340a2040 2024-05-08T18:33:05.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b4581f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b4581f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.345+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c6d80 con 0x55dc1a5c1f50 2024-05-08T18:33:05.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.346+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b3c03b070 con 0x55dc1a5c1f50 2024-05-08T18:33:05.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.346+0000 7f7b4581f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.346+0000 7f7b4581f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.346+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c7250 con 0x55dc1a5c1f50 2024-05-08T18:33:05.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.346+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b3c03b070 con 0x55dc1a5c1f50 2024-05-08T18:33:05.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.346+0000 7f7b4581f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.346+0000 7f7b4581f800 20 started sync module instance, tier type = 2024-05-08T18:33:05.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.346+0000 7f7b4581f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:05.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.346+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c6210 con 0x7f7b3c021070 2024-05-08T18:33:05.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.347+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b34088040 con 0x7f7b3c021070 2024-05-08T18:33:05.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.347+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94403823429120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c7b60 con 0x7f7b3c021070 2024-05-08T18:33:05.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.347+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c83b0 con 0x55dc1a5bbd00 2024-05-08T18:33:05.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.348+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94403823429120] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b34088040 con 0x7f7b3c021070 2024-05-08T18:33:05.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.349+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.349+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94403823433392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c83b0 con 0x55dc1a5bbd00 2024-05-08T18:33:05.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.349+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c8ed0 con 0x55dc1a5c1f50 2024-05-08T18:33:05.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.350+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94403823433392] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.350+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c03b070 con 0x55dc1a5c1f50 2024-05-08T18:33:05.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.350+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94403823438240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c83b0 con 0x55dc1a5c1f50 2024-05-08T18:33:05.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.350+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c9960 con 0x7f7b3c021070 2024-05-08T18:33:05.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.351+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94403823438240] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c03b070 con 0x55dc1a5c1f50 2024-05-08T18:33:05.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.351+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b34088040 con 0x7f7b3c021070 2024-05-08T18:33:05.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.351+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94403823435520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c8320 con 0x7f7b3c021070 2024-05-08T18:33:05.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.351+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5ca820 con 0x55dc1a5bbd00 2024-05-08T18:33:05.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.352+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94403823435520] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b34088040 con 0x7f7b3c021070 2024-05-08T18:33:05.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.352+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.352+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94403823444848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5cac40 con 0x55dc1a5bbd00 2024-05-08T18:33:05.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.352+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5cb600 con 0x7f7b340a2040 2024-05-08T18:33:05.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.353+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.353+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94403823448400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5cba20 con 0x7f7b340a2040 2024-05-08T18:33:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.353+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94403823444848] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.353+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5cc4e0 con 0x7f7b340a2040 2024-05-08T18:33:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.356+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94403823448400] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.356+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.356+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94403823452080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5cba20 con 0x7f7b340a2040 2024-05-08T18:33:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.356+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5cc990 con 0x7f7b340a2040 2024-05-08T18:33:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.357+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94403823452080] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.357+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.357+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94403823453344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5ccb70 con 0x7f7b340a2040 2024-05-08T18:33:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.357+0000 7f7b4581f800 20 add_watcher() i=0 2024-05-08T18:33:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.357+0000 7f7b4581f800 20 add_watcher() i=1 2024-05-08T18:33:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.357+0000 7f7b4581f800 20 add_watcher() i=2 2024-05-08T18:33:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.357+0000 7f7b4581f800 20 add_watcher() i=3 2024-05-08T18:33:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.357+0000 7f7b4581f800 20 add_watcher() i=4 2024-05-08T18:33:05.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.357+0000 7f7b4581f800 20 add_watcher() i=5 2024-05-08T18:33:05.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.357+0000 7f7b4581f800 20 add_watcher() i=6 2024-05-08T18:33:05.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.358+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94403823453344] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.358+0000 7f7b4581f800 20 add_watcher() i=7 2024-05-08T18:33:05.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.358+0000 7f7b4581f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:05.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.358+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5cff40 con 0x55dc1a5bbd00 2024-05-08T18:33:05.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.359+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.359+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94403823454816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5cd330 con 0x55dc1a5bbd00 2024-05-08T18:33:05.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.360+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94403823454816] v29'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.360+0000 7f79fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:05.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.360+0000 7f7b4581f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:05.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.360+0000 7f7b4581f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:05.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.360+0000 7f7b4581f800 5 note: GC not initialized 2024-05-08T18:33:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.360+0000 7f79f97e2640 20 reqs_thread_entry: start 2024-05-08T18:33:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.360+0000 7f7b4581f800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.360+0000 7f7b4581f800 20 Filter name: none 2024-05-08T18:33:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.360+0000 7f79f27fc640 20 reqs_thread_entry: start 2024-05-08T18:33:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.360+0000 7f7b4581f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:33:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.360+0000 7f7b4581f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.360+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a603290 con 0x7f7b340a2040 2024-05-08T18:33:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.361+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.361+0000 7f7b4581f800 20 rados_obj.operate() r=0 bl.length=490 2024-05-08T18:33:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.361+0000 7f7b4581f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:33:05.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.361+0000 7f7b4581f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.361+0000 7f7b4581f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:33:05.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.361+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a609b60 con 0x7f7b340a2040 2024-05-08T18:33:05.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.362+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v29'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.362+0000 7f7b4581f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:05.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.362+0000 7f7b4581f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.362+0000 7f7b4581f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:33:05.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.362+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94403823703328 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a605140 con 0x55dc1a5bbd00 2024-05-08T18:33:05.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.363+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== watch-notify(notify (1) cookie 94403823444848 notify 124554051609 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55dc1a485d60 con 0x55dc1a5bbd00 2024-05-08T18:33:05.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.363+0000 7f7a26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051609 cookie 94403823444848 notifier 4872 bl.length()=666 2024-05-08T18:33:05.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.363+0000 7f7a26ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:05.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.363+0000 7f7a26ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.363+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 notify.4 [notify cookie 94403823703328 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.363+0000 7f7a26ffd640 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7a08003ea0 con 0x55dc1a5bbd00 2024-05-08T18:33:05.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.363+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.363+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== watch-notify(notify_complete (2) cookie 94403823703328 notify 124554051609 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7b3803fa80 con 0x55dc1a5bbd00 2024-05-08T18:33:05.374 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:33:04.270799Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:33:04.270781Z","tags":[],"group_ids":[]} 2024-05-08T18:33:05.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.364+0000 7f79fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:05.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.364+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94403823454816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a605500 con 0x55dc1a5bbd00 2024-05-08T18:33:05.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.365+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94403823454816] v29'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.365+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94403823429120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5cca60 con 0x7f7b3c021070 2024-05-08T18:33:05.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.366+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94403823429120] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b34088040 con 0x7f7b3c021070 2024-05-08T18:33:05.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.366+0000 7f7b4581f800 20 remove_watcher() i=0 2024-05-08T18:33:05.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.366+0000 7f7b4581f800 2 removed watcher, disabling cache 2024-05-08T18:33:05.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.366+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94403823433392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5cca60 con 0x55dc1a5bbd00 2024-05-08T18:33:05.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.367+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94403823433392] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.367+0000 7f7b4581f800 20 remove_watcher() i=1 2024-05-08T18:33:05.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.367+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94403823438240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c76b0 con 0x55dc1a5c1f50 2024-05-08T18:33:05.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.368+0000 7f7b43b1f640 1 -- 172.21.15.87:0/72599052 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94403823438240] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c03b070 con 0x55dc1a5c1f50 2024-05-08T18:33:05.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.368+0000 7f7b4581f800 20 remove_watcher() i=2 2024-05-08T18:33:05.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.368+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94403823435520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5cca60 con 0x7f7b3c021070 2024-05-08T18:33:05.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.369+0000 7f7b4331e640 1 -- 172.21.15.87:0/72599052 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94403823435520] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b34088040 con 0x7f7b3c021070 2024-05-08T18:33:05.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.369+0000 7f7b4581f800 20 remove_watcher() i=3 2024-05-08T18:33:05.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.369+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94403823444848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c89a0 con 0x55dc1a5bbd00 2024-05-08T18:33:05.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.371+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94403823444848] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x55dc1a5bbd00 2024-05-08T18:33:05.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.371+0000 7f7b4581f800 20 remove_watcher() i=4 2024-05-08T18:33:05.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.371+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94403823448400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c76b0 con 0x7f7b340a2040 2024-05-08T18:33:05.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.372+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94403823448400] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.372+0000 7f7b4581f800 20 remove_watcher() i=5 2024-05-08T18:33:05.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.372+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94403823452080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5c7f00 con 0x7f7b340a2040 2024-05-08T18:33:05.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.373+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94403823452080] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.373+0000 7f7b4581f800 20 remove_watcher() i=6 2024-05-08T18:33:05.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.373+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94403823453344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dc1a5cca60 con 0x7f7b340a2040 2024-05-08T18:33:05.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94403823453344] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3802a040 con 0x7f7b340a2040 2024-05-08T18:33:05.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 20 remove_watcher() i=7 2024-05-08T18:33:05.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7b340a2040 msgr2=0x7f7b3405b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7b340a2040 0x7f7b3405b7f0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dc1a5bbd00 msgr2=0x55dc1a5be1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dc1a5bbd00 0x55dc1a5be1c0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f7b3c021070 msgr2=0x7f7b3c0559f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f7b3c021070 0x7f7b3c0559f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55dc1a5c1f50 msgr2=0x55dc1a5c43a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55dc1a5c1f50 0x55dc1a5c43a0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a0c03bba0 msgr2=0x7f7a0c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a0c03bba0 0x7f7a0c03e060 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7b34052450 tx=0x7f7b3408d000 comp rx=0 tx=0).stop 2024-05-08T18:33:05.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a3fa920 msgr2=0x55dc1a5b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 --2- 172.21.15.87:0/72599052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a3fa920 0x55dc1a5b0210 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x55dc1a5a22a0 tx=0x7f7b3c0529a0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 reap_dead start 2024-05-08T18:33:05.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b42b1d640 1 -- 172.21.15.87:0/72599052 reap_dead start 2024-05-08T18:33:05.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 shutdown_connections 2024-05-08T18:33:05.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 >> 172.21.15.87:0/72599052 conn(0x55dc1a5a2d80 msgr2=0x55dc1a5a0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 shutdown_connections 2024-05-08T18:33:05.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 -- 172.21.15.87:0/72599052 wait complete. 2024-05-08T18:33:05.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 -- 172.21.15.87:0/290394840 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a1c03bba0 msgr2=0x7f7a1c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 --2- 172.21.15.87:0/290394840 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a1c03bba0 0x7f7a1c03e060 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7b34078b20 tx=0x7f7b34051480 comp rx=0 tx=0).stop 2024-05-08T18:33:05.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.374+0000 7f7b4581f800 1 -- 172.21.15.87:0/290394840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a599770 msgr2=0x55dc1a599b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 --2- 172.21.15.87:0/290394840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a599770 0x55dc1a599b90 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x55dc1a57f640 tx=0x7f7b3c00ef30 comp rx=0 tx=0).stop 2024-05-08T18:33:05.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 -- 172.21.15.87:0/290394840 shutdown_connections 2024-05-08T18:33:05.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 --2- 172.21.15.87:0/290394840 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a1c03bba0 0x7f7a1c03e060 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 --2- 172.21.15.87:0/290394840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a599770 0x55dc1a599b90 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 -- 172.21.15.87:0/290394840 >> 172.21.15.87:0/290394840 conn(0x55dc1a58d810 msgr2=0x55dc1a58dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 -- 172.21.15.87:0/290394840 shutdown_connections 2024-05-08T18:33:05.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 -- 172.21.15.87:0/290394840 wait complete. 2024-05-08T18:33:05.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 -- 172.21.15.87:0/2951461804 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55dc1a588bc0 msgr2=0x55dc1a58afb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55dc1a588bc0 0x55dc1a58afb0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 -- 172.21.15.87:0/2951461804 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dc1a486480 msgr2=0x55dc1a585480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dc1a486480 0x55dc1a585480 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 -- 172.21.15.87:0/2951461804 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a2803bba0 msgr2=0x7f7a2803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a2803bba0 0x7f7a2803e060 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7b38001d90 tx=0x7f7b380012f0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 -- 172.21.15.87:0/2951461804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 msgr2=0x55dc1a57e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 0x55dc1a57e240 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7b340526d0 tx=0x7f7b34003330 comp rx=0 tx=0).stop 2024-05-08T18:33:05.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 -- 172.21.15.87:0/2951461804 shutdown_connections 2024-05-08T18:33:05.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55dc1a486480 0x55dc1a585480 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55dc1a588bc0 0x55dc1a58afb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f7a2803bba0 0x7f7a2803e060 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 --2- 172.21.15.87:0/2951461804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc1a4852c0 0x55dc1a57e240 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 -- 172.21.15.87:0/2951461804 >> 172.21.15.87:0/2951461804 conn(0x55dc1a480840 msgr2=0x55dc1a5708a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 -- 172.21.15.87:0/2951461804 shutdown_connections 2024-05-08T18:33:05.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.375+0000 7f7b4581f800 1 -- 172.21.15.87:0/2951461804 wait complete. 2024-05-08T18:33:05.386 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:05.387 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:05.387 ERROR:root:0 2024-05-08T18:33:05.387 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:33:05.391 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:05.391 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:33:05.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:33:05.392 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-08T18:33:05.440 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:05.440 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:05.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.442+0000 7fea5ec87800 1 Processor -- start 2024-05-08T18:33:05.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.442+0000 7fea5ec87800 1 -- start start 2024-05-08T18:33:05.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.442+0000 7fea5ec87800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d7a4fac6b0 0x55d7a4fb51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.442+0000 7fea5ec87800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d7a4f1f520 con 0x55d7a4faab70 2024-05-08T18:33:05.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.442+0000 7fea5ec87800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55d7a4e4ce20 con 0x55d7a4fac6b0 2024-05-08T18:33:05.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.443+0000 7fea5bf7e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d7a4fac6b0 0x55d7a4fb51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.443+0000 7fea5bf7e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d7a4fac6b0 0x55d7a4fb51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52870/0 (socket says 172.21.15.87:52870) 2024-05-08T18:33:05.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.443+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1017427716 learned_addr learned my addr 172.21.15.87:0/1017427716 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.443+0000 7fea5c77f640 1 --1- 172.21.15.87:0/1017427716 >> v1:172.21.15.53:6789/0 conn(0x55d7a4faab70 0x55d7a4faaf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58236/0 (socket says 172.21.15.87:58236) 2024-05-08T18:33:05.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.443+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1017427716 >> v1:172.21.15.53:6789/0 conn(0x55d7a4faab70 legacy=0x55d7a4faaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.443+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1017427716 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7a4fb6700 con 0x55d7a4fac6b0 2024-05-08T18:33:05.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.445+0000 7fea5bf7e640 1 --2- 172.21.15.87:0/1017427716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4fac6b0 0x55d7a4fb51b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fea5000a520 tx=0x7fea5001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b63433af653d82 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.445+0000 7fea5b77d640 1 -- 172.21.15.87:0/1017427716 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea50057070 con 0x55d7a4fac6b0 2024-05-08T18:33:05.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.445+0000 7fea5b77d640 1 -- 172.21.15.87:0/1017427716 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea50052570 con 0x55d7a4fac6b0 2024-05-08T18:33:05.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.445+0000 7fea5b77d640 1 -- 172.21.15.87:0/1017427716 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea50052870 con 0x55d7a4fac6b0 2024-05-08T18:33:05.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.445+0000 7fea5ec87800 1 -- 172.21.15.87:0/1017427716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4fac6b0 msgr2=0x55d7a4fb51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.445+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1017427716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4fac6b0 0x55d7a4fb51b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fea5000a520 tx=0x7fea5001d010 comp rx=0 tx=0).stop 2024-05-08T18:33:05.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.445+0000 7fea5ec87800 1 -- 172.21.15.87:0/1017427716 shutdown_connections 2024-05-08T18:33:05.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.445+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1017427716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4fac6b0 0x55d7a4fb51b0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.445+0000 7fea5ec87800 1 -- 172.21.15.87:0/1017427716 >> 172.21.15.87:0/1017427716 conn(0x55d7a4fa6730 msgr2=0x55d7a4fa8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.445+0000 7fea5ec87800 1 -- 172.21.15.87:0/1017427716 shutdown_connections 2024-05-08T18:33:05.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.445+0000 7fea5ec87800 1 -- 172.21.15.87:0/1017427716 wait complete. 2024-05-08T18:33:05.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.459+0000 7fea5ec87800 1 Processor -- start 2024-05-08T18:33:05.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.459+0000 7fea5ec87800 1 -- start start 2024-05-08T18:33:05.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.460+0000 7fea5ec87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4faab70 0x55d7a509f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.460+0000 7fea5ec87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7a4ef75c0 con 0x55d7a4faab70 2024-05-08T18:33:05.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.460+0000 7fea5c77f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4faab70 0x55d7a509f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.460+0000 7fea5c77f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4faab70 0x55d7a509f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52880/0 (socket says 172.21.15.87:52880) 2024-05-08T18:33:05.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.460+0000 7fea5c77f640 1 -- 172.21.15.87:0/3489027064 learned_addr learned my addr 172.21.15.87:0/3489027064 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.460+0000 7fea5c77f640 1 -- 172.21.15.87:0/3489027064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7a509ffa0 con 0x55d7a4faab70 2024-05-08T18:33:05.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.460+0000 7fea5c77f640 1 --2- 172.21.15.87:0/3489027064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4faab70 0x55d7a509f9d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fea4c001680 tx=0x7fea4c001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff4ecee520c53f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.461+0000 7fe94a60c640 1 -- 172.21.15.87:0/3489027064 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea4c013420 con 0x55d7a4faab70 2024-05-08T18:33:05.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.461+0000 7fe94a60c640 1 -- 172.21.15.87:0/3489027064 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea4c0135c0 con 0x55d7a4faab70 2024-05-08T18:33:05.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.461+0000 7fe94a60c640 1 -- 172.21.15.87:0/3489027064 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea4c013900 con 0x55d7a4faab70 2024-05-08T18:33:05.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.461+0000 7fea5ec87800 1 -- 172.21.15.87:0/3489027064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4faab70 msgr2=0x55d7a509f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.461+0000 7fea5ec87800 1 --2- 172.21.15.87:0/3489027064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4faab70 0x55d7a509f9d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fea4c001680 tx=0x7fea4c001b40 comp rx=0 tx=0).stop 2024-05-08T18:33:05.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.461+0000 7fea5ec87800 1 -- 172.21.15.87:0/3489027064 shutdown_connections 2024-05-08T18:33:05.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.461+0000 7fea5ec87800 1 --2- 172.21.15.87:0/3489027064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4faab70 0x55d7a509f9d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.461+0000 7fea5ec87800 1 -- 172.21.15.87:0/3489027064 >> 172.21.15.87:0/3489027064 conn(0x55d7a4fa6730 msgr2=0x55d7a509b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.461+0000 7fea5ec87800 1 -- 172.21.15.87:0/3489027064 shutdown_connections 2024-05-08T18:33:05.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.461+0000 7fea5ec87800 1 -- 172.21.15.87:0/3489027064 wait complete. 2024-05-08T18:33:05.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.462+0000 7fea5ec87800 1 Processor -- start 2024-05-08T18:33:05.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.462+0000 7fea5ec87800 1 -- start start 2024-05-08T18:33:05.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.462+0000 7fea5ec87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4faab70 0x55d7a50a7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.462+0000 7fea5ec87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7a4fb59c0 con 0x55d7a4faab70 2024-05-08T18:33:05.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.462+0000 7fea5c77f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4faab70 0x55d7a50a7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.462+0000 7fea5c77f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4faab70 0x55d7a50a7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52884/0 (socket says 172.21.15.87:52884) 2024-05-08T18:33:05.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.462+0000 7fea5c77f640 1 -- 172.21.15.87:0/1136560601 learned_addr learned my addr 172.21.15.87:0/1136560601 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.462+0000 7fea5c77f640 1 -- 172.21.15.87:0/1136560601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7a50a7a90 con 0x55d7a4faab70 2024-05-08T18:33:05.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.462+0000 7fea5c77f640 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4faab70 0x55d7a50a7550 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fea4c001680 tx=0x7fea4c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.463+0000 7fe948e09640 1 -- 172.21.15.87:0/1136560601 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea4c022020 con 0x55d7a4faab70 2024-05-08T18:33:05.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.463+0000 7fe948e09640 1 -- 172.21.15.87:0/1136560601 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea4c006800 con 0x55d7a4faab70 2024-05-08T18:33:05.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.463+0000 7fea5ec87800 1 -- 172.21.15.87:0/1136560601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7a50a7d20 con 0x55d7a4faab70 2024-05-08T18:33:05.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.463+0000 7fe948e09640 1 -- 172.21.15.87:0/1136560601 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea4c004c30 con 0x55d7a4faab70 2024-05-08T18:33:05.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.463+0000 7fea5ec87800 1 -- 172.21.15.87:0/1136560601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7a50aa9d0 con 0x55d7a4faab70 2024-05-08T18:33:05.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.463+0000 7fe948e09640 1 -- 172.21.15.87:0/1136560601 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fea4c025020 con 0x55d7a4faab70 2024-05-08T18:33:05.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.464+0000 7fe948e09640 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe94403bb50 0x7fe94403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.464+0000 7fe948e09640 1 -- 172.21.15.87:0/1136560601 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fea4c018030 con 0x55d7a4faab70 2024-05-08T18:33:05.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.464+0000 7fea5bf7e640 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe94403bb50 0x7fe94403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.464+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d7a4fac6b0 0x55d7a50ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.464+0000 7fea5ec87800 1 -- 172.21.15.87:0/1136560601 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50aed10 con 0x55d7a4fac6b0 2024-05-08T18:33:05.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.464+0000 7fea5cf80640 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d7a4fac6b0 0x55d7a50ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.464+0000 7fea5bf7e640 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe94403bb50 0x7fe94403e010 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fea50054000 tx=0x7fea5004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.464+0000 7fea5cf80640 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d7a4fac6b0 0x55d7a50ae790 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.465+0000 7fea5cf80640 1 -- 172.21.15.87:0/1136560601 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea540083e0 con 0x55d7a4fac6b0 2024-05-08T18:33:05.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.465+0000 7fea5ec87800 1 -- 172.21.15.87:0/1136560601 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50abd40 con 0x55d7a4fac6b0 2024-05-08T18:33:05.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.465+0000 7fea5cf80640 1 -- 172.21.15.87:0/1136560601 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea540083e0 con 0x55d7a4fac6b0 2024-05-08T18:33:05.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.465+0000 7fea5ec87800 1 -- 172.21.15.87:0/1136560601 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50b0b30 con 0x55d7a4fac6b0 2024-05-08T18:33:05.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.465+0000 7fea5cf80640 1 -- 172.21.15.87:0/1136560601 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fea540083e0 con 0x55d7a4fac6b0 2024-05-08T18:33:05.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.465+0000 7fea5ec87800 1 -- 172.21.15.87:0/1136560601 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50afd60 con 0x55d7a4fac6b0 2024-05-08T18:33:05.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.465+0000 7fea5cf80640 1 -- 172.21.15.87:0/1136560601 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fea540083e0 con 0x55d7a4fac6b0 2024-05-08T18:33:05.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.465+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d7a50b1ee0 0x55d7a50b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.465+0000 7fea5ec87800 1 -- 172.21.15.87:0/1136560601 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50b4810 con 0x55d7a50b1ee0 2024-05-08T18:33:05.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.466+0000 7fea5c77f640 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d7a50b1ee0 0x55d7a50b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.466+0000 7fea5c77f640 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d7a50b1ee0 0x55d7a50b42d0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.466+0000 7fea5c77f640 1 -- 172.21.15.87:0/1136560601 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fea4c01b070 con 0x55d7a50b1ee0 2024-05-08T18:33:05.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.467+0000 7fea5ec87800 1 Processor -- start 2024-05-08T18:33:05.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.467+0000 7fea5ec87800 1 -- start start 2024-05-08T18:33:05.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.467+0000 7fea5ec87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50c2a90 0x55d7a50c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.467+0000 7fea5ec87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7a4e9dfc0 con 0x55d7a50c2a90 2024-05-08T18:33:05.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.467+0000 7fea5cf80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50c2a90 0x55d7a50c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.467+0000 7fea5cf80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50c2a90 0x55d7a50c2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52898/0 (socket says 172.21.15.87:52898) 2024-05-08T18:33:05.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.467+0000 7fea5cf80640 1 -- 172.21.15.87:0/3439356043 learned_addr learned my addr 172.21.15.87:0/3439356043 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.467+0000 7fea5cf80640 1 -- 172.21.15.87:0/3439356043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7a50c33f0 con 0x55d7a50c2a90 2024-05-08T18:33:05.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.468+0000 7fea5cf80640 1 --2- 172.21.15.87:0/3439356043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50c2a90 0x55d7a50c2eb0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x55d7a50a8770 tx=0x7fea5400ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.468+0000 7fe941ffb640 1 -- 172.21.15.87:0/3439356043 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea5401c070 con 0x55d7a50c2a90 2024-05-08T18:33:05.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.468+0000 7fe941ffb640 1 -- 172.21.15.87:0/3439356043 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea54018410 con 0x55d7a50c2a90 2024-05-08T18:33:05.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.468+0000 7fea5ec87800 1 -- 172.21.15.87:0/3439356043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7a50c3e60 con 0x55d7a50c2a90 2024-05-08T18:33:05.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.468+0000 7fe941ffb640 1 -- 172.21.15.87:0/3439356043 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea54018730 con 0x55d7a50c2a90 2024-05-08T18:33:05.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.468+0000 7fea5ec87800 1 -- 172.21.15.87:0/3439356043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7a50c4360 con 0x55d7a50c2a90 2024-05-08T18:33:05.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.468+0000 7fe941ffb640 1 -- 172.21.15.87:0/3439356043 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fea5401f070 con 0x55d7a50c2a90 2024-05-08T18:33:05.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.469+0000 7fe941ffb640 1 --2- 172.21.15.87:0/3439356043 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe93403bba0 0x7fe93403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.469+0000 7fe941ffb640 1 -- 172.21.15.87:0/3439356043 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fea54054770 con 0x55d7a50c2a90 2024-05-08T18:33:05.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.469+0000 7fea5c77f640 1 --2- 172.21.15.87:0/3439356043 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe93403bba0 0x7fe93403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.469+0000 7fea5ec87800 1 Processor -- start 2024-05-08T18:33:05.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.469+0000 7fea5ec87800 1 -- start start 2024-05-08T18:33:05.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.469+0000 7fea5c77f640 1 --2- 172.21.15.87:0/3439356043 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe93403bba0 0x7fe93403e060 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fea4c01ffd0 tx=0x7fea4c051080 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.469+0000 7fea5ec87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50cfde0 0x55d7a50d0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.469+0000 7fea5ec87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7a50a0320 con 0x55d7a50cfde0 2024-05-08T18:33:05.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.469+0000 7fea5cf80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50cfde0 0x55d7a50d0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.469+0000 7fea5cf80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50cfde0 0x55d7a50d0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52908/0 (socket says 172.21.15.87:52908) 2024-05-08T18:33:05.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.469+0000 7fea5cf80640 1 -- 172.21.15.87:0/2082215141 learned_addr learned my addr 172.21.15.87:0/2082215141 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.470+0000 7fea5cf80640 1 -- 172.21.15.87:0/2082215141 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7a50d07d0 con 0x55d7a50cfde0 2024-05-08T18:33:05.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.470+0000 7fea5cf80640 1 --2- 172.21.15.87:0/2082215141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50cfde0 0x55d7a50d0200 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fea54014a50 tx=0x7fea54052c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baaaa6c948b01f69 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.470+0000 7fe93b7fe640 1 -- 172.21.15.87:0/2082215141 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea54026030 con 0x55d7a50cfde0 2024-05-08T18:33:05.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.470+0000 7fe93b7fe640 1 -- 172.21.15.87:0/2082215141 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea54016c80 con 0x55d7a50cfde0 2024-05-08T18:33:05.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.470+0000 7fe93b7fe640 1 -- 172.21.15.87:0/2082215141 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea540173a0 con 0x55d7a50cfde0 2024-05-08T18:33:05.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.470+0000 7fea5ec87800 1 -- 172.21.15.87:0/2082215141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50cfde0 msgr2=0x55d7a50d0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.470+0000 7fea5ec87800 1 --2- 172.21.15.87:0/2082215141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50cfde0 0x55d7a50d0200 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fea54014a50 tx=0x7fea54052c00 comp rx=0 tx=0).stop 2024-05-08T18:33:05.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.470+0000 7fea5ec87800 1 -- 172.21.15.87:0/2082215141 shutdown_connections 2024-05-08T18:33:05.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.470+0000 7fea5ec87800 1 --2- 172.21.15.87:0/2082215141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50cfde0 0x55d7a50d0200 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.470+0000 7fea5ec87800 1 -- 172.21.15.87:0/2082215141 >> 172.21.15.87:0/2082215141 conn(0x55d7a50cc0b0 msgr2=0x55d7a50ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.471+0000 7fea5ec87800 1 -- 172.21.15.87:0/2082215141 shutdown_connections 2024-05-08T18:33:05.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.471+0000 7fea5ec87800 1 -- 172.21.15.87:0/2082215141 wait complete. 2024-05-08T18:33:05.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.471+0000 7fea5ec87800 1 Processor -- start 2024-05-08T18:33:05.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.471+0000 7fea5ec87800 1 -- start start 2024-05-08T18:33:05.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.471+0000 7fea5ec87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50cfde0 0x55d7a50d7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.471+0000 7fea5ec87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7a50d0f20 con 0x55d7a50cfde0 2024-05-08T18:33:05.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.471+0000 7fea5cf80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50cfde0 0x55d7a50d7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.471+0000 7fea5cf80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50cfde0 0x55d7a50d7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52914/0 (socket says 172.21.15.87:52914) 2024-05-08T18:33:05.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.471+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 learned_addr learned my addr 172.21.15.87:0/1967539621 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.471+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7a50d7850 con 0x55d7a50cfde0 2024-05-08T18:33:05.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.472+0000 7fea5cf80640 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50cfde0 0x55d7a50d7310 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fea54014a50 tx=0x7fea54052990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.472+0000 7fe939ffb640 1 -- 172.21.15.87:0/1967539621 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea540542e0 con 0x55d7a50cfde0 2024-05-08T18:33:05.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.472+0000 7fe939ffb640 1 -- 172.21.15.87:0/1967539621 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea54054480 con 0x55d7a50cfde0 2024-05-08T18:33:05.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.472+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7a50d7ae0 con 0x55d7a50cfde0 2024-05-08T18:33:05.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.472+0000 7fe939ffb640 1 -- 172.21.15.87:0/1967539621 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea54018a00 con 0x55d7a50cfde0 2024-05-08T18:33:05.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.472+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7a50d7ae0 con 0x55d7a50cfde0 2024-05-08T18:33:05.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.472+0000 7fe939ffb640 1 -- 172.21.15.87:0/1967539621 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fea54018ba0 con 0x55d7a50cfde0 2024-05-08T18:33:05.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.473+0000 7fe939ffb640 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe92c03bb50 0x7fe92c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.473+0000 7fe939ffb640 1 -- 172.21.15.87:0/1967539621 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fea5403cc00 con 0x55d7a50cfde0 2024-05-08T18:33:05.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.473+0000 7fea5c77f640 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe92c03bb50 0x7fe92c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.473+0000 7fea5c77f640 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe92c03bb50 0x7fe92c03e010 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0267a0 tx=0x7fea4c049000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.474+0000 7fea5ec87800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.474+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d7a50e2c50 0x55d7a50e5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.474+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50e5860 con 0x55d7a50e2c50 2024-05-08T18:33:05.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.474+0000 7fea5bf7e640 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d7a50e2c50 0x55d7a50e5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.474+0000 7fea5bf7e640 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d7a50e2c50 0x55d7a50e5110 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.474+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.474+0000 7fea5ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.474+0000 7fea5ec87800 20 realm 2024-05-08T18:33:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.474+0000 7fea5ec87800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.474+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50e5c30 con 0x55d7a50e2c50 2024-05-08T18:33:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.474+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.474+0000 7fea5ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.474+0000 7fea5ec87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.475+0000 7fea5ec87800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.475+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50e6500 con 0x55d7a50e2c50 2024-05-08T18:33:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.475+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.475+0000 7fea5ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.475+0000 7fea5ec87800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.475+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50e68a0 con 0x55d7a50e2c50 2024-05-08T18:33:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.475+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.475+0000 7fea5ec87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.475+0000 7fea5ec87800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.475+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50e70f0 con 0x55d7a50e2c50 2024-05-08T18:33:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.475+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.475+0000 7fea5ec87800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.475+0000 7fea5ec87800 20 searching for the correct realm 2024-05-08T18:33:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.475+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55d7a50e8e60 0x55d7a50eb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.475+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50eb7e0 con 0x55d7a50e8e60 2024-05-08T18:33:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.475+0000 7fea5cf80640 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55d7a50e8e60 0x55d7a50eb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.476+0000 7fea5cf80640 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55d7a50e8e60 0x55d7a50eb250 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.476+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea54028070 con 0x55d7a50e8e60 2024-05-08T18:33:05.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.476+0000 7fea5cf80640 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fea54029c20 0x7fea54054a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.476+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50eb7e0 con 0x7fea54029c20 2024-05-08T18:33:05.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.476+0000 7fea5c77f640 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fea54029c20 0x7fea54054a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.476+0000 7fea5c77f640 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fea54029c20 0x7fea54054a10 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.477+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4c04d040 con 0x7fea54029c20 2024-05-08T18:33:05.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.477+0000 7fea5c77f640 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fea4c027020 0x7fea4c0435c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.477+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50eb7e0 con 0x7fea4c027020 2024-05-08T18:33:05.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.477+0000 7fea5bf7e640 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fea4c027020 0x7fea4c0435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.478+0000 7fea5bf7e640 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fea4c027020 0x7fea4c0435c0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.478+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.478+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50eb7e0 con 0x55d7a50e2c50 2024-05-08T18:33:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.478+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.478+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50eb7e0 con 0x55d7a50e2c50 2024-05-08T18:33:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.478+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.478+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50eb7e0 con 0x7fea4c027020 2024-05-08T18:33:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.479+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.479+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50eb7e0 con 0x7fea4c027020 2024-05-08T18:33:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.479+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.479+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50eb7e0 con 0x7fea54029c20 2024-05-08T18:33:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.479+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4c04d040 con 0x7fea54029c20 2024-05-08T18:33:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.479+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50eb7e0 con 0x55d7a50e8e60 2024-05-08T18:33:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.479+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea54028070 con 0x55d7a50e8e60 2024-05-08T18:33:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.479+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50eb7e0 con 0x55d7a50e2c50 2024-05-08T18:33:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.480+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.480+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50eb7e0 con 0x7fea4c027020 2024-05-08T18:33:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.480+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.480+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50eb7e0 con 0x55d7a50e2c50 2024-05-08T18:33:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.480+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.480+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50eb7e0 con 0x7fea54029c20 2024-05-08T18:33:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.480+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fea4c04d040 con 0x7fea54029c20 2024-05-08T18:33:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.481+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x55d7a50e8e60 2024-05-08T18:33:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.481+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea54028070 con 0x55d7a50e8e60 2024-05-08T18:33:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.481+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x55d7a50e8e60 2024-05-08T18:33:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.481+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea54028070 con 0x55d7a50e8e60 2024-05-08T18:33:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.481+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x7fea4c027020 2024-05-08T18:33:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.481+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.481+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x55d7a50e8e60 2024-05-08T18:33:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.481+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea54028070 con 0x55d7a50e8e60 2024-05-08T18:33:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.481+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x55d7a50e8e60 2024-05-08T18:33:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.482+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea54028070 con 0x55d7a50e8e60 2024-05-08T18:33:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.482+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x55d7a50e2c50 2024-05-08T18:33:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.482+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.482+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x55d7a50e2c50 2024-05-08T18:33:05.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.482+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v29'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.482+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x7fea4c027020 2024-05-08T18:33:05.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.482+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.482+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x55d7a50e8e60 2024-05-08T18:33:05.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.483+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea54028070 con 0x55d7a50e8e60 2024-05-08T18:33:05.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.483+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x7fea54029c20 2024-05-08T18:33:05.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.483+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4c04d040 con 0x7fea54029c20 2024-05-08T18:33:05.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.483+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x55d7a50e2c50 2024-05-08T18:33:05.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.483+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.483+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x7fea4c027020 2024-05-08T18:33:05.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.483+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.484+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x55d7a50e8e60 2024-05-08T18:33:05.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.484+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea54028070 con 0x55d7a50e8e60 2024-05-08T18:33:05.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.484+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x7fea54029c20 2024-05-08T18:33:05.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.484+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4c04d040 con 0x7fea54029c20 2024-05-08T18:33:05.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.484+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x7fea54029c20 2024-05-08T18:33:05.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.484+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4c04d040 con 0x7fea54029c20 2024-05-08T18:33:05.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.484+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x55d7a50e8e60 2024-05-08T18:33:05.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.484+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea54028070 con 0x55d7a50e8e60 2024-05-08T18:33:05.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.484+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x7fea54029c20 2024-05-08T18:33:05.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.485+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4c04d040 con 0x7fea54029c20 2024-05-08T18:33:05.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.485+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x55d7a50e2c50 2024-05-08T18:33:05.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.485+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.485+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fea4c05e060 con 0x7fea54029c20 2024-05-08T18:33:05.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.485+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4c04d040 con 0x7fea54029c20 2024-05-08T18:33:05.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.485+0000 7fea5ec87800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:05.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.485+0000 7fea5ec87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:05.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.485+0000 7fea5ec87800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:05.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.485+0000 7fea5ec87800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:05.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.485+0000 7fea5ec87800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:05.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.485+0000 7fea5ec87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:05.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.485+0000 7fea5ec87800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.485+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50e7a70 con 0x55d7a50e2c50 2024-05-08T18:33:05.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.485+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.485+0000 7fea5ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.485+0000 7fea5ec87800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.485+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50e8310 con 0x55d7a50e2c50 2024-05-08T18:33:05.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.486+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.486+0000 7fea5ec87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:05.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.486+0000 7fea5ec87800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.486+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50ebc60 con 0x7fea4c027020 2024-05-08T18:33:05.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.486+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.486+0000 7fea5ec87800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:05.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.486+0000 7fea5ec87800 20 zone default found 2024-05-08T18:33:05.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.486+0000 7fea5ec87800 4 Realm: () 2024-05-08T18:33:05.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.486+0000 7fea5ec87800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:05.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.486+0000 7fea5ec87800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:05.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.486+0000 7fea5ec87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:05.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.486+0000 7fea5ec87800 20 zonegroup default 2024-05-08T18:33:05.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.486+0000 7fea5ec87800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.486+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50ec110 con 0x7fea4c027020 2024-05-08T18:33:05.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.487+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.487+0000 7fea5ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.487+0000 7fea5ec87800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.487+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50edaf0 con 0x55d7a50e8e60 2024-05-08T18:33:05.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.487+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea54028070 con 0x55d7a50e8e60 2024-05-08T18:33:05.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.487+0000 7fea5ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.487+0000 7fea5ec87800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.487+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50edf70 con 0x55d7a50e8e60 2024-05-08T18:33:05.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.487+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea54028070 con 0x55d7a50e8e60 2024-05-08T18:33:05.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.487+0000 7fea5ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.487+0000 7fea5ec87800 20 started sync module instance, tier type = 2024-05-08T18:33:05.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.487+0000 7fea5ec87800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:05.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.487+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50ecf80 con 0x7fea54029c20 2024-05-08T18:33:05.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.488+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4c04d040 con 0x7fea54029c20 2024-05-08T18:33:05.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.488+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94384675541872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50ee880 con 0x7fea54029c20 2024-05-08T18:33:05.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.488+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50ef0d0 con 0x55d7a50e2c50 2024-05-08T18:33:05.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.489+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94384675541872] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4c04d040 con 0x7fea54029c20 2024-05-08T18:33:05.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.489+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.489+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94384675546064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50ef170 con 0x55d7a50e2c50 2024-05-08T18:33:05.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.489+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50efc90 con 0x55d7a50e8e60 2024-05-08T18:33:05.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.491+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94384675546064] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.491+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea54028070 con 0x55d7a50e8e60 2024-05-08T18:33:05.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.491+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94384675551072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50efc50 con 0x55d7a50e8e60 2024-05-08T18:33:05.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.491+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50f0740 con 0x7fea54029c20 2024-05-08T18:33:05.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.492+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94384675551072] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea54028070 con 0x55d7a50e8e60 2024-05-08T18:33:05.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.492+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4c04d040 con 0x7fea54029c20 2024-05-08T18:33:05.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.492+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94384675553872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50f0b60 con 0x7fea54029c20 2024-05-08T18:33:05.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.492+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50f1560 con 0x55d7a50e2c50 2024-05-08T18:33:05.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.493+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94384675553872] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4c04d040 con 0x7fea54029c20 2024-05-08T18:33:05.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.493+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.493+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94384675548192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50f1520 con 0x55d7a50e2c50 2024-05-08T18:33:05.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.493+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50f1ff0 con 0x7fea4c027020 2024-05-08T18:33:05.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.494+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.494+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94384675548192] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.494+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94384675560176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50f1ff0 con 0x7fea4c027020 2024-05-08T18:33:05.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.494+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50f2a00 con 0x7fea4c027020 2024-05-08T18:33:05.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.495+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94384675560176] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.495+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.495+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94384675557488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50f2a00 con 0x7fea4c027020 2024-05-08T18:33:05.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.495+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50f33c0 con 0x7fea4c027020 2024-05-08T18:33:05.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.496+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(58 notify.7 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.496+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94384675565328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50f37e0 con 0x7fea4c027020 2024-05-08T18:33:05.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.496+0000 7fea5ec87800 20 add_watcher() i=0 2024-05-08T18:33:05.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.496+0000 7fea5ec87800 20 add_watcher() i=1 2024-05-08T18:33:05.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.496+0000 7fea5ec87800 20 add_watcher() i=2 2024-05-08T18:33:05.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.496+0000 7fea5ec87800 20 add_watcher() i=3 2024-05-08T18:33:05.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.496+0000 7fea5ec87800 20 add_watcher() i=4 2024-05-08T18:33:05.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.496+0000 7fea5ec87800 20 add_watcher() i=5 2024-05-08T18:33:05.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.496+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94384675557488] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.496+0000 7fea5ec87800 20 add_watcher() i=6 2024-05-08T18:33:05.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.497+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94384675565328] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.497+0000 7fea5ec87800 20 add_watcher() i=7 2024-05-08T18:33:05.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.497+0000 7fea5ec87800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:05.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.497+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50f37e0 con 0x55d7a50e2c50 2024-05-08T18:33:05.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.498+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.498+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94384675566384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50f3750 con 0x55d7a50e2c50 2024-05-08T18:33:05.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.499+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94384675566384] v29'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.499+0000 7fe9127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:05.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.499+0000 7fea5ec87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:05.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.499+0000 7fea5ec87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:05.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.499+0000 7fea5ec87800 5 note: GC not initialized 2024-05-08T18:33:05.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.499+0000 7fe9117e2640 20 reqs_thread_entry: start 2024-05-08T18:33:05.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.499+0000 7fea5ec87800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:05.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.499+0000 7fea5ec87800 20 Filter name: none 2024-05-08T18:33:05.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.499+0000 7fe882ffd640 20 reqs_thread_entry: start 2024-05-08T18:33:05.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.499+0000 7fea5ec87800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:33:05.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.499+0000 7fea5ec87800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.499+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a5129c70 con 0x7fea4c027020 2024-05-08T18:33:05.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.500+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.500+0000 7fea5ec87800 20 rados_obj.operate() r=0 bl.length=490 2024-05-08T18:33:05.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.500+0000 7fea5ec87800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:33:05.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.500+0000 7fea5ec87800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.500+0000 7fea5ec87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:33:05.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.500+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a51304a0 con 0x7fea4c027020 2024-05-08T18:33:05.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.502+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v29'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.502+0000 7fea5ec87800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:05.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.502+0000 7fea5ec87800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.502+0000 7fea5ec87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:33:05.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.502+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94384675815008 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d7a512bac0 con 0x55d7a50e2c50 2024-05-08T18:33:05.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.502+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== watch-notify(notify (1) cookie 94384675548192 notify 124554051610 ret 0) ==== 721+0+0 (crc 0 0 0) 0x55d7a4fb6700 con 0x55d7a50e2c50 2024-05-08T18:33:05.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.502+0000 7fe93b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051610 cookie 94384675548192 notifier 4879 bl.length()=679 2024-05-08T18:33:05.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.502+0000 7fe93b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:05.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.502+0000 7fe93b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.502+0000 7fe93b7fe640 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fe920003ea0 con 0x55d7a50e2c50 2024-05-08T18:33:05.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.502+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 notify.4 [notify cookie 94384675815008 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.502+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.502+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== watch-notify(notify_complete (2) cookie 94384675815008 notify 124554051610 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fea5005db80 con 0x55d7a50e2c50 2024-05-08T18:33:05.522 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:33:04.270799Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:33:04.270781Z","tags":[],"group_ids":[]} 2024-05-08T18:33:05.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.503+0000 7fe9127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:05.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.503+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94384675566384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a512ead0 con 0x55d7a50e2c50 2024-05-08T18:33:05.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.504+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94384675566384] v29'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.504+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94384675541872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50f3330 con 0x7fea54029c20 2024-05-08T18:33:05.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.505+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94384675541872] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4c04d040 con 0x7fea54029c20 2024-05-08T18:33:05.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.505+0000 7fea5ec87800 20 remove_watcher() i=0 2024-05-08T18:33:05.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.505+0000 7fea5ec87800 2 removed watcher, disabling cache 2024-05-08T18:33:05.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.505+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94384675546064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50f3330 con 0x55d7a50e2c50 2024-05-08T18:33:05.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.507+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94384675546064] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.507+0000 7fea5ec87800 20 remove_watcher() i=1 2024-05-08T18:33:05.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.507+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94384675551072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50f3330 con 0x55d7a50e8e60 2024-05-08T18:33:05.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.508+0000 7fea5cf80640 1 -- 172.21.15.87:0/1967539621 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94384675551072] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea54028070 con 0x55d7a50e8e60 2024-05-08T18:33:05.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.508+0000 7fea5ec87800 20 remove_watcher() i=2 2024-05-08T18:33:05.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.508+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94384675553872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50ef760 con 0x7fea54029c20 2024-05-08T18:33:05.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.508+0000 7fea5c77f640 1 -- 172.21.15.87:0/1967539621 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94384675553872] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea4c04d040 con 0x7fea54029c20 2024-05-08T18:33:05.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.508+0000 7fea5ec87800 20 remove_watcher() i=3 2024-05-08T18:33:05.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.509+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94384675548192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50f3330 con 0x55d7a50e2c50 2024-05-08T18:33:05.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.509+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94384675548192] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x55d7a50e2c50 2024-05-08T18:33:05.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.509+0000 7fea5ec87800 20 remove_watcher() i=4 2024-05-08T18:33:05.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.509+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94384675560176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50f0250 con 0x7fea4c027020 2024-05-08T18:33:05.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.510+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94384675560176] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.510+0000 7fea5ec87800 20 remove_watcher() i=5 2024-05-08T18:33:05.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.510+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94384675557488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50ef760 con 0x7fea4c027020 2024-05-08T18:33:05.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.512+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94384675557488] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.512+0000 7fea5ec87800 20 remove_watcher() i=6 2024-05-08T18:33:05.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.512+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94384675565328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d7a50eec20 con 0x7fea4c027020 2024-05-08T18:33:05.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94384675565328] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea5005a040 con 0x7fea4c027020 2024-05-08T18:33:05.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 20 remove_watcher() i=7 2024-05-08T18:33:05.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fea4c027020 msgr2=0x7fea4c0435c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fea4c027020 0x7fea4c0435c0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d7a50e2c50 msgr2=0x55d7a50e5110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d7a50e2c50 0x55d7a50e5110 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fea54029c20 msgr2=0x7fea54054a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fea54029c20 0x7fea54054a10 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55d7a50e8e60 msgr2=0x55d7a50eb250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55d7a50e8e60 0x55d7a50eb250 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe92c03bb50 msgr2=0x7fe92c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe92c03bb50 0x7fe92c03e010 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0267a0 tx=0x7fea4c049000 comp rx=0 tx=0).stop 2024-05-08T18:33:05.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50cfde0 msgr2=0x55d7a50d7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5bf7e640 1 -- 172.21.15.87:0/1967539621 reap_dead start 2024-05-08T18:33:05.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50cfde0 0x55d7a50d7310 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fea54014a50 tx=0x7fea54052990 comp rx=0 tx=0).stop 2024-05-08T18:33:05.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 shutdown_connections 2024-05-08T18:33:05.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1967539621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50cfde0 0x55d7a50d7310 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 >> 172.21.15.87:0/1967539621 conn(0x55d7a50cc0b0 msgr2=0x55d7a50c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 shutdown_connections 2024-05-08T18:33:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 -- 172.21.15.87:0/1967539621 wait complete. 2024-05-08T18:33:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 -- 172.21.15.87:0/3439356043 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe93403bba0 msgr2=0x7fe93403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 --2- 172.21.15.87:0/3439356043 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe93403bba0 0x7fe93403e060 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fea4c01ffd0 tx=0x7fea4c051080 comp rx=0 tx=0).stop 2024-05-08T18:33:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 -- 172.21.15.87:0/3439356043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50c2a90 msgr2=0x55d7a50c2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 --2- 172.21.15.87:0/3439356043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50c2a90 0x55d7a50c2eb0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x55d7a50a8770 tx=0x7fea5400ef30 comp rx=0 tx=0).stop 2024-05-08T18:33:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.513+0000 7fea5ec87800 1 -- 172.21.15.87:0/3439356043 shutdown_connections 2024-05-08T18:33:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 --2- 172.21.15.87:0/3439356043 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe93403bba0 0x7fe93403e060 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 --2- 172.21.15.87:0/3439356043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a50c2a90 0x55d7a50c2eb0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 -- 172.21.15.87:0/3439356043 >> 172.21.15.87:0/3439356043 conn(0x55d7a50b6b30 msgr2=0x55d7a50b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 -- 172.21.15.87:0/3439356043 shutdown_connections 2024-05-08T18:33:05.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 -- 172.21.15.87:0/3439356043 wait complete. 2024-05-08T18:33:05.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 -- 172.21.15.87:0/1136560601 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d7a50b1ee0 msgr2=0x55d7a50b42d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d7a50b1ee0 0x55d7a50b42d0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 -- 172.21.15.87:0/1136560601 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d7a4fac6b0 msgr2=0x55d7a50ae790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d7a4fac6b0 0x55d7a50ae790 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 -- 172.21.15.87:0/1136560601 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe94403bb50 msgr2=0x7fe94403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe94403bb50 0x7fe94403e010 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fea50054000 tx=0x7fea5004e000 comp rx=0 tx=0).stop 2024-05-08T18:33:05.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 -- 172.21.15.87:0/1136560601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4faab70 msgr2=0x55d7a50a7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4faab70 0x55d7a50a7550 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fea4c001680 tx=0x7fea4c001250 comp rx=0 tx=0).stop 2024-05-08T18:33:05.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 -- 172.21.15.87:0/1136560601 shutdown_connections 2024-05-08T18:33:05.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55d7a4fac6b0 0x55d7a50ae790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55d7a50b1ee0 0x55d7a50b42d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fe94403bb50 0x7fe94403e010 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 --2- 172.21.15.87:0/1136560601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7a4faab70 0x55d7a50a7550 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 -- 172.21.15.87:0/1136560601 >> 172.21.15.87:0/1136560601 conn(0x55d7a4fa6730 msgr2=0x55d7a5099af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 -- 172.21.15.87:0/1136560601 shutdown_connections 2024-05-08T18:33:05.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.514+0000 7fea5ec87800 1 -- 172.21.15.87:0/1136560601 wait complete. 2024-05-08T18:33:05.535 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:05.536 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:05.536 ERROR:root:0 2024-05-08T18:33:05.536 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:33:05.540 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:05.541 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-05-08T18:33:05.541 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-05-08T18:33:05.541 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-05-08T18:33:05.587 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:05.587 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.589+0000 7f0f13f2d800 1 Processor -- start 2024-05-08T18:33:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.589+0000 7f0f13f2d800 1 -- start start 2024-05-08T18:33:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.590+0000 7f0f13f2d800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558e3ee875e0 0x558e3ee899d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.590+0000 7f0f13f2d800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558e3ee89fa0 con 0x558e3ee83150 2024-05-08T18:33:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.590+0000 7f0f13f2d800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x558e3ed24e20 con 0x558e3ee875e0 2024-05-08T18:33:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.590+0000 7f0f07377640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558e3ee875e0 0x558e3ee899d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.590+0000 7f0f07377640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558e3ee875e0 0x558e3ee899d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52924/0 (socket says 172.21.15.87:52924) 2024-05-08T18:33:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.590+0000 7f0f0fb78640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x558e3ee83150 0x558e3ee83570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58242/0 (socket says 172.21.15.87:58242) 2024-05-08T18:33:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.590+0000 7f0f07377640 1 -- 172.21.15.87:0/1299138610 learned_addr learned my addr 172.21.15.87:0/1299138610 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.590+0000 7f0f07377640 1 -- 172.21.15.87:0/1299138610 >> v1:172.21.15.53:6789/0 conn(0x558e3ee83150 legacy=0x558e3ee83570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.590+0000 7f0f07377640 1 -- 172.21.15.87:0/1299138610 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3ee8b1d0 con 0x558e3ee875e0 2024-05-08T18:33:05.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.592+0000 7f0f07377640 1 --2- 172.21.15.87:0/1299138610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee875e0 0x558e3ee899d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0ef800a520 tx=0x7f0ef801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316ac0f2e998d53b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.592+0000 7f0f0f377640 1 -- 172.21.15.87:0/1299138610 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef8057070 con 0x558e3ee875e0 2024-05-08T18:33:05.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.592+0000 7f0f0f377640 1 -- 172.21.15.87:0/1299138610 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef8052570 con 0x558e3ee875e0 2024-05-08T18:33:05.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.592+0000 7f0f0f377640 1 -- 172.21.15.87:0/1299138610 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef804ae60 con 0x558e3ee875e0 2024-05-08T18:33:05.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.593+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1299138610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee875e0 msgr2=0x558e3ee899d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.593+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/1299138610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee875e0 0x558e3ee899d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0ef800a520 tx=0x7f0ef801d010 comp rx=0 tx=0).stop 2024-05-08T18:33:05.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.593+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1299138610 shutdown_connections 2024-05-08T18:33:05.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.593+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/1299138610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee875e0 0x558e3ee899d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.593+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1299138610 >> 172.21.15.87:0/1299138610 conn(0x558e3ee7e730 msgr2=0x558e3ee80b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.593+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1299138610 shutdown_connections 2024-05-08T18:33:05.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.593+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1299138610 wait complete. 2024-05-08T18:33:05.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.606+0000 7f0f13f2d800 1 Processor -- start 2024-05-08T18:33:05.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.606+0000 7f0f13f2d800 1 -- start start 2024-05-08T18:33:05.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.606+0000 7f0f13f2d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee83150 0x558e3edf72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.607+0000 7f0f13f2d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558e3edcf5c0 con 0x558e3ee83150 2024-05-08T18:33:05.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.607+0000 7f0f0fb78640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee83150 0x558e3edf72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.607+0000 7f0f0fb78640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee83150 0x558e3edf72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52932/0 (socket says 172.21.15.87:52932) 2024-05-08T18:33:05.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.607+0000 7f0f0fb78640 1 -- 172.21.15.87:0/3641746508 learned_addr learned my addr 172.21.15.87:0/3641746508 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.607+0000 7f0f0fb78640 1 -- 172.21.15.87:0/3641746508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3ef761f0 con 0x558e3ee83150 2024-05-08T18:33:05.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.607+0000 7f0f0fb78640 1 --2- 172.21.15.87:0/3641746508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee83150 0x558e3edf72d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000b230 tx=0x7f0f0000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef880c5ddbb4f20 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.607+0000 7f0dfde0b640 1 -- 172.21.15.87:0/3641746508 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f0000e5c0 con 0x558e3ee83150 2024-05-08T18:33:05.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.607+0000 7f0dfde0b640 1 -- 172.21.15.87:0/3641746508 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f00006070 con 0x558e3ee83150 2024-05-08T18:33:05.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.607+0000 7f0dfde0b640 1 -- 172.21.15.87:0/3641746508 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f0000e890 con 0x558e3ee83150 2024-05-08T18:33:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.608+0000 7f0f13f2d800 1 -- 172.21.15.87:0/3641746508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee83150 msgr2=0x558e3edf72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.608+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/3641746508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee83150 0x558e3edf72d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000b230 tx=0x7f0f0000b6f0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.608+0000 7f0f13f2d800 1 -- 172.21.15.87:0/3641746508 shutdown_connections 2024-05-08T18:33:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.608+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/3641746508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee83150 0x558e3edf72d0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.608+0000 7f0f13f2d800 1 -- 172.21.15.87:0/3641746508 >> 172.21.15.87:0/3641746508 conn(0x558e3ee7e730 msgr2=0x558e3ef6fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.608+0000 7f0f13f2d800 1 -- 172.21.15.87:0/3641746508 shutdown_connections 2024-05-08T18:33:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.608+0000 7f0f13f2d800 1 -- 172.21.15.87:0/3641746508 wait complete. 2024-05-08T18:33:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.608+0000 7f0f13f2d800 1 Processor -- start 2024-05-08T18:33:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.609+0000 7f0f13f2d800 1 -- start start 2024-05-08T18:33:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.609+0000 7f0f13f2d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee83150 0x558e3ef7f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.609+0000 7f0f13f2d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558e3ee8a470 con 0x558e3ee83150 2024-05-08T18:33:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.609+0000 7f0f0fb78640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee83150 0x558e3ef7f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.609+0000 7f0f0fb78640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee83150 0x558e3ef7f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52936/0 (socket says 172.21.15.87:52936) 2024-05-08T18:33:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.609+0000 7f0f0fb78640 1 -- 172.21.15.87:0/945519864 learned_addr learned my addr 172.21.15.87:0/945519864 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.609+0000 7f0f0fb78640 1 -- 172.21.15.87:0/945519864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3ef7f9f0 con 0x558e3ee83150 2024-05-08T18:33:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.609+0000 7f0f0fb78640 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee83150 0x558e3ef7f4b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0f00000c00 tx=0x7f0f00000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.609+0000 7f0df7fff640 1 -- 172.21.15.87:0/945519864 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f0000f8d0 con 0x558e3ee83150 2024-05-08T18:33:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.609+0000 7f0df7fff640 1 -- 172.21.15.87:0/945519864 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f0000fa90 con 0x558e3ee83150 2024-05-08T18:33:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.609+0000 7f0df7fff640 1 -- 172.21.15.87:0/945519864 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f0000fdb0 con 0x558e3ee83150 2024-05-08T18:33:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.609+0000 7f0f13f2d800 1 -- 172.21.15.87:0/945519864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e3ef7fc80 con 0x558e3ee83150 2024-05-08T18:33:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.610+0000 7f0f13f2d800 1 -- 172.21.15.87:0/945519864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e3ef828e0 con 0x558e3ee83150 2024-05-08T18:33:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.610+0000 7f0df7fff640 1 -- 172.21.15.87:0/945519864 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f0f00017070 con 0x558e3ee83150 2024-05-08T18:33:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.610+0000 7f0df7fff640 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f0df803bba0 0x7f0df803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.611+0000 7f0df7fff640 1 -- 172.21.15.87:0/945519864 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0f00015020 con 0x558e3ee83150 2024-05-08T18:33:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.611+0000 7f0f07377640 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f0df803bba0 0x7f0df803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.611+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558e3ee875e0 0x558e3ef866a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.611+0000 7f0f13f2d800 1 -- 172.21.15.87:0/945519864 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3ef86c20 con 0x558e3ee875e0 2024-05-08T18:33:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.611+0000 7f0f10379640 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558e3ee875e0 0x558e3ef866a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.611+0000 7f0f07377640 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f0df803bba0 0x7f0df803e060 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8054000 tx=0x7f0ef804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.611+0000 7f0f10379640 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558e3ee875e0 0x558e3ef866a0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.611+0000 7f0f10379640 1 -- 172.21.15.87:0/945519864 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f0800a4a0 con 0x558e3ee875e0 2024-05-08T18:33:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.611+0000 7f0f13f2d800 1 -- 172.21.15.87:0/945519864 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3ef83c70 con 0x558e3ee875e0 2024-05-08T18:33:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.612+0000 7f0f10379640 1 -- 172.21.15.87:0/945519864 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f0800a4a0 con 0x558e3ee875e0 2024-05-08T18:33:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.612+0000 7f0f13f2d800 1 -- 172.21.15.87:0/945519864 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3ef88a40 con 0x558e3ee875e0 2024-05-08T18:33:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.612+0000 7f0f10379640 1 -- 172.21.15.87:0/945519864 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0f0800a4a0 con 0x558e3ee875e0 2024-05-08T18:33:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.612+0000 7f0f13f2d800 1 -- 172.21.15.87:0/945519864 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3ef87c70 con 0x558e3ee875e0 2024-05-08T18:33:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.612+0000 7f0f10379640 1 -- 172.21.15.87:0/945519864 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f0800a4a0 con 0x558e3ee875e0 2024-05-08T18:33:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.612+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558e3ef89df0 0x558e3ef8c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.612+0000 7f0f13f2d800 1 -- 172.21.15.87:0/945519864 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3ef8c720 con 0x558e3ef89df0 2024-05-08T18:33:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.612+0000 7f0f0fb78640 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558e3ef89df0 0x558e3ef8c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.613+0000 7f0f0fb78640 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558e3ef89df0 0x558e3ef8c1e0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.613+0000 7f0f0fb78640 1 -- 172.21.15.87:0/945519864 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0f0002e070 con 0x558e3ef89df0 2024-05-08T18:33:05.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.613+0000 7f0f13f2d800 1 Processor -- start 2024-05-08T18:33:05.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.613+0000 7f0f13f2d800 1 -- start start 2024-05-08T18:33:05.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.614+0000 7f0f13f2d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ef9a960 0x558e3ef9ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.614+0000 7f0f13f2d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558e3ed75fc0 con 0x558e3ef9a960 2024-05-08T18:33:05.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.614+0000 7f0f10379640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ef9a960 0x558e3ef9ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.614+0000 7f0f10379640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ef9a960 0x558e3ef9ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52952/0 (socket says 172.21.15.87:52952) 2024-05-08T18:33:05.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.614+0000 7f0f10379640 1 -- 172.21.15.87:0/3653937817 learned_addr learned my addr 172.21.15.87:0/3653937817 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.614+0000 7f0f10379640 1 -- 172.21.15.87:0/3653937817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3ef9b2c0 con 0x558e3ef9a960 2024-05-08T18:33:05.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.614+0000 7f0f10379640 1 --2- 172.21.15.87:0/3653937817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ef9a960 0x558e3ef9ad80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x558e3ef80860 tx=0x7f0f080178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.614+0000 7f0df57fa640 1 -- 172.21.15.87:0/3653937817 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f08013440 con 0x558e3ef9a960 2024-05-08T18:33:05.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.614+0000 7f0df57fa640 1 -- 172.21.15.87:0/3653937817 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f080135e0 con 0x558e3ef9a960 2024-05-08T18:33:05.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.614+0000 7f0f13f2d800 1 -- 172.21.15.87:0/3653937817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e3ef9bd30 con 0x558e3ef9a960 2024-05-08T18:33:05.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.614+0000 7f0df57fa640 1 -- 172.21.15.87:0/3653937817 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f080138c0 con 0x558e3ef9a960 2024-05-08T18:33:05.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.614+0000 7f0f13f2d800 1 -- 172.21.15.87:0/3653937817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e3ef9c230 con 0x558e3ef9a960 2024-05-08T18:33:05.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.615+0000 7f0df57fa640 1 -- 172.21.15.87:0/3653937817 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f0f08011040 con 0x558e3ef9a960 2024-05-08T18:33:05.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.615+0000 7f0df57fa640 1 --2- 172.21.15.87:0/3653937817 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f0de803bba0 0x7f0de803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.615+0000 7f0df57fa640 1 -- 172.21.15.87:0/3653937817 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0f0801d070 con 0x558e3ef9a960 2024-05-08T18:33:05.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.615+0000 7f0f0fb78640 1 --2- 172.21.15.87:0/3653937817 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f0de803bba0 0x7f0de803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.616+0000 7f0f13f2d800 1 Processor -- start 2024-05-08T18:33:05.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.616+0000 7f0f0fb78640 1 --2- 172.21.15.87:0/3653937817 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f0de803bba0 0x7f0de803e060 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0f0001dfd0 tx=0x7f0f000014c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.616+0000 7f0f13f2d800 1 -- start start 2024-05-08T18:33:05.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.616+0000 7f0f13f2d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3efa7c40 0x558e3efa8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.616+0000 7f0f13f2d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558e3ef7a980 con 0x558e3efa7c40 2024-05-08T18:33:05.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.616+0000 7f0f10379640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3efa7c40 0x558e3efa8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.616+0000 7f0f10379640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3efa7c40 0x558e3efa8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52958/0 (socket says 172.21.15.87:52958) 2024-05-08T18:33:05.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.616+0000 7f0f10379640 1 -- 172.21.15.87:0/4037234775 learned_addr learned my addr 172.21.15.87:0/4037234775 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.616+0000 7f0f10379640 1 -- 172.21.15.87:0/4037234775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3efa8630 con 0x558e3efa7c40 2024-05-08T18:33:05.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.617+0000 7f0f10379640 1 --2- 172.21.15.87:0/4037234775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3efa7c40 0x558e3efa8060 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0f08052990 tx=0x7f0f08029430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96896d9b56d2a768 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.617+0000 7f0deeffd640 1 -- 172.21.15.87:0/4037234775 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f0802ad80 con 0x558e3efa7c40 2024-05-08T18:33:05.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.617+0000 7f0deeffd640 1 -- 172.21.15.87:0/4037234775 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f080014f0 con 0x558e3efa7c40 2024-05-08T18:33:05.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.617+0000 7f0deeffd640 1 -- 172.21.15.87:0/4037234775 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f08001810 con 0x558e3efa7c40 2024-05-08T18:33:05.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.617+0000 7f0f13f2d800 1 -- 172.21.15.87:0/4037234775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3efa7c40 msgr2=0x558e3efa8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.617+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/4037234775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3efa7c40 0x558e3efa8060 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0f08052990 tx=0x7f0f08029430 comp rx=0 tx=0).stop 2024-05-08T18:33:05.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.617+0000 7f0f13f2d800 1 -- 172.21.15.87:0/4037234775 shutdown_connections 2024-05-08T18:33:05.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.617+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/4037234775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3efa7c40 0x558e3efa8060 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.617+0000 7f0f13f2d800 1 -- 172.21.15.87:0/4037234775 >> 172.21.15.87:0/4037234775 conn(0x558e3efa3fa0 msgr2=0x558e3efa2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.617+0000 7f0f13f2d800 1 -- 172.21.15.87:0/4037234775 shutdown_connections 2024-05-08T18:33:05.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.617+0000 7f0f13f2d800 1 -- 172.21.15.87:0/4037234775 wait complete. 2024-05-08T18:33:05.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.618+0000 7f0f13f2d800 1 Processor -- start 2024-05-08T18:33:05.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.618+0000 7f0f13f2d800 1 -- start start 2024-05-08T18:33:05.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.618+0000 7f0f13f2d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3efa7c40 0x558e3efaf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.618+0000 7f0f13f2d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558e3efa8da0 con 0x558e3efa7c40 2024-05-08T18:33:05.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.618+0000 7f0f10379640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3efa7c40 0x558e3efaf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.618+0000 7f0f10379640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3efa7c40 0x558e3efaf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52960/0 (socket says 172.21.15.87:52960) 2024-05-08T18:33:05.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.618+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 learned_addr learned my addr 172.21.15.87:0/1351215895 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.618+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3efaf7e0 con 0x558e3efa7c40 2024-05-08T18:33:05.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.618+0000 7f0f10379640 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3efa7c40 0x558e3efaf2a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0f08001f40 tx=0x7f0f080528f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.618+0000 7f0ded7fa640 1 -- 172.21.15.87:0/1351215895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f08030020 con 0x558e3efa7c40 2024-05-08T18:33:05.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.618+0000 7f0ded7fa640 1 -- 172.21.15.87:0/1351215895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f08013b90 con 0x558e3efa7c40 2024-05-08T18:33:05.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.618+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e3efafa70 con 0x558e3efa7c40 2024-05-08T18:33:05.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.618+0000 7f0ded7fa640 1 -- 172.21.15.87:0/1351215895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f080540d0 con 0x558e3efa7c40 2024-05-08T18:33:05.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.619+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e3efb2720 con 0x558e3efa7c40 2024-05-08T18:33:05.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.619+0000 7f0ded7fa640 1 -- 172.21.15.87:0/1351215895 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f0f08033020 con 0x558e3efa7c40 2024-05-08T18:33:05.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.619+0000 7f0ded7fa640 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f0dd803bba0 0x7f0dd803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.620+0000 7f0ded7fa640 1 -- 172.21.15.87:0/1351215895 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0f0800e040 con 0x558e3efa7c40 2024-05-08T18:33:05.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.620+0000 7f0f0fb78640 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f0dd803bba0 0x7f0dd803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.620+0000 7f0f0fb78640 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f0dd803bba0 0x7f0dd803e060 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0f00000fb0 tx=0x7f0f0004a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.620+0000 7f0f13f2d800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.620+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558e3efbad50 0x558e3efbd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.620+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3efbd960 con 0x558e3efbad50 2024-05-08T18:33:05.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.620+0000 7f0f07377640 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558e3efbad50 0x558e3efbd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.621+0000 7f0f07377640 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558e3efbad50 0x558e3efbd210 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.621+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.621+0000 7f0f13f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.621+0000 7f0f13f2d800 20 realm 2024-05-08T18:33:05.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.621+0000 7f0f13f2d800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.621+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3efbdd30 con 0x558e3efbad50 2024-05-08T18:33:05.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.621+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.621+0000 7f0f13f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.621+0000 7f0f13f2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:05.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.621+0000 7f0f13f2d800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.621+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3efbe600 con 0x558e3efbad50 2024-05-08T18:33:05.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.621+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.621+0000 7f0f13f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.621+0000 7f0f13f2d800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.621+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3efbe9a0 con 0x558e3efbad50 2024-05-08T18:33:05.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.622+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.622+0000 7f0f13f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:05.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.622+0000 7f0f13f2d800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.622+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3efbf1f0 con 0x558e3efbad50 2024-05-08T18:33:05.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.622+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.622+0000 7f0f13f2d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:05.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.622+0000 7f0f13f2d800 20 searching for the correct realm 2024-05-08T18:33:05.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.622+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x558e3efc0f60 0x558e3efc3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.622+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x558e3efc0f60 2024-05-08T18:33:05.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.622+0000 7f0f10379640 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x558e3efc0f60 0x558e3efc3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.622+0000 7f0f10379640 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x558e3efc0f60 0x558e3efc3350 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.623+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f08052d70 con 0x558e3efc0f60 2024-05-08T18:33:05.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.623+0000 7f0f10379640 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f0f08035020 0x7f0f080298d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.623+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x7f0f08035020 2024-05-08T18:33:05.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.623+0000 7f0f0fb78640 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f0f08035020 0x7f0f080298d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.623+0000 7f0f0fb78640 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f0f08035020 0x7f0f080298d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.623+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f0002e070 con 0x7f0f08035020 2024-05-08T18:33:05.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.623+0000 7f0f0fb78640 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f0f00051c20 0x7f0f0001c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.623+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x7f0f00051c20 2024-05-08T18:33:05.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.624+0000 7f0f07377640 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f0f00051c20 0x7f0f0001c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.624+0000 7f0f07377640 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f0f00051c20 0x7f0f0001c820 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.624+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.624+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x558e3efbad50 2024-05-08T18:33:05.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.624+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.624+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x558e3efbad50 2024-05-08T18:33:05.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.625+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.625+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x7f0f00051c20 2024-05-08T18:33:05.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.625+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.625+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x7f0f00051c20 2024-05-08T18:33:05.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.625+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.625+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x7f0f08035020 2024-05-08T18:33:05.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.625+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f0002e070 con 0x7f0f08035020 2024-05-08T18:33:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.625+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x558e3efc0f60 2024-05-08T18:33:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.626+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f08052d70 con 0x558e3efc0f60 2024-05-08T18:33:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.626+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x558e3efbad50 2024-05-08T18:33:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.626+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.626+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x7f0f00051c20 2024-05-08T18:33:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.626+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.626+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x558e3efbad50 2024-05-08T18:33:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.626+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.626+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x7f0f08035020 2024-05-08T18:33:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.627+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0f0002e070 con 0x7f0f08035020 2024-05-08T18:33:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.627+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x558e3efc0f60 2024-05-08T18:33:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.627+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f08052d70 con 0x558e3efc0f60 2024-05-08T18:33:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.627+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x558e3efc0f60 2024-05-08T18:33:05.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.627+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f08052d70 con 0x558e3efc0f60 2024-05-08T18:33:05.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.627+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x7f0f00051c20 2024-05-08T18:33:05.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.627+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.628+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x558e3efc0f60 2024-05-08T18:33:05.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.628+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f08052d70 con 0x558e3efc0f60 2024-05-08T18:33:05.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.628+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x558e3efc0f60 2024-05-08T18:33:05.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.628+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f08052d70 con 0x558e3efc0f60 2024-05-08T18:33:05.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.628+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x558e3efbad50 2024-05-08T18:33:05.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.628+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.628+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x558e3efbad50 2024-05-08T18:33:05.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.628+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v29'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.628+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x7f0f00051c20 2024-05-08T18:33:05.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.629+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.629+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x558e3efc0f60 2024-05-08T18:33:05.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.629+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f08052d70 con 0x558e3efc0f60 2024-05-08T18:33:05.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.629+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x7f0f08035020 2024-05-08T18:33:05.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.629+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f0002e070 con 0x7f0f08035020 2024-05-08T18:33:05.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.629+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x558e3efbad50 2024-05-08T18:33:05.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.629+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.629+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x7f0f00051c20 2024-05-08T18:33:05.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.630+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.630+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x558e3efc0f60 2024-05-08T18:33:05.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.630+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f08052d70 con 0x558e3efc0f60 2024-05-08T18:33:05.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.630+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x7f0f08035020 2024-05-08T18:33:05.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.630+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f0002e070 con 0x7f0f08035020 2024-05-08T18:33:05.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.630+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x7f0f08035020 2024-05-08T18:33:05.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.630+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f0002e070 con 0x7f0f08035020 2024-05-08T18:33:05.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.630+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x558e3efc0f60 2024-05-08T18:33:05.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.631+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f08052d70 con 0x558e3efc0f60 2024-05-08T18:33:05.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.631+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x7f0f08035020 2024-05-08T18:33:05.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.631+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f0002e070 con 0x7f0f08035020 2024-05-08T18:33:05.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.631+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x558e3efbad50 2024-05-08T18:33:05.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.631+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.631+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc38e0 con 0x7f0f08035020 2024-05-08T18:33:05.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.631+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f0002e070 con 0x7f0f08035020 2024-05-08T18:33:05.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.631+0000 7f0f13f2d800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.631+0000 7f0f13f2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.631+0000 7f0f13f2d800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.631+0000 7f0f13f2d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.631+0000 7f0f13f2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.631+0000 7f0f13f2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.631+0000 7f0f13f2d800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.631+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3efbfb70 con 0x558e3efbad50 2024-05-08T18:33:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.631+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.632+0000 7f0f13f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.632+0000 7f0f13f2d800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.632+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc0410 con 0x558e3efbad50 2024-05-08T18:33:05.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.632+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.632+0000 7f0f13f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:05.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.632+0000 7f0f13f2d800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.632+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc3d60 con 0x7f0f00051c20 2024-05-08T18:33:05.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.632+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.632+0000 7f0f13f2d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:05.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.632+0000 7f0f13f2d800 20 zone default found 2024-05-08T18:33:05.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.632+0000 7f0f13f2d800 4 Realm: () 2024-05-08T18:33:05.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.632+0000 7f0f13f2d800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:05.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.632+0000 7f0f13f2d800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:05.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.632+0000 7f0f13f2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:05.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.632+0000 7f0f13f2d800 20 zonegroup default 2024-05-08T18:33:05.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.632+0000 7f0f13f2d800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.632+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc4210 con 0x7f0f00051c20 2024-05-08T18:33:05.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.633+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.633+0000 7f0f13f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.633+0000 7f0f13f2d800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.633+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc5bf0 con 0x558e3efc0f60 2024-05-08T18:33:05.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.633+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f08052d70 con 0x558e3efc0f60 2024-05-08T18:33:05.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.633+0000 7f0f13f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.633+0000 7f0f13f2d800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.633+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc6070 con 0x558e3efc0f60 2024-05-08T18:33:05.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.633+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f08052d70 con 0x558e3efc0f60 2024-05-08T18:33:05.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.633+0000 7f0f13f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.633+0000 7f0f13f2d800 20 started sync module instance, tier type = 2024-05-08T18:33:05.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.633+0000 7f0f13f2d800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:05.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.633+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc5080 con 0x7f0f08035020 2024-05-08T18:33:05.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.634+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f0002e070 con 0x7f0f08035020 2024-05-08T18:33:05.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.634+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94069430441072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc6980 con 0x7f0f08035020 2024-05-08T18:33:05.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.634+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc71d0 con 0x558e3efbad50 2024-05-08T18:33:05.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.635+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94069430441072] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f0002e070 con 0x7f0f08035020 2024-05-08T18:33:05.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.635+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.635+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94069430445264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc7250 con 0x558e3efbad50 2024-05-08T18:33:05.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.636+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc7d10 con 0x558e3efc0f60 2024-05-08T18:33:05.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.637+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94069430445264] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.637+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f08052d70 con 0x558e3efc0f60 2024-05-08T18:33:05.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.637+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94069430450144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc8100 con 0x558e3efc0f60 2024-05-08T18:33:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.637+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc8b20 con 0x7f0f08035020 2024-05-08T18:33:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.638+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94069430450144] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f08052d70 con 0x558e3efc0f60 2024-05-08T18:33:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.638+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f0002e070 con 0x7f0f08035020 2024-05-08T18:33:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.638+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94069430453776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc8f40 con 0x7f0f08035020 2024-05-08T18:33:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.638+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc9960 con 0x558e3efbad50 2024-05-08T18:33:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.639+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.639+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94069430457424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efca200 con 0x558e3efbad50 2024-05-08T18:33:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.639+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efcacc0 con 0x7f0f00051c20 2024-05-08T18:33:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.639+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94069430453776] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f0002e070 con 0x7f0f08035020 2024-05-08T18:33:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.640+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94069430457424] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.640+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.640+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94069430462352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc9c60 con 0x7f0f00051c20 2024-05-08T18:33:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.640+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efcb560 con 0x7f0f00051c20 2024-05-08T18:33:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.641+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(56 notify.6 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.641+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94069430464688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efcb980 con 0x7f0f00051c20 2024-05-08T18:33:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.641+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efcc1d0 con 0x7f0f00051c20 2024-05-08T18:33:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.641+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94069430462352] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.642+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(58 notify.7 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.642+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94069430464688] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.642+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069430466944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efcc250 con 0x7f0f00051c20 2024-05-08T18:33:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.642+0000 7f0f13f2d800 20 add_watcher() i=0 2024-05-08T18:33:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.642+0000 7f0f13f2d800 20 add_watcher() i=1 2024-05-08T18:33:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.642+0000 7f0f13f2d800 20 add_watcher() i=2 2024-05-08T18:33:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.642+0000 7f0f13f2d800 20 add_watcher() i=3 2024-05-08T18:33:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.642+0000 7f0f13f2d800 20 add_watcher() i=4 2024-05-08T18:33:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.642+0000 7f0f13f2d800 20 add_watcher() i=5 2024-05-08T18:33:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.642+0000 7f0f13f2d800 20 add_watcher() i=6 2024-05-08T18:33:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.643+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94069430466944] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.643+0000 7f0f13f2d800 20 add_watcher() i=7 2024-05-08T18:33:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.643+0000 7f0f13f2d800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.643+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3efcf280 con 0x558e3efbad50 2024-05-08T18:33:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.643+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.643+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94069430468000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efcc670 con 0x558e3efbad50 2024-05-08T18:33:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.644+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94069430468000] v29'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.644+0000 7f0dc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.644+0000 7f0f13f2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.644+0000 7f0f13f2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.644+0000 7f0f13f2d800 5 note: GC not initialized 2024-05-08T18:33:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.645+0000 7f0dc4fe1640 20 reqs_thread_entry: start 2024-05-08T18:33:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.645+0000 7f0f13f2d800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.645+0000 7f0f13f2d800 20 Filter name: none 2024-05-08T18:33:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.645+0000 7f0d3e7fc640 20 reqs_thread_entry: start 2024-05-08T18:33:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.645+0000 7f0f13f2d800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:33:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.645+0000 7f0f13f2d800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.645+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3f002460 con 0x7f0f00051c20 2024-05-08T18:33:05.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.646+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.646+0000 7f0f13f2d800 20 rados_obj.operate() r=0 bl.length=503 2024-05-08T18:33:05.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.646+0000 7f0f13f2d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:33:05.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.646+0000 7f0f13f2d800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.646+0000 7f0f13f2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:33:05.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.646+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3f008d60 con 0x7f0f00051c20 2024-05-08T18:33:05.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.647+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v29'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.647+0000 7f0f13f2d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:05.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.647+0000 7f0f13f2d800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.647+0000 7f0f13f2d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:33:05.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.647+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94069430716192 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e3f0043e0 con 0x558e3efbad50 2024-05-08T18:33:05.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.648+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== watch-notify(notify (1) cookie 94069430457424 notify 124554051611 ret 0) ==== 678+0+0 (crc 0 0 0) 0x558e3ee8b1d0 con 0x558e3efbad50 2024-05-08T18:33:05.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.648+0000 7f0deeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051611 cookie 94069430457424 notifier 4886 bl.length()=636 2024-05-08T18:33:05.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.648+0000 7f0deeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:05.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.648+0000 7f0deeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.648+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 notify.4 [notify cookie 94069430716192 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.648+0000 7f0deeffd640 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f0dd4003ea0 con 0x558e3efbad50 2024-05-08T18:33:05.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.648+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.648+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== watch-notify(notify_complete (2) cookie 94069430716192 notify 124554051611 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0ef805dcc0 con 0x558e3efbad50 2024-05-08T18:33:05.664 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:33:04.270799Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:33:04.270781Z","tags":[],"group_ids":[]} 2024-05-08T18:33:05.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.649+0000 7f0dc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:05.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.649+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94069430468000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3f007800 con 0x558e3efbad50 2024-05-08T18:33:05.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.650+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94069430468000] v29'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.650+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94069430441072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3f007800 con 0x7f0f08035020 2024-05-08T18:33:05.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.651+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94069430441072] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f0002e070 con 0x7f0f08035020 2024-05-08T18:33:05.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.651+0000 7f0f13f2d800 20 remove_watcher() i=0 2024-05-08T18:33:05.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.651+0000 7f0f13f2d800 2 removed watcher, disabling cache 2024-05-08T18:33:05.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.651+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94069430445264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc5470 con 0x558e3efbad50 2024-05-08T18:33:05.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.652+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94069430445264] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.652+0000 7f0f13f2d800 20 remove_watcher() i=1 2024-05-08T18:33:05.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.652+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94069430450144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc5470 con 0x558e3efc0f60 2024-05-08T18:33:05.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.653+0000 7f0f10379640 1 -- 172.21.15.87:0/1351215895 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94069430450144] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f08052d70 con 0x558e3efc0f60 2024-05-08T18:33:05.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.653+0000 7f0f13f2d800 20 remove_watcher() i=2 2024-05-08T18:33:05.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.653+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94069430453776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc77e0 con 0x7f0f08035020 2024-05-08T18:33:05.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.654+0000 7f0f0fb78640 1 -- 172.21.15.87:0/1351215895 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94069430453776] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f0002e070 con 0x7f0f08035020 2024-05-08T18:33:05.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.654+0000 7f0f13f2d800 20 remove_watcher() i=3 2024-05-08T18:33:05.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.654+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94069430457424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc5470 con 0x558e3efbad50 2024-05-08T18:33:05.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.655+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94069430457424] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x558e3efbad50 2024-05-08T18:33:05.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.655+0000 7f0f13f2d800 20 remove_watcher() i=4 2024-05-08T18:33:05.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.655+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94069430462352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc77e0 con 0x7f0f00051c20 2024-05-08T18:33:05.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.656+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94069430462352] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.656+0000 7f0f13f2d800 20 remove_watcher() i=5 2024-05-08T18:33:05.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.656+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94069430464688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc9450 con 0x7f0f00051c20 2024-05-08T18:33:05.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.657+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94069430464688] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.657+0000 7f0f13f2d800 20 remove_watcher() i=6 2024-05-08T18:33:05.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.657+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94069430466944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e3efc5470 con 0x7f0f00051c20 2024-05-08T18:33:05.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.658+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94069430466944] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ef805a040 con 0x7f0f00051c20 2024-05-08T18:33:05.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.658+0000 7f0f13f2d800 20 remove_watcher() i=7 2024-05-08T18:33:05.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.658+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f0f00051c20 msgr2=0x7f0f0001c820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.658+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f0f00051c20 0x7f0f0001c820 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.658+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558e3efbad50 msgr2=0x558e3efbd210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.658+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558e3efbad50 0x558e3efbd210 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.658+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f0f08035020 msgr2=0x7f0f080298d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.658+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f0f08035020 0x7f0f080298d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.658+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x558e3efc0f60 msgr2=0x558e3efc3350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.658+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x558e3efc0f60 0x558e3efc3350 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.658+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f0dd803bba0 msgr2=0x7f0dd803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.658+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f0dd803bba0 0x7f0dd803e060 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0f00000fb0 tx=0x7f0f0004a000 comp rx=0 tx=0).stop 2024-05-08T18:33:05.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.658+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3efa7c40 msgr2=0x558e3efaf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.658+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3efa7c40 0x558e3efaf2a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0f08001f40 tx=0x7f0f080528f0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.658+0000 7f0f07377640 1 -- 172.21.15.87:0/1351215895 reap_dead start 2024-05-08T18:33:05.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 shutdown_connections 2024-05-08T18:33:05.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/1351215895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3efa7c40 0x558e3efaf2a0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 >> 172.21.15.87:0/1351215895 conn(0x558e3efa3fa0 msgr2=0x558e3efa1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 shutdown_connections 2024-05-08T18:33:05.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 -- 172.21.15.87:0/1351215895 wait complete. 2024-05-08T18:33:05.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 -- 172.21.15.87:0/3653937817 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f0de803bba0 msgr2=0x7f0de803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/3653937817 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f0de803bba0 0x7f0de803e060 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0f0001dfd0 tx=0x7f0f000014c0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 -- 172.21.15.87:0/3653937817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ef9a960 msgr2=0x558e3ef9ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/3653937817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ef9a960 0x558e3ef9ad80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x558e3ef80860 tx=0x7f0f080178e0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 -- 172.21.15.87:0/3653937817 shutdown_connections 2024-05-08T18:33:05.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/3653937817 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f0de803bba0 0x7f0de803e060 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/3653937817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ef9a960 0x558e3ef9ad80 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 -- 172.21.15.87:0/3653937817 >> 172.21.15.87:0/3653937817 conn(0x558e3ef8ea00 msgr2=0x558e3ef8ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 -- 172.21.15.87:0/3653937817 shutdown_connections 2024-05-08T18:33:05.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 -- 172.21.15.87:0/3653937817 wait complete. 2024-05-08T18:33:05.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 -- 172.21.15.87:0/945519864 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558e3ef89df0 msgr2=0x558e3ef8c1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558e3ef89df0 0x558e3ef8c1e0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 -- 172.21.15.87:0/945519864 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558e3ee875e0 msgr2=0x558e3ef866a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558e3ee875e0 0x558e3ef866a0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 -- 172.21.15.87:0/945519864 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f0df803bba0 msgr2=0x7f0df803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f0df803bba0 0x7f0df803e060 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8054000 tx=0x7f0ef804e000 comp rx=0 tx=0).stop 2024-05-08T18:33:05.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 -- 172.21.15.87:0/945519864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee83150 msgr2=0x558e3ef7f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee83150 0x558e3ef7f4b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0f00000c00 tx=0x7f0f00000ed0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 -- 172.21.15.87:0/945519864 shutdown_connections 2024-05-08T18:33:05.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x558e3ee875e0 0x558e3ef866a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x558e3ef89df0 0x558e3ef8c1e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f0df803bba0 0x7f0df803e060 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 --2- 172.21.15.87:0/945519864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e3ee83150 0x558e3ef7f4b0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.659+0000 7f0f13f2d800 1 -- 172.21.15.87:0/945519864 >> 172.21.15.87:0/945519864 conn(0x558e3ee7e730 msgr2=0x558e3ef6e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.660+0000 7f0f13f2d800 1 -- 172.21.15.87:0/945519864 shutdown_connections 2024-05-08T18:33:05.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.660+0000 7f0f13f2d800 1 -- 172.21.15.87:0/945519864 wait complete. 2024-05-08T18:33:05.677 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:05.677 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:05.677 ERROR:root:0 2024-05-08T18:33:05.677 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-08T18:33:05.677 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-08T18:33:05.677 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-05-08T18:33:05.724 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:05.724 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:05.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.726+0000 7f72a9498800 1 Processor -- start 2024-05-08T18:33:05.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.726+0000 7f72a9498800 1 -- start start 2024-05-08T18:33:05.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.726+0000 7f72a9498800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561085baf2c0 0x561085baf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.726+0000 7f72a9498800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561085bafd60 con 0x561085bb0480 2024-05-08T18:33:05.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.726+0000 7f72a9498800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x561085a4fe20 con 0x561085baf2c0 2024-05-08T18:33:05.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.727+0000 7f72a6f90640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561085baf2c0 0x561085baf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.727+0000 7f729e78f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x561085bb0480 0x561085bb0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58244/0 (socket says 172.21.15.87:58244) 2024-05-08T18:33:05.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.727+0000 7f729e78f640 1 -- 172.21.15.87:0/4009836397 learned_addr learned my addr 172.21.15.87:0/4009836397 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:33:05.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.727+0000 7f72a6f90640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561085baf2c0 0x561085baf6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52966/0 (socket says 172.21.15.87:52966) 2024-05-08T18:33:05.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.727+0000 7f72a6f90640 1 -- 172.21.15.87:0/4009836397 >> v1:172.21.15.53:6789/0 conn(0x561085bb0480 legacy=0x561085bb0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.727+0000 7f72a6f90640 1 -- 172.21.15.87:0/4009836397 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561085bb1040 con 0x561085baf2c0 2024-05-08T18:33:05.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.729+0000 7f72a6f90640 1 --2- 172.21.15.87:0/4009836397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 0x561085baf6e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f729800a470 tx=0x7f729801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73255d26e779a0a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.729+0000 7f72a678f640 1 -- 172.21.15.87:0/4009836397 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7298057070 con 0x561085baf2c0 2024-05-08T18:33:05.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.729+0000 7f72a678f640 1 -- 172.21.15.87:0/4009836397 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f729804adc0 con 0x561085baf2c0 2024-05-08T18:33:05.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.729+0000 7f72a678f640 1 -- 172.21.15.87:0/4009836397 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7298052590 con 0x561085baf2c0 2024-05-08T18:33:05.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.729+0000 7f72a9498800 1 -- 172.21.15.87:0/4009836397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 msgr2=0x561085baf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.729+0000 7f72a9498800 1 --2- 172.21.15.87:0/4009836397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 0x561085baf6e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f729800a470 tx=0x7f729801ce90 comp rx=0 tx=0).stop 2024-05-08T18:33:05.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.730+0000 7f72a9498800 1 -- 172.21.15.87:0/4009836397 shutdown_connections 2024-05-08T18:33:05.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.730+0000 7f72a9498800 1 --2- 172.21.15.87:0/4009836397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 0x561085baf6e0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.730+0000 7f72a9498800 1 -- 172.21.15.87:0/4009836397 >> 172.21.15.87:0/4009836397 conn(0x561085baa840 msgr2=0x561085bacc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.730+0000 7f72a9498800 1 -- 172.21.15.87:0/4009836397 shutdown_connections 2024-05-08T18:33:05.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.730+0000 7f72a9498800 1 -- 172.21.15.87:0/4009836397 wait complete. 2024-05-08T18:33:05.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.743+0000 7f72a9498800 1 Processor -- start 2024-05-08T18:33:05.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.743+0000 7f72a9498800 1 -- start start 2024-05-08T18:33:05.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.743+0000 7f72a9498800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 0x561085ca0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.743+0000 7f72a9498800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561085afa5c0 con 0x561085baf2c0 2024-05-08T18:33:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.743+0000 7f72a6f90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 0x561085ca0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.743+0000 7f72a6f90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 0x561085ca0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52968/0 (socket says 172.21.15.87:52968) 2024-05-08T18:33:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.743+0000 7f72a6f90640 1 -- 172.21.15.87:0/1447562007 learned_addr learned my addr 172.21.15.87:0/1447562007 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.744+0000 7f72a6f90640 1 -- 172.21.15.87:0/1447562007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561085ca0d50 con 0x561085baf2c0 2024-05-08T18:33:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.744+0000 7f72a6f90640 1 --2- 172.21.15.87:0/1447562007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 0x561085ca0780 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f729801ced0 tx=0x7f729804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b5765c8005e73c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.744+0000 7f7194e09640 1 -- 172.21.15.87:0/1447562007 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7298057040 con 0x561085baf2c0 2024-05-08T18:33:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.744+0000 7f7194e09640 1 -- 172.21.15.87:0/1447562007 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7298063070 con 0x561085baf2c0 2024-05-08T18:33:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.744+0000 7f7194e09640 1 -- 172.21.15.87:0/1447562007 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7298052800 con 0x561085baf2c0 2024-05-08T18:33:05.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.745+0000 7f72a9498800 1 -- 172.21.15.87:0/1447562007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 msgr2=0x561085ca0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.745+0000 7f72a9498800 1 --2- 172.21.15.87:0/1447562007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 0x561085ca0780 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f729801ced0 tx=0x7f729804c000 comp rx=0 tx=0).stop 2024-05-08T18:33:05.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.745+0000 7f72a9498800 1 -- 172.21.15.87:0/1447562007 shutdown_connections 2024-05-08T18:33:05.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.745+0000 7f72a9498800 1 --2- 172.21.15.87:0/1447562007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 0x561085ca0780 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.745+0000 7f72a9498800 1 -- 172.21.15.87:0/1447562007 >> 172.21.15.87:0/1447562007 conn(0x561085baa840 msgr2=0x561085c9c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.745+0000 7f72a9498800 1 -- 172.21.15.87:0/1447562007 shutdown_connections 2024-05-08T18:33:05.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.745+0000 7f72a9498800 1 -- 172.21.15.87:0/1447562007 wait complete. 2024-05-08T18:33:05.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.745+0000 7f72a9498800 1 Processor -- start 2024-05-08T18:33:05.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.745+0000 7f72a9498800 1 -- start start 2024-05-08T18:33:05.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.745+0000 7f72a9498800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 0x561085b24c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.745+0000 7f72a9498800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561085bb8950 con 0x561085baf2c0 2024-05-08T18:33:05.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.745+0000 7f72a6f90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 0x561085b24c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.745+0000 7f72a6f90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 0x561085b24c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52970/0 (socket says 172.21.15.87:52970) 2024-05-08T18:33:05.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.745+0000 7f72a6f90640 1 -- 172.21.15.87:0/2414915786 learned_addr learned my addr 172.21.15.87:0/2414915786 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.746+0000 7f72a6f90640 1 -- 172.21.15.87:0/2414915786 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561085b23370 con 0x561085baf2c0 2024-05-08T18:33:05.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.746+0000 7f72a6f90640 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 0x561085b24c80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f729804ad90 tx=0x7f7298002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.746+0000 7f7193606640 1 -- 172.21.15.87:0/2414915786 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f729806d070 con 0x561085baf2c0 2024-05-08T18:33:05.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.746+0000 7f7193606640 1 -- 172.21.15.87:0/2414915786 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7298052d00 con 0x561085baf2c0 2024-05-08T18:33:05.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.746+0000 7f72a9498800 1 -- 172.21.15.87:0/2414915786 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561085b23600 con 0x561085baf2c0 2024-05-08T18:33:05.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.746+0000 7f7193606640 1 -- 172.21.15.87:0/2414915786 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7298057050 con 0x561085baf2c0 2024-05-08T18:33:05.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.746+0000 7f72a9498800 1 -- 172.21.15.87:0/2414915786 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561085b23b80 con 0x561085baf2c0 2024-05-08T18:33:05.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.747+0000 7f7193606640 1 -- 172.21.15.87:0/2414915786 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f729805d470 con 0x561085baf2c0 2024-05-08T18:33:05.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.747+0000 7f7193606640 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f718c03bba0 0x7f718c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.747+0000 7f7193606640 1 -- 172.21.15.87:0/2414915786 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7298093ca0 con 0x561085baf2c0 2024-05-08T18:33:05.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.747+0000 7f729e78f640 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f718c03bba0 0x7f718c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.748+0000 7f72a9498800 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561085bb0480 0x561085cb1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.748+0000 7f72a9498800 1 -- 172.21.15.87:0/2414915786 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085cb1cd0 con 0x561085bb0480 2024-05-08T18:33:05.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.748+0000 7f72a7791640 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561085bb0480 0x561085cb1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.748+0000 7f729e78f640 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f718c03bba0 0x7f718c03e060 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7290000f60 tx=0x7f72900012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.748+0000 7f72a7791640 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561085bb0480 0x561085cb1790 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.748+0000 7f72a7791640 1 -- 172.21.15.87:0/2414915786 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72a000a4a0 con 0x561085bb0480 2024-05-08T18:33:05.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.748+0000 7f72a9498800 1 -- 172.21.15.87:0/2414915786 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085cb2520 con 0x561085bb0480 2024-05-08T18:33:05.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.748+0000 7f72a7791640 1 -- 172.21.15.87:0/2414915786 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72a000a4a0 con 0x561085bb0480 2024-05-08T18:33:05.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.748+0000 7f72a9498800 1 -- 172.21.15.87:0/2414915786 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085cb3910 con 0x561085bb0480 2024-05-08T18:33:05.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.749+0000 7f72a7791640 1 -- 172.21.15.87:0/2414915786 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f72a000a4a0 con 0x561085bb0480 2024-05-08T18:33:05.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.749+0000 7f72a9498800 1 -- 172.21.15.87:0/2414915786 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085cb2d70 con 0x561085bb0480 2024-05-08T18:33:05.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.749+0000 7f72a7791640 1 -- 172.21.15.87:0/2414915786 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72a000a4a0 con 0x561085bb0480 2024-05-08T18:33:05.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.749+0000 7f72a9498800 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561085cb4da0 0x561085cb7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.749+0000 7f72a9498800 1 -- 172.21.15.87:0/2414915786 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085cb77e0 con 0x561085cb4da0 2024-05-08T18:33:05.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.749+0000 7f72a6f90640 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561085cb4da0 0x561085cb7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.750+0000 7f72a6f90640 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561085cb4da0 0x561085cb7190 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.750+0000 7f72a6f90640 1 -- 172.21.15.87:0/2414915786 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f729805a040 con 0x561085cb4da0 2024-05-08T18:33:05.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.750+0000 7f72a9498800 1 Processor -- start 2024-05-08T18:33:05.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.750+0000 7f72a9498800 1 -- start start 2024-05-08T18:33:05.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.750+0000 7f72a9498800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cc5b10 0x561085cc5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.750+0000 7f72a9498800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561085b251c0 con 0x561085cc5b10 2024-05-08T18:33:05.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.751+0000 7f72a7791640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cc5b10 0x561085cc5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.751+0000 7f72a7791640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cc5b10 0x561085cc5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52986/0 (socket says 172.21.15.87:52986) 2024-05-08T18:33:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.751+0000 7f72a7791640 1 -- 172.21.15.87:0/521287413 learned_addr learned my addr 172.21.15.87:0/521287413 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.751+0000 7f72a7791640 1 -- 172.21.15.87:0/521287413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561085cc6470 con 0x561085cc5b10 2024-05-08T18:33:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.751+0000 7f72a7791640 1 --2- 172.21.15.87:0/521287413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cc5b10 0x561085cc5f30 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x561085b249c0 tx=0x7f72a00178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.751+0000 7f7190e01640 1 -- 172.21.15.87:0/521287413 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a0013440 con 0x561085cc5b10 2024-05-08T18:33:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.751+0000 7f7190e01640 1 -- 172.21.15.87:0/521287413 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a00135e0 con 0x561085cc5b10 2024-05-08T18:33:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.751+0000 7f72a9498800 1 -- 172.21.15.87:0/521287413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561085cc6ee0 con 0x561085cc5b10 2024-05-08T18:33:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.751+0000 7f7190e01640 1 -- 172.21.15.87:0/521287413 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a00138c0 con 0x561085cc5b10 2024-05-08T18:33:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.751+0000 7f72a9498800 1 -- 172.21.15.87:0/521287413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561085cc73e0 con 0x561085cc5b10 2024-05-08T18:33:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.752+0000 7f7190e01640 1 -- 172.21.15.87:0/521287413 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f72a0011040 con 0x561085cc5b10 2024-05-08T18:33:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.752+0000 7f7190e01640 1 --2- 172.21.15.87:0/521287413 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f718003bb50 0x7f718003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.752+0000 7f7190e01640 1 -- 172.21.15.87:0/521287413 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f72a001d070 con 0x561085cc5b10 2024-05-08T18:33:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.752+0000 7f72a6f90640 1 --2- 172.21.15.87:0/521287413 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f718003bb50 0x7f718003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.753+0000 7f72a9498800 1 Processor -- start 2024-05-08T18:33:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.753+0000 7f72a9498800 1 -- start start 2024-05-08T18:33:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.753+0000 7f72a6f90640 1 --2- 172.21.15.87:0/521287413 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f718003bb50 0x7f718003e010 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7298005870 tx=0x7f7298091f00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.753+0000 7f72a9498800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cd2ea0 0x561085cd32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.753+0000 7f72a9498800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561085aa0fc0 con 0x561085cd2ea0 2024-05-08T18:33:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.753+0000 7f72a7791640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cd2ea0 0x561085cd32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.753+0000 7f72a7791640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cd2ea0 0x561085cd32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52990/0 (socket says 172.21.15.87:52990) 2024-05-08T18:33:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.753+0000 7f72a7791640 1 -- 172.21.15.87:0/311105342 learned_addr learned my addr 172.21.15.87:0/311105342 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.753+0000 7f72a7791640 1 -- 172.21.15.87:0/311105342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561085cd3890 con 0x561085cd2ea0 2024-05-08T18:33:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.754+0000 7f72a7791640 1 --2- 172.21.15.87:0/311105342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cd2ea0 0x561085cd32c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f72a00529a0 tx=0x7f72a0001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219df27d0abeb4ea server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.754+0000 7f718a7fc640 1 -- 172.21.15.87:0/311105342 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a002ad80 con 0x561085cd2ea0 2024-05-08T18:33:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.754+0000 7f718a7fc640 1 -- 172.21.15.87:0/311105342 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a00014f0 con 0x561085cd2ea0 2024-05-08T18:33:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.754+0000 7f718a7fc640 1 -- 172.21.15.87:0/311105342 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a00017f0 con 0x561085cd2ea0 2024-05-08T18:33:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.754+0000 7f72a9498800 1 -- 172.21.15.87:0/311105342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cd2ea0 msgr2=0x561085cd32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.754+0000 7f72a9498800 1 --2- 172.21.15.87:0/311105342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cd2ea0 0x561085cd32c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f72a00529a0 tx=0x7f72a0001e60 comp rx=0 tx=0).stop 2024-05-08T18:33:05.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.754+0000 7f72a9498800 1 -- 172.21.15.87:0/311105342 shutdown_connections 2024-05-08T18:33:05.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.754+0000 7f72a9498800 1 --2- 172.21.15.87:0/311105342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cd2ea0 0x561085cd32c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.754+0000 7f72a9498800 1 -- 172.21.15.87:0/311105342 >> 172.21.15.87:0/311105342 conn(0x561085ccf1b0 msgr2=0x561085ccd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.754+0000 7f72a9498800 1 -- 172.21.15.87:0/311105342 shutdown_connections 2024-05-08T18:33:05.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.754+0000 7f72a9498800 1 -- 172.21.15.87:0/311105342 wait complete. 2024-05-08T18:33:05.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.755+0000 7f72a9498800 1 Processor -- start 2024-05-08T18:33:05.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.755+0000 7f72a9498800 1 -- start start 2024-05-08T18:33:05.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.755+0000 7f72a9498800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cd2ea0 0x561085cda2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.755+0000 7f72a9498800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561085cd3e60 con 0x561085cd2ea0 2024-05-08T18:33:05.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.755+0000 7f72a7791640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cd2ea0 0x561085cda2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.755+0000 7f72a7791640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cd2ea0 0x561085cda2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:52998/0 (socket says 172.21.15.87:52998) 2024-05-08T18:33:05.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.755+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 learned_addr learned my addr 172.21.15.87:0/2911207905 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.755+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561085cda810 con 0x561085cd2ea0 2024-05-08T18:33:05.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.756+0000 7f72a7791640 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cd2ea0 0x561085cda2d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f72a004d010 tx=0x7f72a0052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.756+0000 7f7188ff9640 1 -- 172.21.15.87:0/2911207905 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a0030020 con 0x561085cd2ea0 2024-05-08T18:33:05.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.756+0000 7f7188ff9640 1 -- 172.21.15.87:0/2911207905 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a0013a60 con 0x561085cd2ea0 2024-05-08T18:33:05.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.756+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561085cdaaa0 con 0x561085cd2ea0 2024-05-08T18:33:05.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.756+0000 7f7188ff9640 1 -- 172.21.15.87:0/2911207905 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a004b070 con 0x561085cd2ea0 2024-05-08T18:33:05.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.756+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561085cdd750 con 0x561085cd2ea0 2024-05-08T18:33:05.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.756+0000 7f7188ff9640 1 -- 172.21.15.87:0/2911207905 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f72a0033020 con 0x561085cd2ea0 2024-05-08T18:33:05.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.757+0000 7f7188ff9640 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f717003bba0 0x7f717003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.757+0000 7f7188ff9640 1 -- 172.21.15.87:0/2911207905 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f72a000e040 con 0x561085cd2ea0 2024-05-08T18:33:05.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.757+0000 7f72a6f90640 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f717003bba0 0x7f717003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.757+0000 7f72a6f90640 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f717003bba0 0x7f717003e060 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f729805ce20 tx=0x7f729807c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.757+0000 7f72a9498800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.757+0000 7f72a9498800 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561085ce5f70 0x561085ce8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.757+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085ce8b80 con 0x561085ce5f70 2024-05-08T18:33:05.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.758+0000 7f729e78f640 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561085ce5f70 0x561085ce8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.758+0000 7f729e78f640 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561085ce5f70 0x561085ce8430 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.758+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7290009050 con 0x561085ce5f70 2024-05-08T18:33:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.758+0000 7f72a9498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.758+0000 7f72a9498800 20 realm 2024-05-08T18:33:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.758+0000 7f72a9498800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.758+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085ce53c0 con 0x561085ce5f70 2024-05-08T18:33:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.758+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7290009050 con 0x561085ce5f70 2024-05-08T18:33:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.758+0000 7f72a9498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.758+0000 7f72a9498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.758+0000 7f72a9498800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.758+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085ce9670 con 0x561085ce5f70 2024-05-08T18:33:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.758+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7290009050 con 0x561085ce5f70 2024-05-08T18:33:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.758+0000 7f72a9498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.758+0000 7f72a9498800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.758+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085ce9f40 con 0x561085ce5f70 2024-05-08T18:33:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.759+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7290009050 con 0x561085ce5f70 2024-05-08T18:33:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.759+0000 7f72a9498800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.759+0000 7f72a9498800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.759+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085cea2e0 con 0x561085ce5f70 2024-05-08T18:33:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.759+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7290009050 con 0x561085ce5f70 2024-05-08T18:33:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.759+0000 7f72a9498800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.759+0000 7f72a9498800 20 searching for the correct realm 2024-05-08T18:33:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.759+0000 7f72a9498800 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561085cec1c0 0x561085cee5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.759+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x561085cec1c0 2024-05-08T18:33:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.759+0000 7f72a7791640 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561085cec1c0 0x561085cee5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.759+0000 7f72a7791640 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561085cec1c0 0x561085cee5b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.760+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0029070 con 0x561085cec1c0 2024-05-08T18:33:05.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.760+0000 7f72a7791640 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f72a0035020 0x7f72a00540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.760+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x7f72a0035020 2024-05-08T18:33:05.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.760+0000 7f72a6f90640 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f72a0035020 0x7f72a00540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.760+0000 7f72a6f90640 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f72a0035020 0x7f72a00540d0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.760+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729805a040 con 0x7f72a0035020 2024-05-08T18:33:05.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.761+0000 7f72a6f90640 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7298086040 0x7f72980027b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.761+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x7f7298086040 2024-05-08T18:33:05.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.761+0000 7f729e78f640 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7298086040 0x7f72980027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.761+0000 7f729e78f640 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7298086040 0x7f72980027b0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.761+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7290009050 con 0x7f7298086040 2024-05-08T18:33:05.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.761+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x561085ce5f70 2024-05-08T18:33:05.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.762+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7290009050 con 0x561085ce5f70 2024-05-08T18:33:05.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.762+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x561085ce5f70 2024-05-08T18:33:05.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.762+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.762+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x7f7298086040 2024-05-08T18:33:05.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.762+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.762+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x7f7298086040 2024-05-08T18:33:05.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.762+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.762+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x7f72a0035020 2024-05-08T18:33:05.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.763+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729805a040 con 0x7f72a0035020 2024-05-08T18:33:05.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.763+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x561085cec1c0 2024-05-08T18:33:05.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.763+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0029070 con 0x561085cec1c0 2024-05-08T18:33:05.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.763+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x561085ce5f70 2024-05-08T18:33:05.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.763+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.763+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x7f7298086040 2024-05-08T18:33:05.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.763+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.763+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x561085ce5f70 2024-05-08T18:33:05.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.764+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.764+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x7f72a0035020 2024-05-08T18:33:05.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.764+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f729805a040 con 0x7f72a0035020 2024-05-08T18:33:05.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.764+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x561085cec1c0 2024-05-08T18:33:05.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.764+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0029070 con 0x561085cec1c0 2024-05-08T18:33:05.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.764+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x561085cec1c0 2024-05-08T18:33:05.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.764+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0029070 con 0x561085cec1c0 2024-05-08T18:33:05.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.764+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x7f7298086040 2024-05-08T18:33:05.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.764+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.765+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x561085cec1c0 2024-05-08T18:33:05.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.765+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0029070 con 0x561085cec1c0 2024-05-08T18:33:05.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.765+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x561085cec1c0 2024-05-08T18:33:05.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.765+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0029070 con 0x561085cec1c0 2024-05-08T18:33:05.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.765+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x561085ce5f70 2024-05-08T18:33:05.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.765+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.765+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x561085ce5f70 2024-05-08T18:33:05.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.765+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v29'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.765+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x7f7298086040 2024-05-08T18:33:05.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.766+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.766+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x561085cec1c0 2024-05-08T18:33:05.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.766+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0029070 con 0x561085cec1c0 2024-05-08T18:33:05.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.766+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x7f72a0035020 2024-05-08T18:33:05.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.766+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729805a040 con 0x7f72a0035020 2024-05-08T18:33:05.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.766+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x561085ce5f70 2024-05-08T18:33:05.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.766+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.766+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x7f7298086040 2024-05-08T18:33:05.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.767+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.767+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x561085cec1c0 2024-05-08T18:33:05.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.767+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0029070 con 0x561085cec1c0 2024-05-08T18:33:05.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.767+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x7f72a0035020 2024-05-08T18:33:05.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.767+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729805a040 con 0x7f72a0035020 2024-05-08T18:33:05.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.767+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x7f72a0035020 2024-05-08T18:33:05.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.767+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729805a040 con 0x7f72a0035020 2024-05-08T18:33:05.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.767+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x561085cec1c0 2024-05-08T18:33:05.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.768+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0029070 con 0x561085cec1c0 2024-05-08T18:33:05.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.768+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x7f72a0035020 2024-05-08T18:33:05.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.768+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729805a040 con 0x7f72a0035020 2024-05-08T18:33:05.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.768+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x561085ce5f70 2024-05-08T18:33:05.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.768+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.768+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561085ceec60 con 0x7f72a0035020 2024-05-08T18:33:05.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.768+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729805a040 con 0x7f72a0035020 2024-05-08T18:33:05.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.768+0000 7f72a9498800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:05.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.768+0000 7f72a9498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:05.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.768+0000 7f72a9498800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:05.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.768+0000 7f72a9498800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:05.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.768+0000 7f72a9498800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:05.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.768+0000 7f72a9498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:05.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.768+0000 7f72a9498800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.768+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085ceac60 con 0x561085ce5f70 2024-05-08T18:33:05.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f72a9498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f72a9498800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085ceb500 con 0x561085ce5f70 2024-05-08T18:33:05.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f72a9498800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:05.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f72a9498800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085cef0e0 con 0x7f7298086040 2024-05-08T18:33:05.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f72a9498800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:05.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f72a9498800 20 zone default found 2024-05-08T18:33:05.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f72a9498800 4 Realm: () 2024-05-08T18:33:05.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f72a9498800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:05.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f72a9498800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:05.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f72a9498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:05.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f72a9498800 20 zonegroup default 2024-05-08T18:33:05.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f72a9498800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.769+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085cef590 con 0x7f7298086040 2024-05-08T18:33:05.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.770+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.770+0000 7f72a9498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.770+0000 7f72a9498800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.770+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085cf0f70 con 0x561085cec1c0 2024-05-08T18:33:05.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.770+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72a0029070 con 0x561085cec1c0 2024-05-08T18:33:05.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.770+0000 7f72a9498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.770+0000 7f72a9498800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.770+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085cf1400 con 0x561085cec1c0 2024-05-08T18:33:05.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.770+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72a0029070 con 0x561085cec1c0 2024-05-08T18:33:05.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.770+0000 7f72a9498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.770+0000 7f72a9498800 20 started sync module instance, tier type = 2024-05-08T18:33:05.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.770+0000 7f72a9498800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:05.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.770+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf0400 con 0x7f72a0035020 2024-05-08T18:33:05.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.771+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729805a040 con 0x7f72a0035020 2024-05-08T18:33:05.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.771+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94628964403184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf0060 con 0x7f72a0035020 2024-05-08T18:33:05.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.771+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf2330 con 0x561085ce5f70 2024-05-08T18:33:05.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.772+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94628964403184] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729805a040 con 0x7f72a0035020 2024-05-08T18:33:05.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.772+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.772+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94628964408960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf2750 con 0x561085ce5f70 2024-05-08T18:33:05.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.773+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf3110 con 0x561085cec1c0 2024-05-08T18:33:05.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.774+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a0029070 con 0x561085cec1c0 2024-05-08T18:33:05.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.774+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94628964412512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf39b0 con 0x561085cec1c0 2024-05-08T18:33:05.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.774+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf4470 con 0x7f72a0035020 2024-05-08T18:33:05.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.774+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94628964408960] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.775+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94628964412512] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a0029070 con 0x561085cec1c0 2024-05-08T18:33:05.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.775+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729805a040 con 0x7f72a0035020 2024-05-08T18:33:05.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.775+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94628964410016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf39b0 con 0x7f72a0035020 2024-05-08T18:33:05.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.775+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf4d50 con 0x561085ce5f70 2024-05-08T18:33:05.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.776+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.776+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94628964419680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf55f0 con 0x561085ce5f70 2024-05-08T18:33:05.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.776+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf6090 con 0x7f7298086040 2024-05-08T18:33:05.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.776+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94628964410016] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729805a040 con 0x7f72a0035020 2024-05-08T18:33:05.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.777+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94628964419680] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.777+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.777+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94628964424544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf50f0 con 0x7f7298086040 2024-05-08T18:33:05.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.777+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf6930 con 0x7f7298086040 2024-05-08T18:33:05.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.778+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94628964424544] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.778+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.778+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94628964421680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf6480 con 0x7f7298086040 2024-05-08T18:33:05.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.778+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf6ee0 con 0x7f7298086040 2024-05-08T18:33:05.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.779+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(58 notify.7 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.779+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94628964421680] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.779+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94628964428224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf6ee0 con 0x7f7298086040 2024-05-08T18:33:05.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.779+0000 7f72a9498800 20 add_watcher() i=0 2024-05-08T18:33:05.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.779+0000 7f72a9498800 20 add_watcher() i=1 2024-05-08T18:33:05.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.779+0000 7f72a9498800 20 add_watcher() i=2 2024-05-08T18:33:05.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.779+0000 7f72a9498800 20 add_watcher() i=3 2024-05-08T18:33:05.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.779+0000 7f72a9498800 20 add_watcher() i=4 2024-05-08T18:33:05.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.779+0000 7f72a9498800 20 add_watcher() i=5 2024-05-08T18:33:05.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.779+0000 7f72a9498800 20 add_watcher() i=6 2024-05-08T18:33:05.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.780+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94628964428224] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.780+0000 7f72a9498800 20 add_watcher() i=7 2024-05-08T18:33:05.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.780+0000 7f72a9498800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:05.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.780+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085cfa310 con 0x561085ce5f70 2024-05-08T18:33:05.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.781+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.781+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94628964414720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf7790 con 0x561085ce5f70 2024-05-08T18:33:05.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.782+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94628964414720] v29'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.782+0000 7f715d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:05.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.782+0000 7f72a9498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:05.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.782+0000 7f72a9498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:05.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.782+0000 7f72a9498800 5 note: GC not initialized 2024-05-08T18:33:05.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.782+0000 7f70d7fff640 20 reqs_thread_entry: start 2024-05-08T18:33:05.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.782+0000 7f72a9498800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:05.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.782+0000 7f72a9498800 20 Filter name: none 2024-05-08T18:33:05.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.782+0000 7f70d5ffb640 20 reqs_thread_entry: start 2024-05-08T18:33:05.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.782+0000 7f72a9498800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:33:05.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.782+0000 7f72a9498800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.782+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085d2d800 con 0x7f7298086040 2024-05-08T18:33:05.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.783+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.783+0000 7f72a9498800 20 rados_obj.operate() r=0 bl.length=460 2024-05-08T18:33:05.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.783+0000 7f72a9498800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:33:05.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.783+0000 7f72a9498800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.783+0000 7f72a9498800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:33:05.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.784+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085d33d70 con 0x7f7298086040 2024-05-08T18:33:05.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.785+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v29'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.785+0000 7f72a9498800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:05.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.785+0000 7f72a9498800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.785+0000 7f72a9498800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:33:05.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.785+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94628964677424 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561085d2f370 con 0x561085ce5f70 2024-05-08T18:33:05.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.785+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== watch-notify(notify (1) cookie 94628964419680 notify 124554051612 ret 0) ==== 708+0+0 (crc 0 0 0) 0x561085bafd60 con 0x561085ce5f70 2024-05-08T18:33:05.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.785+0000 7f718a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051612 cookie 94628964419680 notifier 4893 bl.length()=666 2024-05-08T18:33:05.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.785+0000 7f718a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:05.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.785+0000 7f718a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.785+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 notify.4 [notify cookie 94628964677424 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.785+0000 7f718a7fc640 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f716c003ea0 con 0x561085ce5f70 2024-05-08T18:33:05.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.786+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.786+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== watch-notify(notify_complete (2) cookie 94628964677424 notify 124554051612 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f729003f9b0 con 0x561085ce5f70 2024-05-08T18:33:05.795 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:33:04.270799Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:33:04.270781Z","tags":[],"group_ids":[]} 2024-05-08T18:33:05.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.787+0000 7f715d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:05.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.787+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94628964414720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085ce1790 con 0x561085ce5f70 2024-05-08T18:33:05.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.788+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94628964414720] v29'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.788+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94628964403184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf3500 con 0x7f72a0035020 2024-05-08T18:33:05.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.789+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94628964403184] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729805a040 con 0x7f72a0035020 2024-05-08T18:33:05.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.789+0000 7f72a9498800 20 remove_watcher() i=0 2024-05-08T18:33:05.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.789+0000 7f72a9498800 2 removed watcher, disabling cache 2024-05-08T18:33:05.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.789+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94628964408960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf3500 con 0x561085ce5f70 2024-05-08T18:33:05.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.790+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94628964408960] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.790+0000 7f72a9498800 20 remove_watcher() i=1 2024-05-08T18:33:05.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.790+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94628964412512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf1e80 con 0x561085cec1c0 2024-05-08T18:33:05.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.791+0000 7f72a7791640 1 -- 172.21.15.87:0/2911207905 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94628964412512] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a0029070 con 0x561085cec1c0 2024-05-08T18:33:05.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.791+0000 7f72a9498800 20 remove_watcher() i=2 2024-05-08T18:33:05.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.791+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94628964410016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf3500 con 0x7f72a0035020 2024-05-08T18:33:05.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.792+0000 7f72a6f90640 1 -- 172.21.15.87:0/2911207905 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94628964410016] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729805a040 con 0x7f72a0035020 2024-05-08T18:33:05.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.792+0000 7f72a9498800 20 remove_watcher() i=3 2024-05-08T18:33:05.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.792+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94628964419680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf3500 con 0x561085ce5f70 2024-05-08T18:33:05.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.793+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94628964419680] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729002a040 con 0x561085ce5f70 2024-05-08T18:33:05.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.793+0000 7f72a9498800 20 remove_watcher() i=4 2024-05-08T18:33:05.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.793+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94628964424544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf3500 con 0x7f7298086040 2024-05-08T18:33:05.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.794+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94628964424544] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.794+0000 7f72a9498800 20 remove_watcher() i=5 2024-05-08T18:33:05.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.794+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94628964421680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf3500 con 0x7f7298086040 2024-05-08T18:33:05.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.795+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94628964421680] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.795+0000 7f72a9498800 20 remove_watcher() i=6 2024-05-08T18:33:05.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.795+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94628964428224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561085cf3500 con 0x7f7298086040 2024-05-08T18:33:05.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.796+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94628964428224] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729002a040 con 0x7f7298086040 2024-05-08T18:33:05.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.796+0000 7f72a9498800 20 remove_watcher() i=7 2024-05-08T18:33:05.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.796+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7298086040 msgr2=0x7f72980027b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.796+0000 7f72a9498800 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f7298086040 0x7f72980027b0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.796+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561085ce5f70 msgr2=0x561085ce8430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.796+0000 7f72a9498800 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561085ce5f70 0x561085ce8430 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.796+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f72a0035020 msgr2=0x7f72a00540d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.796+0000 7f72a9498800 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f72a0035020 0x7f72a00540d0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.796+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561085cec1c0 msgr2=0x561085cee5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.796+0000 7f72a9498800 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x561085cec1c0 0x561085cee5b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f717003bba0 msgr2=0x7f717003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f717003bba0 0x7f717003e060 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f729805ce20 tx=0x7f729807c000 comp rx=0 tx=0).stop 2024-05-08T18:33:05.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cd2ea0 msgr2=0x561085cda2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 --2- 172.21.15.87:0/2911207905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cd2ea0 0x561085cda2d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f72a004d010 tx=0x7f72a0052900 comp rx=0 tx=0).stop 2024-05-08T18:33:05.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 reap_dead start 2024-05-08T18:33:05.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f729e78f640 1 -- 172.21.15.87:0/2911207905 reap_dead start 2024-05-08T18:33:05.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 shutdown_connections 2024-05-08T18:33:05.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 >> 172.21.15.87:0/2911207905 conn(0x561085ccf1b0 msgr2=0x561085ccc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 shutdown_connections 2024-05-08T18:33:05.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 -- 172.21.15.87:0/2911207905 wait complete. 2024-05-08T18:33:05.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 -- 172.21.15.87:0/521287413 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f718003bb50 msgr2=0x7f718003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 --2- 172.21.15.87:0/521287413 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f718003bb50 0x7f718003e010 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7298005870 tx=0x7f7298091f00 comp rx=0 tx=0).stop 2024-05-08T18:33:05.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 -- 172.21.15.87:0/521287413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cc5b10 msgr2=0x561085cc5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 --2- 172.21.15.87:0/521287413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cc5b10 0x561085cc5f30 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x561085b249c0 tx=0x7f72a00178e0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 -- 172.21.15.87:0/521287413 shutdown_connections 2024-05-08T18:33:05.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 --2- 172.21.15.87:0/521287413 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f718003bb50 0x7f718003e010 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 --2- 172.21.15.87:0/521287413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085cc5b10 0x561085cc5f30 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 -- 172.21.15.87:0/521287413 >> 172.21.15.87:0/521287413 conn(0x561085cb9bb0 msgr2=0x561085cb9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 -- 172.21.15.87:0/521287413 shutdown_connections 2024-05-08T18:33:05.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 -- 172.21.15.87:0/521287413 wait complete. 2024-05-08T18:33:05.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 -- 172.21.15.87:0/2414915786 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561085cb4da0 msgr2=0x561085cb7190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561085cb4da0 0x561085cb7190 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 -- 172.21.15.87:0/2414915786 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561085bb0480 msgr2=0x561085cb1790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.797+0000 7f72a9498800 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561085bb0480 0x561085cb1790 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.798+0000 7f72a9498800 1 -- 172.21.15.87:0/2414915786 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f718c03bba0 msgr2=0x7f718c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.798+0000 7f72a9498800 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f718c03bba0 0x7f718c03e060 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7290000f60 tx=0x7f72900012b0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.798+0000 7f72a9498800 1 -- 172.21.15.87:0/2414915786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 msgr2=0x561085b24c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.798+0000 7f72a9498800 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 0x561085b24c80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f729804ad90 tx=0x7f7298002fb0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.798+0000 7f72a9498800 1 -- 172.21.15.87:0/2414915786 shutdown_connections 2024-05-08T18:33:05.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.798+0000 7f72a9498800 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x561085bb0480 0x561085cb1790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.798+0000 7f72a9498800 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x561085cb4da0 0x561085cb7190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.798+0000 7f72a9498800 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f718c03bba0 0x7f718c03e060 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.798+0000 7f72a9498800 1 --2- 172.21.15.87:0/2414915786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561085baf2c0 0x561085b24c80 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.798+0000 7f72a9498800 1 -- 172.21.15.87:0/2414915786 >> 172.21.15.87:0/2414915786 conn(0x561085baa840 msgr2=0x561085c9a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.798+0000 7f72a9498800 1 -- 172.21.15.87:0/2414915786 shutdown_connections 2024-05-08T18:33:05.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.798+0000 7f72a9498800 1 -- 172.21.15.87:0/2414915786 wait complete. 2024-05-08T18:33:05.807 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:05.807 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:05.807 ERROR:root:0 2024-05-08T18:33:05.807 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:33:05.812 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx0000039a8d2678e7886db-00663bc561-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:33:05.812 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-08T18:33:05.812 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-08T18:33:05.812 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-05-08T18:33:05.858 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:05.858 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:05.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.861+0000 7f5784738800 1 Processor -- start 2024-05-08T18:33:05.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.861+0000 7f5784738800 1 -- start start 2024-05-08T18:33:05.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.861+0000 7f5784738800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5640bd1c82c0 0x5640bd1c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.861+0000 7f5784738800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5640bd1c8d60 con 0x5640bd1c9480 2024-05-08T18:33:05.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.861+0000 7f5784738800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5640bd068e20 con 0x5640bd1c82c0 2024-05-08T18:33:05.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.861+0000 7f5780433640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5640bd1c82c0 0x5640bd1c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.861+0000 7f5777fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5640bd1c9480 0x5640bd1c9900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58254/0 (socket says 172.21.15.87:58254) 2024-05-08T18:33:05.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.861+0000 7f5777fff640 1 -- 172.21.15.87:0/1142542279 learned_addr learned my addr 172.21.15.87:0/1142542279 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:33:05.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.861+0000 7f5780433640 1 -- 172.21.15.87:0/1142542279 >> v1:172.21.15.53:6789/0 conn(0x5640bd1c9480 legacy=0x5640bd1c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.861+0000 7f5780433640 1 -- 172.21.15.87:0/1142542279 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640bd1ca040 con 0x5640bd1c82c0 2024-05-08T18:33:05.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.863+0000 7f5780433640 1 --2- 172.21.15.87:0/1142542279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 0x5640bd1c86e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f577000a470 tx=0x7f577001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdfdcd6f4b814766 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.863+0000 7f577fc32640 1 -- 172.21.15.87:0/1142542279 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5770057070 con 0x5640bd1c82c0 2024-05-08T18:33:05.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.863+0000 7f577fc32640 1 -- 172.21.15.87:0/1142542279 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f577004adc0 con 0x5640bd1c82c0 2024-05-08T18:33:05.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.863+0000 7f577fc32640 1 -- 172.21.15.87:0/1142542279 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5770052590 con 0x5640bd1c82c0 2024-05-08T18:33:05.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.864+0000 7f5784738800 1 -- 172.21.15.87:0/1142542279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 msgr2=0x5640bd1c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.864+0000 7f5784738800 1 --2- 172.21.15.87:0/1142542279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 0x5640bd1c86e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f577000a470 tx=0x7f577001ce90 comp rx=0 tx=0).stop 2024-05-08T18:33:05.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.864+0000 7f5784738800 1 -- 172.21.15.87:0/1142542279 shutdown_connections 2024-05-08T18:33:05.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.864+0000 7f5784738800 1 --2- 172.21.15.87:0/1142542279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 0x5640bd1c86e0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.864+0000 7f5784738800 1 -- 172.21.15.87:0/1142542279 >> 172.21.15.87:0/1142542279 conn(0x5640bd1c3840 msgr2=0x5640bd1c5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.864+0000 7f5784738800 1 -- 172.21.15.87:0/1142542279 shutdown_connections 2024-05-08T18:33:05.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.864+0000 7f5784738800 1 -- 172.21.15.87:0/1142542279 wait complete. 2024-05-08T18:33:05.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.878+0000 7f5784738800 1 Processor -- start 2024-05-08T18:33:05.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.878+0000 7f5784738800 1 -- start start 2024-05-08T18:33:05.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.878+0000 7f5784738800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 0x5640bd13dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.878+0000 7f5784738800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5640bd1135c0 con 0x5640bd1c82c0 2024-05-08T18:33:05.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.878+0000 7f5780433640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 0x5640bd13dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.878+0000 7f5780433640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 0x5640bd13dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53030/0 (socket says 172.21.15.87:53030) 2024-05-08T18:33:05.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.878+0000 7f5780433640 1 -- 172.21.15.87:0/192494478 learned_addr learned my addr 172.21.15.87:0/192494478 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.879+0000 7f5780433640 1 -- 172.21.15.87:0/192494478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640bd13c240 con 0x5640bd1c82c0 2024-05-08T18:33:05.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.879+0000 7f5780433640 1 --2- 172.21.15.87:0/192494478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 0x5640bd13dc80 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5770055040 tx=0x7f577004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6399445db84b49ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.879+0000 7f566e60c640 1 -- 172.21.15.87:0/192494478 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5770057040 con 0x5640bd1c82c0 2024-05-08T18:33:05.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.879+0000 7f566e60c640 1 -- 172.21.15.87:0/192494478 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5770063070 con 0x5640bd1c82c0 2024-05-08T18:33:05.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.879+0000 7f566e60c640 1 -- 172.21.15.87:0/192494478 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577005d790 con 0x5640bd1c82c0 2024-05-08T18:33:05.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.880+0000 7f5784738800 1 -- 172.21.15.87:0/192494478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 msgr2=0x5640bd13dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.880+0000 7f5784738800 1 --2- 172.21.15.87:0/192494478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 0x5640bd13dc80 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5770055040 tx=0x7f577004c000 comp rx=0 tx=0).stop 2024-05-08T18:33:05.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.880+0000 7f5784738800 1 -- 172.21.15.87:0/192494478 shutdown_connections 2024-05-08T18:33:05.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.880+0000 7f5784738800 1 --2- 172.21.15.87:0/192494478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 0x5640bd13dc80 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.880+0000 7f5784738800 1 -- 172.21.15.87:0/192494478 >> 172.21.15.87:0/192494478 conn(0x5640bd1c3840 msgr2=0x5640bd2b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.880+0000 7f5784738800 1 -- 172.21.15.87:0/192494478 shutdown_connections 2024-05-08T18:33:05.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.880+0000 7f5784738800 1 -- 172.21.15.87:0/192494478 wait complete. 2024-05-08T18:33:05.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.880+0000 7f5784738800 1 Processor -- start 2024-05-08T18:33:05.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.880+0000 7f5784738800 1 -- start start 2024-05-08T18:33:05.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.880+0000 7f5784738800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 0x5640bd2c3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.880+0000 7f5784738800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5640bd1d1950 con 0x5640bd1c82c0 2024-05-08T18:33:05.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.880+0000 7f5780433640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 0x5640bd2c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.880+0000 7f5780433640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 0x5640bd2c3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53044/0 (socket says 172.21.15.87:53044) 2024-05-08T18:33:05.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.880+0000 7f5780433640 1 -- 172.21.15.87:0/1151744461 learned_addr learned my addr 172.21.15.87:0/1151744461 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.881+0000 7f5780433640 1 -- 172.21.15.87:0/1151744461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640bd2c39b0 con 0x5640bd1c82c0 2024-05-08T18:33:05.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.881+0000 7f5780433640 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 0x5640bd2c3470 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f577000a470 tx=0x7f5770002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.881+0000 7f566ce09640 1 -- 172.21.15.87:0/1151744461 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5770057050 con 0x5640bd1c82c0 2024-05-08T18:33:05.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.881+0000 7f566ce09640 1 -- 172.21.15.87:0/1151744461 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f577005dc90 con 0x5640bd1c82c0 2024-05-08T18:33:05.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.881+0000 7f5784738800 1 -- 172.21.15.87:0/1151744461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640bd2c3c40 con 0x5640bd1c82c0 2024-05-08T18:33:05.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.881+0000 7f566ce09640 1 -- 172.21.15.87:0/1151744461 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5770052440 con 0x5640bd1c82c0 2024-05-08T18:33:05.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.881+0000 7f5784738800 1 -- 172.21.15.87:0/1151744461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640bd2c68f0 con 0x5640bd1c82c0 2024-05-08T18:33:05.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.882+0000 7f566ce09640 1 -- 172.21.15.87:0/1151744461 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f57700525e0 con 0x5640bd1c82c0 2024-05-08T18:33:05.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.882+0000 7f566ce09640 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f566803bba0 0x7f566803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.882+0000 7f566ce09640 1 -- 172.21.15.87:0/1151744461 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f5770094100 con 0x5640bd1c82c0 2024-05-08T18:33:05.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.882+0000 7f5777fff640 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f566803bba0 0x7f566803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.882+0000 7f5784738800 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5640bd1c9480 0x5640bd2ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.882+0000 7f5784738800 1 -- 172.21.15.87:0/1151744461 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd2cac30 con 0x5640bd1c9480 2024-05-08T18:33:05.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.882+0000 7f5780c34640 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5640bd1c9480 0x5640bd2ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.883+0000 7f5777fff640 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f566803bba0 0x7f566803e060 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5768000f60 tx=0x7f57680012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.883+0000 7f5780c34640 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5640bd1c9480 0x5640bd2ca6b0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.883+0000 7f5780c34640 1 -- 172.21.15.87:0/1151744461 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f577800a4a0 con 0x5640bd1c9480 2024-05-08T18:33:05.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.883+0000 7f5784738800 1 -- 172.21.15.87:0/1151744461 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd2c7c60 con 0x5640bd1c9480 2024-05-08T18:33:05.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.883+0000 7f5780c34640 1 -- 172.21.15.87:0/1151744461 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f577800a4a0 con 0x5640bd1c9480 2024-05-08T18:33:05.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.883+0000 7f5784738800 1 -- 172.21.15.87:0/1151744461 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd2cca80 con 0x5640bd1c9480 2024-05-08T18:33:05.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.884+0000 7f5780c34640 1 -- 172.21.15.87:0/1151744461 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f577800a4a0 con 0x5640bd1c9480 2024-05-08T18:33:05.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.884+0000 7f5784738800 1 -- 172.21.15.87:0/1151744461 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd2cbbc0 con 0x5640bd1c9480 2024-05-08T18:33:05.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.884+0000 7f5780c34640 1 -- 172.21.15.87:0/1151744461 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f577800a4a0 con 0x5640bd1c9480 2024-05-08T18:33:05.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.884+0000 7f5784738800 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5640bd2cc660 0x5640bd2cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.884+0000 7f5784738800 1 -- 172.21.15.87:0/1151744461 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd2d0650 con 0x5640bd2cc660 2024-05-08T18:33:05.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.884+0000 7f5780433640 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5640bd2cc660 0x5640bd2cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.884+0000 7f5780433640 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5640bd2cc660 0x5640bd2cfec0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.885+0000 7f5780433640 1 -- 172.21.15.87:0/1151744461 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5770078070 con 0x5640bd2cc660 2024-05-08T18:33:05.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.885+0000 7f5784738800 1 Processor -- start 2024-05-08T18:33:05.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.885+0000 7f5784738800 1 -- start start 2024-05-08T18:33:05.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.885+0000 7f5784738800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2de9c0 0x5640bd2dede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.885+0000 7f5784738800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5640bd0b9fc0 con 0x5640bd2de9c0 2024-05-08T18:33:05.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.885+0000 7f5780c34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2de9c0 0x5640bd2dede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.885+0000 7f5780c34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2de9c0 0x5640bd2dede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53060/0 (socket says 172.21.15.87:53060) 2024-05-08T18:33:05.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.885+0000 7f5780c34640 1 -- 172.21.15.87:0/4212880539 learned_addr learned my addr 172.21.15.87:0/4212880539 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.886+0000 7f5780c34640 1 -- 172.21.15.87:0/4212880539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640bd2df320 con 0x5640bd2de9c0 2024-05-08T18:33:05.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.886+0000 7f5780c34640 1 --2- 172.21.15.87:0/4212880539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2de9c0 0x5640bd2dede0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x5640bd2cb010 tx=0x7f57780178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.886+0000 7f5665ffb640 1 -- 172.21.15.87:0/4212880539 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5778013440 con 0x5640bd2de9c0 2024-05-08T18:33:05.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.886+0000 7f5665ffb640 1 -- 172.21.15.87:0/4212880539 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57780135e0 con 0x5640bd2de9c0 2024-05-08T18:33:05.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.886+0000 7f5665ffb640 1 -- 172.21.15.87:0/4212880539 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57780138c0 con 0x5640bd2de9c0 2024-05-08T18:33:05.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.886+0000 7f5784738800 1 -- 172.21.15.87:0/4212880539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640bd2dfd90 con 0x5640bd2de9c0 2024-05-08T18:33:05.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.886+0000 7f5784738800 1 -- 172.21.15.87:0/4212880539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640bd2e0290 con 0x5640bd2de9c0 2024-05-08T18:33:05.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.887+0000 7f5665ffb640 1 -- 172.21.15.87:0/4212880539 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5778011040 con 0x5640bd2de9c0 2024-05-08T18:33:05.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.887+0000 7f5665ffb640 1 --2- 172.21.15.87:0/4212880539 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f565803bba0 0x7f565803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.887+0000 7f5665ffb640 1 -- 172.21.15.87:0/4212880539 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f577801d070 con 0x5640bd2de9c0 2024-05-08T18:33:05.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.887+0000 7f5780433640 1 --2- 172.21.15.87:0/4212880539 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f565803bba0 0x7f565803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.887+0000 7f5784738800 1 Processor -- start 2024-05-08T18:33:05.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.887+0000 7f5780433640 1 --2- 172.21.15.87:0/4212880539 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f565803bba0 0x7f565803e060 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x5640bd2cbf60 tx=0x7f5770092360 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.888+0000 7f5784738800 1 -- start start 2024-05-08T18:33:05.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.888+0000 7f5784738800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2ebc30 0x5640bd2ec050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.888+0000 7f5784738800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5640bd13c500 con 0x5640bd2ebc30 2024-05-08T18:33:05.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.888+0000 7f5780c34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2ebc30 0x5640bd2ec050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.888+0000 7f5780c34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2ebc30 0x5640bd2ec050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53076/0 (socket says 172.21.15.87:53076) 2024-05-08T18:33:05.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.888+0000 7f5780c34640 1 -- 172.21.15.87:0/2089536769 learned_addr learned my addr 172.21.15.87:0/2089536769 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.888+0000 7f5780c34640 1 -- 172.21.15.87:0/2089536769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640bd2ec620 con 0x5640bd2ebc30 2024-05-08T18:33:05.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.888+0000 7f5780c34640 1 --2- 172.21.15.87:0/2089536769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2ebc30 0x5640bd2ec050 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f5778052970 tx=0x7f5778001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e507b14ea3f82941 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.888+0000 7f56577fe640 1 -- 172.21.15.87:0/2089536769 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57780157b0 con 0x5640bd2ebc30 2024-05-08T18:33:05.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.888+0000 7f56577fe640 1 -- 172.21.15.87:0/2089536769 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f577802ac50 con 0x5640bd2ebc30 2024-05-08T18:33:05.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.888+0000 7f56577fe640 1 -- 172.21.15.87:0/2089536769 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5778015950 con 0x5640bd2ebc30 2024-05-08T18:33:05.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.889+0000 7f5784738800 1 -- 172.21.15.87:0/2089536769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2ebc30 msgr2=0x5640bd2ec050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.889+0000 7f5784738800 1 --2- 172.21.15.87:0/2089536769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2ebc30 0x5640bd2ec050 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f5778052970 tx=0x7f5778001e60 comp rx=0 tx=0).stop 2024-05-08T18:33:05.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.889+0000 7f5784738800 1 -- 172.21.15.87:0/2089536769 shutdown_connections 2024-05-08T18:33:05.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.889+0000 7f5784738800 1 --2- 172.21.15.87:0/2089536769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2ebc30 0x5640bd2ec050 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.889+0000 7f5784738800 1 -- 172.21.15.87:0/2089536769 >> 172.21.15.87:0/2089536769 conn(0x5640bd2e7fe0 msgr2=0x5640bd2e6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.889+0000 7f5784738800 1 -- 172.21.15.87:0/2089536769 shutdown_connections 2024-05-08T18:33:05.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.889+0000 7f5784738800 1 -- 172.21.15.87:0/2089536769 wait complete. 2024-05-08T18:33:05.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.889+0000 7f5784738800 1 Processor -- start 2024-05-08T18:33:05.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.889+0000 7f5784738800 1 -- start start 2024-05-08T18:33:05.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.889+0000 7f5784738800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2ebc30 0x5640bd2f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.889+0000 7f5784738800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5640bd2ecd80 con 0x5640bd2ebc30 2024-05-08T18:33:05.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.890+0000 7f5780c34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2ebc30 0x5640bd2f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.890+0000 7f5780c34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2ebc30 0x5640bd2f3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53090/0 (socket says 172.21.15.87:53090) 2024-05-08T18:33:05.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.890+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 learned_addr learned my addr 172.21.15.87:0/2768914869 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:05.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.890+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640bd2f3780 con 0x5640bd2ebc30 2024-05-08T18:33:05.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.890+0000 7f5780c34640 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2ebc30 0x5640bd2f3240 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f5778052970 tx=0x7f5778052900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.890+0000 7f5655ffb640 1 -- 172.21.15.87:0/2768914869 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5778030020 con 0x5640bd2ebc30 2024-05-08T18:33:05.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.890+0000 7f5655ffb640 1 -- 172.21.15.87:0/2768914869 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57780540d0 con 0x5640bd2ebc30 2024-05-08T18:33:05.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.890+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640bd2f3a10 con 0x5640bd2ebc30 2024-05-08T18:33:05.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.890+0000 7f5655ffb640 1 -- 172.21.15.87:0/2768914869 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5778013e60 con 0x5640bd2ebc30 2024-05-08T18:33:05.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.890+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640bd2f66c0 con 0x5640bd2ebc30 2024-05-08T18:33:05.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.891+0000 7f5655ffb640 1 -- 172.21.15.87:0/2768914869 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5778033020 con 0x5640bd2ebc30 2024-05-08T18:33:05.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.891+0000 7f5655ffb640 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f564803bba0 0x7f564803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.891+0000 7f5655ffb640 1 -- 172.21.15.87:0/2768914869 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f577800e040 con 0x5640bd2ebc30 2024-05-08T18:33:05.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.891+0000 7f5780433640 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f564803bba0 0x7f564803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.892+0000 7f5780433640 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f564803bba0 0x7f564803e060 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f57700926c0 tx=0x7f577007e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.892+0000 7f5784738800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.892+0000 7f5784738800 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5640bd2feef0 0x5640bd3013b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.892+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd301b00 con 0x5640bd2feef0 2024-05-08T18:33:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.892+0000 7f5777fff640 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5640bd2feef0 0x5640bd3013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.892+0000 7f5777fff640 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5640bd2feef0 0x5640bd3013b0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.892+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5768009050 con 0x5640bd2feef0 2024-05-08T18:33:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 20 realm 2024-05-08T18:33:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd2fe340 con 0x5640bd2feef0 2024-05-08T18:33:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5768009050 con 0x5640bd2feef0 2024-05-08T18:33:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd3025f0 con 0x5640bd2feef0 2024-05-08T18:33:05.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5768009050 con 0x5640bd2feef0 2024-05-08T18:33:05.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd302ec0 con 0x5640bd2feef0 2024-05-08T18:33:05.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5768009050 con 0x5640bd2feef0 2024-05-08T18:33:05.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:05.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd303260 con 0x5640bd2feef0 2024-05-08T18:33:05.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5768009050 con 0x5640bd2feef0 2024-05-08T18:33:05.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:05.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 20 searching for the correct realm 2024-05-08T18:33:05.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5640bd305140 0x5640bd307530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.893+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x5640bd305140 2024-05-08T18:33:05.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.894+0000 7f5780c34640 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5640bd305140 0x5640bd307530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.894+0000 7f5780c34640 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5640bd305140 0x5640bd307530 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.894+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5778051020 con 0x5640bd305140 2024-05-08T18:33:05.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.894+0000 7f5780c34640 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5778035020 0x7f57780370d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.894+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x7f5778035020 2024-05-08T18:33:05.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.894+0000 7f5780433640 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5778035020 0x7f57780370d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.895+0000 7f5780433640 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5778035020 0x7f57780370d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.895+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577008e040 con 0x7f5778035020 2024-05-08T18:33:05.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.895+0000 7f5780433640 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f57700927a0 0x7f5770095480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.895+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x7f57700927a0 2024-05-08T18:33:05.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.895+0000 7f5777fff640 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f57700927a0 0x7f5770095480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.895+0000 7f5777fff640 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f57700927a0 0x7f5770095480 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.896+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5768009050 con 0x7f57700927a0 2024-05-08T18:33:05.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.896+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x5640bd2feef0 2024-05-08T18:33:05.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.896+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5768009050 con 0x5640bd2feef0 2024-05-08T18:33:05.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.896+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x5640bd2feef0 2024-05-08T18:33:05.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.896+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.896+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x7f57700927a0 2024-05-08T18:33:05.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.896+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.896+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x7f57700927a0 2024-05-08T18:33:05.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.897+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.897+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x7f5778035020 2024-05-08T18:33:05.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.897+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577008e040 con 0x7f5778035020 2024-05-08T18:33:05.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.897+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x5640bd305140 2024-05-08T18:33:05.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.897+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5778051020 con 0x5640bd305140 2024-05-08T18:33:05.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.897+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x5640bd2feef0 2024-05-08T18:33:05.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.897+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.897+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x7f57700927a0 2024-05-08T18:33:05.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.898+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.898+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x5640bd2feef0 2024-05-08T18:33:05.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.898+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.898+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x7f5778035020 2024-05-08T18:33:05.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.898+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f577008e040 con 0x7f5778035020 2024-05-08T18:33:05.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.898+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x5640bd305140 2024-05-08T18:33:05.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.898+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5778051020 con 0x5640bd305140 2024-05-08T18:33:05.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.898+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x5640bd305140 2024-05-08T18:33:05.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.898+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5778051020 con 0x5640bd305140 2024-05-08T18:33:05.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.898+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x7f57700927a0 2024-05-08T18:33:05.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.899+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.899+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x5640bd305140 2024-05-08T18:33:05.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.899+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5778051020 con 0x5640bd305140 2024-05-08T18:33:05.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.899+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x5640bd305140 2024-05-08T18:33:05.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.899+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5778051020 con 0x5640bd305140 2024-05-08T18:33:05.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.899+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x5640bd2feef0 2024-05-08T18:33:05.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.899+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.899+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x5640bd2feef0 2024-05-08T18:33:05.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.900+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v29'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.900+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x7f57700927a0 2024-05-08T18:33:05.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.900+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.900+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x5640bd305140 2024-05-08T18:33:05.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.900+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5778051020 con 0x5640bd305140 2024-05-08T18:33:05.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.900+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x7f5778035020 2024-05-08T18:33:05.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.901+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577008e040 con 0x7f5778035020 2024-05-08T18:33:05.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.901+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x5640bd2feef0 2024-05-08T18:33:05.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.901+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.901+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x7f57700927a0 2024-05-08T18:33:05.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.901+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.901+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x5640bd305140 2024-05-08T18:33:05.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.901+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5778051020 con 0x5640bd305140 2024-05-08T18:33:05.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.901+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x7f5778035020 2024-05-08T18:33:05.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.902+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577008e040 con 0x7f5778035020 2024-05-08T18:33:05.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.902+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x7f5778035020 2024-05-08T18:33:05.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.902+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577008e040 con 0x7f5778035020 2024-05-08T18:33:05.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.902+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x5640bd305140 2024-05-08T18:33:05.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.902+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5778051020 con 0x5640bd305140 2024-05-08T18:33:05.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.902+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640bd307be0 con 0x7f5778035020 2024-05-08T18:33:05.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.902+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577008e040 con 0x7f5778035020 2024-05-08T18:33:05.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.902+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f57700ab040 con 0x5640bd2feef0 2024-05-08T18:33:05.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f57700ab040 con 0x7f5778035020 2024-05-08T18:33:05.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577008e040 con 0x7f5778035020 2024-05-08T18:33:05.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5784738800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:05.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5784738800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:05.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5784738800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:05.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5784738800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:05.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5784738800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:05.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5784738800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:05.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5784738800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd303bb0 con 0x5640bd2feef0 2024-05-08T18:33:05.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5784738800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5784738800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd304450 con 0x5640bd2feef0 2024-05-08T18:33:05.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5784738800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:05.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5784738800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.903+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd308060 con 0x7f57700927a0 2024-05-08T18:33:05.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.904+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.904+0000 7f5784738800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:05.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.904+0000 7f5784738800 20 zone default found 2024-05-08T18:33:05.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.904+0000 7f5784738800 4 Realm: () 2024-05-08T18:33:05.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.904+0000 7f5784738800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:05.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.904+0000 7f5784738800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:05.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.904+0000 7f5784738800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:05.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.904+0000 7f5784738800 20 zonegroup default 2024-05-08T18:33:05.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.904+0000 7f5784738800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.904+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd308510 con 0x7f57700927a0 2024-05-08T18:33:05.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.904+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.904+0000 7f5784738800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.904+0000 7f5784738800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.904+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd309ef0 con 0x5640bd305140 2024-05-08T18:33:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.905+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5778051020 con 0x5640bd305140 2024-05-08T18:33:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.905+0000 7f5784738800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.905+0000 7f5784738800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.905+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30a3f0 con 0x5640bd305140 2024-05-08T18:33:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.905+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5778051020 con 0x5640bd305140 2024-05-08T18:33:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.905+0000 7f5784738800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.905+0000 7f5784738800 20 started sync module instance, tier type = 2024-05-08T18:33:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.905+0000 7f5784738800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.905+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd309380 con 0x7f5778035020 2024-05-08T18:33:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.906+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577008e040 con 0x7f5778035020 2024-05-08T18:33:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.906+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94836051974000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30ad00 con 0x7f5778035020 2024-05-08T18:33:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.906+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30b550 con 0x5640bd2feef0 2024-05-08T18:33:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.907+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94836051974000] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577008e040 con 0x7f5778035020 2024-05-08T18:33:05.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.907+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.907+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94836051978320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30b5b0 con 0x5640bd2feef0 2024-05-08T18:33:05.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.908+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30c0a0 con 0x5640bd305140 2024-05-08T18:33:05.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.908+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94836051978320] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.909+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5778051020 con 0x5640bd305140 2024-05-08T18:33:05.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.909+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94836051983216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30c4c0 con 0x5640bd305140 2024-05-08T18:33:05.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.909+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30cee0 con 0x7f5778035020 2024-05-08T18:33:05.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.910+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94836051983216] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5778051020 con 0x5640bd305140 2024-05-08T18:33:05.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.910+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577008e040 con 0x7f5778035020 2024-05-08T18:33:05.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.910+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94836051986896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30d2d0 con 0x7f5778035020 2024-05-08T18:33:05.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.910+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30dd10 con 0x5640bd2feef0 2024-05-08T18:33:05.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.911+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.911+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94836051990496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30dcd0 con 0x5640bd2feef0 2024-05-08T18:33:05.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.911+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30ecd0 con 0x7f57700927a0 2024-05-08T18:33:05.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.911+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94836051986896] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577008e040 con 0x7f5778035020 2024-05-08T18:33:05.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.912+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94836051990496] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.912+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.912+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94836051992832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30b0a0 con 0x7f57700927a0 2024-05-08T18:33:05.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.912+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30f180 con 0x7f57700927a0 2024-05-08T18:33:05.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.913+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94836051992832] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.913+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.913+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94836051994624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30f180 con 0x7f57700927a0 2024-05-08T18:33:05.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.913+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30fb40 con 0x7f57700927a0 2024-05-08T18:33:05.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.914+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94836051994624] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.914+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.914+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94836051995856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30fd20 con 0x7f57700927a0 2024-05-08T18:33:05.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.914+0000 7f5784738800 20 add_watcher() i=0 2024-05-08T18:33:05.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.914+0000 7f5784738800 20 add_watcher() i=1 2024-05-08T18:33:05.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.914+0000 7f5784738800 20 add_watcher() i=2 2024-05-08T18:33:05.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.914+0000 7f5784738800 20 add_watcher() i=3 2024-05-08T18:33:05.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.914+0000 7f5784738800 20 add_watcher() i=4 2024-05-08T18:33:05.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.914+0000 7f5784738800 20 add_watcher() i=5 2024-05-08T18:33:05.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.914+0000 7f5784738800 20 add_watcher() i=6 2024-05-08T18:33:05.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.916+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94836051995856] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.916+0000 7f5784738800 20 add_watcher() i=7 2024-05-08T18:33:05.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.916+0000 7f5784738800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:05.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.916+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd312ed0 con 0x5640bd2feef0 2024-05-08T18:33:05.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.916+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.916+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94836051998928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd3101a0 con 0x5640bd2feef0 2024-05-08T18:33:05.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.917+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94836051998928] v29'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.917+0000 7f56367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:05.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.917+0000 7f5784738800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:05.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.917+0000 7f5784738800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:05.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.917+0000 7f5784738800 5 note: GC not initialized 2024-05-08T18:33:05.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.917+0000 7f56357e2640 20 reqs_thread_entry: start 2024-05-08T18:33:05.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.918+0000 7f5784738800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:05.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.918+0000 7f5784738800 20 Filter name: none 2024-05-08T18:33:05.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.918+0000 7f55a6ffd640 20 reqs_thread_entry: start 2024-05-08T18:33:05.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.918+0000 7f5784738800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:33:05.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.918+0000 7f5784738800 20 rados->read ofs=0 len=0 2024-05-08T18:33:05.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.918+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd3464a0 con 0x7f57700927a0 2024-05-08T18:33:05.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.918+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.918+0000 7f5784738800 20 rados_obj.operate() r=0 bl.length=490 2024-05-08T18:33:05.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.919+0000 7f5784738800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:33:05.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.919+0000 7f5784738800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.919+0000 7f5784738800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:33:05.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.919+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd34cd30 con 0x7f57700927a0 2024-05-08T18:33:05.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.920+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v29'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.920+0000 7f5784738800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:05.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.920+0000 7f5784738800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.920+0000 7f5784738800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:33:05.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.920+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94836052248304 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640bd348330 con 0x5640bd2feef0 2024-05-08T18:33:05.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.920+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== watch-notify(notify (1) cookie 94836051990496 notify 124554051613 ret 0) ==== 678+0+0 (crc 0 0 0) 0x5640bd1c8d60 con 0x5640bd2feef0 2024-05-08T18:33:05.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.920+0000 7f56577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051613 cookie 94836051990496 notifier 4900 bl.length()=636 2024-05-08T18:33:05.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.920+0000 7f56577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:05.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.920+0000 7f56577fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:05.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.920+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 notify.4 [notify cookie 94836052248304 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.920+0000 7f56577fe640 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f5644003ea0 con 0x5640bd2feef0 2024-05-08T18:33:05.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.921+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.921+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== watch-notify(notify_complete (2) cookie 94836052248304 notify 124554051613 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f576803f660 con 0x5640bd2feef0 2024-05-08T18:33:05.935 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:33:04.270799Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:33:04.270781Z","tags":[],"group_ids":[]} 2024-05-08T18:33:05.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.921+0000 7f56367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:05.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.922+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94836051998928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd3125a0 con 0x5640bd2feef0 2024-05-08T18:33:05.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.923+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94836051998928] v29'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.923+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94836051974000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30f8d0 con 0x7f5778035020 2024-05-08T18:33:05.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.924+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94836051974000] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577008e040 con 0x7f5778035020 2024-05-08T18:33:05.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.924+0000 7f5784738800 20 remove_watcher() i=0 2024-05-08T18:33:05.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.924+0000 7f5784738800 2 removed watcher, disabling cache 2024-05-08T18:33:05.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.924+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94836051978320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30f8d0 con 0x5640bd2feef0 2024-05-08T18:33:05.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.925+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94836051978320] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.925+0000 7f5784738800 20 remove_watcher() i=1 2024-05-08T18:33:05.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.925+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94836051983216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30a850 con 0x5640bd305140 2024-05-08T18:33:05.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.926+0000 7f5780c34640 1 -- 172.21.15.87:0/2768914869 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94836051983216] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5778051020 con 0x5640bd305140 2024-05-08T18:33:05.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.926+0000 7f5784738800 20 remove_watcher() i=2 2024-05-08T18:33:05.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.926+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94836051986896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30f8d0 con 0x7f5778035020 2024-05-08T18:33:05.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.927+0000 7f5780433640 1 -- 172.21.15.87:0/2768914869 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94836051986896] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577008e040 con 0x7f5778035020 2024-05-08T18:33:05.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.927+0000 7f5784738800 20 remove_watcher() i=3 2024-05-08T18:33:05.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.927+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94836051990496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30a850 con 0x5640bd2feef0 2024-05-08T18:33:05.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.928+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94836051990496] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576802a040 con 0x5640bd2feef0 2024-05-08T18:33:05.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.928+0000 7f5784738800 20 remove_watcher() i=4 2024-05-08T18:33:05.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.928+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94836051992832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30c9d0 con 0x7f57700927a0 2024-05-08T18:33:05.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.929+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94836051992832] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.929+0000 7f5784738800 20 remove_watcher() i=5 2024-05-08T18:33:05.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.929+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94836051994624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30f8d0 con 0x7f57700927a0 2024-05-08T18:33:05.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.930+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94836051994624] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.930+0000 7f5784738800 20 remove_watcher() i=6 2024-05-08T18:33:05.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.930+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94836051995856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640bd30a850 con 0x7f57700927a0 2024-05-08T18:33:05.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.931+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94836051995856] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576802a040 con 0x7f57700927a0 2024-05-08T18:33:05.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.931+0000 7f5784738800 20 remove_watcher() i=7 2024-05-08T18:33:05.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.931+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f57700927a0 msgr2=0x7f5770095480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.931+0000 7f5784738800 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f57700927a0 0x7f5770095480 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.931+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5640bd2feef0 msgr2=0x5640bd3013b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.931+0000 7f5784738800 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5640bd2feef0 0x5640bd3013b0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.931+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5778035020 msgr2=0x7f57780370d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.931+0000 7f5784738800 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f5778035020 0x7f57780370d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.931+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5640bd305140 msgr2=0x5640bd307530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.931+0000 7f5784738800 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5640bd305140 0x5640bd307530 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f564803bba0 msgr2=0x7f564803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f564803bba0 0x7f564803e060 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f57700926c0 tx=0x7f577007e000 comp rx=0 tx=0).stop 2024-05-08T18:33:05.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2ebc30 msgr2=0x5640bd2f3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 --2- 172.21.15.87:0/2768914869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2ebc30 0x5640bd2f3240 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f5778052970 tx=0x7f5778052900 comp rx=0 tx=0).stop 2024-05-08T18:33:05.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 reap_dead start 2024-05-08T18:33:05.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5777fff640 1 -- 172.21.15.87:0/2768914869 reap_dead start 2024-05-08T18:33:05.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 shutdown_connections 2024-05-08T18:33:05.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 >> 172.21.15.87:0/2768914869 conn(0x5640bd2e7fe0 msgr2=0x5640bd2ed4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 shutdown_connections 2024-05-08T18:33:05.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 -- 172.21.15.87:0/2768914869 wait complete. 2024-05-08T18:33:05.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 -- 172.21.15.87:0/4212880539 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f565803bba0 msgr2=0x7f565803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 --2- 172.21.15.87:0/4212880539 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f565803bba0 0x7f565803e060 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x5640bd2cbf60 tx=0x7f5770092360 comp rx=0 tx=0).stop 2024-05-08T18:33:05.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 -- 172.21.15.87:0/4212880539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2de9c0 msgr2=0x5640bd2dede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 --2- 172.21.15.87:0/4212880539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2de9c0 0x5640bd2dede0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x5640bd2cb010 tx=0x7f57780178e0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 -- 172.21.15.87:0/4212880539 shutdown_connections 2024-05-08T18:33:05.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 --2- 172.21.15.87:0/4212880539 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f565803bba0 0x7f565803e060 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 --2- 172.21.15.87:0/4212880539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd2de9c0 0x5640bd2dede0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 -- 172.21.15.87:0/4212880539 >> 172.21.15.87:0/4212880539 conn(0x5640bd2d2a60 msgr2=0x5640bd2d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 -- 172.21.15.87:0/4212880539 shutdown_connections 2024-05-08T18:33:05.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 -- 172.21.15.87:0/4212880539 wait complete. 2024-05-08T18:33:05.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 -- 172.21.15.87:0/1151744461 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5640bd2cc660 msgr2=0x5640bd2cfec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5640bd2cc660 0x5640bd2cfec0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 -- 172.21.15.87:0/1151744461 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5640bd1c9480 msgr2=0x5640bd2ca6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5640bd1c9480 0x5640bd2ca6b0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.932+0000 7f5784738800 1 -- 172.21.15.87:0/1151744461 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f566803bba0 msgr2=0x7f566803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.933+0000 7f5784738800 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f566803bba0 0x7f566803e060 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5768000f60 tx=0x7f57680012b0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.933+0000 7f5784738800 1 -- 172.21.15.87:0/1151744461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 msgr2=0x5640bd2c3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.933+0000 7f5784738800 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 0x5640bd2c3470 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f577000a470 tx=0x7f5770002fb0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.933+0000 7f5784738800 1 -- 172.21.15.87:0/1151744461 shutdown_connections 2024-05-08T18:33:05.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.933+0000 7f5784738800 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5640bd1c9480 0x5640bd2ca6b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.933+0000 7f5784738800 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5640bd2cc660 0x5640bd2cfec0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.933+0000 7f5784738800 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f566803bba0 0x7f566803e060 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.933+0000 7f5784738800 1 --2- 172.21.15.87:0/1151744461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640bd1c82c0 0x5640bd2c3470 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:05.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.933+0000 7f5784738800 1 -- 172.21.15.87:0/1151744461 >> 172.21.15.87:0/1151744461 conn(0x5640bd1c3840 msgr2=0x5640bd13ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:05.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.933+0000 7f5784738800 1 -- 172.21.15.87:0/1151744461 shutdown_connections 2024-05-08T18:33:05.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.933+0000 7f5784738800 1 -- 172.21.15.87:0/1151744461 wait complete. 2024-05-08T18:33:05.948 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:05.948 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:05.948 ERROR:root:0 2024-05-08T18:33:05.948 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:33:05.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:33:05.948 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-08T18:33:05.994 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:05.995 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:05.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.997+0000 7fb57172b800 1 Processor -- start 2024-05-08T18:33:05.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.997+0000 7fb57172b800 1 -- start start 2024-05-08T18:33:05.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.997+0000 7fb57172b800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f9d6abdb70 0x55f9d6abdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:05.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.997+0000 7fb57172b800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f9d6a32660 con 0x55f9d6abe4d0 2024-05-08T18:33:05.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.997+0000 7fb57172b800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f9d695fe20 con 0x55f9d6abdb70 2024-05-08T18:33:05.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.997+0000 7fb56d4e8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f9d6abdb70 0x55f9d6abdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:05.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.997+0000 7fb56cce7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55f9d6abe4d0 0x55f9d6abe980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58256/0 (socket says 172.21.15.87:58256) 2024-05-08T18:33:05.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.997+0000 7fb56d4e8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f9d6abdb70 0x55f9d6abdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53092/0 (socket says 172.21.15.87:53092) 2024-05-08T18:33:05.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.997+0000 7fb56cce7640 1 -- 172.21.15.87:0/3323223176 learned_addr learned my addr 172.21.15.87:0/3323223176 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:33:05.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.998+0000 7fb56d4e8640 1 -- 172.21.15.87:0/3323223176 >> v1:172.21.15.53:6789/0 conn(0x55f9d6abe4d0 legacy=0x55f9d6abe980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:05.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.998+0000 7fb56d4e8640 1 -- 172.21.15.87:0/3323223176 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d6abf090 con 0x55f9d6abdb70 2024-05-08T18:33:05.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:05.999+0000 7fb56d4e8640 1 --2- 172.21.15.87:0/3323223176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 0x55f9d6abdf90 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb560005fd0 tx=0x7fb56001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6126ad3ee011b6a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:05.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.000+0000 7fb55ffff640 1 -- 172.21.15.87:0/3323223176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb560052560 con 0x55f9d6abdb70 2024-05-08T18:33:05.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.000+0000 7fb55ffff640 1 -- 172.21.15.87:0/3323223176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb560052700 con 0x55f9d6abdb70 2024-05-08T18:33:05.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.000+0000 7fb55ffff640 1 -- 172.21.15.87:0/3323223176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb560052a60 con 0x55f9d6abdb70 2024-05-08T18:33:05.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.000+0000 7fb57172b800 1 -- 172.21.15.87:0/3323223176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 msgr2=0x55f9d6abdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.000+0000 7fb57172b800 1 --2- 172.21.15.87:0/3323223176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 0x55f9d6abdf90 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb560005fd0 tx=0x7fb56001ccc0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.000+0000 7fb57172b800 1 -- 172.21.15.87:0/3323223176 shutdown_connections 2024-05-08T18:33:06.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.000+0000 7fb57172b800 1 --2- 172.21.15.87:0/3323223176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 0x55f9d6abdf90 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.000+0000 7fb57172b800 1 -- 172.21.15.87:0/3323223176 >> 172.21.15.87:0/3323223176 conn(0x55f9d6ab9730 msgr2=0x55f9d6abbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:06.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.000+0000 7fb57172b800 1 -- 172.21.15.87:0/3323223176 shutdown_connections 2024-05-08T18:33:06.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.000+0000 7fb57172b800 1 -- 172.21.15.87:0/3323223176 wait complete. 2024-05-08T18:33:06.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.014+0000 7fb57172b800 1 Processor -- start 2024-05-08T18:33:06.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.014+0000 7fb57172b800 1 -- start start 2024-05-08T18:33:06.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.014+0000 7fb57172b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 0x55f9d6bb2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.014+0000 7fb57172b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f9d6a0a5c0 con 0x55f9d6abdb70 2024-05-08T18:33:06.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.014+0000 7fb56d4e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 0x55f9d6bb2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.014+0000 7fb56d4e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 0x55f9d6bb2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53098/0 (socket says 172.21.15.87:53098) 2024-05-08T18:33:06.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.014+0000 7fb56d4e8640 1 -- 172.21.15.87:0/552631771 learned_addr learned my addr 172.21.15.87:0/552631771 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:06.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.014+0000 7fb56d4e8640 1 -- 172.21.15.87:0/552631771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d6bb3060 con 0x55f9d6abdb70 2024-05-08T18:33:06.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.015+0000 7fb56d4e8640 1 --2- 172.21.15.87:0/552631771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 0x55f9d6bb2a90 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb560007000 tx=0x7fb56004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc737fe2d3ee245 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.015+0000 7fb45b606640 1 -- 172.21.15.87:0/552631771 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5600529e0 con 0x55f9d6abdb70 2024-05-08T18:33:06.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.015+0000 7fb45b606640 1 -- 172.21.15.87:0/552631771 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb560052b80 con 0x55f9d6abdb70 2024-05-08T18:33:06.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.015+0000 7fb45b606640 1 -- 172.21.15.87:0/552631771 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb56005c430 con 0x55f9d6abdb70 2024-05-08T18:33:06.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.015+0000 7fb57172b800 1 -- 172.21.15.87:0/552631771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 msgr2=0x55f9d6bb2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.015+0000 7fb57172b800 1 --2- 172.21.15.87:0/552631771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 0x55f9d6bb2a90 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb560007000 tx=0x7fb56004c000 comp rx=0 tx=0).stop 2024-05-08T18:33:06.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.015+0000 7fb57172b800 1 -- 172.21.15.87:0/552631771 shutdown_connections 2024-05-08T18:33:06.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.015+0000 7fb57172b800 1 --2- 172.21.15.87:0/552631771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 0x55f9d6bb2a90 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.015+0000 7fb57172b800 1 -- 172.21.15.87:0/552631771 >> 172.21.15.87:0/552631771 conn(0x55f9d6ab9730 msgr2=0x55f9d6bae3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:06.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.015+0000 7fb57172b800 1 -- 172.21.15.87:0/552631771 shutdown_connections 2024-05-08T18:33:06.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.016+0000 7fb57172b800 1 -- 172.21.15.87:0/552631771 wait complete. 2024-05-08T18:33:06.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.016+0000 7fb57172b800 1 Processor -- start 2024-05-08T18:33:06.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.016+0000 7fb57172b800 1 -- start start 2024-05-08T18:33:06.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.016+0000 7fb57172b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 0x55f9d6bba560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.016+0000 7fb57172b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f9d6abf5c0 con 0x55f9d6abdb70 2024-05-08T18:33:06.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.016+0000 7fb56d4e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 0x55f9d6bba560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.016+0000 7fb56d4e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 0x55f9d6bba560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53110/0 (socket says 172.21.15.87:53110) 2024-05-08T18:33:06.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.016+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2744544985 learned_addr learned my addr 172.21.15.87:0/2744544985 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:06.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.016+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2744544985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d6bbaaa0 con 0x55f9d6abdb70 2024-05-08T18:33:06.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.017+0000 7fb56d4e8640 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 0x55f9d6bba560 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb5600526d0 tx=0x7fb560003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.017+0000 7fb459e03640 1 -- 172.21.15.87:0/2744544985 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb560075070 con 0x55f9d6abdb70 2024-05-08T18:33:06.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.017+0000 7fb459e03640 1 -- 172.21.15.87:0/2744544985 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb560070410 con 0x55f9d6abdb70 2024-05-08T18:33:06.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.017+0000 7fb57172b800 1 -- 172.21.15.87:0/2744544985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9d6bbad30 con 0x55f9d6abdb70 2024-05-08T18:33:06.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.017+0000 7fb459e03640 1 -- 172.21.15.87:0/2744544985 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5600529e0 con 0x55f9d6abdb70 2024-05-08T18:33:06.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.017+0000 7fb57172b800 1 -- 172.21.15.87:0/2744544985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9d6bbd9e0 con 0x55f9d6abdb70 2024-05-08T18:33:06.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.018+0000 7fb459e03640 1 -- 172.21.15.87:0/2744544985 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb560078070 con 0x55f9d6abdb70 2024-05-08T18:33:06.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.018+0000 7fb459e03640 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb45403bba0 0x7fb45403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.018+0000 7fb459e03640 1 -- 172.21.15.87:0/2744544985 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fb56006d070 con 0x55f9d6abdb70 2024-05-08T18:33:06.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.018+0000 7fb56cce7640 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb45403bba0 0x7fb45403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.018+0000 7fb57172b800 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f9d6abe4d0 0x55f9d6bc17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.018+0000 7fb57172b800 1 -- 172.21.15.87:0/2744544985 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bc1ce0 con 0x55f9d6abe4d0 2024-05-08T18:33:06.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.018+0000 7fb56dce9640 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f9d6abe4d0 0x55f9d6bc17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.019+0000 7fb56cce7640 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb45403bba0 0x7fb45403e060 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb564000f60 tx=0x7fb5640012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.019+0000 7fb56dce9640 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f9d6abe4d0 0x55f9d6bc17a0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.019+0000 7fb56dce9640 1 -- 172.21.15.87:0/2744544985 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5680083e0 con 0x55f9d6abe4d0 2024-05-08T18:33:06.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.019+0000 7fb57172b800 1 -- 172.21.15.87:0/2744544985 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bbed50 con 0x55f9d6abe4d0 2024-05-08T18:33:06.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.019+0000 7fb56dce9640 1 -- 172.21.15.87:0/2744544985 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5680083e0 con 0x55f9d6abe4d0 2024-05-08T18:33:06.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.019+0000 7fb57172b800 1 -- 172.21.15.87:0/2744544985 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bc3b30 con 0x55f9d6abe4d0 2024-05-08T18:33:06.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.019+0000 7fb56dce9640 1 -- 172.21.15.87:0/2744544985 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb5680083e0 con 0x55f9d6abe4d0 2024-05-08T18:33:06.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.020+0000 7fb57172b800 1 -- 172.21.15.87:0/2744544985 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bc2d60 con 0x55f9d6abe4d0 2024-05-08T18:33:06.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.020+0000 7fb56dce9640 1 -- 172.21.15.87:0/2744544985 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5680083e0 con 0x55f9d6abe4d0 2024-05-08T18:33:06.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.020+0000 7fb57172b800 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f9d6bc4ee0 0x55f9d6bc72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.020+0000 7fb57172b800 1 -- 172.21.15.87:0/2744544985 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bc7810 con 0x55f9d6bc4ee0 2024-05-08T18:33:06.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.020+0000 7fb56d4e8640 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f9d6bc4ee0 0x55f9d6bc72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.020+0000 7fb56d4e8640 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f9d6bc4ee0 0x55f9d6bc72d0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.021+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2744544985 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb560077030 con 0x55f9d6bc4ee0 2024-05-08T18:33:06.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.021+0000 7fb57172b800 1 Processor -- start 2024-05-08T18:33:06.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.021+0000 7fb57172b800 1 -- start start 2024-05-08T18:33:06.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.021+0000 7fb57172b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6bd5a90 0x55f9d6bd5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.021+0000 7fb57172b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f9d69b0fc0 con 0x55f9d6bd5a90 2024-05-08T18:33:06.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.021+0000 7fb56dce9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6bd5a90 0x55f9d6bd5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.021+0000 7fb56dce9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6bd5a90 0x55f9d6bd5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53114/0 (socket says 172.21.15.87:53114) 2024-05-08T18:33:06.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.021+0000 7fb56dce9640 1 -- 172.21.15.87:0/768861629 learned_addr learned my addr 172.21.15.87:0/768861629 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:06.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.022+0000 7fb56dce9640 1 -- 172.21.15.87:0/768861629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d6bd63f0 con 0x55f9d6bd5a90 2024-05-08T18:33:06.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.022+0000 7fb56dce9640 1 --2- 172.21.15.87:0/768861629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6bd5a90 0x55f9d6bd5eb0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x55f9d6bbb960 tx=0x7fb56800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.022+0000 7fb452ffd640 1 -- 172.21.15.87:0/768861629 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb56801c070 con 0x55f9d6bd5a90 2024-05-08T18:33:06.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.022+0000 7fb452ffd640 1 -- 172.21.15.87:0/768861629 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb56800bdc0 con 0x55f9d6bd5a90 2024-05-08T18:33:06.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.022+0000 7fb57172b800 1 -- 172.21.15.87:0/768861629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9d6bd6e60 con 0x55f9d6bd5a90 2024-05-08T18:33:06.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.022+0000 7fb452ffd640 1 -- 172.21.15.87:0/768861629 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb568018540 con 0x55f9d6bd5a90 2024-05-08T18:33:06.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.022+0000 7fb57172b800 1 -- 172.21.15.87:0/768861629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9d6bd7360 con 0x55f9d6bd5a90 2024-05-08T18:33:06.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.023+0000 7fb452ffd640 1 -- 172.21.15.87:0/768861629 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb56801f070 con 0x55f9d6bd5a90 2024-05-08T18:33:06.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.023+0000 7fb452ffd640 1 --2- 172.21.15.87:0/768861629 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb44403bba0 0x7fb44403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.023+0000 7fb452ffd640 1 -- 172.21.15.87:0/768861629 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fb568054730 con 0x55f9d6bd5a90 2024-05-08T18:33:06.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.023+0000 7fb56d4e8640 1 --2- 172.21.15.87:0/768861629 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb44403bba0 0x7fb44403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.023+0000 7fb57172b800 1 Processor -- start 2024-05-08T18:33:06.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.023+0000 7fb56d4e8640 1 --2- 172.21.15.87:0/768861629 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb44403bba0 0x7fb44403e060 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb56006f000 tx=0x7fb56005df10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.023+0000 7fb57172b800 1 -- start start 2024-05-08T18:33:06.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.023+0000 7fb57172b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6be2d30 0x55f9d6be3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.023+0000 7fb57172b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f9d6bb3380 con 0x55f9d6be2d30 2024-05-08T18:33:06.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.024+0000 7fb56dce9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6be2d30 0x55f9d6be3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.024+0000 7fb56dce9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6be2d30 0x55f9d6be3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53122/0 (socket says 172.21.15.87:53122) 2024-05-08T18:33:06.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.024+0000 7fb56dce9640 1 -- 172.21.15.87:0/747087840 learned_addr learned my addr 172.21.15.87:0/747087840 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:06.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.024+0000 7fb56dce9640 1 -- 172.21.15.87:0/747087840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d6be3720 con 0x55f9d6be2d30 2024-05-08T18:33:06.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.024+0000 7fb56dce9640 1 --2- 172.21.15.87:0/747087840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6be2d30 0x55f9d6be3150 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb568052a30 tx=0x7fb568016e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4abd0882595ef9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.024+0000 7fb450ff9640 1 -- 172.21.15.87:0/747087840 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb568026040 con 0x55f9d6be2d30 2024-05-08T18:33:06.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.024+0000 7fb450ff9640 1 -- 172.21.15.87:0/747087840 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb568050070 con 0x55f9d6be2d30 2024-05-08T18:33:06.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.024+0000 7fb450ff9640 1 -- 172.21.15.87:0/747087840 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb568029480 con 0x55f9d6be2d30 2024-05-08T18:33:06.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.025+0000 7fb57172b800 1 -- 172.21.15.87:0/747087840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6be2d30 msgr2=0x55f9d6be3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.025+0000 7fb57172b800 1 --2- 172.21.15.87:0/747087840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6be2d30 0x55f9d6be3150 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb568052a30 tx=0x7fb568016e10 comp rx=0 tx=0).stop 2024-05-08T18:33:06.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.025+0000 7fb57172b800 1 -- 172.21.15.87:0/747087840 shutdown_connections 2024-05-08T18:33:06.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.025+0000 7fb57172b800 1 --2- 172.21.15.87:0/747087840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6be2d30 0x55f9d6be3150 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.025+0000 7fb57172b800 1 -- 172.21.15.87:0/747087840 >> 172.21.15.87:0/747087840 conn(0x55f9d6bdf040 msgr2=0x55f9d6bdd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:06.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.025+0000 7fb57172b800 1 -- 172.21.15.87:0/747087840 shutdown_connections 2024-05-08T18:33:06.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.025+0000 7fb57172b800 1 -- 172.21.15.87:0/747087840 wait complete. 2024-05-08T18:33:06.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.025+0000 7fb57172b800 1 Processor -- start 2024-05-08T18:33:06.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.025+0000 7fb57172b800 1 -- start start 2024-05-08T18:33:06.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.025+0000 7fb57172b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6be2d30 0x55f9d6bea300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.025+0000 7fb57172b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f9d6be3ef0 con 0x55f9d6be2d30 2024-05-08T18:33:06.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.025+0000 7fb56dce9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6be2d30 0x55f9d6bea300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.025+0000 7fb56dce9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6be2d30 0x55f9d6bea300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53136/0 (socket says 172.21.15.87:53136) 2024-05-08T18:33:06.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.025+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 learned_addr learned my addr 172.21.15.87:0/2664733557 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:06.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.026+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d6bea840 con 0x55f9d6be2d30 2024-05-08T18:33:06.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.026+0000 7fb56dce9640 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6be2d30 0x55f9d6bea300 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb568014d30 tx=0x7fb568052990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.026+0000 7fb442ffd640 1 -- 172.21.15.87:0/2664733557 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb568026070 con 0x55f9d6be2d30 2024-05-08T18:33:06.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.026+0000 7fb442ffd640 1 -- 172.21.15.87:0/2664733557 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb568030070 con 0x55f9d6be2d30 2024-05-08T18:33:06.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.026+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9d6beaad0 con 0x55f9d6be2d30 2024-05-08T18:33:06.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.026+0000 7fb442ffd640 1 -- 172.21.15.87:0/2664733557 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb568054410 con 0x55f9d6be2d30 2024-05-08T18:33:06.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.026+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9d6bed780 con 0x55f9d6be2d30 2024-05-08T18:33:06.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.027+0000 7fb442ffd640 1 -- 172.21.15.87:0/2664733557 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb5680186e0 con 0x55f9d6be2d30 2024-05-08T18:33:06.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.027+0000 7fb442ffd640 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb43803bba0 0x7fb43803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.027+0000 7fb442ffd640 1 -- 172.21.15.87:0/2664733557 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fb568004280 con 0x55f9d6be2d30 2024-05-08T18:33:06.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.027+0000 7fb56d4e8640 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb43803bba0 0x7fb43803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.027+0000 7fb56d4e8640 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb43803bba0 0x7fb43803e060 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb560052450 tx=0x7fb56008d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.028+0000 7fb57172b800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.028+0000 7fb57172b800 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f9d6bf5da0 0x55f9d6bf8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.028+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bf89b0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.028+0000 7fb56cce7640 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f9d6bf5da0 0x55f9d6bf8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.028+0000 7fb56cce7640 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f9d6bf5da0 0x55f9d6bf8260 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.028+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb564009050 con 0x55f9d6bf5da0 2024-05-08T18:33:06.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.028+0000 7fb57172b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:06.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.028+0000 7fb57172b800 20 realm 2024-05-08T18:33:06.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.028+0000 7fb57172b800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.028+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bf51f0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb564009050 con 0x55f9d6bf5da0 2024-05-08T18:33:06.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb57172b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:06.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb57172b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:06.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb57172b800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bf94a0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb564009050 con 0x55f9d6bf5da0 2024-05-08T18:33:06.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb57172b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:06.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb57172b800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bf9d70 con 0x55f9d6bf5da0 2024-05-08T18:33:06.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb564009050 con 0x55f9d6bf5da0 2024-05-08T18:33:06.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb57172b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:06.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb57172b800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfa110 con 0x55f9d6bf5da0 2024-05-08T18:33:06.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb564009050 con 0x55f9d6bf5da0 2024-05-08T18:33:06.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb57172b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:06.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb57172b800 20 searching for the correct realm 2024-05-08T18:33:06.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb57172b800 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f9d6bfbff0 0x55f9d6bfe400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x55f9d6bfbff0 2024-05-08T18:33:06.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.029+0000 7fb56dce9640 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f9d6bfbff0 0x55f9d6bfe400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.030+0000 7fb56dce9640 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f9d6bfbff0 0x55f9d6bfe400 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.030+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56804a040 con 0x55f9d6bfbff0 2024-05-08T18:33:06.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.030+0000 7fb56dce9640 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fb568021070 0x7fb5680549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.030+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x7fb568021070 2024-05-08T18:33:06.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.030+0000 7fb56d4e8640 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fb568021070 0x7fb5680549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.030+0000 7fb56d4e8640 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fb568021070 0x7fb5680549d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.031+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb560088040 con 0x7fb568021070 2024-05-08T18:33:06.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.031+0000 7fb56d4e8640 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fb5600a2040 0x7fb56005b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.031+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x7fb5600a2040 2024-05-08T18:33:06.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.031+0000 7fb56cce7640 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fb5600a2040 0x7fb56005b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.031+0000 7fb56cce7640 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fb5600a2040 0x7fb56005b7c0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.031+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb564009050 con 0x7fb5600a2040 2024-05-08T18:33:06.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.031+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.032+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb564009050 con 0x55f9d6bf5da0 2024-05-08T18:33:06.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.032+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.032+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56402a040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.032+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x7fb5600a2040 2024-05-08T18:33:06.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.032+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb56402a040 con 0x7fb5600a2040 2024-05-08T18:33:06.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.032+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x7fb5600a2040 2024-05-08T18:33:06.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.032+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56402a040 con 0x7fb5600a2040 2024-05-08T18:33:06.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.032+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x7fb568021070 2024-05-08T18:33:06.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.033+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb560088040 con 0x7fb568021070 2024-05-08T18:33:06.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.033+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x55f9d6bfbff0 2024-05-08T18:33:06.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.033+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56804a040 con 0x55f9d6bfbff0 2024-05-08T18:33:06.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.033+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.033+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56402a040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.033+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x7fb5600a2040 2024-05-08T18:33:06.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.033+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56402a040 con 0x7fb5600a2040 2024-05-08T18:33:06.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.033+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.034+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56402a040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.034+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x7fb568021070 2024-05-08T18:33:06.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.034+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb560088040 con 0x7fb568021070 2024-05-08T18:33:06.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.034+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x55f9d6bfbff0 2024-05-08T18:33:06.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.034+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56804a040 con 0x55f9d6bfbff0 2024-05-08T18:33:06.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.034+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x55f9d6bfbff0 2024-05-08T18:33:06.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.034+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56804a040 con 0x55f9d6bfbff0 2024-05-08T18:33:06.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.034+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x7fb5600a2040 2024-05-08T18:33:06.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.035+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56402a040 con 0x7fb5600a2040 2024-05-08T18:33:06.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.035+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x55f9d6bfbff0 2024-05-08T18:33:06.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.035+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56804a040 con 0x55f9d6bfbff0 2024-05-08T18:33:06.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.035+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x55f9d6bfbff0 2024-05-08T18:33:06.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.035+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56804a040 con 0x55f9d6bfbff0 2024-05-08T18:33:06.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.035+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.035+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56402a040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.035+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.035+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v29'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fb56402a040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.035+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x7fb5600a2040 2024-05-08T18:33:06.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.036+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56402a040 con 0x7fb5600a2040 2024-05-08T18:33:06.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.036+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x55f9d6bfbff0 2024-05-08T18:33:06.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.036+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56804a040 con 0x55f9d6bfbff0 2024-05-08T18:33:06.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.036+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x7fb568021070 2024-05-08T18:33:06.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.036+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb560088040 con 0x7fb568021070 2024-05-08T18:33:06.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.036+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.036+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56402a040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.036+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x7fb5600a2040 2024-05-08T18:33:06.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.037+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56402a040 con 0x7fb5600a2040 2024-05-08T18:33:06.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.037+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x55f9d6bfbff0 2024-05-08T18:33:06.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.037+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56804a040 con 0x55f9d6bfbff0 2024-05-08T18:33:06.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.037+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x7fb568021070 2024-05-08T18:33:06.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.037+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb560088040 con 0x7fb568021070 2024-05-08T18:33:06.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.037+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x7fb568021070 2024-05-08T18:33:06.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.038+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb560088040 con 0x7fb568021070 2024-05-08T18:33:06.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.038+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x55f9d6bfbff0 2024-05-08T18:33:06.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.038+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb56804a040 con 0x55f9d6bfbff0 2024-05-08T18:33:06.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.038+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x7fb568021070 2024-05-08T18:33:06.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.038+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb560088040 con 0x7fb568021070 2024-05-08T18:33:06.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.038+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.038+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb56402a040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.038+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfead0 con 0x7fb568021070 2024-05-08T18:33:06.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.038+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb560088040 con 0x7fb568021070 2024-05-08T18:33:06.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.038+0000 7fb57172b800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:06.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.038+0000 7fb57172b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:06.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.038+0000 7fb57172b800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:06.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.038+0000 7fb57172b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:06.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.038+0000 7fb57172b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:06.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.038+0000 7fb57172b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:06.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.038+0000 7fb57172b800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.038+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfaa60 con 0x55f9d6bf5da0 2024-05-08T18:33:06.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.039+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb56402a040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.039+0000 7fb57172b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:06.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.039+0000 7fb57172b800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.039+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfb300 con 0x55f9d6bf5da0 2024-05-08T18:33:06.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.039+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb56402a040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.039+0000 7fb57172b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:06.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.039+0000 7fb57172b800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.039+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bfef50 con 0x7fb5600a2040 2024-05-08T18:33:06.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb56402a040 con 0x7fb5600a2040 2024-05-08T18:33:06.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:06.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 20 zone default found 2024-05-08T18:33:06.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 4 Realm: () 2024-05-08T18:33:06.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:06.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:06.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:06.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 20 zonegroup default 2024-05-08T18:33:06.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bff400 con 0x7fb5600a2040 2024-05-08T18:33:06.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb56402a040 con 0x7fb5600a2040 2024-05-08T18:33:06.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:06.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c00de0 con 0x55f9d6bfbff0 2024-05-08T18:33:06.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb56804a040 con 0x55f9d6bfbff0 2024-05-08T18:33:06.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:06.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c01270 con 0x55f9d6bfbff0 2024-05-08T18:33:06.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb56804a040 con 0x55f9d6bfbff0 2024-05-08T18:33:06.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:06.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 20 started sync module instance, tier type = 2024-05-08T18:33:06.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:06.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.040+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c00270 con 0x7fb568021070 2024-05-08T18:33:06.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.041+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb560088040 con 0x7fb568021070 2024-05-08T18:33:06.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.041+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94531538126432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6bffed0 con 0x7fb568021070 2024-05-08T18:33:06.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.041+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c021a0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.042+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94531538126432] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb560088040 con 0x7fb568021070 2024-05-08T18:33:06.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.042+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb56402a040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.042+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94531538132208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c025c0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.043+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c02f80 con 0x55f9d6bfbff0 2024-05-08T18:33:06.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.044+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb56804a040 con 0x55f9d6bfbff0 2024-05-08T18:33:06.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.044+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94531538135760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c033e0 con 0x55f9d6bfbff0 2024-05-08T18:33:06.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.044+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c03f00 con 0x7fb568021070 2024-05-08T18:33:06.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.044+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94531538132208] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb56402a040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.045+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94531538135760] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb56804a040 con 0x55f9d6bfbff0 2024-05-08T18:33:06.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.045+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb560088040 con 0x7fb568021070 2024-05-08T18:33:06.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.045+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94531538139600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c02ef0 con 0x7fb568021070 2024-05-08T18:33:06.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.045+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c04910 con 0x55f9d6bf5da0 2024-05-08T18:33:06.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.046+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb56402a040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.046+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94531538142576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c04fc0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.046+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c05ae0 con 0x7fb5600a2040 2024-05-08T18:33:06.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.046+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94531538139600] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb560088040 con 0x7fb568021070 2024-05-08T18:33:06.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.047+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb56402a040 con 0x7fb5600a2040 2024-05-08T18:33:06.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.047+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94531538146736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c05aa0 con 0x7fb5600a2040 2024-05-08T18:33:06.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.047+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94531538142576] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb56402a040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.047+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c064f0 con 0x7fb5600a2040 2024-05-08T18:33:06.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.048+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94531538146736] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb56402a040 con 0x7fb5600a2040 2024-05-08T18:33:06.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.048+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb56402a040 con 0x7fb5600a2040 2024-05-08T18:33:06.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.048+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94531538133264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c06040 con 0x7fb5600a2040 2024-05-08T18:33:06.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.048+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c06dc0 con 0x7fb5600a2040 2024-05-08T18:33:06.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.049+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94531538133264] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb56402a040 con 0x7fb5600a2040 2024-05-08T18:33:06.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.049+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb56402a040 con 0x7fb5600a2040 2024-05-08T18:33:06.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.049+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94531538143760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c06040 con 0x7fb5600a2040 2024-05-08T18:33:06.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.049+0000 7fb57172b800 20 add_watcher() i=0 2024-05-08T18:33:06.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.049+0000 7fb57172b800 20 add_watcher() i=1 2024-05-08T18:33:06.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.049+0000 7fb57172b800 20 add_watcher() i=2 2024-05-08T18:33:06.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.049+0000 7fb57172b800 20 add_watcher() i=3 2024-05-08T18:33:06.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.049+0000 7fb57172b800 20 add_watcher() i=4 2024-05-08T18:33:06.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.049+0000 7fb57172b800 20 add_watcher() i=5 2024-05-08T18:33:06.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.049+0000 7fb57172b800 20 add_watcher() i=6 2024-05-08T18:33:06.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.050+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94531538143760] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb56402a040 con 0x7fb5600a2040 2024-05-08T18:33:06.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.050+0000 7fb57172b800 20 add_watcher() i=7 2024-05-08T18:33:06.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.050+0000 7fb57172b800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:06.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.050+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c09df0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.050+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb56402a040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.050+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94531538151696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c072b0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.051+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94531538151696] v29'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb56402a040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.052+0000 7fb4237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:06.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.052+0000 7fb57172b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:06.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.052+0000 7fb57172b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:06.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.052+0000 7fb57172b800 5 note: GC not initialized 2024-05-08T18:33:06.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.052+0000 7fb4227e4640 20 reqs_thread_entry: start 2024-05-08T18:33:06.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.052+0000 7fb57172b800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:06.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.052+0000 7fb57172b800 20 Filter name: none 2024-05-08T18:33:06.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.052+0000 7fb393fff640 20 reqs_thread_entry: start 2024-05-08T18:33:06.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.052+0000 7fb57172b800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:33:06.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.052+0000 7fb57172b800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.052+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c3d2e0 con 0x7fb5600a2040 2024-05-08T18:33:06.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.053+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fb56402a040 con 0x7fb5600a2040 2024-05-08T18:33:06.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.053+0000 7fb57172b800 20 rados_obj.operate() r=0 bl.length=460 2024-05-08T18:33:06.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.053+0000 7fb57172b800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:33:06.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.053+0000 7fb57172b800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:06.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.053+0000 7fb57172b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:33:06.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.053+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c43810 con 0x7fb5600a2040 2024-05-08T18:33:06.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.054+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v29'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb564049040 con 0x7fb5600a2040 2024-05-08T18:33:06.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.054+0000 7fb57172b800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:06.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.054+0000 7fb57172b800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:06.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.054+0000 7fb57172b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:33:06.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.054+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94531538399696 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c3ee50 con 0x55f9d6bf5da0 2024-05-08T18:33:06.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.055+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== watch-notify(notify (1) cookie 94531538142576 notify 124554051614 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55f9d6a32660 con 0x55f9d6bf5da0 2024-05-08T18:33:06.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.055+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 notify.4 [notify cookie 94531538399696 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb564049040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.055+0000 7fb450ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051614 cookie 94531538142576 notifier 4907 bl.length()=649 2024-05-08T18:33:06.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.055+0000 7fb450ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:06.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.055+0000 7fb450ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:06.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.055+0000 7fb450ff9640 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fb430003ea0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.055+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb564049040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.055+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== watch-notify(notify_complete (2) cookie 94531538399696 notify 124554051614 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb56403f660 con 0x55f9d6bf5da0 2024-05-08T18:33:06.077 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:33:04.270799Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:33:04.270781Z","tags":[],"group_ids":[]} 2024-05-08T18:33:06.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.056+0000 7fb4237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:06.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.056+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94531538151696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c3f610 con 0x55f9d6bf5da0 2024-05-08T18:33:06.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.057+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94531538151696] v29'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb564049040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.057+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94531538126432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c3f610 con 0x7fb568021070 2024-05-08T18:33:06.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.058+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94531538126432] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb560088040 con 0x7fb568021070 2024-05-08T18:33:06.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.058+0000 7fb57172b800 20 remove_watcher() i=0 2024-05-08T18:33:06.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.058+0000 7fb57172b800 2 removed watcher, disabling cache 2024-05-08T18:33:06.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.058+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94531538132208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c3f610 con 0x55f9d6bf5da0 2024-05-08T18:33:06.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.059+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94531538132208] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb564049040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.059+0000 7fb57172b800 20 remove_watcher() i=1 2024-05-08T18:33:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.059+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94531538135760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c3f610 con 0x55f9d6bfbff0 2024-05-08T18:33:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.060+0000 7fb56dce9640 1 -- 172.21.15.87:0/2664733557 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94531538135760] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb56804a040 con 0x55f9d6bfbff0 2024-05-08T18:33:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.060+0000 7fb57172b800 20 remove_watcher() i=2 2024-05-08T18:33:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.060+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94531538139600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c00660 con 0x7fb568021070 2024-05-08T18:33:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.061+0000 7fb56d4e8640 1 -- 172.21.15.87:0/2664733557 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94531538139600] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb560088040 con 0x7fb568021070 2024-05-08T18:33:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.061+0000 7fb57172b800 20 remove_watcher() i=3 2024-05-08T18:33:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.061+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94531538142576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c01cf0 con 0x55f9d6bf5da0 2024-05-08T18:33:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.062+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94531538142576] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb564049040 con 0x55f9d6bf5da0 2024-05-08T18:33:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.062+0000 7fb57172b800 20 remove_watcher() i=4 2024-05-08T18:33:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.063+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94531538146736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c02ad0 con 0x7fb5600a2040 2024-05-08T18:33:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.063+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94531538146736] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb564049040 con 0x7fb5600a2040 2024-05-08T18:33:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.063+0000 7fb57172b800 20 remove_watcher() i=5 2024-05-08T18:33:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.063+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94531538133264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c00660 con 0x7fb5600a2040 2024-05-08T18:33:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.064+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94531538133264] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb564049040 con 0x7fb5600a2040 2024-05-08T18:33:06.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.064+0000 7fb57172b800 20 remove_watcher() i=6 2024-05-08T18:33:06.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.064+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94531538143760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f9d6c04570 con 0x7fb5600a2040 2024-05-08T18:33:06.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.065+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94531538143760] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb564049040 con 0x7fb5600a2040 2024-05-08T18:33:06.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.065+0000 7fb57172b800 20 remove_watcher() i=7 2024-05-08T18:33:06.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.065+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fb5600a2040 msgr2=0x7fb56005b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.065+0000 7fb57172b800 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7fb5600a2040 0x7fb56005b7c0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.065+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f9d6bf5da0 msgr2=0x55f9d6bf8260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.065+0000 7fb57172b800 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f9d6bf5da0 0x55f9d6bf8260 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.065+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fb568021070 msgr2=0x7fb5680549d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.065+0000 7fb57172b800 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7fb568021070 0x7fb5680549d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.065+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f9d6bfbff0 msgr2=0x55f9d6bfe400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.065+0000 7fb57172b800 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x55f9d6bfbff0 0x55f9d6bfe400 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb43803bba0 msgr2=0x7fb43803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb43803bba0 0x7fb43803e060 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb560052450 tx=0x7fb56008d000 comp rx=0 tx=0).stop 2024-05-08T18:33:06.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6be2d30 msgr2=0x55f9d6bea300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb56cce7640 1 -- 172.21.15.87:0/2664733557 reap_dead start 2024-05-08T18:33:06.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6be2d30 0x55f9d6bea300 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb568014d30 tx=0x7fb568052990 comp rx=0 tx=0).stop 2024-05-08T18:33:06.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 shutdown_connections 2024-05-08T18:33:06.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 --2- 172.21.15.87:0/2664733557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6be2d30 0x55f9d6bea300 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 >> 172.21.15.87:0/2664733557 conn(0x55f9d6bdf040 msgr2=0x55f9d6bdc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:06.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 shutdown_connections 2024-05-08T18:33:06.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 -- 172.21.15.87:0/2664733557 wait complete. 2024-05-08T18:33:06.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 -- 172.21.15.87:0/768861629 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb44403bba0 msgr2=0x7fb44403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 --2- 172.21.15.87:0/768861629 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb44403bba0 0x7fb44403e060 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb56006f000 tx=0x7fb56005df10 comp rx=0 tx=0).stop 2024-05-08T18:33:06.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 -- 172.21.15.87:0/768861629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6bd5a90 msgr2=0x55f9d6bd5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 --2- 172.21.15.87:0/768861629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6bd5a90 0x55f9d6bd5eb0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x55f9d6bbb960 tx=0x7fb56800ef30 comp rx=0 tx=0).stop 2024-05-08T18:33:06.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 -- 172.21.15.87:0/768861629 shutdown_connections 2024-05-08T18:33:06.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 --2- 172.21.15.87:0/768861629 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb44403bba0 0x7fb44403e060 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 --2- 172.21.15.87:0/768861629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6bd5a90 0x55f9d6bd5eb0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 -- 172.21.15.87:0/768861629 >> 172.21.15.87:0/768861629 conn(0x55f9d6bc9b30 msgr2=0x55f9d6bc9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:06.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 -- 172.21.15.87:0/768861629 shutdown_connections 2024-05-08T18:33:06.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.066+0000 7fb57172b800 1 -- 172.21.15.87:0/768861629 wait complete. 2024-05-08T18:33:06.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.067+0000 7fb57172b800 1 -- 172.21.15.87:0/2744544985 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f9d6bc4ee0 msgr2=0x55f9d6bc72d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.067+0000 7fb57172b800 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f9d6bc4ee0 0x55f9d6bc72d0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.067+0000 7fb57172b800 1 -- 172.21.15.87:0/2744544985 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f9d6abe4d0 msgr2=0x55f9d6bc17a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.067+0000 7fb57172b800 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f9d6abe4d0 0x55f9d6bc17a0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.067+0000 7fb57172b800 1 -- 172.21.15.87:0/2744544985 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb45403bba0 msgr2=0x7fb45403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.067+0000 7fb57172b800 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb45403bba0 0x7fb45403e060 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb564000f60 tx=0x7fb5640012b0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.067+0000 7fb57172b800 1 -- 172.21.15.87:0/2744544985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 msgr2=0x55f9d6bba560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.067+0000 7fb57172b800 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 0x55f9d6bba560 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb5600526d0 tx=0x7fb560003330 comp rx=0 tx=0).stop 2024-05-08T18:33:06.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.067+0000 7fb57172b800 1 -- 172.21.15.87:0/2744544985 shutdown_connections 2024-05-08T18:33:06.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.067+0000 7fb57172b800 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x55f9d6abe4d0 0x55f9d6bc17a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.067+0000 7fb57172b800 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x55f9d6bc4ee0 0x55f9d6bc72d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.067+0000 7fb57172b800 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fb45403bba0 0x7fb45403e060 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.067+0000 7fb57172b800 1 --2- 172.21.15.87:0/2744544985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9d6abdb70 0x55f9d6bba560 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.067+0000 7fb57172b800 1 -- 172.21.15.87:0/2744544985 >> 172.21.15.87:0/2744544985 conn(0x55f9d6ab9730 msgr2=0x55f9d6bacbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:06.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.067+0000 7fb57172b800 1 -- 172.21.15.87:0/2744544985 shutdown_connections 2024-05-08T18:33:06.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.067+0000 7fb57172b800 1 -- 172.21.15.87:0/2744544985 wait complete. 2024-05-08T18:33:06.088 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:06.089 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:06.089 ERROR:root:0 2024-05-08T18:33:06.089 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:33:06.089 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:33:06.089 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-08T18:33:06.135 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:33:06.136 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:33:06.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.138+0000 7f90fac3f800 1 Processor -- start 2024-05-08T18:33:06.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.138+0000 7f90fac3f800 1 -- start start 2024-05-08T18:33:06.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.138+0000 7f90fac3f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563579aa2650 0x563579aa2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.138+0000 7f90fac3f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563579aa30f0 con 0x563579aa33d0 2024-05-08T18:33:06.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.138+0000 7f90fac3f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x563579943e20 con 0x563579aa2650 2024-05-08T18:33:06.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.138+0000 7f90f8737640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563579aa2650 0x563579aa2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.138+0000 7f90f8737640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563579aa2650 0x563579aa2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53146/0 (socket says 172.21.15.87:53146) 2024-05-08T18:33:06.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.138+0000 7f90f8737640 1 -- 172.21.15.87:0/3050781129 learned_addr learned my addr 172.21.15.87:0/3050781129 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:06.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.138+0000 7f90f7f36640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x563579aa33d0 0x563579aa3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:58264/0 (socket says 172.21.15.87:58264) 2024-05-08T18:33:06.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.139+0000 7f90f8737640 1 -- 172.21.15.87:0/3050781129 >> v1:172.21.15.53:6789/0 conn(0x563579aa33d0 legacy=0x563579aa3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.139+0000 7f90f8737640 1 -- 172.21.15.87:0/3050781129 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563579aa3f90 con 0x563579aa2650 2024-05-08T18:33:06.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.140+0000 7f90f8737640 1 --2- 172.21.15.87:0/3050781129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 0x563579aa2a70 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f90e8005fd0 tx=0x7f90e801cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e446206edee1a7ba server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.141+0000 7f90f7735640 1 -- 172.21.15.87:0/3050781129 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e8052540 con 0x563579aa2650 2024-05-08T18:33:06.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.141+0000 7f90f7735640 1 -- 172.21.15.87:0/3050781129 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e804e070 con 0x563579aa2650 2024-05-08T18:33:06.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.141+0000 7f90f7735640 1 -- 172.21.15.87:0/3050781129 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e8052890 con 0x563579aa2650 2024-05-08T18:33:06.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.141+0000 7f90fac3f800 1 -- 172.21.15.87:0/3050781129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 msgr2=0x563579aa2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.141+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3050781129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 0x563579aa2a70 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f90e8005fd0 tx=0x7f90e801cd80 comp rx=0 tx=0).stop 2024-05-08T18:33:06.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.141+0000 7f90fac3f800 1 -- 172.21.15.87:0/3050781129 shutdown_connections 2024-05-08T18:33:06.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.141+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3050781129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 0x563579aa2a70 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.141+0000 7f90fac3f800 1 -- 172.21.15.87:0/3050781129 >> 172.21.15.87:0/3050781129 conn(0x563579a9ceb0 msgr2=0x563579a9f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:06.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.141+0000 7f90fac3f800 1 -- 172.21.15.87:0/3050781129 shutdown_connections 2024-05-08T18:33:06.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.141+0000 7f90fac3f800 1 -- 172.21.15.87:0/3050781129 wait complete. 2024-05-08T18:33:06.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.155+0000 7f90fac3f800 1 Processor -- start 2024-05-08T18:33:06.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.155+0000 7f90fac3f800 1 -- start start 2024-05-08T18:33:06.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.155+0000 7f90fac3f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 0x563579aa1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.155+0000 7f90fac3f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5635799ee5c0 con 0x563579aa2650 2024-05-08T18:33:06.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.156+0000 7f90f8737640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 0x563579aa1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.156+0000 7f90f8737640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 0x563579aa1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53148/0 (socket says 172.21.15.87:53148) 2024-05-08T18:33:06.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.156+0000 7f90f8737640 1 -- 172.21.15.87:0/791388547 learned_addr learned my addr 172.21.15.87:0/791388547 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:06.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.156+0000 7f90f8737640 1 -- 172.21.15.87:0/791388547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563579b95270 con 0x563579aa2650 2024-05-08T18:33:06.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.156+0000 7f90f8737640 1 --2- 172.21.15.87:0/791388547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 0x563579aa1d50 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f90e801ba70 tx=0x7f90e804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331fb32dffdb0d09 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.156+0000 7f8fe660c640 1 -- 172.21.15.87:0/791388547 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e8052820 con 0x563579aa2650 2024-05-08T18:33:06.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.156+0000 7f8fe660c640 1 -- 172.21.15.87:0/791388547 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e8062070 con 0x563579aa2650 2024-05-08T18:33:06.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.156+0000 7f8fe660c640 1 -- 172.21.15.87:0/791388547 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e8052b10 con 0x563579aa2650 2024-05-08T18:33:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.157+0000 7f90fac3f800 1 -- 172.21.15.87:0/791388547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 msgr2=0x563579aa1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.157+0000 7f90fac3f800 1 --2- 172.21.15.87:0/791388547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 0x563579aa1d50 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f90e801ba70 tx=0x7f90e804c000 comp rx=0 tx=0).stop 2024-05-08T18:33:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.157+0000 7f90fac3f800 1 -- 172.21.15.87:0/791388547 shutdown_connections 2024-05-08T18:33:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.157+0000 7f90fac3f800 1 --2- 172.21.15.87:0/791388547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 0x563579aa1d50 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.157+0000 7f90fac3f800 1 -- 172.21.15.87:0/791388547 >> 172.21.15.87:0/791388547 conn(0x563579a9ceb0 msgr2=0x563579b8ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.157+0000 7f90fac3f800 1 -- 172.21.15.87:0/791388547 shutdown_connections 2024-05-08T18:33:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.157+0000 7f90fac3f800 1 -- 172.21.15.87:0/791388547 wait complete. 2024-05-08T18:33:06.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.157+0000 7f90fac3f800 1 Processor -- start 2024-05-08T18:33:06.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.158+0000 7f90fac3f800 1 -- start start 2024-05-08T18:33:06.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.158+0000 7f90fac3f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 0x563579b9e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.158+0000 7f90fac3f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563579aab8a0 con 0x563579aa2650 2024-05-08T18:33:06.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.158+0000 7f90f8737640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 0x563579b9e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.158+0000 7f90f8737640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 0x563579b9e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53158/0 (socket says 172.21.15.87:53158) 2024-05-08T18:33:06.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.158+0000 7f90f8737640 1 -- 172.21.15.87:0/3181155532 learned_addr learned my addr 172.21.15.87:0/3181155532 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:06.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.158+0000 7f90f8737640 1 -- 172.21.15.87:0/3181155532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563579b9e930 con 0x563579aa2650 2024-05-08T18:33:06.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.158+0000 7f90f8737640 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 0x563579b9e3f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f90e805f040 tx=0x7f90e8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.158+0000 7f8fe4e09640 1 -- 172.21.15.87:0/3181155532 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e8071570 con 0x563579aa2650 2024-05-08T18:33:06.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.158+0000 7f8fe4e09640 1 -- 172.21.15.87:0/3181155532 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e8058040 con 0x563579aa2650 2024-05-08T18:33:06.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.158+0000 7f8fe4e09640 1 -- 172.21.15.87:0/3181155532 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90e8071880 con 0x563579aa2650 2024-05-08T18:33:06.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.158+0000 7f90fac3f800 1 -- 172.21.15.87:0/3181155532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563579b9ebc0 con 0x563579aa2650 2024-05-08T18:33:06.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.159+0000 7f90fac3f800 1 -- 172.21.15.87:0/3181155532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563579ba1870 con 0x563579aa2650 2024-05-08T18:33:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.159+0000 7f8fe4e09640 1 -- 172.21.15.87:0/3181155532 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f90e8050070 con 0x563579aa2650 2024-05-08T18:33:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.159+0000 7f8fe4e09640 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8fe003bb50 0x7f8fe003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.160+0000 7f8fe4e09640 1 -- 172.21.15.87:0/3181155532 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f90e8094a80 con 0x563579aa2650 2024-05-08T18:33:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.160+0000 7f90f7f36640 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8fe003bb50 0x7f8fe003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.160+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563579aa33d0 0x563579ba5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.160+0000 7f90fac3f800 1 -- 172.21.15.87:0/3181155532 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579ba5c00 con 0x563579aa33d0 2024-05-08T18:33:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.160+0000 7f90f8f38640 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563579aa33d0 0x563579ba5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.160+0000 7f90f7f36640 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8fe003bb50 0x7f8fe003e010 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f90ec000f60 tx=0x7f90ec001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.160+0000 7f90f8f38640 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563579aa33d0 0x563579ba5630 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.160+0000 7f90f8f38640 1 -- 172.21.15.87:0/3181155532 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90f00083e0 con 0x563579aa33d0 2024-05-08T18:33:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.160+0000 7f90fac3f800 1 -- 172.21.15.87:0/3181155532 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579ba2be0 con 0x563579aa33d0 2024-05-08T18:33:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.161+0000 7f90f8f38640 1 -- 172.21.15.87:0/3181155532 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90f00083e0 con 0x563579aa33d0 2024-05-08T18:33:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.161+0000 7f90fac3f800 1 -- 172.21.15.87:0/3181155532 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579ba7a30 con 0x563579aa33d0 2024-05-08T18:33:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.161+0000 7f90f8f38640 1 -- 172.21.15.87:0/3181155532 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f90f00083e0 con 0x563579aa33d0 2024-05-08T18:33:06.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.161+0000 7f90fac3f800 1 -- 172.21.15.87:0/3181155532 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579ba6c60 con 0x563579aa33d0 2024-05-08T18:33:06.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.161+0000 7f90f8f38640 1 -- 172.21.15.87:0/3181155532 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90f00083e0 con 0x563579aa33d0 2024-05-08T18:33:06.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.161+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563579ba8de0 0x563579bab1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.161+0000 7f90fac3f800 1 -- 172.21.15.87:0/3181155532 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579bab710 con 0x563579ba8de0 2024-05-08T18:33:06.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.161+0000 7f90f8737640 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563579ba8de0 0x563579bab1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.162+0000 7f90f8737640 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563579ba8de0 0x563579bab1d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.162+0000 7f90f8737640 1 -- 172.21.15.87:0/3181155532 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f90e8077020 con 0x563579ba8de0 2024-05-08T18:33:06.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.162+0000 7f90fac3f800 1 Processor -- start 2024-05-08T18:33:06.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.162+0000 7f90fac3f800 1 -- start start 2024-05-08T18:33:06.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.163+0000 7f90fac3f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bb9990 0x563579bb9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.163+0000 7f90fac3f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563579994fc0 con 0x563579bb9990 2024-05-08T18:33:06.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.163+0000 7f90f8f38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bb9990 0x563579bb9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.163+0000 7f90f8f38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bb9990 0x563579bb9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53172/0 (socket says 172.21.15.87:53172) 2024-05-08T18:33:06.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.163+0000 7f90f8f38640 1 -- 172.21.15.87:0/2428584595 learned_addr learned my addr 172.21.15.87:0/2428584595 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:06.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.163+0000 7f90f8f38640 1 -- 172.21.15.87:0/2428584595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563579bba2f0 con 0x563579bb9990 2024-05-08T18:33:06.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.163+0000 7f90f8f38640 1 --2- 172.21.15.87:0/2428584595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bb9990 0x563579bb9db0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x563579b9f2c0 tx=0x7f90f000ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.163+0000 7f8fddffb640 1 -- 172.21.15.87:0/2428584595 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f001c070 con 0x563579bb9990 2024-05-08T18:33:06.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.163+0000 7f8fddffb640 1 -- 172.21.15.87:0/2428584595 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f0018410 con 0x563579bb9990 2024-05-08T18:33:06.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.163+0000 7f90fac3f800 1 -- 172.21.15.87:0/2428584595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563579bbad60 con 0x563579bb9990 2024-05-08T18:33:06.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.163+0000 7f8fddffb640 1 -- 172.21.15.87:0/2428584595 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f0018730 con 0x563579bb9990 2024-05-08T18:33:06.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.164+0000 7f90fac3f800 1 -- 172.21.15.87:0/2428584595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563579bbb260 con 0x563579bb9990 2024-05-08T18:33:06.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.164+0000 7f8fddffb640 1 -- 172.21.15.87:0/2428584595 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f90f001f070 con 0x563579bb9990 2024-05-08T18:33:06.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.164+0000 7f8fddffb640 1 --2- 172.21.15.87:0/2428584595 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8fd003bba0 0x7f8fd003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.165+0000 7f8fddffb640 1 -- 172.21.15.87:0/2428584595 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f90f0054670 con 0x563579bb9990 2024-05-08T18:33:06.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.165+0000 7f90f8737640 1 --2- 172.21.15.87:0/2428584595 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8fd003bba0 0x7f8fd003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.165+0000 7f90fac3f800 1 Processor -- start 2024-05-08T18:33:06.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.165+0000 7f90f8737640 1 --2- 172.21.15.87:0/2428584595 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8fd003bba0 0x7f8fd003e060 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f90e8065fd0 tx=0x7f90e8065380 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.165+0000 7f90fac3f800 1 -- start start 2024-05-08T18:33:06.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.165+0000 7f90fac3f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bc6ce0 0x563579bc7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.165+0000 7f90fac3f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563579b99940 con 0x563579bc6ce0 2024-05-08T18:33:06.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.165+0000 7f90f8f38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bc6ce0 0x563579bc7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.165+0000 7f90f8f38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bc6ce0 0x563579bc7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53178/0 (socket says 172.21.15.87:53178) 2024-05-08T18:33:06.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.165+0000 7f90f8f38640 1 -- 172.21.15.87:0/1727424622 learned_addr learned my addr 172.21.15.87:0/1727424622 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:06.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.165+0000 7f90f8f38640 1 -- 172.21.15.87:0/1727424622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563579bc76d0 con 0x563579bc6ce0 2024-05-08T18:33:06.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.166+0000 7f90f8f38640 1 --2- 172.21.15.87:0/1727424622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bc6ce0 0x563579bc7100 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f90f00402f0 tx=0x7f90f00403e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82be044c0722739f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.166+0000 7f8fd77fe640 1 -- 172.21.15.87:0/1727424622 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f0026070 con 0x563579bc6ce0 2024-05-08T18:33:06.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.166+0000 7f8fd77fe640 1 -- 172.21.15.87:0/1727424622 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f001fc40 con 0x563579bc6ce0 2024-05-08T18:33:06.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.166+0000 7f8fd77fe640 1 -- 172.21.15.87:0/1727424622 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f00173a0 con 0x563579bc6ce0 2024-05-08T18:33:06.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.166+0000 7f90fac3f800 1 -- 172.21.15.87:0/1727424622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bc6ce0 msgr2=0x563579bc7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.166+0000 7f90fac3f800 1 --2- 172.21.15.87:0/1727424622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bc6ce0 0x563579bc7100 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f90f00402f0 tx=0x7f90f00403e0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.166+0000 7f90fac3f800 1 -- 172.21.15.87:0/1727424622 shutdown_connections 2024-05-08T18:33:06.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.166+0000 7f90fac3f800 1 --2- 172.21.15.87:0/1727424622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bc6ce0 0x563579bc7100 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.166+0000 7f90fac3f800 1 -- 172.21.15.87:0/1727424622 >> 172.21.15.87:0/1727424622 conn(0x563579bc2f60 msgr2=0x563579bc1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:06.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.166+0000 7f90fac3f800 1 -- 172.21.15.87:0/1727424622 shutdown_connections 2024-05-08T18:33:06.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.166+0000 7f90fac3f800 1 -- 172.21.15.87:0/1727424622 wait complete. 2024-05-08T18:33:06.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.167+0000 7f90fac3f800 1 Processor -- start 2024-05-08T18:33:06.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.167+0000 7f90fac3f800 1 -- start start 2024-05-08T18:33:06.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.167+0000 7f90fac3f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bc6ce0 0x563579bce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.167+0000 7f90fac3f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563579bc7e20 con 0x563579bc6ce0 2024-05-08T18:33:06.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.167+0000 7f90f8f38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bc6ce0 0x563579bce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.167+0000 7f90f8f38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bc6ce0 0x563579bce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53192/0 (socket says 172.21.15.87:53192) 2024-05-08T18:33:06.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.167+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 learned_addr learned my addr 172.21.15.87:0/3832627453 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:33:06.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.167+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563579bce730 con 0x563579bc6ce0 2024-05-08T18:33:06.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.167+0000 7f90f8f38640 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bc6ce0 0x563579bce1f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f90f00518e0 tx=0x7f90f0052950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.167+0000 7f8fd5ffb640 1 -- 172.21.15.87:0/3832627453 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f002f070 con 0x563579bc6ce0 2024-05-08T18:33:06.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.168+0000 7f8fd5ffb640 1 -- 172.21.15.87:0/3832627453 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f004a040 con 0x563579bc6ce0 2024-05-08T18:33:06.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.168+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563579bce9c0 con 0x563579bc6ce0 2024-05-08T18:33:06.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.168+0000 7f8fd5ffb640 1 -- 172.21.15.87:0/3832627453 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f0051190 con 0x563579bc6ce0 2024-05-08T18:33:06.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.168+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563579bce9c0 con 0x563579bc6ce0 2024-05-08T18:33:06.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.168+0000 7f8fd5ffb640 1 -- 172.21.15.87:0/3832627453 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f90f0032070 con 0x563579bc6ce0 2024-05-08T18:33:06.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.169+0000 7f8fd5ffb640 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8fc803bba0 0x7f8fc803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.169+0000 7f8fd5ffb640 1 -- 172.21.15.87:0/3832627453 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f90f0035d70 con 0x563579bc6ce0 2024-05-08T18:33:06.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.169+0000 7f90f8737640 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8fc803bba0 0x7f8fc803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.169+0000 7f90f8737640 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8fc803bba0 0x7f8fc803e060 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f90e8052c10 tx=0x7f90e8086000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.169+0000 7f90fac3f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.169+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563579bd9b90 0x563579bdc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.169+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579bdc7a0 con 0x563579bd9b90 2024-05-08T18:33:06.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.170+0000 7f90f7f36640 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563579bd9b90 0x563579bdc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.170+0000 7f90f7f36640 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563579bd9b90 0x563579bdc050 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.170+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.170+0000 7f90fac3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:06.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.170+0000 7f90fac3f800 20 realm 2024-05-08T18:33:06.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.170+0000 7f90fac3f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.170+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579bd8fe0 con 0x563579bd9b90 2024-05-08T18:33:06.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.170+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.170+0000 7f90fac3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:06.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.170+0000 7f90fac3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:33:06.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.170+0000 7f90fac3f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.170+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579bdd290 con 0x563579bd9b90 2024-05-08T18:33:06.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.171+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.171+0000 7f90fac3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:06.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.171+0000 7f90fac3f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.171+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579bddb60 con 0x563579bd9b90 2024-05-08T18:33:06.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.171+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.171+0000 7f90fac3f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:06.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.171+0000 7f90fac3f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.171+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579bddf00 con 0x563579bd9b90 2024-05-08T18:33:06.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.171+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.171+0000 7f90fac3f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:33:06.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.171+0000 7f90fac3f800 20 searching for the correct realm 2024-05-08T18:33:06.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.171+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563579bdfde0 0x563579be2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.171+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x563579bdfde0 2024-05-08T18:33:06.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.171+0000 7f90f8f38640 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563579bdfde0 0x563579be2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.171+0000 7f90f8f38640 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563579bdfde0 0x563579be2210 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.172+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f0031030 con 0x563579bdfde0 2024-05-08T18:33:06.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.172+0000 7f90f8f38640 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f90f0034070 0x7f90f001f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.172+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x7f90f0034070 2024-05-08T18:33:06.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.172+0000 7f90f8737640 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f90f0034070 0x7f90f001f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.172+0000 7f90f8737640 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f90f0034070 0x7f90f001f360 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.173+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e8077020 con 0x7f90f0034070 2024-05-08T18:33:06.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.173+0000 7f90f8737640 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f90e80a1040 0x7f90e80703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:33:06.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.173+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x7f90e80a1040 2024-05-08T18:33:06.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.173+0000 7f90f7f36640 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f90e80a1040 0x7f90e80703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:33:06.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.173+0000 7f90f7f36640 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f90e80a1040 0x7f90e80703e0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:33:06.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.173+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.173+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x563579bd9b90 2024-05-08T18:33:06.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.174+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.174+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x563579bd9b90 2024-05-08T18:33:06.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.174+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.174+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x7f90e80a1040 2024-05-08T18:33:06.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.174+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.174+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x7f90e80a1040 2024-05-08T18:33:06.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.174+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.174+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x7f90f0034070 2024-05-08T18:33:06.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.175+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e8077020 con 0x7f90f0034070 2024-05-08T18:33:06.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.175+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x563579bdfde0 2024-05-08T18:33:06.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.175+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f0031030 con 0x563579bdfde0 2024-05-08T18:33:06.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.175+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x563579bd9b90 2024-05-08T18:33:06.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.175+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.175+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x7f90e80a1040 2024-05-08T18:33:06.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.175+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.175+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x563579bd9b90 2024-05-08T18:33:06.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.175+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.175+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x7f90f0034070 2024-05-08T18:33:06.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.176+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f90e8077020 con 0x7f90f0034070 2024-05-08T18:33:06.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.176+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x563579bdfde0 2024-05-08T18:33:06.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.176+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f0031030 con 0x563579bdfde0 2024-05-08T18:33:06.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.176+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x563579bdfde0 2024-05-08T18:33:06.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.176+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f0031030 con 0x563579bdfde0 2024-05-08T18:33:06.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.176+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x7f90e80a1040 2024-05-08T18:33:06.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.176+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.176+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x563579bdfde0 2024-05-08T18:33:06.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.177+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f0031030 con 0x563579bdfde0 2024-05-08T18:33:06.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.177+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x563579bdfde0 2024-05-08T18:33:06.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.177+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f0031030 con 0x563579bdfde0 2024-05-08T18:33:06.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.177+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x563579bd9b90 2024-05-08T18:33:06.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.177+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.177+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x563579bd9b90 2024-05-08T18:33:06.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.177+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v29'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.177+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x7f90e80a1040 2024-05-08T18:33:06.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.177+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.177+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x563579bdfde0 2024-05-08T18:33:06.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.178+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f0031030 con 0x563579bdfde0 2024-05-08T18:33:06.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.178+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x7f90f0034070 2024-05-08T18:33:06.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.178+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e8077020 con 0x7f90f0034070 2024-05-08T18:33:06.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.178+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x563579bd9b90 2024-05-08T18:33:06.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.178+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.178+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x7f90e80a1040 2024-05-08T18:33:06.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.178+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.178+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x563579bdfde0 2024-05-08T18:33:06.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.179+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f0031030 con 0x563579bdfde0 2024-05-08T18:33:06.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.179+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x7f90f0034070 2024-05-08T18:33:06.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.179+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e8077020 con 0x7f90f0034070 2024-05-08T18:33:06.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.179+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x7f90f0034070 2024-05-08T18:33:06.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.179+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e8077020 con 0x7f90f0034070 2024-05-08T18:33:06.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.179+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x563579bdfde0 2024-05-08T18:33:06.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.179+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f0031030 con 0x563579bdfde0 2024-05-08T18:33:06.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.179+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x7f90f0034070 2024-05-08T18:33:06.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e8077020 con 0x7f90f0034070 2024-05-08T18:33:06.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x563579bd9b90 2024-05-08T18:33:06.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563579be28e0 con 0x7f90f0034070 2024-05-08T18:33:06.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90e8077020 con 0x7f90f0034070 2024-05-08T18:33:06.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90fac3f800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:33:06.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90fac3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:33:06.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90fac3f800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:33:06.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90fac3f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:33:06.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90fac3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:33:06.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90fac3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:33:06.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90fac3f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579bde880 con 0x563579bd9b90 2024-05-08T18:33:06.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90fac3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:06.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90fac3f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579bdf120 con 0x563579bd9b90 2024-05-08T18:33:06.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90fac3f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:33:06.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90fac3f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.180+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579be2d60 con 0x7f90e80a1040 2024-05-08T18:33:06.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90fac3f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:33:06.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90fac3f800 20 zone default found 2024-05-08T18:33:06.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90fac3f800 4 Realm: () 2024-05-08T18:33:06.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90fac3f800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:33:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90fac3f800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:33:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90fac3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:33:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90fac3f800 20 zonegroup default 2024-05-08T18:33:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90fac3f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579bded80 con 0x7f90e80a1040 2024-05-08T18:33:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90fac3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90fac3f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579be4c70 con 0x563579bdfde0 2024-05-08T18:33:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90f0031030 con 0x563579bdfde0 2024-05-08T18:33:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90fac3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90fac3f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.181+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579be5030 con 0x563579bdfde0 2024-05-08T18:33:06.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.182+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90f0031030 con 0x563579bdfde0 2024-05-08T18:33:06.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.182+0000 7f90fac3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:33:06.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.182+0000 7f90fac3f800 20 started sync module instance, tier type = 2024-05-08T18:33:06.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.182+0000 7f90fac3f800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:33:06.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.182+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be4110 con 0x7f90f0034070 2024-05-08T18:33:06.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.183+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e8077020 con 0x7f90f0034070 2024-05-08T18:33:06.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.183+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94787675765856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be5490 con 0x7f90f0034070 2024-05-08T18:33:06.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.183+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be5ce0 con 0x563579bd9b90 2024-05-08T18:33:06.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.184+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94787675765856] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e8077020 con 0x7f90f0034070 2024-05-08T18:33:06.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.184+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.184+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94787675772976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be6100 con 0x563579bd9b90 2024-05-08T18:33:06.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.184+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be69b0 con 0x563579bdfde0 2024-05-08T18:33:06.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.185+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90f0031030 con 0x563579bdfde0 2024-05-08T18:33:06.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.185+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94787675775232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be6560 con 0x563579bdfde0 2024-05-08T18:33:06.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.185+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be7980 con 0x7f90f0034070 2024-05-08T18:33:06.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.185+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94787675772976] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.186+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e8077020 con 0x7f90f0034070 2024-05-08T18:33:06.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.186+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94787675780208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be7da0 con 0x7f90f0034070 2024-05-08T18:33:06.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.186+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be87c0 con 0x563579bd9b90 2024-05-08T18:33:06.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.186+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94787675775232] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90f0031030 con 0x563579bdfde0 2024-05-08T18:33:06.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.187+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.187+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94787675783856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be8be0 con 0x563579bd9b90 2024-05-08T18:33:06.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.187+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be95a0 con 0x7f90e80a1040 2024-05-08T18:33:06.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.187+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94787675780208] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e8077020 con 0x7f90f0034070 2024-05-08T18:33:06.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.188+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.188+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94787675783856] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.188+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94787675774032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be95a0 con 0x7f90e80a1040 2024-05-08T18:33:06.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.188+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be6da0 con 0x7f90e80a1040 2024-05-08T18:33:06.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.189+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94787675774032] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.189+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.189+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94787675787504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be9510 con 0x7f90e80a1040 2024-05-08T18:33:06.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.189+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579bea490 con 0x7f90e80a1040 2024-05-08T18:33:06.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.190+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94787675787504] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.190+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.190+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94787675790128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579bea400 con 0x7f90e80a1040 2024-05-08T18:33:06.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.190+0000 7f90fac3f800 20 add_watcher() i=0 2024-05-08T18:33:06.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.190+0000 7f90fac3f800 20 add_watcher() i=1 2024-05-08T18:33:06.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.190+0000 7f90fac3f800 20 add_watcher() i=2 2024-05-08T18:33:06.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.190+0000 7f90fac3f800 20 add_watcher() i=3 2024-05-08T18:33:06.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.190+0000 7f90fac3f800 20 add_watcher() i=4 2024-05-08T18:33:06.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.190+0000 7f90fac3f800 20 add_watcher() i=5 2024-05-08T18:33:06.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.190+0000 7f90fac3f800 20 add_watcher() i=6 2024-05-08T18:33:06.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.191+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94787675790128] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.191+0000 7f90fac3f800 20 add_watcher() i=7 2024-05-08T18:33:06.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.191+0000 7f90fac3f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:33:06.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.191+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579bed8f0 con 0x563579bd9b90 2024-05-08T18:33:06.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.192+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.192+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94787675791648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579beae10 con 0x563579bd9b90 2024-05-08T18:33:06.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.193+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94787675791648] v29'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.193+0000 7f8fae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:06.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.193+0000 7f90fac3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:33:06.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.193+0000 7f90fac3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:33:06.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.193+0000 7f90fac3f800 5 note: GC not initialized 2024-05-08T18:33:06.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.193+0000 7f8fad7e2640 20 reqs_thread_entry: start 2024-05-08T18:33:06.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.193+0000 7f90fac3f800 20 init_complete bucket index max shards: 11 2024-05-08T18:33:06.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.193+0000 7f90fac3f800 20 Filter name: none 2024-05-08T18:33:06.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.193+0000 7f8f1effd640 20 reqs_thread_entry: start 2024-05-08T18:33:06.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.193+0000 7f90fac3f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:33:06.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.193+0000 7f90fac3f800 20 rados->read ofs=0 len=0 2024-05-08T18:33:06.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.193+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579c20e10 con 0x7f90e80a1040 2024-05-08T18:33:06.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.194+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.194+0000 7f90fac3f800 20 rados_obj.operate() r=0 bl.length=473 2024-05-08T18:33:06.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.194+0000 7f90fac3f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:33:06.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.194+0000 7f90fac3f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:06.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.194+0000 7f90fac3f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:33:06.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.194+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579c27670 con 0x7f90e80a1040 2024-05-08T18:33:06.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.195+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v29'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.195+0000 7f90fac3f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:06.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.195+0000 7f90fac3f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:06.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.195+0000 7f90fac3f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:33:06.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.195+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94787676041264 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563579c22c70 con 0x563579bd9b90 2024-05-08T18:33:06.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.196+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== watch-notify(notify (1) cookie 94787675783856 notify 124554051615 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f90ec018040 con 0x563579bd9b90 2024-05-08T18:33:06.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.196+0000 7f8fd77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051615 cookie 94787675783856 notifier 4914 bl.length()=649 2024-05-08T18:33:06.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.196+0000 7f8fd77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:33:06.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.196+0000 7f8fd77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:33:06.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.196+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(64 notify.4 [notify cookie 94787676041264 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.196+0000 7f8fd77fe640 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8fbc003ea0 con 0x563579bd9b90 2024-05-08T18:33:06.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.196+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.196+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== watch-notify(notify_complete (2) cookie 94787676041264 notify 124554051615 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f90ec009050 con 0x563579bd9b90 2024-05-08T18:33:06.233 INFO:teuthology.orchestra.run.smithi087.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:33:04.270799Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:33:04.270781Z","tags":[],"group_ids":[]} 2024-05-08T18:33:06.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.197+0000 7f8fae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:33:06.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.197+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94787675791648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579c23020 con 0x563579bd9b90 2024-05-08T18:33:06.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.198+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94787675791648] v29'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.198+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94787675765856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579bea0f0 con 0x7f90f0034070 2024-05-08T18:33:06.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.199+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94787675765856] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e8077020 con 0x7f90f0034070 2024-05-08T18:33:06.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.199+0000 7f90fac3f800 20 remove_watcher() i=0 2024-05-08T18:33:06.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.199+0000 7f90fac3f800 2 removed watcher, disabling cache 2024-05-08T18:33:06.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.199+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94787675772976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be3c60 con 0x563579bd9b90 2024-05-08T18:33:06.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.200+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94787675772976] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.200+0000 7f90fac3f800 20 remove_watcher() i=1 2024-05-08T18:33:06.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.200+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94787675775232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be5830 con 0x563579bdfde0 2024-05-08T18:33:06.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.201+0000 7f90f8f38640 1 -- 172.21.15.87:0/3832627453 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94787675775232] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90f0031030 con 0x563579bdfde0 2024-05-08T18:33:06.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.201+0000 7f90fac3f800 20 remove_watcher() i=2 2024-05-08T18:33:06.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.201+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94787675780208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be5830 con 0x7f90f0034070 2024-05-08T18:33:06.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.202+0000 7f90f8737640 1 -- 172.21.15.87:0/3832627453 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94787675780208] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90e8077020 con 0x7f90f0034070 2024-05-08T18:33:06.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.202+0000 7f90fac3f800 20 remove_watcher() i=3 2024-05-08T18:33:06.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.202+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94787675783856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be7470 con 0x563579bd9b90 2024-05-08T18:33:06.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.203+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94787675783856] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x563579bd9b90 2024-05-08T18:33:06.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.203+0000 7f90fac3f800 20 remove_watcher() i=4 2024-05-08T18:33:06.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.203+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94787675774032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be5830 con 0x7f90e80a1040 2024-05-08T18:33:06.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.204+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94787675774032] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.204+0000 7f90fac3f800 20 remove_watcher() i=5 2024-05-08T18:33:06.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.204+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94787675787504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be7470 con 0x7f90e80a1040 2024-05-08T18:33:06.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.205+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94787675787504] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.205+0000 7f90fac3f800 20 remove_watcher() i=6 2024-05-08T18:33:06.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.205+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94787675790128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563579be90f0 con 0x7f90e80a1040 2024-05-08T18:33:06.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.206+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94787675790128] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ec00f610 con 0x7f90e80a1040 2024-05-08T18:33:06.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.206+0000 7f90fac3f800 20 remove_watcher() i=7 2024-05-08T18:33:06.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.206+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f90e80a1040 msgr2=0x7f90e80703e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.206+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f90e80a1040 0x7f90e80703e0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.206+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563579bd9b90 msgr2=0x563579bdc050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.206+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563579bd9b90 0x563579bdc050 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.206+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f90f0034070 msgr2=0x7f90f001f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.206+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f90f0034070 0x7f90f001f360 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.206+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563579bdfde0 msgr2=0x563579be2210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.206+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x563579bdfde0 0x563579be2210 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8fc803bba0 msgr2=0x7f8fc803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8fc803bba0 0x7f8fc803e060 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f90e8052c10 tx=0x7f90e8086000 comp rx=0 tx=0).stop 2024-05-08T18:33:06.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bc6ce0 msgr2=0x563579bce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bc6ce0 0x563579bce1f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f90f00518e0 tx=0x7f90f0052950 comp rx=0 tx=0).stop 2024-05-08T18:33:06.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90f7f36640 1 -- 172.21.15.87:0/3832627453 reap_dead start 2024-05-08T18:33:06.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 shutdown_connections 2024-05-08T18:33:06.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3832627453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bc6ce0 0x563579bce1f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 >> 172.21.15.87:0/3832627453 conn(0x563579bc2f60 msgr2=0x563579bc0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:06.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 shutdown_connections 2024-05-08T18:33:06.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 -- 172.21.15.87:0/3832627453 wait complete. 2024-05-08T18:33:06.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 -- 172.21.15.87:0/2428584595 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8fd003bba0 msgr2=0x7f8fd003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 --2- 172.21.15.87:0/2428584595 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8fd003bba0 0x7f8fd003e060 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f90e8065fd0 tx=0x7f90e8065380 comp rx=0 tx=0).stop 2024-05-08T18:33:06.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 -- 172.21.15.87:0/2428584595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bb9990 msgr2=0x563579bb9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 --2- 172.21.15.87:0/2428584595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bb9990 0x563579bb9db0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x563579b9f2c0 tx=0x7f90f000ef30 comp rx=0 tx=0).stop 2024-05-08T18:33:06.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 -- 172.21.15.87:0/2428584595 shutdown_connections 2024-05-08T18:33:06.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 --2- 172.21.15.87:0/2428584595 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8fd003bba0 0x7f8fd003e060 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 --2- 172.21.15.87:0/2428584595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579bb9990 0x563579bb9db0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 -- 172.21.15.87:0/2428584595 >> 172.21.15.87:0/2428584595 conn(0x563579bada30 msgr2=0x563579bade30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:06.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 -- 172.21.15.87:0/2428584595 shutdown_connections 2024-05-08T18:33:06.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 -- 172.21.15.87:0/2428584595 wait complete. 2024-05-08T18:33:06.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 -- 172.21.15.87:0/3181155532 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563579ba8de0 msgr2=0x563579bab1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563579ba8de0 0x563579bab1d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 -- 172.21.15.87:0/3181155532 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563579aa33d0 msgr2=0x563579ba5630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.207+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563579aa33d0 0x563579ba5630 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.208+0000 7f90fac3f800 1 -- 172.21.15.87:0/3181155532 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8fe003bb50 msgr2=0x7f8fe003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.208+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8fe003bb50 0x7f8fe003e010 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f90ec000f60 tx=0x7f90ec001370 comp rx=0 tx=0).stop 2024-05-08T18:33:06.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.208+0000 7f90fac3f800 1 -- 172.21.15.87:0/3181155532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 msgr2=0x563579b9e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:33:06.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.208+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 0x563579b9e3f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f90e805f040 tx=0x7f90e8003330 comp rx=0 tx=0).stop 2024-05-08T18:33:06.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.208+0000 7f90fac3f800 1 -- 172.21.15.87:0/3181155532 shutdown_connections 2024-05-08T18:33:06.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.208+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x563579aa33d0 0x563579ba5630 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.208+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x563579ba8de0 0x563579bab1d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.208+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f8fe003bb50 0x7f8fe003e010 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.208+0000 7f90fac3f800 1 --2- 172.21.15.87:0/3181155532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563579aa2650 0x563579b9e3f0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:33:06.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.208+0000 7f90fac3f800 1 -- 172.21.15.87:0/3181155532 >> 172.21.15.87:0/3181155532 conn(0x563579a9ceb0 msgr2=0x563579b8d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:33:06.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.208+0000 7f90fac3f800 1 -- 172.21.15.87:0/3181155532 shutdown_connections 2024-05-08T18:33:06.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:33:06.208+0000 7f90fac3f800 1 -- 172.21.15.87:0/3181155532 wait complete. 2024-05-08T18:33:06.256 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:06.256 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:33:04.270799Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:33:04.270781Z', 'tags': [], 'group_ids': []} 2024-05-08T18:33:06.257 ERROR:root:0 2024-05-08T18:33:06.257 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-05-08T18:33:06.263 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:06.264 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:33:06.268 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:06.268 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-05-08T18:33:06.275 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:06.275 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:33:06.279 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:06.279 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-05-08T18:33:06.287 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-05-08T18:33:06.288 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:33:06.291 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:06.291 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-05-08T18:33:06.302 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:33:06.302 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:33:06.306 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:06.306 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-05-08T18:33:06.314 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-05-08T18:33:06.315 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:33:06.319 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:06.319 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-05-08T18:33:06.327 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-05-08T18:33:06.327 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:33:06.331 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:06.331 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-05-08T18:33:06.338 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:33:06.338 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:33:06.342 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:06.342 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-05-08T18:33:06.347 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:33:06.348 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:33:06.351 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:06.352 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-05-08T18:33:06.359 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:33:06.359 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:33:06.363 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:06.363 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-05-08T18:33:06.367 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-08T18:33:06.368 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-05-08T18:33:06.372 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-08T18:33:06.385 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-05-08T18:33:06.390 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-05-08T18:33:06.390 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-08T18:33:06.395 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '603f2301-f6d0-4df6-aa57-6b1659110044', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11', 'marker': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:33:06.383054Z', 'creation_time': '2024-05-08T18:33:06.380175Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:33:06.395 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-05-08T18:33:06.400 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '603f2301-f6d0-4df6-aa57-6b1659110044', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11', 'marker': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:33:06.383054Z', 'creation_time': '2024-05-08T18:33:06.380175Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-05-08T18:33:06.405 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-08T18:33:06.409 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '603f2301-f6d0-4df6-aa57-6b1659110044', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11', 'marker': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:33:06.383054Z', 'creation_time': '2024-05-08T18:33:06.380175Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:33:06.410 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-05-08T18:33:06.414 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx000008b319c8c1f753ec9-00663bc562-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:33:06.419 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-05-08T18:33:06.426 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:33:06.427 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-05-08T18:33:06.435 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:33:06.483 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11'} 2024-05-08T18:33:06.495 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:33:06.498 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11'} 2024-05-08T18:33:06.509 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:33:06.509 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-05-08T18:33:06.519 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:33:06.525 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-05-08T18:33:06.532 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:33:06.532 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-08T18:33:06.537 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '603f2301-f6d0-4df6-aa57-6b1659110044', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11', 'marker': 'be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:33:06.506623Z', 'creation_time': '2024-05-08T18:33:06.380175Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:34:06.583 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-05-08T18:34:06.602 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:34:06.602 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-05-08T18:34:06.617 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:34:06.618 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-05-08T18:34:06.623 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:34:06.623 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-05-08T18:34:06.628 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:34:06.629 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-05-08T18:34:06.633 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:34:06.634 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-05-08T18:34:06.638 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:34:06.639 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-05-08T18:34:06.644 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:34:06.644 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-05-08T18:34:06.652 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:34:06.652 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-05-08T18:34:06.658 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-05-08T18:34:06.658 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-05-08T18:34:06.667 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:34:06.672 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-05-08T18:34:06.682 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:34:06.926 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-05-08T18:34:06.932 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000ae9ae1b2ba465562-00663bc59e-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:34:07.036 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-05-08T18:34:07.041 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-05-08T18:34:07.046 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-05-08T18:34:07.051 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-05-08T18:34:07.163 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-05-08T18:34:07.206 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:34:07.206 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-05-08T18:34:07.211 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-05-08T18:34:07.212 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-05-08T18:34:07.217 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-08T18:34:07.229 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-05-08T18:34:07.233 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000a3fa953320caef21-00663bc59f-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:34:07.254 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-05-08T18:34:07.290 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:34:07.290 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:34:07.294 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000ea379e682a26c471-00663bc59f-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:34:07.295 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-05-08T18:34:07.298 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '24862ec0-9aa3-4837-9fb5-4efcd65f7b56'}]}} 2024-05-08T18:34:07.299 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-05-08T18:34:07.309 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:34:07.309 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-05-08T18:34:07.313 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-08T18:34:07.313 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-05-08T18:34:07.318 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000001f821ea7314cf4e3-00663bc59f-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:34:07.318 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-05-08T18:34:07.322 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000000c78a59157999f00-00663bc59f-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:34:07.336 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-05-08T18:34:07.342 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-08T18:34:07.343 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-05-08T18:34:07.347 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000004791ad13bbae5224-00663bc59f-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:34:07.347 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-05-08T18:34:07.351 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000006551ab681453743b-00663bc59f-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:34:07.352 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-05-08T18:34:07.357 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-08T18:34:07.357 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-05-08T18:34:07.361 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000052ece19f2feef09d-00663bc59f-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:34:07.361 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-05-08T18:34:07.365 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000002bdee4a13d6d29d5-00663bc59f-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:34:07.365 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-05-08T18:34:07.368 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000002cff9236c9b2d8b4-00663bc59f-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:34:07.369 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-05-08T18:34:07.373 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000b0b1e0951959ec80-00663bc59f-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:34:07.373 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-05-08T18:34:07.382 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:34:07.383 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-05-08T18:34:07.386 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-05-08T18:34:07.387 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-05-08T18:34:07.393 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:34:07.393 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-05-08T18:34:07.397 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-05-08T18:34:07.398 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-05-08T18:34:07.403 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:34:07.409 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-05-08T18:34:07.419 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-05-08T18:34:07.419 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:34:07.420 INFO:tasks.rgw.client.0.smithi087.stdout:2024-05-08T18:34:07.421+0000 7f8cc89b6640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 35250) UID: 0 2024-05-08T18:34:07.420 INFO:tasks.rgw.client.0.smithi087.stdout:2024-05-08T18:34:07.421+0000 7f8ccc20f880 -1 shutting down 2024-05-08T18:34:10.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-05-08T18:34:13.521 INFO:tasks.rgw.client.0:Stopped 2024-05-08T18:34:13.521 DEBUG:teuthology.orchestra.run.smithi087:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-05-08T18:34:13.541 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f /etc/ceph/vault-root-token 2024-05-08T18:34:13.609 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-05-08T18:34:13.677 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-05-08T18:34:13.677 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-05-08T18:34:13.677 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-05-08T18:34:13.763 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:34:13.763 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:34:13.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.766+0000 7f022df2e800 1 Processor -- start 2024-05-08T18:34:13.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.766+0000 7f022df2e800 1 -- start start 2024-05-08T18:34:13.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.766+0000 7f022df2e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5618beb9fcd0 0x5618beba20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:13.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.766+0000 7f022df2e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5618beba6110 con 0x5618beba2600 2024-05-08T18:34:13.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.766+0000 7f022df2e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5618bea3fe20 con 0x5618beb9fcd0 2024-05-08T18:34:13.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.766+0000 7f0229c60640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5618beb9fcd0 0x5618beba20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:13.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.766+0000 7f022945f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5618beba2600 0x5618beba49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.87:60132/0 (socket says 172.21.15.87:60132) 2024-05-08T18:34:13.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.766+0000 7f0229c60640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5618beb9fcd0 0x5618beba20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53724/0 (socket says 172.21.15.87:53724) 2024-05-08T18:34:13.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.766+0000 7f022945f640 1 -- 172.21.15.87:0/2871259882 learned_addr learned my addr 172.21.15.87:0/2871259882 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-08T18:34:13.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.767+0000 7f0229c60640 1 -- 172.21.15.87:0/2871259882 >> v1:172.21.15.53:6789/0 conn(0x5618beba2600 legacy=0x5618beba49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:13.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.767+0000 7f0229c60640 1 -- 172.21.15.87:0/2871259882 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618beba72f0 con 0x5618beb9fcd0 2024-05-08T18:34:13.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.769+0000 7f0229c60640 1 --2- 172.21.15.87:0/2871259882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 0x5618beba20c0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f021c005fd0 tx=0x7f021c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921208df73c3507b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:13.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.769+0000 7f0228c5e640 1 -- 172.21.15.87:0/2871259882 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f021c052560 con 0x5618beb9fcd0 2024-05-08T18:34:13.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.769+0000 7f0228c5e640 1 -- 172.21.15.87:0/2871259882 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f021c052700 con 0x5618beb9fcd0 2024-05-08T18:34:13.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.769+0000 7f0228c5e640 1 -- 172.21.15.87:0/2871259882 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f021c052a60 con 0x5618beb9fcd0 2024-05-08T18:34:13.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.769+0000 7f022df2e800 1 -- 172.21.15.87:0/2871259882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 msgr2=0x5618beba20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:13.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.769+0000 7f022df2e800 1 --2- 172.21.15.87:0/2871259882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 0x5618beba20c0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f021c005fd0 tx=0x7f021c01ccc0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.769+0000 7f022df2e800 1 -- 172.21.15.87:0/2871259882 shutdown_connections 2024-05-08T18:34:13.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.769+0000 7f022df2e800 1 --2- 172.21.15.87:0/2871259882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 0x5618beba20c0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.769+0000 7f022df2e800 1 -- 172.21.15.87:0/2871259882 >> 172.21.15.87:0/2871259882 conn(0x5618beb99720 msgr2=0x5618beb9bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:13.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.769+0000 7f022df2e800 1 -- 172.21.15.87:0/2871259882 shutdown_connections 2024-05-08T18:34:13.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.769+0000 7f022df2e800 1 -- 172.21.15.87:0/2871259882 wait complete. 2024-05-08T18:34:13.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.784+0000 7f022df2e800 1 Processor -- start 2024-05-08T18:34:13.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.784+0000 7f022df2e800 1 -- start start 2024-05-08T18:34:13.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.784+0000 7f022df2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 0x5618bec905c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:13.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.784+0000 7f022df2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5618beaea5b0 con 0x5618beb9fcd0 2024-05-08T18:34:13.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.784+0000 7f0229c60640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 0x5618bec905c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:13.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.784+0000 7f0229c60640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 0x5618bec905c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53732/0 (socket says 172.21.15.87:53732) 2024-05-08T18:34:13.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.784+0000 7f0229c60640 1 -- 172.21.15.87:0/2099094663 learned_addr learned my addr 172.21.15.87:0/2099094663 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:34:13.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.785+0000 7f0229c60640 1 -- 172.21.15.87:0/2099094663 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618bec90b90 con 0x5618beb9fcd0 2024-05-08T18:34:13.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.785+0000 7f0229c60640 1 --2- 172.21.15.87:0/2099094663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 0x5618bec905c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f021c007000 tx=0x7f021c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f603c7ff0f2429 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:13.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.785+0000 7f0117e07640 1 -- 172.21.15.87:0/2099094663 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f021c0529e0 con 0x5618beb9fcd0 2024-05-08T18:34:13.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.785+0000 7f0117e07640 1 -- 172.21.15.87:0/2099094663 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f021c052b80 con 0x5618beb9fcd0 2024-05-08T18:34:13.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.785+0000 7f0117e07640 1 -- 172.21.15.87:0/2099094663 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f021c05c430 con 0x5618beb9fcd0 2024-05-08T18:34:13.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.786+0000 7f022df2e800 1 -- 172.21.15.87:0/2099094663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 msgr2=0x5618bec905c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:13.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.786+0000 7f022df2e800 1 --2- 172.21.15.87:0/2099094663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 0x5618bec905c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f021c007000 tx=0x7f021c04c000 comp rx=0 tx=0).stop 2024-05-08T18:34:13.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.786+0000 7f022df2e800 1 -- 172.21.15.87:0/2099094663 shutdown_connections 2024-05-08T18:34:13.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.786+0000 7f022df2e800 1 --2- 172.21.15.87:0/2099094663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 0x5618bec905c0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.786+0000 7f022df2e800 1 -- 172.21.15.87:0/2099094663 >> 172.21.15.87:0/2099094663 conn(0x5618beb99720 msgr2=0x5618bec8bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:13.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.786+0000 7f022df2e800 1 -- 172.21.15.87:0/2099094663 shutdown_connections 2024-05-08T18:34:13.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.786+0000 7f022df2e800 1 -- 172.21.15.87:0/2099094663 wait complete. 2024-05-08T18:34:13.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.786+0000 7f022df2e800 1 Processor -- start 2024-05-08T18:34:13.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.786+0000 7f022df2e800 1 -- start start 2024-05-08T18:34:13.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.786+0000 7f022df2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 0x5618bec980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:13.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.786+0000 7f022df2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5618beba6580 con 0x5618beb9fcd0 2024-05-08T18:34:13.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.787+0000 7f0229c60640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 0x5618bec980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:13.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.787+0000 7f0229c60640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 0x5618bec980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53734/0 (socket says 172.21.15.87:53734) 2024-05-08T18:34:13.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.787+0000 7f0229c60640 1 -- 172.21.15.87:0/1808892379 learned_addr learned my addr 172.21.15.87:0/1808892379 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:34:13.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.787+0000 7f0229c60640 1 -- 172.21.15.87:0/1808892379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618bec98620 con 0x5618beb9fcd0 2024-05-08T18:34:13.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.787+0000 7f0229c60640 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 0x5618bec980e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f021c0526d0 tx=0x7f021c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:13.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.787+0000 7f0116604640 1 -- 172.21.15.87:0/1808892379 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f021c075070 con 0x5618beb9fcd0 2024-05-08T18:34:13.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.787+0000 7f0116604640 1 -- 172.21.15.87:0/1808892379 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f021c070410 con 0x5618beb9fcd0 2024-05-08T18:34:13.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.787+0000 7f0116604640 1 -- 172.21.15.87:0/1808892379 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f021c0529e0 con 0x5618beb9fcd0 2024-05-08T18:34:13.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.787+0000 7f022df2e800 1 -- 172.21.15.87:0/1808892379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618bec988b0 con 0x5618beb9fcd0 2024-05-08T18:34:13.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.787+0000 7f022df2e800 1 -- 172.21.15.87:0/1808892379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618bec9b560 con 0x5618beb9fcd0 2024-05-08T18:34:13.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.788+0000 7f0116604640 1 -- 172.21.15.87:0/1808892379 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f021c078070 con 0x5618beb9fcd0 2024-05-08T18:34:13.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.788+0000 7f0116604640 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f011003bba0 0x7f011003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:13.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.789+0000 7f0116604640 1 -- 172.21.15.87:0/1808892379 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f021c06d070 con 0x5618beb9fcd0 2024-05-08T18:34:13.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.789+0000 7f022945f640 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f011003bba0 0x7f011003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:13.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.789+0000 7f022df2e800 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5618beba2600 0x5618bec9f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:13.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.789+0000 7f022df2e800 1 -- 172.21.15.87:0/1808892379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bec9f860 con 0x5618beba2600 2024-05-08T18:34:13.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.789+0000 7f022a461640 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5618beba2600 0x5618bec9f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:13.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.789+0000 7f022945f640 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f011003bba0 0x7f011003e060 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0214000f60 tx=0x7f02140012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:13.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.789+0000 7f022a461640 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5618beba2600 0x5618bec9f320 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:13.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.789+0000 7f022a461640 1 -- 172.21.15.87:0/1808892379 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02240083e0 con 0x5618beba2600 2024-05-08T18:34:13.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.789+0000 7f022df2e800 1 -- 172.21.15.87:0/1808892379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bec9c8d0 con 0x5618beba2600 2024-05-08T18:34:13.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.790+0000 7f022a461640 1 -- 172.21.15.87:0/1808892379 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f02240083e0 con 0x5618beba2600 2024-05-08T18:34:13.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.790+0000 7f022df2e800 1 -- 172.21.15.87:0/1808892379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618beca16b0 con 0x5618beba2600 2024-05-08T18:34:13.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.790+0000 7f022a461640 1 -- 172.21.15.87:0/1808892379 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f02240083e0 con 0x5618beba2600 2024-05-08T18:34:13.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.790+0000 7f022df2e800 1 -- 172.21.15.87:0/1808892379 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618beca08e0 con 0x5618beba2600 2024-05-08T18:34:13.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.790+0000 7f022a461640 1 -- 172.21.15.87:0/1808892379 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f02240083e0 con 0x5618beba2600 2024-05-08T18:34:13.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.791+0000 7f022df2e800 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5618beca2a60 0x5618beca4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:13.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.791+0000 7f022df2e800 1 -- 172.21.15.87:0/1808892379 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:5 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618beca5390 con 0x5618beca2a60 2024-05-08T18:34:13.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.791+0000 7f0229c60640 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5618beca2a60 0x5618beca4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:13.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.791+0000 7f0229c60640 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5618beca2a60 0x5618beca4e50 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:13.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.792+0000 7f0229c60640 1 -- 172.21.15.87:0/1808892379 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(5 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f021c077030 con 0x5618beca2a60 2024-05-08T18:34:13.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.792+0000 7f022df2e800 1 Processor -- start 2024-05-08T18:34:13.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.792+0000 7f022df2e800 1 -- start start 2024-05-08T18:34:13.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.792+0000 7f022df2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618becb3610 0x5618becb3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:13.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.792+0000 7f022df2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5618bea90fc0 con 0x5618becb3610 2024-05-08T18:34:13.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.792+0000 7f022a461640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618becb3610 0x5618becb3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:13.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.792+0000 7f022a461640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618becb3610 0x5618becb3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53744/0 (socket says 172.21.15.87:53744) 2024-05-08T18:34:13.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.792+0000 7f022a461640 1 -- 172.21.15.87:0/1309497949 learned_addr learned my addr 172.21.15.87:0/1309497949 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:34:13.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.793+0000 7f022a461640 1 -- 172.21.15.87:0/1309497949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618becb3f70 con 0x5618becb3610 2024-05-08T18:34:13.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.793+0000 7f022a461640 1 --2- 172.21.15.87:0/1309497949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618becb3610 0x5618becb3a30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x5618bec994e0 tx=0x7f022400ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:13.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.793+0000 7f010f7fe640 1 -- 172.21.15.87:0/1309497949 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f022401c070 con 0x5618becb3610 2024-05-08T18:34:13.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.793+0000 7f010f7fe640 1 -- 172.21.15.87:0/1309497949 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f022400bdc0 con 0x5618becb3610 2024-05-08T18:34:13.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.793+0000 7f022df2e800 1 -- 172.21.15.87:0/1309497949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618becb49e0 con 0x5618becb3610 2024-05-08T18:34:13.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.793+0000 7f010f7fe640 1 -- 172.21.15.87:0/1309497949 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0224018540 con 0x5618becb3610 2024-05-08T18:34:13.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.793+0000 7f022df2e800 1 -- 172.21.15.87:0/1309497949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618becb4ee0 con 0x5618becb3610 2024-05-08T18:34:13.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.794+0000 7f010f7fe640 1 -- 172.21.15.87:0/1309497949 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f022401f070 con 0x5618becb3610 2024-05-08T18:34:13.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.794+0000 7f010f7fe640 1 --2- 172.21.15.87:0/1309497949 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f010403bba0 0x7f010403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:13.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.794+0000 7f010f7fe640 1 -- 172.21.15.87:0/1309497949 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f02240546c0 con 0x5618becb3610 2024-05-08T18:34:13.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.794+0000 7f0229c60640 1 --2- 172.21.15.87:0/1309497949 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f010403bba0 0x7f010403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:13.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.795+0000 7f022df2e800 1 Processor -- start 2024-05-08T18:34:13.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.795+0000 7f0229c60640 1 --2- 172.21.15.87:0/1309497949 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f010403bba0 0x7f010403e060 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f021c06f000 tx=0x7f021c05df10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:13.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.795+0000 7f022df2e800 1 -- start start 2024-05-08T18:34:13.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.795+0000 7f022df2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9f300 0x5618beb9f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:13.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.795+0000 7f022df2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5618bec90eb0 con 0x5618beb9f300 2024-05-08T18:34:13.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.795+0000 7f022a461640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9f300 0x5618beb9f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:13.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.795+0000 7f022a461640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9f300 0x5618beb9f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53760/0 (socket says 172.21.15.87:53760) 2024-05-08T18:34:13.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.795+0000 7f022a461640 1 -- 172.21.15.87:0/1910946014 learned_addr learned my addr 172.21.15.87:0/1910946014 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:34:13.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.796+0000 7f022a461640 1 -- 172.21.15.87:0/1910946014 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618beb9db50 con 0x5618beb9f300 2024-05-08T18:34:13.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.796+0000 7f022a461640 1 --2- 172.21.15.87:0/1910946014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9f300 0x5618beb9f720 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f0224052a40 tx=0x7f0224014bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a621e4dc5deb7331 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:13.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.796+0000 7f010d7fa640 1 -- 172.21.15.87:0/1910946014 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0224052d60 con 0x5618beb9f300 2024-05-08T18:34:13.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.796+0000 7f010d7fa640 1 -- 172.21.15.87:0/1910946014 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02240173a0 con 0x5618beb9f300 2024-05-08T18:34:13.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.796+0000 7f010d7fa640 1 -- 172.21.15.87:0/1910946014 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0224017680 con 0x5618beb9f300 2024-05-08T18:34:13.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.797+0000 7f022df2e800 1 -- 172.21.15.87:0/1910946014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9f300 msgr2=0x5618beb9f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:13.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.797+0000 7f022df2e800 1 --2- 172.21.15.87:0/1910946014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9f300 0x5618beb9f720 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f0224052a40 tx=0x7f0224014bb0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.797+0000 7f022df2e800 1 -- 172.21.15.87:0/1910946014 shutdown_connections 2024-05-08T18:34:13.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.797+0000 7f022df2e800 1 --2- 172.21.15.87:0/1910946014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9f300 0x5618beb9f720 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.797+0000 7f022df2e800 1 -- 172.21.15.87:0/1910946014 >> 172.21.15.87:0/1910946014 conn(0x5618becbcc20 msgr2=0x5618becbacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:13.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.797+0000 7f022df2e800 1 -- 172.21.15.87:0/1910946014 shutdown_connections 2024-05-08T18:34:13.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.797+0000 7f022df2e800 1 -- 172.21.15.87:0/1910946014 wait complete. 2024-05-08T18:34:13.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.797+0000 7f022df2e800 1 Processor -- start 2024-05-08T18:34:13.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.797+0000 7f022df2e800 1 -- start start 2024-05-08T18:34:13.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.797+0000 7f022df2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9f300 0x5618becca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:13.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.797+0000 7f022df2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5618beb9e020 con 0x5618beb9f300 2024-05-08T18:34:13.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.797+0000 7f022a461640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9f300 0x5618becca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:13.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.797+0000 7f022a461640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9f300 0x5618becca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.87:53764/0 (socket says 172.21.15.87:53764) 2024-05-08T18:34:13.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.797+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 learned_addr learned my addr 172.21.15.87:0/2132893184 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-08T18:34:13.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.798+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618becca650 con 0x5618beb9f300 2024-05-08T18:34:13.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.798+0000 7f022a461640 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9f300 0x5618becca110 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x5618becbba10 tx=0x7f02240529a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:13.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.798+0000 7f00fb7fe640 1 -- 172.21.15.87:0/2132893184 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0224049040 con 0x5618beb9f300 2024-05-08T18:34:13.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.798+0000 7f00fb7fe640 1 -- 172.21.15.87:0/2132893184 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0224029a60 con 0x5618beb9f300 2024-05-08T18:34:13.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.798+0000 7f00fb7fe640 1 -- 172.21.15.87:0/2132893184 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0224029d80 con 0x5618beb9f300 2024-05-08T18:34:13.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.798+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618becca8e0 con 0x5618beb9f300 2024-05-08T18:34:13.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.798+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618beccd590 con 0x5618beb9f300 2024-05-08T18:34:13.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.799+0000 7f00fb7fe640 1 -- 172.21.15.87:0/2132893184 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f0224054070 con 0x5618beb9f300 2024-05-08T18:34:13.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.799+0000 7f00fb7fe640 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f00f403bb50 0x7f00f403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:13.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.799+0000 7f00fb7fe640 1 -- 172.21.15.87:0/2132893184 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0224035d10 con 0x5618beb9f300 2024-05-08T18:34:13.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.799+0000 7f0229c60640 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f00f403bb50 0x7f00f403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:13.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.800+0000 7f0229c60640 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f00f403bb50 0x7f00f403e010 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f021c052450 tx=0x7f021c08d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:13.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.800+0000 7f022df2e800 20 rados->read ofs=0 len=0 2024-05-08T18:34:13.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.800+0000 7f022df2e800 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5618becd5bd0 0x5618becd8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:13.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.800+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becd87e0 con 0x5618becd5bd0 2024-05-08T18:34:13.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.800+0000 7f022945f640 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5618becd5bd0 0x5618becd8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:13.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.800+0000 7f022945f640 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5618becd5bd0 0x5618becd8090 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:13.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.800+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0214009050 con 0x5618becd5bd0 2024-05-08T18:34:13.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.800+0000 7f022df2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:34:13.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.800+0000 7f022df2e800 20 realm 2024-05-08T18:34:13.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.800+0000 7f022df2e800 20 rados->read ofs=0 len=0 2024-05-08T18:34:13.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.800+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becd5020 con 0x5618becd5bd0 2024-05-08T18:34:13.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.800+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0214009050 con 0x5618becd5bd0 2024-05-08T18:34:13.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022df2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:34:13.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022df2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:34:13.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022df2e800 20 rados->read ofs=0 len=0 2024-05-08T18:34:13.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becd92d0 con 0x5618becd5bd0 2024-05-08T18:34:13.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0214009050 con 0x5618becd5bd0 2024-05-08T18:34:13.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022df2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:34:13.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022df2e800 20 rados->read ofs=0 len=0 2024-05-08T18:34:13.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becd9ba0 con 0x5618becd5bd0 2024-05-08T18:34:13.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0214009050 con 0x5618becd5bd0 2024-05-08T18:34:13.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022df2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:34:13.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022df2e800 20 rados->read ofs=0 len=0 2024-05-08T18:34:13.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:5 5.19 5:9d072479:::zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becd9f40 con 0x5618becd5bd0 2024-05-08T18:34:13.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 5 ==== osd_op_reply(5 zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0214009050 con 0x5618becd5bd0 2024-05-08T18:34:13.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022df2e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:34:13.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022df2e800 20 searching for the correct realm 2024-05-08T18:34:13.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022df2e800 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5618becdbe20 0x5618becde230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:13.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x5618becdbe20 2024-05-08T18:34:13.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.801+0000 7f022a461640 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5618becdbe20 0x5618becde230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:13.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.802+0000 7f022a461640 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5618becdbe20 0x5618becde230 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:13.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.802+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f022403b070 con 0x5618becdbe20 2024-05-08T18:34:13.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.802+0000 7f022a461640 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f0224021070 0x7f02240549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:13.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.802+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x7f0224021070 2024-05-08T18:34:13.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.802+0000 7f0229c60640 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f0224021070 0x7f02240549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:13.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.803+0000 7f0229c60640 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f0224021070 0x7f02240549e0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:13.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.803+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.803+0000 7f0229c60640 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f021c0a2040 0x7f021c05b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:13.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.803+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x7f021c0a2040 2024-05-08T18:34:13.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.803+0000 7f022945f640 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f021c0a2040 0x7f021c05b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:13.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.804+0000 7f022945f640 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f021c0a2040 0x7f021c05b7c0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:13.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.804+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0214009050 con 0x7f021c0a2040 2024-05-08T18:34:13.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.804+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x5618becd5bd0 2024-05-08T18:34:13.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.804+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 6 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0214009050 con 0x5618becd5bd0 2024-05-08T18:34:13.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.804+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x5618becd5bd0 2024-05-08T18:34:13.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.804+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 7 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.805+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x7f021c0a2040 2024-05-08T18:34:13.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.805+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.805+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x7f021c0a2040 2024-05-08T18:34:13.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.805+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.805+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x7f0224021070 2024-05-08T18:34:13.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.805+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.805+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x5618becdbe20 2024-05-08T18:34:13.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.806+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f022403b070 con 0x5618becdbe20 2024-05-08T18:34:13.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.806+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x5618becd5bd0 2024-05-08T18:34:13.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.806+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.806+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x7f021c0a2040 2024-05-08T18:34:13.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.806+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.806+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x5618becd5bd0 2024-05-08T18:34:13.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.806+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.806+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x7f0224021070 2024-05-08T18:34:13.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.807+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.807+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x5618becdbe20 2024-05-08T18:34:13.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.807+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.807+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x5618becdbe20 2024-05-08T18:34:13.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.807+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.807+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x7f021c0a2040 2024-05-08T18:34:13.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.807+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.808+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x5618becdbe20 2024-05-08T18:34:13.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.808+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.808+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x5618becdbe20 2024-05-08T18:34:13.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.808+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.808+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x5618becd5bd0 2024-05-08T18:34:13.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.808+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.808+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x5618becd5bd0 2024-05-08T18:34:13.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.808+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=132b] v29'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.808+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x7f021c0a2040 2024-05-08T18:34:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.809+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.809+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x5618becdbe20 2024-05-08T18:34:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.809+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.809+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x7f0224021070 2024-05-08T18:34:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.809+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.809+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x5618becd5bd0 2024-05-08T18:34:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.810+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.810+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x7f021c0a2040 2024-05-08T18:34:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.810+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=82b] v29'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.810+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x5618becdbe20 2024-05-08T18:34:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.810+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.810+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x7f0224021070 2024-05-08T18:34:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.811+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.811+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x7f0224021070 2024-05-08T18:34:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.811+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.811+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x5618becdbe20 2024-05-08T18:34:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.811+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.811+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x7f0224021070 2024-05-08T18:34:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.811+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.811+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x5618becd5bd0 2024-05-08T18:34:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5618becde900 con 0x7f0224021070 2024-05-08T18:34:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022df2e800 20 RGWRados::pool_iterate: got zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 2024-05-08T18:34:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022df2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:34:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022df2e800 20 RGWRados::pool_iterate: got zone_info.be5b96a9-27d9-41bc-99e2-d41218f7be5a 2024-05-08T18:34:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022df2e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:34:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022df2e800 20 RGWRados::pool_iterate: got period_config.default 2024-05-08T18:34:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022df2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:34:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022df2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:34:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022df2e800 20 rados->read ofs=0 len=0 2024-05-08T18:34:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becda890 con 0x5618becd5bd0 2024-05-08T18:34:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022df2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:34:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022df2e800 20 rados->read ofs=0 len=0 2024-05-08T18:34:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becdb130 con 0x5618becd5bd0 2024-05-08T18:34:13.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022df2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:34:13.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022df2e800 20 rados->read ofs=0 len=0 2024-05-08T18:34:13.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.812+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:40 5.14 5:2b5fa05c:::zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becded80 con 0x7f021c0a2040 2024-05-08T18:34:13.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.813+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 8 ==== osd_op_reply(40 zonegroup_info.603f2301-f6d0-4df6-aa57-6b1659110044 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.813+0000 7f022df2e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:34:13.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.813+0000 7f022df2e800 20 zone default found 2024-05-08T18:34:13.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.813+0000 7f022df2e800 4 Realm: () 2024-05-08T18:34:13.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.813+0000 7f022df2e800 4 ZoneGroup: default (603f2301-f6d0-4df6-aa57-6b1659110044) 2024-05-08T18:34:13.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.813+0000 7f022df2e800 4 Zone: default (be5b96a9-27d9-41bc-99e2-d41218f7be5a) 2024-05-08T18:34:13.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.813+0000 7f022df2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:34:13.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.813+0000 7f022df2e800 20 zonegroup default 2024-05-08T18:34:13.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.813+0000 7f022df2e800 20 rados->read ofs=0 len=0 2024-05-08T18:34:13.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.813+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becdad90 con 0x7f021c0a2040 2024-05-08T18:34:13.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.813+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 9 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.813+0000 7f022df2e800 20 rados_obj.operate() r=0 bl.length=187 2024-05-08T18:34:13.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.813+0000 7f022df2e800 20 rados->read ofs=0 len=0 2024-05-08T18:34:13.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.813+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bece0c90 con 0x5618becdbe20 2024-05-08T18:34:13.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.814+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.814+0000 7f022df2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:34:13.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.814+0000 7f022df2e800 20 rados->read ofs=0 len=0 2024-05-08T18:34:13.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.814+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bece1180 con 0x5618becdbe20 2024-05-08T18:34:13.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.814+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.814+0000 7f022df2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:34:13.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.814+0000 7f022df2e800 20 started sync module instance, tier type = 2024-05-08T18:34:13.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.814+0000 7f022df2e800 20 started zone id=be5b96a9-27d9-41bc-99e2-d41218f7be5a (name=default) with tier type = 2024-05-08T18:34:13.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.814+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bece0130 con 0x7f0224021070 2024-05-08T18:34:13.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.815+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 9 ==== osd_op_reply(44 notify.0 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.815+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94664280376608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becdfd90 con 0x7f0224021070 2024-05-08T18:34:13.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.815+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bece20b0 con 0x5618becd5bd0 2024-05-08T18:34:13.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.816+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94664280376608] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.816+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 16 ==== osd_op_reply(46 notify.1 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.816+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94664280382464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bece2020 con 0x5618becd5bd0 2024-05-08T18:34:13.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.816+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bece2e40 con 0x5618becdbe20 2024-05-08T18:34:13.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.818+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94664280382464] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.818+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 12 ==== osd_op_reply(48 notify.2 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.818+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94664280384672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bece2d70 con 0x5618becdbe20 2024-05-08T18:34:13.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.818+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bece3890 con 0x7f0224021070 2024-05-08T18:34:13.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.819+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94664280384672] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.819+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 11 ==== osd_op_reply(50 notify.3 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.819+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94664280385728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bece2ce0 con 0x7f0224021070 2024-05-08T18:34:13.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.819+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bece4750 con 0x5618becd5bd0 2024-05-08T18:34:13.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.820+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94664280385728] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.820+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 18 ==== osd_op_reply(52 notify.4 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.820+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94664280392352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bece4b70 con 0x5618becd5bd0 2024-05-08T18:34:13.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.820+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bece5530 con 0x7f021c0a2040 2024-05-08T18:34:13.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.822+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94664280392352] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.822+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 10 ==== osd_op_reply(54 notify.5 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.822+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94664280393888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bece5530 con 0x7f021c0a2040 2024-05-08T18:34:13.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.822+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bece5ef0 con 0x7f021c0a2040 2024-05-08T18:34:13.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.823+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94664280393888] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.823+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 12 ==== osd_op_reply(56 notify.6 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.823+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94664280396416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bece5ef0 con 0x7f021c0a2040 2024-05-08T18:34:13.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.823+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bece68b0 con 0x7f021c0a2040 2024-05-08T18:34:13.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.824+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94664280396416] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.824+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 14 ==== osd_op_reply(58 notify.7 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.824+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94664280398912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bece68b0 con 0x7f021c0a2040 2024-05-08T18:34:13.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.824+0000 7f022df2e800 20 add_watcher() i=0 2024-05-08T18:34:13.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.824+0000 7f022df2e800 20 add_watcher() i=1 2024-05-08T18:34:13.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.824+0000 7f022df2e800 20 add_watcher() i=2 2024-05-08T18:34:13.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.824+0000 7f022df2e800 20 add_watcher() i=3 2024-05-08T18:34:13.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.824+0000 7f022df2e800 20 add_watcher() i=4 2024-05-08T18:34:13.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.824+0000 7f022df2e800 20 add_watcher() i=5 2024-05-08T18:34:13.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.824+0000 7f022df2e800 20 add_watcher() i=6 2024-05-08T18:34:13.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.825+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94664280398912] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.825+0000 7f022df2e800 20 add_watcher() i=7 2024-05-08T18:34:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.825+0000 7f022df2e800 2 all 8 watchers are set, enabling cache 2024-05-08T18:34:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.825+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bece9ce0 con 0x5618becd5bd0 2024-05-08T18:34:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.825+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.826+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94664280401360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bece7200 con 0x5618becd5bd0 2024-05-08T18:34:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.826+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94664280401360] v29'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.827+0000 7f00dbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:34:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.827+0000 7f022df2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:34:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.827+0000 7f022df2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:34:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.827+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf2560 con 0x5618becd5bd0 2024-05-08T18:34:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.828+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.828+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf2bb0 con 0x7f021c0a2040 2024-05-08T18:34:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.829+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.829+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3010 con 0x5618becdbe20 2024-05-08T18:34:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.830+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.830+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf2fb0 con 0x5618becd5bd0 2024-05-08T18:34:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.831+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'276 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.831+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3540 con 0x7f0224021070 2024-05-08T18:34:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.832+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'83 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.832+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3a40 con 0x5618becdbe20 2024-05-08T18:34:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.833+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'57 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.833+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3a40 con 0x5618becd5bd0 2024-05-08T18:34:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.834+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.834+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3a40 con 0x7f021c0a2040 2024-05-08T18:34:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.835+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.835+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3a40 con 0x7f0224021070 2024-05-08T18:34:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.836+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.836+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ad0 con 0x5618becdbe20 2024-05-08T18:34:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.837+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.837+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3b60 con 0x7f0224021070 2024-05-08T18:34:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.838+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'84 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.838+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3bf0 con 0x7f021c0a2040 2024-05-08T18:34:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.839+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'41 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.839+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3bf0 con 0x7f0224021070 2024-05-08T18:34:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.840+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.840+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ce0 con 0x7f021c0a2040 2024-05-08T18:34:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.842+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'63 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.842+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ce0 con 0x5618becd5bd0 2024-05-08T18:34:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.843+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'277 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.843+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ca0 con 0x5618becdbe20 2024-05-08T18:34:13.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.844+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'77 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.844+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3d00 con 0x7f0224021070 2024-05-08T18:34:13.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.845+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'85 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.845+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3d00 con 0x5618becdbe20 2024-05-08T18:34:13.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.846+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.846+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ca0 con 0x5618becd5bd0 2024-05-08T18:34:13.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.848+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.848+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ca0 con 0x5618becd5bd0 2024-05-08T18:34:13.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.849+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'278 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.849+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ca0 con 0x5618becdbe20 2024-05-08T18:34:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.850+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'78 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.850+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ca0 con 0x7f0224021070 2024-05-08T18:34:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.851+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'42 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.851+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ca0 con 0x5618becdbe20 2024-05-08T18:34:13.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.852+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.852+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ca0 con 0x5618becdbe20 2024-05-08T18:34:13.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.853+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.853+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ca0 con 0x5618becdbe20 2024-05-08T18:34:13.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.854+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'30 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.854+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ca0 con 0x5618becdbe20 2024-05-08T18:34:13.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.854+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'58 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.854+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ca0 con 0x7f021c0a2040 2024-05-08T18:34:13.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.856+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.856+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ca0 con 0x5618becdbe20 2024-05-08T18:34:13.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.856+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.857+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ca0 con 0x7f021c0a2040 2024-05-08T18:34:13.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.858+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.858+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ca0 con 0x5618becdbe20 2024-05-08T18:34:13.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.859+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'79 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.859+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ca0 con 0x7f021c0a2040 2024-05-08T18:34:13.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.860+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'64 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.860+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf3ca0 con 0x7f0224021070 2024-05-08T18:34:13.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.861+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.861+0000 7f00daffd640 20 reqs_thread_entry: start 2024-05-08T18:34:13.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.861+0000 7f022df2e800 20 init_complete bucket index max shards: 11 2024-05-08T18:34:13.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.861+0000 7f022df2e800 20 Filter name: none 2024-05-08T18:34:13.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.862+0000 7f00d8ff9640 20 reqs_thread_entry: start 2024-05-08T18:34:13.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.862+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-05-08T18:34:13.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.862+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:94 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.863+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 23 ==== osd_op_reply(94 gc.13 [call] v29'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.863+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:95 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.863+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 24 ==== osd_op_reply(95 gc.13 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.863+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.863+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:96 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.864+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 25 ==== osd_op_reply(96 gc.13 [call out=24b] v0'0 uv65 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.864+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:97 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.864+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 26 ==== osd_op_reply(97 gc.13 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.864+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.864+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:98 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.864+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 27 ==== osd_op_reply(98 gc.13 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.864+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.864+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:99 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.865+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 28 ==== osd_op_reply(99 gc.13 [call] v29'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.865+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-05-08T18:34:13.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.865+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:100 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.866+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 28 ==== osd_op_reply(100 gc.14 [call] v29'279 uv279 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.866+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:101 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.867+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 29 ==== osd_op_reply(101 gc.14 [call out=15b] v0'0 uv279 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.867+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.867+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:102 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.867+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 30 ==== osd_op_reply(102 gc.14 [call out=24b] v0'0 uv279 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.867+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:103 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.867+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 31 ==== osd_op_reply(103 gc.14 [call out=15b] v0'0 uv279 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.867+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.867+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:104 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.867+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 32 ==== osd_op_reply(104 gc.14 [call out=15b] v0'0 uv279 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.867+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.867+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:105 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.868+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 33 ==== osd_op_reply(105 gc.14 [call] v29'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.868+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-05-08T18:34:13.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.868+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:106 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.870+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 26 ==== osd_op_reply(106 gc.15 [call] v29'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.870+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:107 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.870+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 27 ==== osd_op_reply(107 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.870+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.870+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:108 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.870+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 28 ==== osd_op_reply(108 gc.15 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.870+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:109 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.870+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 29 ==== osd_op_reply(109 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.871+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.871+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:110 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.871+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 30 ==== osd_op_reply(110 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.871+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.871+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:111 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.872+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 31 ==== osd_op_reply(111 gc.15 [call] v29'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.872+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-05-08T18:34:13.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.872+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:112 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f0224021070 2024-05-08T18:34:13.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.873+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 20 ==== osd_op_reply(112 gc.16 [call] v29'86 uv86 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.873+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:113 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f0224021070 2024-05-08T18:34:13.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.873+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 21 ==== osd_op_reply(113 gc.16 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.873+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.873+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:114 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f0224021070 2024-05-08T18:34:13.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.873+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 22 ==== osd_op_reply(114 gc.16 [call out=24b] v0'0 uv86 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.873+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:115 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f0224021070 2024-05-08T18:34:13.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.874+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 23 ==== osd_op_reply(115 gc.16 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.874+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.874+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:116 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f0224021070 2024-05-08T18:34:13.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.874+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 24 ==== osd_op_reply(116 gc.16 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.874+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.874+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:117 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f0224021070 2024-05-08T18:34:13.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.875+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 25 ==== osd_op_reply(117 gc.16 [call] v29'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.875+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-05-08T18:34:13.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.875+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:118 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.876+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 32 ==== osd_op_reply(118 gc.17 [call] v29'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.876+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:119 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.876+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 33 ==== osd_op_reply(119 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.876+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.876+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:120 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.876+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 34 ==== osd_op_reply(120 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.876+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:121 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.876+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 35 ==== osd_op_reply(121 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.876+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.876+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:122 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.877+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 36 ==== osd_op_reply(122 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.877+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.877+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:123 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.878+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 37 ==== osd_op_reply(123 gc.17 [call] v29'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.878+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-05-08T18:34:13.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.878+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:124 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.879+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 34 ==== osd_op_reply(124 gc.18 [call] v29'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.879+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:125 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.879+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 35 ==== osd_op_reply(125 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.879+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.879+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:126 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.879+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 36 ==== osd_op_reply(126 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.879+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:127 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.880+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 37 ==== osd_op_reply(127 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.880+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.880+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:128 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.880+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 38 ==== osd_op_reply(128 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.880+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.880+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:129 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.881+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 39 ==== osd_op_reply(129 gc.18 [call] v29'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.881+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-05-08T18:34:13.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.881+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:130 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.882+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 40 ==== osd_op_reply(130 gc.19 [call] v29'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.882+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:131 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.882+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 41 ==== osd_op_reply(131 gc.19 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.882+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.882+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:132 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.882+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 42 ==== osd_op_reply(132 gc.19 [call out=24b] v0'0 uv281 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.882+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:133 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.883+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 43 ==== osd_op_reply(133 gc.19 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.883+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.883+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:134 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.883+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 44 ==== osd_op_reply(134 gc.19 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.883+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.883+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:135 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becd5bd0 2024-05-08T18:34:13.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.884+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 45 ==== osd_op_reply(135 gc.19 [call] v29'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.884+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-05-08T18:34:13.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.884+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:136 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.885+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 38 ==== osd_op_reply(136 gc.20 [call] v29'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.885+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:137 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.886+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 39 ==== osd_op_reply(137 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.886+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.886+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:138 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.886+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 40 ==== osd_op_reply(138 gc.20 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.886+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:139 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.886+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 41 ==== osd_op_reply(139 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.886+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.886+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:140 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.886+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 42 ==== osd_op_reply(140 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.886+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.886+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:141 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.887+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 43 ==== osd_op_reply(141 gc.20 [call] v29'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.887+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-05-08T18:34:13.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.887+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:142 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f0224021070 2024-05-08T18:34:13.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.889+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 26 ==== osd_op_reply(142 gc.21 [call] v29'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.889+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:143 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f0224021070 2024-05-08T18:34:13.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.889+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 27 ==== osd_op_reply(143 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.889+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.889+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:144 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f0224021070 2024-05-08T18:34:13.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.889+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 28 ==== osd_op_reply(144 gc.21 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.889+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:145 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f0224021070 2024-05-08T18:34:13.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.889+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 29 ==== osd_op_reply(145 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.889+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.889+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:146 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f0224021070 2024-05-08T18:34:13.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.890+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 30 ==== osd_op_reply(146 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.890+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.890+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:147 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f0224021070 2024-05-08T18:34:13.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.890+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 31 ==== osd_op_reply(147 gc.21 [call] v29'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.890+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-05-08T18:34:13.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.890+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:148 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.891+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 44 ==== osd_op_reply(148 gc.22 [call] v29'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.891+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:149 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.892+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 45 ==== osd_op_reply(149 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.892+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.892+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:150 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.892+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 46 ==== osd_op_reply(150 gc.22 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.892+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:151 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.892+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 47 ==== osd_op_reply(151 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.892+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.892+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:152 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.892+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 48 ==== osd_op_reply(152 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.892+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.892+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:153 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.894+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 49 ==== osd_op_reply(153 gc.22 [call] v29'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.894+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-05-08T18:34:13.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.894+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:154 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.895+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 50 ==== osd_op_reply(154 gc.23 [call] v29'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.895+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:155 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.896+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 51 ==== osd_op_reply(155 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.896+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.896+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:156 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.896+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 52 ==== osd_op_reply(156 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.896+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:157 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.896+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 53 ==== osd_op_reply(157 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.896+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.896+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:158 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.896+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 54 ==== osd_op_reply(158 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.896+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.896+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:159 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.897+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 55 ==== osd_op_reply(159 gc.23 [call] v29'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.897+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-05-08T18:34:13.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.897+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:160 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.898+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 56 ==== osd_op_reply(160 gc.24 [call] v29'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.898+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:161 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.899+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 57 ==== osd_op_reply(161 gc.24 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.899+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.899+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:162 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.899+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 58 ==== osd_op_reply(162 gc.24 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.899+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:163 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.899+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 59 ==== osd_op_reply(163 gc.24 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.899+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.899+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:164 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.899+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 60 ==== osd_op_reply(164 gc.24 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.899+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.899+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:165 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.900+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 61 ==== osd_op_reply(165 gc.24 [call] v29'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.900+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-05-08T18:34:13.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.900+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:166 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.901+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 62 ==== osd_op_reply(166 gc.25 [call] v29'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.901+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:167 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.901+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 63 ==== osd_op_reply(167 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.901+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.901+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:168 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.901+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 64 ==== osd_op_reply(168 gc.25 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.901+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.902+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 65 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.902+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.902+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.902+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 66 ==== osd_op_reply(170 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.902+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.902+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.903+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 67 ==== osd_op_reply(171 gc.25 [call] v29'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.903+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-05-08T18:34:13.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.903+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.904+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 29 ==== osd_op_reply(172 gc.26 [call] v29'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.904+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.904+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 30 ==== osd_op_reply(173 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.904+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.904+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.905+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 31 ==== osd_op_reply(174 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.905+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:175 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.905+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 32 ==== osd_op_reply(175 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.905+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.905+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:176 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.905+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 33 ==== osd_op_reply(176 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.905+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.905+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:177 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.906+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 34 ==== osd_op_reply(177 gc.26 [call] v29'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.906+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-05-08T18:34:13.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.906+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:178 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.907+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 68 ==== osd_op_reply(178 gc.27 [call] v29'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.907+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:179 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.908+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 69 ==== osd_op_reply(179 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.908+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.908+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:180 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.908+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 70 ==== osd_op_reply(180 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.908+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:181 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.908+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 71 ==== osd_op_reply(181 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.908+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.908+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:182 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.908+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 72 ==== osd_op_reply(182 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.908+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.908+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:183 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.909+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 73 ==== osd_op_reply(183 gc.27 [call] v29'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.909+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-05-08T18:34:13.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.909+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:184 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.910+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 35 ==== osd_op_reply(184 gc.28 [call] v29'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.910+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:185 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.911+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 36 ==== osd_op_reply(185 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.911+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.911+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:186 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.911+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 37 ==== osd_op_reply(186 gc.28 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.911+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:187 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.911+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 38 ==== osd_op_reply(187 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.911+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.911+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:188 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.912+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 39 ==== osd_op_reply(188 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.912+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.912+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:189 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.913+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 40 ==== osd_op_reply(189 gc.28 [call] v29'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.913+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-05-08T18:34:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.913+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:190 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.914+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 74 ==== osd_op_reply(190 gc.29 [call] v29'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.914+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:191 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.914+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 75 ==== osd_op_reply(191 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.914+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.914+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:192 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.914+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 76 ==== osd_op_reply(192 gc.29 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.914+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:193 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.914+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 77 ==== osd_op_reply(193 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.914+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.914+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:194 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.915+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 78 ==== osd_op_reply(194 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.915+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.915+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:195 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x5618becdbe20 2024-05-08T18:34:13.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.916+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 79 ==== osd_op_reply(195 gc.29 [call] v29'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.916+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-05-08T18:34:13.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.916+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:196 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.917+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 41 ==== osd_op_reply(196 gc.30 [call] v29'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.917+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:197 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.917+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 42 ==== osd_op_reply(197 gc.30 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.917+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.917+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:198 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.917+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 43 ==== osd_op_reply(198 gc.30 [call out=24b] v0'0 uv67 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.917+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:199 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.917+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 44 ==== osd_op_reply(199 gc.30 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:200 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618becf08f0 con 0x7f021c0a2040 2024-05-08T18:34:13.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 45 ==== osd_op_reply(200 gc.30 [call out=1715b] v0'0 uv67 ondisk = 0) ==== 149+0+1715 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-05-08T18:34:13.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 20 garbage collection: RGWGC::process iterating over entry tag='be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.6291087231410607637', time=2024-05-08T18:34:21.925077+0000, chain.objs.size()=7 2024-05-08T18:34:13.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_1 2024-05-08T18:34:13.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:201 3.2fs0 3:f769aa12:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e6f0 con 0x5618becdbe20 2024-05-08T18:34:13.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_2 2024-05-08T18:34:13.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:202 3.3fs0 3:fed0d742:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec50 con 0x7f0224021070 2024-05-08T18:34:13.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_3 2024-05-08T18:34:13.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:203 3.4s0 3:23a2774c:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed261c0 con 0x7f021c0a2040 2024-05-08T18:34:13.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_4 2024-05-08T18:34:13.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:204 3.20s0 3:075e23a3:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec50 con 0x7f0224021070 2024-05-08T18:34:13.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_5 2024-05-08T18:34:13.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:205 3.1s0 3:80672bf4:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed2afa0 con 0x7f021c0a2040 2024-05-08T18:34:13.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_6 2024-05-08T18:34:13.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:206 3.30s0 3:0efa4c5b:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec50 con 0x5618becdbe20 2024-05-08T18:34:13.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_7 2024-05-08T18:34:13.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.918+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:207 3.22s0 3:45def684:::be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed30090 con 0x5618becdbe20 2024-05-08T18:34:13.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.926+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 32 ==== osd_op_reply(202 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_2 [call] v29'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.926+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 46 ==== osd_op_reply(203 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_3 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.926+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 47 ==== osd_op_reply(205 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_5 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.926+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 33 ==== osd_op_reply(204 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_4 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.927+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 80 ==== osd_op_reply(201 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_1 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.927+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 81 ==== osd_op_reply(206 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_6 [call] v29'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.927+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 82 ==== osd_op_reply(207 be5b96a9-27d9-41bc-99e2-d41218f7be5a.4221.11__shadow_.n97VqGrawa0V5IyOLN4euZugMnIaMPA_7 [call] v29'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.927+0000 7f022df2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-05-08T18:34:13.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.927+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:208 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec50 con 0x7f021c0a2040 2024-05-08T18:34:13.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.933+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 48 ==== osd_op_reply(208 gc.30 [call] v29'68 uv68 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.933+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:209 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec50 con 0x7f021c0a2040 2024-05-08T18:34:13.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.934+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 49 ==== osd_op_reply(209 gc.30 [call] v29'69 uv69 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.934+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-05-08T18:34:13.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.934+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:210 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec50 con 0x7f0224021070 2024-05-08T18:34:13.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.935+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 34 ==== osd_op_reply(210 gc.31 [call] v29'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.935+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:211 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x7f0224021070 2024-05-08T18:34:13.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.935+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 35 ==== osd_op_reply(211 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.935+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.935+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:212 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x7f0224021070 2024-05-08T18:34:13.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.936+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 36 ==== osd_op_reply(212 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.936+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:213 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x7f0224021070 2024-05-08T18:34:13.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.936+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 37 ==== osd_op_reply(213 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.936+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.936+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:214 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x7f0224021070 2024-05-08T18:34:13.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.936+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 38 ==== osd_op_reply(214 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.936+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.936+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:215 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x7f0224021070 2024-05-08T18:34:13.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.937+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 39 ==== osd_op_reply(215 gc.31 [call] v29'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.938+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-05-08T18:34:13.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.938+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:216 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becd5bd0 2024-05-08T18:34:13.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.939+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 46 ==== osd_op_reply(216 gc.0 [call] v29'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.939+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:217 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becd5bd0 2024-05-08T18:34:13.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.939+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 47 ==== osd_op_reply(217 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.939+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.939+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:218 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becd5bd0 2024-05-08T18:34:13.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.940+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 48 ==== osd_op_reply(218 gc.0 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.940+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:219 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becd5bd0 2024-05-08T18:34:13.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.940+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 49 ==== osd_op_reply(219 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.940+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.940+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:220 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becd5bd0 2024-05-08T18:34:13.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.940+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 50 ==== osd_op_reply(220 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.940+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.940+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:221 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becd5bd0 2024-05-08T18:34:13.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.941+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 51 ==== osd_op_reply(221 gc.0 [call] v29'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.941+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-05-08T18:34:13.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.941+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:222 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x7f021c0a2040 2024-05-08T18:34:13.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.942+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 50 ==== osd_op_reply(222 gc.1 [call] v29'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.942+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:223 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x7f021c0a2040 2024-05-08T18:34:13.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.943+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 51 ==== osd_op_reply(223 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.943+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.943+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:224 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x7f021c0a2040 2024-05-08T18:34:13.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.943+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 52 ==== osd_op_reply(224 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.943+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:225 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x7f021c0a2040 2024-05-08T18:34:13.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.943+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 53 ==== osd_op_reply(225 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.943+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.943+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:226 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x7f021c0a2040 2024-05-08T18:34:13.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.943+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 54 ==== osd_op_reply(226 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.943+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.943+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:227 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x7f021c0a2040 2024-05-08T18:34:13.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.944+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 55 ==== osd_op_reply(227 gc.1 [call] v29'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.944+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-05-08T18:34:13.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.944+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:228 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becdbe20 2024-05-08T18:34:13.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.945+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 83 ==== osd_op_reply(228 gc.2 [call] v29'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.945+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:229 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becdbe20 2024-05-08T18:34:13.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.946+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 84 ==== osd_op_reply(229 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.946+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.946+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:230 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becdbe20 2024-05-08T18:34:13.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.946+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 85 ==== osd_op_reply(230 gc.2 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.946+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:231 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becdbe20 2024-05-08T18:34:13.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.946+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 86 ==== osd_op_reply(231 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.946+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.946+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:232 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becdbe20 2024-05-08T18:34:13.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.946+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 87 ==== osd_op_reply(232 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.946+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.946+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:233 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becdbe20 2024-05-08T18:34:13.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.947+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 88 ==== osd_op_reply(233 gc.2 [call] v29'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.947+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-05-08T18:34:13.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.947+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:234 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becd5bd0 2024-05-08T18:34:13.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.948+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 52 ==== osd_op_reply(234 gc.3 [call] v29'283 uv283 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.948+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:235 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becd5bd0 2024-05-08T18:34:13.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.948+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 53 ==== osd_op_reply(235 gc.3 [call out=15b] v0'0 uv283 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.948+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.948+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:236 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becd5bd0 2024-05-08T18:34:13.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.949+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 54 ==== osd_op_reply(236 gc.3 [call out=24b] v0'0 uv283 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.949+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:237 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becd5bd0 2024-05-08T18:34:13.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.949+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 55 ==== osd_op_reply(237 gc.3 [call out=15b] v0'0 uv283 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.949+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.949+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:238 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becd5bd0 2024-05-08T18:34:13.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.949+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 56 ==== osd_op_reply(238 gc.3 [call out=15b] v0'0 uv283 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.949+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.949+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:239 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x5618becd5bd0 2024-05-08T18:34:13.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.950+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 57 ==== osd_op_reply(239 gc.3 [call] v29'284 uv284 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.950+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-05-08T18:34:13.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.950+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:240 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x7f0224021070 2024-05-08T18:34:13.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.951+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 40 ==== osd_op_reply(240 gc.4 [call] v29'88 uv88 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.951+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:241 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1ec00 con 0x7f0224021070 2024-05-08T18:34:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.951+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 41 ==== osd_op_reply(241 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.951+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.951+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:242 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.952+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 42 ==== osd_op_reply(242 gc.4 [call out=24b] v0'0 uv88 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.952+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:243 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.952+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 43 ==== osd_op_reply(243 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.952+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.952+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:244 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.952+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 44 ==== osd_op_reply(244 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.952+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.952+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:245 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.953+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 45 ==== osd_op_reply(245 gc.4 [call] v29'89 uv89 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.953+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-05-08T18:34:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.953+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:246 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becdbe20 2024-05-08T18:34:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.954+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 89 ==== osd_op_reply(246 gc.5 [call] v29'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.954+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:247 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becdbe20 2024-05-08T18:34:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.954+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 90 ==== osd_op_reply(247 gc.5 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.954+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.954+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:248 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becdbe20 2024-05-08T18:34:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.954+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 91 ==== osd_op_reply(248 gc.5 [call out=24b] v0'0 uv61 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.954+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:249 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becdbe20 2024-05-08T18:34:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.954+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 92 ==== osd_op_reply(249 gc.5 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.954+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.954+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:250 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becdbe20 2024-05-08T18:34:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.955+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 93 ==== osd_op_reply(250 gc.5 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.955+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.955+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:251 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becdbe20 2024-05-08T18:34:13.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.956+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 94 ==== osd_op_reply(251 gc.5 [call] v29'62 uv62 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.956+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-05-08T18:34:13.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.956+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:252 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becd5bd0 2024-05-08T18:34:13.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.957+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 58 ==== osd_op_reply(252 gc.6 [call] v29'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.957+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:253 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becd5bd0 2024-05-08T18:34:13.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.957+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 59 ==== osd_op_reply(253 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.957+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.957+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:254 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becd5bd0 2024-05-08T18:34:13.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.957+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 60 ==== osd_op_reply(254 gc.6 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.957+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:255 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becd5bd0 2024-05-08T18:34:13.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.957+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 61 ==== osd_op_reply(255 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.957+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.957+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:256 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becd5bd0 2024-05-08T18:34:13.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.958+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 62 ==== osd_op_reply(256 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.958+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.958+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:257 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becd5bd0 2024-05-08T18:34:13.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.959+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 63 ==== osd_op_reply(257 gc.6 [call] v29'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.959+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-05-08T18:34:13.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.959+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:258 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f021c0a2040 2024-05-08T18:34:13.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.960+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 56 ==== osd_op_reply(258 gc.7 [call] v29'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.960+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:259 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f021c0a2040 2024-05-08T18:34:13.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.960+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 57 ==== osd_op_reply(259 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.960+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.960+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:260 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f021c0a2040 2024-05-08T18:34:13.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.960+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 58 ==== osd_op_reply(260 gc.7 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.960+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:261 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f021c0a2040 2024-05-08T18:34:13.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.960+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 59 ==== osd_op_reply(261 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.961+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.961+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:262 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f021c0a2040 2024-05-08T18:34:13.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.961+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 60 ==== osd_op_reply(262 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.961+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.961+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:263 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f021c0a2040 2024-05-08T18:34:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.962+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 61 ==== osd_op_reply(263 gc.7 [call] v29'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.962+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-05-08T18:34:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.962+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:264 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.963+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 46 ==== osd_op_reply(264 gc.8 [call] v29'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.963+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:265 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.963+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 47 ==== osd_op_reply(265 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.963+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.963+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:266 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.963+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 48 ==== osd_op_reply(266 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.963+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:267 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.964+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 49 ==== osd_op_reply(267 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.964+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.964+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:268 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.964+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 50 ==== osd_op_reply(268 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.964+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.964+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:269 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.965+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 51 ==== osd_op_reply(269 gc.8 [call] v29'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.965+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-05-08T18:34:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.965+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:270 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becdbe20 2024-05-08T18:34:13.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.966+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 95 ==== osd_op_reply(270 gc.9 [call] v29'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.966+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:271 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becdbe20 2024-05-08T18:34:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.966+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 96 ==== osd_op_reply(271 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.967+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.967+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:272 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becdbe20 2024-05-08T18:34:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.967+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 97 ==== osd_op_reply(272 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.967+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:273 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becdbe20 2024-05-08T18:34:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.967+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 98 ==== osd_op_reply(273 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.967+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.967+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:274 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becdbe20 2024-05-08T18:34:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.967+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 99 ==== osd_op_reply(274 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.967+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.967+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:275 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becdbe20 2024-05-08T18:34:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.968+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 100 ==== osd_op_reply(275 gc.9 [call] v29'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.968+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-05-08T18:34:13.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.968+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:276 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.969+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 52 ==== osd_op_reply(276 gc.10 [call] v29'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.969+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:277 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.969+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 53 ==== osd_op_reply(277 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.969+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.969+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:278 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.969+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 54 ==== osd_op_reply(278 gc.10 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.969+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:279 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.970+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 55 ==== osd_op_reply(279 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.970+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.970+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:280 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.970+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 56 ==== osd_op_reply(280 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.970+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.970+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:281 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.971+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 57 ==== osd_op_reply(281 gc.10 [call] v29'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.971+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-05-08T18:34:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.971+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:282 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f021c0a2040 2024-05-08T18:34:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.972+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 62 ==== osd_op_reply(282 gc.11 [call] v29'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.972+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:283 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f021c0a2040 2024-05-08T18:34:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.972+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 63 ==== osd_op_reply(283 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.972+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.972+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:284 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f021c0a2040 2024-05-08T18:34:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.973+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 64 ==== osd_op_reply(284 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.973+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:285 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f021c0a2040 2024-05-08T18:34:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.973+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 65 ==== osd_op_reply(285 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.973+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.973+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:286 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f021c0a2040 2024-05-08T18:34:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.973+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 66 ==== osd_op_reply(286 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.973+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.973+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:287 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f021c0a2040 2024-05-08T18:34:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.974+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 67 ==== osd_op_reply(287 gc.11 [call] v29'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.974+0000 7f022df2e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-05-08T18:34:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.974+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:288 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.975+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 58 ==== osd_op_reply(288 gc.12 [call] v29'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.975+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:289 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.975+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 59 ==== osd_op_reply(289 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.975+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.975+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:290 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.976+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 60 ==== osd_op_reply(290 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.976+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:291 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.976+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 61 ==== osd_op_reply(291 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.976+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:34:13.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.976+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:292 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.976+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 62 ==== osd_op_reply(292 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.976+0000 7f022df2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:34:13.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.976+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:293 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.977+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 63 ==== osd_op_reply(293 gc.12 [call] v29'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.978+0000 7f00dbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:34:13.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.978+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94664280401360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becd5bd0 2024-05-08T18:34:13.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.979+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94664280401360] v29'285 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.979+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94664280376608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.980+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94664280376608] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.980+0000 7f022df2e800 20 remove_watcher() i=0 2024-05-08T18:34:13.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.980+0000 7f022df2e800 2 removed watcher, disabling cache 2024-05-08T18:34:13.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.980+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94664280382464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becd5bd0 2024-05-08T18:34:13.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.981+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94664280382464] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.981+0000 7f022df2e800 20 remove_watcher() i=1 2024-05-08T18:34:13.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.981+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94664280384672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becdbe20 2024-05-08T18:34:13.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.983+0000 7f022a461640 1 -- 172.21.15.87:0/2132893184 <== osd.3 v2:172.21.15.87:6800/2929215285 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94664280384672] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0224061040 con 0x5618becdbe20 2024-05-08T18:34:13.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.983+0000 7f022df2e800 20 remove_watcher() i=2 2024-05-08T18:34:13.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.983+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94664280385728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f0224021070 2024-05-08T18:34:13.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.983+0000 7f0229c60640 1 -- 172.21.15.87:0/2132893184 <== osd.2 v2:172.21.15.87:6816/2108501615 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94664280385728] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c088040 con 0x7f0224021070 2024-05-08T18:34:13.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.984+0000 7f022df2e800 20 remove_watcher() i=3 2024-05-08T18:34:13.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.984+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94664280392352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x5618becd5bd0 2024-05-08T18:34:13.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.985+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.1 v2:172.21.15.87:6808/2448644045 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94664280392352] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021402a040 con 0x5618becd5bd0 2024-05-08T18:34:13.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.985+0000 7f022df2e800 20 remove_watcher() i=4 2024-05-08T18:34:13.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.985+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94664280393888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f021c0a2040 2024-05-08T18:34:13.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.986+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94664280393888] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.986+0000 7f022df2e800 20 remove_watcher() i=5 2024-05-08T18:34:13.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.986+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94664280396416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f021c0a2040 2024-05-08T18:34:13.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.987+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94664280396416] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.987+0000 7f022df2e800 20 remove_watcher() i=6 2024-05-08T18:34:13.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.987+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94664280398912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5618bed1e240 con 0x7f021c0a2040 2024-05-08T18:34:13.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 <== osd.0 v2:172.21.15.53:6800/443747735 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94664280398912] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021402a040 con 0x7f021c0a2040 2024-05-08T18:34:13.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 20 remove_watcher() i=7 2024-05-08T18:34:13.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f021c0a2040 msgr2=0x7f021c05b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:13.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f021c0a2040 0x7f021c05b7c0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5618becd5bd0 msgr2=0x5618becd8090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:13.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5618becd5bd0 0x5618becd8090 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f0224021070 msgr2=0x7f02240549e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:13.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f0224021070 0x7f02240549e0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5618becdbe20 msgr2=0x5618becde230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:13.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x5618becdbe20 0x5618becde230 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f00f403bb50 msgr2=0x7f00f403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:13.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f00f403bb50 0x7f00f403e010 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f021c052450 tx=0x7f021c08d000 comp rx=0 tx=0).stop 2024-05-08T18:34:13.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9f300 msgr2=0x5618becca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:13.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022945f640 1 -- 172.21.15.87:0/2132893184 reap_dead start 2024-05-08T18:34:13.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9f300 0x5618becca110 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x5618becbba10 tx=0x7f02240529a0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 shutdown_connections 2024-05-08T18:34:13.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 --2- 172.21.15.87:0/2132893184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9f300 0x5618becca110 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 >> 172.21.15.87:0/2132893184 conn(0x5618becbcc20 msgr2=0x5618becba2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:13.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 shutdown_connections 2024-05-08T18:34:13.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 -- 172.21.15.87:0/2132893184 wait complete. 2024-05-08T18:34:13.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 -- 172.21.15.87:0/1309497949 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f010403bba0 msgr2=0x7f010403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:13.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 --2- 172.21.15.87:0/1309497949 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f010403bba0 0x7f010403e060 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f021c06f000 tx=0x7f021c05df10 comp rx=0 tx=0).stop 2024-05-08T18:34:13.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 -- 172.21.15.87:0/1309497949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618becb3610 msgr2=0x5618becb3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:13.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 --2- 172.21.15.87:0/1309497949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618becb3610 0x5618becb3a30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x5618bec994e0 tx=0x7f022400ef30 comp rx=0 tx=0).stop 2024-05-08T18:34:13.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 -- 172.21.15.87:0/1309497949 shutdown_connections 2024-05-08T18:34:13.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 --2- 172.21.15.87:0/1309497949 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f010403bba0 0x7f010403e060 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 --2- 172.21.15.87:0/1309497949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618becb3610 0x5618becb3a30 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 -- 172.21.15.87:0/1309497949 >> 172.21.15.87:0/1309497949 conn(0x5618beca76b0 msgr2=0x5618beca7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:13.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 -- 172.21.15.87:0/1309497949 shutdown_connections 2024-05-08T18:34:13.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.988+0000 7f022df2e800 1 -- 172.21.15.87:0/1309497949 wait complete. 2024-05-08T18:34:13.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.989+0000 7f022df2e800 1 -- 172.21.15.87:0/1808892379 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5618beca2a60 msgr2=0x5618beca4e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:13.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.989+0000 7f022df2e800 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5618beca2a60 0x5618beca4e50 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.989+0000 7f022df2e800 1 -- 172.21.15.87:0/1808892379 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5618beba2600 msgr2=0x5618bec9f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:13.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.989+0000 7f022df2e800 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5618beba2600 0x5618bec9f320 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.989+0000 7f022df2e800 1 -- 172.21.15.87:0/1808892379 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f011003bba0 msgr2=0x7f011003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.989+0000 7f022df2e800 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f011003bba0 0x7f011003e060 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0214000f60 tx=0x7f02140012b0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.989+0000 7f022df2e800 1 -- 172.21.15.87:0/1808892379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 msgr2=0x5618bec980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.989+0000 7f022df2e800 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 0x5618bec980e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f021c0526d0 tx=0x7f021c003330 comp rx=0 tx=0).stop 2024-05-08T18:34:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.989+0000 7f022df2e800 1 -- 172.21.15.87:0/1808892379 shutdown_connections 2024-05-08T18:34:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.989+0000 7f022df2e800 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x5618beba2600 0x5618bec9f320 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.989+0000 7f022df2e800 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x5618beca2a60 0x5618beca4e50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.989+0000 7f022df2e800 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f011003bba0 0x7f011003e060 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.989+0000 7f022df2e800 1 --2- 172.21.15.87:0/1808892379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618beb9fcd0 0x5618bec980e0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.989+0000 7f022df2e800 1 -- 172.21.15.87:0/1808892379 >> 172.21.15.87:0/1808892379 conn(0x5618beb99720 msgr2=0x5618bec8a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.989+0000 7f022df2e800 1 -- 172.21.15.87:0/1808892379 shutdown_connections 2024-05-08T18:34:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-08T18:34:13.989+0000 7f022df2e800 1 -- 172.21.15.87:0/1808892379 wait complete. 2024-05-08T18:34:13.996 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-08T18:34:14.008 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T18:34:14.008 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:34:14.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.115+0000 7f621f2ae640 1 Processor -- start 2024-05-08T18:34:14.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.115+0000 7f621f2ae640 1 -- start start 2024-05-08T18:34:14.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.116+0000 7f621f2ae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6218130520 0x7f6218132910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:14.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.116+0000 7f621f2ae640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f621812d590 con 0x7f621812d1b0 2024-05-08T18:34:14.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.116+0000 7f621f2ae640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f6218114de0 con 0x7f6218130520 2024-05-08T18:34:14.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.116+0000 7f621c849640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6218130520 0x7f6218132910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:14.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.116+0000 7f621d04a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f621812d1b0 0x7f621812d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40932/0 (socket says 172.21.15.53:40932) 2024-05-08T18:34:14.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.116+0000 7f621d04a640 1 -- 172.21.15.53:0/44891206 learned_addr learned my addr 172.21.15.53:0/44891206 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:34:14.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.116+0000 7f621c849640 1 -- 172.21.15.53:0/44891206 >> v1:172.21.15.53:6789/0 conn(0x7f621812d1b0 legacy=0x7f621812d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:14.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.116+0000 7f621c849640 1 -- 172.21.15.53:0/44891206 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6218113c30 con 0x7f6218130520 2024-05-08T18:34:14.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.117+0000 7f621c849640 1 --2- 172.21.15.53:0/44891206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6218130520 0x7f6218132910 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f6208009720 tx=0x7f620802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31204a81b9aa925 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:14.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.117+0000 7f620ffff640 1 -- 172.21.15.53:0/44891206 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62080316d0 con 0x7f6218130520 2024-05-08T18:34:14.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.117+0000 7f620ffff640 1 -- 172.21.15.53:0/44891206 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6208037070 con 0x7f6218130520 2024-05-08T18:34:14.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.117+0000 7f620ffff640 1 -- 172.21.15.53:0/44891206 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62080319c0 con 0x7f6218130520 2024-05-08T18:34:14.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.117+0000 7f621f2ae640 1 -- 172.21.15.53:0/44891206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6218130520 msgr2=0x7f6218132910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:14.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.117+0000 7f621f2ae640 1 --2- 172.21.15.53:0/44891206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6218130520 0x7f6218132910 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f6208009720 tx=0x7f620802b840 comp rx=0 tx=0).stop 2024-05-08T18:34:14.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.117+0000 7f621f2ae640 1 -- 172.21.15.53:0/44891206 shutdown_connections 2024-05-08T18:34:14.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.117+0000 7f621f2ae640 1 --2- 172.21.15.53:0/44891206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6218130520 0x7f6218132910 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:14.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.117+0000 7f621f2ae640 1 -- 172.21.15.53:0/44891206 >> 172.21.15.53:0/44891206 conn(0x7f621809a910 msgr2=0x7f621806e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:14.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.118+0000 7f621f2ae640 1 -- 172.21.15.53:0/44891206 shutdown_connections 2024-05-08T18:34:14.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.118+0000 7f621f2ae640 1 -- 172.21.15.53:0/44891206 wait complete. 2024-05-08T18:34:14.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.118+0000 7f621f2ae640 1 Processor -- start 2024-05-08T18:34:14.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.118+0000 7f621f2ae640 1 -- start start 2024-05-08T18:34:14.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.119+0000 7f621f2ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f621812d1b0 0x7f6218123810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:14.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.119+0000 7f621f2ae640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6218132fd0 con 0x7f621812d1b0 2024-05-08T18:34:14.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.119+0000 7f621d04a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f621812d1b0 0x7f6218123810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:14.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.119+0000 7f621d04a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f621812d1b0 0x7f6218123810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41084/0 (socket says 172.21.15.53:41084) 2024-05-08T18:34:14.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.119+0000 7f621d04a640 1 -- 172.21.15.53:0/1325642501 learned_addr learned my addr 172.21.15.53:0/1325642501 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:34:14.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.119+0000 7f621d04a640 1 -- 172.21.15.53:0/1325642501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6218132a40 con 0x7f621812d1b0 2024-05-08T18:34:14.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.119+0000 7f621d04a640 1 --2- 172.21.15.53:0/1325642501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f621812d1b0 0x7f6218123810 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f621400c480 tx=0x7f621400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:14.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.119+0000 7f620dffb640 1 -- 172.21.15.53:0/1325642501 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6214017070 con 0x7f621812d1b0 2024-05-08T18:34:14.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.119+0000 7f620dffb640 1 -- 172.21.15.53:0/1325642501 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6214005c10 con 0x7f621812d1b0 2024-05-08T18:34:14.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.119+0000 7f621f2ae640 1 -- 172.21.15.53:0/1325642501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6218128fd0 con 0x7f621812d1b0 2024-05-08T18:34:14.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.119+0000 7f620dffb640 1 -- 172.21.15.53:0/1325642501 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62140070d0 con 0x7f621812d1b0 2024-05-08T18:34:14.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.120+0000 7f621f2ae640 1 -- 172.21.15.53:0/1325642501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6218123f30 con 0x7f621812d1b0 2024-05-08T18:34:14.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.121+0000 7f620dffb640 1 -- 172.21.15.53:0/1325642501 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f621401a070 con 0x7f621812d1b0 2024-05-08T18:34:14.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.121+0000 7f621f2ae640 1 -- 172.21.15.53:0/1325642501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6218064010 con 0x7f621812d1b0 2024-05-08T18:34:14.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.121+0000 7f620dffb640 1 --2- 172.21.15.53:0/1325642501 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f61fc03d2b0 0x7f61fc03f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:14.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.121+0000 7f620dffb640 1 -- 172.21.15.53:0/1325642501 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f6214051080 con 0x7f621812d1b0 2024-05-08T18:34:14.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.121+0000 7f621c849640 1 --2- 172.21.15.53:0/1325642501 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f61fc03d2b0 0x7f61fc03f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:14.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.122+0000 7f621c849640 1 --2- 172.21.15.53:0/1325642501 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f61fc03d2b0 0x7f61fc03f770 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6208036000 tx=0x7f6208008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:14.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.126+0000 7f620dffb640 1 -- 172.21.15.53:0/1325642501 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6214010c90 con 0x7f621812d1b0 2024-05-08T18:34:14.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.313+0000 7f621f2ae640 1 -- 172.21.15.53:0/1325642501 --> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6218129200 con 0x7f61fc03d2b0 2024-05-08T18:34:14.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.329+0000 7f620dffb640 1 -- 172.21.15.53:0/1325642501 <== mgr.4102 v2:172.21.15.87:6824/211215191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665928 (secure 0 0 0) 0x7f6218129200 con 0x7f61fc03d2b0 2024-05-08T18:34:14.336 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:34:14.342 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:34:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.333+0000 7f621f2ae640 1 -- 172.21.15.53:0/1325642501 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f61fc03d2b0 msgr2=0x7f61fc03f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.333+0000 7f621f2ae640 1 --2- 172.21.15.53:0/1325642501 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f61fc03d2b0 0x7f61fc03f770 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6208036000 tx=0x7f6208008030 comp rx=0 tx=0).stop 2024-05-08T18:34:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.333+0000 7f621f2ae640 1 -- 172.21.15.53:0/1325642501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f621812d1b0 msgr2=0x7f6218123810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.333+0000 7f621f2ae640 1 --2- 172.21.15.53:0/1325642501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f621812d1b0 0x7f6218123810 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f621400c480 tx=0x7f621400c940 comp rx=0 tx=0).stop 2024-05-08T18:34:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.333+0000 7f621f2ae640 1 -- 172.21.15.53:0/1325642501 shutdown_connections 2024-05-08T18:34:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.333+0000 7f621f2ae640 1 --2- 172.21.15.53:0/1325642501 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f61fc03d2b0 0x7f61fc03f770 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.333+0000 7f621f2ae640 1 --2- 172.21.15.53:0/1325642501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f621812d1b0 0x7f6218123810 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.333+0000 7f621f2ae640 1 -- 172.21.15.53:0/1325642501 >> 172.21.15.53:0/1325642501 conn(0x7f621809a910 msgr2=0x7f621812f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.333+0000 7f621f2ae640 1 -- 172.21.15.53:0/1325642501 shutdown_connections 2024-05-08T18:34:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.333+0000 7f621f2ae640 1 -- 172.21.15.53:0/1325642501 wait complete. 2024-05-08T18:34:14.346 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-05-08T18:34:14.164174+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416885,"num_objects":227,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4839,"num_read_kb":4421,"num_write":2046,"num_write_kb":60584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4431,"ondisk_log_size":4431,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":173552,"kb_used_data":36368,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377313808,"statfs":{"total":386547056640,"available":386369339392,"internally_reserved":0,"allocated":37240832,"data_stored":36146218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815783,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003684"},"pg_stats":[{"pgid":"3.3f","version":"29'3","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176450+0000","last_change":"2024-05-08T18:30:58.305519+0000","last_active":"2024-05-08T18:33:03.176450+0000","last_peered":"2024-05-08T18:33:03.176450+0000","last_clean":"2024-05-08T18:33:03.176450+0000","last_became_active":"2024-05-08T18:30:58.305175+0000","last_became_peered":"2024-05-08T18:30:58.305175+0000","last_unstale":"2024-05-08T18:33:03.176450+0000","last_undegraded":"2024-05-08T18:33:03.176450+0000","last_fullsized":"2024-05-08T18:33:03.176450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:04.148371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271698+0000","last_change":"2024-05-08T18:31:00.285719+0000","last_active":"2024-05-08T18:34:07.271698+0000","last_peered":"2024-05-08T18:34:07.271698+0000","last_clean":"2024-05-08T18:34:07.271698+0000","last_became_active":"2024-05-08T18:31:00.284574+0000","last_became_peered":"2024-05-08T18:31:00.284574+0000","last_unstale":"2024-05-08T18:34:07.271698+0000","last_undegraded":"2024-05-08T18:34:07.271698+0000","last_fullsized":"2024-05-08T18:34:07.271698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:40.256644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331029+0000","last_change":"2024-05-08T18:30:58.289175+0000","last_active":"2024-05-08T18:31:45.331029+0000","last_peered":"2024-05-08T18:31:45.331029+0000","last_clean":"2024-05-08T18:31:45.331029+0000","last_became_active":"2024-05-08T18:30:58.288674+0000","last_became_peered":"2024-05-08T18:30:58.288674+0000","last_unstale":"2024-05-08T18:31:45.331029+0000","last_undegraded":"2024-05-08T18:31:45.331029+0000","last_fullsized":"2024-05-08T18:31:45.331029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:34.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329085+0000","last_change":"2024-05-08T18:31:00.299098+0000","last_active":"2024-05-08T18:31:45.329085+0000","last_peered":"2024-05-08T18:31:45.329085+0000","last_clean":"2024-05-08T18:31:45.329085+0000","last_became_active":"2024-05-08T18:31:00.298145+0000","last_became_peered":"2024-05-08T18:31:00.298145+0000","last_unstale":"2024-05-08T18:31:45.329085+0000","last_undegraded":"2024-05-08T18:31:45.329085+0000","last_fullsized":"2024-05-08T18:31:45.329085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:38.415030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331384+0000","last_change":"2024-05-08T18:30:58.306369+0000","last_active":"2024-05-08T18:31:45.331384+0000","last_peered":"2024-05-08T18:31:45.331384+0000","last_clean":"2024-05-08T18:31:45.331384+0000","last_became_active":"2024-05-08T18:30:58.304442+0000","last_became_peered":"2024-05-08T18:30:58.304442+0000","last_unstale":"2024-05-08T18:31:45.331384+0000","last_undegraded":"2024-05-08T18:31:45.331384+0000","last_fullsized":"2024-05-08T18:31:45.331384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:28.002025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328805+0000","last_change":"2024-05-08T18:31:00.298725+0000","last_active":"2024-05-08T18:31:45.328805+0000","last_peered":"2024-05-08T18:31:45.328805+0000","last_clean":"2024-05-08T18:31:45.328805+0000","last_became_active":"2024-05-08T18:31:00.297810+0000","last_became_peered":"2024-05-08T18:31:00.297810+0000","last_unstale":"2024-05-08T18:31:45.328805+0000","last_undegraded":"2024-05-08T18:31:45.328805+0000","last_fullsized":"2024-05-08T18:31:45.328805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:59.418481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330833+0000","last_change":"2024-05-08T18:30:58.295957+0000","last_active":"2024-05-08T18:31:45.330833+0000","last_peered":"2024-05-08T18:31:45.330833+0000","last_clean":"2024-05-08T18:31:45.330833+0000","last_became_active":"2024-05-08T18:30:58.295569+0000","last_became_peered":"2024-05-08T18:30:58.295569+0000","last_unstale":"2024-05-08T18:31:45.330833+0000","last_undegraded":"2024-05-08T18:31:45.330833+0000","last_fullsized":"2024-05-08T18:31:45.330833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:23:31.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271931+0000","last_change":"2024-05-08T18:31:00.296029+0000","last_active":"2024-05-08T18:34:07.271931+0000","last_peered":"2024-05-08T18:34:07.271931+0000","last_clean":"2024-05-08T18:34:07.271931+0000","last_became_active":"2024-05-08T18:31:00.295611+0000","last_became_peered":"2024-05-08T18:31:00.295611+0000","last_unstale":"2024-05-08T18:34:07.271931+0000","last_undegraded":"2024-05-08T18:34:07.271931+0000","last_fullsized":"2024-05-08T18:34:07.271931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:48.739053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328670+0000","last_change":"2024-05-08T18:30:58.313349+0000","last_active":"2024-05-08T18:31:45.328670+0000","last_peered":"2024-05-08T18:31:45.328670+0000","last_clean":"2024-05-08T18:31:45.328670+0000","last_became_active":"2024-05-08T18:30:58.313003+0000","last_became_peered":"2024-05-08T18:30:58.313003+0000","last_unstale":"2024-05-08T18:31:45.328670+0000","last_undegraded":"2024-05-08T18:31:45.328670+0000","last_fullsized":"2024-05-08T18:31:45.328670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:28.678138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'4","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.338700+0000","last_change":"2024-05-08T18:31:00.281345+0000","last_active":"2024-05-08T18:31:45.338700+0000","last_peered":"2024-05-08T18:31:45.338700+0000","last_clean":"2024-05-08T18:31:45.338700+0000","last_became_active":"2024-05-08T18:31:00.281065+0000","last_became_peered":"2024-05-08T18:31:00.281065+0000","last_unstale":"2024-05-08T18:31:45.338700+0000","last_undegraded":"2024-05-08T18:31:45.338700+0000","last_fullsized":"2024-05-08T18:31:45.338700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:58.735465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.335229+0000","last_change":"2024-05-08T18:30:58.308072+0000","last_active":"2024-05-08T18:31:45.335229+0000","last_peered":"2024-05-08T18:31:45.335229+0000","last_clean":"2024-05-08T18:31:45.335229+0000","last_became_active":"2024-05-08T18:30:58.307687+0000","last_became_peered":"2024-05-08T18:30:58.307687+0000","last_unstale":"2024-05-08T18:31:45.335229+0000","last_undegraded":"2024-05-08T18:31:45.335229+0000","last_fullsized":"2024-05-08T18:31:45.335229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:33.986082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.966056+0000","last_change":"2024-05-08T18:31:00.299642+0000","last_active":"2024-05-08T18:34:06.966056+0000","last_peered":"2024-05-08T18:34:06.966056+0000","last_clean":"2024-05-08T18:34:06.966056+0000","last_became_active":"2024-05-08T18:31:00.298978+0000","last_became_peered":"2024-05-08T18:31:00.298978+0000","last_unstale":"2024-05-08T18:34:06.966056+0000","last_undegraded":"2024-05-08T18:34:06.966056+0000","last_fullsized":"2024-05-08T18:34:06.966056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:30.577543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328768+0000","last_change":"2024-05-08T18:30:58.309859+0000","last_active":"2024-05-08T18:31:45.328768+0000","last_peered":"2024-05-08T18:31:45.328768+0000","last_clean":"2024-05-08T18:31:45.328768+0000","last_became_active":"2024-05-08T18:30:58.308931+0000","last_became_peered":"2024-05-08T18:30:58.308931+0000","last_unstale":"2024-05-08T18:31:45.328768+0000","last_undegraded":"2024-05-08T18:31:45.328768+0000","last_fullsized":"2024-05-08T18:31:45.328768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:40:28.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'7","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.333875+0000","last_change":"2024-05-08T18:31:00.295747+0000","last_active":"2024-05-08T18:34:07.333875+0000","last_peered":"2024-05-08T18:34:07.333875+0000","last_clean":"2024-05-08T18:34:07.333875+0000","last_became_active":"2024-05-08T18:31:00.295472+0000","last_became_peered":"2024-05-08T18:31:00.295472+0000","last_unstale":"2024-05-08T18:34:07.333875+0000","last_undegraded":"2024-05-08T18:34:07.333875+0000","last_fullsized":"2024-05-08T18:34:07.333875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:40.256644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329487+0000","last_change":"2024-05-08T18:30:58.295024+0000","last_active":"2024-05-08T18:31:45.329487+0000","last_peered":"2024-05-08T18:31:45.329487+0000","last_clean":"2024-05-08T18:31:45.329487+0000","last_became_active":"2024-05-08T18:30:58.294511+0000","last_became_peered":"2024-05-08T18:30:58.294511+0000","last_unstale":"2024-05-08T18:31:45.329487+0000","last_undegraded":"2024-05-08T18:31:45.329487+0000","last_fullsized":"2024-05-08T18:31:45.329487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:33.046479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.581305+0000","last_change":"2024-05-08T18:31:00.291471+0000","last_active":"2024-05-08T18:33:06.581305+0000","last_peered":"2024-05-08T18:33:06.581305+0000","last_clean":"2024-05-08T18:33:06.581305+0000","last_became_active":"2024-05-08T18:31:00.291203+0000","last_became_peered":"2024-05-08T18:31:00.291203+0000","last_unstale":"2024-05-08T18:33:06.581305+0000","last_undegraded":"2024-05-08T18:33:06.581305+0000","last_fullsized":"2024-05-08T18:33:06.581305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:21.913096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196716+0000","last_change":"2024-05-08T18:31:00.291351+0000","last_active":"2024-05-08T18:34:07.196716+0000","last_peered":"2024-05-08T18:34:07.196716+0000","last_clean":"2024-05-08T18:34:07.196716+0000","last_became_active":"2024-05-08T18:31:00.290806+0000","last_became_peered":"2024-05-08T18:31:00.290806+0000","last_unstale":"2024-05-08T18:34:07.196716+0000","last_undegraded":"2024-05-08T18:34:07.196716+0000","last_fullsized":"2024-05-08T18:34:07.196716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:21:46.897549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.919314+0000","last_change":"2024-05-08T18:30:58.305311+0000","last_active":"2024-05-08T18:34:06.919314+0000","last_peered":"2024-05-08T18:34:06.919314+0000","last_clean":"2024-05-08T18:34:06.919314+0000","last_became_active":"2024-05-08T18:30:58.304685+0000","last_became_peered":"2024-05-08T18:30:58.304685+0000","last_unstale":"2024-05-08T18:34:06.919314+0000","last_undegraded":"2024-05-08T18:34:06.919314+0000","last_fullsized":"2024-05-08T18:34:06.919314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:11.650120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'14","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.335357+0000","last_change":"2024-05-08T18:31:00.283453+0000","last_active":"2024-05-08T18:31:45.335357+0000","last_peered":"2024-05-08T18:31:45.335357+0000","last_clean":"2024-05-08T18:31:45.335357+0000","last_became_active":"2024-05-08T18:31:00.281816+0000","last_became_peered":"2024-05-08T18:31:00.281816+0000","last_unstale":"2024-05-08T18:31:45.335357+0000","last_undegraded":"2024-05-08T18:31:45.335357+0000","last_fullsized":"2024-05-08T18:31:45.335357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:29.461384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337199+0000","last_change":"2024-05-08T18:30:58.307205+0000","last_active":"2024-05-08T18:31:45.337199+0000","last_peered":"2024-05-08T18:31:45.337199+0000","last_clean":"2024-05-08T18:31:45.337199+0000","last_became_active":"2024-05-08T18:30:58.306545+0000","last_became_peered":"2024-05-08T18:30:58.306545+0000","last_unstale":"2024-05-08T18:31:45.337199+0000","last_undegraded":"2024-05-08T18:31:45.337199+0000","last_fullsized":"2024-05-08T18:31:45.337199+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:33.046479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.272025+0000","last_change":"2024-05-08T18:31:00.283417+0000","last_active":"2024-05-08T18:34:07.272025+0000","last_peered":"2024-05-08T18:34:07.272025+0000","last_clean":"2024-05-08T18:34:07.272025+0000","last_became_active":"2024-05-08T18:31:00.283048+0000","last_became_peered":"2024-05-08T18:31:00.283048+0000","last_unstale":"2024-05-08T18:34:07.272025+0000","last_undegraded":"2024-05-08T18:34:07.272025+0000","last_fullsized":"2024-05-08T18:34:07.272025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:16:11.480889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337235+0000","last_change":"2024-05-08T18:30:58.302648+0000","last_active":"2024-05-08T18:31:45.337235+0000","last_peered":"2024-05-08T18:31:45.337235+0000","last_clean":"2024-05-08T18:31:45.337235+0000","last_became_active":"2024-05-08T18:30:58.302245+0000","last_became_peered":"2024-05-08T18:30:58.302245+0000","last_unstale":"2024-05-08T18:31:45.337235+0000","last_undegraded":"2024-05-08T18:31:45.337235+0000","last_fullsized":"2024-05-08T18:31:45.337235+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:18.354135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'10","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196741+0000","last_change":"2024-05-08T18:31:45.338509+0000","last_active":"2024-05-08T18:34:07.196741+0000","last_peered":"2024-05-08T18:34:07.196741+0000","last_clean":"2024-05-08T18:34:07.196741+0000","last_became_active":"2024-05-08T18:31:45.338192+0000","last_became_peered":"2024-05-08T18:31:45.338192+0000","last_unstale":"2024-05-08T18:34:07.196741+0000","last_undegraded":"2024-05-08T18:34:07.196741+0000","last_fullsized":"2024-05-08T18:34:07.196741+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:50.426519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.559767+0000","last_change":"2024-05-08T18:30:58.306070+0000","last_active":"2024-05-08T18:33:06.559767+0000","last_peered":"2024-05-08T18:33:06.559767+0000","last_clean":"2024-05-08T18:33:06.559767+0000","last_became_active":"2024-05-08T18:30:58.304222+0000","last_became_peered":"2024-05-08T18:30:58.304222+0000","last_unstale":"2024-05-08T18:33:06.559767+0000","last_undegraded":"2024-05-08T18:33:06.559767+0000","last_fullsized":"2024-05-08T18:33:06.559767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:33:08.890455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"27'6","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331878+0000","last_change":"2024-05-08T18:31:00.296365+0000","last_active":"2024-05-08T18:31:45.331878+0000","last_peered":"2024-05-08T18:31:45.331878+0000","last_clean":"2024-05-08T18:31:45.331878+0000","last_became_active":"2024-05-08T18:31:00.295990+0000","last_became_peered":"2024-05-08T18:31:00.295990+0000","last_unstale":"2024-05-08T18:31:45.331878+0000","last_undegraded":"2024-05-08T18:31:45.331878+0000","last_fullsized":"2024-05-08T18:31:45.331878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:22:54.136553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330650+0000","last_change":"2024-05-08T18:30:58.285289+0000","last_active":"2024-05-08T18:31:45.330650+0000","last_peered":"2024-05-08T18:31:45.330650+0000","last_clean":"2024-05-08T18:31:45.330650+0000","last_became_active":"2024-05-08T18:30:58.283821+0000","last_became_peered":"2024-05-08T18:30:58.283821+0000","last_unstale":"2024-05-08T18:31:45.330650+0000","last_undegraded":"2024-05-08T18:31:45.330650+0000","last_fullsized":"2024-05-08T18:31:45.330650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:26.528845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'12","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196862+0000","last_change":"2024-05-08T18:31:00.282011+0000","last_active":"2024-05-08T18:34:07.196862+0000","last_peered":"2024-05-08T18:34:07.196862+0000","last_clean":"2024-05-08T18:34:07.196862+0000","last_became_active":"2024-05-08T18:31:00.280827+0000","last_became_peered":"2024-05-08T18:31:00.280827+0000","last_unstale":"2024-05-08T18:34:07.196862+0000","last_undegraded":"2024-05-08T18:34:07.196862+0000","last_fullsized":"2024-05-08T18:34:07.196862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:43.107566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328805+0000","last_change":"2024-05-08T18:30:58.306076+0000","last_active":"2024-05-08T18:31:45.328805+0000","last_peered":"2024-05-08T18:31:45.328805+0000","last_clean":"2024-05-08T18:31:45.328805+0000","last_became_active":"2024-05-08T18:30:58.305571+0000","last_became_peered":"2024-05-08T18:30:58.305571+0000","last_unstale":"2024-05-08T18:31:45.328805+0000","last_undegraded":"2024-05-08T18:31:45.328805+0000","last_fullsized":"2024-05-08T18:31:45.328805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:50.476345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.219476+0000","last_change":"2024-05-08T18:31:08.318466+0000","last_active":"2024-05-08T18:34:07.219476+0000","last_peered":"2024-05-08T18:34:07.219476+0000","last_clean":"2024-05-08T18:34:07.219476+0000","last_became_active":"2024-05-08T18:31:08.318181+0000","last_became_peered":"2024-05-08T18:31:08.318181+0000","last_unstale":"2024-05-08T18:34:07.219476+0000","last_undegraded":"2024-05-08T18:34:07.219476+0000","last_fullsized":"2024-05-08T18:34:07.219476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:26.315849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'12","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.869576+0000","last_change":"2024-05-08T18:31:00.296553+0000","last_active":"2024-05-08T18:32:22.869576+0000","last_peered":"2024-05-08T18:32:22.869576+0000","last_clean":"2024-05-08T18:32:22.869576+0000","last_became_active":"2024-05-08T18:31:00.296160+0000","last_became_peered":"2024-05-08T18:31:00.296160+0000","last_unstale":"2024-05-08T18:32:22.869576+0000","last_undegraded":"2024-05-08T18:32:22.869576+0000","last_fullsized":"2024-05-08T18:32:22.869576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:33.551031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328737+0000","last_change":"2024-05-08T18:30:58.317375+0000","last_active":"2024-05-08T18:31:45.328737+0000","last_peered":"2024-05-08T18:31:45.328737+0000","last_clean":"2024-05-08T18:31:45.328737+0000","last_became_active":"2024-05-08T18:30:58.315246+0000","last_became_peered":"2024-05-08T18:30:58.315246+0000","last_unstale":"2024-05-08T18:31:45.328737+0000","last_undegraded":"2024-05-08T18:31:45.328737+0000","last_fullsized":"2024-05-08T18:31:45.328737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:27.453462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329632+0000","last_change":"2024-05-08T18:31:02.290839+0000","last_active":"2024-05-08T18:31:45.329632+0000","last_peered":"2024-05-08T18:31:45.329632+0000","last_clean":"2024-05-08T18:31:45.329632+0000","last_became_active":"2024-05-08T18:31:02.290465+0000","last_became_peered":"2024-05-08T18:31:02.290465+0000","last_unstale":"2024-05-08T18:31:45.329632+0000","last_undegraded":"2024-05-08T18:31:45.329632+0000","last_fullsized":"2024-05-08T18:31:45.329632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:57.860502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.080511+0000","last_change":"2024-05-08T18:31:04.304092+0000","last_active":"2024-05-08T18:33:05.080511+0000","last_peered":"2024-05-08T18:33:05.080511+0000","last_clean":"2024-05-08T18:33:05.080511+0000","last_became_active":"2024-05-08T18:31:04.303815+0000","last_became_peered":"2024-05-08T18:31:04.303815+0000","last_unstale":"2024-05-08T18:33:05.080511+0000","last_undegraded":"2024-05-08T18:33:05.080511+0000","last_fullsized":"2024-05-08T18:33:05.080511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:57.848922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.338770+0000","last_change":"2024-05-08T18:31:06.310842+0000","last_active":"2024-05-08T18:31:45.338770+0000","last_peered":"2024-05-08T18:31:45.338770+0000","last_clean":"2024-05-08T18:31:45.338770+0000","last_became_active":"2024-05-08T18:31:06.310555+0000","last_became_peered":"2024-05-08T18:31:06.310555+0000","last_unstale":"2024-05-08T18:31:45.338770+0000","last_undegraded":"2024-05-08T18:31:45.338770+0000","last_fullsized":"2024-05-08T18:31:45.338770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:01.875049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.691129+0000","last_change":"2024-05-08T18:31:08.319311+0000","last_active":"2024-05-08T18:32:22.691129+0000","last_peered":"2024-05-08T18:32:22.691129+0000","last_clean":"2024-05-08T18:32:22.691129+0000","last_became_active":"2024-05-08T18:31:08.319009+0000","last_became_peered":"2024-05-08T18:31:08.319009+0000","last_unstale":"2024-05-08T18:32:22.691129+0000","last_undegraded":"2024-05-08T18:32:22.691129+0000","last_fullsized":"2024-05-08T18:32:22.691129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:13.936857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330446+0000","last_change":"2024-05-08T18:31:00.298856+0000","last_active":"2024-05-08T18:31:45.330446+0000","last_peered":"2024-05-08T18:31:45.330446+0000","last_clean":"2024-05-08T18:31:45.330446+0000","last_became_active":"2024-05-08T18:31:00.297497+0000","last_became_peered":"2024-05-08T18:31:00.297497+0000","last_unstale":"2024-05-08T18:31:45.330446+0000","last_undegraded":"2024-05-08T18:31:45.330446+0000","last_fullsized":"2024-05-08T18:31:45.330446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:57.260625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334952+0000","last_change":"2024-05-08T18:30:58.300036+0000","last_active":"2024-05-08T18:31:45.334952+0000","last_peered":"2024-05-08T18:31:45.334952+0000","last_clean":"2024-05-08T18:31:45.334952+0000","last_became_active":"2024-05-08T18:30:58.299649+0000","last_became_peered":"2024-05-08T18:30:58.299649+0000","last_unstale":"2024-05-08T18:31:45.334952+0000","last_undegraded":"2024-05-08T18:31:45.334952+0000","last_fullsized":"2024-05-08T18:31:45.334952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:43.233516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"20'1","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.182063+0000","last_change":"2024-05-08T18:31:02.294330+0000","last_active":"2024-05-08T18:33:06.182063+0000","last_peered":"2024-05-08T18:33:06.182063+0000","last_clean":"2024-05-08T18:33:06.182063+0000","last_became_active":"2024-05-08T18:31:02.293993+0000","last_became_peered":"2024-05-08T18:31:02.293993+0000","last_unstale":"2024-05-08T18:33:06.182063+0000","last_undegraded":"2024-05-08T18:33:06.182063+0000","last_fullsized":"2024-05-08T18:33:06.182063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:57.170520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.181520+0000","last_change":"2024-05-08T18:31:04.300424+0000","last_active":"2024-05-08T18:33:33.181520+0000","last_peered":"2024-05-08T18:33:33.181520+0000","last_clean":"2024-05-08T18:33:33.181520+0000","last_became_active":"2024-05-08T18:31:04.300059+0000","last_became_peered":"2024-05-08T18:31:04.300059+0000","last_unstale":"2024-05-08T18:33:33.181520+0000","last_undegraded":"2024-05-08T18:33:33.181520+0000","last_fullsized":"2024-05-08T18:33:33.181520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:44.348620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336322+0000","last_change":"2024-05-08T18:31:06.312948+0000","last_active":"2024-05-08T18:31:45.336322+0000","last_peered":"2024-05-08T18:31:45.336322+0000","last_clean":"2024-05-08T18:31:45.336322+0000","last_became_active":"2024-05-08T18:31:06.312651+0000","last_became_peered":"2024-05-08T18:31:06.312651+0000","last_unstale":"2024-05-08T18:31:45.336322+0000","last_undegraded":"2024-05-08T18:31:45.336322+0000","last_fullsized":"2024-05-08T18:31:45.336322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:01.719275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328702+0000","last_change":"2024-05-08T18:31:08.311373+0000","last_active":"2024-05-08T18:31:45.328702+0000","last_peered":"2024-05-08T18:31:45.328702+0000","last_clean":"2024-05-08T18:31:45.328702+0000","last_became_active":"2024-05-08T18:31:08.311048+0000","last_became_peered":"2024-05-08T18:31:08.311048+0000","last_unstale":"2024-05-08T18:31:45.328702+0000","last_undegraded":"2024-05-08T18:31:45.328702+0000","last_fullsized":"2024-05-08T18:31:45.328702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:36.670228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.242285+0000","last_change":"2024-05-08T18:31:00.296832+0000","last_active":"2024-05-08T18:34:07.242285+0000","last_peered":"2024-05-08T18:34:07.242285+0000","last_clean":"2024-05-08T18:34:07.242285+0000","last_became_active":"2024-05-08T18:31:00.296176+0000","last_became_peered":"2024-05-08T18:31:00.296176+0000","last_unstale":"2024-05-08T18:34:07.242285+0000","last_undegraded":"2024-05-08T18:34:07.242285+0000","last_fullsized":"2024-05-08T18:34:07.242285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:56.201421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327607+0000","last_change":"2024-05-08T18:30:58.310108+0000","last_active":"2024-05-08T18:31:45.327607+0000","last_peered":"2024-05-08T18:31:45.327607+0000","last_clean":"2024-05-08T18:31:45.327607+0000","last_became_active":"2024-05-08T18:30:58.309339+0000","last_became_peered":"2024-05-08T18:30:58.309339+0000","last_unstale":"2024-05-08T18:31:45.327607+0000","last_undegraded":"2024-05-08T18:31:45.327607+0000","last_fullsized":"2024-05-08T18:31:45.327607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:38.248722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:48.166352+0000","last_change":"2024-05-08T18:31:45.335793+0000","last_active":"2024-05-08T18:31:48.166352+0000","last_peered":"2024-05-08T18:31:48.166352+0000","last_clean":"2024-05-08T18:31:48.166352+0000","last_became_active":"2024-05-08T18:31:45.335489+0000","last_became_peered":"2024-05-08T18:31:45.335489+0000","last_unstale":"2024-05-08T18:31:48.166352+0000","last_undegraded":"2024-05-08T18:31:48.166352+0000","last_fullsized":"2024-05-08T18:31:48.166352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:01.179871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.180653+0000","last_change":"2024-05-08T18:31:04.300336+0000","last_active":"2024-05-08T18:33:28.180653+0000","last_peered":"2024-05-08T18:33:28.180653+0000","last_clean":"2024-05-08T18:33:28.180653+0000","last_became_active":"2024-05-08T18:31:04.300022+0000","last_became_peered":"2024-05-08T18:31:04.300022+0000","last_unstale":"2024-05-08T18:33:28.180653+0000","last_undegraded":"2024-05-08T18:33:28.180653+0000","last_fullsized":"2024-05-08T18:33:28.180653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:42.428646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'282","reported_seq":390,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370245+0000","last_change":"2024-05-08T18:31:06.307960+0000","last_active":"2024-05-08T18:34:07.370245+0000","last_peered":"2024-05-08T18:34:07.370245+0000","last_clean":"2024-05-08T18:34:07.370245+0000","last_became_active":"2024-05-08T18:31:06.306886+0000","last_became_peered":"2024-05-08T18:31:06.306886+0000","last_unstale":"2024-05-08T18:34:07.370245+0000","last_undegraded":"2024-05-08T18:34:07.370245+0000","last_fullsized":"2024-05-08T18:34:07.370245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:48.485718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.578916+0000","last_change":"2024-05-08T18:31:08.312050+0000","last_active":"2024-05-08T18:33:06.578916+0000","last_peered":"2024-05-08T18:33:06.578916+0000","last_clean":"2024-05-08T18:33:06.578916+0000","last_became_active":"2024-05-08T18:31:08.311780+0000","last_became_peered":"2024-05-08T18:31:08.311780+0000","last_unstale":"2024-05-08T18:33:06.578916+0000","last_undegraded":"2024-05-08T18:33:06.578916+0000","last_fullsized":"2024-05-08T18:33:06.578916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:11:36.751971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332003+0000","last_change":"2024-05-08T18:31:00.281650+0000","last_active":"2024-05-08T18:31:45.332003+0000","last_peered":"2024-05-08T18:31:45.332003+0000","last_clean":"2024-05-08T18:31:45.332003+0000","last_became_active":"2024-05-08T18:31:00.281268+0000","last_became_peered":"2024-05-08T18:31:00.281268+0000","last_unstale":"2024-05-08T18:31:45.332003+0000","last_undegraded":"2024-05-08T18:31:45.332003+0000","last_fullsized":"2024-05-08T18:31:45.332003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:40.256644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.186380+0000","last_change":"2024-05-08T18:30:58.306638+0000","last_active":"2024-05-08T18:34:07.186380+0000","last_peered":"2024-05-08T18:34:07.186380+0000","last_clean":"2024-05-08T18:34:07.186380+0000","last_became_active":"2024-05-08T18:30:58.303428+0000","last_became_peered":"2024-05-08T18:30:58.303428+0000","last_unstale":"2024-05-08T18:34:07.186380+0000","last_undegraded":"2024-05-08T18:34:07.186380+0000","last_fullsized":"2024-05-08T18:34:07.186380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:56.618771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332766+0000","last_change":"2024-05-08T18:31:02.292000+0000","last_active":"2024-05-08T18:31:45.332766+0000","last_peered":"2024-05-08T18:31:45.332766+0000","last_clean":"2024-05-08T18:31:45.332766+0000","last_became_active":"2024-05-08T18:31:02.291729+0000","last_became_peered":"2024-05-08T18:31:02.291729+0000","last_unstale":"2024-05-08T18:31:45.332766+0000","last_undegraded":"2024-05-08T18:31:45.332766+0000","last_fullsized":"2024-05-08T18:31:45.332766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:47:19.398957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.075273+0000","last_change":"2024-05-08T18:31:04.304611+0000","last_active":"2024-05-08T18:33:05.075273+0000","last_peered":"2024-05-08T18:33:05.075273+0000","last_clean":"2024-05-08T18:33:05.075273+0000","last_became_active":"2024-05-08T18:31:04.304347+0000","last_became_peered":"2024-05-08T18:31:04.304347+0000","last_unstale":"2024-05-08T18:33:05.075273+0000","last_undegraded":"2024-05-08T18:33:05.075273+0000","last_fullsized":"2024-05-08T18:33:05.075273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:42.690781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'282","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370399+0000","last_change":"2024-05-08T18:31:06.305903+0000","last_active":"2024-05-08T18:34:07.370399+0000","last_peered":"2024-05-08T18:34:07.370399+0000","last_clean":"2024-05-08T18:34:07.370399+0000","last_became_active":"2024-05-08T18:31:06.305591+0000","last_became_peered":"2024-05-08T18:31:06.305591+0000","last_unstale":"2024-05-08T18:34:07.370399+0000","last_undegraded":"2024-05-08T18:34:07.370399+0000","last_fullsized":"2024-05-08T18:34:07.370399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:49.125159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'10","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.272036+0000","last_change":"2024-05-08T18:31:00.291398+0000","last_active":"2024-05-08T18:34:07.272036+0000","last_peered":"2024-05-08T18:34:07.272036+0000","last_clean":"2024-05-08T18:34:07.272036+0000","last_became_active":"2024-05-08T18:31:00.290824+0000","last_became_peered":"2024-05-08T18:31:00.290824+0000","last_unstale":"2024-05-08T18:34:07.272036+0000","last_undegraded":"2024-05-08T18:34:07.272036+0000","last_fullsized":"2024-05-08T18:34:07.272036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:32.380609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333693+0000","last_change":"2024-05-08T18:30:58.301227+0000","last_active":"2024-05-08T18:31:45.333693+0000","last_peered":"2024-05-08T18:31:45.333693+0000","last_clean":"2024-05-08T18:31:45.333693+0000","last_became_active":"2024-05-08T18:30:58.300884+0000","last_became_peered":"2024-05-08T18:30:58.300884+0000","last_unstale":"2024-05-08T18:31:45.333693+0000","last_undegraded":"2024-05-08T18:31:45.333693+0000","last_fullsized":"2024-05-08T18:31:45.333693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:18.354135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334570+0000","last_change":"2024-05-08T18:31:02.291926+0000","last_active":"2024-05-08T18:31:45.334570+0000","last_peered":"2024-05-08T18:31:45.334570+0000","last_clean":"2024-05-08T18:31:45.334570+0000","last_became_active":"2024-05-08T18:31:02.291536+0000","last_became_peered":"2024-05-08T18:31:02.291536+0000","last_unstale":"2024-05-08T18:31:45.334570+0000","last_undegraded":"2024-05-08T18:31:45.334570+0000","last_fullsized":"2024-05-08T18:31:45.334570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:01.425063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'41","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.085136+0000","last_change":"2024-05-08T18:31:04.302745+0000","last_active":"2024-05-08T18:33:05.085136+0000","last_peered":"2024-05-08T18:33:05.085136+0000","last_clean":"2024-05-08T18:33:05.085136+0000","last_became_active":"2024-05-08T18:31:04.302455+0000","last_became_peered":"2024-05-08T18:31:04.302455+0000","last_unstale":"2024-05-08T18:33:05.085136+0000","last_undegraded":"2024-05-08T18:33:05.085136+0000","last_fullsized":"2024-05-08T18:33:05.085136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:32.684836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330256+0000","last_change":"2024-05-08T18:31:06.305190+0000","last_active":"2024-05-08T18:31:45.330256+0000","last_peered":"2024-05-08T18:31:45.330256+0000","last_clean":"2024-05-08T18:31:45.330256+0000","last_became_active":"2024-05-08T18:31:06.304979+0000","last_became_peered":"2024-05-08T18:31:06.304979+0000","last_unstale":"2024-05-08T18:31:45.330256+0000","last_undegraded":"2024-05-08T18:31:45.330256+0000","last_fullsized":"2024-05-08T18:31:45.330256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:43.024781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.692939+0000","last_change":"2024-05-08T18:31:08.311725+0000","last_active":"2024-05-08T18:32:22.692939+0000","last_peered":"2024-05-08T18:32:22.692939+0000","last_clean":"2024-05-08T18:32:22.692939+0000","last_became_active":"2024-05-08T18:31:08.311434+0000","last_became_peered":"2024-05-08T18:31:08.311434+0000","last_unstale":"2024-05-08T18:32:22.692939+0000","last_undegraded":"2024-05-08T18:32:22.692939+0000","last_fullsized":"2024-05-08T18:32:22.692939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:03.726123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.681210+0000","last_change":"2024-05-08T18:31:00.281267+0000","last_active":"2024-05-08T18:32:22.681210+0000","last_peered":"2024-05-08T18:32:22.681210+0000","last_clean":"2024-05-08T18:32:22.681210+0000","last_became_active":"2024-05-08T18:31:00.280969+0000","last_became_peered":"2024-05-08T18:31:00.280969+0000","last_unstale":"2024-05-08T18:32:22.681210+0000","last_undegraded":"2024-05-08T18:32:22.681210+0000","last_fullsized":"2024-05-08T18:32:22.681210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:22:54.136553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331186+0000","last_change":"2024-05-08T18:30:58.303460+0000","last_active":"2024-05-08T18:31:45.331186+0000","last_peered":"2024-05-08T18:31:45.331186+0000","last_clean":"2024-05-08T18:31:45.331186+0000","last_became_active":"2024-05-08T18:30:58.302590+0000","last_became_peered":"2024-05-08T18:30:58.302590+0000","last_unstale":"2024-05-08T18:31:45.331186+0000","last_undegraded":"2024-05-08T18:31:45.331186+0000","last_fullsized":"2024-05-08T18:31:45.331186+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:34.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329728+0000","last_change":"2024-05-08T18:31:02.289867+0000","last_active":"2024-05-08T18:31:45.329728+0000","last_peered":"2024-05-08T18:31:45.329728+0000","last_clean":"2024-05-08T18:31:45.329728+0000","last_became_active":"2024-05-08T18:31:02.289394+0000","last_became_peered":"2024-05-08T18:31:02.289394+0000","last_unstale":"2024-05-08T18:31:45.329728+0000","last_undegraded":"2024-05-08T18:31:45.329728+0000","last_fullsized":"2024-05-08T18:31:45.329728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:11.566252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.064996+0000","last_change":"2024-05-08T18:31:04.303291+0000","last_active":"2024-05-08T18:33:05.064996+0000","last_peered":"2024-05-08T18:33:05.064996+0000","last_clean":"2024-05-08T18:33:05.064996+0000","last_became_active":"2024-05-08T18:31:04.302886+0000","last_became_peered":"2024-05-08T18:31:04.302886+0000","last_unstale":"2024-05-08T18:33:05.064996+0000","last_undegraded":"2024-05-08T18:33:05.064996+0000","last_fullsized":"2024-05-08T18:33:05.064996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:19:01.413463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330112+0000","last_change":"2024-05-08T18:31:06.306937+0000","last_active":"2024-05-08T18:31:45.330112+0000","last_peered":"2024-05-08T18:31:45.330112+0000","last_clean":"2024-05-08T18:31:45.330112+0000","last_became_active":"2024-05-08T18:31:06.306607+0000","last_became_peered":"2024-05-08T18:31:06.306607+0000","last_unstale":"2024-05-08T18:31:45.330112+0000","last_undegraded":"2024-05-08T18:31:45.330112+0000","last_fullsized":"2024-05-08T18:31:45.330112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:57.121163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:17.147191+0000","last_change":"2024-05-08T18:31:08.305446+0000","last_active":"2024-05-08T18:32:17.147191+0000","last_peered":"2024-05-08T18:32:17.147191+0000","last_clean":"2024-05-08T18:32:17.147191+0000","last_became_active":"2024-05-08T18:31:08.305127+0000","last_became_peered":"2024-05-08T18:31:08.305127+0000","last_unstale":"2024-05-08T18:32:17.147191+0000","last_undegraded":"2024-05-08T18:32:17.147191+0000","last_fullsized":"2024-05-08T18:32:17.147191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:34.156497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.870768+0000","last_change":"2024-05-08T18:31:00.293425+0000","last_active":"2024-05-08T18:32:22.870768+0000","last_peered":"2024-05-08T18:32:22.870768+0000","last_clean":"2024-05-08T18:32:22.870768+0000","last_became_active":"2024-05-08T18:31:00.293170+0000","last_became_peered":"2024-05-08T18:31:00.293170+0000","last_unstale":"2024-05-08T18:32:22.870768+0000","last_undegraded":"2024-05-08T18:32:22.870768+0000","last_fullsized":"2024-05-08T18:32:22.870768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:18.374257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.486260+0000","last_change":"2024-05-08T18:30:58.316505+0000","last_active":"2024-05-08T18:33:06.486260+0000","last_peered":"2024-05-08T18:33:06.486260+0000","last_clean":"2024-05-08T18:33:06.486260+0000","last_became_active":"2024-05-08T18:30:58.314352+0000","last_became_peered":"2024-05-08T18:30:58.314352+0000","last_unstale":"2024-05-08T18:33:06.486260+0000","last_undegraded":"2024-05-08T18:33:06.486260+0000","last_fullsized":"2024-05-08T18:33:06.486260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:17.391716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:48.166253+0000","last_change":"2024-05-08T18:31:45.339752+0000","last_active":"2024-05-08T18:31:48.166253+0000","last_peered":"2024-05-08T18:31:48.166253+0000","last_clean":"2024-05-08T18:31:48.166253+0000","last_became_active":"2024-05-08T18:31:45.339423+0000","last_became_peered":"2024-05-08T18:31:45.339423+0000","last_unstale":"2024-05-08T18:31:48.166253+0000","last_undegraded":"2024-05-08T18:31:48.166253+0000","last_fullsized":"2024-05-08T18:31:48.166253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:49:36.600605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.087041+0000","last_change":"2024-05-08T18:31:04.298949+0000","last_active":"2024-05-08T18:33:05.087041+0000","last_peered":"2024-05-08T18:33:05.087041+0000","last_clean":"2024-05-08T18:33:05.087041+0000","last_became_active":"2024-05-08T18:31:04.298026+0000","last_became_peered":"2024-05-08T18:31:04.298026+0000","last_unstale":"2024-05-08T18:33:05.087041+0000","last_undegraded":"2024-05-08T18:33:05.087041+0000","last_fullsized":"2024-05-08T18:33:05.087041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:17.656617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'282","reported_seq":354,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.406177+0000","last_change":"2024-05-08T18:31:06.307022+0000","last_active":"2024-05-08T18:34:07.406177+0000","last_peered":"2024-05-08T18:34:07.406177+0000","last_clean":"2024-05-08T18:34:07.406177+0000","last_became_active":"2024-05-08T18:31:06.306655+0000","last_became_peered":"2024-05-08T18:31:06.306655+0000","last_unstale":"2024-05-08T18:34:07.406177+0000","last_undegraded":"2024-05-08T18:34:07.406177+0000","last_fullsized":"2024-05-08T18:34:07.406177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:17.968800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330293+0000","last_change":"2024-05-08T18:31:08.314593+0000","last_active":"2024-05-08T18:31:45.330293+0000","last_peered":"2024-05-08T18:31:45.330293+0000","last_clean":"2024-05-08T18:31:45.330293+0000","last_became_active":"2024-05-08T18:31:08.314273+0000","last_became_peered":"2024-05-08T18:31:08.314273+0000","last_unstale":"2024-05-08T18:31:45.330293+0000","last_undegraded":"2024-05-08T18:31:45.330293+0000","last_fullsized":"2024-05-08T18:31:45.330293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:44.629789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.869260+0000","last_change":"2024-05-08T18:31:00.283193+0000","last_active":"2024-05-08T18:32:22.869260+0000","last_peered":"2024-05-08T18:32:22.869260+0000","last_clean":"2024-05-08T18:32:22.869260+0000","last_became_active":"2024-05-08T18:31:00.282941+0000","last_became_peered":"2024-05-08T18:31:00.282941+0000","last_unstale":"2024-05-08T18:32:22.869260+0000","last_undegraded":"2024-05-08T18:32:22.869260+0000","last_fullsized":"2024-05-08T18:32:22.869260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:54.772566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328935+0000","last_change":"2024-05-08T18:30:58.316967+0000","last_active":"2024-05-08T18:31:45.328935+0000","last_peered":"2024-05-08T18:31:45.328935+0000","last_clean":"2024-05-08T18:31:45.328935+0000","last_became_active":"2024-05-08T18:30:58.313431+0000","last_became_peered":"2024-05-08T18:30:58.313431+0000","last_unstale":"2024-05-08T18:31:45.328935+0000","last_undegraded":"2024-05-08T18:31:45.328935+0000","last_fullsized":"2024-05-08T18:31:45.328935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:24.289073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329543+0000","last_change":"2024-05-08T18:31:02.290051+0000","last_active":"2024-05-08T18:31:45.329543+0000","last_peered":"2024-05-08T18:31:45.329543+0000","last_clean":"2024-05-08T18:31:45.329543+0000","last_became_active":"2024-05-08T18:31:02.289669+0000","last_became_peered":"2024-05-08T18:31:02.289669+0000","last_unstale":"2024-05-08T18:31:45.329543+0000","last_undegraded":"2024-05-08T18:31:45.329543+0000","last_fullsized":"2024-05-08T18:31:45.329543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:30.670243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'56","reported_seq":112,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.583830+0000","last_change":"2024-05-08T18:31:04.302553+0000","last_active":"2024-05-08T18:33:06.583830+0000","last_peered":"2024-05-08T18:33:06.583830+0000","last_clean":"2024-05-08T18:33:06.583830+0000","last_became_active":"2024-05-08T18:31:04.302244+0000","last_became_peered":"2024-05-08T18:31:04.302244+0000","last_unstale":"2024-05-08T18:33:06.583830+0000","last_undegraded":"2024-05-08T18:33:06.583830+0000","last_fullsized":"2024-05-08T18:33:06.583830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:46.989970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329219+0000","last_change":"2024-05-08T18:31:06.309153+0000","last_active":"2024-05-08T18:31:45.329219+0000","last_peered":"2024-05-08T18:31:45.329219+0000","last_clean":"2024-05-08T18:31:45.329219+0000","last_became_active":"2024-05-08T18:31:06.308806+0000","last_became_peered":"2024-05-08T18:31:06.308806+0000","last_unstale":"2024-05-08T18:31:45.329219+0000","last_undegraded":"2024-05-08T18:31:45.329219+0000","last_fullsized":"2024-05-08T18:31:45.329219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:11:34.745123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.381203+0000","last_change":"2024-05-08T18:31:08.319703+0000","last_active":"2024-05-08T18:34:07.381203+0000","last_peered":"2024-05-08T18:34:07.381203+0000","last_clean":"2024-05-08T18:34:07.381203+0000","last_became_active":"2024-05-08T18:31:08.319370+0000","last_became_peered":"2024-05-08T18:31:08.319370+0000","last_unstale":"2024-05-08T18:34:07.381203+0000","last_undegraded":"2024-05-08T18:34:07.381203+0000","last_fullsized":"2024-05-08T18:34:07.381203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:36.140092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.684230+0000","last_change":"2024-05-08T18:31:00.292416+0000","last_active":"2024-05-08T18:32:22.684230+0000","last_peered":"2024-05-08T18:32:22.684230+0000","last_clean":"2024-05-08T18:32:22.684230+0000","last_became_active":"2024-05-08T18:31:00.292154+0000","last_became_peered":"2024-05-08T18:31:00.292154+0000","last_unstale":"2024-05-08T18:32:22.684230+0000","last_undegraded":"2024-05-08T18:32:22.684230+0000","last_fullsized":"2024-05-08T18:32:22.684230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:03.239102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330126+0000","last_change":"2024-05-08T18:30:58.294896+0000","last_active":"2024-05-08T18:31:45.330126+0000","last_peered":"2024-05-08T18:31:45.330126+0000","last_clean":"2024-05-08T18:31:45.330126+0000","last_became_active":"2024-05-08T18:30:58.294377+0000","last_became_peered":"2024-05-08T18:30:58.294377+0000","last_unstale":"2024-05-08T18:31:45.330126+0000","last_undegraded":"2024-05-08T18:31:45.330126+0000","last_fullsized":"2024-05-08T18:31:45.330126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:04.148371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330076+0000","last_change":"2024-05-08T18:31:02.294000+0000","last_active":"2024-05-08T18:31:45.330076+0000","last_peered":"2024-05-08T18:31:45.330076+0000","last_clean":"2024-05-08T18:31:45.330076+0000","last_became_active":"2024-05-08T18:31:02.293680+0000","last_became_peered":"2024-05-08T18:31:02.293680+0000","last_unstale":"2024-05-08T18:31:45.330076+0000","last_undegraded":"2024-05-08T18:31:45.330076+0000","last_fullsized":"2024-05-08T18:31:45.330076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:49:52.687784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.069060+0000","last_change":"2024-05-08T18:31:04.301433+0000","last_active":"2024-05-08T18:33:05.069060+0000","last_peered":"2024-05-08T18:33:05.069060+0000","last_clean":"2024-05-08T18:33:05.069060+0000","last_became_active":"2024-05-08T18:31:04.301147+0000","last_became_peered":"2024-05-08T18:31:04.301147+0000","last_unstale":"2024-05-08T18:33:05.069060+0000","last_undegraded":"2024-05-08T18:33:05.069060+0000","last_fullsized":"2024-05-08T18:33:05.069060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:13.749614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332085+0000","last_change":"2024-05-08T18:31:06.309848+0000","last_active":"2024-05-08T18:31:45.332085+0000","last_peered":"2024-05-08T18:31:45.332085+0000","last_clean":"2024-05-08T18:31:45.332085+0000","last_became_active":"2024-05-08T18:31:06.308804+0000","last_became_peered":"2024-05-08T18:31:06.308804+0000","last_unstale":"2024-05-08T18:31:45.332085+0000","last_undegraded":"2024-05-08T18:31:45.332085+0000","last_fullsized":"2024-05-08T18:31:45.332085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.734033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177658+0000","last_change":"2024-05-08T18:31:08.320629+0000","last_active":"2024-05-08T18:33:08.177658+0000","last_peered":"2024-05-08T18:33:08.177658+0000","last_clean":"2024-05-08T18:33:08.177658+0000","last_became_active":"2024-05-08T18:31:08.320150+0000","last_became_peered":"2024-05-08T18:31:08.320150+0000","last_unstale":"2024-05-08T18:33:08.177658+0000","last_undegraded":"2024-05-08T18:33:08.177658+0000","last_fullsized":"2024-05-08T18:33:08.177658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:06:21.193541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.962245+0000","last_change":"2024-05-08T18:31:00.300161+0000","last_active":"2024-05-08T18:34:06.962245+0000","last_peered":"2024-05-08T18:34:06.962245+0000","last_clean":"2024-05-08T18:34:06.962245+0000","last_became_active":"2024-05-08T18:31:00.299379+0000","last_became_peered":"2024-05-08T18:31:00.299379+0000","last_unstale":"2024-05-08T18:34:06.962245+0000","last_undegraded":"2024-05-08T18:34:06.962245+0000","last_fullsized":"2024-05-08T18:34:06.962245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:30.742428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329273+0000","last_change":"2024-05-08T18:30:58.316845+0000","last_active":"2024-05-08T18:31:45.329273+0000","last_peered":"2024-05-08T18:31:45.329273+0000","last_clean":"2024-05-08T18:31:45.329273+0000","last_became_active":"2024-05-08T18:30:58.315625+0000","last_became_peered":"2024-05-08T18:30:58.315625+0000","last_unstale":"2024-05-08T18:31:45.329273+0000","last_undegraded":"2024-05-08T18:31:45.329273+0000","last_fullsized":"2024-05-08T18:31:45.329273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:06.716557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329621+0000","last_change":"2024-05-08T18:31:02.290296+0000","last_active":"2024-05-08T18:31:45.329621+0000","last_peered":"2024-05-08T18:31:45.329621+0000","last_clean":"2024-05-08T18:31:45.329621+0000","last_became_active":"2024-05-08T18:31:02.289767+0000","last_became_peered":"2024-05-08T18:31:02.289767+0000","last_unstale":"2024-05-08T18:31:45.329621+0000","last_undegraded":"2024-05-08T18:31:45.329621+0000","last_fullsized":"2024-05-08T18:31:45.329621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:25.978523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.095800+0000","last_change":"2024-05-08T18:31:04.294840+0000","last_active":"2024-05-08T18:33:05.095800+0000","last_peered":"2024-05-08T18:33:05.095800+0000","last_clean":"2024-05-08T18:33:05.095800+0000","last_became_active":"2024-05-08T18:31:04.294573+0000","last_became_peered":"2024-05-08T18:31:04.294573+0000","last_unstale":"2024-05-08T18:33:05.095800+0000","last_undegraded":"2024-05-08T18:33:05.095800+0000","last_fullsized":"2024-05-08T18:33:05.095800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:37.564647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'282","reported_seq":430,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.395855+0000","last_change":"2024-05-08T18:31:06.312484+0000","last_active":"2024-05-08T18:34:07.395855+0000","last_peered":"2024-05-08T18:34:07.395855+0000","last_clean":"2024-05-08T18:34:07.395855+0000","last_became_active":"2024-05-08T18:31:06.312203+0000","last_became_peered":"2024-05-08T18:31:06.312203+0000","last_unstale":"2024-05-08T18:34:07.395855+0000","last_undegraded":"2024-05-08T18:34:07.395855+0000","last_fullsized":"2024-05-08T18:34:07.395855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:28.017188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'14","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.250725+0000","last_change":"2024-05-08T18:31:08.314495+0000","last_active":"2024-05-08T18:34:07.250725+0000","last_peered":"2024-05-08T18:34:07.250725+0000","last_clean":"2024-05-08T18:34:07.250725+0000","last_became_active":"2024-05-08T18:31:08.314171+0000","last_became_peered":"2024-05-08T18:31:08.314171+0000","last_unstale":"2024-05-08T18:34:07.250725+0000","last_undegraded":"2024-05-08T18:34:07.250725+0000","last_fullsized":"2024-05-08T18:34:07.250725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:26.315849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.242517+0000","last_change":"2024-05-08T18:31:00.292788+0000","last_active":"2024-05-08T18:34:07.242517+0000","last_peered":"2024-05-08T18:34:07.242517+0000","last_clean":"2024-05-08T18:34:07.242517+0000","last_became_active":"2024-05-08T18:31:00.292521+0000","last_became_peered":"2024-05-08T18:31:00.292521+0000","last_unstale":"2024-05-08T18:34:07.242517+0000","last_undegraded":"2024-05-08T18:34:07.242517+0000","last_fullsized":"2024-05-08T18:34:07.242517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:09.586689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329194+0000","last_change":"2024-05-08T18:30:58.310166+0000","last_active":"2024-05-08T18:31:45.329194+0000","last_peered":"2024-05-08T18:31:45.329194+0000","last_clean":"2024-05-08T18:31:45.329194+0000","last_became_active":"2024-05-08T18:30:58.309773+0000","last_became_peered":"2024-05-08T18:30:58.309773+0000","last_unstale":"2024-05-08T18:31:45.329194+0000","last_undegraded":"2024-05-08T18:31:45.329194+0000","last_fullsized":"2024-05-08T18:31:45.329194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:07.578767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.181624+0000","last_change":"2024-05-08T18:31:02.289615+0000","last_active":"2024-05-08T18:33:06.181624+0000","last_peered":"2024-05-08T18:33:06.181624+0000","last_clean":"2024-05-08T18:33:06.181624+0000","last_became_active":"2024-05-08T18:31:02.289253+0000","last_became_peered":"2024-05-08T18:31:02.289253+0000","last_unstale":"2024-05-08T18:33:06.181624+0000","last_undegraded":"2024-05-08T18:33:06.181624+0000","last_fullsized":"2024-05-08T18:33:06.181624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:12.617698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330973+0000","last_change":"2024-05-08T18:31:04.304088+0000","last_active":"2024-05-08T18:31:45.330973+0000","last_peered":"2024-05-08T18:31:45.330973+0000","last_clean":"2024-05-08T18:31:45.330973+0000","last_became_active":"2024-05-08T18:31:04.303799+0000","last_became_peered":"2024-05-08T18:31:04.303799+0000","last_unstale":"2024-05-08T18:31:45.330973+0000","last_undegraded":"2024-05-08T18:31:45.330973+0000","last_fullsized":"2024-05-08T18:31:45.330973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:57.074860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'282","reported_seq":459,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370311+0000","last_change":"2024-05-08T18:31:06.305559+0000","last_active":"2024-05-08T18:34:07.370311+0000","last_peered":"2024-05-08T18:34:07.370311+0000","last_clean":"2024-05-08T18:34:07.370311+0000","last_became_active":"2024-05-08T18:31:06.305201+0000","last_became_peered":"2024-05-08T18:31:06.305201+0000","last_unstale":"2024-05-08T18:34:07.370311+0000","last_undegraded":"2024-05-08T18:34:07.370311+0000","last_fullsized":"2024-05-08T18:34:07.370311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:49.125159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.361146+0000","last_change":"2024-05-08T18:31:08.311212+0000","last_active":"2024-05-08T18:33:06.361146+0000","last_peered":"2024-05-08T18:33:06.361146+0000","last_clean":"2024-05-08T18:33:06.361146+0000","last_became_active":"2024-05-08T18:31:08.310906+0000","last_became_peered":"2024-05-08T18:31:08.310906+0000","last_unstale":"2024-05-08T18:33:06.361146+0000","last_undegraded":"2024-05-08T18:33:06.361146+0000","last_fullsized":"2024-05-08T18:33:06.361146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:11.717528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'14","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271660+0000","last_change":"2024-05-08T18:31:00.292227+0000","last_active":"2024-05-08T18:34:07.271660+0000","last_peered":"2024-05-08T18:34:07.271660+0000","last_clean":"2024-05-08T18:34:07.271660+0000","last_became_active":"2024-05-08T18:31:00.291563+0000","last_became_peered":"2024-05-08T18:31:00.291563+0000","last_unstale":"2024-05-08T18:34:07.271660+0000","last_undegraded":"2024-05-08T18:34:07.271660+0000","last_fullsized":"2024-05-08T18:34:07.271660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:21.530085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328340+0000","last_change":"2024-05-08T18:30:58.304032+0000","last_active":"2024-05-08T18:31:45.328340+0000","last_peered":"2024-05-08T18:31:45.328340+0000","last_clean":"2024-05-08T18:31:45.328340+0000","last_became_active":"2024-05-08T18:30:58.302966+0000","last_became_peered":"2024-05-08T18:30:58.302966+0000","last_unstale":"2024-05-08T18:31:45.328340+0000","last_undegraded":"2024-05-08T18:31:45.328340+0000","last_fullsized":"2024-05-08T18:31:45.328340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:53.183411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332859+0000","last_change":"2024-05-08T18:31:02.288493+0000","last_active":"2024-05-08T18:31:45.332859+0000","last_peered":"2024-05-08T18:31:45.332859+0000","last_clean":"2024-05-08T18:31:45.332859+0000","last_became_active":"2024-05-08T18:31:02.288232+0000","last_became_peered":"2024-05-08T18:31:02.288232+0000","last_unstale":"2024-05-08T18:31:45.332859+0000","last_undegraded":"2024-05-08T18:31:45.332859+0000","last_fullsized":"2024-05-08T18:31:45.332859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:29:42.582963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'38","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.081776+0000","last_change":"2024-05-08T18:31:04.301609+0000","last_active":"2024-05-08T18:33:05.081776+0000","last_peered":"2024-05-08T18:33:05.081776+0000","last_clean":"2024-05-08T18:33:05.081776+0000","last_became_active":"2024-05-08T18:31:04.301298+0000","last_became_peered":"2024-05-08T18:31:04.301298+0000","last_unstale":"2024-05-08T18:33:05.081776+0000","last_undegraded":"2024-05-08T18:33:05.081776+0000","last_fullsized":"2024-05-08T18:33:05.081776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:17.287554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331437+0000","last_change":"2024-05-08T18:31:06.310680+0000","last_active":"2024-05-08T18:31:45.331437+0000","last_peered":"2024-05-08T18:31:45.331437+0000","last_clean":"2024-05-08T18:31:45.331437+0000","last_became_active":"2024-05-08T18:31:06.310430+0000","last_became_peered":"2024-05-08T18:31:06.310430+0000","last_unstale":"2024-05-08T18:31:45.331437+0000","last_undegraded":"2024-05-08T18:31:45.331437+0000","last_fullsized":"2024-05-08T18:31:45.331437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:36.763558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.309458+0000","last_change":"2024-05-08T18:31:08.307711+0000","last_active":"2024-05-08T18:34:07.309458+0000","last_peered":"2024-05-08T18:34:07.309458+0000","last_clean":"2024-05-08T18:34:07.309458+0000","last_became_active":"2024-05-08T18:31:08.306492+0000","last_became_peered":"2024-05-08T18:31:08.306492+0000","last_unstale":"2024-05-08T18:34:07.309458+0000","last_undegraded":"2024-05-08T18:34:07.309458+0000","last_fullsized":"2024-05-08T18:34:07.309458+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:47:53.084160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271927+0000","last_change":"2024-05-08T18:31:00.299933+0000","last_active":"2024-05-08T18:34:07.271927+0000","last_peered":"2024-05-08T18:34:07.271927+0000","last_clean":"2024-05-08T18:34:07.271927+0000","last_became_active":"2024-05-08T18:31:00.299186+0000","last_became_peered":"2024-05-08T18:31:00.299186+0000","last_unstale":"2024-05-08T18:34:07.271927+0000","last_undegraded":"2024-05-08T18:34:07.271927+0000","last_fullsized":"2024-05-08T18:34:07.271927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:37.968339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337354+0000","last_change":"2024-05-08T18:30:49.982170+0000","last_active":"2024-05-08T18:31:45.337354+0000","last_peered":"2024-05-08T18:31:45.337354+0000","last_clean":"2024-05-08T18:31:45.337354+0000","last_became_active":"2024-05-08T18:30:49.981852+0000","last_became_peered":"2024-05-08T18:30:49.981852+0000","last_unstale":"2024-05-08T18:31:45.337354+0000","last_undegraded":"2024-05-08T18:31:45.337354+0000","last_fullsized":"2024-05-08T18:31:45.337354+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:54.158426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329142+0000","last_change":"2024-05-08T18:30:49.983387+0000","last_active":"2024-05-08T18:31:45.329142+0000","last_peered":"2024-05-08T18:31:45.329142+0000","last_clean":"2024-05-08T18:31:45.329142+0000","last_became_active":"2024-05-08T18:30:49.983023+0000","last_became_peered":"2024-05-08T18:30:49.983023+0000","last_unstale":"2024-05-08T18:31:45.329142+0000","last_undegraded":"2024-05-08T18:31:45.329142+0000","last_fullsized":"2024-05-08T18:31:45.329142+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:49.558123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328133+0000","last_change":"2024-05-08T18:30:58.317086+0000","last_active":"2024-05-08T18:31:45.328133+0000","last_peered":"2024-05-08T18:31:45.328133+0000","last_clean":"2024-05-08T18:31:45.328133+0000","last_became_active":"2024-05-08T18:30:58.316676+0000","last_became_peered":"2024-05-08T18:30:58.316676+0000","last_unstale":"2024-05-08T18:31:45.328133+0000","last_undegraded":"2024-05-08T18:31:45.328133+0000","last_fullsized":"2024-05-08T18:31:45.328133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:59:23.755041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.340362+0000","last_change":"2024-05-08T18:31:45.339419+0000","last_active":"2024-05-08T18:31:45.340362+0000","last_peered":"2024-05-08T18:31:45.340362+0000","last_clean":"2024-05-08T18:31:45.340362+0000","last_became_active":"2024-05-08T18:31:45.339007+0000","last_became_peered":"2024-05-08T18:31:45.339007+0000","last_unstale":"2024-05-08T18:31:45.340362+0000","last_undegraded":"2024-05-08T18:31:45.340362+0000","last_fullsized":"2024-05-08T18:31:45.340362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:27.129227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'76","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.093625+0000","last_change":"2024-05-08T18:31:04.299443+0000","last_active":"2024-05-08T18:33:05.093625+0000","last_peered":"2024-05-08T18:33:05.093625+0000","last_clean":"2024-05-08T18:33:05.093625+0000","last_became_active":"2024-05-08T18:31:04.299145+0000","last_became_peered":"2024-05-08T18:31:04.299145+0000","last_unstale":"2024-05-08T18:33:05.093625+0000","last_undegraded":"2024-05-08T18:33:05.093625+0000","last_fullsized":"2024-05-08T18:33:05.093625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:54.440135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330451+0000","last_change":"2024-05-08T18:31:06.312091+0000","last_active":"2024-05-08T18:31:45.330451+0000","last_peered":"2024-05-08T18:31:45.330451+0000","last_clean":"2024-05-08T18:31:45.330451+0000","last_became_active":"2024-05-08T18:31:06.311742+0000","last_became_peered":"2024-05-08T18:31:06.311742+0000","last_unstale":"2024-05-08T18:31:45.330451+0000","last_undegraded":"2024-05-08T18:31:45.330451+0000","last_fullsized":"2024-05-08T18:31:45.330451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:29:46.597510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'87","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.286528+0000","last_change":"2024-05-08T18:31:08.311008+0000","last_active":"2024-05-08T18:34:07.286528+0000","last_peered":"2024-05-08T18:34:07.286528+0000","last_clean":"2024-05-08T18:34:07.286528+0000","last_became_active":"2024-05-08T18:31:08.310715+0000","last_became_peered":"2024-05-08T18:31:08.310715+0000","last_unstale":"2024-05-08T18:34:07.286528+0000","last_undegraded":"2024-05-08T18:34:07.286528+0000","last_fullsized":"2024-05-08T18:34:07.286528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:34.317569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":173,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.057524+0000","last_change":"2024-05-08T18:31:00.295877+0000","last_active":"2024-05-08T18:34:07.057524+0000","last_peered":"2024-05-08T18:34:07.057524+0000","last_clean":"2024-05-08T18:34:07.057524+0000","last_became_active":"2024-05-08T18:31:00.295578+0000","last_became_peered":"2024-05-08T18:31:00.295578+0000","last_unstale":"2024-05-08T18:34:07.057524+0000","last_undegraded":"2024-05-08T18:34:07.057524+0000","last_fullsized":"2024-05-08T18:34:07.057524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:10.611116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327422+0000","last_change":"2024-05-08T18:30:49.983190+0000","last_active":"2024-05-08T18:31:45.327422+0000","last_peered":"2024-05-08T18:31:45.327422+0000","last_clean":"2024-05-08T18:31:45.327422+0000","last_became_active":"2024-05-08T18:30:49.982854+0000","last_became_peered":"2024-05-08T18:30:49.982854+0000","last_unstale":"2024-05-08T18:31:45.327422+0000","last_undegraded":"2024-05-08T18:31:45.327422+0000","last_fullsized":"2024-05-08T18:31:45.327422+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:33.902157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176047+0000","last_change":"2024-05-08T18:30:58.295078+0000","last_active":"2024-05-08T18:33:03.176047+0000","last_peered":"2024-05-08T18:33:03.176047+0000","last_clean":"2024-05-08T18:33:03.176047+0000","last_became_active":"2024-05-08T18:30:58.294153+0000","last_became_peered":"2024-05-08T18:30:58.294153+0000","last_unstale":"2024-05-08T18:33:03.176047+0000","last_undegraded":"2024-05-08T18:33:03.176047+0000","last_fullsized":"2024-05-08T18:33:03.176047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:18.354135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332227+0000","last_change":"2024-05-08T18:31:02.292269+0000","last_active":"2024-05-08T18:31:45.332227+0000","last_peered":"2024-05-08T18:31:45.332227+0000","last_clean":"2024-05-08T18:31:45.332227+0000","last_became_active":"2024-05-08T18:31:02.291979+0000","last_became_peered":"2024-05-08T18:31:02.291979+0000","last_unstale":"2024-05-08T18:31:45.332227+0000","last_undegraded":"2024-05-08T18:31:45.332227+0000","last_fullsized":"2024-05-08T18:31:45.332227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:39.010234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'274","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370443+0000","last_change":"2024-05-08T18:31:04.299833+0000","last_active":"2024-05-08T18:34:07.370443+0000","last_peered":"2024-05-08T18:34:07.370443+0000","last_clean":"2024-05-08T18:34:07.370443+0000","last_became_active":"2024-05-08T18:31:04.299494+0000","last_became_peered":"2024-05-08T18:31:04.299494+0000","last_unstale":"2024-05-08T18:34:07.370443+0000","last_undegraded":"2024-05-08T18:34:07.370443+0000","last_fullsized":"2024-05-08T18:34:07.370443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:04:48.277052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329374+0000","last_change":"2024-05-08T18:31:06.307338+0000","last_active":"2024-05-08T18:31:45.329374+0000","last_peered":"2024-05-08T18:31:45.329374+0000","last_clean":"2024-05-08T18:31:45.329374+0000","last_became_active":"2024-05-08T18:31:06.306554+0000","last_became_peered":"2024-05-08T18:31:06.306554+0000","last_unstale":"2024-05-08T18:31:45.329374+0000","last_undegraded":"2024-05-08T18:31:45.329374+0000","last_fullsized":"2024-05-08T18:31:45.329374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:32.299617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.867202+0000","last_change":"2024-05-08T18:31:08.316829+0000","last_active":"2024-05-08T18:32:22.867202+0000","last_peered":"2024-05-08T18:32:22.867202+0000","last_clean":"2024-05-08T18:32:22.867202+0000","last_became_active":"2024-05-08T18:31:08.316536+0000","last_became_peered":"2024-05-08T18:31:08.316536+0000","last_unstale":"2024-05-08T18:32:22.867202+0000","last_undegraded":"2024-05-08T18:32:22.867202+0000","last_fullsized":"2024-05-08T18:32:22.867202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:54.836108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'10","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.334094+0000","last_change":"2024-05-08T18:31:00.281674+0000","last_active":"2024-05-08T18:34:07.334094+0000","last_peered":"2024-05-08T18:34:07.334094+0000","last_clean":"2024-05-08T18:34:07.334094+0000","last_became_active":"2024-05-08T18:31:00.281359+0000","last_became_peered":"2024-05-08T18:31:00.281359+0000","last_unstale":"2024-05-08T18:34:07.334094+0000","last_undegraded":"2024-05-08T18:34:07.334094+0000","last_fullsized":"2024-05-08T18:34:07.334094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:21.913096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330082+0000","last_change":"2024-05-08T18:30:49.982800+0000","last_active":"2024-05-08T18:31:45.330082+0000","last_peered":"2024-05-08T18:31:45.330082+0000","last_clean":"2024-05-08T18:31:45.330082+0000","last_became_active":"2024-05-08T18:30:49.982438+0000","last_became_peered":"2024-05-08T18:30:49.982438+0000","last_unstale":"2024-05-08T18:31:45.330082+0000","last_undegraded":"2024-05-08T18:31:45.330082+0000","last_fullsized":"2024-05-08T18:31:45.330082+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:18.664851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328603+0000","last_change":"2024-05-08T18:30:58.294820+0000","last_active":"2024-05-08T18:31:45.328603+0000","last_peered":"2024-05-08T18:31:45.328603+0000","last_clean":"2024-05-08T18:31:45.328603+0000","last_became_active":"2024-05-08T18:30:58.294292+0000","last_became_peered":"2024-05-08T18:30:58.294292+0000","last_unstale":"2024-05-08T18:31:45.328603+0000","last_undegraded":"2024-05-08T18:31:45.328603+0000","last_fullsized":"2024-05-08T18:31:45.328603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:07.501461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330259+0000","last_change":"2024-05-08T18:31:02.292271+0000","last_active":"2024-05-08T18:31:45.330259+0000","last_peered":"2024-05-08T18:31:45.330259+0000","last_clean":"2024-05-08T18:31:45.330259+0000","last_became_active":"2024-05-08T18:31:02.291806+0000","last_became_peered":"2024-05-08T18:31:02.291806+0000","last_unstale":"2024-05-08T18:31:45.330259+0000","last_undegraded":"2024-05-08T18:31:45.330259+0000","last_fullsized":"2024-05-08T18:31:45.330259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:03.635955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370265+0000","last_change":"2024-05-08T18:31:04.303574+0000","last_active":"2024-05-08T18:34:07.370265+0000","last_peered":"2024-05-08T18:34:07.370265+0000","last_clean":"2024-05-08T18:34:07.370265+0000","last_became_active":"2024-05-08T18:31:04.303321+0000","last_became_peered":"2024-05-08T18:31:04.303321+0000","last_unstale":"2024-05-08T18:34:07.370265+0000","last_undegraded":"2024-05-08T18:34:07.370265+0000","last_fullsized":"2024-05-08T18:34:07.370265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:03.432097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330522+0000","last_change":"2024-05-08T18:31:06.309771+0000","last_active":"2024-05-08T18:31:45.330522+0000","last_peered":"2024-05-08T18:31:45.330522+0000","last_clean":"2024-05-08T18:31:45.330522+0000","last_became_active":"2024-05-08T18:31:06.309525+0000","last_became_peered":"2024-05-08T18:31:06.309525+0000","last_unstale":"2024-05-08T18:31:45.330522+0000","last_undegraded":"2024-05-08T18:31:45.330522+0000","last_fullsized":"2024-05-08T18:31:45.330522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:47:23.413504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'8","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327513+0000","last_change":"2024-05-08T18:31:08.314823+0000","last_active":"2024-05-08T18:31:45.327513+0000","last_peered":"2024-05-08T18:31:45.327513+0000","last_clean":"2024-05-08T18:31:45.327513+0000","last_became_active":"2024-05-08T18:31:08.314503+0000","last_became_peered":"2024-05-08T18:31:08.314503+0000","last_unstale":"2024-05-08T18:31:45.327513+0000","last_undegraded":"2024-05-08T18:31:45.327513+0000","last_fullsized":"2024-05-08T18:31:45.327513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:58.072442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.333503+0000","last_change":"2024-05-08T18:31:00.283770+0000","last_active":"2024-05-08T18:33:03.333503+0000","last_peered":"2024-05-08T18:33:03.333503+0000","last_clean":"2024-05-08T18:33:03.333503+0000","last_became_active":"2024-05-08T18:31:00.283410+0000","last_became_peered":"2024-05-08T18:31:00.283410+0000","last_unstale":"2024-05-08T18:33:03.333503+0000","last_undegraded":"2024-05-08T18:33:03.333503+0000","last_fullsized":"2024-05-08T18:33:03.333503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:56.345475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327663+0000","last_change":"2024-05-08T18:30:49.983911+0000","last_active":"2024-05-08T18:31:45.327663+0000","last_peered":"2024-05-08T18:31:45.327663+0000","last_clean":"2024-05-08T18:31:45.327663+0000","last_became_active":"2024-05-08T18:30:49.983515+0000","last_became_peered":"2024-05-08T18:30:49.983515+0000","last_unstale":"2024-05-08T18:31:45.327663+0000","last_undegraded":"2024-05-08T18:31:45.327663+0000","last_fullsized":"2024-05-08T18:31:45.327663+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:40.629929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332492+0000","last_change":"2024-05-08T18:30:58.306622+0000","last_active":"2024-05-08T18:31:45.332492+0000","last_peered":"2024-05-08T18:31:45.332492+0000","last_clean":"2024-05-08T18:31:45.332492+0000","last_became_active":"2024-05-08T18:30:58.306268+0000","last_became_peered":"2024-05-08T18:30:58.306268+0000","last_unstale":"2024-05-08T18:31:45.332492+0000","last_undegraded":"2024-05-08T18:31:45.332492+0000","last_fullsized":"2024-05-08T18:31:45.332492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:07.501461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330794+0000","last_change":"2024-05-08T18:31:02.292466+0000","last_active":"2024-05-08T18:31:45.330794+0000","last_peered":"2024-05-08T18:31:45.330794+0000","last_clean":"2024-05-08T18:31:45.330794+0000","last_became_active":"2024-05-08T18:31:02.292030+0000","last_became_peered":"2024-05-08T18:31:02.292030+0000","last_unstale":"2024-05-08T18:31:45.330794+0000","last_undegraded":"2024-05-08T18:31:45.330794+0000","last_fullsized":"2024-05-08T18:31:45.330794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:24.356014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'13","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.594211+0000","last_change":"2024-05-08T18:31:04.296591+0000","last_active":"2024-05-08T18:34:06.594211+0000","last_peered":"2024-05-08T18:34:06.594211+0000","last_clean":"2024-05-08T18:34:06.594211+0000","last_became_active":"2024-05-08T18:31:04.296257+0000","last_became_peered":"2024-05-08T18:31:04.296257+0000","last_unstale":"2024-05-08T18:34:06.594211+0000","last_undegraded":"2024-05-08T18:34:06.594211+0000","last_fullsized":"2024-05-08T18:34:06.594211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:29.136261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332452+0000","last_change":"2024-05-08T18:31:06.309173+0000","last_active":"2024-05-08T18:31:45.332452+0000","last_peered":"2024-05-08T18:31:45.332452+0000","last_clean":"2024-05-08T18:31:45.332452+0000","last_became_active":"2024-05-08T18:31:06.308892+0000","last_became_peered":"2024-05-08T18:31:06.308892+0000","last_unstale":"2024-05-08T18:31:45.332452+0000","last_undegraded":"2024-05-08T18:31:45.332452+0000","last_fullsized":"2024-05-08T18:31:45.332452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:18.093112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.340083+0000","last_change":"2024-05-08T18:31:08.319035+0000","last_active":"2024-05-08T18:33:06.340083+0000","last_peered":"2024-05-08T18:33:06.340083+0000","last_clean":"2024-05-08T18:33:06.340083+0000","last_became_active":"2024-05-08T18:31:08.318728+0000","last_became_peered":"2024-05-08T18:31:08.318728+0000","last_unstale":"2024-05-08T18:33:06.340083+0000","last_undegraded":"2024-05-08T18:33:06.340083+0000","last_fullsized":"2024-05-08T18:33:06.340083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:14.378528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'3","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:53.184078+0000","last_change":"2024-05-08T18:31:45.344716+0000","last_active":"2024-05-08T18:33:53.184078+0000","last_peered":"2024-05-08T18:33:53.184078+0000","last_clean":"2024-05-08T18:33:53.184078+0000","last_became_active":"2024-05-08T18:31:45.337785+0000","last_became_peered":"2024-05-08T18:31:45.337785+0000","last_unstale":"2024-05-08T18:33:53.184078+0000","last_undegraded":"2024-05-08T18:33:53.184078+0000","last_fullsized":"2024-05-08T18:33:53.184078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:46.808130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.419073+0000","last_change":"2024-05-08T18:30:58.302684+0000","last_active":"2024-05-08T18:33:06.419073+0000","last_peered":"2024-05-08T18:33:06.419073+0000","last_clean":"2024-05-08T18:33:06.419073+0000","last_became_active":"2024-05-08T18:30:58.302328+0000","last_became_peered":"2024-05-08T18:30:58.302328+0000","last_unstale":"2024-05-08T18:33:06.419073+0000","last_undegraded":"2024-05-08T18:33:06.419073+0000","last_fullsized":"2024-05-08T18:33:06.419073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:26.528845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330056+0000","last_change":"2024-05-08T18:30:49.983824+0000","last_active":"2024-05-08T18:31:45.330056+0000","last_peered":"2024-05-08T18:31:45.330056+0000","last_clean":"2024-05-08T18:31:45.330056+0000","last_became_active":"2024-05-08T18:30:49.983522+0000","last_became_peered":"2024-05-08T18:30:49.983522+0000","last_unstale":"2024-05-08T18:31:45.330056+0000","last_undegraded":"2024-05-08T18:31:45.330056+0000","last_fullsized":"2024-05-08T18:31:45.330056+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:18.812194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.176791+0000","last_change":"2024-05-08T18:31:02.294921+0000","last_active":"2024-05-08T18:33:08.176791+0000","last_peered":"2024-05-08T18:33:08.176791+0000","last_clean":"2024-05-08T18:33:08.176791+0000","last_became_active":"2024-05-08T18:31:02.294603+0000","last_became_peered":"2024-05-08T18:31:02.294603+0000","last_unstale":"2024-05-08T18:33:08.176791+0000","last_undegraded":"2024-05-08T18:33:08.176791+0000","last_fullsized":"2024-05-08T18:33:08.176791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:32.998440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'62","reported_seq":121,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.929072+0000","last_change":"2024-05-08T18:31:04.295377+0000","last_active":"2024-05-08T18:34:06.929072+0000","last_peered":"2024-05-08T18:34:06.929072+0000","last_clean":"2024-05-08T18:34:06.929072+0000","last_became_active":"2024-05-08T18:31:04.295090+0000","last_became_peered":"2024-05-08T18:31:04.295090+0000","last_unstale":"2024-05-08T18:34:06.929072+0000","last_undegraded":"2024-05-08T18:34:06.929072+0000","last_fullsized":"2024-05-08T18:34:06.929072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:24.176022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":61,"num_read_kb":49,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330265+0000","last_change":"2024-05-08T18:31:06.312460+0000","last_active":"2024-05-08T18:31:45.330265+0000","last_peered":"2024-05-08T18:31:45.330265+0000","last_clean":"2024-05-08T18:31:45.330265+0000","last_became_active":"2024-05-08T18:31:06.312179+0000","last_became_peered":"2024-05-08T18:31:06.312179+0000","last_unstale":"2024-05-08T18:31:45.330265+0000","last_undegraded":"2024-05-08T18:31:45.330265+0000","last_fullsized":"2024-05-08T18:31:45.330265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:03.281754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.521191+0000","last_change":"2024-05-08T18:31:08.306655+0000","last_active":"2024-05-08T18:33:06.521191+0000","last_peered":"2024-05-08T18:33:06.521191+0000","last_clean":"2024-05-08T18:33:06.521191+0000","last_became_active":"2024-05-08T18:31:08.304818+0000","last_became_peered":"2024-05-08T18:31:08.304818+0000","last_unstale":"2024-05-08T18:33:06.521191+0000","last_undegraded":"2024-05-08T18:33:06.521191+0000","last_fullsized":"2024-05-08T18:33:06.521191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:38.400920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.057661+0000","last_change":"2024-05-08T18:31:00.294763+0000","last_active":"2024-05-08T18:34:07.057661+0000","last_peered":"2024-05-08T18:34:07.057661+0000","last_clean":"2024-05-08T18:34:07.057661+0000","last_became_active":"2024-05-08T18:31:00.294157+0000","last_became_peered":"2024-05-08T18:31:00.294157+0000","last_unstale":"2024-05-08T18:34:07.057661+0000","last_undegraded":"2024-05-08T18:34:07.057661+0000","last_fullsized":"2024-05-08T18:34:07.057661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:41.794217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176107+0000","last_change":"2024-05-08T18:30:58.288464+0000","last_active":"2024-05-08T18:33:03.176107+0000","last_peered":"2024-05-08T18:33:03.176107+0000","last_clean":"2024-05-08T18:33:03.176107+0000","last_became_active":"2024-05-08T18:30:58.286578+0000","last_became_peered":"2024-05-08T18:30:58.286578+0000","last_unstale":"2024-05-08T18:33:03.176107+0000","last_undegraded":"2024-05-08T18:33:03.176107+0000","last_fullsized":"2024-05-08T18:33:03.176107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:46.459524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329948+0000","last_change":"2024-05-08T18:30:49.982777+0000","last_active":"2024-05-08T18:31:45.329948+0000","last_peered":"2024-05-08T18:31:45.329948+0000","last_clean":"2024-05-08T18:31:45.329948+0000","last_became_active":"2024-05-08T18:30:49.982471+0000","last_became_peered":"2024-05-08T18:30:49.982471+0000","last_unstale":"2024-05-08T18:31:45.329948+0000","last_undegraded":"2024-05-08T18:31:45.329948+0000","last_fullsized":"2024-05-08T18:31:45.329948+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:54.349839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327459+0000","last_change":"2024-05-08T18:31:02.288838+0000","last_active":"2024-05-08T18:31:45.327459+0000","last_peered":"2024-05-08T18:31:45.327459+0000","last_clean":"2024-05-08T18:31:45.327459+0000","last_became_active":"2024-05-08T18:31:02.287974+0000","last_became_peered":"2024-05-08T18:31:02.287974+0000","last_unstale":"2024-05-08T18:31:45.327459+0000","last_undegraded":"2024-05-08T18:31:45.327459+0000","last_fullsized":"2024-05-08T18:31:45.327459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:05.696133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'15","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178044+0000","last_change":"2024-05-08T18:31:04.301545+0000","last_active":"2024-05-08T18:33:13.178044+0000","last_peered":"2024-05-08T18:33:13.178044+0000","last_clean":"2024-05-08T18:33:13.178044+0000","last_became_active":"2024-05-08T18:31:04.301116+0000","last_became_peered":"2024-05-08T18:31:04.301116+0000","last_unstale":"2024-05-08T18:33:13.178044+0000","last_undegraded":"2024-05-08T18:33:13.178044+0000","last_fullsized":"2024-05-08T18:33:13.178044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:26.009674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'282","reported_seq":374,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370404+0000","last_change":"2024-05-08T18:31:06.308742+0000","last_active":"2024-05-08T18:34:07.370404+0000","last_peered":"2024-05-08T18:34:07.370404+0000","last_clean":"2024-05-08T18:34:07.370404+0000","last_became_active":"2024-05-08T18:31:06.308274+0000","last_became_peered":"2024-05-08T18:31:06.308274+0000","last_unstale":"2024-05-08T18:34:07.370404+0000","last_undegraded":"2024-05-08T18:34:07.370404+0000","last_fullsized":"2024-05-08T18:34:07.370404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:57.121163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331379+0000","last_change":"2024-05-08T18:31:08.318932+0000","last_active":"2024-05-08T18:31:45.331379+0000","last_peered":"2024-05-08T18:31:45.331379+0000","last_clean":"2024-05-08T18:31:45.331379+0000","last_became_active":"2024-05-08T18:31:08.318609+0000","last_became_peered":"2024-05-08T18:31:08.318609+0000","last_unstale":"2024-05-08T18:31:45.331379+0000","last_undegraded":"2024-05-08T18:31:45.331379+0000","last_fullsized":"2024-05-08T18:31:45.331379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:50.231594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328412+0000","last_change":"2024-05-08T18:31:00.291567+0000","last_active":"2024-05-08T18:31:45.328412+0000","last_peered":"2024-05-08T18:31:45.328412+0000","last_clean":"2024-05-08T18:31:45.328412+0000","last_became_active":"2024-05-08T18:31:00.291093+0000","last_became_peered":"2024-05-08T18:31:00.291093+0000","last_unstale":"2024-05-08T18:31:45.328412+0000","last_undegraded":"2024-05-08T18:31:45.328412+0000","last_fullsized":"2024-05-08T18:31:45.328412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:53.284230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333265+0000","last_change":"2024-05-08T18:30:58.306520+0000","last_active":"2024-05-08T18:31:45.333265+0000","last_peered":"2024-05-08T18:31:45.333265+0000","last_clean":"2024-05-08T18:31:45.333265+0000","last_became_active":"2024-05-08T18:30:58.305915+0000","last_became_peered":"2024-05-08T18:30:58.305915+0000","last_unstale":"2024-05-08T18:31:45.333265+0000","last_undegraded":"2024-05-08T18:31:45.333265+0000","last_fullsized":"2024-05-08T18:31:45.333265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:35.822576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330715+0000","last_change":"2024-05-08T18:30:49.982641+0000","last_active":"2024-05-08T18:31:45.330715+0000","last_peered":"2024-05-08T18:31:45.330715+0000","last_clean":"2024-05-08T18:31:45.330715+0000","last_became_active":"2024-05-08T18:30:49.982330+0000","last_became_peered":"2024-05-08T18:30:49.982330+0000","last_unstale":"2024-05-08T18:31:45.330715+0000","last_undegraded":"2024-05-08T18:31:45.330715+0000","last_fullsized":"2024-05-08T18:31:45.330715+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:18.664851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327471+0000","last_change":"2024-05-08T18:31:02.292781+0000","last_active":"2024-05-08T18:31:45.327471+0000","last_peered":"2024-05-08T18:31:45.327471+0000","last_clean":"2024-05-08T18:31:45.327471+0000","last_became_active":"2024-05-08T18:31:02.292328+0000","last_became_peered":"2024-05-08T18:31:02.292328+0000","last_unstale":"2024-05-08T18:31:45.327471+0000","last_undegraded":"2024-05-08T18:31:45.327471+0000","last_fullsized":"2024-05-08T18:31:45.327471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:57.704727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328449+0000","last_change":"2024-05-08T18:31:04.302579+0000","last_active":"2024-05-08T18:31:45.328449+0000","last_peered":"2024-05-08T18:31:45.328449+0000","last_clean":"2024-05-08T18:31:45.328449+0000","last_became_active":"2024-05-08T18:31:04.302020+0000","last_became_peered":"2024-05-08T18:31:04.302020+0000","last_unstale":"2024-05-08T18:31:45.328449+0000","last_undegraded":"2024-05-08T18:31:45.328449+0000","last_fullsized":"2024-05-08T18:31:45.328449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:32.125730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'282","reported_seq":389,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.381934+0000","last_change":"2024-05-08T18:31:06.305364+0000","last_active":"2024-05-08T18:34:07.381934+0000","last_peered":"2024-05-08T18:34:07.381934+0000","last_clean":"2024-05-08T18:34:07.381934+0000","last_became_active":"2024-05-08T18:31:06.305020+0000","last_became_peered":"2024-05-08T18:31:06.305020+0000","last_unstale":"2024-05-08T18:34:07.381934+0000","last_undegraded":"2024-05-08T18:34:07.381934+0000","last_fullsized":"2024-05-08T18:34:07.381934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:01.875049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333286+0000","last_change":"2024-05-08T18:31:08.310217+0000","last_active":"2024-05-08T18:31:45.333286+0000","last_peered":"2024-05-08T18:31:45.333286+0000","last_clean":"2024-05-08T18:31:45.333286+0000","last_became_active":"2024-05-08T18:31:08.309869+0000","last_became_peered":"2024-05-08T18:31:08.309869+0000","last_unstale":"2024-05-08T18:31:45.333286+0000","last_undegraded":"2024-05-08T18:31:45.333286+0000","last_fullsized":"2024-05-08T18:31:45.333286+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:36.670228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331588+0000","last_change":"2024-05-08T18:31:00.297171+0000","last_active":"2024-05-08T18:31:45.331588+0000","last_peered":"2024-05-08T18:31:45.331588+0000","last_clean":"2024-05-08T18:31:45.331588+0000","last_became_active":"2024-05-08T18:31:00.296431+0000","last_became_peered":"2024-05-08T18:31:00.296431+0000","last_unstale":"2024-05-08T18:31:45.331588+0000","last_undegraded":"2024-05-08T18:31:45.331588+0000","last_fullsized":"2024-05-08T18:31:45.331588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:19:18.458032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336437+0000","last_change":"2024-05-08T18:30:58.304887+0000","last_active":"2024-05-08T18:31:45.336437+0000","last_peered":"2024-05-08T18:31:45.336437+0000","last_clean":"2024-05-08T18:31:45.336437+0000","last_became_active":"2024-05-08T18:30:58.303997+0000","last_became_peered":"2024-05-08T18:30:58.303997+0000","last_unstale":"2024-05-08T18:31:45.336437+0000","last_undegraded":"2024-05-08T18:31:45.336437+0000","last_fullsized":"2024-05-08T18:31:45.336437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:34.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332663+0000","last_change":"2024-05-08T18:30:49.984897+0000","last_active":"2024-05-08T18:31:45.332663+0000","last_peered":"2024-05-08T18:31:45.332663+0000","last_clean":"2024-05-08T18:31:45.332663+0000","last_became_active":"2024-05-08T18:30:49.984280+0000","last_became_peered":"2024-05-08T18:30:49.984280+0000","last_unstale":"2024-05-08T18:31:45.332663+0000","last_undegraded":"2024-05-08T18:31:45.332663+0000","last_fullsized":"2024-05-08T18:31:45.332663+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:26.601806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327309+0000","last_change":"2024-05-08T18:31:02.290848+0000","last_active":"2024-05-08T18:31:45.327309+0000","last_peered":"2024-05-08T18:31:45.327309+0000","last_clean":"2024-05-08T18:31:45.327309+0000","last_became_active":"2024-05-08T18:31:02.290540+0000","last_became_peered":"2024-05-08T18:31:02.290540+0000","last_unstale":"2024-05-08T18:31:45.327309+0000","last_undegraded":"2024-05-08T18:31:45.327309+0000","last_fullsized":"2024-05-08T18:31:45.327309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:13.954253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'82","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.079634+0000","last_change":"2024-05-08T18:31:04.304969+0000","last_active":"2024-05-08T18:33:05.079634+0000","last_peered":"2024-05-08T18:33:05.079634+0000","last_clean":"2024-05-08T18:33:05.079634+0000","last_became_active":"2024-05-08T18:31:04.304669+0000","last_became_peered":"2024-05-08T18:31:04.304669+0000","last_unstale":"2024-05-08T18:33:05.079634+0000","last_undegraded":"2024-05-08T18:33:05.079634+0000","last_fullsized":"2024-05-08T18:33:05.079634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:46.499999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328793+0000","last_change":"2024-05-08T18:31:06.308900+0000","last_active":"2024-05-08T18:31:45.328793+0000","last_peered":"2024-05-08T18:31:45.328793+0000","last_clean":"2024-05-08T18:31:45.328793+0000","last_became_active":"2024-05-08T18:31:06.308621+0000","last_became_peered":"2024-05-08T18:31:06.308621+0000","last_unstale":"2024-05-08T18:31:45.328793+0000","last_undegraded":"2024-05-08T18:31:45.328793+0000","last_fullsized":"2024-05-08T18:31:45.328793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:09.710680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.335673+0000","last_change":"2024-05-08T18:31:08.308718+0000","last_active":"2024-05-08T18:34:07.335673+0000","last_peered":"2024-05-08T18:34:07.335673+0000","last_clean":"2024-05-08T18:34:07.335673+0000","last_became_active":"2024-05-08T18:31:08.308427+0000","last_became_peered":"2024-05-08T18:31:08.308427+0000","last_unstale":"2024-05-08T18:34:07.335673+0000","last_undegraded":"2024-05-08T18:34:07.335673+0000","last_fullsized":"2024-05-08T18:34:07.335673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:19.975648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330856+0000","last_change":"2024-05-08T18:31:08.315548+0000","last_active":"2024-05-08T18:31:45.330856+0000","last_peered":"2024-05-08T18:31:45.330856+0000","last_clean":"2024-05-08T18:31:45.330856+0000","last_became_active":"2024-05-08T18:31:08.315257+0000","last_became_peered":"2024-05-08T18:31:08.315257+0000","last_unstale":"2024-05-08T18:31:45.330856+0000","last_undegraded":"2024-05-08T18:31:45.330856+0000","last_fullsized":"2024-05-08T18:31:45.330856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:51.132007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'11","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.064332+0000","last_change":"2024-05-08T18:31:00.295123+0000","last_active":"2024-05-08T18:34:07.064332+0000","last_peered":"2024-05-08T18:34:07.064332+0000","last_clean":"2024-05-08T18:34:07.064332+0000","last_became_active":"2024-05-08T18:31:00.294827+0000","last_became_peered":"2024-05-08T18:31:00.294827+0000","last_unstale":"2024-05-08T18:34:07.064332+0000","last_undegraded":"2024-05-08T18:34:07.064332+0000","last_fullsized":"2024-05-08T18:34:07.064332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:55.191334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.174101+0000","last_change":"2024-05-08T18:30:58.313343+0000","last_active":"2024-05-08T18:34:07.174101+0000","last_peered":"2024-05-08T18:34:07.174101+0000","last_clean":"2024-05-08T18:34:07.174101+0000","last_became_active":"2024-05-08T18:30:58.313034+0000","last_became_peered":"2024-05-08T18:30:58.313034+0000","last_unstale":"2024-05-08T18:34:07.174101+0000","last_undegraded":"2024-05-08T18:34:07.174101+0000","last_fullsized":"2024-05-08T18:34:07.174101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:55.941415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334770+0000","last_change":"2024-05-08T18:31:02.291732+0000","last_active":"2024-05-08T18:31:45.334770+0000","last_peered":"2024-05-08T18:31:45.334770+0000","last_clean":"2024-05-08T18:31:45.334770+0000","last_became_active":"2024-05-08T18:31:02.291119+0000","last_became_peered":"2024-05-08T18:31:02.291119+0000","last_unstale":"2024-05-08T18:31:45.334770+0000","last_undegraded":"2024-05-08T18:31:45.334770+0000","last_fullsized":"2024-05-08T18:31:45.334770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:50.745635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.086081+0000","last_change":"2024-05-08T18:31:04.301279+0000","last_active":"2024-05-08T18:33:05.086081+0000","last_peered":"2024-05-08T18:33:05.086081+0000","last_clean":"2024-05-08T18:33:05.086081+0000","last_became_active":"2024-05-08T18:31:04.300990+0000","last_became_peered":"2024-05-08T18:31:04.300990+0000","last_unstale":"2024-05-08T18:33:05.086081+0000","last_undegraded":"2024-05-08T18:33:05.086081+0000","last_fullsized":"2024-05-08T18:33:05.086081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:40.615427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329018+0000","last_change":"2024-05-08T18:31:06.315203+0000","last_active":"2024-05-08T18:31:45.329018+0000","last_peered":"2024-05-08T18:31:45.329018+0000","last_clean":"2024-05-08T18:31:45.329018+0000","last_became_active":"2024-05-08T18:31:06.314696+0000","last_became_peered":"2024-05-08T18:31:06.314696+0000","last_unstale":"2024-05-08T18:31:45.329018+0000","last_undegraded":"2024-05-08T18:31:45.329018+0000","last_fullsized":"2024-05-08T18:31:45.329018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:41.839545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.795512+0000","last_change":"2024-05-08T18:31:08.319177+0000","last_active":"2024-05-08T18:33:04.795512+0000","last_peered":"2024-05-08T18:33:04.795512+0000","last_clean":"2024-05-08T18:33:04.795512+0000","last_became_active":"2024-05-08T18:31:08.318901+0000","last_became_peered":"2024-05-08T18:31:08.318901+0000","last_unstale":"2024-05-08T18:33:04.795512+0000","last_undegraded":"2024-05-08T18:33:04.795512+0000","last_fullsized":"2024-05-08T18:33:04.795512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:21.670979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.870376+0000","last_change":"2024-05-08T18:31:00.293009+0000","last_active":"2024-05-08T18:32:22.870376+0000","last_peered":"2024-05-08T18:32:22.870376+0000","last_clean":"2024-05-08T18:32:22.870376+0000","last_became_active":"2024-05-08T18:31:00.292376+0000","last_became_peered":"2024-05-08T18:31:00.292376+0000","last_unstale":"2024-05-08T18:32:22.870376+0000","last_undegraded":"2024-05-08T18:32:22.870376+0000","last_fullsized":"2024-05-08T18:32:22.870376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:09.586689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329734+0000","last_change":"2024-05-08T18:30:58.301858+0000","last_active":"2024-05-08T18:31:45.329734+0000","last_peered":"2024-05-08T18:31:45.329734+0000","last_clean":"2024-05-08T18:31:45.329734+0000","last_became_active":"2024-05-08T18:30:58.301520+0000","last_became_peered":"2024-05-08T18:30:58.301520+0000","last_unstale":"2024-05-08T18:31:45.329734+0000","last_undegraded":"2024-05-08T18:31:45.329734+0000","last_fullsized":"2024-05-08T18:31:45.329734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:46.459524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328015+0000","last_change":"2024-05-08T18:31:02.293828+0000","last_active":"2024-05-08T18:31:45.328015+0000","last_peered":"2024-05-08T18:31:45.328015+0000","last_clean":"2024-05-08T18:31:45.328015+0000","last_became_active":"2024-05-08T18:31:02.293459+0000","last_became_peered":"2024-05-08T18:31:02.293459+0000","last_unstale":"2024-05-08T18:31:45.328015+0000","last_undegraded":"2024-05-08T18:31:45.328015+0000","last_fullsized":"2024-05-08T18:31:45.328015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:45.110612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.598503+0000","last_change":"2024-05-08T18:31:04.298674+0000","last_active":"2024-05-08T18:34:06.598503+0000","last_peered":"2024-05-08T18:34:06.598503+0000","last_clean":"2024-05-08T18:34:06.598503+0000","last_became_active":"2024-05-08T18:31:04.298237+0000","last_became_peered":"2024-05-08T18:31:04.298237+0000","last_unstale":"2024-05-08T18:34:06.598503+0000","last_undegraded":"2024-05-08T18:34:06.598503+0000","last_fullsized":"2024-05-08T18:34:06.598503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:57.297845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329847+0000","last_change":"2024-05-08T18:31:06.307437+0000","last_active":"2024-05-08T18:31:45.329847+0000","last_peered":"2024-05-08T18:31:45.329847+0000","last_clean":"2024-05-08T18:31:45.329847+0000","last_became_active":"2024-05-08T18:31:06.307048+0000","last_became_peered":"2024-05-08T18:31:06.307048+0000","last_unstale":"2024-05-08T18:31:45.329847+0000","last_undegraded":"2024-05-08T18:31:45.329847+0000","last_fullsized":"2024-05-08T18:31:45.329847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:21:52.918678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329757+0000","last_change":"2024-05-08T18:31:08.314432+0000","last_active":"2024-05-08T18:31:45.329757+0000","last_peered":"2024-05-08T18:31:45.329757+0000","last_clean":"2024-05-08T18:31:45.329757+0000","last_became_active":"2024-05-08T18:31:08.313943+0000","last_became_peered":"2024-05-08T18:31:08.313943+0000","last_unstale":"2024-05-08T18:31:45.329757+0000","last_undegraded":"2024-05-08T18:31:45.329757+0000","last_fullsized":"2024-05-08T18:31:45.329757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:40.327081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271781+0000","last_change":"2024-05-08T18:31:00.286107+0000","last_active":"2024-05-08T18:34:07.271781+0000","last_peered":"2024-05-08T18:34:07.271781+0000","last_clean":"2024-05-08T18:34:07.271781+0000","last_became_active":"2024-05-08T18:31:00.285842+0000","last_became_peered":"2024-05-08T18:31:00.285842+0000","last_unstale":"2024-05-08T18:34:07.271781+0000","last_undegraded":"2024-05-08T18:34:07.271781+0000","last_fullsized":"2024-05-08T18:34:07.271781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:19.399639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336683+0000","last_change":"2024-05-08T18:30:58.303703+0000","last_active":"2024-05-08T18:31:45.336683+0000","last_peered":"2024-05-08T18:31:45.336683+0000","last_clean":"2024-05-08T18:31:45.336683+0000","last_became_active":"2024-05-08T18:30:58.303112+0000","last_became_peered":"2024-05-08T18:30:58.303112+0000","last_unstale":"2024-05-08T18:31:45.336683+0000","last_undegraded":"2024-05-08T18:31:45.336683+0000","last_fullsized":"2024-05-08T18:31:45.336683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:25.031288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331560+0000","last_change":"2024-05-08T18:31:02.295088+0000","last_active":"2024-05-08T18:31:45.331560+0000","last_peered":"2024-05-08T18:31:45.331560+0000","last_clean":"2024-05-08T18:31:45.331560+0000","last_became_active":"2024-05-08T18:31:02.294812+0000","last_became_peered":"2024-05-08T18:31:02.294812+0000","last_unstale":"2024-05-08T18:31:45.331560+0000","last_undegraded":"2024-05-08T18:31:45.331560+0000","last_fullsized":"2024-05-08T18:31:45.331560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:59.466223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'40","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.660807+0000","last_change":"2024-05-08T18:31:04.302309+0000","last_active":"2024-05-08T18:34:06.660807+0000","last_peered":"2024-05-08T18:34:06.660807+0000","last_clean":"2024-05-08T18:34:06.660807+0000","last_became_active":"2024-05-08T18:31:04.301969+0000","last_became_peered":"2024-05-08T18:31:04.301969+0000","last_unstale":"2024-05-08T18:34:06.660807+0000","last_undegraded":"2024-05-08T18:34:06.660807+0000","last_fullsized":"2024-05-08T18:34:06.660807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:14.097510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334470+0000","last_change":"2024-05-08T18:31:06.306660+0000","last_active":"2024-05-08T18:31:45.334470+0000","last_peered":"2024-05-08T18:31:45.334470+0000","last_clean":"2024-05-08T18:31:45.334470+0000","last_became_active":"2024-05-08T18:31:06.306346+0000","last_became_peered":"2024-05-08T18:31:06.306346+0000","last_unstale":"2024-05-08T18:31:45.334470+0000","last_undegraded":"2024-05-08T18:31:45.334470+0000","last_fullsized":"2024-05-08T18:31:45.334470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:47:23.413504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328038+0000","last_change":"2024-05-08T18:31:08.317029+0000","last_active":"2024-05-08T18:31:45.328038+0000","last_peered":"2024-05-08T18:31:45.328038+0000","last_clean":"2024-05-08T18:31:45.328038+0000","last_became_active":"2024-05-08T18:31:08.316673+0000","last_became_peered":"2024-05-08T18:31:08.316673+0000","last_unstale":"2024-05-08T18:31:45.328038+0000","last_undegraded":"2024-05-08T18:31:45.328038+0000","last_fullsized":"2024-05-08T18:31:45.328038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:47.053479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327883+0000","last_change":"2024-05-08T18:31:00.291577+0000","last_active":"2024-05-08T18:31:45.327883+0000","last_peered":"2024-05-08T18:31:45.327883+0000","last_clean":"2024-05-08T18:31:45.327883+0000","last_became_active":"2024-05-08T18:31:00.291163+0000","last_became_peered":"2024-05-08T18:31:00.291163+0000","last_unstale":"2024-05-08T18:31:45.327883+0000","last_undegraded":"2024-05-08T18:31:45.327883+0000","last_fullsized":"2024-05-08T18:31:45.327883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:38.677165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.323955+0000","last_change":"2024-05-08T18:30:58.305036+0000","last_active":"2024-05-08T18:33:03.323955+0000","last_peered":"2024-05-08T18:33:03.323955+0000","last_clean":"2024-05-08T18:33:03.323955+0000","last_became_active":"2024-05-08T18:30:58.304135+0000","last_became_peered":"2024-05-08T18:30:58.304135+0000","last_unstale":"2024-05-08T18:33:03.323955+0000","last_undegraded":"2024-05-08T18:33:03.323955+0000","last_fullsized":"2024-05-08T18:33:03.323955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:26.528845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327635+0000","last_change":"2024-05-08T18:31:02.290480+0000","last_active":"2024-05-08T18:31:45.327635+0000","last_peered":"2024-05-08T18:31:45.327635+0000","last_clean":"2024-05-08T18:31:45.327635+0000","last_became_active":"2024-05-08T18:31:02.290191+0000","last_became_peered":"2024-05-08T18:31:02.290191+0000","last_unstale":"2024-05-08T18:31:45.327635+0000","last_undegraded":"2024-05-08T18:31:45.327635+0000","last_fullsized":"2024-05-08T18:31:45.327635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:53.106616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.071221+0000","last_change":"2024-05-08T18:31:04.295526+0000","last_active":"2024-05-08T18:33:05.071221+0000","last_peered":"2024-05-08T18:33:05.071221+0000","last_clean":"2024-05-08T18:33:05.071221+0000","last_became_active":"2024-05-08T18:31:04.295255+0000","last_became_peered":"2024-05-08T18:31:04.295255+0000","last_unstale":"2024-05-08T18:33:05.071221+0000","last_undegraded":"2024-05-08T18:33:05.071221+0000","last_fullsized":"2024-05-08T18:33:05.071221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:47.180901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330989+0000","last_change":"2024-05-08T18:31:06.305114+0000","last_active":"2024-05-08T18:31:45.330989+0000","last_peered":"2024-05-08T18:31:45.330989+0000","last_clean":"2024-05-08T18:31:45.330989+0000","last_became_active":"2024-05-08T18:31:06.304851+0000","last_became_peered":"2024-05-08T18:31:06.304851+0000","last_unstale":"2024-05-08T18:31:45.330989+0000","last_undegraded":"2024-05-08T18:31:45.330989+0000","last_fullsized":"2024-05-08T18:31:45.330989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:36.598673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'8","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.580774+0000","last_change":"2024-05-08T18:31:45.343090+0000","last_active":"2024-05-08T18:33:06.580774+0000","last_peered":"2024-05-08T18:33:06.580774+0000","last_clean":"2024-05-08T18:33:06.580774+0000","last_became_active":"2024-05-08T18:31:45.336717+0000","last_became_peered":"2024-05-08T18:31:45.336717+0000","last_unstale":"2024-05-08T18:33:06.580774+0000","last_undegraded":"2024-05-08T18:33:06.580774+0000","last_fullsized":"2024-05-08T18:33:06.580774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:06.350550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327536+0000","last_change":"2024-05-08T18:30:58.303784+0000","last_active":"2024-05-08T18:31:45.327536+0000","last_peered":"2024-05-08T18:31:45.327536+0000","last_clean":"2024-05-08T18:31:45.327536+0000","last_became_active":"2024-05-08T18:30:58.302486+0000","last_became_peered":"2024-05-08T18:30:58.302486+0000","last_unstale":"2024-05-08T18:31:45.327536+0000","last_undegraded":"2024-05-08T18:31:45.327536+0000","last_fullsized":"2024-05-08T18:31:45.327536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:19.905174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330661+0000","last_change":"2024-05-08T18:31:02.292304+0000","last_active":"2024-05-08T18:31:45.330661+0000","last_peered":"2024-05-08T18:31:45.330661+0000","last_clean":"2024-05-08T18:31:45.330661+0000","last_became_active":"2024-05-08T18:31:02.291965+0000","last_became_peered":"2024-05-08T18:31:02.291965+0000","last_unstale":"2024-05-08T18:31:45.330661+0000","last_undegraded":"2024-05-08T18:31:45.330661+0000","last_fullsized":"2024-05-08T18:31:45.330661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:45.173868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.092410+0000","last_change":"2024-05-08T18:31:04.298401+0000","last_active":"2024-05-08T18:33:05.092410+0000","last_peered":"2024-05-08T18:33:05.092410+0000","last_clean":"2024-05-08T18:33:05.092410+0000","last_became_active":"2024-05-08T18:31:04.298061+0000","last_became_peered":"2024-05-08T18:31:04.298061+0000","last_unstale":"2024-05-08T18:33:05.092410+0000","last_undegraded":"2024-05-08T18:33:05.092410+0000","last_fullsized":"2024-05-08T18:33:05.092410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:36.394225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329659+0000","last_change":"2024-05-08T18:31:06.308566+0000","last_active":"2024-05-08T18:31:45.329659+0000","last_peered":"2024-05-08T18:31:45.329659+0000","last_clean":"2024-05-08T18:31:45.329659+0000","last_became_active":"2024-05-08T18:31:06.308247+0000","last_became_peered":"2024-05-08T18:31:06.308247+0000","last_unstale":"2024-05-08T18:31:45.329659+0000","last_undegraded":"2024-05-08T18:31:45.329659+0000","last_fullsized":"2024-05-08T18:31:45.329659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:43.989468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.059608+0000","last_change":"2024-05-08T18:31:08.314319+0000","last_active":"2024-05-08T18:34:07.059608+0000","last_peered":"2024-05-08T18:34:07.059608+0000","last_clean":"2024-05-08T18:34:07.059608+0000","last_became_active":"2024-05-08T18:31:08.313986+0000","last_became_peered":"2024-05-08T18:31:08.313986+0000","last_unstale":"2024-05-08T18:34:07.059608+0000","last_undegraded":"2024-05-08T18:34:07.059608+0000","last_fullsized":"2024-05-08T18:34:07.059608+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:34.156497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.240343+0000","last_change":"2024-05-08T18:31:00.281726+0000","last_active":"2024-05-08T18:34:07.240343+0000","last_peered":"2024-05-08T18:34:07.240343+0000","last_clean":"2024-05-08T18:34:07.240343+0000","last_became_active":"2024-05-08T18:31:00.281233+0000","last_became_peered":"2024-05-08T18:31:00.281233+0000","last_unstale":"2024-05-08T18:34:07.240343+0000","last_undegraded":"2024-05-08T18:34:07.240343+0000","last_fullsized":"2024-05-08T18:34:07.240343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:16:11.480889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334233+0000","last_change":"2024-05-08T18:30:58.290021+0000","last_active":"2024-05-08T18:31:45.334233+0000","last_peered":"2024-05-08T18:31:45.334233+0000","last_clean":"2024-05-08T18:31:45.334233+0000","last_became_active":"2024-05-08T18:30:58.289251+0000","last_became_peered":"2024-05-08T18:30:58.289251+0000","last_unstale":"2024-05-08T18:31:45.334233+0000","last_undegraded":"2024-05-08T18:31:45.334233+0000","last_fullsized":"2024-05-08T18:31:45.334233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:33.046479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332268+0000","last_change":"2024-05-08T18:31:02.293460+0000","last_active":"2024-05-08T18:31:45.332268+0000","last_peered":"2024-05-08T18:31:45.332268+0000","last_clean":"2024-05-08T18:31:45.332268+0000","last_became_active":"2024-05-08T18:31:02.293185+0000","last_became_peered":"2024-05-08T18:31:02.293185+0000","last_unstale":"2024-05-08T18:31:45.332268+0000","last_undegraded":"2024-05-08T18:31:45.332268+0000","last_fullsized":"2024-05-08T18:31:45.332268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:43.800799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.072164+0000","last_change":"2024-05-08T18:31:04.298821+0000","last_active":"2024-05-08T18:33:05.072164+0000","last_peered":"2024-05-08T18:33:05.072164+0000","last_clean":"2024-05-08T18:33:05.072164+0000","last_became_active":"2024-05-08T18:31:04.298482+0000","last_became_peered":"2024-05-08T18:31:04.298482+0000","last_unstale":"2024-05-08T18:33:05.072164+0000","last_undegraded":"2024-05-08T18:33:05.072164+0000","last_fullsized":"2024-05-08T18:33:05.072164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:16.451277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336190+0000","last_change":"2024-05-08T18:31:06.311670+0000","last_active":"2024-05-08T18:31:45.336190+0000","last_peered":"2024-05-08T18:31:45.336190+0000","last_clean":"2024-05-08T18:31:45.336190+0000","last_became_active":"2024-05-08T18:31:06.311392+0000","last_became_peered":"2024-05-08T18:31:06.311392+0000","last_unstale":"2024-05-08T18:31:45.336190+0000","last_undegraded":"2024-05-08T18:31:45.336190+0000","last_fullsized":"2024-05-08T18:31:45.336190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:17.968800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327375+0000","last_change":"2024-05-08T18:31:08.319678+0000","last_active":"2024-05-08T18:31:45.327375+0000","last_peered":"2024-05-08T18:31:45.327375+0000","last_clean":"2024-05-08T18:31:45.327375+0000","last_became_active":"2024-05-08T18:31:08.319394+0000","last_became_peered":"2024-05-08T18:31:08.319394+0000","last_unstale":"2024-05-08T18:31:45.327375+0000","last_undegraded":"2024-05-08T18:31:45.327375+0000","last_fullsized":"2024-05-08T18:31:45.327375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:16.822143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'18","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271649+0000","last_change":"2024-05-08T18:31:00.300170+0000","last_active":"2024-05-08T18:34:07.271649+0000","last_peered":"2024-05-08T18:34:07.271649+0000","last_clean":"2024-05-08T18:34:07.271649+0000","last_became_active":"2024-05-08T18:31:00.299547+0000","last_became_peered":"2024-05-08T18:31:00.299547+0000","last_unstale":"2024-05-08T18:34:07.271649+0000","last_undegraded":"2024-05-08T18:34:07.271649+0000","last_fullsized":"2024-05-08T18:34:07.271649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:21.996058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334865+0000","last_change":"2024-05-08T18:30:58.305155+0000","last_active":"2024-05-08T18:31:45.334865+0000","last_peered":"2024-05-08T18:31:45.334865+0000","last_clean":"2024-05-08T18:31:45.334865+0000","last_became_active":"2024-05-08T18:30:58.303624+0000","last_became_peered":"2024-05-08T18:30:58.303624+0000","last_unstale":"2024-05-08T18:31:45.334865+0000","last_undegraded":"2024-05-08T18:31:45.334865+0000","last_fullsized":"2024-05-08T18:31:45.334865+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:04.148371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331693+0000","last_change":"2024-05-08T18:31:02.292792+0000","last_active":"2024-05-08T18:31:45.331693+0000","last_peered":"2024-05-08T18:31:45.331693+0000","last_clean":"2024-05-08T18:31:45.331693+0000","last_became_active":"2024-05-08T18:31:02.292498+0000","last_became_peered":"2024-05-08T18:31:02.292498+0000","last_unstale":"2024-05-08T18:31:45.331693+0000","last_undegraded":"2024-05-08T18:31:45.331693+0000","last_fullsized":"2024-05-08T18:31:45.331693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:45.114148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.090360+0000","last_change":"2024-05-08T18:31:04.297701+0000","last_active":"2024-05-08T18:33:05.090360+0000","last_peered":"2024-05-08T18:33:05.090360+0000","last_clean":"2024-05-08T18:33:05.090360+0000","last_became_active":"2024-05-08T18:31:04.297297+0000","last_became_peered":"2024-05-08T18:31:04.297297+0000","last_unstale":"2024-05-08T18:33:05.090360+0000","last_undegraded":"2024-05-08T18:33:05.090360+0000","last_fullsized":"2024-05-08T18:33:05.090360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:01.274241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330477+0000","last_change":"2024-05-08T18:31:06.305923+0000","last_active":"2024-05-08T18:31:45.330477+0000","last_peered":"2024-05-08T18:31:45.330477+0000","last_clean":"2024-05-08T18:31:45.330477+0000","last_became_active":"2024-05-08T18:31:06.305567+0000","last_became_peered":"2024-05-08T18:31:06.305567+0000","last_unstale":"2024-05-08T18:31:45.330477+0000","last_undegraded":"2024-05-08T18:31:45.330477+0000","last_fullsized":"2024-05-08T18:31:45.330477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:20.352238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'11","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.682210+0000","last_change":"2024-05-08T18:31:08.317380+0000","last_active":"2024-05-08T18:34:06.682210+0000","last_peered":"2024-05-08T18:34:06.682210+0000","last_clean":"2024-05-08T18:34:06.682210+0000","last_became_active":"2024-05-08T18:31:08.316943+0000","last_became_peered":"2024-05-08T18:31:08.316943+0000","last_unstale":"2024-05-08T18:34:06.682210+0000","last_undegraded":"2024-05-08T18:34:06.682210+0000","last_fullsized":"2024-05-08T18:34:06.682210+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:54.462045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'5","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.280149+0000","last_change":"2024-05-08T18:31:00.283641+0000","last_active":"2024-05-08T18:34:07.280149+0000","last_peered":"2024-05-08T18:34:07.280149+0000","last_clean":"2024-05-08T18:34:07.280149+0000","last_became_active":"2024-05-08T18:31:00.282923+0000","last_became_peered":"2024-05-08T18:31:00.282923+0000","last_unstale":"2024-05-08T18:34:07.280149+0000","last_undegraded":"2024-05-08T18:34:07.280149+0000","last_fullsized":"2024-05-08T18:34:07.280149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:09.586689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328361+0000","last_change":"2024-05-08T18:30:58.318535+0000","last_active":"2024-05-08T18:31:45.328361+0000","last_peered":"2024-05-08T18:31:45.328361+0000","last_clean":"2024-05-08T18:31:45.328361+0000","last_became_active":"2024-05-08T18:30:58.316980+0000","last_became_peered":"2024-05-08T18:30:58.316980+0000","last_unstale":"2024-05-08T18:31:45.328361+0000","last_undegraded":"2024-05-08T18:31:45.328361+0000","last_fullsized":"2024-05-08T18:31:45.328361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:22:52.128630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336413+0000","last_change":"2024-05-08T18:31:02.288494+0000","last_active":"2024-05-08T18:31:45.336413+0000","last_peered":"2024-05-08T18:31:45.336413+0000","last_clean":"2024-05-08T18:31:45.336413+0000","last_became_active":"2024-05-08T18:31:02.288127+0000","last_became_peered":"2024-05-08T18:31:02.288127+0000","last_unstale":"2024-05-08T18:31:45.336413+0000","last_undegraded":"2024-05-08T18:31:45.336413+0000","last_fullsized":"2024-05-08T18:31:45.336413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:58.208003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333068+0000","last_change":"2024-05-08T18:31:04.302369+0000","last_active":"2024-05-08T18:31:45.333068+0000","last_peered":"2024-05-08T18:31:45.333068+0000","last_clean":"2024-05-08T18:31:45.333068+0000","last_became_active":"2024-05-08T18:31:04.302034+0000","last_became_peered":"2024-05-08T18:31:04.302034+0000","last_unstale":"2024-05-08T18:31:45.333068+0000","last_undegraded":"2024-05-08T18:31:45.333068+0000","last_fullsized":"2024-05-08T18:31:45.333068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:50:40.916183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'282","reported_seq":406,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370201+0000","last_change":"2024-05-08T18:31:06.311326+0000","last_active":"2024-05-08T18:34:07.370201+0000","last_peered":"2024-05-08T18:34:07.370201+0000","last_clean":"2024-05-08T18:34:07.370201+0000","last_became_active":"2024-05-08T18:31:06.311063+0000","last_became_peered":"2024-05-08T18:31:06.311063+0000","last_unstale":"2024-05-08T18:34:07.370201+0000","last_undegraded":"2024-05-08T18:34:07.370201+0000","last_fullsized":"2024-05-08T18:34:07.370201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:46.356134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327053+0000","last_change":"2024-05-08T18:31:08.320650+0000","last_active":"2024-05-08T18:31:45.327053+0000","last_peered":"2024-05-08T18:31:45.327053+0000","last_clean":"2024-05-08T18:31:45.327053+0000","last_became_active":"2024-05-08T18:31:08.320260+0000","last_became_peered":"2024-05-08T18:31:08.320260+0000","last_unstale":"2024-05-08T18:31:45.327053+0000","last_undegraded":"2024-05-08T18:31:45.327053+0000","last_fullsized":"2024-05-08T18:31:45.327053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:03.499843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.580949+0000","last_change":"2024-05-08T18:31:00.285978+0000","last_active":"2024-05-08T18:33:06.580949+0000","last_peered":"2024-05-08T18:33:06.580949+0000","last_clean":"2024-05-08T18:33:06.580949+0000","last_became_active":"2024-05-08T18:31:00.284982+0000","last_became_peered":"2024-05-08T18:31:00.284982+0000","last_unstale":"2024-05-08T18:33:06.580949+0000","last_undegraded":"2024-05-08T18:33:06.580949+0000","last_fullsized":"2024-05-08T18:33:06.580949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:19.399639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.338145+0000","last_change":"2024-05-08T18:30:58.306355+0000","last_active":"2024-05-08T18:31:45.338145+0000","last_peered":"2024-05-08T18:31:45.338145+0000","last_clean":"2024-05-08T18:31:45.338145+0000","last_became_active":"2024-05-08T18:30:58.304969+0000","last_became_peered":"2024-05-08T18:30:58.304969+0000","last_unstale":"2024-05-08T18:31:45.338145+0000","last_undegraded":"2024-05-08T18:31:45.338145+0000","last_fullsized":"2024-05-08T18:31:45.338145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:07.501461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334669+0000","last_change":"2024-05-08T18:31:02.289211+0000","last_active":"2024-05-08T18:31:45.334669+0000","last_peered":"2024-05-08T18:31:45.334669+0000","last_clean":"2024-05-08T18:31:45.334669+0000","last_became_active":"2024-05-08T18:31:02.288719+0000","last_became_peered":"2024-05-08T18:31:02.288719+0000","last_unstale":"2024-05-08T18:31:45.334669+0000","last_undegraded":"2024-05-08T18:31:45.334669+0000","last_fullsized":"2024-05-08T18:31:45.334669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:42.419001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'37","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.062940+0000","last_change":"2024-05-08T18:31:04.299750+0000","last_active":"2024-05-08T18:33:05.062940+0000","last_peered":"2024-05-08T18:33:05.062940+0000","last_clean":"2024-05-08T18:33:05.062940+0000","last_became_active":"2024-05-08T18:31:04.297013+0000","last_became_peered":"2024-05-08T18:31:04.297013+0000","last_unstale":"2024-05-08T18:33:05.062940+0000","last_undegraded":"2024-05-08T18:33:05.062940+0000","last_fullsized":"2024-05-08T18:33:05.062940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:34.756044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328787+0000","last_change":"2024-05-08T18:31:06.312037+0000","last_active":"2024-05-08T18:31:45.328787+0000","last_peered":"2024-05-08T18:31:45.328787+0000","last_clean":"2024-05-08T18:31:45.328787+0000","last_became_active":"2024-05-08T18:31:06.311767+0000","last_became_peered":"2024-05-08T18:31:06.311767+0000","last_unstale":"2024-05-08T18:31:45.328787+0000","last_undegraded":"2024-05-08T18:31:45.328787+0000","last_fullsized":"2024-05-08T18:31:45.328787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:32.310721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.985534+0000","last_change":"2024-05-08T18:31:08.313489+0000","last_active":"2024-05-08T18:34:06.985534+0000","last_peered":"2024-05-08T18:34:06.985534+0000","last_clean":"2024-05-08T18:34:06.985534+0000","last_became_active":"2024-05-08T18:31:08.312031+0000","last_became_peered":"2024-05-08T18:31:08.312031+0000","last_unstale":"2024-05-08T18:34:06.985534+0000","last_undegraded":"2024-05-08T18:34:06.985534+0000","last_fullsized":"2024-05-08T18:34:06.985534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:40.327081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.681165+0000","last_change":"2024-05-08T18:31:00.282870+0000","last_active":"2024-05-08T18:32:22.681165+0000","last_peered":"2024-05-08T18:32:22.681165+0000","last_clean":"2024-05-08T18:32:22.681165+0000","last_became_active":"2024-05-08T18:31:00.282605+0000","last_became_peered":"2024-05-08T18:31:00.282605+0000","last_unstale":"2024-05-08T18:32:22.681165+0000","last_undegraded":"2024-05-08T18:32:22.681165+0000","last_fullsized":"2024-05-08T18:32:22.681165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:30.009947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330348+0000","last_change":"2024-05-08T18:30:58.316801+0000","last_active":"2024-05-08T18:31:45.330348+0000","last_peered":"2024-05-08T18:31:45.330348+0000","last_clean":"2024-05-08T18:31:45.330348+0000","last_became_active":"2024-05-08T18:30:58.316166+0000","last_became_peered":"2024-05-08T18:30:58.316166+0000","last_unstale":"2024-05-08T18:31:45.330348+0000","last_undegraded":"2024-05-08T18:31:45.330348+0000","last_fullsized":"2024-05-08T18:31:45.330348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:24.440258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334438+0000","last_change":"2024-05-08T18:31:02.294645+0000","last_active":"2024-05-08T18:31:45.334438+0000","last_peered":"2024-05-08T18:31:45.334438+0000","last_clean":"2024-05-08T18:31:45.334438+0000","last_became_active":"2024-05-08T18:31:02.294335+0000","last_became_peered":"2024-05-08T18:31:02.294335+0000","last_unstale":"2024-05-08T18:31:45.334438+0000","last_undegraded":"2024-05-08T18:31:45.334438+0000","last_fullsized":"2024-05-08T18:31:45.334438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:40:41.976982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.063967+0000","last_change":"2024-05-08T18:31:04.297821+0000","last_active":"2024-05-08T18:33:05.063967+0000","last_peered":"2024-05-08T18:33:05.063967+0000","last_clean":"2024-05-08T18:33:05.063967+0000","last_became_active":"2024-05-08T18:31:04.297440+0000","last_became_peered":"2024-05-08T18:31:04.297440+0000","last_unstale":"2024-05-08T18:33:05.063967+0000","last_undegraded":"2024-05-08T18:33:05.063967+0000","last_fullsized":"2024-05-08T18:33:05.063967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:14.624732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327191+0000","last_change":"2024-05-08T18:31:06.312504+0000","last_active":"2024-05-08T18:31:45.327191+0000","last_peered":"2024-05-08T18:31:45.327191+0000","last_clean":"2024-05-08T18:31:45.327191+0000","last_became_active":"2024-05-08T18:31:06.312162+0000","last_became_peered":"2024-05-08T18:31:06.312162+0000","last_unstale":"2024-05-08T18:31:45.327191+0000","last_undegraded":"2024-05-08T18:31:45.327191+0000","last_fullsized":"2024-05-08T18:31:45.327191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:25.211733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.331019+0000","last_change":"2024-05-08T18:31:08.318309+0000","last_active":"2024-05-08T18:33:03.331019+0000","last_peered":"2024-05-08T18:33:03.331019+0000","last_clean":"2024-05-08T18:33:03.331019+0000","last_became_active":"2024-05-08T18:31:08.318072+0000","last_became_peered":"2024-05-08T18:31:08.318072+0000","last_unstale":"2024-05-08T18:33:03.331019+0000","last_undegraded":"2024-05-08T18:33:03.331019+0000","last_fullsized":"2024-05-08T18:33:03.331019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:36:18.141092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'4","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.247651+0000","last_change":"2024-05-08T18:31:00.292044+0000","last_active":"2024-05-08T18:34:07.247651+0000","last_peered":"2024-05-08T18:34:07.247651+0000","last_clean":"2024-05-08T18:34:07.247651+0000","last_became_active":"2024-05-08T18:31:00.291128+0000","last_became_peered":"2024-05-08T18:31:00.291128+0000","last_unstale":"2024-05-08T18:34:07.247651+0000","last_undegraded":"2024-05-08T18:34:07.247651+0000","last_fullsized":"2024-05-08T18:34:07.247651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:28.671220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330831+0000","last_change":"2024-05-08T18:30:58.285590+0000","last_active":"2024-05-08T18:31:45.330831+0000","last_peered":"2024-05-08T18:31:45.330831+0000","last_clean":"2024-05-08T18:31:45.330831+0000","last_became_active":"2024-05-08T18:30:58.283402+0000","last_became_peered":"2024-05-08T18:30:58.283402+0000","last_unstale":"2024-05-08T18:31:45.330831+0000","last_undegraded":"2024-05-08T18:31:45.330831+0000","last_fullsized":"2024-05-08T18:31:45.330831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:43.233516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336457+0000","last_change":"2024-05-08T18:31:02.292679+0000","last_active":"2024-05-08T18:31:45.336457+0000","last_peered":"2024-05-08T18:31:45.336457+0000","last_clean":"2024-05-08T18:31:45.336457+0000","last_became_active":"2024-05-08T18:31:02.291363+0000","last_became_peered":"2024-05-08T18:31:02.291363+0000","last_unstale":"2024-05-08T18:31:45.336457+0000","last_undegraded":"2024-05-08T18:31:45.336457+0000","last_fullsized":"2024-05-08T18:31:45.336457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:40.683748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'29","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.088039+0000","last_change":"2024-05-08T18:31:04.298937+0000","last_active":"2024-05-08T18:33:05.088039+0000","last_peered":"2024-05-08T18:33:05.088039+0000","last_clean":"2024-05-08T18:33:05.088039+0000","last_became_active":"2024-05-08T18:31:04.298601+0000","last_became_peered":"2024-05-08T18:31:04.298601+0000","last_unstale":"2024-05-08T18:33:05.088039+0000","last_undegraded":"2024-05-08T18:33:05.088039+0000","last_fullsized":"2024-05-08T18:33:05.088039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:52.647996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":40,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327562+0000","last_change":"2024-05-08T18:31:06.308361+0000","last_active":"2024-05-08T18:31:45.327562+0000","last_peered":"2024-05-08T18:31:45.327562+0000","last_clean":"2024-05-08T18:31:45.327562+0000","last_became_active":"2024-05-08T18:31:06.307801+0000","last_became_peered":"2024-05-08T18:31:06.307801+0000","last_unstale":"2024-05-08T18:31:45.327562+0000","last_undegraded":"2024-05-08T18:31:45.327562+0000","last_fullsized":"2024-05-08T18:31:45.327562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:23.188589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.098741+0000","last_change":"2024-05-08T18:31:08.319580+0000","last_active":"2024-05-08T18:33:05.098741+0000","last_peered":"2024-05-08T18:33:05.098741+0000","last_clean":"2024-05-08T18:33:05.098741+0000","last_became_active":"2024-05-08T18:31:08.319232+0000","last_became_peered":"2024-05-08T18:31:08.319232+0000","last_unstale":"2024-05-08T18:33:05.098741+0000","last_undegraded":"2024-05-08T18:33:05.098741+0000","last_fullsized":"2024-05-08T18:33:05.098741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:04.750785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271785+0000","last_change":"2024-05-08T18:31:00.283026+0000","last_active":"2024-05-08T18:34:07.271785+0000","last_peered":"2024-05-08T18:34:07.271785+0000","last_clean":"2024-05-08T18:34:07.271785+0000","last_became_active":"2024-05-08T18:31:00.282644+0000","last_became_peered":"2024-05-08T18:31:00.282644+0000","last_unstale":"2024-05-08T18:34:07.271785+0000","last_undegraded":"2024-05-08T18:34:07.271785+0000","last_fullsized":"2024-05-08T18:34:07.271785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:26.448180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.944420+0000","last_change":"2024-05-08T18:30:58.304661+0000","last_active":"2024-05-08T18:34:06.944420+0000","last_peered":"2024-05-08T18:34:06.944420+0000","last_clean":"2024-05-08T18:34:06.944420+0000","last_became_active":"2024-05-08T18:30:58.303312+0000","last_became_peered":"2024-05-08T18:30:58.303312+0000","last_unstale":"2024-05-08T18:34:06.944420+0000","last_undegraded":"2024-05-08T18:34:06.944420+0000","last_fullsized":"2024-05-08T18:34:06.944420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:46.459524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'6","reported_seq":228,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.172197+0000","last_change":"2024-05-08T18:31:02.288759+0000","last_active":"2024-05-08T18:33:06.172197+0000","last_peered":"2024-05-08T18:33:06.172197+0000","last_clean":"2024-05-08T18:33:06.172197+0000","last_became_active":"2024-05-08T18:31:02.288433+0000","last_became_peered":"2024-05-08T18:31:02.288433+0000","last_unstale":"2024-05-08T18:33:06.172197+0000","last_undegraded":"2024-05-08T18:33:06.172197+0000","last_fullsized":"2024-05-08T18:33:06.172197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:35.557614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'32","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.599172+0000","last_change":"2024-05-08T18:31:04.299253+0000","last_active":"2024-05-08T18:34:06.599172+0000","last_peered":"2024-05-08T18:34:06.599172+0000","last_clean":"2024-05-08T18:34:06.599172+0000","last_became_active":"2024-05-08T18:31:04.298089+0000","last_became_peered":"2024-05-08T18:31:04.298089+0000","last_unstale":"2024-05-08T18:34:06.599172+0000","last_undegraded":"2024-05-08T18:34:06.599172+0000","last_fullsized":"2024-05-08T18:34:06.599172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:34.386559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329003+0000","last_change":"2024-05-08T18:31:06.312121+0000","last_active":"2024-05-08T18:31:45.329003+0000","last_peered":"2024-05-08T18:31:45.329003+0000","last_clean":"2024-05-08T18:31:45.329003+0000","last_became_active":"2024-05-08T18:31:06.311810+0000","last_became_peered":"2024-05-08T18:31:06.311810+0000","last_unstale":"2024-05-08T18:31:45.329003+0000","last_undegraded":"2024-05-08T18:31:45.329003+0000","last_fullsized":"2024-05-08T18:31:45.329003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:01.719275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.101535+0000","last_change":"2024-05-08T18:31:08.317101+0000","last_active":"2024-05-08T18:33:05.101535+0000","last_peered":"2024-05-08T18:33:05.101535+0000","last_clean":"2024-05-08T18:33:05.101535+0000","last_became_active":"2024-05-08T18:31:08.316723+0000","last_became_peered":"2024-05-08T18:31:08.316723+0000","last_unstale":"2024-05-08T18:33:05.101535+0000","last_undegraded":"2024-05-08T18:33:05.101535+0000","last_fullsized":"2024-05-08T18:33:05.101535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:49.236295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.346732+0000","last_change":"2024-05-08T18:31:45.346058+0000","last_active":"2024-05-08T18:31:45.346732+0000","last_peered":"2024-05-08T18:31:45.346732+0000","last_clean":"2024-05-08T18:31:45.346732+0000","last_became_active":"2024-05-08T18:31:45.339252+0000","last_became_peered":"2024-05-08T18:31:45.339252+0000","last_unstale":"2024-05-08T18:31:45.346732+0000","last_undegraded":"2024-05-08T18:31:45.346732+0000","last_fullsized":"2024-05-08T18:31:45.346732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:50:36.902568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176307+0000","last_change":"2024-05-08T18:30:58.308668+0000","last_active":"2024-05-08T18:33:03.176307+0000","last_peered":"2024-05-08T18:33:03.176307+0000","last_clean":"2024-05-08T18:33:03.176307+0000","last_became_active":"2024-05-08T18:30:58.308290+0000","last_became_peered":"2024-05-08T18:30:58.308290+0000","last_unstale":"2024-05-08T18:33:03.176307+0000","last_undegraded":"2024-05-08T18:33:03.176307+0000","last_fullsized":"2024-05-08T18:33:03.176307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:38.049573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.869487+0000","last_change":"2024-05-08T18:31:00.283309+0000","last_active":"2024-05-08T18:32:22.869487+0000","last_peered":"2024-05-08T18:32:22.869487+0000","last_clean":"2024-05-08T18:32:22.869487+0000","last_became_active":"2024-05-08T18:31:00.282889+0000","last_became_peered":"2024-05-08T18:31:00.282889+0000","last_unstale":"2024-05-08T18:32:22.869487+0000","last_undegraded":"2024-05-08T18:32:22.869487+0000","last_fullsized":"2024-05-08T18:32:22.869487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:30.686060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328796+0000","last_change":"2024-05-08T18:30:58.295262+0000","last_active":"2024-05-08T18:31:45.328796+0000","last_peered":"2024-05-08T18:31:45.328796+0000","last_clean":"2024-05-08T18:31:45.328796+0000","last_became_active":"2024-05-08T18:30:58.294210+0000","last_became_peered":"2024-05-08T18:30:58.294210+0000","last_unstale":"2024-05-08T18:31:45.328796+0000","last_undegraded":"2024-05-08T18:31:45.328796+0000","last_fullsized":"2024-05-08T18:31:45.328796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:11.650120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196723+0000","last_change":"2024-05-08T18:31:00.298041+0000","last_active":"2024-05-08T18:34:07.196723+0000","last_peered":"2024-05-08T18:34:07.196723+0000","last_clean":"2024-05-08T18:34:07.196723+0000","last_became_active":"2024-05-08T18:31:00.295749+0000","last_became_peered":"2024-05-08T18:31:00.295749+0000","last_unstale":"2024-05-08T18:34:07.196723+0000","last_undegraded":"2024-05-08T18:34:07.196723+0000","last_fullsized":"2024-05-08T18:34:07.196723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:10.083894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'5","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.177037+0000","last_change":"2024-05-08T18:30:58.316506+0000","last_active":"2024-05-08T18:33:03.177037+0000","last_peered":"2024-05-08T18:33:03.177037+0000","last_clean":"2024-05-08T18:33:03.177037+0000","last_became_active":"2024-05-08T18:30:58.314786+0000","last_became_peered":"2024-05-08T18:30:58.314786+0000","last_unstale":"2024-05-08T18:33:03.177037+0000","last_undegraded":"2024-05-08T18:33:03.177037+0000","last_fullsized":"2024-05-08T18:33:03.177037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:18.913736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'11","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.283079+0000","last_change":"2024-05-08T18:31:00.283309+0000","last_active":"2024-05-08T18:34:07.283079+0000","last_peered":"2024-05-08T18:34:07.283079+0000","last_clean":"2024-05-08T18:34:07.283079+0000","last_became_active":"2024-05-08T18:31:00.282863+0000","last_became_peered":"2024-05-08T18:31:00.282863+0000","last_unstale":"2024-05-08T18:34:07.283079+0000","last_undegraded":"2024-05-08T18:34:07.283079+0000","last_fullsized":"2024-05-08T18:34:07.283079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:55.191334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'3","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.671656+0000","last_change":"2024-05-08T18:30:58.289717+0000","last_active":"2024-05-08T18:32:22.671656+0000","last_peered":"2024-05-08T18:32:22.671656+0000","last_clean":"2024-05-08T18:32:22.671656+0000","last_became_active":"2024-05-08T18:30:58.289337+0000","last_became_peered":"2024-05-08T18:30:58.289337+0000","last_unstale":"2024-05-08T18:32:22.671656+0000","last_undegraded":"2024-05-08T18:32:22.671656+0000","last_fullsized":"2024-05-08T18:32:22.671656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:38.049573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.581291+0000","last_change":"2024-05-08T18:31:00.291487+0000","last_active":"2024-05-08T18:33:06.581291+0000","last_peered":"2024-05-08T18:33:06.581291+0000","last_clean":"2024-05-08T18:33:06.581291+0000","last_became_active":"2024-05-08T18:31:00.291269+0000","last_became_peered":"2024-05-08T18:31:00.291269+0000","last_unstale":"2024-05-08T18:33:06.581291+0000","last_undegraded":"2024-05-08T18:33:06.581291+0000","last_fullsized":"2024-05-08T18:33:06.581291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:30.009947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330816+0000","last_change":"2024-05-08T18:30:58.285778+0000","last_active":"2024-05-08T18:31:45.330816+0000","last_peered":"2024-05-08T18:31:45.330816+0000","last_clean":"2024-05-08T18:31:45.330816+0000","last_became_active":"2024-05-08T18:30:58.283976+0000","last_became_peered":"2024-05-08T18:30:58.283976+0000","last_unstale":"2024-05-08T18:31:45.330816+0000","last_undegraded":"2024-05-08T18:31:45.330816+0000","last_fullsized":"2024-05-08T18:31:45.330816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:23:31.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.202924+0000","last_change":"2024-05-08T18:31:00.292666+0000","last_active":"2024-05-08T18:34:07.202924+0000","last_peered":"2024-05-08T18:34:07.202924+0000","last_clean":"2024-05-08T18:34:07.202924+0000","last_became_active":"2024-05-08T18:31:00.292385+0000","last_became_peered":"2024-05-08T18:31:00.292385+0000","last_unstale":"2024-05-08T18:34:07.202924+0000","last_undegraded":"2024-05-08T18:34:07.202924+0000","last_fullsized":"2024-05-08T18:34:07.202924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:36.076362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.860195+0000","last_change":"2024-05-08T18:30:58.304478+0000","last_active":"2024-05-08T18:32:22.860195+0000","last_peered":"2024-05-08T18:32:22.860195+0000","last_clean":"2024-05-08T18:32:22.860195+0000","last_became_active":"2024-05-08T18:30:58.303839+0000","last_became_peered":"2024-05-08T18:30:58.303839+0000","last_unstale":"2024-05-08T18:32:22.860195+0000","last_undegraded":"2024-05-08T18:32:22.860195+0000","last_fullsized":"2024-05-08T18:32:22.860195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:23:31.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'8","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.965732+0000","last_change":"2024-05-08T18:31:00.288783+0000","last_active":"2024-05-08T18:34:06.965732+0000","last_peered":"2024-05-08T18:34:06.965732+0000","last_clean":"2024-05-08T18:34:06.965732+0000","last_became_active":"2024-05-08T18:31:00.288202+0000","last_became_peered":"2024-05-08T18:31:00.288202+0000","last_unstale":"2024-05-08T18:34:06.965732+0000","last_undegraded":"2024-05-08T18:34:06.965732+0000","last_fullsized":"2024-05-08T18:34:06.965732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:54.772566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336793+0000","last_change":"2024-05-08T18:30:58.305905+0000","last_active":"2024-05-08T18:31:45.336793+0000","last_peered":"2024-05-08T18:31:45.336793+0000","last_clean":"2024-05-08T18:31:45.336793+0000","last_became_active":"2024-05-08T18:30:58.305116+0000","last_became_peered":"2024-05-08T18:30:58.305116+0000","last_unstale":"2024-05-08T18:31:45.336793+0000","last_undegraded":"2024-05-08T18:31:45.336793+0000","last_fullsized":"2024-05-08T18:31:45.336793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:11.650120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.581054+0000","last_change":"2024-05-08T18:31:00.285833+0000","last_active":"2024-05-08T18:33:06.581054+0000","last_peered":"2024-05-08T18:33:06.581054+0000","last_clean":"2024-05-08T18:33:06.581054+0000","last_became_active":"2024-05-08T18:31:00.284439+0000","last_became_peered":"2024-05-08T18:31:00.284439+0000","last_unstale":"2024-05-08T18:33:06.581054+0000","last_undegraded":"2024-05-08T18:33:06.581054+0000","last_fullsized":"2024-05-08T18:33:06.581054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:21.913096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.265892+0000","last_change":"2024-05-08T18:30:58.287850+0000","last_active":"2024-05-08T18:34:07.265892+0000","last_peered":"2024-05-08T18:34:07.265892+0000","last_clean":"2024-05-08T18:34:07.265892+0000","last_became_active":"2024-05-08T18:30:58.286930+0000","last_became_peered":"2024-05-08T18:30:58.286930+0000","last_unstale":"2024-05-08T18:34:07.265892+0000","last_undegraded":"2024-05-08T18:34:07.265892+0000","last_fullsized":"2024-05-08T18:34:07.265892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:33.986082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.964490+0000","last_change":"2024-05-08T18:31:00.283948+0000","last_active":"2024-05-08T18:34:06.964490+0000","last_peered":"2024-05-08T18:34:06.964490+0000","last_clean":"2024-05-08T18:34:06.964490+0000","last_became_active":"2024-05-08T18:31:00.282958+0000","last_became_peered":"2024-05-08T18:31:00.282958+0000","last_unstale":"2024-05-08T18:34:06.964490+0000","last_undegraded":"2024-05-08T18:34:06.964490+0000","last_fullsized":"2024-05-08T18:34:06.964490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:41.064447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328195+0000","last_change":"2024-05-08T18:30:58.305701+0000","last_active":"2024-05-08T18:31:45.328195+0000","last_peered":"2024-05-08T18:31:45.328195+0000","last_clean":"2024-05-08T18:31:45.328195+0000","last_became_active":"2024-05-08T18:30:58.302051+0000","last_became_peered":"2024-05-08T18:30:58.302051+0000","last_unstale":"2024-05-08T18:31:45.328195+0000","last_undegraded":"2024-05-08T18:31:45.328195+0000","last_fullsized":"2024-05-08T18:31:45.328195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:52.764644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332860+0000","last_change":"2024-05-08T18:31:00.299248+0000","last_active":"2024-05-08T18:31:45.332860+0000","last_peered":"2024-05-08T18:31:45.332860+0000","last_clean":"2024-05-08T18:31:45.332860+0000","last_became_active":"2024-05-08T18:31:00.297787+0000","last_became_peered":"2024-05-08T18:31:00.297787+0000","last_unstale":"2024-05-08T18:31:45.332860+0000","last_undegraded":"2024-05-08T18:31:45.332860+0000","last_fullsized":"2024-05-08T18:31:45.332860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:40.412419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.190202+0000","last_change":"2024-05-08T18:30:58.285595+0000","last_active":"2024-05-08T18:34:07.190202+0000","last_peered":"2024-05-08T18:34:07.190202+0000","last_clean":"2024-05-08T18:34:07.190202+0000","last_became_active":"2024-05-08T18:30:58.284146+0000","last_became_peered":"2024-05-08T18:30:58.284146+0000","last_unstale":"2024-05-08T18:34:07.190202+0000","last_undegraded":"2024-05-08T18:34:07.190202+0000","last_fullsized":"2024-05-08T18:34:07.190202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:25.031288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'12","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.242555+0000","last_change":"2024-05-08T18:31:00.291767+0000","last_active":"2024-05-08T18:34:07.242555+0000","last_peered":"2024-05-08T18:34:07.242555+0000","last_clean":"2024-05-08T18:34:07.242555+0000","last_became_active":"2024-05-08T18:31:00.291399+0000","last_became_peered":"2024-05-08T18:31:00.291399+0000","last_unstale":"2024-05-08T18:34:07.242555+0000","last_undegraded":"2024-05-08T18:34:07.242555+0000","last_fullsized":"2024-05-08T18:34:07.242555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:29.461384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.177075+0000","last_change":"2024-05-08T18:30:58.305891+0000","last_active":"2024-05-08T18:34:07.177075+0000","last_peered":"2024-05-08T18:34:07.177075+0000","last_clean":"2024-05-08T18:34:07.177075+0000","last_became_active":"2024-05-08T18:30:58.305523+0000","last_became_peered":"2024-05-08T18:30:58.305523+0000","last_unstale":"2024-05-08T18:34:07.177075+0000","last_undegraded":"2024-05-08T18:34:07.177075+0000","last_fullsized":"2024-05-08T18:34:07.177075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:38.049573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'14","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196828+0000","last_change":"2024-05-08T18:31:00.281500+0000","last_active":"2024-05-08T18:34:07.196828+0000","last_peered":"2024-05-08T18:34:07.196828+0000","last_clean":"2024-05-08T18:34:07.196828+0000","last_became_active":"2024-05-08T18:31:00.281199+0000","last_became_peered":"2024-05-08T18:31:00.281199+0000","last_unstale":"2024-05-08T18:34:07.196828+0000","last_undegraded":"2024-05-08T18:34:07.196828+0000","last_fullsized":"2024-05-08T18:34:07.196828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:40:39.970400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333475+0000","last_change":"2024-05-08T18:30:58.302582+0000","last_active":"2024-05-08T18:31:45.333475+0000","last_peered":"2024-05-08T18:31:45.333475+0000","last_clean":"2024-05-08T18:31:45.333475+0000","last_became_active":"2024-05-08T18:30:58.302218+0000","last_became_peered":"2024-05-08T18:30:58.302218+0000","last_unstale":"2024-05-08T18:31:45.333475+0000","last_undegraded":"2024-05-08T18:31:45.333475+0000","last_fullsized":"2024-05-08T18:31:45.333475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:25.031288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.057640+0000","last_change":"2024-05-08T18:31:00.294447+0000","last_active":"2024-05-08T18:34:07.057640+0000","last_peered":"2024-05-08T18:34:07.057640+0000","last_clean":"2024-05-08T18:34:07.057640+0000","last_became_active":"2024-05-08T18:31:00.294146+0000","last_became_peered":"2024-05-08T18:31:00.294146+0000","last_unstale":"2024-05-08T18:34:07.057640+0000","last_undegraded":"2024-05-08T18:34:07.057640+0000","last_fullsized":"2024-05-08T18:34:07.057640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:01.629372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329386+0000","last_change":"2024-05-08T18:30:58.317135+0000","last_active":"2024-05-08T18:31:45.329386+0000","last_peered":"2024-05-08T18:31:45.329386+0000","last_clean":"2024-05-08T18:31:45.329386+0000","last_became_active":"2024-05-08T18:30:58.314388+0000","last_became_peered":"2024-05-08T18:30:58.314388+0000","last_unstale":"2024-05-08T18:31:45.329386+0000","last_undegraded":"2024-05-08T18:31:45.329386+0000","last_fullsized":"2024-05-08T18:31:45.329386+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:19:16.450109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.239867+0000","last_change":"2024-05-08T18:31:00.283542+0000","last_active":"2024-05-08T18:34:07.239867+0000","last_peered":"2024-05-08T18:34:07.239867+0000","last_clean":"2024-05-08T18:34:07.239867+0000","last_became_active":"2024-05-08T18:31:00.281847+0000","last_became_peered":"2024-05-08T18:31:00.281847+0000","last_unstale":"2024-05-08T18:34:07.239867+0000","last_undegraded":"2024-05-08T18:34:07.239867+0000","last_fullsized":"2024-05-08T18:34:07.239867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:57.459641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330545+0000","last_change":"2024-05-08T18:30:58.309703+0000","last_active":"2024-05-08T18:31:45.330545+0000","last_peered":"2024-05-08T18:31:45.330545+0000","last_clean":"2024-05-08T18:31:45.330545+0000","last_became_active":"2024-05-08T18:30:58.309203+0000","last_became_peered":"2024-05-08T18:30:58.309203+0000","last_unstale":"2024-05-08T18:31:45.330545+0000","last_undegraded":"2024-05-08T18:31:45.330545+0000","last_fullsized":"2024-05-08T18:31:45.330545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:16.366334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'16","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.197060+0000","last_change":"2024-05-08T18:31:00.296525+0000","last_active":"2024-05-08T18:34:07.197060+0000","last_peered":"2024-05-08T18:34:07.197060+0000","last_clean":"2024-05-08T18:34:07.197060+0000","last_became_active":"2024-05-08T18:31:00.296240+0000","last_became_peered":"2024-05-08T18:31:00.296240+0000","last_unstale":"2024-05-08T18:34:07.197060+0000","last_undegraded":"2024-05-08T18:34:07.197060+0000","last_fullsized":"2024-05-08T18:34:07.197060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:42.486383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337097+0000","last_change":"2024-05-08T18:30:58.306151+0000","last_active":"2024-05-08T18:31:45.337097+0000","last_peered":"2024-05-08T18:31:45.337097+0000","last_clean":"2024-05-08T18:31:45.337097+0000","last_became_active":"2024-05-08T18:30:58.305572+0000","last_became_peered":"2024-05-08T18:30:58.305572+0000","last_unstale":"2024-05-08T18:31:45.337097+0000","last_undegraded":"2024-05-08T18:31:45.337097+0000","last_fullsized":"2024-05-08T18:31:45.337097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:56.618771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.240162+0000","last_change":"2024-05-08T18:31:00.283388+0000","last_active":"2024-05-08T18:34:07.240162+0000","last_peered":"2024-05-08T18:34:07.240162+0000","last_clean":"2024-05-08T18:34:07.240162+0000","last_became_active":"2024-05-08T18:31:00.282414+0000","last_became_peered":"2024-05-08T18:31:00.282414+0000","last_unstale":"2024-05-08T18:34:07.240162+0000","last_undegraded":"2024-05-08T18:34:07.240162+0000","last_fullsized":"2024-05-08T18:34:07.240162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:56.345475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.179636+0000","last_change":"2024-05-08T18:30:58.308682+0000","last_active":"2024-05-08T18:33:18.179636+0000","last_peered":"2024-05-08T18:33:18.179636+0000","last_clean":"2024-05-08T18:33:18.179636+0000","last_became_active":"2024-05-08T18:30:58.304591+0000","last_became_peered":"2024-05-08T18:30:58.304591+0000","last_unstale":"2024-05-08T18:33:18.179636+0000","last_undegraded":"2024-05-08T18:33:18.179636+0000","last_fullsized":"2024-05-08T18:33:18.179636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:40.162258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.180377+0000","last_change":"2024-05-08T18:30:58.304754+0000","last_active":"2024-05-08T18:34:07.180377+0000","last_peered":"2024-05-08T18:34:07.180377+0000","last_clean":"2024-05-08T18:34:07.180377+0000","last_became_active":"2024-05-08T18:30:58.303443+0000","last_became_peered":"2024-05-08T18:30:58.303443+0000","last_unstale":"2024-05-08T18:34:07.180377+0000","last_undegraded":"2024-05-08T18:34:07.180377+0000","last_fullsized":"2024-05-08T18:34:07.180377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:56.525015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'11","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.248139+0000","last_change":"2024-05-08T18:31:00.288619+0000","last_active":"2024-05-08T18:34:07.248139+0000","last_peered":"2024-05-08T18:34:07.248139+0000","last_clean":"2024-05-08T18:34:07.248139+0000","last_became_active":"2024-05-08T18:31:00.288250+0000","last_became_peered":"2024-05-08T18:31:00.288250+0000","last_unstale":"2024-05-08T18:34:07.248139+0000","last_undegraded":"2024-05-08T18:34:07.248139+0000","last_fullsized":"2024-05-08T18:34:07.248139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:58.735465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329134+0000","last_change":"2024-05-08T18:30:58.285795+0000","last_active":"2024-05-08T18:31:45.329134+0000","last_peered":"2024-05-08T18:31:45.329134+0000","last_clean":"2024-05-08T18:31:45.329134+0000","last_became_active":"2024-05-08T18:30:58.284090+0000","last_became_peered":"2024-05-08T18:30:58.284090+0000","last_unstale":"2024-05-08T18:31:45.329134+0000","last_undegraded":"2024-05-08T18:31:45.329134+0000","last_fullsized":"2024-05-08T18:31:45.329134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:56.618771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337379+0000","last_change":"2024-05-08T18:31:00.291942+0000","last_active":"2024-05-08T18:31:45.337379+0000","last_peered":"2024-05-08T18:31:45.337379+0000","last_clean":"2024-05-08T18:31:45.337379+0000","last_became_active":"2024-05-08T18:31:00.291650+0000","last_became_peered":"2024-05-08T18:31:00.291650+0000","last_unstale":"2024-05-08T18:31:45.337379+0000","last_undegraded":"2024-05-08T18:31:45.337379+0000","last_fullsized":"2024-05-08T18:31:45.337379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:49:50.681202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705708,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44172,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327668,"statfs":{"total":96636764160,"available":96591532032,"internally_reserved":0,"allocated":9048064,"data_stored":8743598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44688,"kb_used_data":9352,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327152,"statfs":{"total":96636764160,"available":96591003648,"internally_reserved":0,"allocated":9576448,"data_stored":9329841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44708,"kb_used_data":9372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327132,"statfs":{"total":96636764160,"available":96590983168,"internally_reserved":0,"allocated":9596928,"data_stored":9330329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705707,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":8808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":9019392,"data_stored":8742450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:34:14.357 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:34:14.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.486+0000 7fce68f25640 1 Processor -- start 2024-05-08T18:34:14.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.486+0000 7fce68f25640 1 -- start start 2024-05-08T18:34:14.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.486+0000 7fce68f25640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fce6412d1b0 0x7fce6412d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:14.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.486+0000 7fce68f25640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce6412d590 con 0x7fce6412dda0 2024-05-08T18:34:14.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.486+0000 7fce68f25640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fce64114de0 con 0x7fce6412d1b0 2024-05-08T18:34:14.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.487+0000 7fce6259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fce6412d1b0 0x7fce6412d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:14.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.487+0000 7fce61d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fce6412dda0 0x7fce64129c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40934/0 (socket says 172.21.15.53:40934) 2024-05-08T18:34:14.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.487+0000 7fce61d9b640 1 -- 172.21.15.53:0/88970561 learned_addr learned my addr 172.21.15.53:0/88970561 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:34:14.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.487+0000 7fce6259c640 1 -- 172.21.15.53:0/88970561 >> v1:172.21.15.53:6789/0 conn(0x7fce6412dda0 legacy=0x7fce64129c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:14.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.487+0000 7fce6259c640 1 -- 172.21.15.53:0/88970561 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce64113c30 con 0x7fce6412d1b0 2024-05-08T18:34:14.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.487+0000 7fce6159a640 1 -- 172.21.15.53:0/88970561 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 594281102 0 0) 0x7fce6412d590 con 0x7fce6412dda0 2024-05-08T18:34:14.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.488+0000 7fce6259c640 1 --2- 172.21.15.53:0/88970561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce6412d1b0 0x7fce6412d860 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fce54009720 tx=0x7fce5402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef514da3c83f2506 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:14.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.488+0000 7fce6159a640 1 -- 172.21.15.53:0/88970561 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce540316d0 con 0x7fce6412d1b0 2024-05-08T18:34:14.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.488+0000 7fce6159a640 1 -- 172.21.15.53:0/88970561 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce54037070 con 0x7fce6412d1b0 2024-05-08T18:34:14.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.488+0000 7fce6159a640 1 -- 172.21.15.53:0/88970561 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce540319c0 con 0x7fce6412d1b0 2024-05-08T18:34:14.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.488+0000 7fce68f25640 1 -- 172.21.15.53:0/88970561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce6412d1b0 msgr2=0x7fce6412d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:14.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.488+0000 7fce68f25640 1 --2- 172.21.15.53:0/88970561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce6412d1b0 0x7fce6412d860 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fce54009720 tx=0x7fce5402b840 comp rx=0 tx=0).stop 2024-05-08T18:34:14.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.489+0000 7fce68f25640 1 -- 172.21.15.53:0/88970561 shutdown_connections 2024-05-08T18:34:14.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.489+0000 7fce68f25640 1 --2- 172.21.15.53:0/88970561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce6412d1b0 0x7fce6412d860 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:14.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.489+0000 7fce68f25640 1 -- 172.21.15.53:0/88970561 >> 172.21.15.53:0/88970561 conn(0x7fce6409a910 msgr2=0x7fce6406e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:14.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.489+0000 7fce68f25640 1 -- 172.21.15.53:0/88970561 shutdown_connections 2024-05-08T18:34:14.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.489+0000 7fce68f25640 1 -- 172.21.15.53:0/88970561 wait complete. 2024-05-08T18:34:14.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.490+0000 7fce68f25640 1 Processor -- start 2024-05-08T18:34:14.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.490+0000 7fce68f25640 1 -- start start 2024-05-08T18:34:14.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.490+0000 7fce68f25640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce6412d1b0 0x7fce641c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:14.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.490+0000 7fce68f25640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fce6412a6d0 con 0x7fce6412d1b0 2024-05-08T18:34:14.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.490+0000 7fce6259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce6412d1b0 0x7fce641c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:14.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.490+0000 7fce6259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce6412d1b0 0x7fce641c4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41102/0 (socket says 172.21.15.53:41102) 2024-05-08T18:34:14.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.490+0000 7fce6259c640 1 -- 172.21.15.53:0/992596258 learned_addr learned my addr 172.21.15.53:0/992596258 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:34:14.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.490+0000 7fce6259c640 1 -- 172.21.15.53:0/992596258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce64073370 con 0x7fce6412d1b0 2024-05-08T18:34:14.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.490+0000 7fce6259c640 1 --2- 172.21.15.53:0/992596258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce6412d1b0 0x7fce641c4270 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fce5402b880 tx=0x7fce540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:14.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.491+0000 7fce52ffd640 1 -- 172.21.15.53:0/992596258 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce54004030 con 0x7fce6412d1b0 2024-05-08T18:34:14.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.491+0000 7fce52ffd640 1 -- 172.21.15.53:0/992596258 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce540041d0 con 0x7fce6412d1b0 2024-05-08T18:34:14.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.491+0000 7fce68f25640 1 -- 172.21.15.53:0/992596258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6411c760 con 0x7fce6412d1b0 2024-05-08T18:34:14.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.491+0000 7fce52ffd640 1 -- 172.21.15.53:0/992596258 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce54032640 con 0x7fce6412d1b0 2024-05-08T18:34:14.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.491+0000 7fce68f25640 1 -- 172.21.15.53:0/992596258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce641c4990 con 0x7fce6412d1b0 2024-05-08T18:34:14.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.491+0000 7fce52ffd640 1 -- 172.21.15.53:0/992596258 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fce540327e0 con 0x7fce6412d1b0 2024-05-08T18:34:14.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.492+0000 7fce52ffd640 1 --2- 172.21.15.53:0/992596258 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fce4403d2b0 0x7fce4403f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:14.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.492+0000 7fce52ffd640 1 -- 172.21.15.53:0/992596258 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fce5402f050 con 0x7fce6412d1b0 2024-05-08T18:34:14.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.492+0000 7fce68f25640 1 -- 172.21.15.53:0/992596258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce64064010 con 0x7fce6412d1b0 2024-05-08T18:34:14.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.492+0000 7fce61d9b640 1 --2- 172.21.15.53:0/992596258 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fce4403d2b0 0x7fce4403f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:14.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.492+0000 7fce61d9b640 1 --2- 172.21.15.53:0/992596258 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fce4403d2b0 0x7fce4403f770 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fce58000c00 tx=0x7fce58007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:14.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.497+0000 7fce52ffd640 1 -- 172.21.15.53:0/992596258 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fce54041070 con 0x7fce6412d1b0 2024-05-08T18:34:14.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.686+0000 7fce68f25640 1 -- 172.21.15.53:0/992596258 --> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce64129e50 con 0x7fce4403d2b0 2024-05-08T18:34:14.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.701+0000 7fce52ffd640 1 -- 172.21.15.53:0/992596258 <== mgr.4102 v2:172.21.15.87:6824/211215191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665928 (secure 0 0 0) 0x7fce64129e50 con 0x7fce4403d2b0 2024-05-08T18:34:14.708 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:34:14.714 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:34:14.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.705+0000 7fce68f25640 1 -- 172.21.15.53:0/992596258 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fce4403d2b0 msgr2=0x7fce4403f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:14.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.705+0000 7fce68f25640 1 --2- 172.21.15.53:0/992596258 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fce4403d2b0 0x7fce4403f770 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fce58000c00 tx=0x7fce58007970 comp rx=0 tx=0).stop 2024-05-08T18:34:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.705+0000 7fce68f25640 1 -- 172.21.15.53:0/992596258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce6412d1b0 msgr2=0x7fce641c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.705+0000 7fce68f25640 1 --2- 172.21.15.53:0/992596258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce6412d1b0 0x7fce641c4270 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fce5402b880 tx=0x7fce540046c0 comp rx=0 tx=0).stop 2024-05-08T18:34:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.705+0000 7fce68f25640 1 -- 172.21.15.53:0/992596258 shutdown_connections 2024-05-08T18:34:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.705+0000 7fce68f25640 1 --2- 172.21.15.53:0/992596258 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fce4403d2b0 0x7fce4403f770 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.705+0000 7fce68f25640 1 --2- 172.21.15.53:0/992596258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce6412d1b0 0x7fce641c4270 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.705+0000 7fce68f25640 1 -- 172.21.15.53:0/992596258 >> 172.21.15.53:0/992596258 conn(0x7fce6409a910 msgr2=0x7fce640707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.705+0000 7fce68f25640 1 -- 172.21.15.53:0/992596258 shutdown_connections 2024-05-08T18:34:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.705+0000 7fce68f25640 1 -- 172.21.15.53:0/992596258 wait complete. 2024-05-08T18:34:14.717 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-05-08T18:34:14.164174+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416885,"num_objects":227,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4839,"num_read_kb":4421,"num_write":2046,"num_write_kb":60584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4431,"ondisk_log_size":4431,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":173552,"kb_used_data":36368,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377313808,"statfs":{"total":386547056640,"available":386369339392,"internally_reserved":0,"allocated":37240832,"data_stored":36146218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815783,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003684"},"pg_stats":[{"pgid":"3.3f","version":"29'3","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176450+0000","last_change":"2024-05-08T18:30:58.305519+0000","last_active":"2024-05-08T18:33:03.176450+0000","last_peered":"2024-05-08T18:33:03.176450+0000","last_clean":"2024-05-08T18:33:03.176450+0000","last_became_active":"2024-05-08T18:30:58.305175+0000","last_became_peered":"2024-05-08T18:30:58.305175+0000","last_unstale":"2024-05-08T18:33:03.176450+0000","last_undegraded":"2024-05-08T18:33:03.176450+0000","last_fullsized":"2024-05-08T18:33:03.176450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:04.148371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271698+0000","last_change":"2024-05-08T18:31:00.285719+0000","last_active":"2024-05-08T18:34:07.271698+0000","last_peered":"2024-05-08T18:34:07.271698+0000","last_clean":"2024-05-08T18:34:07.271698+0000","last_became_active":"2024-05-08T18:31:00.284574+0000","last_became_peered":"2024-05-08T18:31:00.284574+0000","last_unstale":"2024-05-08T18:34:07.271698+0000","last_undegraded":"2024-05-08T18:34:07.271698+0000","last_fullsized":"2024-05-08T18:34:07.271698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:40.256644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331029+0000","last_change":"2024-05-08T18:30:58.289175+0000","last_active":"2024-05-08T18:31:45.331029+0000","last_peered":"2024-05-08T18:31:45.331029+0000","last_clean":"2024-05-08T18:31:45.331029+0000","last_became_active":"2024-05-08T18:30:58.288674+0000","last_became_peered":"2024-05-08T18:30:58.288674+0000","last_unstale":"2024-05-08T18:31:45.331029+0000","last_undegraded":"2024-05-08T18:31:45.331029+0000","last_fullsized":"2024-05-08T18:31:45.331029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:34.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329085+0000","last_change":"2024-05-08T18:31:00.299098+0000","last_active":"2024-05-08T18:31:45.329085+0000","last_peered":"2024-05-08T18:31:45.329085+0000","last_clean":"2024-05-08T18:31:45.329085+0000","last_became_active":"2024-05-08T18:31:00.298145+0000","last_became_peered":"2024-05-08T18:31:00.298145+0000","last_unstale":"2024-05-08T18:31:45.329085+0000","last_undegraded":"2024-05-08T18:31:45.329085+0000","last_fullsized":"2024-05-08T18:31:45.329085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:38.415030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331384+0000","last_change":"2024-05-08T18:30:58.306369+0000","last_active":"2024-05-08T18:31:45.331384+0000","last_peered":"2024-05-08T18:31:45.331384+0000","last_clean":"2024-05-08T18:31:45.331384+0000","last_became_active":"2024-05-08T18:30:58.304442+0000","last_became_peered":"2024-05-08T18:30:58.304442+0000","last_unstale":"2024-05-08T18:31:45.331384+0000","last_undegraded":"2024-05-08T18:31:45.331384+0000","last_fullsized":"2024-05-08T18:31:45.331384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:28.002025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328805+0000","last_change":"2024-05-08T18:31:00.298725+0000","last_active":"2024-05-08T18:31:45.328805+0000","last_peered":"2024-05-08T18:31:45.328805+0000","last_clean":"2024-05-08T18:31:45.328805+0000","last_became_active":"2024-05-08T18:31:00.297810+0000","last_became_peered":"2024-05-08T18:31:00.297810+0000","last_unstale":"2024-05-08T18:31:45.328805+0000","last_undegraded":"2024-05-08T18:31:45.328805+0000","last_fullsized":"2024-05-08T18:31:45.328805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:59.418481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330833+0000","last_change":"2024-05-08T18:30:58.295957+0000","last_active":"2024-05-08T18:31:45.330833+0000","last_peered":"2024-05-08T18:31:45.330833+0000","last_clean":"2024-05-08T18:31:45.330833+0000","last_became_active":"2024-05-08T18:30:58.295569+0000","last_became_peered":"2024-05-08T18:30:58.295569+0000","last_unstale":"2024-05-08T18:31:45.330833+0000","last_undegraded":"2024-05-08T18:31:45.330833+0000","last_fullsized":"2024-05-08T18:31:45.330833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:23:31.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271931+0000","last_change":"2024-05-08T18:31:00.296029+0000","last_active":"2024-05-08T18:34:07.271931+0000","last_peered":"2024-05-08T18:34:07.271931+0000","last_clean":"2024-05-08T18:34:07.271931+0000","last_became_active":"2024-05-08T18:31:00.295611+0000","last_became_peered":"2024-05-08T18:31:00.295611+0000","last_unstale":"2024-05-08T18:34:07.271931+0000","last_undegraded":"2024-05-08T18:34:07.271931+0000","last_fullsized":"2024-05-08T18:34:07.271931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:48.739053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328670+0000","last_change":"2024-05-08T18:30:58.313349+0000","last_active":"2024-05-08T18:31:45.328670+0000","last_peered":"2024-05-08T18:31:45.328670+0000","last_clean":"2024-05-08T18:31:45.328670+0000","last_became_active":"2024-05-08T18:30:58.313003+0000","last_became_peered":"2024-05-08T18:30:58.313003+0000","last_unstale":"2024-05-08T18:31:45.328670+0000","last_undegraded":"2024-05-08T18:31:45.328670+0000","last_fullsized":"2024-05-08T18:31:45.328670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:28.678138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'4","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.338700+0000","last_change":"2024-05-08T18:31:00.281345+0000","last_active":"2024-05-08T18:31:45.338700+0000","last_peered":"2024-05-08T18:31:45.338700+0000","last_clean":"2024-05-08T18:31:45.338700+0000","last_became_active":"2024-05-08T18:31:00.281065+0000","last_became_peered":"2024-05-08T18:31:00.281065+0000","last_unstale":"2024-05-08T18:31:45.338700+0000","last_undegraded":"2024-05-08T18:31:45.338700+0000","last_fullsized":"2024-05-08T18:31:45.338700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:58.735465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.335229+0000","last_change":"2024-05-08T18:30:58.308072+0000","last_active":"2024-05-08T18:31:45.335229+0000","last_peered":"2024-05-08T18:31:45.335229+0000","last_clean":"2024-05-08T18:31:45.335229+0000","last_became_active":"2024-05-08T18:30:58.307687+0000","last_became_peered":"2024-05-08T18:30:58.307687+0000","last_unstale":"2024-05-08T18:31:45.335229+0000","last_undegraded":"2024-05-08T18:31:45.335229+0000","last_fullsized":"2024-05-08T18:31:45.335229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:33.986082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.966056+0000","last_change":"2024-05-08T18:31:00.299642+0000","last_active":"2024-05-08T18:34:06.966056+0000","last_peered":"2024-05-08T18:34:06.966056+0000","last_clean":"2024-05-08T18:34:06.966056+0000","last_became_active":"2024-05-08T18:31:00.298978+0000","last_became_peered":"2024-05-08T18:31:00.298978+0000","last_unstale":"2024-05-08T18:34:06.966056+0000","last_undegraded":"2024-05-08T18:34:06.966056+0000","last_fullsized":"2024-05-08T18:34:06.966056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:30.577543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328768+0000","last_change":"2024-05-08T18:30:58.309859+0000","last_active":"2024-05-08T18:31:45.328768+0000","last_peered":"2024-05-08T18:31:45.328768+0000","last_clean":"2024-05-08T18:31:45.328768+0000","last_became_active":"2024-05-08T18:30:58.308931+0000","last_became_peered":"2024-05-08T18:30:58.308931+0000","last_unstale":"2024-05-08T18:31:45.328768+0000","last_undegraded":"2024-05-08T18:31:45.328768+0000","last_fullsized":"2024-05-08T18:31:45.328768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:40:28.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'7","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.333875+0000","last_change":"2024-05-08T18:31:00.295747+0000","last_active":"2024-05-08T18:34:07.333875+0000","last_peered":"2024-05-08T18:34:07.333875+0000","last_clean":"2024-05-08T18:34:07.333875+0000","last_became_active":"2024-05-08T18:31:00.295472+0000","last_became_peered":"2024-05-08T18:31:00.295472+0000","last_unstale":"2024-05-08T18:34:07.333875+0000","last_undegraded":"2024-05-08T18:34:07.333875+0000","last_fullsized":"2024-05-08T18:34:07.333875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:40.256644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329487+0000","last_change":"2024-05-08T18:30:58.295024+0000","last_active":"2024-05-08T18:31:45.329487+0000","last_peered":"2024-05-08T18:31:45.329487+0000","last_clean":"2024-05-08T18:31:45.329487+0000","last_became_active":"2024-05-08T18:30:58.294511+0000","last_became_peered":"2024-05-08T18:30:58.294511+0000","last_unstale":"2024-05-08T18:31:45.329487+0000","last_undegraded":"2024-05-08T18:31:45.329487+0000","last_fullsized":"2024-05-08T18:31:45.329487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:33.046479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.581305+0000","last_change":"2024-05-08T18:31:00.291471+0000","last_active":"2024-05-08T18:33:06.581305+0000","last_peered":"2024-05-08T18:33:06.581305+0000","last_clean":"2024-05-08T18:33:06.581305+0000","last_became_active":"2024-05-08T18:31:00.291203+0000","last_became_peered":"2024-05-08T18:31:00.291203+0000","last_unstale":"2024-05-08T18:33:06.581305+0000","last_undegraded":"2024-05-08T18:33:06.581305+0000","last_fullsized":"2024-05-08T18:33:06.581305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:21.913096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196716+0000","last_change":"2024-05-08T18:31:00.291351+0000","last_active":"2024-05-08T18:34:07.196716+0000","last_peered":"2024-05-08T18:34:07.196716+0000","last_clean":"2024-05-08T18:34:07.196716+0000","last_became_active":"2024-05-08T18:31:00.290806+0000","last_became_peered":"2024-05-08T18:31:00.290806+0000","last_unstale":"2024-05-08T18:34:07.196716+0000","last_undegraded":"2024-05-08T18:34:07.196716+0000","last_fullsized":"2024-05-08T18:34:07.196716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:21:46.897549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.919314+0000","last_change":"2024-05-08T18:30:58.305311+0000","last_active":"2024-05-08T18:34:06.919314+0000","last_peered":"2024-05-08T18:34:06.919314+0000","last_clean":"2024-05-08T18:34:06.919314+0000","last_became_active":"2024-05-08T18:30:58.304685+0000","last_became_peered":"2024-05-08T18:30:58.304685+0000","last_unstale":"2024-05-08T18:34:06.919314+0000","last_undegraded":"2024-05-08T18:34:06.919314+0000","last_fullsized":"2024-05-08T18:34:06.919314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:11.650120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'14","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.335357+0000","last_change":"2024-05-08T18:31:00.283453+0000","last_active":"2024-05-08T18:31:45.335357+0000","last_peered":"2024-05-08T18:31:45.335357+0000","last_clean":"2024-05-08T18:31:45.335357+0000","last_became_active":"2024-05-08T18:31:00.281816+0000","last_became_peered":"2024-05-08T18:31:00.281816+0000","last_unstale":"2024-05-08T18:31:45.335357+0000","last_undegraded":"2024-05-08T18:31:45.335357+0000","last_fullsized":"2024-05-08T18:31:45.335357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:29.461384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337199+0000","last_change":"2024-05-08T18:30:58.307205+0000","last_active":"2024-05-08T18:31:45.337199+0000","last_peered":"2024-05-08T18:31:45.337199+0000","last_clean":"2024-05-08T18:31:45.337199+0000","last_became_active":"2024-05-08T18:30:58.306545+0000","last_became_peered":"2024-05-08T18:30:58.306545+0000","last_unstale":"2024-05-08T18:31:45.337199+0000","last_undegraded":"2024-05-08T18:31:45.337199+0000","last_fullsized":"2024-05-08T18:31:45.337199+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:33.046479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.272025+0000","last_change":"2024-05-08T18:31:00.283417+0000","last_active":"2024-05-08T18:34:07.272025+0000","last_peered":"2024-05-08T18:34:07.272025+0000","last_clean":"2024-05-08T18:34:07.272025+0000","last_became_active":"2024-05-08T18:31:00.283048+0000","last_became_peered":"2024-05-08T18:31:00.283048+0000","last_unstale":"2024-05-08T18:34:07.272025+0000","last_undegraded":"2024-05-08T18:34:07.272025+0000","last_fullsized":"2024-05-08T18:34:07.272025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:16:11.480889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337235+0000","last_change":"2024-05-08T18:30:58.302648+0000","last_active":"2024-05-08T18:31:45.337235+0000","last_peered":"2024-05-08T18:31:45.337235+0000","last_clean":"2024-05-08T18:31:45.337235+0000","last_became_active":"2024-05-08T18:30:58.302245+0000","last_became_peered":"2024-05-08T18:30:58.302245+0000","last_unstale":"2024-05-08T18:31:45.337235+0000","last_undegraded":"2024-05-08T18:31:45.337235+0000","last_fullsized":"2024-05-08T18:31:45.337235+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:18.354135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'10","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196741+0000","last_change":"2024-05-08T18:31:45.338509+0000","last_active":"2024-05-08T18:34:07.196741+0000","last_peered":"2024-05-08T18:34:07.196741+0000","last_clean":"2024-05-08T18:34:07.196741+0000","last_became_active":"2024-05-08T18:31:45.338192+0000","last_became_peered":"2024-05-08T18:31:45.338192+0000","last_unstale":"2024-05-08T18:34:07.196741+0000","last_undegraded":"2024-05-08T18:34:07.196741+0000","last_fullsized":"2024-05-08T18:34:07.196741+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:50.426519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.559767+0000","last_change":"2024-05-08T18:30:58.306070+0000","last_active":"2024-05-08T18:33:06.559767+0000","last_peered":"2024-05-08T18:33:06.559767+0000","last_clean":"2024-05-08T18:33:06.559767+0000","last_became_active":"2024-05-08T18:30:58.304222+0000","last_became_peered":"2024-05-08T18:30:58.304222+0000","last_unstale":"2024-05-08T18:33:06.559767+0000","last_undegraded":"2024-05-08T18:33:06.559767+0000","last_fullsized":"2024-05-08T18:33:06.559767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:33:08.890455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"27'6","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331878+0000","last_change":"2024-05-08T18:31:00.296365+0000","last_active":"2024-05-08T18:31:45.331878+0000","last_peered":"2024-05-08T18:31:45.331878+0000","last_clean":"2024-05-08T18:31:45.331878+0000","last_became_active":"2024-05-08T18:31:00.295990+0000","last_became_peered":"2024-05-08T18:31:00.295990+0000","last_unstale":"2024-05-08T18:31:45.331878+0000","last_undegraded":"2024-05-08T18:31:45.331878+0000","last_fullsized":"2024-05-08T18:31:45.331878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:22:54.136553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330650+0000","last_change":"2024-05-08T18:30:58.285289+0000","last_active":"2024-05-08T18:31:45.330650+0000","last_peered":"2024-05-08T18:31:45.330650+0000","last_clean":"2024-05-08T18:31:45.330650+0000","last_became_active":"2024-05-08T18:30:58.283821+0000","last_became_peered":"2024-05-08T18:30:58.283821+0000","last_unstale":"2024-05-08T18:31:45.330650+0000","last_undegraded":"2024-05-08T18:31:45.330650+0000","last_fullsized":"2024-05-08T18:31:45.330650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:26.528845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'12","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196862+0000","last_change":"2024-05-08T18:31:00.282011+0000","last_active":"2024-05-08T18:34:07.196862+0000","last_peered":"2024-05-08T18:34:07.196862+0000","last_clean":"2024-05-08T18:34:07.196862+0000","last_became_active":"2024-05-08T18:31:00.280827+0000","last_became_peered":"2024-05-08T18:31:00.280827+0000","last_unstale":"2024-05-08T18:34:07.196862+0000","last_undegraded":"2024-05-08T18:34:07.196862+0000","last_fullsized":"2024-05-08T18:34:07.196862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:43.107566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328805+0000","last_change":"2024-05-08T18:30:58.306076+0000","last_active":"2024-05-08T18:31:45.328805+0000","last_peered":"2024-05-08T18:31:45.328805+0000","last_clean":"2024-05-08T18:31:45.328805+0000","last_became_active":"2024-05-08T18:30:58.305571+0000","last_became_peered":"2024-05-08T18:30:58.305571+0000","last_unstale":"2024-05-08T18:31:45.328805+0000","last_undegraded":"2024-05-08T18:31:45.328805+0000","last_fullsized":"2024-05-08T18:31:45.328805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:50.476345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.219476+0000","last_change":"2024-05-08T18:31:08.318466+0000","last_active":"2024-05-08T18:34:07.219476+0000","last_peered":"2024-05-08T18:34:07.219476+0000","last_clean":"2024-05-08T18:34:07.219476+0000","last_became_active":"2024-05-08T18:31:08.318181+0000","last_became_peered":"2024-05-08T18:31:08.318181+0000","last_unstale":"2024-05-08T18:34:07.219476+0000","last_undegraded":"2024-05-08T18:34:07.219476+0000","last_fullsized":"2024-05-08T18:34:07.219476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:26.315849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'12","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.869576+0000","last_change":"2024-05-08T18:31:00.296553+0000","last_active":"2024-05-08T18:32:22.869576+0000","last_peered":"2024-05-08T18:32:22.869576+0000","last_clean":"2024-05-08T18:32:22.869576+0000","last_became_active":"2024-05-08T18:31:00.296160+0000","last_became_peered":"2024-05-08T18:31:00.296160+0000","last_unstale":"2024-05-08T18:32:22.869576+0000","last_undegraded":"2024-05-08T18:32:22.869576+0000","last_fullsized":"2024-05-08T18:32:22.869576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:33.551031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328737+0000","last_change":"2024-05-08T18:30:58.317375+0000","last_active":"2024-05-08T18:31:45.328737+0000","last_peered":"2024-05-08T18:31:45.328737+0000","last_clean":"2024-05-08T18:31:45.328737+0000","last_became_active":"2024-05-08T18:30:58.315246+0000","last_became_peered":"2024-05-08T18:30:58.315246+0000","last_unstale":"2024-05-08T18:31:45.328737+0000","last_undegraded":"2024-05-08T18:31:45.328737+0000","last_fullsized":"2024-05-08T18:31:45.328737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:27.453462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329632+0000","last_change":"2024-05-08T18:31:02.290839+0000","last_active":"2024-05-08T18:31:45.329632+0000","last_peered":"2024-05-08T18:31:45.329632+0000","last_clean":"2024-05-08T18:31:45.329632+0000","last_became_active":"2024-05-08T18:31:02.290465+0000","last_became_peered":"2024-05-08T18:31:02.290465+0000","last_unstale":"2024-05-08T18:31:45.329632+0000","last_undegraded":"2024-05-08T18:31:45.329632+0000","last_fullsized":"2024-05-08T18:31:45.329632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:57.860502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.080511+0000","last_change":"2024-05-08T18:31:04.304092+0000","last_active":"2024-05-08T18:33:05.080511+0000","last_peered":"2024-05-08T18:33:05.080511+0000","last_clean":"2024-05-08T18:33:05.080511+0000","last_became_active":"2024-05-08T18:31:04.303815+0000","last_became_peered":"2024-05-08T18:31:04.303815+0000","last_unstale":"2024-05-08T18:33:05.080511+0000","last_undegraded":"2024-05-08T18:33:05.080511+0000","last_fullsized":"2024-05-08T18:33:05.080511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:57.848922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.338770+0000","last_change":"2024-05-08T18:31:06.310842+0000","last_active":"2024-05-08T18:31:45.338770+0000","last_peered":"2024-05-08T18:31:45.338770+0000","last_clean":"2024-05-08T18:31:45.338770+0000","last_became_active":"2024-05-08T18:31:06.310555+0000","last_became_peered":"2024-05-08T18:31:06.310555+0000","last_unstale":"2024-05-08T18:31:45.338770+0000","last_undegraded":"2024-05-08T18:31:45.338770+0000","last_fullsized":"2024-05-08T18:31:45.338770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:01.875049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.691129+0000","last_change":"2024-05-08T18:31:08.319311+0000","last_active":"2024-05-08T18:32:22.691129+0000","last_peered":"2024-05-08T18:32:22.691129+0000","last_clean":"2024-05-08T18:32:22.691129+0000","last_became_active":"2024-05-08T18:31:08.319009+0000","last_became_peered":"2024-05-08T18:31:08.319009+0000","last_unstale":"2024-05-08T18:32:22.691129+0000","last_undegraded":"2024-05-08T18:32:22.691129+0000","last_fullsized":"2024-05-08T18:32:22.691129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:13.936857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330446+0000","last_change":"2024-05-08T18:31:00.298856+0000","last_active":"2024-05-08T18:31:45.330446+0000","last_peered":"2024-05-08T18:31:45.330446+0000","last_clean":"2024-05-08T18:31:45.330446+0000","last_became_active":"2024-05-08T18:31:00.297497+0000","last_became_peered":"2024-05-08T18:31:00.297497+0000","last_unstale":"2024-05-08T18:31:45.330446+0000","last_undegraded":"2024-05-08T18:31:45.330446+0000","last_fullsized":"2024-05-08T18:31:45.330446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:57.260625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334952+0000","last_change":"2024-05-08T18:30:58.300036+0000","last_active":"2024-05-08T18:31:45.334952+0000","last_peered":"2024-05-08T18:31:45.334952+0000","last_clean":"2024-05-08T18:31:45.334952+0000","last_became_active":"2024-05-08T18:30:58.299649+0000","last_became_peered":"2024-05-08T18:30:58.299649+0000","last_unstale":"2024-05-08T18:31:45.334952+0000","last_undegraded":"2024-05-08T18:31:45.334952+0000","last_fullsized":"2024-05-08T18:31:45.334952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:43.233516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"20'1","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.182063+0000","last_change":"2024-05-08T18:31:02.294330+0000","last_active":"2024-05-08T18:33:06.182063+0000","last_peered":"2024-05-08T18:33:06.182063+0000","last_clean":"2024-05-08T18:33:06.182063+0000","last_became_active":"2024-05-08T18:31:02.293993+0000","last_became_peered":"2024-05-08T18:31:02.293993+0000","last_unstale":"2024-05-08T18:33:06.182063+0000","last_undegraded":"2024-05-08T18:33:06.182063+0000","last_fullsized":"2024-05-08T18:33:06.182063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:57.170520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.181520+0000","last_change":"2024-05-08T18:31:04.300424+0000","last_active":"2024-05-08T18:33:33.181520+0000","last_peered":"2024-05-08T18:33:33.181520+0000","last_clean":"2024-05-08T18:33:33.181520+0000","last_became_active":"2024-05-08T18:31:04.300059+0000","last_became_peered":"2024-05-08T18:31:04.300059+0000","last_unstale":"2024-05-08T18:33:33.181520+0000","last_undegraded":"2024-05-08T18:33:33.181520+0000","last_fullsized":"2024-05-08T18:33:33.181520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:44.348620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336322+0000","last_change":"2024-05-08T18:31:06.312948+0000","last_active":"2024-05-08T18:31:45.336322+0000","last_peered":"2024-05-08T18:31:45.336322+0000","last_clean":"2024-05-08T18:31:45.336322+0000","last_became_active":"2024-05-08T18:31:06.312651+0000","last_became_peered":"2024-05-08T18:31:06.312651+0000","last_unstale":"2024-05-08T18:31:45.336322+0000","last_undegraded":"2024-05-08T18:31:45.336322+0000","last_fullsized":"2024-05-08T18:31:45.336322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:01.719275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328702+0000","last_change":"2024-05-08T18:31:08.311373+0000","last_active":"2024-05-08T18:31:45.328702+0000","last_peered":"2024-05-08T18:31:45.328702+0000","last_clean":"2024-05-08T18:31:45.328702+0000","last_became_active":"2024-05-08T18:31:08.311048+0000","last_became_peered":"2024-05-08T18:31:08.311048+0000","last_unstale":"2024-05-08T18:31:45.328702+0000","last_undegraded":"2024-05-08T18:31:45.328702+0000","last_fullsized":"2024-05-08T18:31:45.328702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:36.670228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.242285+0000","last_change":"2024-05-08T18:31:00.296832+0000","last_active":"2024-05-08T18:34:07.242285+0000","last_peered":"2024-05-08T18:34:07.242285+0000","last_clean":"2024-05-08T18:34:07.242285+0000","last_became_active":"2024-05-08T18:31:00.296176+0000","last_became_peered":"2024-05-08T18:31:00.296176+0000","last_unstale":"2024-05-08T18:34:07.242285+0000","last_undegraded":"2024-05-08T18:34:07.242285+0000","last_fullsized":"2024-05-08T18:34:07.242285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:56.201421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327607+0000","last_change":"2024-05-08T18:30:58.310108+0000","last_active":"2024-05-08T18:31:45.327607+0000","last_peered":"2024-05-08T18:31:45.327607+0000","last_clean":"2024-05-08T18:31:45.327607+0000","last_became_active":"2024-05-08T18:30:58.309339+0000","last_became_peered":"2024-05-08T18:30:58.309339+0000","last_unstale":"2024-05-08T18:31:45.327607+0000","last_undegraded":"2024-05-08T18:31:45.327607+0000","last_fullsized":"2024-05-08T18:31:45.327607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:38.248722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:48.166352+0000","last_change":"2024-05-08T18:31:45.335793+0000","last_active":"2024-05-08T18:31:48.166352+0000","last_peered":"2024-05-08T18:31:48.166352+0000","last_clean":"2024-05-08T18:31:48.166352+0000","last_became_active":"2024-05-08T18:31:45.335489+0000","last_became_peered":"2024-05-08T18:31:45.335489+0000","last_unstale":"2024-05-08T18:31:48.166352+0000","last_undegraded":"2024-05-08T18:31:48.166352+0000","last_fullsized":"2024-05-08T18:31:48.166352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:01.179871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.180653+0000","last_change":"2024-05-08T18:31:04.300336+0000","last_active":"2024-05-08T18:33:28.180653+0000","last_peered":"2024-05-08T18:33:28.180653+0000","last_clean":"2024-05-08T18:33:28.180653+0000","last_became_active":"2024-05-08T18:31:04.300022+0000","last_became_peered":"2024-05-08T18:31:04.300022+0000","last_unstale":"2024-05-08T18:33:28.180653+0000","last_undegraded":"2024-05-08T18:33:28.180653+0000","last_fullsized":"2024-05-08T18:33:28.180653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:42.428646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'282","reported_seq":390,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370245+0000","last_change":"2024-05-08T18:31:06.307960+0000","last_active":"2024-05-08T18:34:07.370245+0000","last_peered":"2024-05-08T18:34:07.370245+0000","last_clean":"2024-05-08T18:34:07.370245+0000","last_became_active":"2024-05-08T18:31:06.306886+0000","last_became_peered":"2024-05-08T18:31:06.306886+0000","last_unstale":"2024-05-08T18:34:07.370245+0000","last_undegraded":"2024-05-08T18:34:07.370245+0000","last_fullsized":"2024-05-08T18:34:07.370245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:48.485718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.578916+0000","last_change":"2024-05-08T18:31:08.312050+0000","last_active":"2024-05-08T18:33:06.578916+0000","last_peered":"2024-05-08T18:33:06.578916+0000","last_clean":"2024-05-08T18:33:06.578916+0000","last_became_active":"2024-05-08T18:31:08.311780+0000","last_became_peered":"2024-05-08T18:31:08.311780+0000","last_unstale":"2024-05-08T18:33:06.578916+0000","last_undegraded":"2024-05-08T18:33:06.578916+0000","last_fullsized":"2024-05-08T18:33:06.578916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:11:36.751971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332003+0000","last_change":"2024-05-08T18:31:00.281650+0000","last_active":"2024-05-08T18:31:45.332003+0000","last_peered":"2024-05-08T18:31:45.332003+0000","last_clean":"2024-05-08T18:31:45.332003+0000","last_became_active":"2024-05-08T18:31:00.281268+0000","last_became_peered":"2024-05-08T18:31:00.281268+0000","last_unstale":"2024-05-08T18:31:45.332003+0000","last_undegraded":"2024-05-08T18:31:45.332003+0000","last_fullsized":"2024-05-08T18:31:45.332003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:40.256644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.186380+0000","last_change":"2024-05-08T18:30:58.306638+0000","last_active":"2024-05-08T18:34:07.186380+0000","last_peered":"2024-05-08T18:34:07.186380+0000","last_clean":"2024-05-08T18:34:07.186380+0000","last_became_active":"2024-05-08T18:30:58.303428+0000","last_became_peered":"2024-05-08T18:30:58.303428+0000","last_unstale":"2024-05-08T18:34:07.186380+0000","last_undegraded":"2024-05-08T18:34:07.186380+0000","last_fullsized":"2024-05-08T18:34:07.186380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:56.618771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332766+0000","last_change":"2024-05-08T18:31:02.292000+0000","last_active":"2024-05-08T18:31:45.332766+0000","last_peered":"2024-05-08T18:31:45.332766+0000","last_clean":"2024-05-08T18:31:45.332766+0000","last_became_active":"2024-05-08T18:31:02.291729+0000","last_became_peered":"2024-05-08T18:31:02.291729+0000","last_unstale":"2024-05-08T18:31:45.332766+0000","last_undegraded":"2024-05-08T18:31:45.332766+0000","last_fullsized":"2024-05-08T18:31:45.332766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:47:19.398957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.075273+0000","last_change":"2024-05-08T18:31:04.304611+0000","last_active":"2024-05-08T18:33:05.075273+0000","last_peered":"2024-05-08T18:33:05.075273+0000","last_clean":"2024-05-08T18:33:05.075273+0000","last_became_active":"2024-05-08T18:31:04.304347+0000","last_became_peered":"2024-05-08T18:31:04.304347+0000","last_unstale":"2024-05-08T18:33:05.075273+0000","last_undegraded":"2024-05-08T18:33:05.075273+0000","last_fullsized":"2024-05-08T18:33:05.075273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:42.690781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'282","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370399+0000","last_change":"2024-05-08T18:31:06.305903+0000","last_active":"2024-05-08T18:34:07.370399+0000","last_peered":"2024-05-08T18:34:07.370399+0000","last_clean":"2024-05-08T18:34:07.370399+0000","last_became_active":"2024-05-08T18:31:06.305591+0000","last_became_peered":"2024-05-08T18:31:06.305591+0000","last_unstale":"2024-05-08T18:34:07.370399+0000","last_undegraded":"2024-05-08T18:34:07.370399+0000","last_fullsized":"2024-05-08T18:34:07.370399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:49.125159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'10","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.272036+0000","last_change":"2024-05-08T18:31:00.291398+0000","last_active":"2024-05-08T18:34:07.272036+0000","last_peered":"2024-05-08T18:34:07.272036+0000","last_clean":"2024-05-08T18:34:07.272036+0000","last_became_active":"2024-05-08T18:31:00.290824+0000","last_became_peered":"2024-05-08T18:31:00.290824+0000","last_unstale":"2024-05-08T18:34:07.272036+0000","last_undegraded":"2024-05-08T18:34:07.272036+0000","last_fullsized":"2024-05-08T18:34:07.272036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:32.380609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333693+0000","last_change":"2024-05-08T18:30:58.301227+0000","last_active":"2024-05-08T18:31:45.333693+0000","last_peered":"2024-05-08T18:31:45.333693+0000","last_clean":"2024-05-08T18:31:45.333693+0000","last_became_active":"2024-05-08T18:30:58.300884+0000","last_became_peered":"2024-05-08T18:30:58.300884+0000","last_unstale":"2024-05-08T18:31:45.333693+0000","last_undegraded":"2024-05-08T18:31:45.333693+0000","last_fullsized":"2024-05-08T18:31:45.333693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:18.354135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334570+0000","last_change":"2024-05-08T18:31:02.291926+0000","last_active":"2024-05-08T18:31:45.334570+0000","last_peered":"2024-05-08T18:31:45.334570+0000","last_clean":"2024-05-08T18:31:45.334570+0000","last_became_active":"2024-05-08T18:31:02.291536+0000","last_became_peered":"2024-05-08T18:31:02.291536+0000","last_unstale":"2024-05-08T18:31:45.334570+0000","last_undegraded":"2024-05-08T18:31:45.334570+0000","last_fullsized":"2024-05-08T18:31:45.334570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:01.425063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'41","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.085136+0000","last_change":"2024-05-08T18:31:04.302745+0000","last_active":"2024-05-08T18:33:05.085136+0000","last_peered":"2024-05-08T18:33:05.085136+0000","last_clean":"2024-05-08T18:33:05.085136+0000","last_became_active":"2024-05-08T18:31:04.302455+0000","last_became_peered":"2024-05-08T18:31:04.302455+0000","last_unstale":"2024-05-08T18:33:05.085136+0000","last_undegraded":"2024-05-08T18:33:05.085136+0000","last_fullsized":"2024-05-08T18:33:05.085136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:32.684836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330256+0000","last_change":"2024-05-08T18:31:06.305190+0000","last_active":"2024-05-08T18:31:45.330256+0000","last_peered":"2024-05-08T18:31:45.330256+0000","last_clean":"2024-05-08T18:31:45.330256+0000","last_became_active":"2024-05-08T18:31:06.304979+0000","last_became_peered":"2024-05-08T18:31:06.304979+0000","last_unstale":"2024-05-08T18:31:45.330256+0000","last_undegraded":"2024-05-08T18:31:45.330256+0000","last_fullsized":"2024-05-08T18:31:45.330256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:43.024781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.692939+0000","last_change":"2024-05-08T18:31:08.311725+0000","last_active":"2024-05-08T18:32:22.692939+0000","last_peered":"2024-05-08T18:32:22.692939+0000","last_clean":"2024-05-08T18:32:22.692939+0000","last_became_active":"2024-05-08T18:31:08.311434+0000","last_became_peered":"2024-05-08T18:31:08.311434+0000","last_unstale":"2024-05-08T18:32:22.692939+0000","last_undegraded":"2024-05-08T18:32:22.692939+0000","last_fullsized":"2024-05-08T18:32:22.692939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:03.726123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.681210+0000","last_change":"2024-05-08T18:31:00.281267+0000","last_active":"2024-05-08T18:32:22.681210+0000","last_peered":"2024-05-08T18:32:22.681210+0000","last_clean":"2024-05-08T18:32:22.681210+0000","last_became_active":"2024-05-08T18:31:00.280969+0000","last_became_peered":"2024-05-08T18:31:00.280969+0000","last_unstale":"2024-05-08T18:32:22.681210+0000","last_undegraded":"2024-05-08T18:32:22.681210+0000","last_fullsized":"2024-05-08T18:32:22.681210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:22:54.136553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331186+0000","last_change":"2024-05-08T18:30:58.303460+0000","last_active":"2024-05-08T18:31:45.331186+0000","last_peered":"2024-05-08T18:31:45.331186+0000","last_clean":"2024-05-08T18:31:45.331186+0000","last_became_active":"2024-05-08T18:30:58.302590+0000","last_became_peered":"2024-05-08T18:30:58.302590+0000","last_unstale":"2024-05-08T18:31:45.331186+0000","last_undegraded":"2024-05-08T18:31:45.331186+0000","last_fullsized":"2024-05-08T18:31:45.331186+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:34.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329728+0000","last_change":"2024-05-08T18:31:02.289867+0000","last_active":"2024-05-08T18:31:45.329728+0000","last_peered":"2024-05-08T18:31:45.329728+0000","last_clean":"2024-05-08T18:31:45.329728+0000","last_became_active":"2024-05-08T18:31:02.289394+0000","last_became_peered":"2024-05-08T18:31:02.289394+0000","last_unstale":"2024-05-08T18:31:45.329728+0000","last_undegraded":"2024-05-08T18:31:45.329728+0000","last_fullsized":"2024-05-08T18:31:45.329728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:11.566252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.064996+0000","last_change":"2024-05-08T18:31:04.303291+0000","last_active":"2024-05-08T18:33:05.064996+0000","last_peered":"2024-05-08T18:33:05.064996+0000","last_clean":"2024-05-08T18:33:05.064996+0000","last_became_active":"2024-05-08T18:31:04.302886+0000","last_became_peered":"2024-05-08T18:31:04.302886+0000","last_unstale":"2024-05-08T18:33:05.064996+0000","last_undegraded":"2024-05-08T18:33:05.064996+0000","last_fullsized":"2024-05-08T18:33:05.064996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:19:01.413463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330112+0000","last_change":"2024-05-08T18:31:06.306937+0000","last_active":"2024-05-08T18:31:45.330112+0000","last_peered":"2024-05-08T18:31:45.330112+0000","last_clean":"2024-05-08T18:31:45.330112+0000","last_became_active":"2024-05-08T18:31:06.306607+0000","last_became_peered":"2024-05-08T18:31:06.306607+0000","last_unstale":"2024-05-08T18:31:45.330112+0000","last_undegraded":"2024-05-08T18:31:45.330112+0000","last_fullsized":"2024-05-08T18:31:45.330112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:57.121163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:17.147191+0000","last_change":"2024-05-08T18:31:08.305446+0000","last_active":"2024-05-08T18:32:17.147191+0000","last_peered":"2024-05-08T18:32:17.147191+0000","last_clean":"2024-05-08T18:32:17.147191+0000","last_became_active":"2024-05-08T18:31:08.305127+0000","last_became_peered":"2024-05-08T18:31:08.305127+0000","last_unstale":"2024-05-08T18:32:17.147191+0000","last_undegraded":"2024-05-08T18:32:17.147191+0000","last_fullsized":"2024-05-08T18:32:17.147191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:34.156497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.870768+0000","last_change":"2024-05-08T18:31:00.293425+0000","last_active":"2024-05-08T18:32:22.870768+0000","last_peered":"2024-05-08T18:32:22.870768+0000","last_clean":"2024-05-08T18:32:22.870768+0000","last_became_active":"2024-05-08T18:31:00.293170+0000","last_became_peered":"2024-05-08T18:31:00.293170+0000","last_unstale":"2024-05-08T18:32:22.870768+0000","last_undegraded":"2024-05-08T18:32:22.870768+0000","last_fullsized":"2024-05-08T18:32:22.870768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:18.374257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.486260+0000","last_change":"2024-05-08T18:30:58.316505+0000","last_active":"2024-05-08T18:33:06.486260+0000","last_peered":"2024-05-08T18:33:06.486260+0000","last_clean":"2024-05-08T18:33:06.486260+0000","last_became_active":"2024-05-08T18:30:58.314352+0000","last_became_peered":"2024-05-08T18:30:58.314352+0000","last_unstale":"2024-05-08T18:33:06.486260+0000","last_undegraded":"2024-05-08T18:33:06.486260+0000","last_fullsized":"2024-05-08T18:33:06.486260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:17.391716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:48.166253+0000","last_change":"2024-05-08T18:31:45.339752+0000","last_active":"2024-05-08T18:31:48.166253+0000","last_peered":"2024-05-08T18:31:48.166253+0000","last_clean":"2024-05-08T18:31:48.166253+0000","last_became_active":"2024-05-08T18:31:45.339423+0000","last_became_peered":"2024-05-08T18:31:45.339423+0000","last_unstale":"2024-05-08T18:31:48.166253+0000","last_undegraded":"2024-05-08T18:31:48.166253+0000","last_fullsized":"2024-05-08T18:31:48.166253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:49:36.600605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.087041+0000","last_change":"2024-05-08T18:31:04.298949+0000","last_active":"2024-05-08T18:33:05.087041+0000","last_peered":"2024-05-08T18:33:05.087041+0000","last_clean":"2024-05-08T18:33:05.087041+0000","last_became_active":"2024-05-08T18:31:04.298026+0000","last_became_peered":"2024-05-08T18:31:04.298026+0000","last_unstale":"2024-05-08T18:33:05.087041+0000","last_undegraded":"2024-05-08T18:33:05.087041+0000","last_fullsized":"2024-05-08T18:33:05.087041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:17.656617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'282","reported_seq":354,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.406177+0000","last_change":"2024-05-08T18:31:06.307022+0000","last_active":"2024-05-08T18:34:07.406177+0000","last_peered":"2024-05-08T18:34:07.406177+0000","last_clean":"2024-05-08T18:34:07.406177+0000","last_became_active":"2024-05-08T18:31:06.306655+0000","last_became_peered":"2024-05-08T18:31:06.306655+0000","last_unstale":"2024-05-08T18:34:07.406177+0000","last_undegraded":"2024-05-08T18:34:07.406177+0000","last_fullsized":"2024-05-08T18:34:07.406177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:17.968800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330293+0000","last_change":"2024-05-08T18:31:08.314593+0000","last_active":"2024-05-08T18:31:45.330293+0000","last_peered":"2024-05-08T18:31:45.330293+0000","last_clean":"2024-05-08T18:31:45.330293+0000","last_became_active":"2024-05-08T18:31:08.314273+0000","last_became_peered":"2024-05-08T18:31:08.314273+0000","last_unstale":"2024-05-08T18:31:45.330293+0000","last_undegraded":"2024-05-08T18:31:45.330293+0000","last_fullsized":"2024-05-08T18:31:45.330293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:44.629789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.869260+0000","last_change":"2024-05-08T18:31:00.283193+0000","last_active":"2024-05-08T18:32:22.869260+0000","last_peered":"2024-05-08T18:32:22.869260+0000","last_clean":"2024-05-08T18:32:22.869260+0000","last_became_active":"2024-05-08T18:31:00.282941+0000","last_became_peered":"2024-05-08T18:31:00.282941+0000","last_unstale":"2024-05-08T18:32:22.869260+0000","last_undegraded":"2024-05-08T18:32:22.869260+0000","last_fullsized":"2024-05-08T18:32:22.869260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:54.772566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328935+0000","last_change":"2024-05-08T18:30:58.316967+0000","last_active":"2024-05-08T18:31:45.328935+0000","last_peered":"2024-05-08T18:31:45.328935+0000","last_clean":"2024-05-08T18:31:45.328935+0000","last_became_active":"2024-05-08T18:30:58.313431+0000","last_became_peered":"2024-05-08T18:30:58.313431+0000","last_unstale":"2024-05-08T18:31:45.328935+0000","last_undegraded":"2024-05-08T18:31:45.328935+0000","last_fullsized":"2024-05-08T18:31:45.328935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:24.289073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329543+0000","last_change":"2024-05-08T18:31:02.290051+0000","last_active":"2024-05-08T18:31:45.329543+0000","last_peered":"2024-05-08T18:31:45.329543+0000","last_clean":"2024-05-08T18:31:45.329543+0000","last_became_active":"2024-05-08T18:31:02.289669+0000","last_became_peered":"2024-05-08T18:31:02.289669+0000","last_unstale":"2024-05-08T18:31:45.329543+0000","last_undegraded":"2024-05-08T18:31:45.329543+0000","last_fullsized":"2024-05-08T18:31:45.329543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:30.670243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'56","reported_seq":112,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.583830+0000","last_change":"2024-05-08T18:31:04.302553+0000","last_active":"2024-05-08T18:33:06.583830+0000","last_peered":"2024-05-08T18:33:06.583830+0000","last_clean":"2024-05-08T18:33:06.583830+0000","last_became_active":"2024-05-08T18:31:04.302244+0000","last_became_peered":"2024-05-08T18:31:04.302244+0000","last_unstale":"2024-05-08T18:33:06.583830+0000","last_undegraded":"2024-05-08T18:33:06.583830+0000","last_fullsized":"2024-05-08T18:33:06.583830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:46.989970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329219+0000","last_change":"2024-05-08T18:31:06.309153+0000","last_active":"2024-05-08T18:31:45.329219+0000","last_peered":"2024-05-08T18:31:45.329219+0000","last_clean":"2024-05-08T18:31:45.329219+0000","last_became_active":"2024-05-08T18:31:06.308806+0000","last_became_peered":"2024-05-08T18:31:06.308806+0000","last_unstale":"2024-05-08T18:31:45.329219+0000","last_undegraded":"2024-05-08T18:31:45.329219+0000","last_fullsized":"2024-05-08T18:31:45.329219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:11:34.745123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.381203+0000","last_change":"2024-05-08T18:31:08.319703+0000","last_active":"2024-05-08T18:34:07.381203+0000","last_peered":"2024-05-08T18:34:07.381203+0000","last_clean":"2024-05-08T18:34:07.381203+0000","last_became_active":"2024-05-08T18:31:08.319370+0000","last_became_peered":"2024-05-08T18:31:08.319370+0000","last_unstale":"2024-05-08T18:34:07.381203+0000","last_undegraded":"2024-05-08T18:34:07.381203+0000","last_fullsized":"2024-05-08T18:34:07.381203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:36.140092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.684230+0000","last_change":"2024-05-08T18:31:00.292416+0000","last_active":"2024-05-08T18:32:22.684230+0000","last_peered":"2024-05-08T18:32:22.684230+0000","last_clean":"2024-05-08T18:32:22.684230+0000","last_became_active":"2024-05-08T18:31:00.292154+0000","last_became_peered":"2024-05-08T18:31:00.292154+0000","last_unstale":"2024-05-08T18:32:22.684230+0000","last_undegraded":"2024-05-08T18:32:22.684230+0000","last_fullsized":"2024-05-08T18:32:22.684230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:03.239102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330126+0000","last_change":"2024-05-08T18:30:58.294896+0000","last_active":"2024-05-08T18:31:45.330126+0000","last_peered":"2024-05-08T18:31:45.330126+0000","last_clean":"2024-05-08T18:31:45.330126+0000","last_became_active":"2024-05-08T18:30:58.294377+0000","last_became_peered":"2024-05-08T18:30:58.294377+0000","last_unstale":"2024-05-08T18:31:45.330126+0000","last_undegraded":"2024-05-08T18:31:45.330126+0000","last_fullsized":"2024-05-08T18:31:45.330126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:04.148371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330076+0000","last_change":"2024-05-08T18:31:02.294000+0000","last_active":"2024-05-08T18:31:45.330076+0000","last_peered":"2024-05-08T18:31:45.330076+0000","last_clean":"2024-05-08T18:31:45.330076+0000","last_became_active":"2024-05-08T18:31:02.293680+0000","last_became_peered":"2024-05-08T18:31:02.293680+0000","last_unstale":"2024-05-08T18:31:45.330076+0000","last_undegraded":"2024-05-08T18:31:45.330076+0000","last_fullsized":"2024-05-08T18:31:45.330076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:49:52.687784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.069060+0000","last_change":"2024-05-08T18:31:04.301433+0000","last_active":"2024-05-08T18:33:05.069060+0000","last_peered":"2024-05-08T18:33:05.069060+0000","last_clean":"2024-05-08T18:33:05.069060+0000","last_became_active":"2024-05-08T18:31:04.301147+0000","last_became_peered":"2024-05-08T18:31:04.301147+0000","last_unstale":"2024-05-08T18:33:05.069060+0000","last_undegraded":"2024-05-08T18:33:05.069060+0000","last_fullsized":"2024-05-08T18:33:05.069060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:13.749614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332085+0000","last_change":"2024-05-08T18:31:06.309848+0000","last_active":"2024-05-08T18:31:45.332085+0000","last_peered":"2024-05-08T18:31:45.332085+0000","last_clean":"2024-05-08T18:31:45.332085+0000","last_became_active":"2024-05-08T18:31:06.308804+0000","last_became_peered":"2024-05-08T18:31:06.308804+0000","last_unstale":"2024-05-08T18:31:45.332085+0000","last_undegraded":"2024-05-08T18:31:45.332085+0000","last_fullsized":"2024-05-08T18:31:45.332085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.734033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177658+0000","last_change":"2024-05-08T18:31:08.320629+0000","last_active":"2024-05-08T18:33:08.177658+0000","last_peered":"2024-05-08T18:33:08.177658+0000","last_clean":"2024-05-08T18:33:08.177658+0000","last_became_active":"2024-05-08T18:31:08.320150+0000","last_became_peered":"2024-05-08T18:31:08.320150+0000","last_unstale":"2024-05-08T18:33:08.177658+0000","last_undegraded":"2024-05-08T18:33:08.177658+0000","last_fullsized":"2024-05-08T18:33:08.177658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:06:21.193541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.962245+0000","last_change":"2024-05-08T18:31:00.300161+0000","last_active":"2024-05-08T18:34:06.962245+0000","last_peered":"2024-05-08T18:34:06.962245+0000","last_clean":"2024-05-08T18:34:06.962245+0000","last_became_active":"2024-05-08T18:31:00.299379+0000","last_became_peered":"2024-05-08T18:31:00.299379+0000","last_unstale":"2024-05-08T18:34:06.962245+0000","last_undegraded":"2024-05-08T18:34:06.962245+0000","last_fullsized":"2024-05-08T18:34:06.962245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:30.742428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329273+0000","last_change":"2024-05-08T18:30:58.316845+0000","last_active":"2024-05-08T18:31:45.329273+0000","last_peered":"2024-05-08T18:31:45.329273+0000","last_clean":"2024-05-08T18:31:45.329273+0000","last_became_active":"2024-05-08T18:30:58.315625+0000","last_became_peered":"2024-05-08T18:30:58.315625+0000","last_unstale":"2024-05-08T18:31:45.329273+0000","last_undegraded":"2024-05-08T18:31:45.329273+0000","last_fullsized":"2024-05-08T18:31:45.329273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:06.716557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329621+0000","last_change":"2024-05-08T18:31:02.290296+0000","last_active":"2024-05-08T18:31:45.329621+0000","last_peered":"2024-05-08T18:31:45.329621+0000","last_clean":"2024-05-08T18:31:45.329621+0000","last_became_active":"2024-05-08T18:31:02.289767+0000","last_became_peered":"2024-05-08T18:31:02.289767+0000","last_unstale":"2024-05-08T18:31:45.329621+0000","last_undegraded":"2024-05-08T18:31:45.329621+0000","last_fullsized":"2024-05-08T18:31:45.329621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:25.978523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.095800+0000","last_change":"2024-05-08T18:31:04.294840+0000","last_active":"2024-05-08T18:33:05.095800+0000","last_peered":"2024-05-08T18:33:05.095800+0000","last_clean":"2024-05-08T18:33:05.095800+0000","last_became_active":"2024-05-08T18:31:04.294573+0000","last_became_peered":"2024-05-08T18:31:04.294573+0000","last_unstale":"2024-05-08T18:33:05.095800+0000","last_undegraded":"2024-05-08T18:33:05.095800+0000","last_fullsized":"2024-05-08T18:33:05.095800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:37.564647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'282","reported_seq":430,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.395855+0000","last_change":"2024-05-08T18:31:06.312484+0000","last_active":"2024-05-08T18:34:07.395855+0000","last_peered":"2024-05-08T18:34:07.395855+0000","last_clean":"2024-05-08T18:34:07.395855+0000","last_became_active":"2024-05-08T18:31:06.312203+0000","last_became_peered":"2024-05-08T18:31:06.312203+0000","last_unstale":"2024-05-08T18:34:07.395855+0000","last_undegraded":"2024-05-08T18:34:07.395855+0000","last_fullsized":"2024-05-08T18:34:07.395855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:28.017188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'14","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.250725+0000","last_change":"2024-05-08T18:31:08.314495+0000","last_active":"2024-05-08T18:34:07.250725+0000","last_peered":"2024-05-08T18:34:07.250725+0000","last_clean":"2024-05-08T18:34:07.250725+0000","last_became_active":"2024-05-08T18:31:08.314171+0000","last_became_peered":"2024-05-08T18:31:08.314171+0000","last_unstale":"2024-05-08T18:34:07.250725+0000","last_undegraded":"2024-05-08T18:34:07.250725+0000","last_fullsized":"2024-05-08T18:34:07.250725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:26.315849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.242517+0000","last_change":"2024-05-08T18:31:00.292788+0000","last_active":"2024-05-08T18:34:07.242517+0000","last_peered":"2024-05-08T18:34:07.242517+0000","last_clean":"2024-05-08T18:34:07.242517+0000","last_became_active":"2024-05-08T18:31:00.292521+0000","last_became_peered":"2024-05-08T18:31:00.292521+0000","last_unstale":"2024-05-08T18:34:07.242517+0000","last_undegraded":"2024-05-08T18:34:07.242517+0000","last_fullsized":"2024-05-08T18:34:07.242517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:09.586689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329194+0000","last_change":"2024-05-08T18:30:58.310166+0000","last_active":"2024-05-08T18:31:45.329194+0000","last_peered":"2024-05-08T18:31:45.329194+0000","last_clean":"2024-05-08T18:31:45.329194+0000","last_became_active":"2024-05-08T18:30:58.309773+0000","last_became_peered":"2024-05-08T18:30:58.309773+0000","last_unstale":"2024-05-08T18:31:45.329194+0000","last_undegraded":"2024-05-08T18:31:45.329194+0000","last_fullsized":"2024-05-08T18:31:45.329194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:07.578767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.181624+0000","last_change":"2024-05-08T18:31:02.289615+0000","last_active":"2024-05-08T18:33:06.181624+0000","last_peered":"2024-05-08T18:33:06.181624+0000","last_clean":"2024-05-08T18:33:06.181624+0000","last_became_active":"2024-05-08T18:31:02.289253+0000","last_became_peered":"2024-05-08T18:31:02.289253+0000","last_unstale":"2024-05-08T18:33:06.181624+0000","last_undegraded":"2024-05-08T18:33:06.181624+0000","last_fullsized":"2024-05-08T18:33:06.181624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:12.617698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330973+0000","last_change":"2024-05-08T18:31:04.304088+0000","last_active":"2024-05-08T18:31:45.330973+0000","last_peered":"2024-05-08T18:31:45.330973+0000","last_clean":"2024-05-08T18:31:45.330973+0000","last_became_active":"2024-05-08T18:31:04.303799+0000","last_became_peered":"2024-05-08T18:31:04.303799+0000","last_unstale":"2024-05-08T18:31:45.330973+0000","last_undegraded":"2024-05-08T18:31:45.330973+0000","last_fullsized":"2024-05-08T18:31:45.330973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:57.074860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'282","reported_seq":459,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370311+0000","last_change":"2024-05-08T18:31:06.305559+0000","last_active":"2024-05-08T18:34:07.370311+0000","last_peered":"2024-05-08T18:34:07.370311+0000","last_clean":"2024-05-08T18:34:07.370311+0000","last_became_active":"2024-05-08T18:31:06.305201+0000","last_became_peered":"2024-05-08T18:31:06.305201+0000","last_unstale":"2024-05-08T18:34:07.370311+0000","last_undegraded":"2024-05-08T18:34:07.370311+0000","last_fullsized":"2024-05-08T18:34:07.370311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:49.125159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.361146+0000","last_change":"2024-05-08T18:31:08.311212+0000","last_active":"2024-05-08T18:33:06.361146+0000","last_peered":"2024-05-08T18:33:06.361146+0000","last_clean":"2024-05-08T18:33:06.361146+0000","last_became_active":"2024-05-08T18:31:08.310906+0000","last_became_peered":"2024-05-08T18:31:08.310906+0000","last_unstale":"2024-05-08T18:33:06.361146+0000","last_undegraded":"2024-05-08T18:33:06.361146+0000","last_fullsized":"2024-05-08T18:33:06.361146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:11.717528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'14","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271660+0000","last_change":"2024-05-08T18:31:00.292227+0000","last_active":"2024-05-08T18:34:07.271660+0000","last_peered":"2024-05-08T18:34:07.271660+0000","last_clean":"2024-05-08T18:34:07.271660+0000","last_became_active":"2024-05-08T18:31:00.291563+0000","last_became_peered":"2024-05-08T18:31:00.291563+0000","last_unstale":"2024-05-08T18:34:07.271660+0000","last_undegraded":"2024-05-08T18:34:07.271660+0000","last_fullsized":"2024-05-08T18:34:07.271660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:21.530085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328340+0000","last_change":"2024-05-08T18:30:58.304032+0000","last_active":"2024-05-08T18:31:45.328340+0000","last_peered":"2024-05-08T18:31:45.328340+0000","last_clean":"2024-05-08T18:31:45.328340+0000","last_became_active":"2024-05-08T18:30:58.302966+0000","last_became_peered":"2024-05-08T18:30:58.302966+0000","last_unstale":"2024-05-08T18:31:45.328340+0000","last_undegraded":"2024-05-08T18:31:45.328340+0000","last_fullsized":"2024-05-08T18:31:45.328340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:53.183411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332859+0000","last_change":"2024-05-08T18:31:02.288493+0000","last_active":"2024-05-08T18:31:45.332859+0000","last_peered":"2024-05-08T18:31:45.332859+0000","last_clean":"2024-05-08T18:31:45.332859+0000","last_became_active":"2024-05-08T18:31:02.288232+0000","last_became_peered":"2024-05-08T18:31:02.288232+0000","last_unstale":"2024-05-08T18:31:45.332859+0000","last_undegraded":"2024-05-08T18:31:45.332859+0000","last_fullsized":"2024-05-08T18:31:45.332859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:29:42.582963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'38","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.081776+0000","last_change":"2024-05-08T18:31:04.301609+0000","last_active":"2024-05-08T18:33:05.081776+0000","last_peered":"2024-05-08T18:33:05.081776+0000","last_clean":"2024-05-08T18:33:05.081776+0000","last_became_active":"2024-05-08T18:31:04.301298+0000","last_became_peered":"2024-05-08T18:31:04.301298+0000","last_unstale":"2024-05-08T18:33:05.081776+0000","last_undegraded":"2024-05-08T18:33:05.081776+0000","last_fullsized":"2024-05-08T18:33:05.081776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:17.287554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331437+0000","last_change":"2024-05-08T18:31:06.310680+0000","last_active":"2024-05-08T18:31:45.331437+0000","last_peered":"2024-05-08T18:31:45.331437+0000","last_clean":"2024-05-08T18:31:45.331437+0000","last_became_active":"2024-05-08T18:31:06.310430+0000","last_became_peered":"2024-05-08T18:31:06.310430+0000","last_unstale":"2024-05-08T18:31:45.331437+0000","last_undegraded":"2024-05-08T18:31:45.331437+0000","last_fullsized":"2024-05-08T18:31:45.331437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:36.763558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.309458+0000","last_change":"2024-05-08T18:31:08.307711+0000","last_active":"2024-05-08T18:34:07.309458+0000","last_peered":"2024-05-08T18:34:07.309458+0000","last_clean":"2024-05-08T18:34:07.309458+0000","last_became_active":"2024-05-08T18:31:08.306492+0000","last_became_peered":"2024-05-08T18:31:08.306492+0000","last_unstale":"2024-05-08T18:34:07.309458+0000","last_undegraded":"2024-05-08T18:34:07.309458+0000","last_fullsized":"2024-05-08T18:34:07.309458+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:47:53.084160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271927+0000","last_change":"2024-05-08T18:31:00.299933+0000","last_active":"2024-05-08T18:34:07.271927+0000","last_peered":"2024-05-08T18:34:07.271927+0000","last_clean":"2024-05-08T18:34:07.271927+0000","last_became_active":"2024-05-08T18:31:00.299186+0000","last_became_peered":"2024-05-08T18:31:00.299186+0000","last_unstale":"2024-05-08T18:34:07.271927+0000","last_undegraded":"2024-05-08T18:34:07.271927+0000","last_fullsized":"2024-05-08T18:34:07.271927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:37.968339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337354+0000","last_change":"2024-05-08T18:30:49.982170+0000","last_active":"2024-05-08T18:31:45.337354+0000","last_peered":"2024-05-08T18:31:45.337354+0000","last_clean":"2024-05-08T18:31:45.337354+0000","last_became_active":"2024-05-08T18:30:49.981852+0000","last_became_peered":"2024-05-08T18:30:49.981852+0000","last_unstale":"2024-05-08T18:31:45.337354+0000","last_undegraded":"2024-05-08T18:31:45.337354+0000","last_fullsized":"2024-05-08T18:31:45.337354+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:54.158426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329142+0000","last_change":"2024-05-08T18:30:49.983387+0000","last_active":"2024-05-08T18:31:45.329142+0000","last_peered":"2024-05-08T18:31:45.329142+0000","last_clean":"2024-05-08T18:31:45.329142+0000","last_became_active":"2024-05-08T18:30:49.983023+0000","last_became_peered":"2024-05-08T18:30:49.983023+0000","last_unstale":"2024-05-08T18:31:45.329142+0000","last_undegraded":"2024-05-08T18:31:45.329142+0000","last_fullsized":"2024-05-08T18:31:45.329142+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:49.558123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328133+0000","last_change":"2024-05-08T18:30:58.317086+0000","last_active":"2024-05-08T18:31:45.328133+0000","last_peered":"2024-05-08T18:31:45.328133+0000","last_clean":"2024-05-08T18:31:45.328133+0000","last_became_active":"2024-05-08T18:30:58.316676+0000","last_became_peered":"2024-05-08T18:30:58.316676+0000","last_unstale":"2024-05-08T18:31:45.328133+0000","last_undegraded":"2024-05-08T18:31:45.328133+0000","last_fullsized":"2024-05-08T18:31:45.328133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:59:23.755041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.340362+0000","last_change":"2024-05-08T18:31:45.339419+0000","last_active":"2024-05-08T18:31:45.340362+0000","last_peered":"2024-05-08T18:31:45.340362+0000","last_clean":"2024-05-08T18:31:45.340362+0000","last_became_active":"2024-05-08T18:31:45.339007+0000","last_became_peered":"2024-05-08T18:31:45.339007+0000","last_unstale":"2024-05-08T18:31:45.340362+0000","last_undegraded":"2024-05-08T18:31:45.340362+0000","last_fullsized":"2024-05-08T18:31:45.340362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:27.129227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'76","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.093625+0000","last_change":"2024-05-08T18:31:04.299443+0000","last_active":"2024-05-08T18:33:05.093625+0000","last_peered":"2024-05-08T18:33:05.093625+0000","last_clean":"2024-05-08T18:33:05.093625+0000","last_became_active":"2024-05-08T18:31:04.299145+0000","last_became_peered":"2024-05-08T18:31:04.299145+0000","last_unstale":"2024-05-08T18:33:05.093625+0000","last_undegraded":"2024-05-08T18:33:05.093625+0000","last_fullsized":"2024-05-08T18:33:05.093625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:54.440135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330451+0000","last_change":"2024-05-08T18:31:06.312091+0000","last_active":"2024-05-08T18:31:45.330451+0000","last_peered":"2024-05-08T18:31:45.330451+0000","last_clean":"2024-05-08T18:31:45.330451+0000","last_became_active":"2024-05-08T18:31:06.311742+0000","last_became_peered":"2024-05-08T18:31:06.311742+0000","last_unstale":"2024-05-08T18:31:45.330451+0000","last_undegraded":"2024-05-08T18:31:45.330451+0000","last_fullsized":"2024-05-08T18:31:45.330451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:29:46.597510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'87","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.286528+0000","last_change":"2024-05-08T18:31:08.311008+0000","last_active":"2024-05-08T18:34:07.286528+0000","last_peered":"2024-05-08T18:34:07.286528+0000","last_clean":"2024-05-08T18:34:07.286528+0000","last_became_active":"2024-05-08T18:31:08.310715+0000","last_became_peered":"2024-05-08T18:31:08.310715+0000","last_unstale":"2024-05-08T18:34:07.286528+0000","last_undegraded":"2024-05-08T18:34:07.286528+0000","last_fullsized":"2024-05-08T18:34:07.286528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:34.317569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":173,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.057524+0000","last_change":"2024-05-08T18:31:00.295877+0000","last_active":"2024-05-08T18:34:07.057524+0000","last_peered":"2024-05-08T18:34:07.057524+0000","last_clean":"2024-05-08T18:34:07.057524+0000","last_became_active":"2024-05-08T18:31:00.295578+0000","last_became_peered":"2024-05-08T18:31:00.295578+0000","last_unstale":"2024-05-08T18:34:07.057524+0000","last_undegraded":"2024-05-08T18:34:07.057524+0000","last_fullsized":"2024-05-08T18:34:07.057524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:10.611116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327422+0000","last_change":"2024-05-08T18:30:49.983190+0000","last_active":"2024-05-08T18:31:45.327422+0000","last_peered":"2024-05-08T18:31:45.327422+0000","last_clean":"2024-05-08T18:31:45.327422+0000","last_became_active":"2024-05-08T18:30:49.982854+0000","last_became_peered":"2024-05-08T18:30:49.982854+0000","last_unstale":"2024-05-08T18:31:45.327422+0000","last_undegraded":"2024-05-08T18:31:45.327422+0000","last_fullsized":"2024-05-08T18:31:45.327422+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:33.902157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176047+0000","last_change":"2024-05-08T18:30:58.295078+0000","last_active":"2024-05-08T18:33:03.176047+0000","last_peered":"2024-05-08T18:33:03.176047+0000","last_clean":"2024-05-08T18:33:03.176047+0000","last_became_active":"2024-05-08T18:30:58.294153+0000","last_became_peered":"2024-05-08T18:30:58.294153+0000","last_unstale":"2024-05-08T18:33:03.176047+0000","last_undegraded":"2024-05-08T18:33:03.176047+0000","last_fullsized":"2024-05-08T18:33:03.176047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:18.354135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332227+0000","last_change":"2024-05-08T18:31:02.292269+0000","last_active":"2024-05-08T18:31:45.332227+0000","last_peered":"2024-05-08T18:31:45.332227+0000","last_clean":"2024-05-08T18:31:45.332227+0000","last_became_active":"2024-05-08T18:31:02.291979+0000","last_became_peered":"2024-05-08T18:31:02.291979+0000","last_unstale":"2024-05-08T18:31:45.332227+0000","last_undegraded":"2024-05-08T18:31:45.332227+0000","last_fullsized":"2024-05-08T18:31:45.332227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:39.010234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'274","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370443+0000","last_change":"2024-05-08T18:31:04.299833+0000","last_active":"2024-05-08T18:34:07.370443+0000","last_peered":"2024-05-08T18:34:07.370443+0000","last_clean":"2024-05-08T18:34:07.370443+0000","last_became_active":"2024-05-08T18:31:04.299494+0000","last_became_peered":"2024-05-08T18:31:04.299494+0000","last_unstale":"2024-05-08T18:34:07.370443+0000","last_undegraded":"2024-05-08T18:34:07.370443+0000","last_fullsized":"2024-05-08T18:34:07.370443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:04:48.277052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329374+0000","last_change":"2024-05-08T18:31:06.307338+0000","last_active":"2024-05-08T18:31:45.329374+0000","last_peered":"2024-05-08T18:31:45.329374+0000","last_clean":"2024-05-08T18:31:45.329374+0000","last_became_active":"2024-05-08T18:31:06.306554+0000","last_became_peered":"2024-05-08T18:31:06.306554+0000","last_unstale":"2024-05-08T18:31:45.329374+0000","last_undegraded":"2024-05-08T18:31:45.329374+0000","last_fullsized":"2024-05-08T18:31:45.329374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:32.299617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.867202+0000","last_change":"2024-05-08T18:31:08.316829+0000","last_active":"2024-05-08T18:32:22.867202+0000","last_peered":"2024-05-08T18:32:22.867202+0000","last_clean":"2024-05-08T18:32:22.867202+0000","last_became_active":"2024-05-08T18:31:08.316536+0000","last_became_peered":"2024-05-08T18:31:08.316536+0000","last_unstale":"2024-05-08T18:32:22.867202+0000","last_undegraded":"2024-05-08T18:32:22.867202+0000","last_fullsized":"2024-05-08T18:32:22.867202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:54.836108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'10","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.334094+0000","last_change":"2024-05-08T18:31:00.281674+0000","last_active":"2024-05-08T18:34:07.334094+0000","last_peered":"2024-05-08T18:34:07.334094+0000","last_clean":"2024-05-08T18:34:07.334094+0000","last_became_active":"2024-05-08T18:31:00.281359+0000","last_became_peered":"2024-05-08T18:31:00.281359+0000","last_unstale":"2024-05-08T18:34:07.334094+0000","last_undegraded":"2024-05-08T18:34:07.334094+0000","last_fullsized":"2024-05-08T18:34:07.334094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:21.913096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330082+0000","last_change":"2024-05-08T18:30:49.982800+0000","last_active":"2024-05-08T18:31:45.330082+0000","last_peered":"2024-05-08T18:31:45.330082+0000","last_clean":"2024-05-08T18:31:45.330082+0000","last_became_active":"2024-05-08T18:30:49.982438+0000","last_became_peered":"2024-05-08T18:30:49.982438+0000","last_unstale":"2024-05-08T18:31:45.330082+0000","last_undegraded":"2024-05-08T18:31:45.330082+0000","last_fullsized":"2024-05-08T18:31:45.330082+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:18.664851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328603+0000","last_change":"2024-05-08T18:30:58.294820+0000","last_active":"2024-05-08T18:31:45.328603+0000","last_peered":"2024-05-08T18:31:45.328603+0000","last_clean":"2024-05-08T18:31:45.328603+0000","last_became_active":"2024-05-08T18:30:58.294292+0000","last_became_peered":"2024-05-08T18:30:58.294292+0000","last_unstale":"2024-05-08T18:31:45.328603+0000","last_undegraded":"2024-05-08T18:31:45.328603+0000","last_fullsized":"2024-05-08T18:31:45.328603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:07.501461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330259+0000","last_change":"2024-05-08T18:31:02.292271+0000","last_active":"2024-05-08T18:31:45.330259+0000","last_peered":"2024-05-08T18:31:45.330259+0000","last_clean":"2024-05-08T18:31:45.330259+0000","last_became_active":"2024-05-08T18:31:02.291806+0000","last_became_peered":"2024-05-08T18:31:02.291806+0000","last_unstale":"2024-05-08T18:31:45.330259+0000","last_undegraded":"2024-05-08T18:31:45.330259+0000","last_fullsized":"2024-05-08T18:31:45.330259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:03.635955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370265+0000","last_change":"2024-05-08T18:31:04.303574+0000","last_active":"2024-05-08T18:34:07.370265+0000","last_peered":"2024-05-08T18:34:07.370265+0000","last_clean":"2024-05-08T18:34:07.370265+0000","last_became_active":"2024-05-08T18:31:04.303321+0000","last_became_peered":"2024-05-08T18:31:04.303321+0000","last_unstale":"2024-05-08T18:34:07.370265+0000","last_undegraded":"2024-05-08T18:34:07.370265+0000","last_fullsized":"2024-05-08T18:34:07.370265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:03.432097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330522+0000","last_change":"2024-05-08T18:31:06.309771+0000","last_active":"2024-05-08T18:31:45.330522+0000","last_peered":"2024-05-08T18:31:45.330522+0000","last_clean":"2024-05-08T18:31:45.330522+0000","last_became_active":"2024-05-08T18:31:06.309525+0000","last_became_peered":"2024-05-08T18:31:06.309525+0000","last_unstale":"2024-05-08T18:31:45.330522+0000","last_undegraded":"2024-05-08T18:31:45.330522+0000","last_fullsized":"2024-05-08T18:31:45.330522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:47:23.413504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'8","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327513+0000","last_change":"2024-05-08T18:31:08.314823+0000","last_active":"2024-05-08T18:31:45.327513+0000","last_peered":"2024-05-08T18:31:45.327513+0000","last_clean":"2024-05-08T18:31:45.327513+0000","last_became_active":"2024-05-08T18:31:08.314503+0000","last_became_peered":"2024-05-08T18:31:08.314503+0000","last_unstale":"2024-05-08T18:31:45.327513+0000","last_undegraded":"2024-05-08T18:31:45.327513+0000","last_fullsized":"2024-05-08T18:31:45.327513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:58.072442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.333503+0000","last_change":"2024-05-08T18:31:00.283770+0000","last_active":"2024-05-08T18:33:03.333503+0000","last_peered":"2024-05-08T18:33:03.333503+0000","last_clean":"2024-05-08T18:33:03.333503+0000","last_became_active":"2024-05-08T18:31:00.283410+0000","last_became_peered":"2024-05-08T18:31:00.283410+0000","last_unstale":"2024-05-08T18:33:03.333503+0000","last_undegraded":"2024-05-08T18:33:03.333503+0000","last_fullsized":"2024-05-08T18:33:03.333503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:56.345475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327663+0000","last_change":"2024-05-08T18:30:49.983911+0000","last_active":"2024-05-08T18:31:45.327663+0000","last_peered":"2024-05-08T18:31:45.327663+0000","last_clean":"2024-05-08T18:31:45.327663+0000","last_became_active":"2024-05-08T18:30:49.983515+0000","last_became_peered":"2024-05-08T18:30:49.983515+0000","last_unstale":"2024-05-08T18:31:45.327663+0000","last_undegraded":"2024-05-08T18:31:45.327663+0000","last_fullsized":"2024-05-08T18:31:45.327663+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:40.629929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332492+0000","last_change":"2024-05-08T18:30:58.306622+0000","last_active":"2024-05-08T18:31:45.332492+0000","last_peered":"2024-05-08T18:31:45.332492+0000","last_clean":"2024-05-08T18:31:45.332492+0000","last_became_active":"2024-05-08T18:30:58.306268+0000","last_became_peered":"2024-05-08T18:30:58.306268+0000","last_unstale":"2024-05-08T18:31:45.332492+0000","last_undegraded":"2024-05-08T18:31:45.332492+0000","last_fullsized":"2024-05-08T18:31:45.332492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:07.501461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330794+0000","last_change":"2024-05-08T18:31:02.292466+0000","last_active":"2024-05-08T18:31:45.330794+0000","last_peered":"2024-05-08T18:31:45.330794+0000","last_clean":"2024-05-08T18:31:45.330794+0000","last_became_active":"2024-05-08T18:31:02.292030+0000","last_became_peered":"2024-05-08T18:31:02.292030+0000","last_unstale":"2024-05-08T18:31:45.330794+0000","last_undegraded":"2024-05-08T18:31:45.330794+0000","last_fullsized":"2024-05-08T18:31:45.330794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:24.356014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'13","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.594211+0000","last_change":"2024-05-08T18:31:04.296591+0000","last_active":"2024-05-08T18:34:06.594211+0000","last_peered":"2024-05-08T18:34:06.594211+0000","last_clean":"2024-05-08T18:34:06.594211+0000","last_became_active":"2024-05-08T18:31:04.296257+0000","last_became_peered":"2024-05-08T18:31:04.296257+0000","last_unstale":"2024-05-08T18:34:06.594211+0000","last_undegraded":"2024-05-08T18:34:06.594211+0000","last_fullsized":"2024-05-08T18:34:06.594211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:29.136261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332452+0000","last_change":"2024-05-08T18:31:06.309173+0000","last_active":"2024-05-08T18:31:45.332452+0000","last_peered":"2024-05-08T18:31:45.332452+0000","last_clean":"2024-05-08T18:31:45.332452+0000","last_became_active":"2024-05-08T18:31:06.308892+0000","last_became_peered":"2024-05-08T18:31:06.308892+0000","last_unstale":"2024-05-08T18:31:45.332452+0000","last_undegraded":"2024-05-08T18:31:45.332452+0000","last_fullsized":"2024-05-08T18:31:45.332452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:18.093112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.340083+0000","last_change":"2024-05-08T18:31:08.319035+0000","last_active":"2024-05-08T18:33:06.340083+0000","last_peered":"2024-05-08T18:33:06.340083+0000","last_clean":"2024-05-08T18:33:06.340083+0000","last_became_active":"2024-05-08T18:31:08.318728+0000","last_became_peered":"2024-05-08T18:31:08.318728+0000","last_unstale":"2024-05-08T18:33:06.340083+0000","last_undegraded":"2024-05-08T18:33:06.340083+0000","last_fullsized":"2024-05-08T18:33:06.340083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:14.378528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'3","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:53.184078+0000","last_change":"2024-05-08T18:31:45.344716+0000","last_active":"2024-05-08T18:33:53.184078+0000","last_peered":"2024-05-08T18:33:53.184078+0000","last_clean":"2024-05-08T18:33:53.184078+0000","last_became_active":"2024-05-08T18:31:45.337785+0000","last_became_peered":"2024-05-08T18:31:45.337785+0000","last_unstale":"2024-05-08T18:33:53.184078+0000","last_undegraded":"2024-05-08T18:33:53.184078+0000","last_fullsized":"2024-05-08T18:33:53.184078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:46.808130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.419073+0000","last_change":"2024-05-08T18:30:58.302684+0000","last_active":"2024-05-08T18:33:06.419073+0000","last_peered":"2024-05-08T18:33:06.419073+0000","last_clean":"2024-05-08T18:33:06.419073+0000","last_became_active":"2024-05-08T18:30:58.302328+0000","last_became_peered":"2024-05-08T18:30:58.302328+0000","last_unstale":"2024-05-08T18:33:06.419073+0000","last_undegraded":"2024-05-08T18:33:06.419073+0000","last_fullsized":"2024-05-08T18:33:06.419073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:26.528845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330056+0000","last_change":"2024-05-08T18:30:49.983824+0000","last_active":"2024-05-08T18:31:45.330056+0000","last_peered":"2024-05-08T18:31:45.330056+0000","last_clean":"2024-05-08T18:31:45.330056+0000","last_became_active":"2024-05-08T18:30:49.983522+0000","last_became_peered":"2024-05-08T18:30:49.983522+0000","last_unstale":"2024-05-08T18:31:45.330056+0000","last_undegraded":"2024-05-08T18:31:45.330056+0000","last_fullsized":"2024-05-08T18:31:45.330056+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:18.812194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.176791+0000","last_change":"2024-05-08T18:31:02.294921+0000","last_active":"2024-05-08T18:33:08.176791+0000","last_peered":"2024-05-08T18:33:08.176791+0000","last_clean":"2024-05-08T18:33:08.176791+0000","last_became_active":"2024-05-08T18:31:02.294603+0000","last_became_peered":"2024-05-08T18:31:02.294603+0000","last_unstale":"2024-05-08T18:33:08.176791+0000","last_undegraded":"2024-05-08T18:33:08.176791+0000","last_fullsized":"2024-05-08T18:33:08.176791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:32.998440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'62","reported_seq":121,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.929072+0000","last_change":"2024-05-08T18:31:04.295377+0000","last_active":"2024-05-08T18:34:06.929072+0000","last_peered":"2024-05-08T18:34:06.929072+0000","last_clean":"2024-05-08T18:34:06.929072+0000","last_became_active":"2024-05-08T18:31:04.295090+0000","last_became_peered":"2024-05-08T18:31:04.295090+0000","last_unstale":"2024-05-08T18:34:06.929072+0000","last_undegraded":"2024-05-08T18:34:06.929072+0000","last_fullsized":"2024-05-08T18:34:06.929072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:24.176022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":61,"num_read_kb":49,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330265+0000","last_change":"2024-05-08T18:31:06.312460+0000","last_active":"2024-05-08T18:31:45.330265+0000","last_peered":"2024-05-08T18:31:45.330265+0000","last_clean":"2024-05-08T18:31:45.330265+0000","last_became_active":"2024-05-08T18:31:06.312179+0000","last_became_peered":"2024-05-08T18:31:06.312179+0000","last_unstale":"2024-05-08T18:31:45.330265+0000","last_undegraded":"2024-05-08T18:31:45.330265+0000","last_fullsized":"2024-05-08T18:31:45.330265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:03.281754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.521191+0000","last_change":"2024-05-08T18:31:08.306655+0000","last_active":"2024-05-08T18:33:06.521191+0000","last_peered":"2024-05-08T18:33:06.521191+0000","last_clean":"2024-05-08T18:33:06.521191+0000","last_became_active":"2024-05-08T18:31:08.304818+0000","last_became_peered":"2024-05-08T18:31:08.304818+0000","last_unstale":"2024-05-08T18:33:06.521191+0000","last_undegraded":"2024-05-08T18:33:06.521191+0000","last_fullsized":"2024-05-08T18:33:06.521191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:38.400920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.057661+0000","last_change":"2024-05-08T18:31:00.294763+0000","last_active":"2024-05-08T18:34:07.057661+0000","last_peered":"2024-05-08T18:34:07.057661+0000","last_clean":"2024-05-08T18:34:07.057661+0000","last_became_active":"2024-05-08T18:31:00.294157+0000","last_became_peered":"2024-05-08T18:31:00.294157+0000","last_unstale":"2024-05-08T18:34:07.057661+0000","last_undegraded":"2024-05-08T18:34:07.057661+0000","last_fullsized":"2024-05-08T18:34:07.057661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:41.794217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176107+0000","last_change":"2024-05-08T18:30:58.288464+0000","last_active":"2024-05-08T18:33:03.176107+0000","last_peered":"2024-05-08T18:33:03.176107+0000","last_clean":"2024-05-08T18:33:03.176107+0000","last_became_active":"2024-05-08T18:30:58.286578+0000","last_became_peered":"2024-05-08T18:30:58.286578+0000","last_unstale":"2024-05-08T18:33:03.176107+0000","last_undegraded":"2024-05-08T18:33:03.176107+0000","last_fullsized":"2024-05-08T18:33:03.176107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:46.459524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329948+0000","last_change":"2024-05-08T18:30:49.982777+0000","last_active":"2024-05-08T18:31:45.329948+0000","last_peered":"2024-05-08T18:31:45.329948+0000","last_clean":"2024-05-08T18:31:45.329948+0000","last_became_active":"2024-05-08T18:30:49.982471+0000","last_became_peered":"2024-05-08T18:30:49.982471+0000","last_unstale":"2024-05-08T18:31:45.329948+0000","last_undegraded":"2024-05-08T18:31:45.329948+0000","last_fullsized":"2024-05-08T18:31:45.329948+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:54.349839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327459+0000","last_change":"2024-05-08T18:31:02.288838+0000","last_active":"2024-05-08T18:31:45.327459+0000","last_peered":"2024-05-08T18:31:45.327459+0000","last_clean":"2024-05-08T18:31:45.327459+0000","last_became_active":"2024-05-08T18:31:02.287974+0000","last_became_peered":"2024-05-08T18:31:02.287974+0000","last_unstale":"2024-05-08T18:31:45.327459+0000","last_undegraded":"2024-05-08T18:31:45.327459+0000","last_fullsized":"2024-05-08T18:31:45.327459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:05.696133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'15","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178044+0000","last_change":"2024-05-08T18:31:04.301545+0000","last_active":"2024-05-08T18:33:13.178044+0000","last_peered":"2024-05-08T18:33:13.178044+0000","last_clean":"2024-05-08T18:33:13.178044+0000","last_became_active":"2024-05-08T18:31:04.301116+0000","last_became_peered":"2024-05-08T18:31:04.301116+0000","last_unstale":"2024-05-08T18:33:13.178044+0000","last_undegraded":"2024-05-08T18:33:13.178044+0000","last_fullsized":"2024-05-08T18:33:13.178044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:26.009674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'282","reported_seq":374,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370404+0000","last_change":"2024-05-08T18:31:06.308742+0000","last_active":"2024-05-08T18:34:07.370404+0000","last_peered":"2024-05-08T18:34:07.370404+0000","last_clean":"2024-05-08T18:34:07.370404+0000","last_became_active":"2024-05-08T18:31:06.308274+0000","last_became_peered":"2024-05-08T18:31:06.308274+0000","last_unstale":"2024-05-08T18:34:07.370404+0000","last_undegraded":"2024-05-08T18:34:07.370404+0000","last_fullsized":"2024-05-08T18:34:07.370404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:57.121163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331379+0000","last_change":"2024-05-08T18:31:08.318932+0000","last_active":"2024-05-08T18:31:45.331379+0000","last_peered":"2024-05-08T18:31:45.331379+0000","last_clean":"2024-05-08T18:31:45.331379+0000","last_became_active":"2024-05-08T18:31:08.318609+0000","last_became_peered":"2024-05-08T18:31:08.318609+0000","last_unstale":"2024-05-08T18:31:45.331379+0000","last_undegraded":"2024-05-08T18:31:45.331379+0000","last_fullsized":"2024-05-08T18:31:45.331379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:50.231594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328412+0000","last_change":"2024-05-08T18:31:00.291567+0000","last_active":"2024-05-08T18:31:45.328412+0000","last_peered":"2024-05-08T18:31:45.328412+0000","last_clean":"2024-05-08T18:31:45.328412+0000","last_became_active":"2024-05-08T18:31:00.291093+0000","last_became_peered":"2024-05-08T18:31:00.291093+0000","last_unstale":"2024-05-08T18:31:45.328412+0000","last_undegraded":"2024-05-08T18:31:45.328412+0000","last_fullsized":"2024-05-08T18:31:45.328412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:53.284230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333265+0000","last_change":"2024-05-08T18:30:58.306520+0000","last_active":"2024-05-08T18:31:45.333265+0000","last_peered":"2024-05-08T18:31:45.333265+0000","last_clean":"2024-05-08T18:31:45.333265+0000","last_became_active":"2024-05-08T18:30:58.305915+0000","last_became_peered":"2024-05-08T18:30:58.305915+0000","last_unstale":"2024-05-08T18:31:45.333265+0000","last_undegraded":"2024-05-08T18:31:45.333265+0000","last_fullsized":"2024-05-08T18:31:45.333265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:35.822576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330715+0000","last_change":"2024-05-08T18:30:49.982641+0000","last_active":"2024-05-08T18:31:45.330715+0000","last_peered":"2024-05-08T18:31:45.330715+0000","last_clean":"2024-05-08T18:31:45.330715+0000","last_became_active":"2024-05-08T18:30:49.982330+0000","last_became_peered":"2024-05-08T18:30:49.982330+0000","last_unstale":"2024-05-08T18:31:45.330715+0000","last_undegraded":"2024-05-08T18:31:45.330715+0000","last_fullsized":"2024-05-08T18:31:45.330715+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:18.664851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327471+0000","last_change":"2024-05-08T18:31:02.292781+0000","last_active":"2024-05-08T18:31:45.327471+0000","last_peered":"2024-05-08T18:31:45.327471+0000","last_clean":"2024-05-08T18:31:45.327471+0000","last_became_active":"2024-05-08T18:31:02.292328+0000","last_became_peered":"2024-05-08T18:31:02.292328+0000","last_unstale":"2024-05-08T18:31:45.327471+0000","last_undegraded":"2024-05-08T18:31:45.327471+0000","last_fullsized":"2024-05-08T18:31:45.327471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:57.704727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328449+0000","last_change":"2024-05-08T18:31:04.302579+0000","last_active":"2024-05-08T18:31:45.328449+0000","last_peered":"2024-05-08T18:31:45.328449+0000","last_clean":"2024-05-08T18:31:45.328449+0000","last_became_active":"2024-05-08T18:31:04.302020+0000","last_became_peered":"2024-05-08T18:31:04.302020+0000","last_unstale":"2024-05-08T18:31:45.328449+0000","last_undegraded":"2024-05-08T18:31:45.328449+0000","last_fullsized":"2024-05-08T18:31:45.328449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:32.125730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'282","reported_seq":389,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.381934+0000","last_change":"2024-05-08T18:31:06.305364+0000","last_active":"2024-05-08T18:34:07.381934+0000","last_peered":"2024-05-08T18:34:07.381934+0000","last_clean":"2024-05-08T18:34:07.381934+0000","last_became_active":"2024-05-08T18:31:06.305020+0000","last_became_peered":"2024-05-08T18:31:06.305020+0000","last_unstale":"2024-05-08T18:34:07.381934+0000","last_undegraded":"2024-05-08T18:34:07.381934+0000","last_fullsized":"2024-05-08T18:34:07.381934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:01.875049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333286+0000","last_change":"2024-05-08T18:31:08.310217+0000","last_active":"2024-05-08T18:31:45.333286+0000","last_peered":"2024-05-08T18:31:45.333286+0000","last_clean":"2024-05-08T18:31:45.333286+0000","last_became_active":"2024-05-08T18:31:08.309869+0000","last_became_peered":"2024-05-08T18:31:08.309869+0000","last_unstale":"2024-05-08T18:31:45.333286+0000","last_undegraded":"2024-05-08T18:31:45.333286+0000","last_fullsized":"2024-05-08T18:31:45.333286+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:36.670228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331588+0000","last_change":"2024-05-08T18:31:00.297171+0000","last_active":"2024-05-08T18:31:45.331588+0000","last_peered":"2024-05-08T18:31:45.331588+0000","last_clean":"2024-05-08T18:31:45.331588+0000","last_became_active":"2024-05-08T18:31:00.296431+0000","last_became_peered":"2024-05-08T18:31:00.296431+0000","last_unstale":"2024-05-08T18:31:45.331588+0000","last_undegraded":"2024-05-08T18:31:45.331588+0000","last_fullsized":"2024-05-08T18:31:45.331588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:19:18.458032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336437+0000","last_change":"2024-05-08T18:30:58.304887+0000","last_active":"2024-05-08T18:31:45.336437+0000","last_peered":"2024-05-08T18:31:45.336437+0000","last_clean":"2024-05-08T18:31:45.336437+0000","last_became_active":"2024-05-08T18:30:58.303997+0000","last_became_peered":"2024-05-08T18:30:58.303997+0000","last_unstale":"2024-05-08T18:31:45.336437+0000","last_undegraded":"2024-05-08T18:31:45.336437+0000","last_fullsized":"2024-05-08T18:31:45.336437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:34.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332663+0000","last_change":"2024-05-08T18:30:49.984897+0000","last_active":"2024-05-08T18:31:45.332663+0000","last_peered":"2024-05-08T18:31:45.332663+0000","last_clean":"2024-05-08T18:31:45.332663+0000","last_became_active":"2024-05-08T18:30:49.984280+0000","last_became_peered":"2024-05-08T18:30:49.984280+0000","last_unstale":"2024-05-08T18:31:45.332663+0000","last_undegraded":"2024-05-08T18:31:45.332663+0000","last_fullsized":"2024-05-08T18:31:45.332663+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:26.601806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327309+0000","last_change":"2024-05-08T18:31:02.290848+0000","last_active":"2024-05-08T18:31:45.327309+0000","last_peered":"2024-05-08T18:31:45.327309+0000","last_clean":"2024-05-08T18:31:45.327309+0000","last_became_active":"2024-05-08T18:31:02.290540+0000","last_became_peered":"2024-05-08T18:31:02.290540+0000","last_unstale":"2024-05-08T18:31:45.327309+0000","last_undegraded":"2024-05-08T18:31:45.327309+0000","last_fullsized":"2024-05-08T18:31:45.327309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:13.954253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'82","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.079634+0000","last_change":"2024-05-08T18:31:04.304969+0000","last_active":"2024-05-08T18:33:05.079634+0000","last_peered":"2024-05-08T18:33:05.079634+0000","last_clean":"2024-05-08T18:33:05.079634+0000","last_became_active":"2024-05-08T18:31:04.304669+0000","last_became_peered":"2024-05-08T18:31:04.304669+0000","last_unstale":"2024-05-08T18:33:05.079634+0000","last_undegraded":"2024-05-08T18:33:05.079634+0000","last_fullsized":"2024-05-08T18:33:05.079634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:46.499999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328793+0000","last_change":"2024-05-08T18:31:06.308900+0000","last_active":"2024-05-08T18:31:45.328793+0000","last_peered":"2024-05-08T18:31:45.328793+0000","last_clean":"2024-05-08T18:31:45.328793+0000","last_became_active":"2024-05-08T18:31:06.308621+0000","last_became_peered":"2024-05-08T18:31:06.308621+0000","last_unstale":"2024-05-08T18:31:45.328793+0000","last_undegraded":"2024-05-08T18:31:45.328793+0000","last_fullsized":"2024-05-08T18:31:45.328793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:09.710680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.335673+0000","last_change":"2024-05-08T18:31:08.308718+0000","last_active":"2024-05-08T18:34:07.335673+0000","last_peered":"2024-05-08T18:34:07.335673+0000","last_clean":"2024-05-08T18:34:07.335673+0000","last_became_active":"2024-05-08T18:31:08.308427+0000","last_became_peered":"2024-05-08T18:31:08.308427+0000","last_unstale":"2024-05-08T18:34:07.335673+0000","last_undegraded":"2024-05-08T18:34:07.335673+0000","last_fullsized":"2024-05-08T18:34:07.335673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:19.975648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330856+0000","last_change":"2024-05-08T18:31:08.315548+0000","last_active":"2024-05-08T18:31:45.330856+0000","last_peered":"2024-05-08T18:31:45.330856+0000","last_clean":"2024-05-08T18:31:45.330856+0000","last_became_active":"2024-05-08T18:31:08.315257+0000","last_became_peered":"2024-05-08T18:31:08.315257+0000","last_unstale":"2024-05-08T18:31:45.330856+0000","last_undegraded":"2024-05-08T18:31:45.330856+0000","last_fullsized":"2024-05-08T18:31:45.330856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:51.132007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'11","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.064332+0000","last_change":"2024-05-08T18:31:00.295123+0000","last_active":"2024-05-08T18:34:07.064332+0000","last_peered":"2024-05-08T18:34:07.064332+0000","last_clean":"2024-05-08T18:34:07.064332+0000","last_became_active":"2024-05-08T18:31:00.294827+0000","last_became_peered":"2024-05-08T18:31:00.294827+0000","last_unstale":"2024-05-08T18:34:07.064332+0000","last_undegraded":"2024-05-08T18:34:07.064332+0000","last_fullsized":"2024-05-08T18:34:07.064332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:55.191334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.174101+0000","last_change":"2024-05-08T18:30:58.313343+0000","last_active":"2024-05-08T18:34:07.174101+0000","last_peered":"2024-05-08T18:34:07.174101+0000","last_clean":"2024-05-08T18:34:07.174101+0000","last_became_active":"2024-05-08T18:30:58.313034+0000","last_became_peered":"2024-05-08T18:30:58.313034+0000","last_unstale":"2024-05-08T18:34:07.174101+0000","last_undegraded":"2024-05-08T18:34:07.174101+0000","last_fullsized":"2024-05-08T18:34:07.174101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:55.941415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334770+0000","last_change":"2024-05-08T18:31:02.291732+0000","last_active":"2024-05-08T18:31:45.334770+0000","last_peered":"2024-05-08T18:31:45.334770+0000","last_clean":"2024-05-08T18:31:45.334770+0000","last_became_active":"2024-05-08T18:31:02.291119+0000","last_became_peered":"2024-05-08T18:31:02.291119+0000","last_unstale":"2024-05-08T18:31:45.334770+0000","last_undegraded":"2024-05-08T18:31:45.334770+0000","last_fullsized":"2024-05-08T18:31:45.334770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:50.745635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.086081+0000","last_change":"2024-05-08T18:31:04.301279+0000","last_active":"2024-05-08T18:33:05.086081+0000","last_peered":"2024-05-08T18:33:05.086081+0000","last_clean":"2024-05-08T18:33:05.086081+0000","last_became_active":"2024-05-08T18:31:04.300990+0000","last_became_peered":"2024-05-08T18:31:04.300990+0000","last_unstale":"2024-05-08T18:33:05.086081+0000","last_undegraded":"2024-05-08T18:33:05.086081+0000","last_fullsized":"2024-05-08T18:33:05.086081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:40.615427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329018+0000","last_change":"2024-05-08T18:31:06.315203+0000","last_active":"2024-05-08T18:31:45.329018+0000","last_peered":"2024-05-08T18:31:45.329018+0000","last_clean":"2024-05-08T18:31:45.329018+0000","last_became_active":"2024-05-08T18:31:06.314696+0000","last_became_peered":"2024-05-08T18:31:06.314696+0000","last_unstale":"2024-05-08T18:31:45.329018+0000","last_undegraded":"2024-05-08T18:31:45.329018+0000","last_fullsized":"2024-05-08T18:31:45.329018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:41.839545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.795512+0000","last_change":"2024-05-08T18:31:08.319177+0000","last_active":"2024-05-08T18:33:04.795512+0000","last_peered":"2024-05-08T18:33:04.795512+0000","last_clean":"2024-05-08T18:33:04.795512+0000","last_became_active":"2024-05-08T18:31:08.318901+0000","last_became_peered":"2024-05-08T18:31:08.318901+0000","last_unstale":"2024-05-08T18:33:04.795512+0000","last_undegraded":"2024-05-08T18:33:04.795512+0000","last_fullsized":"2024-05-08T18:33:04.795512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:21.670979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.870376+0000","last_change":"2024-05-08T18:31:00.293009+0000","last_active":"2024-05-08T18:32:22.870376+0000","last_peered":"2024-05-08T18:32:22.870376+0000","last_clean":"2024-05-08T18:32:22.870376+0000","last_became_active":"2024-05-08T18:31:00.292376+0000","last_became_peered":"2024-05-08T18:31:00.292376+0000","last_unstale":"2024-05-08T18:32:22.870376+0000","last_undegraded":"2024-05-08T18:32:22.870376+0000","last_fullsized":"2024-05-08T18:32:22.870376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:09.586689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329734+0000","last_change":"2024-05-08T18:30:58.301858+0000","last_active":"2024-05-08T18:31:45.329734+0000","last_peered":"2024-05-08T18:31:45.329734+0000","last_clean":"2024-05-08T18:31:45.329734+0000","last_became_active":"2024-05-08T18:30:58.301520+0000","last_became_peered":"2024-05-08T18:30:58.301520+0000","last_unstale":"2024-05-08T18:31:45.329734+0000","last_undegraded":"2024-05-08T18:31:45.329734+0000","last_fullsized":"2024-05-08T18:31:45.329734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:46.459524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328015+0000","last_change":"2024-05-08T18:31:02.293828+0000","last_active":"2024-05-08T18:31:45.328015+0000","last_peered":"2024-05-08T18:31:45.328015+0000","last_clean":"2024-05-08T18:31:45.328015+0000","last_became_active":"2024-05-08T18:31:02.293459+0000","last_became_peered":"2024-05-08T18:31:02.293459+0000","last_unstale":"2024-05-08T18:31:45.328015+0000","last_undegraded":"2024-05-08T18:31:45.328015+0000","last_fullsized":"2024-05-08T18:31:45.328015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:45.110612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.598503+0000","last_change":"2024-05-08T18:31:04.298674+0000","last_active":"2024-05-08T18:34:06.598503+0000","last_peered":"2024-05-08T18:34:06.598503+0000","last_clean":"2024-05-08T18:34:06.598503+0000","last_became_active":"2024-05-08T18:31:04.298237+0000","last_became_peered":"2024-05-08T18:31:04.298237+0000","last_unstale":"2024-05-08T18:34:06.598503+0000","last_undegraded":"2024-05-08T18:34:06.598503+0000","last_fullsized":"2024-05-08T18:34:06.598503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:57.297845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329847+0000","last_change":"2024-05-08T18:31:06.307437+0000","last_active":"2024-05-08T18:31:45.329847+0000","last_peered":"2024-05-08T18:31:45.329847+0000","last_clean":"2024-05-08T18:31:45.329847+0000","last_became_active":"2024-05-08T18:31:06.307048+0000","last_became_peered":"2024-05-08T18:31:06.307048+0000","last_unstale":"2024-05-08T18:31:45.329847+0000","last_undegraded":"2024-05-08T18:31:45.329847+0000","last_fullsized":"2024-05-08T18:31:45.329847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:21:52.918678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329757+0000","last_change":"2024-05-08T18:31:08.314432+0000","last_active":"2024-05-08T18:31:45.329757+0000","last_peered":"2024-05-08T18:31:45.329757+0000","last_clean":"2024-05-08T18:31:45.329757+0000","last_became_active":"2024-05-08T18:31:08.313943+0000","last_became_peered":"2024-05-08T18:31:08.313943+0000","last_unstale":"2024-05-08T18:31:45.329757+0000","last_undegraded":"2024-05-08T18:31:45.329757+0000","last_fullsized":"2024-05-08T18:31:45.329757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:40.327081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271781+0000","last_change":"2024-05-08T18:31:00.286107+0000","last_active":"2024-05-08T18:34:07.271781+0000","last_peered":"2024-05-08T18:34:07.271781+0000","last_clean":"2024-05-08T18:34:07.271781+0000","last_became_active":"2024-05-08T18:31:00.285842+0000","last_became_peered":"2024-05-08T18:31:00.285842+0000","last_unstale":"2024-05-08T18:34:07.271781+0000","last_undegraded":"2024-05-08T18:34:07.271781+0000","last_fullsized":"2024-05-08T18:34:07.271781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:19.399639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336683+0000","last_change":"2024-05-08T18:30:58.303703+0000","last_active":"2024-05-08T18:31:45.336683+0000","last_peered":"2024-05-08T18:31:45.336683+0000","last_clean":"2024-05-08T18:31:45.336683+0000","last_became_active":"2024-05-08T18:30:58.303112+0000","last_became_peered":"2024-05-08T18:30:58.303112+0000","last_unstale":"2024-05-08T18:31:45.336683+0000","last_undegraded":"2024-05-08T18:31:45.336683+0000","last_fullsized":"2024-05-08T18:31:45.336683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:25.031288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331560+0000","last_change":"2024-05-08T18:31:02.295088+0000","last_active":"2024-05-08T18:31:45.331560+0000","last_peered":"2024-05-08T18:31:45.331560+0000","last_clean":"2024-05-08T18:31:45.331560+0000","last_became_active":"2024-05-08T18:31:02.294812+0000","last_became_peered":"2024-05-08T18:31:02.294812+0000","last_unstale":"2024-05-08T18:31:45.331560+0000","last_undegraded":"2024-05-08T18:31:45.331560+0000","last_fullsized":"2024-05-08T18:31:45.331560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:59.466223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'40","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.660807+0000","last_change":"2024-05-08T18:31:04.302309+0000","last_active":"2024-05-08T18:34:06.660807+0000","last_peered":"2024-05-08T18:34:06.660807+0000","last_clean":"2024-05-08T18:34:06.660807+0000","last_became_active":"2024-05-08T18:31:04.301969+0000","last_became_peered":"2024-05-08T18:31:04.301969+0000","last_unstale":"2024-05-08T18:34:06.660807+0000","last_undegraded":"2024-05-08T18:34:06.660807+0000","last_fullsized":"2024-05-08T18:34:06.660807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:14.097510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334470+0000","last_change":"2024-05-08T18:31:06.306660+0000","last_active":"2024-05-08T18:31:45.334470+0000","last_peered":"2024-05-08T18:31:45.334470+0000","last_clean":"2024-05-08T18:31:45.334470+0000","last_became_active":"2024-05-08T18:31:06.306346+0000","last_became_peered":"2024-05-08T18:31:06.306346+0000","last_unstale":"2024-05-08T18:31:45.334470+0000","last_undegraded":"2024-05-08T18:31:45.334470+0000","last_fullsized":"2024-05-08T18:31:45.334470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:47:23.413504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328038+0000","last_change":"2024-05-08T18:31:08.317029+0000","last_active":"2024-05-08T18:31:45.328038+0000","last_peered":"2024-05-08T18:31:45.328038+0000","last_clean":"2024-05-08T18:31:45.328038+0000","last_became_active":"2024-05-08T18:31:08.316673+0000","last_became_peered":"2024-05-08T18:31:08.316673+0000","last_unstale":"2024-05-08T18:31:45.328038+0000","last_undegraded":"2024-05-08T18:31:45.328038+0000","last_fullsized":"2024-05-08T18:31:45.328038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:47.053479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327883+0000","last_change":"2024-05-08T18:31:00.291577+0000","last_active":"2024-05-08T18:31:45.327883+0000","last_peered":"2024-05-08T18:31:45.327883+0000","last_clean":"2024-05-08T18:31:45.327883+0000","last_became_active":"2024-05-08T18:31:00.291163+0000","last_became_peered":"2024-05-08T18:31:00.291163+0000","last_unstale":"2024-05-08T18:31:45.327883+0000","last_undegraded":"2024-05-08T18:31:45.327883+0000","last_fullsized":"2024-05-08T18:31:45.327883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:38.677165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.323955+0000","last_change":"2024-05-08T18:30:58.305036+0000","last_active":"2024-05-08T18:33:03.323955+0000","last_peered":"2024-05-08T18:33:03.323955+0000","last_clean":"2024-05-08T18:33:03.323955+0000","last_became_active":"2024-05-08T18:30:58.304135+0000","last_became_peered":"2024-05-08T18:30:58.304135+0000","last_unstale":"2024-05-08T18:33:03.323955+0000","last_undegraded":"2024-05-08T18:33:03.323955+0000","last_fullsized":"2024-05-08T18:33:03.323955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:26.528845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327635+0000","last_change":"2024-05-08T18:31:02.290480+0000","last_active":"2024-05-08T18:31:45.327635+0000","last_peered":"2024-05-08T18:31:45.327635+0000","last_clean":"2024-05-08T18:31:45.327635+0000","last_became_active":"2024-05-08T18:31:02.290191+0000","last_became_peered":"2024-05-08T18:31:02.290191+0000","last_unstale":"2024-05-08T18:31:45.327635+0000","last_undegraded":"2024-05-08T18:31:45.327635+0000","last_fullsized":"2024-05-08T18:31:45.327635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:53.106616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.071221+0000","last_change":"2024-05-08T18:31:04.295526+0000","last_active":"2024-05-08T18:33:05.071221+0000","last_peered":"2024-05-08T18:33:05.071221+0000","last_clean":"2024-05-08T18:33:05.071221+0000","last_became_active":"2024-05-08T18:31:04.295255+0000","last_became_peered":"2024-05-08T18:31:04.295255+0000","last_unstale":"2024-05-08T18:33:05.071221+0000","last_undegraded":"2024-05-08T18:33:05.071221+0000","last_fullsized":"2024-05-08T18:33:05.071221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:47.180901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330989+0000","last_change":"2024-05-08T18:31:06.305114+0000","last_active":"2024-05-08T18:31:45.330989+0000","last_peered":"2024-05-08T18:31:45.330989+0000","last_clean":"2024-05-08T18:31:45.330989+0000","last_became_active":"2024-05-08T18:31:06.304851+0000","last_became_peered":"2024-05-08T18:31:06.304851+0000","last_unstale":"2024-05-08T18:31:45.330989+0000","last_undegraded":"2024-05-08T18:31:45.330989+0000","last_fullsized":"2024-05-08T18:31:45.330989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:36.598673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'8","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.580774+0000","last_change":"2024-05-08T18:31:45.343090+0000","last_active":"2024-05-08T18:33:06.580774+0000","last_peered":"2024-05-08T18:33:06.580774+0000","last_clean":"2024-05-08T18:33:06.580774+0000","last_became_active":"2024-05-08T18:31:45.336717+0000","last_became_peered":"2024-05-08T18:31:45.336717+0000","last_unstale":"2024-05-08T18:33:06.580774+0000","last_undegraded":"2024-05-08T18:33:06.580774+0000","last_fullsized":"2024-05-08T18:33:06.580774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:06.350550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327536+0000","last_change":"2024-05-08T18:30:58.303784+0000","last_active":"2024-05-08T18:31:45.327536+0000","last_peered":"2024-05-08T18:31:45.327536+0000","last_clean":"2024-05-08T18:31:45.327536+0000","last_became_active":"2024-05-08T18:30:58.302486+0000","last_became_peered":"2024-05-08T18:30:58.302486+0000","last_unstale":"2024-05-08T18:31:45.327536+0000","last_undegraded":"2024-05-08T18:31:45.327536+0000","last_fullsized":"2024-05-08T18:31:45.327536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:19.905174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330661+0000","last_change":"2024-05-08T18:31:02.292304+0000","last_active":"2024-05-08T18:31:45.330661+0000","last_peered":"2024-05-08T18:31:45.330661+0000","last_clean":"2024-05-08T18:31:45.330661+0000","last_became_active":"2024-05-08T18:31:02.291965+0000","last_became_peered":"2024-05-08T18:31:02.291965+0000","last_unstale":"2024-05-08T18:31:45.330661+0000","last_undegraded":"2024-05-08T18:31:45.330661+0000","last_fullsized":"2024-05-08T18:31:45.330661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:45.173868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.092410+0000","last_change":"2024-05-08T18:31:04.298401+0000","last_active":"2024-05-08T18:33:05.092410+0000","last_peered":"2024-05-08T18:33:05.092410+0000","last_clean":"2024-05-08T18:33:05.092410+0000","last_became_active":"2024-05-08T18:31:04.298061+0000","last_became_peered":"2024-05-08T18:31:04.298061+0000","last_unstale":"2024-05-08T18:33:05.092410+0000","last_undegraded":"2024-05-08T18:33:05.092410+0000","last_fullsized":"2024-05-08T18:33:05.092410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:36.394225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329659+0000","last_change":"2024-05-08T18:31:06.308566+0000","last_active":"2024-05-08T18:31:45.329659+0000","last_peered":"2024-05-08T18:31:45.329659+0000","last_clean":"2024-05-08T18:31:45.329659+0000","last_became_active":"2024-05-08T18:31:06.308247+0000","last_became_peered":"2024-05-08T18:31:06.308247+0000","last_unstale":"2024-05-08T18:31:45.329659+0000","last_undegraded":"2024-05-08T18:31:45.329659+0000","last_fullsized":"2024-05-08T18:31:45.329659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:43.989468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.059608+0000","last_change":"2024-05-08T18:31:08.314319+0000","last_active":"2024-05-08T18:34:07.059608+0000","last_peered":"2024-05-08T18:34:07.059608+0000","last_clean":"2024-05-08T18:34:07.059608+0000","last_became_active":"2024-05-08T18:31:08.313986+0000","last_became_peered":"2024-05-08T18:31:08.313986+0000","last_unstale":"2024-05-08T18:34:07.059608+0000","last_undegraded":"2024-05-08T18:34:07.059608+0000","last_fullsized":"2024-05-08T18:34:07.059608+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:34.156497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.240343+0000","last_change":"2024-05-08T18:31:00.281726+0000","last_active":"2024-05-08T18:34:07.240343+0000","last_peered":"2024-05-08T18:34:07.240343+0000","last_clean":"2024-05-08T18:34:07.240343+0000","last_became_active":"2024-05-08T18:31:00.281233+0000","last_became_peered":"2024-05-08T18:31:00.281233+0000","last_unstale":"2024-05-08T18:34:07.240343+0000","last_undegraded":"2024-05-08T18:34:07.240343+0000","last_fullsized":"2024-05-08T18:34:07.240343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:16:11.480889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334233+0000","last_change":"2024-05-08T18:30:58.290021+0000","last_active":"2024-05-08T18:31:45.334233+0000","last_peered":"2024-05-08T18:31:45.334233+0000","last_clean":"2024-05-08T18:31:45.334233+0000","last_became_active":"2024-05-08T18:30:58.289251+0000","last_became_peered":"2024-05-08T18:30:58.289251+0000","last_unstale":"2024-05-08T18:31:45.334233+0000","last_undegraded":"2024-05-08T18:31:45.334233+0000","last_fullsized":"2024-05-08T18:31:45.334233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:33.046479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332268+0000","last_change":"2024-05-08T18:31:02.293460+0000","last_active":"2024-05-08T18:31:45.332268+0000","last_peered":"2024-05-08T18:31:45.332268+0000","last_clean":"2024-05-08T18:31:45.332268+0000","last_became_active":"2024-05-08T18:31:02.293185+0000","last_became_peered":"2024-05-08T18:31:02.293185+0000","last_unstale":"2024-05-08T18:31:45.332268+0000","last_undegraded":"2024-05-08T18:31:45.332268+0000","last_fullsized":"2024-05-08T18:31:45.332268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:43.800799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.072164+0000","last_change":"2024-05-08T18:31:04.298821+0000","last_active":"2024-05-08T18:33:05.072164+0000","last_peered":"2024-05-08T18:33:05.072164+0000","last_clean":"2024-05-08T18:33:05.072164+0000","last_became_active":"2024-05-08T18:31:04.298482+0000","last_became_peered":"2024-05-08T18:31:04.298482+0000","last_unstale":"2024-05-08T18:33:05.072164+0000","last_undegraded":"2024-05-08T18:33:05.072164+0000","last_fullsized":"2024-05-08T18:33:05.072164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:16.451277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336190+0000","last_change":"2024-05-08T18:31:06.311670+0000","last_active":"2024-05-08T18:31:45.336190+0000","last_peered":"2024-05-08T18:31:45.336190+0000","last_clean":"2024-05-08T18:31:45.336190+0000","last_became_active":"2024-05-08T18:31:06.311392+0000","last_became_peered":"2024-05-08T18:31:06.311392+0000","last_unstale":"2024-05-08T18:31:45.336190+0000","last_undegraded":"2024-05-08T18:31:45.336190+0000","last_fullsized":"2024-05-08T18:31:45.336190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:17.968800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327375+0000","last_change":"2024-05-08T18:31:08.319678+0000","last_active":"2024-05-08T18:31:45.327375+0000","last_peered":"2024-05-08T18:31:45.327375+0000","last_clean":"2024-05-08T18:31:45.327375+0000","last_became_active":"2024-05-08T18:31:08.319394+0000","last_became_peered":"2024-05-08T18:31:08.319394+0000","last_unstale":"2024-05-08T18:31:45.327375+0000","last_undegraded":"2024-05-08T18:31:45.327375+0000","last_fullsized":"2024-05-08T18:31:45.327375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:16.822143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'18","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271649+0000","last_change":"2024-05-08T18:31:00.300170+0000","last_active":"2024-05-08T18:34:07.271649+0000","last_peered":"2024-05-08T18:34:07.271649+0000","last_clean":"2024-05-08T18:34:07.271649+0000","last_became_active":"2024-05-08T18:31:00.299547+0000","last_became_peered":"2024-05-08T18:31:00.299547+0000","last_unstale":"2024-05-08T18:34:07.271649+0000","last_undegraded":"2024-05-08T18:34:07.271649+0000","last_fullsized":"2024-05-08T18:34:07.271649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:21.996058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334865+0000","last_change":"2024-05-08T18:30:58.305155+0000","last_active":"2024-05-08T18:31:45.334865+0000","last_peered":"2024-05-08T18:31:45.334865+0000","last_clean":"2024-05-08T18:31:45.334865+0000","last_became_active":"2024-05-08T18:30:58.303624+0000","last_became_peered":"2024-05-08T18:30:58.303624+0000","last_unstale":"2024-05-08T18:31:45.334865+0000","last_undegraded":"2024-05-08T18:31:45.334865+0000","last_fullsized":"2024-05-08T18:31:45.334865+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:04.148371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331693+0000","last_change":"2024-05-08T18:31:02.292792+0000","last_active":"2024-05-08T18:31:45.331693+0000","last_peered":"2024-05-08T18:31:45.331693+0000","last_clean":"2024-05-08T18:31:45.331693+0000","last_became_active":"2024-05-08T18:31:02.292498+0000","last_became_peered":"2024-05-08T18:31:02.292498+0000","last_unstale":"2024-05-08T18:31:45.331693+0000","last_undegraded":"2024-05-08T18:31:45.331693+0000","last_fullsized":"2024-05-08T18:31:45.331693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:45.114148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.090360+0000","last_change":"2024-05-08T18:31:04.297701+0000","last_active":"2024-05-08T18:33:05.090360+0000","last_peered":"2024-05-08T18:33:05.090360+0000","last_clean":"2024-05-08T18:33:05.090360+0000","last_became_active":"2024-05-08T18:31:04.297297+0000","last_became_peered":"2024-05-08T18:31:04.297297+0000","last_unstale":"2024-05-08T18:33:05.090360+0000","last_undegraded":"2024-05-08T18:33:05.090360+0000","last_fullsized":"2024-05-08T18:33:05.090360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:01.274241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330477+0000","last_change":"2024-05-08T18:31:06.305923+0000","last_active":"2024-05-08T18:31:45.330477+0000","last_peered":"2024-05-08T18:31:45.330477+0000","last_clean":"2024-05-08T18:31:45.330477+0000","last_became_active":"2024-05-08T18:31:06.305567+0000","last_became_peered":"2024-05-08T18:31:06.305567+0000","last_unstale":"2024-05-08T18:31:45.330477+0000","last_undegraded":"2024-05-08T18:31:45.330477+0000","last_fullsized":"2024-05-08T18:31:45.330477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:20.352238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'11","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.682210+0000","last_change":"2024-05-08T18:31:08.317380+0000","last_active":"2024-05-08T18:34:06.682210+0000","last_peered":"2024-05-08T18:34:06.682210+0000","last_clean":"2024-05-08T18:34:06.682210+0000","last_became_active":"2024-05-08T18:31:08.316943+0000","last_became_peered":"2024-05-08T18:31:08.316943+0000","last_unstale":"2024-05-08T18:34:06.682210+0000","last_undegraded":"2024-05-08T18:34:06.682210+0000","last_fullsized":"2024-05-08T18:34:06.682210+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:54.462045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'5","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.280149+0000","last_change":"2024-05-08T18:31:00.283641+0000","last_active":"2024-05-08T18:34:07.280149+0000","last_peered":"2024-05-08T18:34:07.280149+0000","last_clean":"2024-05-08T18:34:07.280149+0000","last_became_active":"2024-05-08T18:31:00.282923+0000","last_became_peered":"2024-05-08T18:31:00.282923+0000","last_unstale":"2024-05-08T18:34:07.280149+0000","last_undegraded":"2024-05-08T18:34:07.280149+0000","last_fullsized":"2024-05-08T18:34:07.280149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:09.586689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328361+0000","last_change":"2024-05-08T18:30:58.318535+0000","last_active":"2024-05-08T18:31:45.328361+0000","last_peered":"2024-05-08T18:31:45.328361+0000","last_clean":"2024-05-08T18:31:45.328361+0000","last_became_active":"2024-05-08T18:30:58.316980+0000","last_became_peered":"2024-05-08T18:30:58.316980+0000","last_unstale":"2024-05-08T18:31:45.328361+0000","last_undegraded":"2024-05-08T18:31:45.328361+0000","last_fullsized":"2024-05-08T18:31:45.328361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:22:52.128630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336413+0000","last_change":"2024-05-08T18:31:02.288494+0000","last_active":"2024-05-08T18:31:45.336413+0000","last_peered":"2024-05-08T18:31:45.336413+0000","last_clean":"2024-05-08T18:31:45.336413+0000","last_became_active":"2024-05-08T18:31:02.288127+0000","last_became_peered":"2024-05-08T18:31:02.288127+0000","last_unstale":"2024-05-08T18:31:45.336413+0000","last_undegraded":"2024-05-08T18:31:45.336413+0000","last_fullsized":"2024-05-08T18:31:45.336413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:58.208003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333068+0000","last_change":"2024-05-08T18:31:04.302369+0000","last_active":"2024-05-08T18:31:45.333068+0000","last_peered":"2024-05-08T18:31:45.333068+0000","last_clean":"2024-05-08T18:31:45.333068+0000","last_became_active":"2024-05-08T18:31:04.302034+0000","last_became_peered":"2024-05-08T18:31:04.302034+0000","last_unstale":"2024-05-08T18:31:45.333068+0000","last_undegraded":"2024-05-08T18:31:45.333068+0000","last_fullsized":"2024-05-08T18:31:45.333068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:50:40.916183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'282","reported_seq":406,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370201+0000","last_change":"2024-05-08T18:31:06.311326+0000","last_active":"2024-05-08T18:34:07.370201+0000","last_peered":"2024-05-08T18:34:07.370201+0000","last_clean":"2024-05-08T18:34:07.370201+0000","last_became_active":"2024-05-08T18:31:06.311063+0000","last_became_peered":"2024-05-08T18:31:06.311063+0000","last_unstale":"2024-05-08T18:34:07.370201+0000","last_undegraded":"2024-05-08T18:34:07.370201+0000","last_fullsized":"2024-05-08T18:34:07.370201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:46.356134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327053+0000","last_change":"2024-05-08T18:31:08.320650+0000","last_active":"2024-05-08T18:31:45.327053+0000","last_peered":"2024-05-08T18:31:45.327053+0000","last_clean":"2024-05-08T18:31:45.327053+0000","last_became_active":"2024-05-08T18:31:08.320260+0000","last_became_peered":"2024-05-08T18:31:08.320260+0000","last_unstale":"2024-05-08T18:31:45.327053+0000","last_undegraded":"2024-05-08T18:31:45.327053+0000","last_fullsized":"2024-05-08T18:31:45.327053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:03.499843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.580949+0000","last_change":"2024-05-08T18:31:00.285978+0000","last_active":"2024-05-08T18:33:06.580949+0000","last_peered":"2024-05-08T18:33:06.580949+0000","last_clean":"2024-05-08T18:33:06.580949+0000","last_became_active":"2024-05-08T18:31:00.284982+0000","last_became_peered":"2024-05-08T18:31:00.284982+0000","last_unstale":"2024-05-08T18:33:06.580949+0000","last_undegraded":"2024-05-08T18:33:06.580949+0000","last_fullsized":"2024-05-08T18:33:06.580949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:19.399639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.338145+0000","last_change":"2024-05-08T18:30:58.306355+0000","last_active":"2024-05-08T18:31:45.338145+0000","last_peered":"2024-05-08T18:31:45.338145+0000","last_clean":"2024-05-08T18:31:45.338145+0000","last_became_active":"2024-05-08T18:30:58.304969+0000","last_became_peered":"2024-05-08T18:30:58.304969+0000","last_unstale":"2024-05-08T18:31:45.338145+0000","last_undegraded":"2024-05-08T18:31:45.338145+0000","last_fullsized":"2024-05-08T18:31:45.338145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:07.501461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334669+0000","last_change":"2024-05-08T18:31:02.289211+0000","last_active":"2024-05-08T18:31:45.334669+0000","last_peered":"2024-05-08T18:31:45.334669+0000","last_clean":"2024-05-08T18:31:45.334669+0000","last_became_active":"2024-05-08T18:31:02.288719+0000","last_became_peered":"2024-05-08T18:31:02.288719+0000","last_unstale":"2024-05-08T18:31:45.334669+0000","last_undegraded":"2024-05-08T18:31:45.334669+0000","last_fullsized":"2024-05-08T18:31:45.334669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:42.419001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'37","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.062940+0000","last_change":"2024-05-08T18:31:04.299750+0000","last_active":"2024-05-08T18:33:05.062940+0000","last_peered":"2024-05-08T18:33:05.062940+0000","last_clean":"2024-05-08T18:33:05.062940+0000","last_became_active":"2024-05-08T18:31:04.297013+0000","last_became_peered":"2024-05-08T18:31:04.297013+0000","last_unstale":"2024-05-08T18:33:05.062940+0000","last_undegraded":"2024-05-08T18:33:05.062940+0000","last_fullsized":"2024-05-08T18:33:05.062940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:34.756044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328787+0000","last_change":"2024-05-08T18:31:06.312037+0000","last_active":"2024-05-08T18:31:45.328787+0000","last_peered":"2024-05-08T18:31:45.328787+0000","last_clean":"2024-05-08T18:31:45.328787+0000","last_became_active":"2024-05-08T18:31:06.311767+0000","last_became_peered":"2024-05-08T18:31:06.311767+0000","last_unstale":"2024-05-08T18:31:45.328787+0000","last_undegraded":"2024-05-08T18:31:45.328787+0000","last_fullsized":"2024-05-08T18:31:45.328787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:32.310721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.985534+0000","last_change":"2024-05-08T18:31:08.313489+0000","last_active":"2024-05-08T18:34:06.985534+0000","last_peered":"2024-05-08T18:34:06.985534+0000","last_clean":"2024-05-08T18:34:06.985534+0000","last_became_active":"2024-05-08T18:31:08.312031+0000","last_became_peered":"2024-05-08T18:31:08.312031+0000","last_unstale":"2024-05-08T18:34:06.985534+0000","last_undegraded":"2024-05-08T18:34:06.985534+0000","last_fullsized":"2024-05-08T18:34:06.985534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:40.327081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.681165+0000","last_change":"2024-05-08T18:31:00.282870+0000","last_active":"2024-05-08T18:32:22.681165+0000","last_peered":"2024-05-08T18:32:22.681165+0000","last_clean":"2024-05-08T18:32:22.681165+0000","last_became_active":"2024-05-08T18:31:00.282605+0000","last_became_peered":"2024-05-08T18:31:00.282605+0000","last_unstale":"2024-05-08T18:32:22.681165+0000","last_undegraded":"2024-05-08T18:32:22.681165+0000","last_fullsized":"2024-05-08T18:32:22.681165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:30.009947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330348+0000","last_change":"2024-05-08T18:30:58.316801+0000","last_active":"2024-05-08T18:31:45.330348+0000","last_peered":"2024-05-08T18:31:45.330348+0000","last_clean":"2024-05-08T18:31:45.330348+0000","last_became_active":"2024-05-08T18:30:58.316166+0000","last_became_peered":"2024-05-08T18:30:58.316166+0000","last_unstale":"2024-05-08T18:31:45.330348+0000","last_undegraded":"2024-05-08T18:31:45.330348+0000","last_fullsized":"2024-05-08T18:31:45.330348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:24.440258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334438+0000","last_change":"2024-05-08T18:31:02.294645+0000","last_active":"2024-05-08T18:31:45.334438+0000","last_peered":"2024-05-08T18:31:45.334438+0000","last_clean":"2024-05-08T18:31:45.334438+0000","last_became_active":"2024-05-08T18:31:02.294335+0000","last_became_peered":"2024-05-08T18:31:02.294335+0000","last_unstale":"2024-05-08T18:31:45.334438+0000","last_undegraded":"2024-05-08T18:31:45.334438+0000","last_fullsized":"2024-05-08T18:31:45.334438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:40:41.976982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.063967+0000","last_change":"2024-05-08T18:31:04.297821+0000","last_active":"2024-05-08T18:33:05.063967+0000","last_peered":"2024-05-08T18:33:05.063967+0000","last_clean":"2024-05-08T18:33:05.063967+0000","last_became_active":"2024-05-08T18:31:04.297440+0000","last_became_peered":"2024-05-08T18:31:04.297440+0000","last_unstale":"2024-05-08T18:33:05.063967+0000","last_undegraded":"2024-05-08T18:33:05.063967+0000","last_fullsized":"2024-05-08T18:33:05.063967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:14.624732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327191+0000","last_change":"2024-05-08T18:31:06.312504+0000","last_active":"2024-05-08T18:31:45.327191+0000","last_peered":"2024-05-08T18:31:45.327191+0000","last_clean":"2024-05-08T18:31:45.327191+0000","last_became_active":"2024-05-08T18:31:06.312162+0000","last_became_peered":"2024-05-08T18:31:06.312162+0000","last_unstale":"2024-05-08T18:31:45.327191+0000","last_undegraded":"2024-05-08T18:31:45.327191+0000","last_fullsized":"2024-05-08T18:31:45.327191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:25.211733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.331019+0000","last_change":"2024-05-08T18:31:08.318309+0000","last_active":"2024-05-08T18:33:03.331019+0000","last_peered":"2024-05-08T18:33:03.331019+0000","last_clean":"2024-05-08T18:33:03.331019+0000","last_became_active":"2024-05-08T18:31:08.318072+0000","last_became_peered":"2024-05-08T18:31:08.318072+0000","last_unstale":"2024-05-08T18:33:03.331019+0000","last_undegraded":"2024-05-08T18:33:03.331019+0000","last_fullsized":"2024-05-08T18:33:03.331019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:36:18.141092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'4","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.247651+0000","last_change":"2024-05-08T18:31:00.292044+0000","last_active":"2024-05-08T18:34:07.247651+0000","last_peered":"2024-05-08T18:34:07.247651+0000","last_clean":"2024-05-08T18:34:07.247651+0000","last_became_active":"2024-05-08T18:31:00.291128+0000","last_became_peered":"2024-05-08T18:31:00.291128+0000","last_unstale":"2024-05-08T18:34:07.247651+0000","last_undegraded":"2024-05-08T18:34:07.247651+0000","last_fullsized":"2024-05-08T18:34:07.247651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:28.671220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330831+0000","last_change":"2024-05-08T18:30:58.285590+0000","last_active":"2024-05-08T18:31:45.330831+0000","last_peered":"2024-05-08T18:31:45.330831+0000","last_clean":"2024-05-08T18:31:45.330831+0000","last_became_active":"2024-05-08T18:30:58.283402+0000","last_became_peered":"2024-05-08T18:30:58.283402+0000","last_unstale":"2024-05-08T18:31:45.330831+0000","last_undegraded":"2024-05-08T18:31:45.330831+0000","last_fullsized":"2024-05-08T18:31:45.330831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:43.233516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336457+0000","last_change":"2024-05-08T18:31:02.292679+0000","last_active":"2024-05-08T18:31:45.336457+0000","last_peered":"2024-05-08T18:31:45.336457+0000","last_clean":"2024-05-08T18:31:45.336457+0000","last_became_active":"2024-05-08T18:31:02.291363+0000","last_became_peered":"2024-05-08T18:31:02.291363+0000","last_unstale":"2024-05-08T18:31:45.336457+0000","last_undegraded":"2024-05-08T18:31:45.336457+0000","last_fullsized":"2024-05-08T18:31:45.336457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:40.683748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'29","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.088039+0000","last_change":"2024-05-08T18:31:04.298937+0000","last_active":"2024-05-08T18:33:05.088039+0000","last_peered":"2024-05-08T18:33:05.088039+0000","last_clean":"2024-05-08T18:33:05.088039+0000","last_became_active":"2024-05-08T18:31:04.298601+0000","last_became_peered":"2024-05-08T18:31:04.298601+0000","last_unstale":"2024-05-08T18:33:05.088039+0000","last_undegraded":"2024-05-08T18:33:05.088039+0000","last_fullsized":"2024-05-08T18:33:05.088039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:52.647996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":40,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327562+0000","last_change":"2024-05-08T18:31:06.308361+0000","last_active":"2024-05-08T18:31:45.327562+0000","last_peered":"2024-05-08T18:31:45.327562+0000","last_clean":"2024-05-08T18:31:45.327562+0000","last_became_active":"2024-05-08T18:31:06.307801+0000","last_became_peered":"2024-05-08T18:31:06.307801+0000","last_unstale":"2024-05-08T18:31:45.327562+0000","last_undegraded":"2024-05-08T18:31:45.327562+0000","last_fullsized":"2024-05-08T18:31:45.327562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:23.188589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.098741+0000","last_change":"2024-05-08T18:31:08.319580+0000","last_active":"2024-05-08T18:33:05.098741+0000","last_peered":"2024-05-08T18:33:05.098741+0000","last_clean":"2024-05-08T18:33:05.098741+0000","last_became_active":"2024-05-08T18:31:08.319232+0000","last_became_peered":"2024-05-08T18:31:08.319232+0000","last_unstale":"2024-05-08T18:33:05.098741+0000","last_undegraded":"2024-05-08T18:33:05.098741+0000","last_fullsized":"2024-05-08T18:33:05.098741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:04.750785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271785+0000","last_change":"2024-05-08T18:31:00.283026+0000","last_active":"2024-05-08T18:34:07.271785+0000","last_peered":"2024-05-08T18:34:07.271785+0000","last_clean":"2024-05-08T18:34:07.271785+0000","last_became_active":"2024-05-08T18:31:00.282644+0000","last_became_peered":"2024-05-08T18:31:00.282644+0000","last_unstale":"2024-05-08T18:34:07.271785+0000","last_undegraded":"2024-05-08T18:34:07.271785+0000","last_fullsized":"2024-05-08T18:34:07.271785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:26.448180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.944420+0000","last_change":"2024-05-08T18:30:58.304661+0000","last_active":"2024-05-08T18:34:06.944420+0000","last_peered":"2024-05-08T18:34:06.944420+0000","last_clean":"2024-05-08T18:34:06.944420+0000","last_became_active":"2024-05-08T18:30:58.303312+0000","last_became_peered":"2024-05-08T18:30:58.303312+0000","last_unstale":"2024-05-08T18:34:06.944420+0000","last_undegraded":"2024-05-08T18:34:06.944420+0000","last_fullsized":"2024-05-08T18:34:06.944420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:46.459524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'6","reported_seq":228,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.172197+0000","last_change":"2024-05-08T18:31:02.288759+0000","last_active":"2024-05-08T18:33:06.172197+0000","last_peered":"2024-05-08T18:33:06.172197+0000","last_clean":"2024-05-08T18:33:06.172197+0000","last_became_active":"2024-05-08T18:31:02.288433+0000","last_became_peered":"2024-05-08T18:31:02.288433+0000","last_unstale":"2024-05-08T18:33:06.172197+0000","last_undegraded":"2024-05-08T18:33:06.172197+0000","last_fullsized":"2024-05-08T18:33:06.172197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:35.557614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'32","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.599172+0000","last_change":"2024-05-08T18:31:04.299253+0000","last_active":"2024-05-08T18:34:06.599172+0000","last_peered":"2024-05-08T18:34:06.599172+0000","last_clean":"2024-05-08T18:34:06.599172+0000","last_became_active":"2024-05-08T18:31:04.298089+0000","last_became_peered":"2024-05-08T18:31:04.298089+0000","last_unstale":"2024-05-08T18:34:06.599172+0000","last_undegraded":"2024-05-08T18:34:06.599172+0000","last_fullsized":"2024-05-08T18:34:06.599172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:34.386559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329003+0000","last_change":"2024-05-08T18:31:06.312121+0000","last_active":"2024-05-08T18:31:45.329003+0000","last_peered":"2024-05-08T18:31:45.329003+0000","last_clean":"2024-05-08T18:31:45.329003+0000","last_became_active":"2024-05-08T18:31:06.311810+0000","last_became_peered":"2024-05-08T18:31:06.311810+0000","last_unstale":"2024-05-08T18:31:45.329003+0000","last_undegraded":"2024-05-08T18:31:45.329003+0000","last_fullsized":"2024-05-08T18:31:45.329003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:01.719275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.101535+0000","last_change":"2024-05-08T18:31:08.317101+0000","last_active":"2024-05-08T18:33:05.101535+0000","last_peered":"2024-05-08T18:33:05.101535+0000","last_clean":"2024-05-08T18:33:05.101535+0000","last_became_active":"2024-05-08T18:31:08.316723+0000","last_became_peered":"2024-05-08T18:31:08.316723+0000","last_unstale":"2024-05-08T18:33:05.101535+0000","last_undegraded":"2024-05-08T18:33:05.101535+0000","last_fullsized":"2024-05-08T18:33:05.101535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:49.236295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.346732+0000","last_change":"2024-05-08T18:31:45.346058+0000","last_active":"2024-05-08T18:31:45.346732+0000","last_peered":"2024-05-08T18:31:45.346732+0000","last_clean":"2024-05-08T18:31:45.346732+0000","last_became_active":"2024-05-08T18:31:45.339252+0000","last_became_peered":"2024-05-08T18:31:45.339252+0000","last_unstale":"2024-05-08T18:31:45.346732+0000","last_undegraded":"2024-05-08T18:31:45.346732+0000","last_fullsized":"2024-05-08T18:31:45.346732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:50:36.902568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176307+0000","last_change":"2024-05-08T18:30:58.308668+0000","last_active":"2024-05-08T18:33:03.176307+0000","last_peered":"2024-05-08T18:33:03.176307+0000","last_clean":"2024-05-08T18:33:03.176307+0000","last_became_active":"2024-05-08T18:30:58.308290+0000","last_became_peered":"2024-05-08T18:30:58.308290+0000","last_unstale":"2024-05-08T18:33:03.176307+0000","last_undegraded":"2024-05-08T18:33:03.176307+0000","last_fullsized":"2024-05-08T18:33:03.176307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:38.049573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.869487+0000","last_change":"2024-05-08T18:31:00.283309+0000","last_active":"2024-05-08T18:32:22.869487+0000","last_peered":"2024-05-08T18:32:22.869487+0000","last_clean":"2024-05-08T18:32:22.869487+0000","last_became_active":"2024-05-08T18:31:00.282889+0000","last_became_peered":"2024-05-08T18:31:00.282889+0000","last_unstale":"2024-05-08T18:32:22.869487+0000","last_undegraded":"2024-05-08T18:32:22.869487+0000","last_fullsized":"2024-05-08T18:32:22.869487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:30.686060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328796+0000","last_change":"2024-05-08T18:30:58.295262+0000","last_active":"2024-05-08T18:31:45.328796+0000","last_peered":"2024-05-08T18:31:45.328796+0000","last_clean":"2024-05-08T18:31:45.328796+0000","last_became_active":"2024-05-08T18:30:58.294210+0000","last_became_peered":"2024-05-08T18:30:58.294210+0000","last_unstale":"2024-05-08T18:31:45.328796+0000","last_undegraded":"2024-05-08T18:31:45.328796+0000","last_fullsized":"2024-05-08T18:31:45.328796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:11.650120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196723+0000","last_change":"2024-05-08T18:31:00.298041+0000","last_active":"2024-05-08T18:34:07.196723+0000","last_peered":"2024-05-08T18:34:07.196723+0000","last_clean":"2024-05-08T18:34:07.196723+0000","last_became_active":"2024-05-08T18:31:00.295749+0000","last_became_peered":"2024-05-08T18:31:00.295749+0000","last_unstale":"2024-05-08T18:34:07.196723+0000","last_undegraded":"2024-05-08T18:34:07.196723+0000","last_fullsized":"2024-05-08T18:34:07.196723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:10.083894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'5","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.177037+0000","last_change":"2024-05-08T18:30:58.316506+0000","last_active":"2024-05-08T18:33:03.177037+0000","last_peered":"2024-05-08T18:33:03.177037+0000","last_clean":"2024-05-08T18:33:03.177037+0000","last_became_active":"2024-05-08T18:30:58.314786+0000","last_became_peered":"2024-05-08T18:30:58.314786+0000","last_unstale":"2024-05-08T18:33:03.177037+0000","last_undegraded":"2024-05-08T18:33:03.177037+0000","last_fullsized":"2024-05-08T18:33:03.177037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:18.913736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'11","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.283079+0000","last_change":"2024-05-08T18:31:00.283309+0000","last_active":"2024-05-08T18:34:07.283079+0000","last_peered":"2024-05-08T18:34:07.283079+0000","last_clean":"2024-05-08T18:34:07.283079+0000","last_became_active":"2024-05-08T18:31:00.282863+0000","last_became_peered":"2024-05-08T18:31:00.282863+0000","last_unstale":"2024-05-08T18:34:07.283079+0000","last_undegraded":"2024-05-08T18:34:07.283079+0000","last_fullsized":"2024-05-08T18:34:07.283079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:55.191334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'3","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.671656+0000","last_change":"2024-05-08T18:30:58.289717+0000","last_active":"2024-05-08T18:32:22.671656+0000","last_peered":"2024-05-08T18:32:22.671656+0000","last_clean":"2024-05-08T18:32:22.671656+0000","last_became_active":"2024-05-08T18:30:58.289337+0000","last_became_peered":"2024-05-08T18:30:58.289337+0000","last_unstale":"2024-05-08T18:32:22.671656+0000","last_undegraded":"2024-05-08T18:32:22.671656+0000","last_fullsized":"2024-05-08T18:32:22.671656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:38.049573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.581291+0000","last_change":"2024-05-08T18:31:00.291487+0000","last_active":"2024-05-08T18:33:06.581291+0000","last_peered":"2024-05-08T18:33:06.581291+0000","last_clean":"2024-05-08T18:33:06.581291+0000","last_became_active":"2024-05-08T18:31:00.291269+0000","last_became_peered":"2024-05-08T18:31:00.291269+0000","last_unstale":"2024-05-08T18:33:06.581291+0000","last_undegraded":"2024-05-08T18:33:06.581291+0000","last_fullsized":"2024-05-08T18:33:06.581291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:30.009947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330816+0000","last_change":"2024-05-08T18:30:58.285778+0000","last_active":"2024-05-08T18:31:45.330816+0000","last_peered":"2024-05-08T18:31:45.330816+0000","last_clean":"2024-05-08T18:31:45.330816+0000","last_became_active":"2024-05-08T18:30:58.283976+0000","last_became_peered":"2024-05-08T18:30:58.283976+0000","last_unstale":"2024-05-08T18:31:45.330816+0000","last_undegraded":"2024-05-08T18:31:45.330816+0000","last_fullsized":"2024-05-08T18:31:45.330816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:23:31.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.202924+0000","last_change":"2024-05-08T18:31:00.292666+0000","last_active":"2024-05-08T18:34:07.202924+0000","last_peered":"2024-05-08T18:34:07.202924+0000","last_clean":"2024-05-08T18:34:07.202924+0000","last_became_active":"2024-05-08T18:31:00.292385+0000","last_became_peered":"2024-05-08T18:31:00.292385+0000","last_unstale":"2024-05-08T18:34:07.202924+0000","last_undegraded":"2024-05-08T18:34:07.202924+0000","last_fullsized":"2024-05-08T18:34:07.202924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:36.076362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.860195+0000","last_change":"2024-05-08T18:30:58.304478+0000","last_active":"2024-05-08T18:32:22.860195+0000","last_peered":"2024-05-08T18:32:22.860195+0000","last_clean":"2024-05-08T18:32:22.860195+0000","last_became_active":"2024-05-08T18:30:58.303839+0000","last_became_peered":"2024-05-08T18:30:58.303839+0000","last_unstale":"2024-05-08T18:32:22.860195+0000","last_undegraded":"2024-05-08T18:32:22.860195+0000","last_fullsized":"2024-05-08T18:32:22.860195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:23:31.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'8","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.965732+0000","last_change":"2024-05-08T18:31:00.288783+0000","last_active":"2024-05-08T18:34:06.965732+0000","last_peered":"2024-05-08T18:34:06.965732+0000","last_clean":"2024-05-08T18:34:06.965732+0000","last_became_active":"2024-05-08T18:31:00.288202+0000","last_became_peered":"2024-05-08T18:31:00.288202+0000","last_unstale":"2024-05-08T18:34:06.965732+0000","last_undegraded":"2024-05-08T18:34:06.965732+0000","last_fullsized":"2024-05-08T18:34:06.965732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:54.772566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336793+0000","last_change":"2024-05-08T18:30:58.305905+0000","last_active":"2024-05-08T18:31:45.336793+0000","last_peered":"2024-05-08T18:31:45.336793+0000","last_clean":"2024-05-08T18:31:45.336793+0000","last_became_active":"2024-05-08T18:30:58.305116+0000","last_became_peered":"2024-05-08T18:30:58.305116+0000","last_unstale":"2024-05-08T18:31:45.336793+0000","last_undegraded":"2024-05-08T18:31:45.336793+0000","last_fullsized":"2024-05-08T18:31:45.336793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:11.650120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.581054+0000","last_change":"2024-05-08T18:31:00.285833+0000","last_active":"2024-05-08T18:33:06.581054+0000","last_peered":"2024-05-08T18:33:06.581054+0000","last_clean":"2024-05-08T18:33:06.581054+0000","last_became_active":"2024-05-08T18:31:00.284439+0000","last_became_peered":"2024-05-08T18:31:00.284439+0000","last_unstale":"2024-05-08T18:33:06.581054+0000","last_undegraded":"2024-05-08T18:33:06.581054+0000","last_fullsized":"2024-05-08T18:33:06.581054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:21.913096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.265892+0000","last_change":"2024-05-08T18:30:58.287850+0000","last_active":"2024-05-08T18:34:07.265892+0000","last_peered":"2024-05-08T18:34:07.265892+0000","last_clean":"2024-05-08T18:34:07.265892+0000","last_became_active":"2024-05-08T18:30:58.286930+0000","last_became_peered":"2024-05-08T18:30:58.286930+0000","last_unstale":"2024-05-08T18:34:07.265892+0000","last_undegraded":"2024-05-08T18:34:07.265892+0000","last_fullsized":"2024-05-08T18:34:07.265892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:33.986082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.964490+0000","last_change":"2024-05-08T18:31:00.283948+0000","last_active":"2024-05-08T18:34:06.964490+0000","last_peered":"2024-05-08T18:34:06.964490+0000","last_clean":"2024-05-08T18:34:06.964490+0000","last_became_active":"2024-05-08T18:31:00.282958+0000","last_became_peered":"2024-05-08T18:31:00.282958+0000","last_unstale":"2024-05-08T18:34:06.964490+0000","last_undegraded":"2024-05-08T18:34:06.964490+0000","last_fullsized":"2024-05-08T18:34:06.964490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:41.064447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328195+0000","last_change":"2024-05-08T18:30:58.305701+0000","last_active":"2024-05-08T18:31:45.328195+0000","last_peered":"2024-05-08T18:31:45.328195+0000","last_clean":"2024-05-08T18:31:45.328195+0000","last_became_active":"2024-05-08T18:30:58.302051+0000","last_became_peered":"2024-05-08T18:30:58.302051+0000","last_unstale":"2024-05-08T18:31:45.328195+0000","last_undegraded":"2024-05-08T18:31:45.328195+0000","last_fullsized":"2024-05-08T18:31:45.328195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:52.764644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332860+0000","last_change":"2024-05-08T18:31:00.299248+0000","last_active":"2024-05-08T18:31:45.332860+0000","last_peered":"2024-05-08T18:31:45.332860+0000","last_clean":"2024-05-08T18:31:45.332860+0000","last_became_active":"2024-05-08T18:31:00.297787+0000","last_became_peered":"2024-05-08T18:31:00.297787+0000","last_unstale":"2024-05-08T18:31:45.332860+0000","last_undegraded":"2024-05-08T18:31:45.332860+0000","last_fullsized":"2024-05-08T18:31:45.332860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:40.412419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.190202+0000","last_change":"2024-05-08T18:30:58.285595+0000","last_active":"2024-05-08T18:34:07.190202+0000","last_peered":"2024-05-08T18:34:07.190202+0000","last_clean":"2024-05-08T18:34:07.190202+0000","last_became_active":"2024-05-08T18:30:58.284146+0000","last_became_peered":"2024-05-08T18:30:58.284146+0000","last_unstale":"2024-05-08T18:34:07.190202+0000","last_undegraded":"2024-05-08T18:34:07.190202+0000","last_fullsized":"2024-05-08T18:34:07.190202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:25.031288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'12","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.242555+0000","last_change":"2024-05-08T18:31:00.291767+0000","last_active":"2024-05-08T18:34:07.242555+0000","last_peered":"2024-05-08T18:34:07.242555+0000","last_clean":"2024-05-08T18:34:07.242555+0000","last_became_active":"2024-05-08T18:31:00.291399+0000","last_became_peered":"2024-05-08T18:31:00.291399+0000","last_unstale":"2024-05-08T18:34:07.242555+0000","last_undegraded":"2024-05-08T18:34:07.242555+0000","last_fullsized":"2024-05-08T18:34:07.242555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:29.461384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.177075+0000","last_change":"2024-05-08T18:30:58.305891+0000","last_active":"2024-05-08T18:34:07.177075+0000","last_peered":"2024-05-08T18:34:07.177075+0000","last_clean":"2024-05-08T18:34:07.177075+0000","last_became_active":"2024-05-08T18:30:58.305523+0000","last_became_peered":"2024-05-08T18:30:58.305523+0000","last_unstale":"2024-05-08T18:34:07.177075+0000","last_undegraded":"2024-05-08T18:34:07.177075+0000","last_fullsized":"2024-05-08T18:34:07.177075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:38.049573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'14","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196828+0000","last_change":"2024-05-08T18:31:00.281500+0000","last_active":"2024-05-08T18:34:07.196828+0000","last_peered":"2024-05-08T18:34:07.196828+0000","last_clean":"2024-05-08T18:34:07.196828+0000","last_became_active":"2024-05-08T18:31:00.281199+0000","last_became_peered":"2024-05-08T18:31:00.281199+0000","last_unstale":"2024-05-08T18:34:07.196828+0000","last_undegraded":"2024-05-08T18:34:07.196828+0000","last_fullsized":"2024-05-08T18:34:07.196828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:40:39.970400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333475+0000","last_change":"2024-05-08T18:30:58.302582+0000","last_active":"2024-05-08T18:31:45.333475+0000","last_peered":"2024-05-08T18:31:45.333475+0000","last_clean":"2024-05-08T18:31:45.333475+0000","last_became_active":"2024-05-08T18:30:58.302218+0000","last_became_peered":"2024-05-08T18:30:58.302218+0000","last_unstale":"2024-05-08T18:31:45.333475+0000","last_undegraded":"2024-05-08T18:31:45.333475+0000","last_fullsized":"2024-05-08T18:31:45.333475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:25.031288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.057640+0000","last_change":"2024-05-08T18:31:00.294447+0000","last_active":"2024-05-08T18:34:07.057640+0000","last_peered":"2024-05-08T18:34:07.057640+0000","last_clean":"2024-05-08T18:34:07.057640+0000","last_became_active":"2024-05-08T18:31:00.294146+0000","last_became_peered":"2024-05-08T18:31:00.294146+0000","last_unstale":"2024-05-08T18:34:07.057640+0000","last_undegraded":"2024-05-08T18:34:07.057640+0000","last_fullsized":"2024-05-08T18:34:07.057640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:01.629372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329386+0000","last_change":"2024-05-08T18:30:58.317135+0000","last_active":"2024-05-08T18:31:45.329386+0000","last_peered":"2024-05-08T18:31:45.329386+0000","last_clean":"2024-05-08T18:31:45.329386+0000","last_became_active":"2024-05-08T18:30:58.314388+0000","last_became_peered":"2024-05-08T18:30:58.314388+0000","last_unstale":"2024-05-08T18:31:45.329386+0000","last_undegraded":"2024-05-08T18:31:45.329386+0000","last_fullsized":"2024-05-08T18:31:45.329386+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:19:16.450109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.239867+0000","last_change":"2024-05-08T18:31:00.283542+0000","last_active":"2024-05-08T18:34:07.239867+0000","last_peered":"2024-05-08T18:34:07.239867+0000","last_clean":"2024-05-08T18:34:07.239867+0000","last_became_active":"2024-05-08T18:31:00.281847+0000","last_became_peered":"2024-05-08T18:31:00.281847+0000","last_unstale":"2024-05-08T18:34:07.239867+0000","last_undegraded":"2024-05-08T18:34:07.239867+0000","last_fullsized":"2024-05-08T18:34:07.239867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:57.459641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330545+0000","last_change":"2024-05-08T18:30:58.309703+0000","last_active":"2024-05-08T18:31:45.330545+0000","last_peered":"2024-05-08T18:31:45.330545+0000","last_clean":"2024-05-08T18:31:45.330545+0000","last_became_active":"2024-05-08T18:30:58.309203+0000","last_became_peered":"2024-05-08T18:30:58.309203+0000","last_unstale":"2024-05-08T18:31:45.330545+0000","last_undegraded":"2024-05-08T18:31:45.330545+0000","last_fullsized":"2024-05-08T18:31:45.330545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:16.366334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'16","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.197060+0000","last_change":"2024-05-08T18:31:00.296525+0000","last_active":"2024-05-08T18:34:07.197060+0000","last_peered":"2024-05-08T18:34:07.197060+0000","last_clean":"2024-05-08T18:34:07.197060+0000","last_became_active":"2024-05-08T18:31:00.296240+0000","last_became_peered":"2024-05-08T18:31:00.296240+0000","last_unstale":"2024-05-08T18:34:07.197060+0000","last_undegraded":"2024-05-08T18:34:07.197060+0000","last_fullsized":"2024-05-08T18:34:07.197060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:42.486383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337097+0000","last_change":"2024-05-08T18:30:58.306151+0000","last_active":"2024-05-08T18:31:45.337097+0000","last_peered":"2024-05-08T18:31:45.337097+0000","last_clean":"2024-05-08T18:31:45.337097+0000","last_became_active":"2024-05-08T18:30:58.305572+0000","last_became_peered":"2024-05-08T18:30:58.305572+0000","last_unstale":"2024-05-08T18:31:45.337097+0000","last_undegraded":"2024-05-08T18:31:45.337097+0000","last_fullsized":"2024-05-08T18:31:45.337097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:56.618771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.240162+0000","last_change":"2024-05-08T18:31:00.283388+0000","last_active":"2024-05-08T18:34:07.240162+0000","last_peered":"2024-05-08T18:34:07.240162+0000","last_clean":"2024-05-08T18:34:07.240162+0000","last_became_active":"2024-05-08T18:31:00.282414+0000","last_became_peered":"2024-05-08T18:31:00.282414+0000","last_unstale":"2024-05-08T18:34:07.240162+0000","last_undegraded":"2024-05-08T18:34:07.240162+0000","last_fullsized":"2024-05-08T18:34:07.240162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:56.345475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.179636+0000","last_change":"2024-05-08T18:30:58.308682+0000","last_active":"2024-05-08T18:33:18.179636+0000","last_peered":"2024-05-08T18:33:18.179636+0000","last_clean":"2024-05-08T18:33:18.179636+0000","last_became_active":"2024-05-08T18:30:58.304591+0000","last_became_peered":"2024-05-08T18:30:58.304591+0000","last_unstale":"2024-05-08T18:33:18.179636+0000","last_undegraded":"2024-05-08T18:33:18.179636+0000","last_fullsized":"2024-05-08T18:33:18.179636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:40.162258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.180377+0000","last_change":"2024-05-08T18:30:58.304754+0000","last_active":"2024-05-08T18:34:07.180377+0000","last_peered":"2024-05-08T18:34:07.180377+0000","last_clean":"2024-05-08T18:34:07.180377+0000","last_became_active":"2024-05-08T18:30:58.303443+0000","last_became_peered":"2024-05-08T18:30:58.303443+0000","last_unstale":"2024-05-08T18:34:07.180377+0000","last_undegraded":"2024-05-08T18:34:07.180377+0000","last_fullsized":"2024-05-08T18:34:07.180377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:56.525015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'11","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.248139+0000","last_change":"2024-05-08T18:31:00.288619+0000","last_active":"2024-05-08T18:34:07.248139+0000","last_peered":"2024-05-08T18:34:07.248139+0000","last_clean":"2024-05-08T18:34:07.248139+0000","last_became_active":"2024-05-08T18:31:00.288250+0000","last_became_peered":"2024-05-08T18:31:00.288250+0000","last_unstale":"2024-05-08T18:34:07.248139+0000","last_undegraded":"2024-05-08T18:34:07.248139+0000","last_fullsized":"2024-05-08T18:34:07.248139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:58.735465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329134+0000","last_change":"2024-05-08T18:30:58.285795+0000","last_active":"2024-05-08T18:31:45.329134+0000","last_peered":"2024-05-08T18:31:45.329134+0000","last_clean":"2024-05-08T18:31:45.329134+0000","last_became_active":"2024-05-08T18:30:58.284090+0000","last_became_peered":"2024-05-08T18:30:58.284090+0000","last_unstale":"2024-05-08T18:31:45.329134+0000","last_undegraded":"2024-05-08T18:31:45.329134+0000","last_fullsized":"2024-05-08T18:31:45.329134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:56.618771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337379+0000","last_change":"2024-05-08T18:31:00.291942+0000","last_active":"2024-05-08T18:31:45.337379+0000","last_peered":"2024-05-08T18:31:45.337379+0000","last_clean":"2024-05-08T18:31:45.337379+0000","last_became_active":"2024-05-08T18:31:00.291650+0000","last_became_peered":"2024-05-08T18:31:00.291650+0000","last_unstale":"2024-05-08T18:31:45.337379+0000","last_undegraded":"2024-05-08T18:31:45.337379+0000","last_fullsized":"2024-05-08T18:31:45.337379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:49:50.681202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705708,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44172,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327668,"statfs":{"total":96636764160,"available":96591532032,"internally_reserved":0,"allocated":9048064,"data_stored":8743598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44688,"kb_used_data":9352,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327152,"statfs":{"total":96636764160,"available":96591003648,"internally_reserved":0,"allocated":9576448,"data_stored":9329841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44708,"kb_used_data":9372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327132,"statfs":{"total":96636764160,"available":96590983168,"internally_reserved":0,"allocated":9596928,"data_stored":9330329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705707,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":8808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":9019392,"data_stored":8742450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:34:14.727 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T18:34:14.727 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:34:14.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.858+0000 7f4883154640 1 Processor -- start 2024-05-08T18:34:14.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.858+0000 7f4883154640 1 -- start start 2024-05-08T18:34:14.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.858+0000 7f4883154640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f487c12d1b0 0x7f487c12d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:14.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.858+0000 7f4883154640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f487c12d590 con 0x7f487c12dda0 2024-05-08T18:34:14.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.858+0000 7f4883154640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f487c114de0 con 0x7f487c12d1b0 2024-05-08T18:34:14.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.859+0000 7f4880ef0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f487c12d1b0 0x7f487c12d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:14.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.859+0000 7f4880ef0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f487c12d1b0 0x7f487c12d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41118/0 (socket says 172.21.15.53:41118) 2024-05-08T18:34:14.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.859+0000 7f4880ef0640 1 -- 172.21.15.53:0/2717762240 learned_addr learned my addr 172.21.15.53:0/2717762240 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:34:14.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.859+0000 7f487bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f487c12dda0 0x7f487c129c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40950/0 (socket says 172.21.15.53:40950) 2024-05-08T18:34:14.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.859+0000 7f4880ef0640 1 -- 172.21.15.53:0/2717762240 >> v1:172.21.15.53:6789/0 conn(0x7f487c12dda0 legacy=0x7f487c129c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:14.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.859+0000 7f4880ef0640 1 -- 172.21.15.53:0/2717762240 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487c113c30 con 0x7f487c12d1b0 2024-05-08T18:34:14.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.860+0000 7f4880ef0640 1 --2- 172.21.15.53:0/2717762240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f487c12d1b0 0x7f487c12d860 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f48700097f0 tx=0x7f487002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e884ce592e6832 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:14.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.860+0000 7f487b7fe640 1 -- 172.21.15.53:0/2717762240 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4870035020 con 0x7f487c12d1b0 2024-05-08T18:34:14.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.860+0000 7f487b7fe640 1 -- 172.21.15.53:0/2717762240 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48700317a0 con 0x7f487c12d1b0 2024-05-08T18:34:14.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.860+0000 7f487b7fe640 1 -- 172.21.15.53:0/2717762240 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4870031aa0 con 0x7f487c12d1b0 2024-05-08T18:34:14.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.860+0000 7f4883154640 1 -- 172.21.15.53:0/2717762240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f487c12d1b0 msgr2=0x7f487c12d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:14.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.860+0000 7f4883154640 1 --2- 172.21.15.53:0/2717762240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f487c12d1b0 0x7f487c12d860 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f48700097f0 tx=0x7f487002b910 comp rx=0 tx=0).stop 2024-05-08T18:34:14.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.860+0000 7f4883154640 1 -- 172.21.15.53:0/2717762240 shutdown_connections 2024-05-08T18:34:14.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.860+0000 7f4883154640 1 --2- 172.21.15.53:0/2717762240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f487c12d1b0 0x7f487c12d860 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:14.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.860+0000 7f4883154640 1 -- 172.21.15.53:0/2717762240 >> 172.21.15.53:0/2717762240 conn(0x7f487c09a910 msgr2=0x7f487c06e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:14.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.860+0000 7f4883154640 1 -- 172.21.15.53:0/2717762240 shutdown_connections 2024-05-08T18:34:14.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.860+0000 7f4883154640 1 -- 172.21.15.53:0/2717762240 wait complete. 2024-05-08T18:34:14.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.861+0000 7f4883154640 1 Processor -- start 2024-05-08T18:34:14.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.861+0000 7f4883154640 1 -- start start 2024-05-08T18:34:14.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.862+0000 7f4883154640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f487c12d1b0 0x7f487c1c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:14.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.862+0000 7f4883154640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f487c12a6d0 con 0x7f487c12d1b0 2024-05-08T18:34:14.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.862+0000 7f4880ef0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f487c12d1b0 0x7f487c1c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:14.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.862+0000 7f4880ef0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f487c12d1b0 0x7f487c1c43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41130/0 (socket says 172.21.15.53:41130) 2024-05-08T18:34:14.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.862+0000 7f4880ef0640 1 -- 172.21.15.53:0/963451357 learned_addr learned my addr 172.21.15.53:0/963451357 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:34:14.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.862+0000 7f4880ef0640 1 -- 172.21.15.53:0/963451357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487c11c1c0 con 0x7f487c12d1b0 2024-05-08T18:34:14.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.862+0000 7f4880ef0640 1 --2- 172.21.15.53:0/963451357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f487c12d1b0 0x7f487c1c43c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f48700097f0 tx=0x7f48700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:14.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.862+0000 7f48797fa640 1 -- 172.21.15.53:0/963451357 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f487003acb0 con 0x7f487c12d1b0 2024-05-08T18:34:14.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.862+0000 7f48797fa640 1 -- 172.21.15.53:0/963451357 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487003ae50 con 0x7f487c12d1b0 2024-05-08T18:34:14.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.862+0000 7f4883154640 1 -- 172.21.15.53:0/963451357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f487c11c550 con 0x7f487c12d1b0 2024-05-08T18:34:14.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.862+0000 7f48797fa640 1 -- 172.21.15.53:0/963451357 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4870044520 con 0x7f487c12d1b0 2024-05-08T18:34:14.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.862+0000 7f4883154640 1 -- 172.21.15.53:0/963451357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f487c0732a0 con 0x7f487c12d1b0 2024-05-08T18:34:14.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.863+0000 7f48797fa640 1 -- 172.21.15.53:0/963451357 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f487004b060 con 0x7f487c12d1b0 2024-05-08T18:34:14.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.863+0000 7f4883154640 1 -- 172.21.15.53:0/963451357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f487c064010 con 0x7f487c12d1b0 2024-05-08T18:34:14.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.864+0000 7f48797fa640 1 --2- 172.21.15.53:0/963451357 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f486003d2b0 0x7f486003f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:14.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.864+0000 7f48797fa640 1 -- 172.21.15.53:0/963451357 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f4870074060 con 0x7f487c12d1b0 2024-05-08T18:34:14.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.864+0000 7f487bfff640 1 --2- 172.21.15.53:0/963451357 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f486003d2b0 0x7f486003f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:14.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.864+0000 7f487bfff640 1 --2- 172.21.15.53:0/963451357 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f486003d2b0 0x7f486003f770 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f48680015f0 tx=0x7f4868007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:14.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:14.868+0000 7f48797fa640 1 -- 172.21.15.53:0/963451357 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f487003f070 con 0x7f487c12d1b0 2024-05-08T18:34:15.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.053+0000 7f4883154640 1 -- 172.21.15.53:0/963451357 --> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f487c072b00 con 0x7f486003d2b0 2024-05-08T18:34:15.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.068+0000 7f48797fa640 1 -- 172.21.15.53:0/963451357 <== mgr.4102 v2:172.21.15.87:6824/211215191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665928 (secure 0 0 0) 0x7f487c072b00 con 0x7f486003d2b0 2024-05-08T18:34:15.074 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:34:15.080 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:34:15.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.073+0000 7f4883154640 1 -- 172.21.15.53:0/963451357 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f486003d2b0 msgr2=0x7f486003f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:15.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.073+0000 7f4883154640 1 --2- 172.21.15.53:0/963451357 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f486003d2b0 0x7f486003f770 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f48680015f0 tx=0x7f4868007a40 comp rx=0 tx=0).stop 2024-05-08T18:34:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.073+0000 7f4883154640 1 -- 172.21.15.53:0/963451357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f487c12d1b0 msgr2=0x7f487c1c43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.073+0000 7f4883154640 1 --2- 172.21.15.53:0/963451357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f487c12d1b0 0x7f487c1c43c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f48700097f0 tx=0x7f48700046c0 comp rx=0 tx=0).stop 2024-05-08T18:34:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.073+0000 7f4883154640 1 -- 172.21.15.53:0/963451357 shutdown_connections 2024-05-08T18:34:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.073+0000 7f4883154640 1 --2- 172.21.15.53:0/963451357 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f486003d2b0 0x7f486003f770 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.073+0000 7f4883154640 1 --2- 172.21.15.53:0/963451357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f487c12d1b0 0x7f487c1c43c0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.073+0000 7f4883154640 1 -- 172.21.15.53:0/963451357 >> 172.21.15.53:0/963451357 conn(0x7f487c09a910 msgr2=0x7f487c06f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.073+0000 7f4883154640 1 -- 172.21.15.53:0/963451357 shutdown_connections 2024-05-08T18:34:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.073+0000 7f4883154640 1 -- 172.21.15.53:0/963451357 wait complete. 2024-05-08T18:34:15.083 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-05-08T18:34:14.164174+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416885,"num_objects":227,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4839,"num_read_kb":4421,"num_write":2046,"num_write_kb":60584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4431,"ondisk_log_size":4431,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":173552,"kb_used_data":36368,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377313808,"statfs":{"total":386547056640,"available":386369339392,"internally_reserved":0,"allocated":37240832,"data_stored":36146218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815783,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003684"},"pg_stats":[{"pgid":"3.3f","version":"29'3","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176450+0000","last_change":"2024-05-08T18:30:58.305519+0000","last_active":"2024-05-08T18:33:03.176450+0000","last_peered":"2024-05-08T18:33:03.176450+0000","last_clean":"2024-05-08T18:33:03.176450+0000","last_became_active":"2024-05-08T18:30:58.305175+0000","last_became_peered":"2024-05-08T18:30:58.305175+0000","last_unstale":"2024-05-08T18:33:03.176450+0000","last_undegraded":"2024-05-08T18:33:03.176450+0000","last_fullsized":"2024-05-08T18:33:03.176450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:04.148371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271698+0000","last_change":"2024-05-08T18:31:00.285719+0000","last_active":"2024-05-08T18:34:07.271698+0000","last_peered":"2024-05-08T18:34:07.271698+0000","last_clean":"2024-05-08T18:34:07.271698+0000","last_became_active":"2024-05-08T18:31:00.284574+0000","last_became_peered":"2024-05-08T18:31:00.284574+0000","last_unstale":"2024-05-08T18:34:07.271698+0000","last_undegraded":"2024-05-08T18:34:07.271698+0000","last_fullsized":"2024-05-08T18:34:07.271698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:40.256644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331029+0000","last_change":"2024-05-08T18:30:58.289175+0000","last_active":"2024-05-08T18:31:45.331029+0000","last_peered":"2024-05-08T18:31:45.331029+0000","last_clean":"2024-05-08T18:31:45.331029+0000","last_became_active":"2024-05-08T18:30:58.288674+0000","last_became_peered":"2024-05-08T18:30:58.288674+0000","last_unstale":"2024-05-08T18:31:45.331029+0000","last_undegraded":"2024-05-08T18:31:45.331029+0000","last_fullsized":"2024-05-08T18:31:45.331029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:34.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329085+0000","last_change":"2024-05-08T18:31:00.299098+0000","last_active":"2024-05-08T18:31:45.329085+0000","last_peered":"2024-05-08T18:31:45.329085+0000","last_clean":"2024-05-08T18:31:45.329085+0000","last_became_active":"2024-05-08T18:31:00.298145+0000","last_became_peered":"2024-05-08T18:31:00.298145+0000","last_unstale":"2024-05-08T18:31:45.329085+0000","last_undegraded":"2024-05-08T18:31:45.329085+0000","last_fullsized":"2024-05-08T18:31:45.329085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:38.415030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331384+0000","last_change":"2024-05-08T18:30:58.306369+0000","last_active":"2024-05-08T18:31:45.331384+0000","last_peered":"2024-05-08T18:31:45.331384+0000","last_clean":"2024-05-08T18:31:45.331384+0000","last_became_active":"2024-05-08T18:30:58.304442+0000","last_became_peered":"2024-05-08T18:30:58.304442+0000","last_unstale":"2024-05-08T18:31:45.331384+0000","last_undegraded":"2024-05-08T18:31:45.331384+0000","last_fullsized":"2024-05-08T18:31:45.331384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:28.002025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328805+0000","last_change":"2024-05-08T18:31:00.298725+0000","last_active":"2024-05-08T18:31:45.328805+0000","last_peered":"2024-05-08T18:31:45.328805+0000","last_clean":"2024-05-08T18:31:45.328805+0000","last_became_active":"2024-05-08T18:31:00.297810+0000","last_became_peered":"2024-05-08T18:31:00.297810+0000","last_unstale":"2024-05-08T18:31:45.328805+0000","last_undegraded":"2024-05-08T18:31:45.328805+0000","last_fullsized":"2024-05-08T18:31:45.328805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:59.418481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330833+0000","last_change":"2024-05-08T18:30:58.295957+0000","last_active":"2024-05-08T18:31:45.330833+0000","last_peered":"2024-05-08T18:31:45.330833+0000","last_clean":"2024-05-08T18:31:45.330833+0000","last_became_active":"2024-05-08T18:30:58.295569+0000","last_became_peered":"2024-05-08T18:30:58.295569+0000","last_unstale":"2024-05-08T18:31:45.330833+0000","last_undegraded":"2024-05-08T18:31:45.330833+0000","last_fullsized":"2024-05-08T18:31:45.330833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:23:31.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271931+0000","last_change":"2024-05-08T18:31:00.296029+0000","last_active":"2024-05-08T18:34:07.271931+0000","last_peered":"2024-05-08T18:34:07.271931+0000","last_clean":"2024-05-08T18:34:07.271931+0000","last_became_active":"2024-05-08T18:31:00.295611+0000","last_became_peered":"2024-05-08T18:31:00.295611+0000","last_unstale":"2024-05-08T18:34:07.271931+0000","last_undegraded":"2024-05-08T18:34:07.271931+0000","last_fullsized":"2024-05-08T18:34:07.271931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:48.739053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328670+0000","last_change":"2024-05-08T18:30:58.313349+0000","last_active":"2024-05-08T18:31:45.328670+0000","last_peered":"2024-05-08T18:31:45.328670+0000","last_clean":"2024-05-08T18:31:45.328670+0000","last_became_active":"2024-05-08T18:30:58.313003+0000","last_became_peered":"2024-05-08T18:30:58.313003+0000","last_unstale":"2024-05-08T18:31:45.328670+0000","last_undegraded":"2024-05-08T18:31:45.328670+0000","last_fullsized":"2024-05-08T18:31:45.328670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:28.678138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'4","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.338700+0000","last_change":"2024-05-08T18:31:00.281345+0000","last_active":"2024-05-08T18:31:45.338700+0000","last_peered":"2024-05-08T18:31:45.338700+0000","last_clean":"2024-05-08T18:31:45.338700+0000","last_became_active":"2024-05-08T18:31:00.281065+0000","last_became_peered":"2024-05-08T18:31:00.281065+0000","last_unstale":"2024-05-08T18:31:45.338700+0000","last_undegraded":"2024-05-08T18:31:45.338700+0000","last_fullsized":"2024-05-08T18:31:45.338700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:58.735465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.335229+0000","last_change":"2024-05-08T18:30:58.308072+0000","last_active":"2024-05-08T18:31:45.335229+0000","last_peered":"2024-05-08T18:31:45.335229+0000","last_clean":"2024-05-08T18:31:45.335229+0000","last_became_active":"2024-05-08T18:30:58.307687+0000","last_became_peered":"2024-05-08T18:30:58.307687+0000","last_unstale":"2024-05-08T18:31:45.335229+0000","last_undegraded":"2024-05-08T18:31:45.335229+0000","last_fullsized":"2024-05-08T18:31:45.335229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:33.986082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.966056+0000","last_change":"2024-05-08T18:31:00.299642+0000","last_active":"2024-05-08T18:34:06.966056+0000","last_peered":"2024-05-08T18:34:06.966056+0000","last_clean":"2024-05-08T18:34:06.966056+0000","last_became_active":"2024-05-08T18:31:00.298978+0000","last_became_peered":"2024-05-08T18:31:00.298978+0000","last_unstale":"2024-05-08T18:34:06.966056+0000","last_undegraded":"2024-05-08T18:34:06.966056+0000","last_fullsized":"2024-05-08T18:34:06.966056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:30.577543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328768+0000","last_change":"2024-05-08T18:30:58.309859+0000","last_active":"2024-05-08T18:31:45.328768+0000","last_peered":"2024-05-08T18:31:45.328768+0000","last_clean":"2024-05-08T18:31:45.328768+0000","last_became_active":"2024-05-08T18:30:58.308931+0000","last_became_peered":"2024-05-08T18:30:58.308931+0000","last_unstale":"2024-05-08T18:31:45.328768+0000","last_undegraded":"2024-05-08T18:31:45.328768+0000","last_fullsized":"2024-05-08T18:31:45.328768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:40:28.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'7","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.333875+0000","last_change":"2024-05-08T18:31:00.295747+0000","last_active":"2024-05-08T18:34:07.333875+0000","last_peered":"2024-05-08T18:34:07.333875+0000","last_clean":"2024-05-08T18:34:07.333875+0000","last_became_active":"2024-05-08T18:31:00.295472+0000","last_became_peered":"2024-05-08T18:31:00.295472+0000","last_unstale":"2024-05-08T18:34:07.333875+0000","last_undegraded":"2024-05-08T18:34:07.333875+0000","last_fullsized":"2024-05-08T18:34:07.333875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:40.256644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329487+0000","last_change":"2024-05-08T18:30:58.295024+0000","last_active":"2024-05-08T18:31:45.329487+0000","last_peered":"2024-05-08T18:31:45.329487+0000","last_clean":"2024-05-08T18:31:45.329487+0000","last_became_active":"2024-05-08T18:30:58.294511+0000","last_became_peered":"2024-05-08T18:30:58.294511+0000","last_unstale":"2024-05-08T18:31:45.329487+0000","last_undegraded":"2024-05-08T18:31:45.329487+0000","last_fullsized":"2024-05-08T18:31:45.329487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:33.046479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.581305+0000","last_change":"2024-05-08T18:31:00.291471+0000","last_active":"2024-05-08T18:33:06.581305+0000","last_peered":"2024-05-08T18:33:06.581305+0000","last_clean":"2024-05-08T18:33:06.581305+0000","last_became_active":"2024-05-08T18:31:00.291203+0000","last_became_peered":"2024-05-08T18:31:00.291203+0000","last_unstale":"2024-05-08T18:33:06.581305+0000","last_undegraded":"2024-05-08T18:33:06.581305+0000","last_fullsized":"2024-05-08T18:33:06.581305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:21.913096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196716+0000","last_change":"2024-05-08T18:31:00.291351+0000","last_active":"2024-05-08T18:34:07.196716+0000","last_peered":"2024-05-08T18:34:07.196716+0000","last_clean":"2024-05-08T18:34:07.196716+0000","last_became_active":"2024-05-08T18:31:00.290806+0000","last_became_peered":"2024-05-08T18:31:00.290806+0000","last_unstale":"2024-05-08T18:34:07.196716+0000","last_undegraded":"2024-05-08T18:34:07.196716+0000","last_fullsized":"2024-05-08T18:34:07.196716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:21:46.897549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.919314+0000","last_change":"2024-05-08T18:30:58.305311+0000","last_active":"2024-05-08T18:34:06.919314+0000","last_peered":"2024-05-08T18:34:06.919314+0000","last_clean":"2024-05-08T18:34:06.919314+0000","last_became_active":"2024-05-08T18:30:58.304685+0000","last_became_peered":"2024-05-08T18:30:58.304685+0000","last_unstale":"2024-05-08T18:34:06.919314+0000","last_undegraded":"2024-05-08T18:34:06.919314+0000","last_fullsized":"2024-05-08T18:34:06.919314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:11.650120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'14","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.335357+0000","last_change":"2024-05-08T18:31:00.283453+0000","last_active":"2024-05-08T18:31:45.335357+0000","last_peered":"2024-05-08T18:31:45.335357+0000","last_clean":"2024-05-08T18:31:45.335357+0000","last_became_active":"2024-05-08T18:31:00.281816+0000","last_became_peered":"2024-05-08T18:31:00.281816+0000","last_unstale":"2024-05-08T18:31:45.335357+0000","last_undegraded":"2024-05-08T18:31:45.335357+0000","last_fullsized":"2024-05-08T18:31:45.335357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:29.461384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337199+0000","last_change":"2024-05-08T18:30:58.307205+0000","last_active":"2024-05-08T18:31:45.337199+0000","last_peered":"2024-05-08T18:31:45.337199+0000","last_clean":"2024-05-08T18:31:45.337199+0000","last_became_active":"2024-05-08T18:30:58.306545+0000","last_became_peered":"2024-05-08T18:30:58.306545+0000","last_unstale":"2024-05-08T18:31:45.337199+0000","last_undegraded":"2024-05-08T18:31:45.337199+0000","last_fullsized":"2024-05-08T18:31:45.337199+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:33.046479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.272025+0000","last_change":"2024-05-08T18:31:00.283417+0000","last_active":"2024-05-08T18:34:07.272025+0000","last_peered":"2024-05-08T18:34:07.272025+0000","last_clean":"2024-05-08T18:34:07.272025+0000","last_became_active":"2024-05-08T18:31:00.283048+0000","last_became_peered":"2024-05-08T18:31:00.283048+0000","last_unstale":"2024-05-08T18:34:07.272025+0000","last_undegraded":"2024-05-08T18:34:07.272025+0000","last_fullsized":"2024-05-08T18:34:07.272025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:16:11.480889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337235+0000","last_change":"2024-05-08T18:30:58.302648+0000","last_active":"2024-05-08T18:31:45.337235+0000","last_peered":"2024-05-08T18:31:45.337235+0000","last_clean":"2024-05-08T18:31:45.337235+0000","last_became_active":"2024-05-08T18:30:58.302245+0000","last_became_peered":"2024-05-08T18:30:58.302245+0000","last_unstale":"2024-05-08T18:31:45.337235+0000","last_undegraded":"2024-05-08T18:31:45.337235+0000","last_fullsized":"2024-05-08T18:31:45.337235+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:18.354135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'10","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196741+0000","last_change":"2024-05-08T18:31:45.338509+0000","last_active":"2024-05-08T18:34:07.196741+0000","last_peered":"2024-05-08T18:34:07.196741+0000","last_clean":"2024-05-08T18:34:07.196741+0000","last_became_active":"2024-05-08T18:31:45.338192+0000","last_became_peered":"2024-05-08T18:31:45.338192+0000","last_unstale":"2024-05-08T18:34:07.196741+0000","last_undegraded":"2024-05-08T18:34:07.196741+0000","last_fullsized":"2024-05-08T18:34:07.196741+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:50.426519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.559767+0000","last_change":"2024-05-08T18:30:58.306070+0000","last_active":"2024-05-08T18:33:06.559767+0000","last_peered":"2024-05-08T18:33:06.559767+0000","last_clean":"2024-05-08T18:33:06.559767+0000","last_became_active":"2024-05-08T18:30:58.304222+0000","last_became_peered":"2024-05-08T18:30:58.304222+0000","last_unstale":"2024-05-08T18:33:06.559767+0000","last_undegraded":"2024-05-08T18:33:06.559767+0000","last_fullsized":"2024-05-08T18:33:06.559767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:33:08.890455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"27'6","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331878+0000","last_change":"2024-05-08T18:31:00.296365+0000","last_active":"2024-05-08T18:31:45.331878+0000","last_peered":"2024-05-08T18:31:45.331878+0000","last_clean":"2024-05-08T18:31:45.331878+0000","last_became_active":"2024-05-08T18:31:00.295990+0000","last_became_peered":"2024-05-08T18:31:00.295990+0000","last_unstale":"2024-05-08T18:31:45.331878+0000","last_undegraded":"2024-05-08T18:31:45.331878+0000","last_fullsized":"2024-05-08T18:31:45.331878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:22:54.136553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330650+0000","last_change":"2024-05-08T18:30:58.285289+0000","last_active":"2024-05-08T18:31:45.330650+0000","last_peered":"2024-05-08T18:31:45.330650+0000","last_clean":"2024-05-08T18:31:45.330650+0000","last_became_active":"2024-05-08T18:30:58.283821+0000","last_became_peered":"2024-05-08T18:30:58.283821+0000","last_unstale":"2024-05-08T18:31:45.330650+0000","last_undegraded":"2024-05-08T18:31:45.330650+0000","last_fullsized":"2024-05-08T18:31:45.330650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:26.528845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'12","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196862+0000","last_change":"2024-05-08T18:31:00.282011+0000","last_active":"2024-05-08T18:34:07.196862+0000","last_peered":"2024-05-08T18:34:07.196862+0000","last_clean":"2024-05-08T18:34:07.196862+0000","last_became_active":"2024-05-08T18:31:00.280827+0000","last_became_peered":"2024-05-08T18:31:00.280827+0000","last_unstale":"2024-05-08T18:34:07.196862+0000","last_undegraded":"2024-05-08T18:34:07.196862+0000","last_fullsized":"2024-05-08T18:34:07.196862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:43.107566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328805+0000","last_change":"2024-05-08T18:30:58.306076+0000","last_active":"2024-05-08T18:31:45.328805+0000","last_peered":"2024-05-08T18:31:45.328805+0000","last_clean":"2024-05-08T18:31:45.328805+0000","last_became_active":"2024-05-08T18:30:58.305571+0000","last_became_peered":"2024-05-08T18:30:58.305571+0000","last_unstale":"2024-05-08T18:31:45.328805+0000","last_undegraded":"2024-05-08T18:31:45.328805+0000","last_fullsized":"2024-05-08T18:31:45.328805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:50.476345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.219476+0000","last_change":"2024-05-08T18:31:08.318466+0000","last_active":"2024-05-08T18:34:07.219476+0000","last_peered":"2024-05-08T18:34:07.219476+0000","last_clean":"2024-05-08T18:34:07.219476+0000","last_became_active":"2024-05-08T18:31:08.318181+0000","last_became_peered":"2024-05-08T18:31:08.318181+0000","last_unstale":"2024-05-08T18:34:07.219476+0000","last_undegraded":"2024-05-08T18:34:07.219476+0000","last_fullsized":"2024-05-08T18:34:07.219476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:26.315849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'12","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.869576+0000","last_change":"2024-05-08T18:31:00.296553+0000","last_active":"2024-05-08T18:32:22.869576+0000","last_peered":"2024-05-08T18:32:22.869576+0000","last_clean":"2024-05-08T18:32:22.869576+0000","last_became_active":"2024-05-08T18:31:00.296160+0000","last_became_peered":"2024-05-08T18:31:00.296160+0000","last_unstale":"2024-05-08T18:32:22.869576+0000","last_undegraded":"2024-05-08T18:32:22.869576+0000","last_fullsized":"2024-05-08T18:32:22.869576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:33.551031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328737+0000","last_change":"2024-05-08T18:30:58.317375+0000","last_active":"2024-05-08T18:31:45.328737+0000","last_peered":"2024-05-08T18:31:45.328737+0000","last_clean":"2024-05-08T18:31:45.328737+0000","last_became_active":"2024-05-08T18:30:58.315246+0000","last_became_peered":"2024-05-08T18:30:58.315246+0000","last_unstale":"2024-05-08T18:31:45.328737+0000","last_undegraded":"2024-05-08T18:31:45.328737+0000","last_fullsized":"2024-05-08T18:31:45.328737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:27.453462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329632+0000","last_change":"2024-05-08T18:31:02.290839+0000","last_active":"2024-05-08T18:31:45.329632+0000","last_peered":"2024-05-08T18:31:45.329632+0000","last_clean":"2024-05-08T18:31:45.329632+0000","last_became_active":"2024-05-08T18:31:02.290465+0000","last_became_peered":"2024-05-08T18:31:02.290465+0000","last_unstale":"2024-05-08T18:31:45.329632+0000","last_undegraded":"2024-05-08T18:31:45.329632+0000","last_fullsized":"2024-05-08T18:31:45.329632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:57.860502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.080511+0000","last_change":"2024-05-08T18:31:04.304092+0000","last_active":"2024-05-08T18:33:05.080511+0000","last_peered":"2024-05-08T18:33:05.080511+0000","last_clean":"2024-05-08T18:33:05.080511+0000","last_became_active":"2024-05-08T18:31:04.303815+0000","last_became_peered":"2024-05-08T18:31:04.303815+0000","last_unstale":"2024-05-08T18:33:05.080511+0000","last_undegraded":"2024-05-08T18:33:05.080511+0000","last_fullsized":"2024-05-08T18:33:05.080511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:57.848922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.338770+0000","last_change":"2024-05-08T18:31:06.310842+0000","last_active":"2024-05-08T18:31:45.338770+0000","last_peered":"2024-05-08T18:31:45.338770+0000","last_clean":"2024-05-08T18:31:45.338770+0000","last_became_active":"2024-05-08T18:31:06.310555+0000","last_became_peered":"2024-05-08T18:31:06.310555+0000","last_unstale":"2024-05-08T18:31:45.338770+0000","last_undegraded":"2024-05-08T18:31:45.338770+0000","last_fullsized":"2024-05-08T18:31:45.338770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:01.875049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.691129+0000","last_change":"2024-05-08T18:31:08.319311+0000","last_active":"2024-05-08T18:32:22.691129+0000","last_peered":"2024-05-08T18:32:22.691129+0000","last_clean":"2024-05-08T18:32:22.691129+0000","last_became_active":"2024-05-08T18:31:08.319009+0000","last_became_peered":"2024-05-08T18:31:08.319009+0000","last_unstale":"2024-05-08T18:32:22.691129+0000","last_undegraded":"2024-05-08T18:32:22.691129+0000","last_fullsized":"2024-05-08T18:32:22.691129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:13.936857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330446+0000","last_change":"2024-05-08T18:31:00.298856+0000","last_active":"2024-05-08T18:31:45.330446+0000","last_peered":"2024-05-08T18:31:45.330446+0000","last_clean":"2024-05-08T18:31:45.330446+0000","last_became_active":"2024-05-08T18:31:00.297497+0000","last_became_peered":"2024-05-08T18:31:00.297497+0000","last_unstale":"2024-05-08T18:31:45.330446+0000","last_undegraded":"2024-05-08T18:31:45.330446+0000","last_fullsized":"2024-05-08T18:31:45.330446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:57.260625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334952+0000","last_change":"2024-05-08T18:30:58.300036+0000","last_active":"2024-05-08T18:31:45.334952+0000","last_peered":"2024-05-08T18:31:45.334952+0000","last_clean":"2024-05-08T18:31:45.334952+0000","last_became_active":"2024-05-08T18:30:58.299649+0000","last_became_peered":"2024-05-08T18:30:58.299649+0000","last_unstale":"2024-05-08T18:31:45.334952+0000","last_undegraded":"2024-05-08T18:31:45.334952+0000","last_fullsized":"2024-05-08T18:31:45.334952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:43.233516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"20'1","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.182063+0000","last_change":"2024-05-08T18:31:02.294330+0000","last_active":"2024-05-08T18:33:06.182063+0000","last_peered":"2024-05-08T18:33:06.182063+0000","last_clean":"2024-05-08T18:33:06.182063+0000","last_became_active":"2024-05-08T18:31:02.293993+0000","last_became_peered":"2024-05-08T18:31:02.293993+0000","last_unstale":"2024-05-08T18:33:06.182063+0000","last_undegraded":"2024-05-08T18:33:06.182063+0000","last_fullsized":"2024-05-08T18:33:06.182063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:57.170520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.181520+0000","last_change":"2024-05-08T18:31:04.300424+0000","last_active":"2024-05-08T18:33:33.181520+0000","last_peered":"2024-05-08T18:33:33.181520+0000","last_clean":"2024-05-08T18:33:33.181520+0000","last_became_active":"2024-05-08T18:31:04.300059+0000","last_became_peered":"2024-05-08T18:31:04.300059+0000","last_unstale":"2024-05-08T18:33:33.181520+0000","last_undegraded":"2024-05-08T18:33:33.181520+0000","last_fullsized":"2024-05-08T18:33:33.181520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:44.348620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336322+0000","last_change":"2024-05-08T18:31:06.312948+0000","last_active":"2024-05-08T18:31:45.336322+0000","last_peered":"2024-05-08T18:31:45.336322+0000","last_clean":"2024-05-08T18:31:45.336322+0000","last_became_active":"2024-05-08T18:31:06.312651+0000","last_became_peered":"2024-05-08T18:31:06.312651+0000","last_unstale":"2024-05-08T18:31:45.336322+0000","last_undegraded":"2024-05-08T18:31:45.336322+0000","last_fullsized":"2024-05-08T18:31:45.336322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:01.719275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328702+0000","last_change":"2024-05-08T18:31:08.311373+0000","last_active":"2024-05-08T18:31:45.328702+0000","last_peered":"2024-05-08T18:31:45.328702+0000","last_clean":"2024-05-08T18:31:45.328702+0000","last_became_active":"2024-05-08T18:31:08.311048+0000","last_became_peered":"2024-05-08T18:31:08.311048+0000","last_unstale":"2024-05-08T18:31:45.328702+0000","last_undegraded":"2024-05-08T18:31:45.328702+0000","last_fullsized":"2024-05-08T18:31:45.328702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:36.670228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.242285+0000","last_change":"2024-05-08T18:31:00.296832+0000","last_active":"2024-05-08T18:34:07.242285+0000","last_peered":"2024-05-08T18:34:07.242285+0000","last_clean":"2024-05-08T18:34:07.242285+0000","last_became_active":"2024-05-08T18:31:00.296176+0000","last_became_peered":"2024-05-08T18:31:00.296176+0000","last_unstale":"2024-05-08T18:34:07.242285+0000","last_undegraded":"2024-05-08T18:34:07.242285+0000","last_fullsized":"2024-05-08T18:34:07.242285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:56.201421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327607+0000","last_change":"2024-05-08T18:30:58.310108+0000","last_active":"2024-05-08T18:31:45.327607+0000","last_peered":"2024-05-08T18:31:45.327607+0000","last_clean":"2024-05-08T18:31:45.327607+0000","last_became_active":"2024-05-08T18:30:58.309339+0000","last_became_peered":"2024-05-08T18:30:58.309339+0000","last_unstale":"2024-05-08T18:31:45.327607+0000","last_undegraded":"2024-05-08T18:31:45.327607+0000","last_fullsized":"2024-05-08T18:31:45.327607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:38.248722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:48.166352+0000","last_change":"2024-05-08T18:31:45.335793+0000","last_active":"2024-05-08T18:31:48.166352+0000","last_peered":"2024-05-08T18:31:48.166352+0000","last_clean":"2024-05-08T18:31:48.166352+0000","last_became_active":"2024-05-08T18:31:45.335489+0000","last_became_peered":"2024-05-08T18:31:45.335489+0000","last_unstale":"2024-05-08T18:31:48.166352+0000","last_undegraded":"2024-05-08T18:31:48.166352+0000","last_fullsized":"2024-05-08T18:31:48.166352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:01.179871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.180653+0000","last_change":"2024-05-08T18:31:04.300336+0000","last_active":"2024-05-08T18:33:28.180653+0000","last_peered":"2024-05-08T18:33:28.180653+0000","last_clean":"2024-05-08T18:33:28.180653+0000","last_became_active":"2024-05-08T18:31:04.300022+0000","last_became_peered":"2024-05-08T18:31:04.300022+0000","last_unstale":"2024-05-08T18:33:28.180653+0000","last_undegraded":"2024-05-08T18:33:28.180653+0000","last_fullsized":"2024-05-08T18:33:28.180653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:42.428646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'282","reported_seq":390,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370245+0000","last_change":"2024-05-08T18:31:06.307960+0000","last_active":"2024-05-08T18:34:07.370245+0000","last_peered":"2024-05-08T18:34:07.370245+0000","last_clean":"2024-05-08T18:34:07.370245+0000","last_became_active":"2024-05-08T18:31:06.306886+0000","last_became_peered":"2024-05-08T18:31:06.306886+0000","last_unstale":"2024-05-08T18:34:07.370245+0000","last_undegraded":"2024-05-08T18:34:07.370245+0000","last_fullsized":"2024-05-08T18:34:07.370245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:48.485718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.578916+0000","last_change":"2024-05-08T18:31:08.312050+0000","last_active":"2024-05-08T18:33:06.578916+0000","last_peered":"2024-05-08T18:33:06.578916+0000","last_clean":"2024-05-08T18:33:06.578916+0000","last_became_active":"2024-05-08T18:31:08.311780+0000","last_became_peered":"2024-05-08T18:31:08.311780+0000","last_unstale":"2024-05-08T18:33:06.578916+0000","last_undegraded":"2024-05-08T18:33:06.578916+0000","last_fullsized":"2024-05-08T18:33:06.578916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:11:36.751971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332003+0000","last_change":"2024-05-08T18:31:00.281650+0000","last_active":"2024-05-08T18:31:45.332003+0000","last_peered":"2024-05-08T18:31:45.332003+0000","last_clean":"2024-05-08T18:31:45.332003+0000","last_became_active":"2024-05-08T18:31:00.281268+0000","last_became_peered":"2024-05-08T18:31:00.281268+0000","last_unstale":"2024-05-08T18:31:45.332003+0000","last_undegraded":"2024-05-08T18:31:45.332003+0000","last_fullsized":"2024-05-08T18:31:45.332003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:40.256644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.186380+0000","last_change":"2024-05-08T18:30:58.306638+0000","last_active":"2024-05-08T18:34:07.186380+0000","last_peered":"2024-05-08T18:34:07.186380+0000","last_clean":"2024-05-08T18:34:07.186380+0000","last_became_active":"2024-05-08T18:30:58.303428+0000","last_became_peered":"2024-05-08T18:30:58.303428+0000","last_unstale":"2024-05-08T18:34:07.186380+0000","last_undegraded":"2024-05-08T18:34:07.186380+0000","last_fullsized":"2024-05-08T18:34:07.186380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:56.618771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332766+0000","last_change":"2024-05-08T18:31:02.292000+0000","last_active":"2024-05-08T18:31:45.332766+0000","last_peered":"2024-05-08T18:31:45.332766+0000","last_clean":"2024-05-08T18:31:45.332766+0000","last_became_active":"2024-05-08T18:31:02.291729+0000","last_became_peered":"2024-05-08T18:31:02.291729+0000","last_unstale":"2024-05-08T18:31:45.332766+0000","last_undegraded":"2024-05-08T18:31:45.332766+0000","last_fullsized":"2024-05-08T18:31:45.332766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:47:19.398957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.075273+0000","last_change":"2024-05-08T18:31:04.304611+0000","last_active":"2024-05-08T18:33:05.075273+0000","last_peered":"2024-05-08T18:33:05.075273+0000","last_clean":"2024-05-08T18:33:05.075273+0000","last_became_active":"2024-05-08T18:31:04.304347+0000","last_became_peered":"2024-05-08T18:31:04.304347+0000","last_unstale":"2024-05-08T18:33:05.075273+0000","last_undegraded":"2024-05-08T18:33:05.075273+0000","last_fullsized":"2024-05-08T18:33:05.075273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:42.690781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'282","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370399+0000","last_change":"2024-05-08T18:31:06.305903+0000","last_active":"2024-05-08T18:34:07.370399+0000","last_peered":"2024-05-08T18:34:07.370399+0000","last_clean":"2024-05-08T18:34:07.370399+0000","last_became_active":"2024-05-08T18:31:06.305591+0000","last_became_peered":"2024-05-08T18:31:06.305591+0000","last_unstale":"2024-05-08T18:34:07.370399+0000","last_undegraded":"2024-05-08T18:34:07.370399+0000","last_fullsized":"2024-05-08T18:34:07.370399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:49.125159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'10","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.272036+0000","last_change":"2024-05-08T18:31:00.291398+0000","last_active":"2024-05-08T18:34:07.272036+0000","last_peered":"2024-05-08T18:34:07.272036+0000","last_clean":"2024-05-08T18:34:07.272036+0000","last_became_active":"2024-05-08T18:31:00.290824+0000","last_became_peered":"2024-05-08T18:31:00.290824+0000","last_unstale":"2024-05-08T18:34:07.272036+0000","last_undegraded":"2024-05-08T18:34:07.272036+0000","last_fullsized":"2024-05-08T18:34:07.272036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:32.380609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333693+0000","last_change":"2024-05-08T18:30:58.301227+0000","last_active":"2024-05-08T18:31:45.333693+0000","last_peered":"2024-05-08T18:31:45.333693+0000","last_clean":"2024-05-08T18:31:45.333693+0000","last_became_active":"2024-05-08T18:30:58.300884+0000","last_became_peered":"2024-05-08T18:30:58.300884+0000","last_unstale":"2024-05-08T18:31:45.333693+0000","last_undegraded":"2024-05-08T18:31:45.333693+0000","last_fullsized":"2024-05-08T18:31:45.333693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:18.354135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334570+0000","last_change":"2024-05-08T18:31:02.291926+0000","last_active":"2024-05-08T18:31:45.334570+0000","last_peered":"2024-05-08T18:31:45.334570+0000","last_clean":"2024-05-08T18:31:45.334570+0000","last_became_active":"2024-05-08T18:31:02.291536+0000","last_became_peered":"2024-05-08T18:31:02.291536+0000","last_unstale":"2024-05-08T18:31:45.334570+0000","last_undegraded":"2024-05-08T18:31:45.334570+0000","last_fullsized":"2024-05-08T18:31:45.334570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:01.425063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'41","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.085136+0000","last_change":"2024-05-08T18:31:04.302745+0000","last_active":"2024-05-08T18:33:05.085136+0000","last_peered":"2024-05-08T18:33:05.085136+0000","last_clean":"2024-05-08T18:33:05.085136+0000","last_became_active":"2024-05-08T18:31:04.302455+0000","last_became_peered":"2024-05-08T18:31:04.302455+0000","last_unstale":"2024-05-08T18:33:05.085136+0000","last_undegraded":"2024-05-08T18:33:05.085136+0000","last_fullsized":"2024-05-08T18:33:05.085136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:32.684836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330256+0000","last_change":"2024-05-08T18:31:06.305190+0000","last_active":"2024-05-08T18:31:45.330256+0000","last_peered":"2024-05-08T18:31:45.330256+0000","last_clean":"2024-05-08T18:31:45.330256+0000","last_became_active":"2024-05-08T18:31:06.304979+0000","last_became_peered":"2024-05-08T18:31:06.304979+0000","last_unstale":"2024-05-08T18:31:45.330256+0000","last_undegraded":"2024-05-08T18:31:45.330256+0000","last_fullsized":"2024-05-08T18:31:45.330256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:43.024781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.692939+0000","last_change":"2024-05-08T18:31:08.311725+0000","last_active":"2024-05-08T18:32:22.692939+0000","last_peered":"2024-05-08T18:32:22.692939+0000","last_clean":"2024-05-08T18:32:22.692939+0000","last_became_active":"2024-05-08T18:31:08.311434+0000","last_became_peered":"2024-05-08T18:31:08.311434+0000","last_unstale":"2024-05-08T18:32:22.692939+0000","last_undegraded":"2024-05-08T18:32:22.692939+0000","last_fullsized":"2024-05-08T18:32:22.692939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:03.726123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.681210+0000","last_change":"2024-05-08T18:31:00.281267+0000","last_active":"2024-05-08T18:32:22.681210+0000","last_peered":"2024-05-08T18:32:22.681210+0000","last_clean":"2024-05-08T18:32:22.681210+0000","last_became_active":"2024-05-08T18:31:00.280969+0000","last_became_peered":"2024-05-08T18:31:00.280969+0000","last_unstale":"2024-05-08T18:32:22.681210+0000","last_undegraded":"2024-05-08T18:32:22.681210+0000","last_fullsized":"2024-05-08T18:32:22.681210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:22:54.136553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331186+0000","last_change":"2024-05-08T18:30:58.303460+0000","last_active":"2024-05-08T18:31:45.331186+0000","last_peered":"2024-05-08T18:31:45.331186+0000","last_clean":"2024-05-08T18:31:45.331186+0000","last_became_active":"2024-05-08T18:30:58.302590+0000","last_became_peered":"2024-05-08T18:30:58.302590+0000","last_unstale":"2024-05-08T18:31:45.331186+0000","last_undegraded":"2024-05-08T18:31:45.331186+0000","last_fullsized":"2024-05-08T18:31:45.331186+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:34.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329728+0000","last_change":"2024-05-08T18:31:02.289867+0000","last_active":"2024-05-08T18:31:45.329728+0000","last_peered":"2024-05-08T18:31:45.329728+0000","last_clean":"2024-05-08T18:31:45.329728+0000","last_became_active":"2024-05-08T18:31:02.289394+0000","last_became_peered":"2024-05-08T18:31:02.289394+0000","last_unstale":"2024-05-08T18:31:45.329728+0000","last_undegraded":"2024-05-08T18:31:45.329728+0000","last_fullsized":"2024-05-08T18:31:45.329728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:11.566252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.064996+0000","last_change":"2024-05-08T18:31:04.303291+0000","last_active":"2024-05-08T18:33:05.064996+0000","last_peered":"2024-05-08T18:33:05.064996+0000","last_clean":"2024-05-08T18:33:05.064996+0000","last_became_active":"2024-05-08T18:31:04.302886+0000","last_became_peered":"2024-05-08T18:31:04.302886+0000","last_unstale":"2024-05-08T18:33:05.064996+0000","last_undegraded":"2024-05-08T18:33:05.064996+0000","last_fullsized":"2024-05-08T18:33:05.064996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:19:01.413463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330112+0000","last_change":"2024-05-08T18:31:06.306937+0000","last_active":"2024-05-08T18:31:45.330112+0000","last_peered":"2024-05-08T18:31:45.330112+0000","last_clean":"2024-05-08T18:31:45.330112+0000","last_became_active":"2024-05-08T18:31:06.306607+0000","last_became_peered":"2024-05-08T18:31:06.306607+0000","last_unstale":"2024-05-08T18:31:45.330112+0000","last_undegraded":"2024-05-08T18:31:45.330112+0000","last_fullsized":"2024-05-08T18:31:45.330112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:57.121163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:17.147191+0000","last_change":"2024-05-08T18:31:08.305446+0000","last_active":"2024-05-08T18:32:17.147191+0000","last_peered":"2024-05-08T18:32:17.147191+0000","last_clean":"2024-05-08T18:32:17.147191+0000","last_became_active":"2024-05-08T18:31:08.305127+0000","last_became_peered":"2024-05-08T18:31:08.305127+0000","last_unstale":"2024-05-08T18:32:17.147191+0000","last_undegraded":"2024-05-08T18:32:17.147191+0000","last_fullsized":"2024-05-08T18:32:17.147191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:34.156497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.870768+0000","last_change":"2024-05-08T18:31:00.293425+0000","last_active":"2024-05-08T18:32:22.870768+0000","last_peered":"2024-05-08T18:32:22.870768+0000","last_clean":"2024-05-08T18:32:22.870768+0000","last_became_active":"2024-05-08T18:31:00.293170+0000","last_became_peered":"2024-05-08T18:31:00.293170+0000","last_unstale":"2024-05-08T18:32:22.870768+0000","last_undegraded":"2024-05-08T18:32:22.870768+0000","last_fullsized":"2024-05-08T18:32:22.870768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:18.374257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.486260+0000","last_change":"2024-05-08T18:30:58.316505+0000","last_active":"2024-05-08T18:33:06.486260+0000","last_peered":"2024-05-08T18:33:06.486260+0000","last_clean":"2024-05-08T18:33:06.486260+0000","last_became_active":"2024-05-08T18:30:58.314352+0000","last_became_peered":"2024-05-08T18:30:58.314352+0000","last_unstale":"2024-05-08T18:33:06.486260+0000","last_undegraded":"2024-05-08T18:33:06.486260+0000","last_fullsized":"2024-05-08T18:33:06.486260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:17.391716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:48.166253+0000","last_change":"2024-05-08T18:31:45.339752+0000","last_active":"2024-05-08T18:31:48.166253+0000","last_peered":"2024-05-08T18:31:48.166253+0000","last_clean":"2024-05-08T18:31:48.166253+0000","last_became_active":"2024-05-08T18:31:45.339423+0000","last_became_peered":"2024-05-08T18:31:45.339423+0000","last_unstale":"2024-05-08T18:31:48.166253+0000","last_undegraded":"2024-05-08T18:31:48.166253+0000","last_fullsized":"2024-05-08T18:31:48.166253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:49:36.600605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.087041+0000","last_change":"2024-05-08T18:31:04.298949+0000","last_active":"2024-05-08T18:33:05.087041+0000","last_peered":"2024-05-08T18:33:05.087041+0000","last_clean":"2024-05-08T18:33:05.087041+0000","last_became_active":"2024-05-08T18:31:04.298026+0000","last_became_peered":"2024-05-08T18:31:04.298026+0000","last_unstale":"2024-05-08T18:33:05.087041+0000","last_undegraded":"2024-05-08T18:33:05.087041+0000","last_fullsized":"2024-05-08T18:33:05.087041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:17.656617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'282","reported_seq":354,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.406177+0000","last_change":"2024-05-08T18:31:06.307022+0000","last_active":"2024-05-08T18:34:07.406177+0000","last_peered":"2024-05-08T18:34:07.406177+0000","last_clean":"2024-05-08T18:34:07.406177+0000","last_became_active":"2024-05-08T18:31:06.306655+0000","last_became_peered":"2024-05-08T18:31:06.306655+0000","last_unstale":"2024-05-08T18:34:07.406177+0000","last_undegraded":"2024-05-08T18:34:07.406177+0000","last_fullsized":"2024-05-08T18:34:07.406177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:17.968800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330293+0000","last_change":"2024-05-08T18:31:08.314593+0000","last_active":"2024-05-08T18:31:45.330293+0000","last_peered":"2024-05-08T18:31:45.330293+0000","last_clean":"2024-05-08T18:31:45.330293+0000","last_became_active":"2024-05-08T18:31:08.314273+0000","last_became_peered":"2024-05-08T18:31:08.314273+0000","last_unstale":"2024-05-08T18:31:45.330293+0000","last_undegraded":"2024-05-08T18:31:45.330293+0000","last_fullsized":"2024-05-08T18:31:45.330293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:44.629789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.869260+0000","last_change":"2024-05-08T18:31:00.283193+0000","last_active":"2024-05-08T18:32:22.869260+0000","last_peered":"2024-05-08T18:32:22.869260+0000","last_clean":"2024-05-08T18:32:22.869260+0000","last_became_active":"2024-05-08T18:31:00.282941+0000","last_became_peered":"2024-05-08T18:31:00.282941+0000","last_unstale":"2024-05-08T18:32:22.869260+0000","last_undegraded":"2024-05-08T18:32:22.869260+0000","last_fullsized":"2024-05-08T18:32:22.869260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:54.772566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328935+0000","last_change":"2024-05-08T18:30:58.316967+0000","last_active":"2024-05-08T18:31:45.328935+0000","last_peered":"2024-05-08T18:31:45.328935+0000","last_clean":"2024-05-08T18:31:45.328935+0000","last_became_active":"2024-05-08T18:30:58.313431+0000","last_became_peered":"2024-05-08T18:30:58.313431+0000","last_unstale":"2024-05-08T18:31:45.328935+0000","last_undegraded":"2024-05-08T18:31:45.328935+0000","last_fullsized":"2024-05-08T18:31:45.328935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:24.289073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329543+0000","last_change":"2024-05-08T18:31:02.290051+0000","last_active":"2024-05-08T18:31:45.329543+0000","last_peered":"2024-05-08T18:31:45.329543+0000","last_clean":"2024-05-08T18:31:45.329543+0000","last_became_active":"2024-05-08T18:31:02.289669+0000","last_became_peered":"2024-05-08T18:31:02.289669+0000","last_unstale":"2024-05-08T18:31:45.329543+0000","last_undegraded":"2024-05-08T18:31:45.329543+0000","last_fullsized":"2024-05-08T18:31:45.329543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:30.670243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'56","reported_seq":112,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.583830+0000","last_change":"2024-05-08T18:31:04.302553+0000","last_active":"2024-05-08T18:33:06.583830+0000","last_peered":"2024-05-08T18:33:06.583830+0000","last_clean":"2024-05-08T18:33:06.583830+0000","last_became_active":"2024-05-08T18:31:04.302244+0000","last_became_peered":"2024-05-08T18:31:04.302244+0000","last_unstale":"2024-05-08T18:33:06.583830+0000","last_undegraded":"2024-05-08T18:33:06.583830+0000","last_fullsized":"2024-05-08T18:33:06.583830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:46.989970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329219+0000","last_change":"2024-05-08T18:31:06.309153+0000","last_active":"2024-05-08T18:31:45.329219+0000","last_peered":"2024-05-08T18:31:45.329219+0000","last_clean":"2024-05-08T18:31:45.329219+0000","last_became_active":"2024-05-08T18:31:06.308806+0000","last_became_peered":"2024-05-08T18:31:06.308806+0000","last_unstale":"2024-05-08T18:31:45.329219+0000","last_undegraded":"2024-05-08T18:31:45.329219+0000","last_fullsized":"2024-05-08T18:31:45.329219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:11:34.745123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.381203+0000","last_change":"2024-05-08T18:31:08.319703+0000","last_active":"2024-05-08T18:34:07.381203+0000","last_peered":"2024-05-08T18:34:07.381203+0000","last_clean":"2024-05-08T18:34:07.381203+0000","last_became_active":"2024-05-08T18:31:08.319370+0000","last_became_peered":"2024-05-08T18:31:08.319370+0000","last_unstale":"2024-05-08T18:34:07.381203+0000","last_undegraded":"2024-05-08T18:34:07.381203+0000","last_fullsized":"2024-05-08T18:34:07.381203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:36.140092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.684230+0000","last_change":"2024-05-08T18:31:00.292416+0000","last_active":"2024-05-08T18:32:22.684230+0000","last_peered":"2024-05-08T18:32:22.684230+0000","last_clean":"2024-05-08T18:32:22.684230+0000","last_became_active":"2024-05-08T18:31:00.292154+0000","last_became_peered":"2024-05-08T18:31:00.292154+0000","last_unstale":"2024-05-08T18:32:22.684230+0000","last_undegraded":"2024-05-08T18:32:22.684230+0000","last_fullsized":"2024-05-08T18:32:22.684230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:03.239102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330126+0000","last_change":"2024-05-08T18:30:58.294896+0000","last_active":"2024-05-08T18:31:45.330126+0000","last_peered":"2024-05-08T18:31:45.330126+0000","last_clean":"2024-05-08T18:31:45.330126+0000","last_became_active":"2024-05-08T18:30:58.294377+0000","last_became_peered":"2024-05-08T18:30:58.294377+0000","last_unstale":"2024-05-08T18:31:45.330126+0000","last_undegraded":"2024-05-08T18:31:45.330126+0000","last_fullsized":"2024-05-08T18:31:45.330126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:04.148371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330076+0000","last_change":"2024-05-08T18:31:02.294000+0000","last_active":"2024-05-08T18:31:45.330076+0000","last_peered":"2024-05-08T18:31:45.330076+0000","last_clean":"2024-05-08T18:31:45.330076+0000","last_became_active":"2024-05-08T18:31:02.293680+0000","last_became_peered":"2024-05-08T18:31:02.293680+0000","last_unstale":"2024-05-08T18:31:45.330076+0000","last_undegraded":"2024-05-08T18:31:45.330076+0000","last_fullsized":"2024-05-08T18:31:45.330076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:49:52.687784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.069060+0000","last_change":"2024-05-08T18:31:04.301433+0000","last_active":"2024-05-08T18:33:05.069060+0000","last_peered":"2024-05-08T18:33:05.069060+0000","last_clean":"2024-05-08T18:33:05.069060+0000","last_became_active":"2024-05-08T18:31:04.301147+0000","last_became_peered":"2024-05-08T18:31:04.301147+0000","last_unstale":"2024-05-08T18:33:05.069060+0000","last_undegraded":"2024-05-08T18:33:05.069060+0000","last_fullsized":"2024-05-08T18:33:05.069060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:13.749614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332085+0000","last_change":"2024-05-08T18:31:06.309848+0000","last_active":"2024-05-08T18:31:45.332085+0000","last_peered":"2024-05-08T18:31:45.332085+0000","last_clean":"2024-05-08T18:31:45.332085+0000","last_became_active":"2024-05-08T18:31:06.308804+0000","last_became_peered":"2024-05-08T18:31:06.308804+0000","last_unstale":"2024-05-08T18:31:45.332085+0000","last_undegraded":"2024-05-08T18:31:45.332085+0000","last_fullsized":"2024-05-08T18:31:45.332085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.734033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177658+0000","last_change":"2024-05-08T18:31:08.320629+0000","last_active":"2024-05-08T18:33:08.177658+0000","last_peered":"2024-05-08T18:33:08.177658+0000","last_clean":"2024-05-08T18:33:08.177658+0000","last_became_active":"2024-05-08T18:31:08.320150+0000","last_became_peered":"2024-05-08T18:31:08.320150+0000","last_unstale":"2024-05-08T18:33:08.177658+0000","last_undegraded":"2024-05-08T18:33:08.177658+0000","last_fullsized":"2024-05-08T18:33:08.177658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:06:21.193541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.962245+0000","last_change":"2024-05-08T18:31:00.300161+0000","last_active":"2024-05-08T18:34:06.962245+0000","last_peered":"2024-05-08T18:34:06.962245+0000","last_clean":"2024-05-08T18:34:06.962245+0000","last_became_active":"2024-05-08T18:31:00.299379+0000","last_became_peered":"2024-05-08T18:31:00.299379+0000","last_unstale":"2024-05-08T18:34:06.962245+0000","last_undegraded":"2024-05-08T18:34:06.962245+0000","last_fullsized":"2024-05-08T18:34:06.962245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:30.742428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329273+0000","last_change":"2024-05-08T18:30:58.316845+0000","last_active":"2024-05-08T18:31:45.329273+0000","last_peered":"2024-05-08T18:31:45.329273+0000","last_clean":"2024-05-08T18:31:45.329273+0000","last_became_active":"2024-05-08T18:30:58.315625+0000","last_became_peered":"2024-05-08T18:30:58.315625+0000","last_unstale":"2024-05-08T18:31:45.329273+0000","last_undegraded":"2024-05-08T18:31:45.329273+0000","last_fullsized":"2024-05-08T18:31:45.329273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:06.716557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329621+0000","last_change":"2024-05-08T18:31:02.290296+0000","last_active":"2024-05-08T18:31:45.329621+0000","last_peered":"2024-05-08T18:31:45.329621+0000","last_clean":"2024-05-08T18:31:45.329621+0000","last_became_active":"2024-05-08T18:31:02.289767+0000","last_became_peered":"2024-05-08T18:31:02.289767+0000","last_unstale":"2024-05-08T18:31:45.329621+0000","last_undegraded":"2024-05-08T18:31:45.329621+0000","last_fullsized":"2024-05-08T18:31:45.329621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:25.978523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.095800+0000","last_change":"2024-05-08T18:31:04.294840+0000","last_active":"2024-05-08T18:33:05.095800+0000","last_peered":"2024-05-08T18:33:05.095800+0000","last_clean":"2024-05-08T18:33:05.095800+0000","last_became_active":"2024-05-08T18:31:04.294573+0000","last_became_peered":"2024-05-08T18:31:04.294573+0000","last_unstale":"2024-05-08T18:33:05.095800+0000","last_undegraded":"2024-05-08T18:33:05.095800+0000","last_fullsized":"2024-05-08T18:33:05.095800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:37.564647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'282","reported_seq":430,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.395855+0000","last_change":"2024-05-08T18:31:06.312484+0000","last_active":"2024-05-08T18:34:07.395855+0000","last_peered":"2024-05-08T18:34:07.395855+0000","last_clean":"2024-05-08T18:34:07.395855+0000","last_became_active":"2024-05-08T18:31:06.312203+0000","last_became_peered":"2024-05-08T18:31:06.312203+0000","last_unstale":"2024-05-08T18:34:07.395855+0000","last_undegraded":"2024-05-08T18:34:07.395855+0000","last_fullsized":"2024-05-08T18:34:07.395855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:28.017188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'14","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.250725+0000","last_change":"2024-05-08T18:31:08.314495+0000","last_active":"2024-05-08T18:34:07.250725+0000","last_peered":"2024-05-08T18:34:07.250725+0000","last_clean":"2024-05-08T18:34:07.250725+0000","last_became_active":"2024-05-08T18:31:08.314171+0000","last_became_peered":"2024-05-08T18:31:08.314171+0000","last_unstale":"2024-05-08T18:34:07.250725+0000","last_undegraded":"2024-05-08T18:34:07.250725+0000","last_fullsized":"2024-05-08T18:34:07.250725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:26.315849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.242517+0000","last_change":"2024-05-08T18:31:00.292788+0000","last_active":"2024-05-08T18:34:07.242517+0000","last_peered":"2024-05-08T18:34:07.242517+0000","last_clean":"2024-05-08T18:34:07.242517+0000","last_became_active":"2024-05-08T18:31:00.292521+0000","last_became_peered":"2024-05-08T18:31:00.292521+0000","last_unstale":"2024-05-08T18:34:07.242517+0000","last_undegraded":"2024-05-08T18:34:07.242517+0000","last_fullsized":"2024-05-08T18:34:07.242517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:09.586689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329194+0000","last_change":"2024-05-08T18:30:58.310166+0000","last_active":"2024-05-08T18:31:45.329194+0000","last_peered":"2024-05-08T18:31:45.329194+0000","last_clean":"2024-05-08T18:31:45.329194+0000","last_became_active":"2024-05-08T18:30:58.309773+0000","last_became_peered":"2024-05-08T18:30:58.309773+0000","last_unstale":"2024-05-08T18:31:45.329194+0000","last_undegraded":"2024-05-08T18:31:45.329194+0000","last_fullsized":"2024-05-08T18:31:45.329194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:07.578767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.181624+0000","last_change":"2024-05-08T18:31:02.289615+0000","last_active":"2024-05-08T18:33:06.181624+0000","last_peered":"2024-05-08T18:33:06.181624+0000","last_clean":"2024-05-08T18:33:06.181624+0000","last_became_active":"2024-05-08T18:31:02.289253+0000","last_became_peered":"2024-05-08T18:31:02.289253+0000","last_unstale":"2024-05-08T18:33:06.181624+0000","last_undegraded":"2024-05-08T18:33:06.181624+0000","last_fullsized":"2024-05-08T18:33:06.181624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:12.617698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330973+0000","last_change":"2024-05-08T18:31:04.304088+0000","last_active":"2024-05-08T18:31:45.330973+0000","last_peered":"2024-05-08T18:31:45.330973+0000","last_clean":"2024-05-08T18:31:45.330973+0000","last_became_active":"2024-05-08T18:31:04.303799+0000","last_became_peered":"2024-05-08T18:31:04.303799+0000","last_unstale":"2024-05-08T18:31:45.330973+0000","last_undegraded":"2024-05-08T18:31:45.330973+0000","last_fullsized":"2024-05-08T18:31:45.330973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:57.074860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'282","reported_seq":459,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370311+0000","last_change":"2024-05-08T18:31:06.305559+0000","last_active":"2024-05-08T18:34:07.370311+0000","last_peered":"2024-05-08T18:34:07.370311+0000","last_clean":"2024-05-08T18:34:07.370311+0000","last_became_active":"2024-05-08T18:31:06.305201+0000","last_became_peered":"2024-05-08T18:31:06.305201+0000","last_unstale":"2024-05-08T18:34:07.370311+0000","last_undegraded":"2024-05-08T18:34:07.370311+0000","last_fullsized":"2024-05-08T18:34:07.370311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:49.125159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.361146+0000","last_change":"2024-05-08T18:31:08.311212+0000","last_active":"2024-05-08T18:33:06.361146+0000","last_peered":"2024-05-08T18:33:06.361146+0000","last_clean":"2024-05-08T18:33:06.361146+0000","last_became_active":"2024-05-08T18:31:08.310906+0000","last_became_peered":"2024-05-08T18:31:08.310906+0000","last_unstale":"2024-05-08T18:33:06.361146+0000","last_undegraded":"2024-05-08T18:33:06.361146+0000","last_fullsized":"2024-05-08T18:33:06.361146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:11.717528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'14","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271660+0000","last_change":"2024-05-08T18:31:00.292227+0000","last_active":"2024-05-08T18:34:07.271660+0000","last_peered":"2024-05-08T18:34:07.271660+0000","last_clean":"2024-05-08T18:34:07.271660+0000","last_became_active":"2024-05-08T18:31:00.291563+0000","last_became_peered":"2024-05-08T18:31:00.291563+0000","last_unstale":"2024-05-08T18:34:07.271660+0000","last_undegraded":"2024-05-08T18:34:07.271660+0000","last_fullsized":"2024-05-08T18:34:07.271660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:21.530085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328340+0000","last_change":"2024-05-08T18:30:58.304032+0000","last_active":"2024-05-08T18:31:45.328340+0000","last_peered":"2024-05-08T18:31:45.328340+0000","last_clean":"2024-05-08T18:31:45.328340+0000","last_became_active":"2024-05-08T18:30:58.302966+0000","last_became_peered":"2024-05-08T18:30:58.302966+0000","last_unstale":"2024-05-08T18:31:45.328340+0000","last_undegraded":"2024-05-08T18:31:45.328340+0000","last_fullsized":"2024-05-08T18:31:45.328340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:53.183411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332859+0000","last_change":"2024-05-08T18:31:02.288493+0000","last_active":"2024-05-08T18:31:45.332859+0000","last_peered":"2024-05-08T18:31:45.332859+0000","last_clean":"2024-05-08T18:31:45.332859+0000","last_became_active":"2024-05-08T18:31:02.288232+0000","last_became_peered":"2024-05-08T18:31:02.288232+0000","last_unstale":"2024-05-08T18:31:45.332859+0000","last_undegraded":"2024-05-08T18:31:45.332859+0000","last_fullsized":"2024-05-08T18:31:45.332859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:29:42.582963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'38","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.081776+0000","last_change":"2024-05-08T18:31:04.301609+0000","last_active":"2024-05-08T18:33:05.081776+0000","last_peered":"2024-05-08T18:33:05.081776+0000","last_clean":"2024-05-08T18:33:05.081776+0000","last_became_active":"2024-05-08T18:31:04.301298+0000","last_became_peered":"2024-05-08T18:31:04.301298+0000","last_unstale":"2024-05-08T18:33:05.081776+0000","last_undegraded":"2024-05-08T18:33:05.081776+0000","last_fullsized":"2024-05-08T18:33:05.081776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:17.287554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331437+0000","last_change":"2024-05-08T18:31:06.310680+0000","last_active":"2024-05-08T18:31:45.331437+0000","last_peered":"2024-05-08T18:31:45.331437+0000","last_clean":"2024-05-08T18:31:45.331437+0000","last_became_active":"2024-05-08T18:31:06.310430+0000","last_became_peered":"2024-05-08T18:31:06.310430+0000","last_unstale":"2024-05-08T18:31:45.331437+0000","last_undegraded":"2024-05-08T18:31:45.331437+0000","last_fullsized":"2024-05-08T18:31:45.331437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:36.763558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.309458+0000","last_change":"2024-05-08T18:31:08.307711+0000","last_active":"2024-05-08T18:34:07.309458+0000","last_peered":"2024-05-08T18:34:07.309458+0000","last_clean":"2024-05-08T18:34:07.309458+0000","last_became_active":"2024-05-08T18:31:08.306492+0000","last_became_peered":"2024-05-08T18:31:08.306492+0000","last_unstale":"2024-05-08T18:34:07.309458+0000","last_undegraded":"2024-05-08T18:34:07.309458+0000","last_fullsized":"2024-05-08T18:34:07.309458+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:47:53.084160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271927+0000","last_change":"2024-05-08T18:31:00.299933+0000","last_active":"2024-05-08T18:34:07.271927+0000","last_peered":"2024-05-08T18:34:07.271927+0000","last_clean":"2024-05-08T18:34:07.271927+0000","last_became_active":"2024-05-08T18:31:00.299186+0000","last_became_peered":"2024-05-08T18:31:00.299186+0000","last_unstale":"2024-05-08T18:34:07.271927+0000","last_undegraded":"2024-05-08T18:34:07.271927+0000","last_fullsized":"2024-05-08T18:34:07.271927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:37.968339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337354+0000","last_change":"2024-05-08T18:30:49.982170+0000","last_active":"2024-05-08T18:31:45.337354+0000","last_peered":"2024-05-08T18:31:45.337354+0000","last_clean":"2024-05-08T18:31:45.337354+0000","last_became_active":"2024-05-08T18:30:49.981852+0000","last_became_peered":"2024-05-08T18:30:49.981852+0000","last_unstale":"2024-05-08T18:31:45.337354+0000","last_undegraded":"2024-05-08T18:31:45.337354+0000","last_fullsized":"2024-05-08T18:31:45.337354+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:54.158426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329142+0000","last_change":"2024-05-08T18:30:49.983387+0000","last_active":"2024-05-08T18:31:45.329142+0000","last_peered":"2024-05-08T18:31:45.329142+0000","last_clean":"2024-05-08T18:31:45.329142+0000","last_became_active":"2024-05-08T18:30:49.983023+0000","last_became_peered":"2024-05-08T18:30:49.983023+0000","last_unstale":"2024-05-08T18:31:45.329142+0000","last_undegraded":"2024-05-08T18:31:45.329142+0000","last_fullsized":"2024-05-08T18:31:45.329142+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:49.558123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328133+0000","last_change":"2024-05-08T18:30:58.317086+0000","last_active":"2024-05-08T18:31:45.328133+0000","last_peered":"2024-05-08T18:31:45.328133+0000","last_clean":"2024-05-08T18:31:45.328133+0000","last_became_active":"2024-05-08T18:30:58.316676+0000","last_became_peered":"2024-05-08T18:30:58.316676+0000","last_unstale":"2024-05-08T18:31:45.328133+0000","last_undegraded":"2024-05-08T18:31:45.328133+0000","last_fullsized":"2024-05-08T18:31:45.328133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:59:23.755041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.340362+0000","last_change":"2024-05-08T18:31:45.339419+0000","last_active":"2024-05-08T18:31:45.340362+0000","last_peered":"2024-05-08T18:31:45.340362+0000","last_clean":"2024-05-08T18:31:45.340362+0000","last_became_active":"2024-05-08T18:31:45.339007+0000","last_became_peered":"2024-05-08T18:31:45.339007+0000","last_unstale":"2024-05-08T18:31:45.340362+0000","last_undegraded":"2024-05-08T18:31:45.340362+0000","last_fullsized":"2024-05-08T18:31:45.340362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:27.129227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'76","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.093625+0000","last_change":"2024-05-08T18:31:04.299443+0000","last_active":"2024-05-08T18:33:05.093625+0000","last_peered":"2024-05-08T18:33:05.093625+0000","last_clean":"2024-05-08T18:33:05.093625+0000","last_became_active":"2024-05-08T18:31:04.299145+0000","last_became_peered":"2024-05-08T18:31:04.299145+0000","last_unstale":"2024-05-08T18:33:05.093625+0000","last_undegraded":"2024-05-08T18:33:05.093625+0000","last_fullsized":"2024-05-08T18:33:05.093625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:54.440135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330451+0000","last_change":"2024-05-08T18:31:06.312091+0000","last_active":"2024-05-08T18:31:45.330451+0000","last_peered":"2024-05-08T18:31:45.330451+0000","last_clean":"2024-05-08T18:31:45.330451+0000","last_became_active":"2024-05-08T18:31:06.311742+0000","last_became_peered":"2024-05-08T18:31:06.311742+0000","last_unstale":"2024-05-08T18:31:45.330451+0000","last_undegraded":"2024-05-08T18:31:45.330451+0000","last_fullsized":"2024-05-08T18:31:45.330451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:29:46.597510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'87","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.286528+0000","last_change":"2024-05-08T18:31:08.311008+0000","last_active":"2024-05-08T18:34:07.286528+0000","last_peered":"2024-05-08T18:34:07.286528+0000","last_clean":"2024-05-08T18:34:07.286528+0000","last_became_active":"2024-05-08T18:31:08.310715+0000","last_became_peered":"2024-05-08T18:31:08.310715+0000","last_unstale":"2024-05-08T18:34:07.286528+0000","last_undegraded":"2024-05-08T18:34:07.286528+0000","last_fullsized":"2024-05-08T18:34:07.286528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:34.317569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":173,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.057524+0000","last_change":"2024-05-08T18:31:00.295877+0000","last_active":"2024-05-08T18:34:07.057524+0000","last_peered":"2024-05-08T18:34:07.057524+0000","last_clean":"2024-05-08T18:34:07.057524+0000","last_became_active":"2024-05-08T18:31:00.295578+0000","last_became_peered":"2024-05-08T18:31:00.295578+0000","last_unstale":"2024-05-08T18:34:07.057524+0000","last_undegraded":"2024-05-08T18:34:07.057524+0000","last_fullsized":"2024-05-08T18:34:07.057524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:10.611116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327422+0000","last_change":"2024-05-08T18:30:49.983190+0000","last_active":"2024-05-08T18:31:45.327422+0000","last_peered":"2024-05-08T18:31:45.327422+0000","last_clean":"2024-05-08T18:31:45.327422+0000","last_became_active":"2024-05-08T18:30:49.982854+0000","last_became_peered":"2024-05-08T18:30:49.982854+0000","last_unstale":"2024-05-08T18:31:45.327422+0000","last_undegraded":"2024-05-08T18:31:45.327422+0000","last_fullsized":"2024-05-08T18:31:45.327422+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:33.902157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176047+0000","last_change":"2024-05-08T18:30:58.295078+0000","last_active":"2024-05-08T18:33:03.176047+0000","last_peered":"2024-05-08T18:33:03.176047+0000","last_clean":"2024-05-08T18:33:03.176047+0000","last_became_active":"2024-05-08T18:30:58.294153+0000","last_became_peered":"2024-05-08T18:30:58.294153+0000","last_unstale":"2024-05-08T18:33:03.176047+0000","last_undegraded":"2024-05-08T18:33:03.176047+0000","last_fullsized":"2024-05-08T18:33:03.176047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:18.354135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332227+0000","last_change":"2024-05-08T18:31:02.292269+0000","last_active":"2024-05-08T18:31:45.332227+0000","last_peered":"2024-05-08T18:31:45.332227+0000","last_clean":"2024-05-08T18:31:45.332227+0000","last_became_active":"2024-05-08T18:31:02.291979+0000","last_became_peered":"2024-05-08T18:31:02.291979+0000","last_unstale":"2024-05-08T18:31:45.332227+0000","last_undegraded":"2024-05-08T18:31:45.332227+0000","last_fullsized":"2024-05-08T18:31:45.332227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:39.010234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'274","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370443+0000","last_change":"2024-05-08T18:31:04.299833+0000","last_active":"2024-05-08T18:34:07.370443+0000","last_peered":"2024-05-08T18:34:07.370443+0000","last_clean":"2024-05-08T18:34:07.370443+0000","last_became_active":"2024-05-08T18:31:04.299494+0000","last_became_peered":"2024-05-08T18:31:04.299494+0000","last_unstale":"2024-05-08T18:34:07.370443+0000","last_undegraded":"2024-05-08T18:34:07.370443+0000","last_fullsized":"2024-05-08T18:34:07.370443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:04:48.277052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329374+0000","last_change":"2024-05-08T18:31:06.307338+0000","last_active":"2024-05-08T18:31:45.329374+0000","last_peered":"2024-05-08T18:31:45.329374+0000","last_clean":"2024-05-08T18:31:45.329374+0000","last_became_active":"2024-05-08T18:31:06.306554+0000","last_became_peered":"2024-05-08T18:31:06.306554+0000","last_unstale":"2024-05-08T18:31:45.329374+0000","last_undegraded":"2024-05-08T18:31:45.329374+0000","last_fullsized":"2024-05-08T18:31:45.329374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:32.299617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.867202+0000","last_change":"2024-05-08T18:31:08.316829+0000","last_active":"2024-05-08T18:32:22.867202+0000","last_peered":"2024-05-08T18:32:22.867202+0000","last_clean":"2024-05-08T18:32:22.867202+0000","last_became_active":"2024-05-08T18:31:08.316536+0000","last_became_peered":"2024-05-08T18:31:08.316536+0000","last_unstale":"2024-05-08T18:32:22.867202+0000","last_undegraded":"2024-05-08T18:32:22.867202+0000","last_fullsized":"2024-05-08T18:32:22.867202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:54.836108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'10","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.334094+0000","last_change":"2024-05-08T18:31:00.281674+0000","last_active":"2024-05-08T18:34:07.334094+0000","last_peered":"2024-05-08T18:34:07.334094+0000","last_clean":"2024-05-08T18:34:07.334094+0000","last_became_active":"2024-05-08T18:31:00.281359+0000","last_became_peered":"2024-05-08T18:31:00.281359+0000","last_unstale":"2024-05-08T18:34:07.334094+0000","last_undegraded":"2024-05-08T18:34:07.334094+0000","last_fullsized":"2024-05-08T18:34:07.334094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:21.913096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330082+0000","last_change":"2024-05-08T18:30:49.982800+0000","last_active":"2024-05-08T18:31:45.330082+0000","last_peered":"2024-05-08T18:31:45.330082+0000","last_clean":"2024-05-08T18:31:45.330082+0000","last_became_active":"2024-05-08T18:30:49.982438+0000","last_became_peered":"2024-05-08T18:30:49.982438+0000","last_unstale":"2024-05-08T18:31:45.330082+0000","last_undegraded":"2024-05-08T18:31:45.330082+0000","last_fullsized":"2024-05-08T18:31:45.330082+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:18.664851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328603+0000","last_change":"2024-05-08T18:30:58.294820+0000","last_active":"2024-05-08T18:31:45.328603+0000","last_peered":"2024-05-08T18:31:45.328603+0000","last_clean":"2024-05-08T18:31:45.328603+0000","last_became_active":"2024-05-08T18:30:58.294292+0000","last_became_peered":"2024-05-08T18:30:58.294292+0000","last_unstale":"2024-05-08T18:31:45.328603+0000","last_undegraded":"2024-05-08T18:31:45.328603+0000","last_fullsized":"2024-05-08T18:31:45.328603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:07.501461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330259+0000","last_change":"2024-05-08T18:31:02.292271+0000","last_active":"2024-05-08T18:31:45.330259+0000","last_peered":"2024-05-08T18:31:45.330259+0000","last_clean":"2024-05-08T18:31:45.330259+0000","last_became_active":"2024-05-08T18:31:02.291806+0000","last_became_peered":"2024-05-08T18:31:02.291806+0000","last_unstale":"2024-05-08T18:31:45.330259+0000","last_undegraded":"2024-05-08T18:31:45.330259+0000","last_fullsized":"2024-05-08T18:31:45.330259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:03.635955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370265+0000","last_change":"2024-05-08T18:31:04.303574+0000","last_active":"2024-05-08T18:34:07.370265+0000","last_peered":"2024-05-08T18:34:07.370265+0000","last_clean":"2024-05-08T18:34:07.370265+0000","last_became_active":"2024-05-08T18:31:04.303321+0000","last_became_peered":"2024-05-08T18:31:04.303321+0000","last_unstale":"2024-05-08T18:34:07.370265+0000","last_undegraded":"2024-05-08T18:34:07.370265+0000","last_fullsized":"2024-05-08T18:34:07.370265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:03.432097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330522+0000","last_change":"2024-05-08T18:31:06.309771+0000","last_active":"2024-05-08T18:31:45.330522+0000","last_peered":"2024-05-08T18:31:45.330522+0000","last_clean":"2024-05-08T18:31:45.330522+0000","last_became_active":"2024-05-08T18:31:06.309525+0000","last_became_peered":"2024-05-08T18:31:06.309525+0000","last_unstale":"2024-05-08T18:31:45.330522+0000","last_undegraded":"2024-05-08T18:31:45.330522+0000","last_fullsized":"2024-05-08T18:31:45.330522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:47:23.413504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'8","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327513+0000","last_change":"2024-05-08T18:31:08.314823+0000","last_active":"2024-05-08T18:31:45.327513+0000","last_peered":"2024-05-08T18:31:45.327513+0000","last_clean":"2024-05-08T18:31:45.327513+0000","last_became_active":"2024-05-08T18:31:08.314503+0000","last_became_peered":"2024-05-08T18:31:08.314503+0000","last_unstale":"2024-05-08T18:31:45.327513+0000","last_undegraded":"2024-05-08T18:31:45.327513+0000","last_fullsized":"2024-05-08T18:31:45.327513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:58.072442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.333503+0000","last_change":"2024-05-08T18:31:00.283770+0000","last_active":"2024-05-08T18:33:03.333503+0000","last_peered":"2024-05-08T18:33:03.333503+0000","last_clean":"2024-05-08T18:33:03.333503+0000","last_became_active":"2024-05-08T18:31:00.283410+0000","last_became_peered":"2024-05-08T18:31:00.283410+0000","last_unstale":"2024-05-08T18:33:03.333503+0000","last_undegraded":"2024-05-08T18:33:03.333503+0000","last_fullsized":"2024-05-08T18:33:03.333503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:56.345475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327663+0000","last_change":"2024-05-08T18:30:49.983911+0000","last_active":"2024-05-08T18:31:45.327663+0000","last_peered":"2024-05-08T18:31:45.327663+0000","last_clean":"2024-05-08T18:31:45.327663+0000","last_became_active":"2024-05-08T18:30:49.983515+0000","last_became_peered":"2024-05-08T18:30:49.983515+0000","last_unstale":"2024-05-08T18:31:45.327663+0000","last_undegraded":"2024-05-08T18:31:45.327663+0000","last_fullsized":"2024-05-08T18:31:45.327663+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:40.629929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332492+0000","last_change":"2024-05-08T18:30:58.306622+0000","last_active":"2024-05-08T18:31:45.332492+0000","last_peered":"2024-05-08T18:31:45.332492+0000","last_clean":"2024-05-08T18:31:45.332492+0000","last_became_active":"2024-05-08T18:30:58.306268+0000","last_became_peered":"2024-05-08T18:30:58.306268+0000","last_unstale":"2024-05-08T18:31:45.332492+0000","last_undegraded":"2024-05-08T18:31:45.332492+0000","last_fullsized":"2024-05-08T18:31:45.332492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:07.501461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330794+0000","last_change":"2024-05-08T18:31:02.292466+0000","last_active":"2024-05-08T18:31:45.330794+0000","last_peered":"2024-05-08T18:31:45.330794+0000","last_clean":"2024-05-08T18:31:45.330794+0000","last_became_active":"2024-05-08T18:31:02.292030+0000","last_became_peered":"2024-05-08T18:31:02.292030+0000","last_unstale":"2024-05-08T18:31:45.330794+0000","last_undegraded":"2024-05-08T18:31:45.330794+0000","last_fullsized":"2024-05-08T18:31:45.330794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:24.356014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'13","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.594211+0000","last_change":"2024-05-08T18:31:04.296591+0000","last_active":"2024-05-08T18:34:06.594211+0000","last_peered":"2024-05-08T18:34:06.594211+0000","last_clean":"2024-05-08T18:34:06.594211+0000","last_became_active":"2024-05-08T18:31:04.296257+0000","last_became_peered":"2024-05-08T18:31:04.296257+0000","last_unstale":"2024-05-08T18:34:06.594211+0000","last_undegraded":"2024-05-08T18:34:06.594211+0000","last_fullsized":"2024-05-08T18:34:06.594211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:29.136261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332452+0000","last_change":"2024-05-08T18:31:06.309173+0000","last_active":"2024-05-08T18:31:45.332452+0000","last_peered":"2024-05-08T18:31:45.332452+0000","last_clean":"2024-05-08T18:31:45.332452+0000","last_became_active":"2024-05-08T18:31:06.308892+0000","last_became_peered":"2024-05-08T18:31:06.308892+0000","last_unstale":"2024-05-08T18:31:45.332452+0000","last_undegraded":"2024-05-08T18:31:45.332452+0000","last_fullsized":"2024-05-08T18:31:45.332452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:18.093112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.340083+0000","last_change":"2024-05-08T18:31:08.319035+0000","last_active":"2024-05-08T18:33:06.340083+0000","last_peered":"2024-05-08T18:33:06.340083+0000","last_clean":"2024-05-08T18:33:06.340083+0000","last_became_active":"2024-05-08T18:31:08.318728+0000","last_became_peered":"2024-05-08T18:31:08.318728+0000","last_unstale":"2024-05-08T18:33:06.340083+0000","last_undegraded":"2024-05-08T18:33:06.340083+0000","last_fullsized":"2024-05-08T18:33:06.340083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:14.378528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'3","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:53.184078+0000","last_change":"2024-05-08T18:31:45.344716+0000","last_active":"2024-05-08T18:33:53.184078+0000","last_peered":"2024-05-08T18:33:53.184078+0000","last_clean":"2024-05-08T18:33:53.184078+0000","last_became_active":"2024-05-08T18:31:45.337785+0000","last_became_peered":"2024-05-08T18:31:45.337785+0000","last_unstale":"2024-05-08T18:33:53.184078+0000","last_undegraded":"2024-05-08T18:33:53.184078+0000","last_fullsized":"2024-05-08T18:33:53.184078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:46.808130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.419073+0000","last_change":"2024-05-08T18:30:58.302684+0000","last_active":"2024-05-08T18:33:06.419073+0000","last_peered":"2024-05-08T18:33:06.419073+0000","last_clean":"2024-05-08T18:33:06.419073+0000","last_became_active":"2024-05-08T18:30:58.302328+0000","last_became_peered":"2024-05-08T18:30:58.302328+0000","last_unstale":"2024-05-08T18:33:06.419073+0000","last_undegraded":"2024-05-08T18:33:06.419073+0000","last_fullsized":"2024-05-08T18:33:06.419073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:26.528845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330056+0000","last_change":"2024-05-08T18:30:49.983824+0000","last_active":"2024-05-08T18:31:45.330056+0000","last_peered":"2024-05-08T18:31:45.330056+0000","last_clean":"2024-05-08T18:31:45.330056+0000","last_became_active":"2024-05-08T18:30:49.983522+0000","last_became_peered":"2024-05-08T18:30:49.983522+0000","last_unstale":"2024-05-08T18:31:45.330056+0000","last_undegraded":"2024-05-08T18:31:45.330056+0000","last_fullsized":"2024-05-08T18:31:45.330056+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:18.812194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.176791+0000","last_change":"2024-05-08T18:31:02.294921+0000","last_active":"2024-05-08T18:33:08.176791+0000","last_peered":"2024-05-08T18:33:08.176791+0000","last_clean":"2024-05-08T18:33:08.176791+0000","last_became_active":"2024-05-08T18:31:02.294603+0000","last_became_peered":"2024-05-08T18:31:02.294603+0000","last_unstale":"2024-05-08T18:33:08.176791+0000","last_undegraded":"2024-05-08T18:33:08.176791+0000","last_fullsized":"2024-05-08T18:33:08.176791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:32.998440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'62","reported_seq":121,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.929072+0000","last_change":"2024-05-08T18:31:04.295377+0000","last_active":"2024-05-08T18:34:06.929072+0000","last_peered":"2024-05-08T18:34:06.929072+0000","last_clean":"2024-05-08T18:34:06.929072+0000","last_became_active":"2024-05-08T18:31:04.295090+0000","last_became_peered":"2024-05-08T18:31:04.295090+0000","last_unstale":"2024-05-08T18:34:06.929072+0000","last_undegraded":"2024-05-08T18:34:06.929072+0000","last_fullsized":"2024-05-08T18:34:06.929072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:24.176022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":61,"num_read_kb":49,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330265+0000","last_change":"2024-05-08T18:31:06.312460+0000","last_active":"2024-05-08T18:31:45.330265+0000","last_peered":"2024-05-08T18:31:45.330265+0000","last_clean":"2024-05-08T18:31:45.330265+0000","last_became_active":"2024-05-08T18:31:06.312179+0000","last_became_peered":"2024-05-08T18:31:06.312179+0000","last_unstale":"2024-05-08T18:31:45.330265+0000","last_undegraded":"2024-05-08T18:31:45.330265+0000","last_fullsized":"2024-05-08T18:31:45.330265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:03.281754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.521191+0000","last_change":"2024-05-08T18:31:08.306655+0000","last_active":"2024-05-08T18:33:06.521191+0000","last_peered":"2024-05-08T18:33:06.521191+0000","last_clean":"2024-05-08T18:33:06.521191+0000","last_became_active":"2024-05-08T18:31:08.304818+0000","last_became_peered":"2024-05-08T18:31:08.304818+0000","last_unstale":"2024-05-08T18:33:06.521191+0000","last_undegraded":"2024-05-08T18:33:06.521191+0000","last_fullsized":"2024-05-08T18:33:06.521191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:38.400920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.057661+0000","last_change":"2024-05-08T18:31:00.294763+0000","last_active":"2024-05-08T18:34:07.057661+0000","last_peered":"2024-05-08T18:34:07.057661+0000","last_clean":"2024-05-08T18:34:07.057661+0000","last_became_active":"2024-05-08T18:31:00.294157+0000","last_became_peered":"2024-05-08T18:31:00.294157+0000","last_unstale":"2024-05-08T18:34:07.057661+0000","last_undegraded":"2024-05-08T18:34:07.057661+0000","last_fullsized":"2024-05-08T18:34:07.057661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:41.794217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176107+0000","last_change":"2024-05-08T18:30:58.288464+0000","last_active":"2024-05-08T18:33:03.176107+0000","last_peered":"2024-05-08T18:33:03.176107+0000","last_clean":"2024-05-08T18:33:03.176107+0000","last_became_active":"2024-05-08T18:30:58.286578+0000","last_became_peered":"2024-05-08T18:30:58.286578+0000","last_unstale":"2024-05-08T18:33:03.176107+0000","last_undegraded":"2024-05-08T18:33:03.176107+0000","last_fullsized":"2024-05-08T18:33:03.176107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:46.459524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329948+0000","last_change":"2024-05-08T18:30:49.982777+0000","last_active":"2024-05-08T18:31:45.329948+0000","last_peered":"2024-05-08T18:31:45.329948+0000","last_clean":"2024-05-08T18:31:45.329948+0000","last_became_active":"2024-05-08T18:30:49.982471+0000","last_became_peered":"2024-05-08T18:30:49.982471+0000","last_unstale":"2024-05-08T18:31:45.329948+0000","last_undegraded":"2024-05-08T18:31:45.329948+0000","last_fullsized":"2024-05-08T18:31:45.329948+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:54.349839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327459+0000","last_change":"2024-05-08T18:31:02.288838+0000","last_active":"2024-05-08T18:31:45.327459+0000","last_peered":"2024-05-08T18:31:45.327459+0000","last_clean":"2024-05-08T18:31:45.327459+0000","last_became_active":"2024-05-08T18:31:02.287974+0000","last_became_peered":"2024-05-08T18:31:02.287974+0000","last_unstale":"2024-05-08T18:31:45.327459+0000","last_undegraded":"2024-05-08T18:31:45.327459+0000","last_fullsized":"2024-05-08T18:31:45.327459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:05.696133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'15","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178044+0000","last_change":"2024-05-08T18:31:04.301545+0000","last_active":"2024-05-08T18:33:13.178044+0000","last_peered":"2024-05-08T18:33:13.178044+0000","last_clean":"2024-05-08T18:33:13.178044+0000","last_became_active":"2024-05-08T18:31:04.301116+0000","last_became_peered":"2024-05-08T18:31:04.301116+0000","last_unstale":"2024-05-08T18:33:13.178044+0000","last_undegraded":"2024-05-08T18:33:13.178044+0000","last_fullsized":"2024-05-08T18:33:13.178044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:26.009674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'282","reported_seq":374,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370404+0000","last_change":"2024-05-08T18:31:06.308742+0000","last_active":"2024-05-08T18:34:07.370404+0000","last_peered":"2024-05-08T18:34:07.370404+0000","last_clean":"2024-05-08T18:34:07.370404+0000","last_became_active":"2024-05-08T18:31:06.308274+0000","last_became_peered":"2024-05-08T18:31:06.308274+0000","last_unstale":"2024-05-08T18:34:07.370404+0000","last_undegraded":"2024-05-08T18:34:07.370404+0000","last_fullsized":"2024-05-08T18:34:07.370404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:57.121163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331379+0000","last_change":"2024-05-08T18:31:08.318932+0000","last_active":"2024-05-08T18:31:45.331379+0000","last_peered":"2024-05-08T18:31:45.331379+0000","last_clean":"2024-05-08T18:31:45.331379+0000","last_became_active":"2024-05-08T18:31:08.318609+0000","last_became_peered":"2024-05-08T18:31:08.318609+0000","last_unstale":"2024-05-08T18:31:45.331379+0000","last_undegraded":"2024-05-08T18:31:45.331379+0000","last_fullsized":"2024-05-08T18:31:45.331379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:50.231594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328412+0000","last_change":"2024-05-08T18:31:00.291567+0000","last_active":"2024-05-08T18:31:45.328412+0000","last_peered":"2024-05-08T18:31:45.328412+0000","last_clean":"2024-05-08T18:31:45.328412+0000","last_became_active":"2024-05-08T18:31:00.291093+0000","last_became_peered":"2024-05-08T18:31:00.291093+0000","last_unstale":"2024-05-08T18:31:45.328412+0000","last_undegraded":"2024-05-08T18:31:45.328412+0000","last_fullsized":"2024-05-08T18:31:45.328412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:53.284230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333265+0000","last_change":"2024-05-08T18:30:58.306520+0000","last_active":"2024-05-08T18:31:45.333265+0000","last_peered":"2024-05-08T18:31:45.333265+0000","last_clean":"2024-05-08T18:31:45.333265+0000","last_became_active":"2024-05-08T18:30:58.305915+0000","last_became_peered":"2024-05-08T18:30:58.305915+0000","last_unstale":"2024-05-08T18:31:45.333265+0000","last_undegraded":"2024-05-08T18:31:45.333265+0000","last_fullsized":"2024-05-08T18:31:45.333265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:35.822576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330715+0000","last_change":"2024-05-08T18:30:49.982641+0000","last_active":"2024-05-08T18:31:45.330715+0000","last_peered":"2024-05-08T18:31:45.330715+0000","last_clean":"2024-05-08T18:31:45.330715+0000","last_became_active":"2024-05-08T18:30:49.982330+0000","last_became_peered":"2024-05-08T18:30:49.982330+0000","last_unstale":"2024-05-08T18:31:45.330715+0000","last_undegraded":"2024-05-08T18:31:45.330715+0000","last_fullsized":"2024-05-08T18:31:45.330715+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:18.664851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327471+0000","last_change":"2024-05-08T18:31:02.292781+0000","last_active":"2024-05-08T18:31:45.327471+0000","last_peered":"2024-05-08T18:31:45.327471+0000","last_clean":"2024-05-08T18:31:45.327471+0000","last_became_active":"2024-05-08T18:31:02.292328+0000","last_became_peered":"2024-05-08T18:31:02.292328+0000","last_unstale":"2024-05-08T18:31:45.327471+0000","last_undegraded":"2024-05-08T18:31:45.327471+0000","last_fullsized":"2024-05-08T18:31:45.327471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:57.704727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328449+0000","last_change":"2024-05-08T18:31:04.302579+0000","last_active":"2024-05-08T18:31:45.328449+0000","last_peered":"2024-05-08T18:31:45.328449+0000","last_clean":"2024-05-08T18:31:45.328449+0000","last_became_active":"2024-05-08T18:31:04.302020+0000","last_became_peered":"2024-05-08T18:31:04.302020+0000","last_unstale":"2024-05-08T18:31:45.328449+0000","last_undegraded":"2024-05-08T18:31:45.328449+0000","last_fullsized":"2024-05-08T18:31:45.328449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:32.125730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'282","reported_seq":389,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.381934+0000","last_change":"2024-05-08T18:31:06.305364+0000","last_active":"2024-05-08T18:34:07.381934+0000","last_peered":"2024-05-08T18:34:07.381934+0000","last_clean":"2024-05-08T18:34:07.381934+0000","last_became_active":"2024-05-08T18:31:06.305020+0000","last_became_peered":"2024-05-08T18:31:06.305020+0000","last_unstale":"2024-05-08T18:34:07.381934+0000","last_undegraded":"2024-05-08T18:34:07.381934+0000","last_fullsized":"2024-05-08T18:34:07.381934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:01.875049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333286+0000","last_change":"2024-05-08T18:31:08.310217+0000","last_active":"2024-05-08T18:31:45.333286+0000","last_peered":"2024-05-08T18:31:45.333286+0000","last_clean":"2024-05-08T18:31:45.333286+0000","last_became_active":"2024-05-08T18:31:08.309869+0000","last_became_peered":"2024-05-08T18:31:08.309869+0000","last_unstale":"2024-05-08T18:31:45.333286+0000","last_undegraded":"2024-05-08T18:31:45.333286+0000","last_fullsized":"2024-05-08T18:31:45.333286+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:36.670228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331588+0000","last_change":"2024-05-08T18:31:00.297171+0000","last_active":"2024-05-08T18:31:45.331588+0000","last_peered":"2024-05-08T18:31:45.331588+0000","last_clean":"2024-05-08T18:31:45.331588+0000","last_became_active":"2024-05-08T18:31:00.296431+0000","last_became_peered":"2024-05-08T18:31:00.296431+0000","last_unstale":"2024-05-08T18:31:45.331588+0000","last_undegraded":"2024-05-08T18:31:45.331588+0000","last_fullsized":"2024-05-08T18:31:45.331588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:19:18.458032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336437+0000","last_change":"2024-05-08T18:30:58.304887+0000","last_active":"2024-05-08T18:31:45.336437+0000","last_peered":"2024-05-08T18:31:45.336437+0000","last_clean":"2024-05-08T18:31:45.336437+0000","last_became_active":"2024-05-08T18:30:58.303997+0000","last_became_peered":"2024-05-08T18:30:58.303997+0000","last_unstale":"2024-05-08T18:31:45.336437+0000","last_undegraded":"2024-05-08T18:31:45.336437+0000","last_fullsized":"2024-05-08T18:31:45.336437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:34.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332663+0000","last_change":"2024-05-08T18:30:49.984897+0000","last_active":"2024-05-08T18:31:45.332663+0000","last_peered":"2024-05-08T18:31:45.332663+0000","last_clean":"2024-05-08T18:31:45.332663+0000","last_became_active":"2024-05-08T18:30:49.984280+0000","last_became_peered":"2024-05-08T18:30:49.984280+0000","last_unstale":"2024-05-08T18:31:45.332663+0000","last_undegraded":"2024-05-08T18:31:45.332663+0000","last_fullsized":"2024-05-08T18:31:45.332663+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:26.601806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327309+0000","last_change":"2024-05-08T18:31:02.290848+0000","last_active":"2024-05-08T18:31:45.327309+0000","last_peered":"2024-05-08T18:31:45.327309+0000","last_clean":"2024-05-08T18:31:45.327309+0000","last_became_active":"2024-05-08T18:31:02.290540+0000","last_became_peered":"2024-05-08T18:31:02.290540+0000","last_unstale":"2024-05-08T18:31:45.327309+0000","last_undegraded":"2024-05-08T18:31:45.327309+0000","last_fullsized":"2024-05-08T18:31:45.327309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:13.954253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'82","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.079634+0000","last_change":"2024-05-08T18:31:04.304969+0000","last_active":"2024-05-08T18:33:05.079634+0000","last_peered":"2024-05-08T18:33:05.079634+0000","last_clean":"2024-05-08T18:33:05.079634+0000","last_became_active":"2024-05-08T18:31:04.304669+0000","last_became_peered":"2024-05-08T18:31:04.304669+0000","last_unstale":"2024-05-08T18:33:05.079634+0000","last_undegraded":"2024-05-08T18:33:05.079634+0000","last_fullsized":"2024-05-08T18:33:05.079634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:46.499999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328793+0000","last_change":"2024-05-08T18:31:06.308900+0000","last_active":"2024-05-08T18:31:45.328793+0000","last_peered":"2024-05-08T18:31:45.328793+0000","last_clean":"2024-05-08T18:31:45.328793+0000","last_became_active":"2024-05-08T18:31:06.308621+0000","last_became_peered":"2024-05-08T18:31:06.308621+0000","last_unstale":"2024-05-08T18:31:45.328793+0000","last_undegraded":"2024-05-08T18:31:45.328793+0000","last_fullsized":"2024-05-08T18:31:45.328793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:09.710680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.335673+0000","last_change":"2024-05-08T18:31:08.308718+0000","last_active":"2024-05-08T18:34:07.335673+0000","last_peered":"2024-05-08T18:34:07.335673+0000","last_clean":"2024-05-08T18:34:07.335673+0000","last_became_active":"2024-05-08T18:31:08.308427+0000","last_became_peered":"2024-05-08T18:31:08.308427+0000","last_unstale":"2024-05-08T18:34:07.335673+0000","last_undegraded":"2024-05-08T18:34:07.335673+0000","last_fullsized":"2024-05-08T18:34:07.335673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:19.975648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330856+0000","last_change":"2024-05-08T18:31:08.315548+0000","last_active":"2024-05-08T18:31:45.330856+0000","last_peered":"2024-05-08T18:31:45.330856+0000","last_clean":"2024-05-08T18:31:45.330856+0000","last_became_active":"2024-05-08T18:31:08.315257+0000","last_became_peered":"2024-05-08T18:31:08.315257+0000","last_unstale":"2024-05-08T18:31:45.330856+0000","last_undegraded":"2024-05-08T18:31:45.330856+0000","last_fullsized":"2024-05-08T18:31:45.330856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:51.132007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'11","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.064332+0000","last_change":"2024-05-08T18:31:00.295123+0000","last_active":"2024-05-08T18:34:07.064332+0000","last_peered":"2024-05-08T18:34:07.064332+0000","last_clean":"2024-05-08T18:34:07.064332+0000","last_became_active":"2024-05-08T18:31:00.294827+0000","last_became_peered":"2024-05-08T18:31:00.294827+0000","last_unstale":"2024-05-08T18:34:07.064332+0000","last_undegraded":"2024-05-08T18:34:07.064332+0000","last_fullsized":"2024-05-08T18:34:07.064332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:55.191334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.174101+0000","last_change":"2024-05-08T18:30:58.313343+0000","last_active":"2024-05-08T18:34:07.174101+0000","last_peered":"2024-05-08T18:34:07.174101+0000","last_clean":"2024-05-08T18:34:07.174101+0000","last_became_active":"2024-05-08T18:30:58.313034+0000","last_became_peered":"2024-05-08T18:30:58.313034+0000","last_unstale":"2024-05-08T18:34:07.174101+0000","last_undegraded":"2024-05-08T18:34:07.174101+0000","last_fullsized":"2024-05-08T18:34:07.174101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:55.941415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334770+0000","last_change":"2024-05-08T18:31:02.291732+0000","last_active":"2024-05-08T18:31:45.334770+0000","last_peered":"2024-05-08T18:31:45.334770+0000","last_clean":"2024-05-08T18:31:45.334770+0000","last_became_active":"2024-05-08T18:31:02.291119+0000","last_became_peered":"2024-05-08T18:31:02.291119+0000","last_unstale":"2024-05-08T18:31:45.334770+0000","last_undegraded":"2024-05-08T18:31:45.334770+0000","last_fullsized":"2024-05-08T18:31:45.334770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:50.745635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.086081+0000","last_change":"2024-05-08T18:31:04.301279+0000","last_active":"2024-05-08T18:33:05.086081+0000","last_peered":"2024-05-08T18:33:05.086081+0000","last_clean":"2024-05-08T18:33:05.086081+0000","last_became_active":"2024-05-08T18:31:04.300990+0000","last_became_peered":"2024-05-08T18:31:04.300990+0000","last_unstale":"2024-05-08T18:33:05.086081+0000","last_undegraded":"2024-05-08T18:33:05.086081+0000","last_fullsized":"2024-05-08T18:33:05.086081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:40.615427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329018+0000","last_change":"2024-05-08T18:31:06.315203+0000","last_active":"2024-05-08T18:31:45.329018+0000","last_peered":"2024-05-08T18:31:45.329018+0000","last_clean":"2024-05-08T18:31:45.329018+0000","last_became_active":"2024-05-08T18:31:06.314696+0000","last_became_peered":"2024-05-08T18:31:06.314696+0000","last_unstale":"2024-05-08T18:31:45.329018+0000","last_undegraded":"2024-05-08T18:31:45.329018+0000","last_fullsized":"2024-05-08T18:31:45.329018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:41.839545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.795512+0000","last_change":"2024-05-08T18:31:08.319177+0000","last_active":"2024-05-08T18:33:04.795512+0000","last_peered":"2024-05-08T18:33:04.795512+0000","last_clean":"2024-05-08T18:33:04.795512+0000","last_became_active":"2024-05-08T18:31:08.318901+0000","last_became_peered":"2024-05-08T18:31:08.318901+0000","last_unstale":"2024-05-08T18:33:04.795512+0000","last_undegraded":"2024-05-08T18:33:04.795512+0000","last_fullsized":"2024-05-08T18:33:04.795512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:21.670979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.870376+0000","last_change":"2024-05-08T18:31:00.293009+0000","last_active":"2024-05-08T18:32:22.870376+0000","last_peered":"2024-05-08T18:32:22.870376+0000","last_clean":"2024-05-08T18:32:22.870376+0000","last_became_active":"2024-05-08T18:31:00.292376+0000","last_became_peered":"2024-05-08T18:31:00.292376+0000","last_unstale":"2024-05-08T18:32:22.870376+0000","last_undegraded":"2024-05-08T18:32:22.870376+0000","last_fullsized":"2024-05-08T18:32:22.870376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:09.586689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329734+0000","last_change":"2024-05-08T18:30:58.301858+0000","last_active":"2024-05-08T18:31:45.329734+0000","last_peered":"2024-05-08T18:31:45.329734+0000","last_clean":"2024-05-08T18:31:45.329734+0000","last_became_active":"2024-05-08T18:30:58.301520+0000","last_became_peered":"2024-05-08T18:30:58.301520+0000","last_unstale":"2024-05-08T18:31:45.329734+0000","last_undegraded":"2024-05-08T18:31:45.329734+0000","last_fullsized":"2024-05-08T18:31:45.329734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:46.459524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328015+0000","last_change":"2024-05-08T18:31:02.293828+0000","last_active":"2024-05-08T18:31:45.328015+0000","last_peered":"2024-05-08T18:31:45.328015+0000","last_clean":"2024-05-08T18:31:45.328015+0000","last_became_active":"2024-05-08T18:31:02.293459+0000","last_became_peered":"2024-05-08T18:31:02.293459+0000","last_unstale":"2024-05-08T18:31:45.328015+0000","last_undegraded":"2024-05-08T18:31:45.328015+0000","last_fullsized":"2024-05-08T18:31:45.328015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:45.110612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.598503+0000","last_change":"2024-05-08T18:31:04.298674+0000","last_active":"2024-05-08T18:34:06.598503+0000","last_peered":"2024-05-08T18:34:06.598503+0000","last_clean":"2024-05-08T18:34:06.598503+0000","last_became_active":"2024-05-08T18:31:04.298237+0000","last_became_peered":"2024-05-08T18:31:04.298237+0000","last_unstale":"2024-05-08T18:34:06.598503+0000","last_undegraded":"2024-05-08T18:34:06.598503+0000","last_fullsized":"2024-05-08T18:34:06.598503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:57.297845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329847+0000","last_change":"2024-05-08T18:31:06.307437+0000","last_active":"2024-05-08T18:31:45.329847+0000","last_peered":"2024-05-08T18:31:45.329847+0000","last_clean":"2024-05-08T18:31:45.329847+0000","last_became_active":"2024-05-08T18:31:06.307048+0000","last_became_peered":"2024-05-08T18:31:06.307048+0000","last_unstale":"2024-05-08T18:31:45.329847+0000","last_undegraded":"2024-05-08T18:31:45.329847+0000","last_fullsized":"2024-05-08T18:31:45.329847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:21:52.918678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329757+0000","last_change":"2024-05-08T18:31:08.314432+0000","last_active":"2024-05-08T18:31:45.329757+0000","last_peered":"2024-05-08T18:31:45.329757+0000","last_clean":"2024-05-08T18:31:45.329757+0000","last_became_active":"2024-05-08T18:31:08.313943+0000","last_became_peered":"2024-05-08T18:31:08.313943+0000","last_unstale":"2024-05-08T18:31:45.329757+0000","last_undegraded":"2024-05-08T18:31:45.329757+0000","last_fullsized":"2024-05-08T18:31:45.329757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:40.327081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271781+0000","last_change":"2024-05-08T18:31:00.286107+0000","last_active":"2024-05-08T18:34:07.271781+0000","last_peered":"2024-05-08T18:34:07.271781+0000","last_clean":"2024-05-08T18:34:07.271781+0000","last_became_active":"2024-05-08T18:31:00.285842+0000","last_became_peered":"2024-05-08T18:31:00.285842+0000","last_unstale":"2024-05-08T18:34:07.271781+0000","last_undegraded":"2024-05-08T18:34:07.271781+0000","last_fullsized":"2024-05-08T18:34:07.271781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:19.399639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336683+0000","last_change":"2024-05-08T18:30:58.303703+0000","last_active":"2024-05-08T18:31:45.336683+0000","last_peered":"2024-05-08T18:31:45.336683+0000","last_clean":"2024-05-08T18:31:45.336683+0000","last_became_active":"2024-05-08T18:30:58.303112+0000","last_became_peered":"2024-05-08T18:30:58.303112+0000","last_unstale":"2024-05-08T18:31:45.336683+0000","last_undegraded":"2024-05-08T18:31:45.336683+0000","last_fullsized":"2024-05-08T18:31:45.336683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:25.031288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331560+0000","last_change":"2024-05-08T18:31:02.295088+0000","last_active":"2024-05-08T18:31:45.331560+0000","last_peered":"2024-05-08T18:31:45.331560+0000","last_clean":"2024-05-08T18:31:45.331560+0000","last_became_active":"2024-05-08T18:31:02.294812+0000","last_became_peered":"2024-05-08T18:31:02.294812+0000","last_unstale":"2024-05-08T18:31:45.331560+0000","last_undegraded":"2024-05-08T18:31:45.331560+0000","last_fullsized":"2024-05-08T18:31:45.331560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:59.466223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'40","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.660807+0000","last_change":"2024-05-08T18:31:04.302309+0000","last_active":"2024-05-08T18:34:06.660807+0000","last_peered":"2024-05-08T18:34:06.660807+0000","last_clean":"2024-05-08T18:34:06.660807+0000","last_became_active":"2024-05-08T18:31:04.301969+0000","last_became_peered":"2024-05-08T18:31:04.301969+0000","last_unstale":"2024-05-08T18:34:06.660807+0000","last_undegraded":"2024-05-08T18:34:06.660807+0000","last_fullsized":"2024-05-08T18:34:06.660807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:14.097510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334470+0000","last_change":"2024-05-08T18:31:06.306660+0000","last_active":"2024-05-08T18:31:45.334470+0000","last_peered":"2024-05-08T18:31:45.334470+0000","last_clean":"2024-05-08T18:31:45.334470+0000","last_became_active":"2024-05-08T18:31:06.306346+0000","last_became_peered":"2024-05-08T18:31:06.306346+0000","last_unstale":"2024-05-08T18:31:45.334470+0000","last_undegraded":"2024-05-08T18:31:45.334470+0000","last_fullsized":"2024-05-08T18:31:45.334470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:47:23.413504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328038+0000","last_change":"2024-05-08T18:31:08.317029+0000","last_active":"2024-05-08T18:31:45.328038+0000","last_peered":"2024-05-08T18:31:45.328038+0000","last_clean":"2024-05-08T18:31:45.328038+0000","last_became_active":"2024-05-08T18:31:08.316673+0000","last_became_peered":"2024-05-08T18:31:08.316673+0000","last_unstale":"2024-05-08T18:31:45.328038+0000","last_undegraded":"2024-05-08T18:31:45.328038+0000","last_fullsized":"2024-05-08T18:31:45.328038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:47.053479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327883+0000","last_change":"2024-05-08T18:31:00.291577+0000","last_active":"2024-05-08T18:31:45.327883+0000","last_peered":"2024-05-08T18:31:45.327883+0000","last_clean":"2024-05-08T18:31:45.327883+0000","last_became_active":"2024-05-08T18:31:00.291163+0000","last_became_peered":"2024-05-08T18:31:00.291163+0000","last_unstale":"2024-05-08T18:31:45.327883+0000","last_undegraded":"2024-05-08T18:31:45.327883+0000","last_fullsized":"2024-05-08T18:31:45.327883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:38.677165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.323955+0000","last_change":"2024-05-08T18:30:58.305036+0000","last_active":"2024-05-08T18:33:03.323955+0000","last_peered":"2024-05-08T18:33:03.323955+0000","last_clean":"2024-05-08T18:33:03.323955+0000","last_became_active":"2024-05-08T18:30:58.304135+0000","last_became_peered":"2024-05-08T18:30:58.304135+0000","last_unstale":"2024-05-08T18:33:03.323955+0000","last_undegraded":"2024-05-08T18:33:03.323955+0000","last_fullsized":"2024-05-08T18:33:03.323955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:26.528845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327635+0000","last_change":"2024-05-08T18:31:02.290480+0000","last_active":"2024-05-08T18:31:45.327635+0000","last_peered":"2024-05-08T18:31:45.327635+0000","last_clean":"2024-05-08T18:31:45.327635+0000","last_became_active":"2024-05-08T18:31:02.290191+0000","last_became_peered":"2024-05-08T18:31:02.290191+0000","last_unstale":"2024-05-08T18:31:45.327635+0000","last_undegraded":"2024-05-08T18:31:45.327635+0000","last_fullsized":"2024-05-08T18:31:45.327635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:53.106616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.071221+0000","last_change":"2024-05-08T18:31:04.295526+0000","last_active":"2024-05-08T18:33:05.071221+0000","last_peered":"2024-05-08T18:33:05.071221+0000","last_clean":"2024-05-08T18:33:05.071221+0000","last_became_active":"2024-05-08T18:31:04.295255+0000","last_became_peered":"2024-05-08T18:31:04.295255+0000","last_unstale":"2024-05-08T18:33:05.071221+0000","last_undegraded":"2024-05-08T18:33:05.071221+0000","last_fullsized":"2024-05-08T18:33:05.071221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:47.180901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330989+0000","last_change":"2024-05-08T18:31:06.305114+0000","last_active":"2024-05-08T18:31:45.330989+0000","last_peered":"2024-05-08T18:31:45.330989+0000","last_clean":"2024-05-08T18:31:45.330989+0000","last_became_active":"2024-05-08T18:31:06.304851+0000","last_became_peered":"2024-05-08T18:31:06.304851+0000","last_unstale":"2024-05-08T18:31:45.330989+0000","last_undegraded":"2024-05-08T18:31:45.330989+0000","last_fullsized":"2024-05-08T18:31:45.330989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:36.598673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'8","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.580774+0000","last_change":"2024-05-08T18:31:45.343090+0000","last_active":"2024-05-08T18:33:06.580774+0000","last_peered":"2024-05-08T18:33:06.580774+0000","last_clean":"2024-05-08T18:33:06.580774+0000","last_became_active":"2024-05-08T18:31:45.336717+0000","last_became_peered":"2024-05-08T18:31:45.336717+0000","last_unstale":"2024-05-08T18:33:06.580774+0000","last_undegraded":"2024-05-08T18:33:06.580774+0000","last_fullsized":"2024-05-08T18:33:06.580774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:06.350550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327536+0000","last_change":"2024-05-08T18:30:58.303784+0000","last_active":"2024-05-08T18:31:45.327536+0000","last_peered":"2024-05-08T18:31:45.327536+0000","last_clean":"2024-05-08T18:31:45.327536+0000","last_became_active":"2024-05-08T18:30:58.302486+0000","last_became_peered":"2024-05-08T18:30:58.302486+0000","last_unstale":"2024-05-08T18:31:45.327536+0000","last_undegraded":"2024-05-08T18:31:45.327536+0000","last_fullsized":"2024-05-08T18:31:45.327536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:19.905174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330661+0000","last_change":"2024-05-08T18:31:02.292304+0000","last_active":"2024-05-08T18:31:45.330661+0000","last_peered":"2024-05-08T18:31:45.330661+0000","last_clean":"2024-05-08T18:31:45.330661+0000","last_became_active":"2024-05-08T18:31:02.291965+0000","last_became_peered":"2024-05-08T18:31:02.291965+0000","last_unstale":"2024-05-08T18:31:45.330661+0000","last_undegraded":"2024-05-08T18:31:45.330661+0000","last_fullsized":"2024-05-08T18:31:45.330661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:45.173868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.092410+0000","last_change":"2024-05-08T18:31:04.298401+0000","last_active":"2024-05-08T18:33:05.092410+0000","last_peered":"2024-05-08T18:33:05.092410+0000","last_clean":"2024-05-08T18:33:05.092410+0000","last_became_active":"2024-05-08T18:31:04.298061+0000","last_became_peered":"2024-05-08T18:31:04.298061+0000","last_unstale":"2024-05-08T18:33:05.092410+0000","last_undegraded":"2024-05-08T18:33:05.092410+0000","last_fullsized":"2024-05-08T18:33:05.092410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:36.394225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329659+0000","last_change":"2024-05-08T18:31:06.308566+0000","last_active":"2024-05-08T18:31:45.329659+0000","last_peered":"2024-05-08T18:31:45.329659+0000","last_clean":"2024-05-08T18:31:45.329659+0000","last_became_active":"2024-05-08T18:31:06.308247+0000","last_became_peered":"2024-05-08T18:31:06.308247+0000","last_unstale":"2024-05-08T18:31:45.329659+0000","last_undegraded":"2024-05-08T18:31:45.329659+0000","last_fullsized":"2024-05-08T18:31:45.329659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:43.989468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.059608+0000","last_change":"2024-05-08T18:31:08.314319+0000","last_active":"2024-05-08T18:34:07.059608+0000","last_peered":"2024-05-08T18:34:07.059608+0000","last_clean":"2024-05-08T18:34:07.059608+0000","last_became_active":"2024-05-08T18:31:08.313986+0000","last_became_peered":"2024-05-08T18:31:08.313986+0000","last_unstale":"2024-05-08T18:34:07.059608+0000","last_undegraded":"2024-05-08T18:34:07.059608+0000","last_fullsized":"2024-05-08T18:34:07.059608+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:34.156497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.240343+0000","last_change":"2024-05-08T18:31:00.281726+0000","last_active":"2024-05-08T18:34:07.240343+0000","last_peered":"2024-05-08T18:34:07.240343+0000","last_clean":"2024-05-08T18:34:07.240343+0000","last_became_active":"2024-05-08T18:31:00.281233+0000","last_became_peered":"2024-05-08T18:31:00.281233+0000","last_unstale":"2024-05-08T18:34:07.240343+0000","last_undegraded":"2024-05-08T18:34:07.240343+0000","last_fullsized":"2024-05-08T18:34:07.240343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:16:11.480889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334233+0000","last_change":"2024-05-08T18:30:58.290021+0000","last_active":"2024-05-08T18:31:45.334233+0000","last_peered":"2024-05-08T18:31:45.334233+0000","last_clean":"2024-05-08T18:31:45.334233+0000","last_became_active":"2024-05-08T18:30:58.289251+0000","last_became_peered":"2024-05-08T18:30:58.289251+0000","last_unstale":"2024-05-08T18:31:45.334233+0000","last_undegraded":"2024-05-08T18:31:45.334233+0000","last_fullsized":"2024-05-08T18:31:45.334233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:33.046479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332268+0000","last_change":"2024-05-08T18:31:02.293460+0000","last_active":"2024-05-08T18:31:45.332268+0000","last_peered":"2024-05-08T18:31:45.332268+0000","last_clean":"2024-05-08T18:31:45.332268+0000","last_became_active":"2024-05-08T18:31:02.293185+0000","last_became_peered":"2024-05-08T18:31:02.293185+0000","last_unstale":"2024-05-08T18:31:45.332268+0000","last_undegraded":"2024-05-08T18:31:45.332268+0000","last_fullsized":"2024-05-08T18:31:45.332268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:43.800799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.072164+0000","last_change":"2024-05-08T18:31:04.298821+0000","last_active":"2024-05-08T18:33:05.072164+0000","last_peered":"2024-05-08T18:33:05.072164+0000","last_clean":"2024-05-08T18:33:05.072164+0000","last_became_active":"2024-05-08T18:31:04.298482+0000","last_became_peered":"2024-05-08T18:31:04.298482+0000","last_unstale":"2024-05-08T18:33:05.072164+0000","last_undegraded":"2024-05-08T18:33:05.072164+0000","last_fullsized":"2024-05-08T18:33:05.072164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:16.451277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336190+0000","last_change":"2024-05-08T18:31:06.311670+0000","last_active":"2024-05-08T18:31:45.336190+0000","last_peered":"2024-05-08T18:31:45.336190+0000","last_clean":"2024-05-08T18:31:45.336190+0000","last_became_active":"2024-05-08T18:31:06.311392+0000","last_became_peered":"2024-05-08T18:31:06.311392+0000","last_unstale":"2024-05-08T18:31:45.336190+0000","last_undegraded":"2024-05-08T18:31:45.336190+0000","last_fullsized":"2024-05-08T18:31:45.336190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:17.968800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327375+0000","last_change":"2024-05-08T18:31:08.319678+0000","last_active":"2024-05-08T18:31:45.327375+0000","last_peered":"2024-05-08T18:31:45.327375+0000","last_clean":"2024-05-08T18:31:45.327375+0000","last_became_active":"2024-05-08T18:31:08.319394+0000","last_became_peered":"2024-05-08T18:31:08.319394+0000","last_unstale":"2024-05-08T18:31:45.327375+0000","last_undegraded":"2024-05-08T18:31:45.327375+0000","last_fullsized":"2024-05-08T18:31:45.327375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:16.822143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'18","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271649+0000","last_change":"2024-05-08T18:31:00.300170+0000","last_active":"2024-05-08T18:34:07.271649+0000","last_peered":"2024-05-08T18:34:07.271649+0000","last_clean":"2024-05-08T18:34:07.271649+0000","last_became_active":"2024-05-08T18:31:00.299547+0000","last_became_peered":"2024-05-08T18:31:00.299547+0000","last_unstale":"2024-05-08T18:34:07.271649+0000","last_undegraded":"2024-05-08T18:34:07.271649+0000","last_fullsized":"2024-05-08T18:34:07.271649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:21.996058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334865+0000","last_change":"2024-05-08T18:30:58.305155+0000","last_active":"2024-05-08T18:31:45.334865+0000","last_peered":"2024-05-08T18:31:45.334865+0000","last_clean":"2024-05-08T18:31:45.334865+0000","last_became_active":"2024-05-08T18:30:58.303624+0000","last_became_peered":"2024-05-08T18:30:58.303624+0000","last_unstale":"2024-05-08T18:31:45.334865+0000","last_undegraded":"2024-05-08T18:31:45.334865+0000","last_fullsized":"2024-05-08T18:31:45.334865+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:04.148371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331693+0000","last_change":"2024-05-08T18:31:02.292792+0000","last_active":"2024-05-08T18:31:45.331693+0000","last_peered":"2024-05-08T18:31:45.331693+0000","last_clean":"2024-05-08T18:31:45.331693+0000","last_became_active":"2024-05-08T18:31:02.292498+0000","last_became_peered":"2024-05-08T18:31:02.292498+0000","last_unstale":"2024-05-08T18:31:45.331693+0000","last_undegraded":"2024-05-08T18:31:45.331693+0000","last_fullsized":"2024-05-08T18:31:45.331693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:45.114148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.090360+0000","last_change":"2024-05-08T18:31:04.297701+0000","last_active":"2024-05-08T18:33:05.090360+0000","last_peered":"2024-05-08T18:33:05.090360+0000","last_clean":"2024-05-08T18:33:05.090360+0000","last_became_active":"2024-05-08T18:31:04.297297+0000","last_became_peered":"2024-05-08T18:31:04.297297+0000","last_unstale":"2024-05-08T18:33:05.090360+0000","last_undegraded":"2024-05-08T18:33:05.090360+0000","last_fullsized":"2024-05-08T18:33:05.090360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:01.274241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330477+0000","last_change":"2024-05-08T18:31:06.305923+0000","last_active":"2024-05-08T18:31:45.330477+0000","last_peered":"2024-05-08T18:31:45.330477+0000","last_clean":"2024-05-08T18:31:45.330477+0000","last_became_active":"2024-05-08T18:31:06.305567+0000","last_became_peered":"2024-05-08T18:31:06.305567+0000","last_unstale":"2024-05-08T18:31:45.330477+0000","last_undegraded":"2024-05-08T18:31:45.330477+0000","last_fullsized":"2024-05-08T18:31:45.330477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:20.352238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'11","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.682210+0000","last_change":"2024-05-08T18:31:08.317380+0000","last_active":"2024-05-08T18:34:06.682210+0000","last_peered":"2024-05-08T18:34:06.682210+0000","last_clean":"2024-05-08T18:34:06.682210+0000","last_became_active":"2024-05-08T18:31:08.316943+0000","last_became_peered":"2024-05-08T18:31:08.316943+0000","last_unstale":"2024-05-08T18:34:06.682210+0000","last_undegraded":"2024-05-08T18:34:06.682210+0000","last_fullsized":"2024-05-08T18:34:06.682210+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:54.462045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'5","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.280149+0000","last_change":"2024-05-08T18:31:00.283641+0000","last_active":"2024-05-08T18:34:07.280149+0000","last_peered":"2024-05-08T18:34:07.280149+0000","last_clean":"2024-05-08T18:34:07.280149+0000","last_became_active":"2024-05-08T18:31:00.282923+0000","last_became_peered":"2024-05-08T18:31:00.282923+0000","last_unstale":"2024-05-08T18:34:07.280149+0000","last_undegraded":"2024-05-08T18:34:07.280149+0000","last_fullsized":"2024-05-08T18:34:07.280149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:09.586689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328361+0000","last_change":"2024-05-08T18:30:58.318535+0000","last_active":"2024-05-08T18:31:45.328361+0000","last_peered":"2024-05-08T18:31:45.328361+0000","last_clean":"2024-05-08T18:31:45.328361+0000","last_became_active":"2024-05-08T18:30:58.316980+0000","last_became_peered":"2024-05-08T18:30:58.316980+0000","last_unstale":"2024-05-08T18:31:45.328361+0000","last_undegraded":"2024-05-08T18:31:45.328361+0000","last_fullsized":"2024-05-08T18:31:45.328361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:22:52.128630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336413+0000","last_change":"2024-05-08T18:31:02.288494+0000","last_active":"2024-05-08T18:31:45.336413+0000","last_peered":"2024-05-08T18:31:45.336413+0000","last_clean":"2024-05-08T18:31:45.336413+0000","last_became_active":"2024-05-08T18:31:02.288127+0000","last_became_peered":"2024-05-08T18:31:02.288127+0000","last_unstale":"2024-05-08T18:31:45.336413+0000","last_undegraded":"2024-05-08T18:31:45.336413+0000","last_fullsized":"2024-05-08T18:31:45.336413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:58.208003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333068+0000","last_change":"2024-05-08T18:31:04.302369+0000","last_active":"2024-05-08T18:31:45.333068+0000","last_peered":"2024-05-08T18:31:45.333068+0000","last_clean":"2024-05-08T18:31:45.333068+0000","last_became_active":"2024-05-08T18:31:04.302034+0000","last_became_peered":"2024-05-08T18:31:04.302034+0000","last_unstale":"2024-05-08T18:31:45.333068+0000","last_undegraded":"2024-05-08T18:31:45.333068+0000","last_fullsized":"2024-05-08T18:31:45.333068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:50:40.916183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'282","reported_seq":406,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370201+0000","last_change":"2024-05-08T18:31:06.311326+0000","last_active":"2024-05-08T18:34:07.370201+0000","last_peered":"2024-05-08T18:34:07.370201+0000","last_clean":"2024-05-08T18:34:07.370201+0000","last_became_active":"2024-05-08T18:31:06.311063+0000","last_became_peered":"2024-05-08T18:31:06.311063+0000","last_unstale":"2024-05-08T18:34:07.370201+0000","last_undegraded":"2024-05-08T18:34:07.370201+0000","last_fullsized":"2024-05-08T18:34:07.370201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:46.356134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327053+0000","last_change":"2024-05-08T18:31:08.320650+0000","last_active":"2024-05-08T18:31:45.327053+0000","last_peered":"2024-05-08T18:31:45.327053+0000","last_clean":"2024-05-08T18:31:45.327053+0000","last_became_active":"2024-05-08T18:31:08.320260+0000","last_became_peered":"2024-05-08T18:31:08.320260+0000","last_unstale":"2024-05-08T18:31:45.327053+0000","last_undegraded":"2024-05-08T18:31:45.327053+0000","last_fullsized":"2024-05-08T18:31:45.327053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:03.499843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.580949+0000","last_change":"2024-05-08T18:31:00.285978+0000","last_active":"2024-05-08T18:33:06.580949+0000","last_peered":"2024-05-08T18:33:06.580949+0000","last_clean":"2024-05-08T18:33:06.580949+0000","last_became_active":"2024-05-08T18:31:00.284982+0000","last_became_peered":"2024-05-08T18:31:00.284982+0000","last_unstale":"2024-05-08T18:33:06.580949+0000","last_undegraded":"2024-05-08T18:33:06.580949+0000","last_fullsized":"2024-05-08T18:33:06.580949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:19.399639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.338145+0000","last_change":"2024-05-08T18:30:58.306355+0000","last_active":"2024-05-08T18:31:45.338145+0000","last_peered":"2024-05-08T18:31:45.338145+0000","last_clean":"2024-05-08T18:31:45.338145+0000","last_became_active":"2024-05-08T18:30:58.304969+0000","last_became_peered":"2024-05-08T18:30:58.304969+0000","last_unstale":"2024-05-08T18:31:45.338145+0000","last_undegraded":"2024-05-08T18:31:45.338145+0000","last_fullsized":"2024-05-08T18:31:45.338145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:07.501461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334669+0000","last_change":"2024-05-08T18:31:02.289211+0000","last_active":"2024-05-08T18:31:45.334669+0000","last_peered":"2024-05-08T18:31:45.334669+0000","last_clean":"2024-05-08T18:31:45.334669+0000","last_became_active":"2024-05-08T18:31:02.288719+0000","last_became_peered":"2024-05-08T18:31:02.288719+0000","last_unstale":"2024-05-08T18:31:45.334669+0000","last_undegraded":"2024-05-08T18:31:45.334669+0000","last_fullsized":"2024-05-08T18:31:45.334669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:42.419001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'37","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.062940+0000","last_change":"2024-05-08T18:31:04.299750+0000","last_active":"2024-05-08T18:33:05.062940+0000","last_peered":"2024-05-08T18:33:05.062940+0000","last_clean":"2024-05-08T18:33:05.062940+0000","last_became_active":"2024-05-08T18:31:04.297013+0000","last_became_peered":"2024-05-08T18:31:04.297013+0000","last_unstale":"2024-05-08T18:33:05.062940+0000","last_undegraded":"2024-05-08T18:33:05.062940+0000","last_fullsized":"2024-05-08T18:33:05.062940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:34.756044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328787+0000","last_change":"2024-05-08T18:31:06.312037+0000","last_active":"2024-05-08T18:31:45.328787+0000","last_peered":"2024-05-08T18:31:45.328787+0000","last_clean":"2024-05-08T18:31:45.328787+0000","last_became_active":"2024-05-08T18:31:06.311767+0000","last_became_peered":"2024-05-08T18:31:06.311767+0000","last_unstale":"2024-05-08T18:31:45.328787+0000","last_undegraded":"2024-05-08T18:31:45.328787+0000","last_fullsized":"2024-05-08T18:31:45.328787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:32.310721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.985534+0000","last_change":"2024-05-08T18:31:08.313489+0000","last_active":"2024-05-08T18:34:06.985534+0000","last_peered":"2024-05-08T18:34:06.985534+0000","last_clean":"2024-05-08T18:34:06.985534+0000","last_became_active":"2024-05-08T18:31:08.312031+0000","last_became_peered":"2024-05-08T18:31:08.312031+0000","last_unstale":"2024-05-08T18:34:06.985534+0000","last_undegraded":"2024-05-08T18:34:06.985534+0000","last_fullsized":"2024-05-08T18:34:06.985534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:40.327081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.681165+0000","last_change":"2024-05-08T18:31:00.282870+0000","last_active":"2024-05-08T18:32:22.681165+0000","last_peered":"2024-05-08T18:32:22.681165+0000","last_clean":"2024-05-08T18:32:22.681165+0000","last_became_active":"2024-05-08T18:31:00.282605+0000","last_became_peered":"2024-05-08T18:31:00.282605+0000","last_unstale":"2024-05-08T18:32:22.681165+0000","last_undegraded":"2024-05-08T18:32:22.681165+0000","last_fullsized":"2024-05-08T18:32:22.681165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:30.009947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330348+0000","last_change":"2024-05-08T18:30:58.316801+0000","last_active":"2024-05-08T18:31:45.330348+0000","last_peered":"2024-05-08T18:31:45.330348+0000","last_clean":"2024-05-08T18:31:45.330348+0000","last_became_active":"2024-05-08T18:30:58.316166+0000","last_became_peered":"2024-05-08T18:30:58.316166+0000","last_unstale":"2024-05-08T18:31:45.330348+0000","last_undegraded":"2024-05-08T18:31:45.330348+0000","last_fullsized":"2024-05-08T18:31:45.330348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:24.440258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334438+0000","last_change":"2024-05-08T18:31:02.294645+0000","last_active":"2024-05-08T18:31:45.334438+0000","last_peered":"2024-05-08T18:31:45.334438+0000","last_clean":"2024-05-08T18:31:45.334438+0000","last_became_active":"2024-05-08T18:31:02.294335+0000","last_became_peered":"2024-05-08T18:31:02.294335+0000","last_unstale":"2024-05-08T18:31:45.334438+0000","last_undegraded":"2024-05-08T18:31:45.334438+0000","last_fullsized":"2024-05-08T18:31:45.334438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:40:41.976982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.063967+0000","last_change":"2024-05-08T18:31:04.297821+0000","last_active":"2024-05-08T18:33:05.063967+0000","last_peered":"2024-05-08T18:33:05.063967+0000","last_clean":"2024-05-08T18:33:05.063967+0000","last_became_active":"2024-05-08T18:31:04.297440+0000","last_became_peered":"2024-05-08T18:31:04.297440+0000","last_unstale":"2024-05-08T18:33:05.063967+0000","last_undegraded":"2024-05-08T18:33:05.063967+0000","last_fullsized":"2024-05-08T18:33:05.063967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:14.624732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327191+0000","last_change":"2024-05-08T18:31:06.312504+0000","last_active":"2024-05-08T18:31:45.327191+0000","last_peered":"2024-05-08T18:31:45.327191+0000","last_clean":"2024-05-08T18:31:45.327191+0000","last_became_active":"2024-05-08T18:31:06.312162+0000","last_became_peered":"2024-05-08T18:31:06.312162+0000","last_unstale":"2024-05-08T18:31:45.327191+0000","last_undegraded":"2024-05-08T18:31:45.327191+0000","last_fullsized":"2024-05-08T18:31:45.327191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:25.211733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.331019+0000","last_change":"2024-05-08T18:31:08.318309+0000","last_active":"2024-05-08T18:33:03.331019+0000","last_peered":"2024-05-08T18:33:03.331019+0000","last_clean":"2024-05-08T18:33:03.331019+0000","last_became_active":"2024-05-08T18:31:08.318072+0000","last_became_peered":"2024-05-08T18:31:08.318072+0000","last_unstale":"2024-05-08T18:33:03.331019+0000","last_undegraded":"2024-05-08T18:33:03.331019+0000","last_fullsized":"2024-05-08T18:33:03.331019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:36:18.141092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'4","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.247651+0000","last_change":"2024-05-08T18:31:00.292044+0000","last_active":"2024-05-08T18:34:07.247651+0000","last_peered":"2024-05-08T18:34:07.247651+0000","last_clean":"2024-05-08T18:34:07.247651+0000","last_became_active":"2024-05-08T18:31:00.291128+0000","last_became_peered":"2024-05-08T18:31:00.291128+0000","last_unstale":"2024-05-08T18:34:07.247651+0000","last_undegraded":"2024-05-08T18:34:07.247651+0000","last_fullsized":"2024-05-08T18:34:07.247651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:28.671220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330831+0000","last_change":"2024-05-08T18:30:58.285590+0000","last_active":"2024-05-08T18:31:45.330831+0000","last_peered":"2024-05-08T18:31:45.330831+0000","last_clean":"2024-05-08T18:31:45.330831+0000","last_became_active":"2024-05-08T18:30:58.283402+0000","last_became_peered":"2024-05-08T18:30:58.283402+0000","last_unstale":"2024-05-08T18:31:45.330831+0000","last_undegraded":"2024-05-08T18:31:45.330831+0000","last_fullsized":"2024-05-08T18:31:45.330831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:43.233516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336457+0000","last_change":"2024-05-08T18:31:02.292679+0000","last_active":"2024-05-08T18:31:45.336457+0000","last_peered":"2024-05-08T18:31:45.336457+0000","last_clean":"2024-05-08T18:31:45.336457+0000","last_became_active":"2024-05-08T18:31:02.291363+0000","last_became_peered":"2024-05-08T18:31:02.291363+0000","last_unstale":"2024-05-08T18:31:45.336457+0000","last_undegraded":"2024-05-08T18:31:45.336457+0000","last_fullsized":"2024-05-08T18:31:45.336457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:40.683748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'29","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.088039+0000","last_change":"2024-05-08T18:31:04.298937+0000","last_active":"2024-05-08T18:33:05.088039+0000","last_peered":"2024-05-08T18:33:05.088039+0000","last_clean":"2024-05-08T18:33:05.088039+0000","last_became_active":"2024-05-08T18:31:04.298601+0000","last_became_peered":"2024-05-08T18:31:04.298601+0000","last_unstale":"2024-05-08T18:33:05.088039+0000","last_undegraded":"2024-05-08T18:33:05.088039+0000","last_fullsized":"2024-05-08T18:33:05.088039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:52.647996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":40,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327562+0000","last_change":"2024-05-08T18:31:06.308361+0000","last_active":"2024-05-08T18:31:45.327562+0000","last_peered":"2024-05-08T18:31:45.327562+0000","last_clean":"2024-05-08T18:31:45.327562+0000","last_became_active":"2024-05-08T18:31:06.307801+0000","last_became_peered":"2024-05-08T18:31:06.307801+0000","last_unstale":"2024-05-08T18:31:45.327562+0000","last_undegraded":"2024-05-08T18:31:45.327562+0000","last_fullsized":"2024-05-08T18:31:45.327562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:23.188589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.098741+0000","last_change":"2024-05-08T18:31:08.319580+0000","last_active":"2024-05-08T18:33:05.098741+0000","last_peered":"2024-05-08T18:33:05.098741+0000","last_clean":"2024-05-08T18:33:05.098741+0000","last_became_active":"2024-05-08T18:31:08.319232+0000","last_became_peered":"2024-05-08T18:31:08.319232+0000","last_unstale":"2024-05-08T18:33:05.098741+0000","last_undegraded":"2024-05-08T18:33:05.098741+0000","last_fullsized":"2024-05-08T18:33:05.098741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:04.750785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271785+0000","last_change":"2024-05-08T18:31:00.283026+0000","last_active":"2024-05-08T18:34:07.271785+0000","last_peered":"2024-05-08T18:34:07.271785+0000","last_clean":"2024-05-08T18:34:07.271785+0000","last_became_active":"2024-05-08T18:31:00.282644+0000","last_became_peered":"2024-05-08T18:31:00.282644+0000","last_unstale":"2024-05-08T18:34:07.271785+0000","last_undegraded":"2024-05-08T18:34:07.271785+0000","last_fullsized":"2024-05-08T18:34:07.271785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:26.448180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.944420+0000","last_change":"2024-05-08T18:30:58.304661+0000","last_active":"2024-05-08T18:34:06.944420+0000","last_peered":"2024-05-08T18:34:06.944420+0000","last_clean":"2024-05-08T18:34:06.944420+0000","last_became_active":"2024-05-08T18:30:58.303312+0000","last_became_peered":"2024-05-08T18:30:58.303312+0000","last_unstale":"2024-05-08T18:34:06.944420+0000","last_undegraded":"2024-05-08T18:34:06.944420+0000","last_fullsized":"2024-05-08T18:34:06.944420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:46.459524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'6","reported_seq":228,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.172197+0000","last_change":"2024-05-08T18:31:02.288759+0000","last_active":"2024-05-08T18:33:06.172197+0000","last_peered":"2024-05-08T18:33:06.172197+0000","last_clean":"2024-05-08T18:33:06.172197+0000","last_became_active":"2024-05-08T18:31:02.288433+0000","last_became_peered":"2024-05-08T18:31:02.288433+0000","last_unstale":"2024-05-08T18:33:06.172197+0000","last_undegraded":"2024-05-08T18:33:06.172197+0000","last_fullsized":"2024-05-08T18:33:06.172197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:35.557614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'32","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.599172+0000","last_change":"2024-05-08T18:31:04.299253+0000","last_active":"2024-05-08T18:34:06.599172+0000","last_peered":"2024-05-08T18:34:06.599172+0000","last_clean":"2024-05-08T18:34:06.599172+0000","last_became_active":"2024-05-08T18:31:04.298089+0000","last_became_peered":"2024-05-08T18:31:04.298089+0000","last_unstale":"2024-05-08T18:34:06.599172+0000","last_undegraded":"2024-05-08T18:34:06.599172+0000","last_fullsized":"2024-05-08T18:34:06.599172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:34.386559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329003+0000","last_change":"2024-05-08T18:31:06.312121+0000","last_active":"2024-05-08T18:31:45.329003+0000","last_peered":"2024-05-08T18:31:45.329003+0000","last_clean":"2024-05-08T18:31:45.329003+0000","last_became_active":"2024-05-08T18:31:06.311810+0000","last_became_peered":"2024-05-08T18:31:06.311810+0000","last_unstale":"2024-05-08T18:31:45.329003+0000","last_undegraded":"2024-05-08T18:31:45.329003+0000","last_fullsized":"2024-05-08T18:31:45.329003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:01.719275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.101535+0000","last_change":"2024-05-08T18:31:08.317101+0000","last_active":"2024-05-08T18:33:05.101535+0000","last_peered":"2024-05-08T18:33:05.101535+0000","last_clean":"2024-05-08T18:33:05.101535+0000","last_became_active":"2024-05-08T18:31:08.316723+0000","last_became_peered":"2024-05-08T18:31:08.316723+0000","last_unstale":"2024-05-08T18:33:05.101535+0000","last_undegraded":"2024-05-08T18:33:05.101535+0000","last_fullsized":"2024-05-08T18:33:05.101535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:49.236295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.346732+0000","last_change":"2024-05-08T18:31:45.346058+0000","last_active":"2024-05-08T18:31:45.346732+0000","last_peered":"2024-05-08T18:31:45.346732+0000","last_clean":"2024-05-08T18:31:45.346732+0000","last_became_active":"2024-05-08T18:31:45.339252+0000","last_became_peered":"2024-05-08T18:31:45.339252+0000","last_unstale":"2024-05-08T18:31:45.346732+0000","last_undegraded":"2024-05-08T18:31:45.346732+0000","last_fullsized":"2024-05-08T18:31:45.346732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:50:36.902568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176307+0000","last_change":"2024-05-08T18:30:58.308668+0000","last_active":"2024-05-08T18:33:03.176307+0000","last_peered":"2024-05-08T18:33:03.176307+0000","last_clean":"2024-05-08T18:33:03.176307+0000","last_became_active":"2024-05-08T18:30:58.308290+0000","last_became_peered":"2024-05-08T18:30:58.308290+0000","last_unstale":"2024-05-08T18:33:03.176307+0000","last_undegraded":"2024-05-08T18:33:03.176307+0000","last_fullsized":"2024-05-08T18:33:03.176307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:38.049573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.869487+0000","last_change":"2024-05-08T18:31:00.283309+0000","last_active":"2024-05-08T18:32:22.869487+0000","last_peered":"2024-05-08T18:32:22.869487+0000","last_clean":"2024-05-08T18:32:22.869487+0000","last_became_active":"2024-05-08T18:31:00.282889+0000","last_became_peered":"2024-05-08T18:31:00.282889+0000","last_unstale":"2024-05-08T18:32:22.869487+0000","last_undegraded":"2024-05-08T18:32:22.869487+0000","last_fullsized":"2024-05-08T18:32:22.869487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:30.686060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328796+0000","last_change":"2024-05-08T18:30:58.295262+0000","last_active":"2024-05-08T18:31:45.328796+0000","last_peered":"2024-05-08T18:31:45.328796+0000","last_clean":"2024-05-08T18:31:45.328796+0000","last_became_active":"2024-05-08T18:30:58.294210+0000","last_became_peered":"2024-05-08T18:30:58.294210+0000","last_unstale":"2024-05-08T18:31:45.328796+0000","last_undegraded":"2024-05-08T18:31:45.328796+0000","last_fullsized":"2024-05-08T18:31:45.328796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:11.650120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196723+0000","last_change":"2024-05-08T18:31:00.298041+0000","last_active":"2024-05-08T18:34:07.196723+0000","last_peered":"2024-05-08T18:34:07.196723+0000","last_clean":"2024-05-08T18:34:07.196723+0000","last_became_active":"2024-05-08T18:31:00.295749+0000","last_became_peered":"2024-05-08T18:31:00.295749+0000","last_unstale":"2024-05-08T18:34:07.196723+0000","last_undegraded":"2024-05-08T18:34:07.196723+0000","last_fullsized":"2024-05-08T18:34:07.196723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:10.083894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'5","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.177037+0000","last_change":"2024-05-08T18:30:58.316506+0000","last_active":"2024-05-08T18:33:03.177037+0000","last_peered":"2024-05-08T18:33:03.177037+0000","last_clean":"2024-05-08T18:33:03.177037+0000","last_became_active":"2024-05-08T18:30:58.314786+0000","last_became_peered":"2024-05-08T18:30:58.314786+0000","last_unstale":"2024-05-08T18:33:03.177037+0000","last_undegraded":"2024-05-08T18:33:03.177037+0000","last_fullsized":"2024-05-08T18:33:03.177037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:18.913736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'11","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.283079+0000","last_change":"2024-05-08T18:31:00.283309+0000","last_active":"2024-05-08T18:34:07.283079+0000","last_peered":"2024-05-08T18:34:07.283079+0000","last_clean":"2024-05-08T18:34:07.283079+0000","last_became_active":"2024-05-08T18:31:00.282863+0000","last_became_peered":"2024-05-08T18:31:00.282863+0000","last_unstale":"2024-05-08T18:34:07.283079+0000","last_undegraded":"2024-05-08T18:34:07.283079+0000","last_fullsized":"2024-05-08T18:34:07.283079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:55.191334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'3","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.671656+0000","last_change":"2024-05-08T18:30:58.289717+0000","last_active":"2024-05-08T18:32:22.671656+0000","last_peered":"2024-05-08T18:32:22.671656+0000","last_clean":"2024-05-08T18:32:22.671656+0000","last_became_active":"2024-05-08T18:30:58.289337+0000","last_became_peered":"2024-05-08T18:30:58.289337+0000","last_unstale":"2024-05-08T18:32:22.671656+0000","last_undegraded":"2024-05-08T18:32:22.671656+0000","last_fullsized":"2024-05-08T18:32:22.671656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:38.049573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.581291+0000","last_change":"2024-05-08T18:31:00.291487+0000","last_active":"2024-05-08T18:33:06.581291+0000","last_peered":"2024-05-08T18:33:06.581291+0000","last_clean":"2024-05-08T18:33:06.581291+0000","last_became_active":"2024-05-08T18:31:00.291269+0000","last_became_peered":"2024-05-08T18:31:00.291269+0000","last_unstale":"2024-05-08T18:33:06.581291+0000","last_undegraded":"2024-05-08T18:33:06.581291+0000","last_fullsized":"2024-05-08T18:33:06.581291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:30.009947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330816+0000","last_change":"2024-05-08T18:30:58.285778+0000","last_active":"2024-05-08T18:31:45.330816+0000","last_peered":"2024-05-08T18:31:45.330816+0000","last_clean":"2024-05-08T18:31:45.330816+0000","last_became_active":"2024-05-08T18:30:58.283976+0000","last_became_peered":"2024-05-08T18:30:58.283976+0000","last_unstale":"2024-05-08T18:31:45.330816+0000","last_undegraded":"2024-05-08T18:31:45.330816+0000","last_fullsized":"2024-05-08T18:31:45.330816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:23:31.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.202924+0000","last_change":"2024-05-08T18:31:00.292666+0000","last_active":"2024-05-08T18:34:07.202924+0000","last_peered":"2024-05-08T18:34:07.202924+0000","last_clean":"2024-05-08T18:34:07.202924+0000","last_became_active":"2024-05-08T18:31:00.292385+0000","last_became_peered":"2024-05-08T18:31:00.292385+0000","last_unstale":"2024-05-08T18:34:07.202924+0000","last_undegraded":"2024-05-08T18:34:07.202924+0000","last_fullsized":"2024-05-08T18:34:07.202924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:36.076362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.860195+0000","last_change":"2024-05-08T18:30:58.304478+0000","last_active":"2024-05-08T18:32:22.860195+0000","last_peered":"2024-05-08T18:32:22.860195+0000","last_clean":"2024-05-08T18:32:22.860195+0000","last_became_active":"2024-05-08T18:30:58.303839+0000","last_became_peered":"2024-05-08T18:30:58.303839+0000","last_unstale":"2024-05-08T18:32:22.860195+0000","last_undegraded":"2024-05-08T18:32:22.860195+0000","last_fullsized":"2024-05-08T18:32:22.860195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:23:31.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'8","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.965732+0000","last_change":"2024-05-08T18:31:00.288783+0000","last_active":"2024-05-08T18:34:06.965732+0000","last_peered":"2024-05-08T18:34:06.965732+0000","last_clean":"2024-05-08T18:34:06.965732+0000","last_became_active":"2024-05-08T18:31:00.288202+0000","last_became_peered":"2024-05-08T18:31:00.288202+0000","last_unstale":"2024-05-08T18:34:06.965732+0000","last_undegraded":"2024-05-08T18:34:06.965732+0000","last_fullsized":"2024-05-08T18:34:06.965732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:54.772566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336793+0000","last_change":"2024-05-08T18:30:58.305905+0000","last_active":"2024-05-08T18:31:45.336793+0000","last_peered":"2024-05-08T18:31:45.336793+0000","last_clean":"2024-05-08T18:31:45.336793+0000","last_became_active":"2024-05-08T18:30:58.305116+0000","last_became_peered":"2024-05-08T18:30:58.305116+0000","last_unstale":"2024-05-08T18:31:45.336793+0000","last_undegraded":"2024-05-08T18:31:45.336793+0000","last_fullsized":"2024-05-08T18:31:45.336793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:11.650120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.581054+0000","last_change":"2024-05-08T18:31:00.285833+0000","last_active":"2024-05-08T18:33:06.581054+0000","last_peered":"2024-05-08T18:33:06.581054+0000","last_clean":"2024-05-08T18:33:06.581054+0000","last_became_active":"2024-05-08T18:31:00.284439+0000","last_became_peered":"2024-05-08T18:31:00.284439+0000","last_unstale":"2024-05-08T18:33:06.581054+0000","last_undegraded":"2024-05-08T18:33:06.581054+0000","last_fullsized":"2024-05-08T18:33:06.581054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:21.913096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.265892+0000","last_change":"2024-05-08T18:30:58.287850+0000","last_active":"2024-05-08T18:34:07.265892+0000","last_peered":"2024-05-08T18:34:07.265892+0000","last_clean":"2024-05-08T18:34:07.265892+0000","last_became_active":"2024-05-08T18:30:58.286930+0000","last_became_peered":"2024-05-08T18:30:58.286930+0000","last_unstale":"2024-05-08T18:34:07.265892+0000","last_undegraded":"2024-05-08T18:34:07.265892+0000","last_fullsized":"2024-05-08T18:34:07.265892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:33.986082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.964490+0000","last_change":"2024-05-08T18:31:00.283948+0000","last_active":"2024-05-08T18:34:06.964490+0000","last_peered":"2024-05-08T18:34:06.964490+0000","last_clean":"2024-05-08T18:34:06.964490+0000","last_became_active":"2024-05-08T18:31:00.282958+0000","last_became_peered":"2024-05-08T18:31:00.282958+0000","last_unstale":"2024-05-08T18:34:06.964490+0000","last_undegraded":"2024-05-08T18:34:06.964490+0000","last_fullsized":"2024-05-08T18:34:06.964490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:41.064447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328195+0000","last_change":"2024-05-08T18:30:58.305701+0000","last_active":"2024-05-08T18:31:45.328195+0000","last_peered":"2024-05-08T18:31:45.328195+0000","last_clean":"2024-05-08T18:31:45.328195+0000","last_became_active":"2024-05-08T18:30:58.302051+0000","last_became_peered":"2024-05-08T18:30:58.302051+0000","last_unstale":"2024-05-08T18:31:45.328195+0000","last_undegraded":"2024-05-08T18:31:45.328195+0000","last_fullsized":"2024-05-08T18:31:45.328195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:52.764644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332860+0000","last_change":"2024-05-08T18:31:00.299248+0000","last_active":"2024-05-08T18:31:45.332860+0000","last_peered":"2024-05-08T18:31:45.332860+0000","last_clean":"2024-05-08T18:31:45.332860+0000","last_became_active":"2024-05-08T18:31:00.297787+0000","last_became_peered":"2024-05-08T18:31:00.297787+0000","last_unstale":"2024-05-08T18:31:45.332860+0000","last_undegraded":"2024-05-08T18:31:45.332860+0000","last_fullsized":"2024-05-08T18:31:45.332860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:40.412419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.190202+0000","last_change":"2024-05-08T18:30:58.285595+0000","last_active":"2024-05-08T18:34:07.190202+0000","last_peered":"2024-05-08T18:34:07.190202+0000","last_clean":"2024-05-08T18:34:07.190202+0000","last_became_active":"2024-05-08T18:30:58.284146+0000","last_became_peered":"2024-05-08T18:30:58.284146+0000","last_unstale":"2024-05-08T18:34:07.190202+0000","last_undegraded":"2024-05-08T18:34:07.190202+0000","last_fullsized":"2024-05-08T18:34:07.190202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:25.031288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'12","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.242555+0000","last_change":"2024-05-08T18:31:00.291767+0000","last_active":"2024-05-08T18:34:07.242555+0000","last_peered":"2024-05-08T18:34:07.242555+0000","last_clean":"2024-05-08T18:34:07.242555+0000","last_became_active":"2024-05-08T18:31:00.291399+0000","last_became_peered":"2024-05-08T18:31:00.291399+0000","last_unstale":"2024-05-08T18:34:07.242555+0000","last_undegraded":"2024-05-08T18:34:07.242555+0000","last_fullsized":"2024-05-08T18:34:07.242555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:29.461384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.177075+0000","last_change":"2024-05-08T18:30:58.305891+0000","last_active":"2024-05-08T18:34:07.177075+0000","last_peered":"2024-05-08T18:34:07.177075+0000","last_clean":"2024-05-08T18:34:07.177075+0000","last_became_active":"2024-05-08T18:30:58.305523+0000","last_became_peered":"2024-05-08T18:30:58.305523+0000","last_unstale":"2024-05-08T18:34:07.177075+0000","last_undegraded":"2024-05-08T18:34:07.177075+0000","last_fullsized":"2024-05-08T18:34:07.177075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:38.049573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'14","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196828+0000","last_change":"2024-05-08T18:31:00.281500+0000","last_active":"2024-05-08T18:34:07.196828+0000","last_peered":"2024-05-08T18:34:07.196828+0000","last_clean":"2024-05-08T18:34:07.196828+0000","last_became_active":"2024-05-08T18:31:00.281199+0000","last_became_peered":"2024-05-08T18:31:00.281199+0000","last_unstale":"2024-05-08T18:34:07.196828+0000","last_undegraded":"2024-05-08T18:34:07.196828+0000","last_fullsized":"2024-05-08T18:34:07.196828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:40:39.970400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333475+0000","last_change":"2024-05-08T18:30:58.302582+0000","last_active":"2024-05-08T18:31:45.333475+0000","last_peered":"2024-05-08T18:31:45.333475+0000","last_clean":"2024-05-08T18:31:45.333475+0000","last_became_active":"2024-05-08T18:30:58.302218+0000","last_became_peered":"2024-05-08T18:30:58.302218+0000","last_unstale":"2024-05-08T18:31:45.333475+0000","last_undegraded":"2024-05-08T18:31:45.333475+0000","last_fullsized":"2024-05-08T18:31:45.333475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:25.031288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.057640+0000","last_change":"2024-05-08T18:31:00.294447+0000","last_active":"2024-05-08T18:34:07.057640+0000","last_peered":"2024-05-08T18:34:07.057640+0000","last_clean":"2024-05-08T18:34:07.057640+0000","last_became_active":"2024-05-08T18:31:00.294146+0000","last_became_peered":"2024-05-08T18:31:00.294146+0000","last_unstale":"2024-05-08T18:34:07.057640+0000","last_undegraded":"2024-05-08T18:34:07.057640+0000","last_fullsized":"2024-05-08T18:34:07.057640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:01.629372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329386+0000","last_change":"2024-05-08T18:30:58.317135+0000","last_active":"2024-05-08T18:31:45.329386+0000","last_peered":"2024-05-08T18:31:45.329386+0000","last_clean":"2024-05-08T18:31:45.329386+0000","last_became_active":"2024-05-08T18:30:58.314388+0000","last_became_peered":"2024-05-08T18:30:58.314388+0000","last_unstale":"2024-05-08T18:31:45.329386+0000","last_undegraded":"2024-05-08T18:31:45.329386+0000","last_fullsized":"2024-05-08T18:31:45.329386+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:19:16.450109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.239867+0000","last_change":"2024-05-08T18:31:00.283542+0000","last_active":"2024-05-08T18:34:07.239867+0000","last_peered":"2024-05-08T18:34:07.239867+0000","last_clean":"2024-05-08T18:34:07.239867+0000","last_became_active":"2024-05-08T18:31:00.281847+0000","last_became_peered":"2024-05-08T18:31:00.281847+0000","last_unstale":"2024-05-08T18:34:07.239867+0000","last_undegraded":"2024-05-08T18:34:07.239867+0000","last_fullsized":"2024-05-08T18:34:07.239867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:57.459641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330545+0000","last_change":"2024-05-08T18:30:58.309703+0000","last_active":"2024-05-08T18:31:45.330545+0000","last_peered":"2024-05-08T18:31:45.330545+0000","last_clean":"2024-05-08T18:31:45.330545+0000","last_became_active":"2024-05-08T18:30:58.309203+0000","last_became_peered":"2024-05-08T18:30:58.309203+0000","last_unstale":"2024-05-08T18:31:45.330545+0000","last_undegraded":"2024-05-08T18:31:45.330545+0000","last_fullsized":"2024-05-08T18:31:45.330545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:16.366334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'16","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.197060+0000","last_change":"2024-05-08T18:31:00.296525+0000","last_active":"2024-05-08T18:34:07.197060+0000","last_peered":"2024-05-08T18:34:07.197060+0000","last_clean":"2024-05-08T18:34:07.197060+0000","last_became_active":"2024-05-08T18:31:00.296240+0000","last_became_peered":"2024-05-08T18:31:00.296240+0000","last_unstale":"2024-05-08T18:34:07.197060+0000","last_undegraded":"2024-05-08T18:34:07.197060+0000","last_fullsized":"2024-05-08T18:34:07.197060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:42.486383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337097+0000","last_change":"2024-05-08T18:30:58.306151+0000","last_active":"2024-05-08T18:31:45.337097+0000","last_peered":"2024-05-08T18:31:45.337097+0000","last_clean":"2024-05-08T18:31:45.337097+0000","last_became_active":"2024-05-08T18:30:58.305572+0000","last_became_peered":"2024-05-08T18:30:58.305572+0000","last_unstale":"2024-05-08T18:31:45.337097+0000","last_undegraded":"2024-05-08T18:31:45.337097+0000","last_fullsized":"2024-05-08T18:31:45.337097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:56.618771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.240162+0000","last_change":"2024-05-08T18:31:00.283388+0000","last_active":"2024-05-08T18:34:07.240162+0000","last_peered":"2024-05-08T18:34:07.240162+0000","last_clean":"2024-05-08T18:34:07.240162+0000","last_became_active":"2024-05-08T18:31:00.282414+0000","last_became_peered":"2024-05-08T18:31:00.282414+0000","last_unstale":"2024-05-08T18:34:07.240162+0000","last_undegraded":"2024-05-08T18:34:07.240162+0000","last_fullsized":"2024-05-08T18:34:07.240162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:56.345475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.179636+0000","last_change":"2024-05-08T18:30:58.308682+0000","last_active":"2024-05-08T18:33:18.179636+0000","last_peered":"2024-05-08T18:33:18.179636+0000","last_clean":"2024-05-08T18:33:18.179636+0000","last_became_active":"2024-05-08T18:30:58.304591+0000","last_became_peered":"2024-05-08T18:30:58.304591+0000","last_unstale":"2024-05-08T18:33:18.179636+0000","last_undegraded":"2024-05-08T18:33:18.179636+0000","last_fullsized":"2024-05-08T18:33:18.179636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:40.162258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.180377+0000","last_change":"2024-05-08T18:30:58.304754+0000","last_active":"2024-05-08T18:34:07.180377+0000","last_peered":"2024-05-08T18:34:07.180377+0000","last_clean":"2024-05-08T18:34:07.180377+0000","last_became_active":"2024-05-08T18:30:58.303443+0000","last_became_peered":"2024-05-08T18:30:58.303443+0000","last_unstale":"2024-05-08T18:34:07.180377+0000","last_undegraded":"2024-05-08T18:34:07.180377+0000","last_fullsized":"2024-05-08T18:34:07.180377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:56.525015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'11","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.248139+0000","last_change":"2024-05-08T18:31:00.288619+0000","last_active":"2024-05-08T18:34:07.248139+0000","last_peered":"2024-05-08T18:34:07.248139+0000","last_clean":"2024-05-08T18:34:07.248139+0000","last_became_active":"2024-05-08T18:31:00.288250+0000","last_became_peered":"2024-05-08T18:31:00.288250+0000","last_unstale":"2024-05-08T18:34:07.248139+0000","last_undegraded":"2024-05-08T18:34:07.248139+0000","last_fullsized":"2024-05-08T18:34:07.248139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:58.735465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329134+0000","last_change":"2024-05-08T18:30:58.285795+0000","last_active":"2024-05-08T18:31:45.329134+0000","last_peered":"2024-05-08T18:31:45.329134+0000","last_clean":"2024-05-08T18:31:45.329134+0000","last_became_active":"2024-05-08T18:30:58.284090+0000","last_became_peered":"2024-05-08T18:30:58.284090+0000","last_unstale":"2024-05-08T18:31:45.329134+0000","last_undegraded":"2024-05-08T18:31:45.329134+0000","last_fullsized":"2024-05-08T18:31:45.329134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:56.618771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337379+0000","last_change":"2024-05-08T18:31:00.291942+0000","last_active":"2024-05-08T18:31:45.337379+0000","last_peered":"2024-05-08T18:31:45.337379+0000","last_clean":"2024-05-08T18:31:45.337379+0000","last_became_active":"2024-05-08T18:31:00.291650+0000","last_became_peered":"2024-05-08T18:31:00.291650+0000","last_unstale":"2024-05-08T18:31:45.337379+0000","last_undegraded":"2024-05-08T18:31:45.337379+0000","last_fullsized":"2024-05-08T18:31:45.337379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:49:50.681202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705708,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44172,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327668,"statfs":{"total":96636764160,"available":96591532032,"internally_reserved":0,"allocated":9048064,"data_stored":8743598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44688,"kb_used_data":9352,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327152,"statfs":{"total":96636764160,"available":96591003648,"internally_reserved":0,"allocated":9576448,"data_stored":9329841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44708,"kb_used_data":9372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327132,"statfs":{"total":96636764160,"available":96590983168,"internally_reserved":0,"allocated":9596928,"data_stored":9330329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705707,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":8808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":9019392,"data_stored":8742450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:34:15.092 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:34:15.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.226+0000 7f95dcabc640 1 Processor -- start 2024-05-08T18:34:15.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.226+0000 7f95dcabc640 1 -- start start 2024-05-08T18:34:15.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.227+0000 7f95dcabc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f95d812c7f0 0x7f95d812cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:15.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.227+0000 7f95dcabc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95d80a23e0 con 0x7f95d8070850 2024-05-08T18:34:15.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.227+0000 7f95dcabc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f95d8072fc0 con 0x7f95d812c7f0 2024-05-08T18:34:15.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.227+0000 7f95d659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f95d812c7f0 0x7f95d812cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:15.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.227+0000 7f95d5d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f95d8070850 0x7f95d8070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40954/0 (socket says 172.21.15.53:40954) 2024-05-08T18:34:15.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.227+0000 7f95d5d9b640 1 -- 172.21.15.53:0/2416986115 learned_addr learned my addr 172.21.15.53:0/2416986115 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:34:15.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.227+0000 7f95d659c640 1 -- 172.21.15.53:0/2416986115 >> v1:172.21.15.53:6789/0 conn(0x7f95d8070850 legacy=0x7f95d8070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:15.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.227+0000 7f95d659c640 1 -- 172.21.15.53:0/2416986115 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d8071f80 con 0x7f95d812c7f0 2024-05-08T18:34:15.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.227+0000 7f95d559a640 1 -- 172.21.15.53:0/2416986115 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2439792773 0 0) 0x7f95d80a23e0 con 0x7f95d8070850 2024-05-08T18:34:15.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.228+0000 7f95d659c640 1 --2- 172.21.15.53:0/2416986115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95d812c7f0 0x7f95d812cbd0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009720 tx=0x7f95c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48925de6e05daad0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.228+0000 7f95d559a640 1 -- 172.21.15.53:0/2416986115 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95c80316d0 con 0x7f95d812c7f0 2024-05-08T18:34:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.228+0000 7f95d559a640 1 -- 172.21.15.53:0/2416986115 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c8037070 con 0x7f95d812c7f0 2024-05-08T18:34:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.228+0000 7f95d559a640 1 -- 172.21.15.53:0/2416986115 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95c80319c0 con 0x7f95d812c7f0 2024-05-08T18:34:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.229+0000 7f95dcabc640 1 -- 172.21.15.53:0/2416986115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95d812c7f0 msgr2=0x7f95d812cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.229+0000 7f95dcabc640 1 --2- 172.21.15.53:0/2416986115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95d812c7f0 0x7f95d812cbd0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009720 tx=0x7f95c802b840 comp rx=0 tx=0).stop 2024-05-08T18:34:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.229+0000 7f95dcabc640 1 -- 172.21.15.53:0/2416986115 shutdown_connections 2024-05-08T18:34:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.229+0000 7f95dcabc640 1 --2- 172.21.15.53:0/2416986115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95d812c7f0 0x7f95d812cbd0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.229+0000 7f95dcabc640 1 -- 172.21.15.53:0/2416986115 >> 172.21.15.53:0/2416986115 conn(0x7f95d809ff90 msgr2=0x7f95d80a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.229+0000 7f95dcabc640 1 -- 172.21.15.53:0/2416986115 shutdown_connections 2024-05-08T18:34:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.229+0000 7f95dcabc640 1 -- 172.21.15.53:0/2416986115 wait complete. 2024-05-08T18:34:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.230+0000 7f95dcabc640 1 Processor -- start 2024-05-08T18:34:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.230+0000 7f95dcabc640 1 -- start start 2024-05-08T18:34:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.230+0000 7f95dcabc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95d8070850 0x7f95d81c0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:15.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.230+0000 7f95dcabc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f95d8071530 con 0x7f95d8070850 2024-05-08T18:34:15.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.231+0000 7f95d659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95d8070850 0x7f95d81c0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:15.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.231+0000 7f95d659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95d8070850 0x7f95d81c0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41148/0 (socket says 172.21.15.53:41148) 2024-05-08T18:34:15.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.231+0000 7f95d659c640 1 -- 172.21.15.53:0/1260620421 learned_addr learned my addr 172.21.15.53:0/1260620421 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:34:15.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.231+0000 7f95d659c640 1 -- 172.21.15.53:0/1260620421 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d811bea0 con 0x7f95d8070850 2024-05-08T18:34:15.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.231+0000 7f95d659c640 1 --2- 172.21.15.53:0/1260620421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95d8070850 0x7f95d81c0d60 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f95c8034040 tx=0x7f95c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:15.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.231+0000 7f95c6ffd640 1 -- 172.21.15.53:0/1260620421 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95c8032770 con 0x7f95d8070850 2024-05-08T18:34:15.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.231+0000 7f95c6ffd640 1 -- 172.21.15.53:0/1260620421 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c8032910 con 0x7f95d8070850 2024-05-08T18:34:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.231+0000 7f95dcabc640 1 -- 172.21.15.53:0/1260620421 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95d811db80 con 0x7f95d8070850 2024-05-08T18:34:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.231+0000 7f95c6ffd640 1 -- 172.21.15.53:0/1260620421 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95c8032c30 con 0x7f95d8070850 2024-05-08T18:34:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.231+0000 7f95dcabc640 1 -- 172.21.15.53:0/1260620421 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95d81c12a0 con 0x7f95d8070850 2024-05-08T18:34:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.232+0000 7f95c6ffd640 1 -- 172.21.15.53:0/1260620421 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f95c804c060 con 0x7f95d8070850 2024-05-08T18:34:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.232+0000 7f95dcabc640 1 -- 172.21.15.53:0/1260620421 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95d8064010 con 0x7f95d8070850 2024-05-08T18:34:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.233+0000 7f95c6ffd640 1 --2- 172.21.15.53:0/1260620421 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f95b803d260 0x7f95b803f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.233+0000 7f95c6ffd640 1 -- 172.21.15.53:0/1260620421 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f95c802f050 con 0x7f95d8070850 2024-05-08T18:34:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.233+0000 7f95d5d9b640 1 --2- 172.21.15.53:0/1260620421 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f95b803d260 0x7f95b803f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.233+0000 7f95d5d9b640 1 --2- 172.21.15.53:0/1260620421 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f95b803d260 0x7f95b803f720 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0011e0 tx=0x7f95cc007930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:15.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.237+0000 7f95c6ffd640 1 -- 172.21.15.53:0/1260620421 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f95c8040070 con 0x7f95d8070850 2024-05-08T18:34:15.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.428+0000 7f95dcabc640 1 -- 172.21.15.53:0/1260620421 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95d80a2930 con 0x7f95d8070850 2024-05-08T18:34:15.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.430+0000 7f95c6ffd640 1 -- 172.21.15.53:0/1260620421 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+20997 (secure 0 0 0) 0x7f95c8032dd0 con 0x7f95d8070850 2024-05-08T18:34:15.429 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:34:15.429 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":29,"fsid":"24862ec0-9aa3-4837-9fb5-4efcd65f7b56","created":"2024-05-08T18:30:39.594585+0000","modified":"2024-05-08T18:31:45.323768+0000","last_up_change":"2024-05-08T18:30:47.973576+0000","last_in_change":"2024-05-08T18:30:40.701334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:30:48.122011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:30:48.538594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-08T18:30:56.260148+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-08T18:30:58.591077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-08T18:31:00.582723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-08T18:31:02.356632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-08T18:31:04.308930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-08T18:31:06.385588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2bf91df5-317b-40b7-a1ef-93220b68d9eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":443747735},{"type":"v1","addr":"172.21.15.53:6801","nonce":443747735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":443747735},{"type":"v1","addr":"172.21.15.53:6803","nonce":443747735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":443747735},{"type":"v1","addr":"172.21.15.53:6807","nonce":443747735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":443747735},{"type":"v1","addr":"172.21.15.53:6805","nonce":443747735}]},"public_addr":"172.21.15.53:6801/443747735","cluster_addr":"172.21.15.53:6803/443747735","heartbeat_back_addr":"172.21.15.53:6807/443747735","heartbeat_front_addr":"172.21.15.53:6805/443747735","state":["exists","up"]},{"osd":1,"uuid":"8f60b028-91b7-4350-8ebf-62eb3cf4d77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2448644045},{"type":"v1","addr":"172.21.15.87:6809","nonce":2448644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2448644045},{"type":"v1","addr":"172.21.15.87:6811","nonce":2448644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2448644045},{"type":"v1","addr":"172.21.15.87:6815","nonce":2448644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2448644045},{"type":"v1","addr":"172.21.15.87:6813","nonce":2448644045}]},"public_addr":"172.21.15.87:6809/2448644045","cluster_addr":"172.21.15.87:6811/2448644045","heartbeat_back_addr":"172.21.15.87:6815/2448644045","heartbeat_front_addr":"172.21.15.87:6813/2448644045","state":["exists","up"]},{"osd":2,"uuid":"bdb8b677-0dba-4bd1-871f-dcd34fbaf2a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2108501615},{"type":"v1","addr":"172.21.15.87:6817","nonce":2108501615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2108501615},{"type":"v1","addr":"172.21.15.87:6819","nonce":2108501615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2108501615},{"type":"v1","addr":"172.21.15.87:6823","nonce":2108501615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2108501615},{"type":"v1","addr":"172.21.15.87:6821","nonce":2108501615}]},"public_addr":"172.21.15.87:6817/2108501615","cluster_addr":"172.21.15.87:6819/2108501615","heartbeat_back_addr":"172.21.15.87:6823/2108501615","heartbeat_front_addr":"172.21.15.87:6821/2108501615","state":["exists","up"]},{"osd":3,"uuid":"461c3e80-69a6-46f2-a941-06ff79538fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2929215285},{"type":"v1","addr":"172.21.15.87:6801","nonce":2929215285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2929215285},{"type":"v1","addr":"172.21.15.87:6803","nonce":2929215285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2929215285},{"type":"v1","addr":"172.21.15.87:6807","nonce":2929215285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2929215285},{"type":"v1","addr":"172.21.15.87:6805","nonce":2929215285}]},"public_addr":"172.21.15.87:6801/2929215285","cluster_addr":"172.21.15.87:6803/2929215285","heartbeat_back_addr":"172.21.15.87:6807/2929215285","heartbeat_front_addr":"172.21.15.87:6805/2929215285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:30:45.715976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:30:45.795465+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:30:45.865129+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:30:45.829998+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":3,"to":0}]},{"pgid":"4.33","mappings":[{"from":3,"to":2}]},{"pgid":"5.4","mappings":[{"from":0,"to":2}]},{"pgid":"5.b","mappings":[{"from":0,"to":2}]},{"pgid":"5.17","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:34:15.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.432+0000 7f95dcabc640 1 -- 172.21.15.53:0/1260620421 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f95b803d260 msgr2=0x7f95b803f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:15.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.432+0000 7f95dcabc640 1 --2- 172.21.15.53:0/1260620421 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f95b803d260 0x7f95b803f720 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0011e0 tx=0x7f95cc007930 comp rx=0 tx=0).stop 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.432+0000 7f95dcabc640 1 -- 172.21.15.53:0/1260620421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95d8070850 msgr2=0x7f95d81c0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.432+0000 7f95dcabc640 1 --2- 172.21.15.53:0/1260620421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95d8070850 0x7f95d81c0d60 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f95c8034040 tx=0x7f95c80046c0 comp rx=0 tx=0).stop 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.432+0000 7f95dcabc640 1 -- 172.21.15.53:0/1260620421 shutdown_connections 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.432+0000 7f95dcabc640 1 --2- 172.21.15.53:0/1260620421 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f95b803d260 0x7f95b803f720 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.432+0000 7f95dcabc640 1 --2- 172.21.15.53:0/1260620421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95d8070850 0x7f95d81c0d60 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.432+0000 7f95dcabc640 1 -- 172.21.15.53:0/1260620421 >> 172.21.15.53:0/1260620421 conn(0x7f95d809ff90 msgr2=0x7f95d81b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.432+0000 7f95dcabc640 1 -- 172.21.15.53:0/1260620421 shutdown_connections 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:15.432+0000 7f95dcabc640 1 -- 172.21.15.53:0/1260620421 wait complete. 2024-05-08T18:34:15.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-05-08T18:34:16.443 INFO:tasks.ceph:Scrubbing osd.0 2024-05-08T18:34:16.443 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:34:16.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.563+0000 7f65b77ed640 1 Processor -- start 2024-05-08T18:34:16.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.564+0000 7f65b77ed640 1 -- start start 2024-05-08T18:34:16.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.564+0000 7f65b77ed640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f65b0096ac0 0x7f65b0135060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:16.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.564+0000 7f65b77ed640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b0094ec0 con 0x7f65b00684f0 2024-05-08T18:34:16.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.564+0000 7f65b77ed640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f65b0074290 con 0x7f65b0096ac0 2024-05-08T18:34:16.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.564+0000 7f65b4d88640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f65b0096ac0 0x7f65b0135060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:16.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.564+0000 7f65b5589640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f65b00684f0 0x7f65b00963b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40962/0 (socket says 172.21.15.53:40962) 2024-05-08T18:34:16.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.564+0000 7f65b5589640 1 -- 172.21.15.53:0/1904262448 learned_addr learned my addr 172.21.15.53:0/1904262448 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:34:16.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.565+0000 7f65b4d88640 1 -- 172.21.15.53:0/1904262448 >> v1:172.21.15.53:6789/0 conn(0x7f65b00684f0 legacy=0x7f65b00963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:16.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.565+0000 7f65b4d88640 1 -- 172.21.15.53:0/1904262448 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b009ed70 con 0x7f65b0096ac0 2024-05-08T18:34:16.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.565+0000 7f65a7fff640 1 -- 172.21.15.53:0/1904262448 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2461227765 0 0) 0x7f65b0094ec0 con 0x7f65b00684f0 2024-05-08T18:34:16.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.565+0000 7f65b4d88640 1 --2- 172.21.15.53:0/1904262448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b0096ac0 0x7f65b0135060 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009720 tx=0x7f65a002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc026c34363bbd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:16.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.566+0000 7f65a7fff640 1 -- 172.21.15.53:0/1904262448 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a00316d0 con 0x7f65b0096ac0 2024-05-08T18:34:16.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.566+0000 7f65a7fff640 1 -- 172.21.15.53:0/1904262448 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a0037070 con 0x7f65b0096ac0 2024-05-08T18:34:16.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.566+0000 7f65a7fff640 1 -- 172.21.15.53:0/1904262448 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a00319c0 con 0x7f65b0096ac0 2024-05-08T18:34:16.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.566+0000 7f65b77ed640 1 -- 172.21.15.53:0/1904262448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b0096ac0 msgr2=0x7f65b0135060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:16.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.566+0000 7f65b77ed640 1 --2- 172.21.15.53:0/1904262448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b0096ac0 0x7f65b0135060 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009720 tx=0x7f65a002b840 comp rx=0 tx=0).stop 2024-05-08T18:34:16.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.566+0000 7f65b77ed640 1 -- 172.21.15.53:0/1904262448 shutdown_connections 2024-05-08T18:34:16.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.566+0000 7f65b77ed640 1 --2- 172.21.15.53:0/1904262448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b0096ac0 0x7f65b0135060 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:16.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.566+0000 7f65b77ed640 1 -- 172.21.15.53:0/1904262448 >> 172.21.15.53:0/1904262448 conn(0x7f65b009e4d0 msgr2=0x7f65b009a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:16.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.566+0000 7f65b77ed640 1 -- 172.21.15.53:0/1904262448 shutdown_connections 2024-05-08T18:34:16.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.566+0000 7f65b77ed640 1 -- 172.21.15.53:0/1904262448 wait complete. 2024-05-08T18:34:16.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.567+0000 7f65b77ed640 1 Processor -- start 2024-05-08T18:34:16.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.567+0000 7f65b77ed640 1 -- start start 2024-05-08T18:34:16.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.568+0000 7f65b77ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b00684f0 0x7f65b01c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:16.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.568+0000 7f65b77ed640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f65b0097040 con 0x7f65b00684f0 2024-05-08T18:34:16.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.568+0000 7f65b5589640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b00684f0 0x7f65b01c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:16.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.568+0000 7f65b5589640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b00684f0 0x7f65b01c0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41164/0 (socket says 172.21.15.53:41164) 2024-05-08T18:34:16.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.568+0000 7f65b5589640 1 -- 172.21.15.53:0/115388731 learned_addr learned my addr 172.21.15.53:0/115388731 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:34:16.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.568+0000 7f65b5589640 1 -- 172.21.15.53:0/115388731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b01abcc0 con 0x7f65b00684f0 2024-05-08T18:34:16.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.568+0000 7f65b5589640 1 --2- 172.21.15.53:0/115388731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b00684f0 0x7f65b01c0a30 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00c420 tx=0x7f65ac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:16.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.568+0000 7f65a5ffb640 1 -- 172.21.15.53:0/115388731 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65ac018070 con 0x7f65b00684f0 2024-05-08T18:34:16.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.568+0000 7f65a5ffb640 1 -- 172.21.15.53:0/115388731 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ac0074d0 con 0x7f65b00684f0 2024-05-08T18:34:16.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.568+0000 7f65b77ed640 1 -- 172.21.15.53:0/115388731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b01aa280 con 0x7f65b00684f0 2024-05-08T18:34:16.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.568+0000 7f65a5ffb640 1 -- 172.21.15.53:0/115388731 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65ac004950 con 0x7f65b00684f0 2024-05-08T18:34:16.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.569+0000 7f65b77ed640 1 -- 172.21.15.53:0/115388731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b01abf60 con 0x7f65b00684f0 2024-05-08T18:34:16.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.569+0000 7f65b77ed640 1 -- 172.21.15.53:0/115388731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f65b01a9ad0 con 0x7f65b00684f0 2024-05-08T18:34:16.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.570+0000 7f65a5ffb640 1 -- 172.21.15.53:0/115388731 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f65ac01b070 con 0x7f65b00684f0 2024-05-08T18:34:16.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.570+0000 7f65a5ffb640 1 --2- 172.21.15.53:0/115388731 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f659403d2e0 0x7f659403f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:16.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.570+0000 7f65a5ffb640 1 -- 172.21.15.53:0/115388731 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f65ac0511c0 con 0x7f65b00684f0 2024-05-08T18:34:16.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.570+0000 7f65a5ffb640 1 --2- 172.21.15.53:0/115388731 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6594049750 0x7f659404bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:16.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.570+0000 7f65a5ffb640 1 -- 172.21.15.53:0/115388731 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f659404c2c0 con 0x7f6594049750 2024-05-08T18:34:16.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.570+0000 7f65a5ffb640 1 -- 172.21.15.53:0/115388731 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f65ac058050 con 0x7f65b00684f0 2024-05-08T18:34:16.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.570+0000 7f65b5d8a640 1 --2- 172.21.15.53:0/115388731 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6594049750 0x7f659404bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:16.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.570+0000 7f65b4d88640 1 --2- 172.21.15.53:0/115388731 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f659403d2e0 0x7f659403f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:16.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.570+0000 7f65b5d8a640 1 --2- 172.21.15.53:0/115388731 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6594049750 0x7f659404bbf0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:16.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.571+0000 7f65b4d88640 1 --2- 172.21.15.53:0/115388731 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f659403d2e0 0x7f659403f7a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009720 tx=0x7f65a0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:16.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.571+0000 7f65a5ffb640 1 -- 172.21.15.53:0/115388731 <== osd.0 v2:172.21.15.53:6800/443747735 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f659404c2c0 con 0x7f6594049750 2024-05-08T18:34:16.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.584+0000 7f65b77ed640 1 -- 172.21.15.53:0/115388731 --> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f65b0064010 con 0x7f6594049750 2024-05-08T18:34:16.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.585+0000 7f65a5ffb640 1 -- 172.21.15.53:0/115388731 <== osd.0 v2:172.21.15.53:6800/443747735 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f65b0064010 con 0x7f6594049750 2024-05-08T18:34:16.584 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-05-08T18:34:16.584 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:34:16.584 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-05-08T18:34:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.585+0000 7f65b77ed640 1 -- 172.21.15.53:0/115388731 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6594049750 msgr2=0x7f659404bbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.585+0000 7f65b77ed640 1 --2- 172.21.15.53:0/115388731 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6594049750 0x7f659404bbf0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.585+0000 7f65b77ed640 1 -- 172.21.15.53:0/115388731 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f659403d2e0 msgr2=0x7f659403f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.585+0000 7f65b77ed640 1 --2- 172.21.15.53:0/115388731 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f659403d2e0 0x7f659403f7a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009720 tx=0x7f65a0008030 comp rx=0 tx=0).stop 2024-05-08T18:34:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.585+0000 7f65b77ed640 1 -- 172.21.15.53:0/115388731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b00684f0 msgr2=0x7f65b01c0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.585+0000 7f65b77ed640 1 --2- 172.21.15.53:0/115388731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b00684f0 0x7f65b01c0a30 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00c420 tx=0x7f65ac00c8e0 comp rx=0 tx=0).stop 2024-05-08T18:34:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.585+0000 7f65b77ed640 1 -- 172.21.15.53:0/115388731 shutdown_connections 2024-05-08T18:34:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.585+0000 7f65b77ed640 1 --2- 172.21.15.53:0/115388731 >> [v2:172.21.15.53:6800/443747735,v1:172.21.15.53:6801/443747735] conn(0x7f6594049750 0x7f659404bbf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.585+0000 7f65b77ed640 1 --2- 172.21.15.53:0/115388731 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f659403d2e0 0x7f659403f7a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.585+0000 7f65b77ed640 1 --2- 172.21.15.53:0/115388731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b00684f0 0x7f65b01c0a30 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.585+0000 7f65b77ed640 1 -- 172.21.15.53:0/115388731 >> 172.21.15.53:0/115388731 conn(0x7f65b009e4d0 msgr2=0x7f65b0092420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.585+0000 7f65b77ed640 1 -- 172.21.15.53:0/115388731 shutdown_connections 2024-05-08T18:34:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.585+0000 7f65b77ed640 1 -- 172.21.15.53:0/115388731 wait complete. 2024-05-08T18:34:16.595 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-08T18:34:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.699+0000 7f51bdeb4640 1 Processor -- start 2024-05-08T18:34:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.699+0000 7f51bdeb4640 1 -- start start 2024-05-08T18:34:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.699+0000 7f51bdeb4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51b812d1b0 0x7f51b812d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.699+0000 7f51bdeb4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b812d590 con 0x7f51b812dda0 2024-05-08T18:34:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.699+0000 7f51bdeb4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f51b8114de0 con 0x7f51b812d1b0 2024-05-08T18:34:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.700+0000 7f51b6ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f51b812dda0 0x7f51b8129c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40968/0 (socket says 172.21.15.53:40968) 2024-05-08T18:34:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.700+0000 7f51b77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51b812d1b0 0x7f51b812d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.700+0000 7f51b6ffd640 1 -- 172.21.15.53:0/863566537 learned_addr learned my addr 172.21.15.53:0/863566537 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:34:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.700+0000 7f51b77fe640 1 -- 172.21.15.53:0/863566537 >> v1:172.21.15.53:6789/0 conn(0x7f51b812dda0 legacy=0x7f51b8129c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.700+0000 7f51b77fe640 1 -- 172.21.15.53:0/863566537 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b8113c30 con 0x7f51b812d1b0 2024-05-08T18:34:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.701+0000 7f51b77fe640 1 --2- 172.21.15.53:0/863566537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51b812d1b0 0x7f51b812d860 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009720 tx=0x7f51a802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81859032c994f8a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.701+0000 7f51b67fc640 1 -- 172.21.15.53:0/863566537 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51a80316d0 con 0x7f51b812d1b0 2024-05-08T18:34:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.701+0000 7f51b67fc640 1 -- 172.21.15.53:0/863566537 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a8037070 con 0x7f51b812d1b0 2024-05-08T18:34:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.701+0000 7f51b67fc640 1 -- 172.21.15.53:0/863566537 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51a80319c0 con 0x7f51b812d1b0 2024-05-08T18:34:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.701+0000 7f51bdeb4640 1 -- 172.21.15.53:0/863566537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51b812d1b0 msgr2=0x7f51b812d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.701+0000 7f51bdeb4640 1 --2- 172.21.15.53:0/863566537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51b812d1b0 0x7f51b812d860 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009720 tx=0x7f51a802b840 comp rx=0 tx=0).stop 2024-05-08T18:34:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.701+0000 7f51bdeb4640 1 -- 172.21.15.53:0/863566537 shutdown_connections 2024-05-08T18:34:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.701+0000 7f51bdeb4640 1 --2- 172.21.15.53:0/863566537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51b812d1b0 0x7f51b812d860 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.701+0000 7f51bdeb4640 1 -- 172.21.15.53:0/863566537 >> 172.21.15.53:0/863566537 conn(0x7f51b809a910 msgr2=0x7f51b806e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.701+0000 7f51bdeb4640 1 -- 172.21.15.53:0/863566537 shutdown_connections 2024-05-08T18:34:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.701+0000 7f51bdeb4640 1 -- 172.21.15.53:0/863566537 wait complete. 2024-05-08T18:34:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.702+0000 7f51bdeb4640 1 Processor -- start 2024-05-08T18:34:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.702+0000 7f51bdeb4640 1 -- start start 2024-05-08T18:34:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.703+0000 7f51bdeb4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51b812d1b0 0x7f51b8117f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.703+0000 7f51bdeb4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f51b812a6d0 con 0x7f51b812d1b0 2024-05-08T18:34:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.703+0000 7f51b77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51b812d1b0 0x7f51b8117f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.703+0000 7f51b77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51b812d1b0 0x7f51b8117f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41182/0 (socket says 172.21.15.53:41182) 2024-05-08T18:34:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.703+0000 7f51b77fe640 1 -- 172.21.15.53:0/295272189 learned_addr learned my addr 172.21.15.53:0/295272189 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:34:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.703+0000 7f51b77fe640 1 -- 172.21.15.53:0/295272189 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b811b070 con 0x7f51b812d1b0 2024-05-08T18:34:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.703+0000 7f51b77fe640 1 --2- 172.21.15.53:0/295272189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51b812d1b0 0x7f51b8117f10 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f51a8034040 tx=0x7f51a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.704+0000 7f519ffff640 1 -- 172.21.15.53:0/295272189 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51a8032770 con 0x7f51b812d1b0 2024-05-08T18:34:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.704+0000 7f519ffff640 1 -- 172.21.15.53:0/295272189 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a8032930 con 0x7f51b812d1b0 2024-05-08T18:34:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.704+0000 7f51bdeb4640 1 -- 172.21.15.53:0/295272189 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b8070aa0 con 0x7f51b812d1b0 2024-05-08T18:34:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.704+0000 7f519ffff640 1 -- 172.21.15.53:0/295272189 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51a8032c50 con 0x7f51b812d1b0 2024-05-08T18:34:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.704+0000 7f51bdeb4640 1 -- 172.21.15.53:0/295272189 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b811a990 con 0x7f51b812d1b0 2024-05-08T18:34:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.705+0000 7f519ffff640 1 -- 172.21.15.53:0/295272189 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f51a804c060 con 0x7f51b812d1b0 2024-05-08T18:34:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.705+0000 7f51bdeb4640 1 -- 172.21.15.53:0/295272189 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b809cac0 con 0x7f51b812d1b0 2024-05-08T18:34:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.705+0000 7f519ffff640 1 --2- 172.21.15.53:0/295272189 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f51a403d2b0 0x7f51a403f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.705+0000 7f519ffff640 1 -- 172.21.15.53:0/295272189 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f51a802f050 con 0x7f51b812d1b0 2024-05-08T18:34:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.705+0000 7f51b6ffd640 1 --2- 172.21.15.53:0/295272189 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f51a403d2b0 0x7f51a403f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.705+0000 7f51b6ffd640 1 --2- 172.21.15.53:0/295272189 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f51a403d2b0 0x7f51a403f770 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f51ac007fd0 tx=0x7f51ac007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:16.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.709+0000 7f519ffff640 1 -- 172.21.15.53:0/295272189 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f51b809cac0 con 0x7f51b812d1b0 2024-05-08T18:34:16.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.899+0000 7f51bdeb4640 1 -- 172.21.15.53:0/295272189 --> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f51b811ac20 con 0x7f51a403d2b0 2024-05-08T18:34:16.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.900+0000 7f519ffff640 1 -- 172.21.15.53:0/295272189 <== mgr.4102 v2:172.21.15.87:6824/211215191 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f51b811ac20 con 0x7f51a403d2b0 2024-05-08T18:34:16.899 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 0 to deep-scrub 2024-05-08T18:34:16.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.902+0000 7f51bdeb4640 1 -- 172.21.15.53:0/295272189 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f51a403d2b0 msgr2=0x7f51a403f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:16.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.902+0000 7f51bdeb4640 1 --2- 172.21.15.53:0/295272189 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f51a403d2b0 0x7f51a403f770 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f51ac007fd0 tx=0x7f51ac007ac0 comp rx=0 tx=0).stop 2024-05-08T18:34:16.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.902+0000 7f51bdeb4640 1 -- 172.21.15.53:0/295272189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51b812d1b0 msgr2=0x7f51b8117f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:16.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.902+0000 7f51bdeb4640 1 --2- 172.21.15.53:0/295272189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51b812d1b0 0x7f51b8117f10 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f51a8034040 tx=0x7f51a80046c0 comp rx=0 tx=0).stop 2024-05-08T18:34:16.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.903+0000 7f51bdeb4640 1 -- 172.21.15.53:0/295272189 shutdown_connections 2024-05-08T18:34:16.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.903+0000 7f51bdeb4640 1 --2- 172.21.15.53:0/295272189 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f51a403d2b0 0x7f51a403f770 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:16.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.903+0000 7f51bdeb4640 1 --2- 172.21.15.53:0/295272189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51b812d1b0 0x7f51b8117f10 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:16.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.903+0000 7f51bdeb4640 1 -- 172.21.15.53:0/295272189 >> 172.21.15.53:0/295272189 conn(0x7f51b809a910 msgr2=0x7f51b806f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:16.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.903+0000 7f51bdeb4640 1 -- 172.21.15.53:0/295272189 shutdown_connections 2024-05-08T18:34:16.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:16.903+0000 7f51bdeb4640 1 -- 172.21.15.53:0/295272189 wait complete. 2024-05-08T18:34:16.912 INFO:tasks.ceph:Scrubbing osd.1 2024-05-08T18:34:16.913 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:34:17.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.020+0000 7ff04f939640 1 Processor -- start 2024-05-08T18:34:17.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.020+0000 7ff04f939640 1 -- start start 2024-05-08T18:34:17.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.021+0000 7ff04f939640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff04812e6f0 0x7ff04812ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.021+0000 7ff04f939640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04806eec0 con 0x7ff04809d490 2024-05-08T18:34:17.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.021+0000 7ff04f939640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ff04809adc0 con 0x7ff04812e6f0 2024-05-08T18:34:17.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.021+0000 7ff04d6d5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff04812e6f0 0x7ff04812ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.021+0000 7ff04ced4640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff04809d490 0x7ff04809d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40980/0 (socket says 172.21.15.53:40980) 2024-05-08T18:34:17.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.021+0000 7ff04ced4640 1 -- 172.21.15.53:0/4280828932 learned_addr learned my addr 172.21.15.53:0/4280828932 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:34:17.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.021+0000 7ff04d6d5640 1 -- 172.21.15.53:0/4280828932 >> v1:172.21.15.53:6789/0 conn(0x7ff04809d490 legacy=0x7ff04809d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.021+0000 7ff047fff640 1 -- 172.21.15.53:0/4280828932 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3498454204 0 0) 0x7ff04806eec0 con 0x7ff04809d490 2024-05-08T18:34:17.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.021+0000 7ff04d6d5640 1 -- 172.21.15.53:0/4280828932 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04809b300 con 0x7ff04812e6f0 2024-05-08T18:34:17.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.022+0000 7ff04d6d5640 1 --2- 172.21.15.53:0/4280828932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04812e6f0 0x7ff04812ead0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7ff040009720 tx=0x7ff04002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657fe8e34b272af9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.022+0000 7ff047fff640 1 -- 172.21.15.53:0/4280828932 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0400316d0 con 0x7ff04812e6f0 2024-05-08T18:34:17.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.022+0000 7ff047fff640 1 -- 172.21.15.53:0/4280828932 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff040037070 con 0x7ff04812e6f0 2024-05-08T18:34:17.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.022+0000 7ff047fff640 1 -- 172.21.15.53:0/4280828932 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0400319c0 con 0x7ff04812e6f0 2024-05-08T18:34:17.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.023+0000 7ff04f939640 1 -- 172.21.15.53:0/4280828932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04812e6f0 msgr2=0x7ff04812ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.023+0000 7ff04f939640 1 --2- 172.21.15.53:0/4280828932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04812e6f0 0x7ff04812ead0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7ff040009720 tx=0x7ff04002b840 comp rx=0 tx=0).stop 2024-05-08T18:34:17.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.023+0000 7ff04f939640 1 -- 172.21.15.53:0/4280828932 shutdown_connections 2024-05-08T18:34:17.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.023+0000 7ff04f939640 1 --2- 172.21.15.53:0/4280828932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04812e6f0 0x7ff04812ead0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.023+0000 7ff04f939640 1 -- 172.21.15.53:0/4280828932 >> 172.21.15.53:0/4280828932 conn(0x7ff04806e160 msgr2=0x7ff04806e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:17.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.023+0000 7ff04f939640 1 -- 172.21.15.53:0/4280828932 shutdown_connections 2024-05-08T18:34:17.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.023+0000 7ff04f939640 1 -- 172.21.15.53:0/4280828932 wait complete. 2024-05-08T18:34:17.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.024+0000 7ff04f939640 1 Processor -- start 2024-05-08T18:34:17.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.024+0000 7ff04f939640 1 -- start start 2024-05-08T18:34:17.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.024+0000 7ff04f939640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04809d490 0x7ff04811a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.024+0000 7ff04f939640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff04809a440 con 0x7ff04809d490 2024-05-08T18:34:17.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.024+0000 7ff04d6d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04809d490 0x7ff04811a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.024+0000 7ff04d6d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04809d490 0x7ff04811a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41186/0 (socket says 172.21.15.53:41186) 2024-05-08T18:34:17.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.024+0000 7ff04d6d5640 1 -- 172.21.15.53:0/721543405 learned_addr learned my addr 172.21.15.53:0/721543405 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:34:17.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.024+0000 7ff04d6d5640 1 -- 172.21.15.53:0/721543405 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04811d470 con 0x7ff04809d490 2024-05-08T18:34:17.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.025+0000 7ff04d6d5640 1 --2- 172.21.15.53:0/721543405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04809d490 0x7ff04811a310 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff040009840 tx=0x7ff0400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.025+0000 7ff045ffb640 1 -- 172.21.15.53:0/721543405 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff040004030 con 0x7ff04809d490 2024-05-08T18:34:17.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.025+0000 7ff045ffb640 1 -- 172.21.15.53:0/721543405 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0400041d0 con 0x7ff04809d490 2024-05-08T18:34:17.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.025+0000 7ff04f939640 1 -- 172.21.15.53:0/721543405 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff04811d8b0 con 0x7ff04809d490 2024-05-08T18:34:17.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.025+0000 7ff045ffb640 1 -- 172.21.15.53:0/721543405 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0400044b0 con 0x7ff04809d490 2024-05-08T18:34:17.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.025+0000 7ff04f939640 1 -- 172.21.15.53:0/721543405 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff04811a850 con 0x7ff04809d490 2024-05-08T18:34:17.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.026+0000 7ff04f939640 1 -- 172.21.15.53:0/721543405 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff048064010 con 0x7ff04809d490 2024-05-08T18:34:17.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.026+0000 7ff045ffb640 1 -- 172.21.15.53:0/721543405 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff040003610 con 0x7ff04809d490 2024-05-08T18:34:17.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.026+0000 7ff045ffb640 1 --2- 172.21.15.53:0/721543405 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff03403d2b0 0x7ff03403f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.026+0000 7ff045ffb640 1 -- 172.21.15.53:0/721543405 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff04002f050 con 0x7ff04809d490 2024-05-08T18:34:17.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.026+0000 7ff045ffb640 1 --2- 172.21.15.53:0/721543405 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x7ff034049720 0x7ff03404bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.026+0000 7ff045ffb640 1 -- 172.21.15.53:0/721543405 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff04002de50 con 0x7ff034049720 2024-05-08T18:34:17.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.026+0000 7ff045ffb640 1 -- 172.21.15.53:0/721543405 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff0400782a0 con 0x7ff04809d490 2024-05-08T18:34:17.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.026+0000 7ff04ced4640 1 --2- 172.21.15.53:0/721543405 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff03403d2b0 0x7ff03403f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.027+0000 7ff04ded6640 1 --2- 172.21.15.53:0/721543405 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x7ff034049720 0x7ff03404bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.027+0000 7ff04ced4640 1 --2- 172.21.15.53:0/721543405 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff03403d2b0 0x7ff03403f770 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff03c000c00 tx=0x7ff03c007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.027+0000 7ff04ded6640 1 --2- 172.21.15.53:0/721543405 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x7ff034049720 0x7ff03404bbc0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.028+0000 7ff045ffb640 1 -- 172.21.15.53:0/721543405 <== osd.1 v2:172.21.15.87:6808/2448644045 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff04002de50 con 0x7ff034049720 2024-05-08T18:34:17.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.041+0000 7ff04f939640 1 -- 172.21.15.53:0/721543405 --> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff04811ce90 con 0x7ff034049720 2024-05-08T18:34:17.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.041+0000 7ff045ffb640 1 -- 172.21.15.53:0/721543405 <== osd.1 v2:172.21.15.87:6808/2448644045 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff03800ad10 con 0x7ff034049720 2024-05-08T18:34:17.040 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-05-08T18:34:17.040 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:34:17.040 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-05-08T18:34:17.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.042+0000 7ff04f939640 1 -- 172.21.15.53:0/721543405 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x7ff034049720 msgr2=0x7ff03404bbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.042+0000 7ff04f939640 1 --2- 172.21.15.53:0/721543405 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x7ff034049720 0x7ff03404bbc0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.042+0000 7ff04f939640 1 -- 172.21.15.53:0/721543405 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff03403d2b0 msgr2=0x7ff03403f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.042+0000 7ff04f939640 1 --2- 172.21.15.53:0/721543405 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff03403d2b0 0x7ff03403f770 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff03c000c00 tx=0x7ff03c007910 comp rx=0 tx=0).stop 2024-05-08T18:34:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.042+0000 7ff04f939640 1 -- 172.21.15.53:0/721543405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04809d490 msgr2=0x7ff04811a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.042+0000 7ff04f939640 1 --2- 172.21.15.53:0/721543405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04809d490 0x7ff04811a310 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff040009840 tx=0x7ff0400046c0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.042+0000 7ff04f939640 1 -- 172.21.15.53:0/721543405 shutdown_connections 2024-05-08T18:34:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.042+0000 7ff04f939640 1 --2- 172.21.15.53:0/721543405 >> [v2:172.21.15.87:6808/2448644045,v1:172.21.15.87:6809/2448644045] conn(0x7ff034049720 0x7ff03404bbc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.042+0000 7ff04f939640 1 --2- 172.21.15.53:0/721543405 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff03403d2b0 0x7ff03403f770 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.042+0000 7ff04f939640 1 --2- 172.21.15.53:0/721543405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04809d490 0x7ff04811a310 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.042+0000 7ff04f939640 1 -- 172.21.15.53:0/721543405 >> 172.21.15.53:0/721543405 conn(0x7ff04806e160 msgr2=0x7ff0481b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.042+0000 7ff04f939640 1 -- 172.21.15.53:0/721543405 shutdown_connections 2024-05-08T18:34:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.042+0000 7ff04f939640 1 -- 172.21.15.53:0/721543405 wait complete. 2024-05-08T18:34:17.051 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-08T18:34:17.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.155+0000 7f2d44454640 1 Processor -- start 2024-05-08T18:34:17.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.155+0000 7f2d44454640 1 -- start start 2024-05-08T18:34:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.156+0000 7f2d44454640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d3c130520 0x7f2d3c132910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.156+0000 7f2d44454640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d3c12d590 con 0x7f2d3c12d1b0 2024-05-08T18:34:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.156+0000 7f2d44454640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f2d3c114de0 con 0x7f2d3c130520 2024-05-08T18:34:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.156+0000 7f2d419ef640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d3c130520 0x7f2d3c132910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.156+0000 7f2d421f0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2d3c12d1b0 0x7f2d3c12d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40996/0 (socket says 172.21.15.53:40996) 2024-05-08T18:34:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.156+0000 7f2d421f0640 1 -- 172.21.15.53:0/1260004952 learned_addr learned my addr 172.21.15.53:0/1260004952 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:34:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.156+0000 7f2d419ef640 1 -- 172.21.15.53:0/1260004952 >> v1:172.21.15.53:6789/0 conn(0x7f2d3c12d1b0 legacy=0x7f2d3c12d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.156+0000 7f2d419ef640 1 -- 172.21.15.53:0/1260004952 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3c113c30 con 0x7f2d3c130520 2024-05-08T18:34:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.157+0000 7f2d419ef640 1 --2- 172.21.15.53:0/1260004952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d3c130520 0x7f2d3c132910 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009720 tx=0x7f2d2c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8592eed8cf94a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.157+0000 7f2d411ee640 1 -- 172.21.15.53:0/1260004952 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d2c0316d0 con 0x7f2d3c130520 2024-05-08T18:34:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.157+0000 7f2d411ee640 1 -- 172.21.15.53:0/1260004952 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d2c037070 con 0x7f2d3c130520 2024-05-08T18:34:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.157+0000 7f2d411ee640 1 -- 172.21.15.53:0/1260004952 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d2c0319c0 con 0x7f2d3c130520 2024-05-08T18:34:17.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.157+0000 7f2d44454640 1 -- 172.21.15.53:0/1260004952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d3c130520 msgr2=0x7f2d3c132910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.157+0000 7f2d44454640 1 --2- 172.21.15.53:0/1260004952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d3c130520 0x7f2d3c132910 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009720 tx=0x7f2d2c02b840 comp rx=0 tx=0).stop 2024-05-08T18:34:17.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.158+0000 7f2d44454640 1 -- 172.21.15.53:0/1260004952 shutdown_connections 2024-05-08T18:34:17.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.158+0000 7f2d44454640 1 --2- 172.21.15.53:0/1260004952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d3c130520 0x7f2d3c132910 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.158+0000 7f2d44454640 1 -- 172.21.15.53:0/1260004952 >> 172.21.15.53:0/1260004952 conn(0x7f2d3c09a910 msgr2=0x7f2d3c06e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:17.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.158+0000 7f2d44454640 1 -- 172.21.15.53:0/1260004952 shutdown_connections 2024-05-08T18:34:17.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.158+0000 7f2d44454640 1 -- 172.21.15.53:0/1260004952 wait complete. 2024-05-08T18:34:17.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.158+0000 7f2d44454640 1 Processor -- start 2024-05-08T18:34:17.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.159+0000 7f2d44454640 1 -- start start 2024-05-08T18:34:17.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.159+0000 7f2d44454640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d3c12d1b0 0x7f2d3c128bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.159+0000 7f2d44454640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c132fd0 con 0x7f2d3c12d1b0 2024-05-08T18:34:17.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.159+0000 7f2d421f0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d3c12d1b0 0x7f2d3c128bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.159+0000 7f2d421f0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d3c12d1b0 0x7f2d3c128bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41210/0 (socket says 172.21.15.53:41210) 2024-05-08T18:34:17.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.159+0000 7f2d421f0640 1 -- 172.21.15.53:0/3171229483 learned_addr learned my addr 172.21.15.53:0/3171229483 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:34:17.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.159+0000 7f2d421f0640 1 -- 172.21.15.53:0/3171229483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3c12aa90 con 0x7f2d3c12d1b0 2024-05-08T18:34:17.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.159+0000 7f2d421f0640 1 --2- 172.21.15.53:0/3171229483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d3c12d1b0 0x7f2d3c128bd0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800c340 tx=0x7f2d3800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.159+0000 7f2d32ffd640 1 -- 172.21.15.53:0/3171229483 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d38005cd0 con 0x7f2d3c12d1b0 2024-05-08T18:34:17.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.160+0000 7f2d32ffd640 1 -- 172.21.15.53:0/3171229483 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d380047e0 con 0x7f2d3c12d1b0 2024-05-08T18:34:17.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.160+0000 7f2d44454640 1 -- 172.21.15.53:0/3171229483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3c115c00 con 0x7f2d3c12d1b0 2024-05-08T18:34:17.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.160+0000 7f2d32ffd640 1 -- 172.21.15.53:0/3171229483 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d38004b20 con 0x7f2d3c12d1b0 2024-05-08T18:34:17.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.160+0000 7f2d44454640 1 -- 172.21.15.53:0/3171229483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d3c129110 con 0x7f2d3c12d1b0 2024-05-08T18:34:17.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.160+0000 7f2d32ffd640 1 -- 172.21.15.53:0/3171229483 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2d3801a020 con 0x7f2d3c12d1b0 2024-05-08T18:34:17.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.161+0000 7f2d32ffd640 1 --2- 172.21.15.53:0/3171229483 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2d2003d2b0 0x7f2d2003f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.161+0000 7f2d32ffd640 1 -- 172.21.15.53:0/3171229483 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f2d38051620 con 0x7f2d3c12d1b0 2024-05-08T18:34:17.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.161+0000 7f2d44454640 1 -- 172.21.15.53:0/3171229483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d3c064010 con 0x7f2d3c12d1b0 2024-05-08T18:34:17.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.161+0000 7f2d419ef640 1 --2- 172.21.15.53:0/3171229483 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2d2003d2b0 0x7f2d2003f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.161+0000 7f2d419ef640 1 --2- 172.21.15.53:0/3171229483 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2d2003d2b0 0x7f2d2003f770 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c036000 tx=0x7f2d2c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.165+0000 7f2d32ffd640 1 -- 172.21.15.53:0/3171229483 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2d380075f0 con 0x7f2d3c12d1b0 2024-05-08T18:34:17.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.358+0000 7f2d44454640 1 -- 172.21.15.53:0/3171229483 --> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f2d3c115510 con 0x7f2d2003d2b0 2024-05-08T18:34:17.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.359+0000 7f2d32ffd640 1 -- 172.21.15.53:0/3171229483 <== mgr.4102 v2:172.21.15.87:6824/211215191 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2d3c115510 con 0x7f2d2003d2b0 2024-05-08T18:34:17.358 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 1 to deep-scrub 2024-05-08T18:34:17.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.361+0000 7f2d44454640 1 -- 172.21.15.53:0/3171229483 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2d2003d2b0 msgr2=0x7f2d2003f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.361+0000 7f2d44454640 1 --2- 172.21.15.53:0/3171229483 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2d2003d2b0 0x7f2d2003f770 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c036000 tx=0x7f2d2c008030 comp rx=0 tx=0).stop 2024-05-08T18:34:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.361+0000 7f2d44454640 1 -- 172.21.15.53:0/3171229483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d3c12d1b0 msgr2=0x7f2d3c128bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.361+0000 7f2d44454640 1 --2- 172.21.15.53:0/3171229483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d3c12d1b0 0x7f2d3c128bd0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800c340 tx=0x7f2d3800c800 comp rx=0 tx=0).stop 2024-05-08T18:34:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.361+0000 7f2d44454640 1 -- 172.21.15.53:0/3171229483 shutdown_connections 2024-05-08T18:34:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.361+0000 7f2d44454640 1 --2- 172.21.15.53:0/3171229483 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f2d2003d2b0 0x7f2d2003f770 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.361+0000 7f2d44454640 1 --2- 172.21.15.53:0/3171229483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d3c12d1b0 0x7f2d3c128bd0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.361+0000 7f2d44454640 1 -- 172.21.15.53:0/3171229483 >> 172.21.15.53:0/3171229483 conn(0x7f2d3c09a910 msgr2=0x7f2d3c12f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.361+0000 7f2d44454640 1 -- 172.21.15.53:0/3171229483 shutdown_connections 2024-05-08T18:34:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.361+0000 7f2d44454640 1 -- 172.21.15.53:0/3171229483 wait complete. 2024-05-08T18:34:17.371 INFO:tasks.ceph:Scrubbing osd.2 2024-05-08T18:34:17.374 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:34:17.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.481+0000 7f01e592d640 1 Processor -- start 2024-05-08T18:34:17.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.482+0000 7f01e592d640 1 -- start start 2024-05-08T18:34:17.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.482+0000 7f01e592d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f01e006f780 0x7f01e012c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.482+0000 7f01e592d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e012c0e0 con 0x7f01e012ca50 2024-05-08T18:34:17.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.482+0000 7f01e592d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f01e0073300 con 0x7f01e006f780 2024-05-08T18:34:17.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.482+0000 7f01de7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f01e012ca50 0x7f01e0071120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41008/0 (socket says 172.21.15.53:41008) 2024-05-08T18:34:17.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.482+0000 7f01deffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f01e006f780 0x7f01e012c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.482+0000 7f01de7fc640 1 -- 172.21.15.53:0/2899271188 learned_addr learned my addr 172.21.15.53:0/2899271188 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:34:17.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.482+0000 7f01ddffb640 1 -- 172.21.15.53:0/2899271188 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 777219553 0 0) 0x7f01e012c0e0 con 0x7f01e012ca50 2024-05-08T18:34:17.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.482+0000 7f01ddffb640 1 -- 172.21.15.53:0/2899271188 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01c8003520 con 0x7f01e012ca50 2024-05-08T18:34:17.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.482+0000 7f01deffd640 1 -- 172.21.15.53:0/2899271188 >> v1:172.21.15.53:6789/0 conn(0x7f01e012ca50 legacy=0x7f01e0071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.482+0000 7f01deffd640 1 -- 172.21.15.53:0/2899271188 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e0113ca0 con 0x7f01e006f780 2024-05-08T18:34:17.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.483+0000 7f01deffd640 1 --2- 172.21.15.53:0/2899271188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01e006f780 0x7f01e012c510 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009720 tx=0x7f01d002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d075c28e86f8fd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.483+0000 7f01ddffb640 1 -- 172.21.15.53:0/2899271188 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d0035020 con 0x7f01e006f780 2024-05-08T18:34:17.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.483+0000 7f01ddffb640 1 -- 172.21.15.53:0/2899271188 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d0031760 con 0x7f01e006f780 2024-05-08T18:34:17.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.483+0000 7f01ddffb640 1 -- 172.21.15.53:0/2899271188 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d0031a40 con 0x7f01e006f780 2024-05-08T18:34:17.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.484+0000 7f01e592d640 1 -- 172.21.15.53:0/2899271188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01e006f780 msgr2=0x7f01e012c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.484+0000 7f01e592d640 1 --2- 172.21.15.53:0/2899271188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01e006f780 0x7f01e012c510 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009720 tx=0x7f01d002b8d0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.484+0000 7f01e592d640 1 -- 172.21.15.53:0/2899271188 shutdown_connections 2024-05-08T18:34:17.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.484+0000 7f01e592d640 1 --2- 172.21.15.53:0/2899271188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01e006f780 0x7f01e012c510 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.484+0000 7f01e592d640 1 -- 172.21.15.53:0/2899271188 >> 172.21.15.53:0/2899271188 conn(0x7f01e009a330 msgr2=0x7f01e009a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:17.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.484+0000 7f01e592d640 1 -- 172.21.15.53:0/2899271188 shutdown_connections 2024-05-08T18:34:17.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.484+0000 7f01e592d640 1 -- 172.21.15.53:0/2899271188 wait complete. 2024-05-08T18:34:17.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.485+0000 7f01e592d640 1 Processor -- start 2024-05-08T18:34:17.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.485+0000 7f01e592d640 1 -- start start 2024-05-08T18:34:17.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.485+0000 7f01e592d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01e006f780 0x7f01e01c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.485+0000 7f01e592d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f01e0072b30 con 0x7f01e006f780 2024-05-08T18:34:17.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.485+0000 7f01deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01e006f780 0x7f01e01c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.486+0000 7f01deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01e006f780 0x7f01e01c1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41234/0 (socket says 172.21.15.53:41234) 2024-05-08T18:34:17.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.486+0000 7f01deffd640 1 -- 172.21.15.53:0/4021594328 learned_addr learned my addr 172.21.15.53:0/4021594328 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:34:17.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.486+0000 7f01deffd640 1 -- 172.21.15.53:0/4021594328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e01290d0 con 0x7f01e006f780 2024-05-08T18:34:17.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.486+0000 7f01deffd640 1 --2- 172.21.15.53:0/4021594328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01e006f780 0x7f01e01c1d10 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f01d0034040 tx=0x7f01d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.486+0000 7f01c7fff640 1 -- 172.21.15.53:0/4021594328 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d0003820 con 0x7f01e006f780 2024-05-08T18:34:17.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.486+0000 7f01c7fff640 1 -- 172.21.15.53:0/4021594328 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d00039c0 con 0x7f01e006f780 2024-05-08T18:34:17.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.486+0000 7f01e592d640 1 -- 172.21.15.53:0/4021594328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e0115ec0 con 0x7f01e006f780 2024-05-08T18:34:17.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.486+0000 7f01c7fff640 1 -- 172.21.15.53:0/4021594328 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d0003cc0 con 0x7f01e006f780 2024-05-08T18:34:17.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.486+0000 7f01e592d640 1 -- 172.21.15.53:0/4021594328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e01c2250 con 0x7f01e006f780 2024-05-08T18:34:17.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.487+0000 7f01e592d640 1 -- 172.21.15.53:0/4021594328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f01e0064010 con 0x7f01e006f780 2024-05-08T18:34:17.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.487+0000 7f01c7fff640 1 -- 172.21.15.53:0/4021594328 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f01d0038020 con 0x7f01e006f780 2024-05-08T18:34:17.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.487+0000 7f01c7fff640 1 --2- 172.21.15.53:0/4021594328 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f01cc03d2b0 0x7f01cc03f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.487+0000 7f01c7fff640 1 -- 172.21.15.53:0/4021594328 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f01d0074250 con 0x7f01e006f780 2024-05-08T18:34:17.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.487+0000 7f01c7fff640 1 --2- 172.21.15.53:0/4021594328 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f01cc049780 0x7f01cc04bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.487+0000 7f01c7fff640 1 -- 172.21.15.53:0/4021594328 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01d0031760 con 0x7f01cc049780 2024-05-08T18:34:17.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.487+0000 7f01c7fff640 1 -- 172.21.15.53:0/4021594328 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f01d007b050 con 0x7f01e006f780 2024-05-08T18:34:17.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.488+0000 7f01de7fc640 1 --2- 172.21.15.53:0/4021594328 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f01cc03d2b0 0x7f01cc03f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.488+0000 7f01df7fe640 1 --2- 172.21.15.53:0/4021594328 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f01cc049780 0x7f01cc04bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.488+0000 7f01de7fc640 1 --2- 172.21.15.53:0/4021594328 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f01cc03d2b0 0x7f01cc03f770 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f01d4007fd0 tx=0x7f01d40010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.488+0000 7f01df7fe640 1 --2- 172.21.15.53:0/4021594328 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f01cc049780 0x7f01cc04bc20 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.489+0000 7f01c7fff640 1 -- 172.21.15.53:0/4021594328 <== osd.2 v2:172.21.15.87:6816/2108501615 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f01d0031760 con 0x7f01cc049780 2024-05-08T18:34:17.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.502+0000 7f01e592d640 1 -- 172.21.15.53:0/4021594328 --> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f01e01b45c0 con 0x7f01cc049780 2024-05-08T18:34:17.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.502+0000 7f01c7fff640 1 -- 172.21.15.53:0/4021594328 <== osd.2 v2:172.21.15.87:6816/2108501615 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f01e01b45c0 con 0x7f01cc049780 2024-05-08T18:34:17.502 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-05-08T18:34:17.502 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:34:17.502 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-05-08T18:34:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.503+0000 7f01e592d640 1 -- 172.21.15.53:0/4021594328 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f01cc049780 msgr2=0x7f01cc04bc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.503+0000 7f01e592d640 1 --2- 172.21.15.53:0/4021594328 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f01cc049780 0x7f01cc04bc20 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.503+0000 7f01e592d640 1 -- 172.21.15.53:0/4021594328 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f01cc03d2b0 msgr2=0x7f01cc03f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.503+0000 7f01e592d640 1 --2- 172.21.15.53:0/4021594328 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f01cc03d2b0 0x7f01cc03f770 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f01d4007fd0 tx=0x7f01d40010a0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.503+0000 7f01e592d640 1 -- 172.21.15.53:0/4021594328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01e006f780 msgr2=0x7f01e01c1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.503+0000 7f01e592d640 1 --2- 172.21.15.53:0/4021594328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01e006f780 0x7f01e01c1d10 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f01d0034040 tx=0x7f01d00046c0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.503+0000 7f01e592d640 1 -- 172.21.15.53:0/4021594328 shutdown_connections 2024-05-08T18:34:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.503+0000 7f01e592d640 1 --2- 172.21.15.53:0/4021594328 >> [v2:172.21.15.87:6816/2108501615,v1:172.21.15.87:6817/2108501615] conn(0x7f01cc049780 0x7f01cc04bc20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.503+0000 7f01e592d640 1 --2- 172.21.15.53:0/4021594328 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f01cc03d2b0 0x7f01cc03f770 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.503+0000 7f01e592d640 1 --2- 172.21.15.53:0/4021594328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01e006f780 0x7f01e01c1d10 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.503+0000 7f01e592d640 1 -- 172.21.15.53:0/4021594328 >> 172.21.15.53:0/4021594328 conn(0x7f01e009a330 msgr2=0x7f01e01b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:17.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.503+0000 7f01e592d640 1 -- 172.21.15.53:0/4021594328 shutdown_connections 2024-05-08T18:34:17.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.503+0000 7f01e592d640 1 -- 172.21.15.53:0/4021594328 wait complete. 2024-05-08T18:34:17.512 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-08T18:34:17.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.617+0000 7f1607106640 1 Processor -- start 2024-05-08T18:34:17.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.617+0000 7f1607106640 1 -- start start 2024-05-08T18:34:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.617+0000 7f1607106640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1600129560 0x7f16001313d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.617+0000 7f1607106640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1600072dc0 con 0x7f160006fe20 2024-05-08T18:34:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.617+0000 7f1607106640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f16001299f0 con 0x7f1600129560 2024-05-08T18:34:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.618+0000 7f15fffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1600129560 0x7f16001313d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.618+0000 7f1604ea2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f160006fe20 0x7f1600128e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41024/0 (socket says 172.21.15.53:41024) 2024-05-08T18:34:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.618+0000 7f1604ea2640 1 -- 172.21.15.53:0/2140721762 learned_addr learned my addr 172.21.15.53:0/2140721762 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:34:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.618+0000 7f15fffff640 1 -- 172.21.15.53:0/2140721762 >> v1:172.21.15.53:6789/0 conn(0x7f160006fe20 legacy=0x7f1600128e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.618+0000 7f15fffff640 1 -- 172.21.15.53:0/2140721762 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1600128ad0 con 0x7f1600129560 2024-05-08T18:34:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.619+0000 7f15fffff640 1 --2- 172.21.15.53:0/2140721762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1600129560 0x7f16001313d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009720 tx=0x7f15ec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d77ea9941b77149 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.619+0000 7f15ff7fe640 1 -- 172.21.15.53:0/2140721762 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15ec0316d0 con 0x7f1600129560 2024-05-08T18:34:17.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.619+0000 7f15ff7fe640 1 -- 172.21.15.53:0/2140721762 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15ec037070 con 0x7f1600129560 2024-05-08T18:34:17.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.619+0000 7f15ff7fe640 1 -- 172.21.15.53:0/2140721762 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15ec0319c0 con 0x7f1600129560 2024-05-08T18:34:17.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.619+0000 7f1607106640 1 -- 172.21.15.53:0/2140721762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1600129560 msgr2=0x7f16001313d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.619+0000 7f1607106640 1 --2- 172.21.15.53:0/2140721762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1600129560 0x7f16001313d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009720 tx=0x7f15ec02b840 comp rx=0 tx=0).stop 2024-05-08T18:34:17.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.619+0000 7f1607106640 1 -- 172.21.15.53:0/2140721762 shutdown_connections 2024-05-08T18:34:17.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.619+0000 7f1607106640 1 --2- 172.21.15.53:0/2140721762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1600129560 0x7f16001313d0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.619+0000 7f1607106640 1 -- 172.21.15.53:0/2140721762 >> 172.21.15.53:0/2140721762 conn(0x7f160009a910 msgr2=0x7f160006e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:17.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.619+0000 7f1607106640 1 -- 172.21.15.53:0/2140721762 shutdown_connections 2024-05-08T18:34:17.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.619+0000 7f1607106640 1 -- 172.21.15.53:0/2140721762 wait complete. 2024-05-08T18:34:17.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.620+0000 7f1607106640 1 Processor -- start 2024-05-08T18:34:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.620+0000 7f1607106640 1 -- start start 2024-05-08T18:34:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.621+0000 7f1607106640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160006fe20 0x7f16001c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.621+0000 7f1607106640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1600131910 con 0x7f160006fe20 2024-05-08T18:34:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.621+0000 7f1604ea2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160006fe20 0x7f16001c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.621+0000 7f1604ea2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160006fe20 0x7f16001c3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41254/0 (socket says 172.21.15.53:41254) 2024-05-08T18:34:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.621+0000 7f1604ea2640 1 -- 172.21.15.53:0/321856302 learned_addr learned my addr 172.21.15.53:0/321856302 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:34:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.621+0000 7f1604ea2640 1 -- 172.21.15.53:0/321856302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1600124a90 con 0x7f160006fe20 2024-05-08T18:34:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.621+0000 7f1604ea2640 1 --2- 172.21.15.53:0/321856302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160006fe20 0x7f16001c3e70 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f15f400c4a0 tx=0x7f15f400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.621+0000 7f15fd7fa640 1 -- 172.21.15.53:0/321856302 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f4017070 con 0x7f160006fe20 2024-05-08T18:34:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.621+0000 7f15fd7fa640 1 -- 172.21.15.53:0/321856302 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f4005c10 con 0x7f160006fe20 2024-05-08T18:34:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.621+0000 7f1607106640 1 -- 172.21.15.53:0/321856302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1600118570 con 0x7f160006fe20 2024-05-08T18:34:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.621+0000 7f15fd7fa640 1 -- 172.21.15.53:0/321856302 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f4007070 con 0x7f160006fe20 2024-05-08T18:34:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.621+0000 7f1607106640 1 -- 172.21.15.53:0/321856302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16001c43b0 con 0x7f160006fe20 2024-05-08T18:34:17.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.622+0000 7f15fd7fa640 1 -- 172.21.15.53:0/321856302 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f15f401a070 con 0x7f160006fe20 2024-05-08T18:34:17.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.622+0000 7f1607106640 1 -- 172.21.15.53:0/321856302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1600064010 con 0x7f160006fe20 2024-05-08T18:34:17.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.623+0000 7f15fd7fa640 1 --2- 172.21.15.53:0/321856302 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f15e403d2b0 0x7f15e403f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.623+0000 7f15fd7fa640 1 -- 172.21.15.53:0/321856302 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f15f4051110 con 0x7f160006fe20 2024-05-08T18:34:17.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.623+0000 7f15fffff640 1 --2- 172.21.15.53:0/321856302 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f15e403d2b0 0x7f15e403f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.623+0000 7f15fffff640 1 --2- 172.21.15.53:0/321856302 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f15e403d2b0 0x7f15e403f770 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f15ec036000 tx=0x7f15ec008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.627+0000 7f15fd7fa640 1 -- 172.21.15.53:0/321856302 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f15f401ac60 con 0x7f160006fe20 2024-05-08T18:34:17.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.822+0000 7f1607106640 1 -- 172.21.15.53:0/321856302 --> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f1600073aa0 con 0x7f15e403d2b0 2024-05-08T18:34:17.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.823+0000 7f15fd7fa640 1 -- 172.21.15.53:0/321856302 <== mgr.4102 v2:172.21.15.87:6824/211215191 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1600073aa0 con 0x7f15e403d2b0 2024-05-08T18:34:17.822 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 2 to deep-scrub 2024-05-08T18:34:17.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.825+0000 7f1607106640 1 -- 172.21.15.53:0/321856302 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f15e403d2b0 msgr2=0x7f15e403f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.825+0000 7f1607106640 1 --2- 172.21.15.53:0/321856302 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f15e403d2b0 0x7f15e403f770 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f15ec036000 tx=0x7f15ec008030 comp rx=0 tx=0).stop 2024-05-08T18:34:17.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.825+0000 7f1607106640 1 -- 172.21.15.53:0/321856302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160006fe20 msgr2=0x7f16001c3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.825+0000 7f1607106640 1 --2- 172.21.15.53:0/321856302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160006fe20 0x7f16001c3e70 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f15f400c4a0 tx=0x7f15f400c960 comp rx=0 tx=0).stop 2024-05-08T18:34:17.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.825+0000 7f1607106640 1 -- 172.21.15.53:0/321856302 shutdown_connections 2024-05-08T18:34:17.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.825+0000 7f1607106640 1 --2- 172.21.15.53:0/321856302 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f15e403d2b0 0x7f15e403f770 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.825+0000 7f1607106640 1 --2- 172.21.15.53:0/321856302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160006fe20 0x7f16001c3e70 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.825+0000 7f1607106640 1 -- 172.21.15.53:0/321856302 >> 172.21.15.53:0/321856302 conn(0x7f160009a910 msgr2=0x7f1600125760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:17.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.825+0000 7f1607106640 1 -- 172.21.15.53:0/321856302 shutdown_connections 2024-05-08T18:34:17.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.825+0000 7f1607106640 1 -- 172.21.15.53:0/321856302 wait complete. 2024-05-08T18:34:17.835 INFO:tasks.ceph:Scrubbing osd.3 2024-05-08T18:34:17.835 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:34:17.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.943+0000 7f13dd683640 1 Processor -- start 2024-05-08T18:34:17.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.943+0000 7f13dd683640 1 -- start start 2024-05-08T18:34:17.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.943+0000 7f13dd683640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13d812d470 0x7f13d812d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.943+0000 7f13dd683640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d812d270 con 0x7f13d812dd90 2024-05-08T18:34:17.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.943+0000 7f13dd683640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f13d8073600 con 0x7f13d812d470 2024-05-08T18:34:17.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.943+0000 7f13d6ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13d812d470 0x7f13d812d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.943+0000 7f13ce7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f13d812dd90 0x7f13d806f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41028/0 (socket says 172.21.15.53:41028) 2024-05-08T18:34:17.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.943+0000 7f13ce7fc640 1 -- 172.21.15.53:0/3727144295 learned_addr learned my addr 172.21.15.53:0/3727144295 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:34:17.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.944+0000 7f13d6ffd640 1 -- 172.21.15.53:0/3727144295 >> v1:172.21.15.53:6789/0 conn(0x7f13d812dd90 legacy=0x7f13d806f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.944+0000 7f13d6ffd640 1 -- 172.21.15.53:0/3727144295 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d8113ca0 con 0x7f13d812d470 2024-05-08T18:34:17.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.944+0000 7f13d6ffd640 1 --2- 172.21.15.53:0/3727144295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13d812d470 0x7f13d812d850 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f13c8009720 tx=0x7f13c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe11c234078695c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.944+0000 7f13d67fc640 1 -- 172.21.15.53:0/3727144295 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13c80316d0 con 0x7f13d812d470 2024-05-08T18:34:17.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.944+0000 7f13d67fc640 1 -- 172.21.15.53:0/3727144295 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c8037070 con 0x7f13d812d470 2024-05-08T18:34:17.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.945+0000 7f13d67fc640 1 -- 172.21.15.53:0/3727144295 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13c80319c0 con 0x7f13d812d470 2024-05-08T18:34:17.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.945+0000 7f13dd683640 1 -- 172.21.15.53:0/3727144295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13d812d470 msgr2=0x7f13d812d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.945+0000 7f13dd683640 1 --2- 172.21.15.53:0/3727144295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13d812d470 0x7f13d812d850 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f13c8009720 tx=0x7f13c802b840 comp rx=0 tx=0).stop 2024-05-08T18:34:17.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.945+0000 7f13dd683640 1 -- 172.21.15.53:0/3727144295 shutdown_connections 2024-05-08T18:34:17.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.945+0000 7f13dd683640 1 --2- 172.21.15.53:0/3727144295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13d812d470 0x7f13d812d850 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.945+0000 7f13dd683640 1 -- 172.21.15.53:0/3727144295 >> 172.21.15.53:0/3727144295 conn(0x7f13d809a330 msgr2=0x7f13d809a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:17.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.945+0000 7f13dd683640 1 -- 172.21.15.53:0/3727144295 shutdown_connections 2024-05-08T18:34:17.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.945+0000 7f13dd683640 1 -- 172.21.15.53:0/3727144295 wait complete. 2024-05-08T18:34:17.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.946+0000 7f13dd683640 1 Processor -- start 2024-05-08T18:34:17.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.946+0000 7f13dd683640 1 -- start start 2024-05-08T18:34:17.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.946+0000 7f13dd683640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13d812d470 0x7f13d8071120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.946+0000 7f13dd683640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f13d81149f0 con 0x7f13d812d470 2024-05-08T18:34:17.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.947+0000 7f13d6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13d812d470 0x7f13d8071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.947+0000 7f13d6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13d812d470 0x7f13d8071120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41278/0 (socket says 172.21.15.53:41278) 2024-05-08T18:34:17.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.947+0000 7f13d6ffd640 1 -- 172.21.15.53:0/2818315587 learned_addr learned my addr 172.21.15.53:0/2818315587 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:34:17.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.947+0000 7f13d6ffd640 1 -- 172.21.15.53:0/2818315587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d812b490 con 0x7f13d812d470 2024-05-08T18:34:17.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.947+0000 7f13d6ffd640 1 --2- 172.21.15.53:0/2818315587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13d812d470 0x7f13d8071120 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f13c8009720 tx=0x7f13c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.947+0000 7f13cffff640 1 -- 172.21.15.53:0/2818315587 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13c8032770 con 0x7f13d812d470 2024-05-08T18:34:17.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.947+0000 7f13cffff640 1 -- 172.21.15.53:0/2818315587 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c8032910 con 0x7f13d812d470 2024-05-08T18:34:17.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.947+0000 7f13cffff640 1 -- 172.21.15.53:0/2818315587 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13c8032bf0 con 0x7f13d812d470 2024-05-08T18:34:17.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.947+0000 7f13dd683640 1 -- 172.21.15.53:0/2818315587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d8129f30 con 0x7f13d812d470 2024-05-08T18:34:17.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.947+0000 7f13dd683640 1 -- 172.21.15.53:0/2818315587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d8072320 con 0x7f13d812d470 2024-05-08T18:34:17.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.948+0000 7f13cffff640 1 -- 172.21.15.53:0/2818315587 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f13c804c060 con 0x7f13d812d470 2024-05-08T18:34:17.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.948+0000 7f13dd683640 1 -- 172.21.15.53:0/2818315587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f13d8072d20 con 0x7f13d812d470 2024-05-08T18:34:17.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.948+0000 7f13cffff640 1 --2- 172.21.15.53:0/2818315587 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13b803d2b0 0x7f13b803f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.948+0000 7f13cffff640 1 -- 172.21.15.53:0/2818315587 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f13c802f050 con 0x7f13d812d470 2024-05-08T18:34:17.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.949+0000 7f13cffff640 1 --2- 172.21.15.53:0/2818315587 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x7f13b8049780 0x7f13b804bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:17.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.949+0000 7f13cffff640 1 -- 172.21.15.53:0/2818315587 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13c803de50 con 0x7f13b8049780 2024-05-08T18:34:17.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.949+0000 7f13cffff640 1 -- 172.21.15.53:0/2818315587 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f13c80782a0 con 0x7f13d812d470 2024-05-08T18:34:17.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.949+0000 7f13ce7fc640 1 --2- 172.21.15.53:0/2818315587 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13b803d2b0 0x7f13b803f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.949+0000 7f13d77fe640 1 --2- 172.21.15.53:0/2818315587 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x7f13b8049780 0x7f13b804bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:17.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.949+0000 7f13d77fe640 1 --2- 172.21.15.53:0/2818315587 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x7f13b8049780 0x7f13b804bc20 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.949+0000 7f13ce7fc640 1 --2- 172.21.15.53:0/2818315587 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13b803d2b0 0x7f13b803f770 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f13c0005880 tx=0x7f13c0007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:17.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.950+0000 7f13cffff640 1 -- 172.21.15.53:0/2818315587 <== osd.3 v2:172.21.15.87:6800/2929215285 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f13c803de50 con 0x7f13b8049780 2024-05-08T18:34:17.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.963+0000 7f13dd683640 1 -- 172.21.15.53:0/2818315587 --> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f13d8064010 con 0x7f13b8049780 2024-05-08T18:34:17.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.963+0000 7f13cffff640 1 -- 172.21.15.53:0/2818315587 <== osd.3 v2:172.21.15.87:6800/2929215285 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f13d8064010 con 0x7f13b8049780 2024-05-08T18:34:17.963 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-05-08T18:34:17.963 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:34:17.963 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-05-08T18:34:17.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.964+0000 7f13dd683640 1 -- 172.21.15.53:0/2818315587 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x7f13b8049780 msgr2=0x7f13b804bc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.964+0000 7f13dd683640 1 --2- 172.21.15.53:0/2818315587 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x7f13b8049780 0x7f13b804bc20 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.964+0000 7f13dd683640 1 -- 172.21.15.53:0/2818315587 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13b803d2b0 msgr2=0x7f13b803f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.964+0000 7f13dd683640 1 --2- 172.21.15.53:0/2818315587 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13b803d2b0 0x7f13b803f770 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f13c0005880 tx=0x7f13c0007a80 comp rx=0 tx=0).stop 2024-05-08T18:34:17.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.964+0000 7f13dd683640 1 -- 172.21.15.53:0/2818315587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13d812d470 msgr2=0x7f13d8071120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:17.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.964+0000 7f13dd683640 1 --2- 172.21.15.53:0/2818315587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13d812d470 0x7f13d8071120 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f13c8009720 tx=0x7f13c80046c0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.964+0000 7f13dd683640 1 -- 172.21.15.53:0/2818315587 shutdown_connections 2024-05-08T18:34:17.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.964+0000 7f13dd683640 1 --2- 172.21.15.53:0/2818315587 >> [v2:172.21.15.87:6800/2929215285,v1:172.21.15.87:6801/2929215285] conn(0x7f13b8049780 0x7f13b804bc20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.964+0000 7f13dd683640 1 --2- 172.21.15.53:0/2818315587 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f13b803d2b0 0x7f13b803f770 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.964+0000 7f13dd683640 1 --2- 172.21.15.53:0/2818315587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13d812d470 0x7f13d8071120 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:17.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.964+0000 7f13dd683640 1 -- 172.21.15.53:0/2818315587 >> 172.21.15.53:0/2818315587 conn(0x7f13d809a330 msgr2=0x7f13d81b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:17.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.964+0000 7f13dd683640 1 -- 172.21.15.53:0/2818315587 shutdown_connections 2024-05-08T18:34:17.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:17.964+0000 7f13dd683640 1 -- 172.21.15.53:0/2818315587 wait complete. 2024-05-08T18:34:17.973 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-08T18:34:18.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.077+0000 7ff274aca640 1 Processor -- start 2024-05-08T18:34:18.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.077+0000 7ff274aca640 1 -- start start 2024-05-08T18:34:18.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.078+0000 7ff274aca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff27012c7f0 0x7ff27012cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:18.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.078+0000 7ff274aca640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2700a23e0 con 0x7ff270070850 2024-05-08T18:34:18.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.078+0000 7ff274aca640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ff270072fc0 con 0x7ff27012c7f0 2024-05-08T18:34:18.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.078+0000 7ff26e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff27012c7f0 0x7ff27012cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:18.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.078+0000 7ff26dd9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff270070850 0x7ff270070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41036/0 (socket says 172.21.15.53:41036) 2024-05-08T18:34:18.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.078+0000 7ff26dd9b640 1 -- 172.21.15.53:0/3283967198 learned_addr learned my addr 172.21.15.53:0/3283967198 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:34:18.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.078+0000 7ff26e59c640 1 -- 172.21.15.53:0/3283967198 >> v1:172.21.15.53:6789/0 conn(0x7ff270070850 legacy=0x7ff270070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:18.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.078+0000 7ff26e59c640 1 -- 172.21.15.53:0/3283967198 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff270071f80 con 0x7ff27012c7f0 2024-05-08T18:34:18.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.078+0000 7ff26d59a640 1 -- 172.21.15.53:0/3283967198 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2675371292 0 0) 0x7ff2700a23e0 con 0x7ff270070850 2024-05-08T18:34:18.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.079+0000 7ff26e59c640 1 --2- 172.21.15.53:0/3283967198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff27012c7f0 0x7ff27012cbd0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff260009720 tx=0x7ff26002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de718e08688c4c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.079+0000 7ff26d59a640 1 -- 172.21.15.53:0/3283967198 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2600316d0 con 0x7ff27012c7f0 2024-05-08T18:34:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.079+0000 7ff26d59a640 1 -- 172.21.15.53:0/3283967198 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff260037070 con 0x7ff27012c7f0 2024-05-08T18:34:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.079+0000 7ff26d59a640 1 -- 172.21.15.53:0/3283967198 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2600319c0 con 0x7ff27012c7f0 2024-05-08T18:34:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.080+0000 7ff274aca640 1 -- 172.21.15.53:0/3283967198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff27012c7f0 msgr2=0x7ff27012cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.080+0000 7ff274aca640 1 --2- 172.21.15.53:0/3283967198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff27012c7f0 0x7ff27012cbd0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff260009720 tx=0x7ff26002b840 comp rx=0 tx=0).stop 2024-05-08T18:34:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.080+0000 7ff274aca640 1 -- 172.21.15.53:0/3283967198 shutdown_connections 2024-05-08T18:34:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.080+0000 7ff274aca640 1 --2- 172.21.15.53:0/3283967198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff27012c7f0 0x7ff27012cbd0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.080+0000 7ff274aca640 1 -- 172.21.15.53:0/3283967198 >> 172.21.15.53:0/3283967198 conn(0x7ff27009ff90 msgr2=0x7ff2700a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.080+0000 7ff274aca640 1 -- 172.21.15.53:0/3283967198 shutdown_connections 2024-05-08T18:34:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.080+0000 7ff274aca640 1 -- 172.21.15.53:0/3283967198 wait complete. 2024-05-08T18:34:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.081+0000 7ff274aca640 1 Processor -- start 2024-05-08T18:34:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.081+0000 7ff274aca640 1 -- start start 2024-05-08T18:34:18.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.081+0000 7ff274aca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff270070850 0x7ff27011a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.081+0000 7ff274aca640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff270071530 con 0x7ff270070850 2024-05-08T18:34:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.081+0000 7ff26e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff270070850 0x7ff27011a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.081+0000 7ff26e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff270070850 0x7ff27011a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41288/0 (socket says 172.21.15.53:41288) 2024-05-08T18:34:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.081+0000 7ff26e59c640 1 -- 172.21.15.53:0/2601676088 learned_addr learned my addr 172.21.15.53:0/2601676088 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:34:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.082+0000 7ff26e59c640 1 -- 172.21.15.53:0/2601676088 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27011d550 con 0x7ff270070850 2024-05-08T18:34:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.082+0000 7ff26e59c640 1 --2- 172.21.15.53:0/2601676088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff270070850 0x7ff27011a440 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff260034040 tx=0x7ff2600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.082+0000 7ff25effd640 1 -- 172.21.15.53:0/2601676088 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff260032770 con 0x7ff270070850 2024-05-08T18:34:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.082+0000 7ff25effd640 1 -- 172.21.15.53:0/2601676088 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff260032910 con 0x7ff270070850 2024-05-08T18:34:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.082+0000 7ff274aca640 1 -- 172.21.15.53:0/2601676088 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27011d990 con 0x7ff270070850 2024-05-08T18:34:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.082+0000 7ff25effd640 1 -- 172.21.15.53:0/2601676088 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff260032c30 con 0x7ff270070850 2024-05-08T18:34:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.082+0000 7ff274aca640 1 -- 172.21.15.53:0/2601676088 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff27011ab60 con 0x7ff270070850 2024-05-08T18:34:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.083+0000 7ff25effd640 1 -- 172.21.15.53:0/2601676088 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff26004c060 con 0x7ff270070850 2024-05-08T18:34:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.083+0000 7ff25effd640 1 --2- 172.21.15.53:0/2601676088 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff25003d2b0 0x7ff25003f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:18.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.083+0000 7ff25effd640 1 -- 172.21.15.53:0/2601676088 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff26002f050 con 0x7ff270070850 2024-05-08T18:34:18.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.083+0000 7ff274aca640 1 -- 172.21.15.53:0/2601676088 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff270064010 con 0x7ff270070850 2024-05-08T18:34:18.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.083+0000 7ff26dd9b640 1 --2- 172.21.15.53:0/2601676088 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff25003d2b0 0x7ff25003f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:18.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.084+0000 7ff26dd9b640 1 --2- 172.21.15.53:0/2601676088 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff25003d2b0 0x7ff25003f770 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff264000c00 tx=0x7ff264007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:18.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.088+0000 7ff25effd640 1 -- 172.21.15.53:0/2601676088 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff260040070 con 0x7ff270070850 2024-05-08T18:34:18.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.281+0000 7ff274aca640 1 -- 172.21.15.53:0/2601676088 --> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7ff2700a2930 con 0x7ff25003d2b0 2024-05-08T18:34:18.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.283+0000 7ff25effd640 1 -- 172.21.15.53:0/2601676088 <== mgr.4102 v2:172.21.15.87:6824/211215191 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff2700a2930 con 0x7ff25003d2b0 2024-05-08T18:34:18.281 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 3 to deep-scrub 2024-05-08T18:34:18.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.284+0000 7ff274aca640 1 -- 172.21.15.53:0/2601676088 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff25003d2b0 msgr2=0x7ff25003f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:18.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.284+0000 7ff274aca640 1 --2- 172.21.15.53:0/2601676088 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff25003d2b0 0x7ff25003f770 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff264000c00 tx=0x7ff264007910 comp rx=0 tx=0).stop 2024-05-08T18:34:18.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.284+0000 7ff274aca640 1 -- 172.21.15.53:0/2601676088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff270070850 msgr2=0x7ff27011a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:18.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.284+0000 7ff274aca640 1 --2- 172.21.15.53:0/2601676088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff270070850 0x7ff27011a440 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff260034040 tx=0x7ff2600046c0 comp rx=0 tx=0).stop 2024-05-08T18:34:18.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.284+0000 7ff274aca640 1 -- 172.21.15.53:0/2601676088 shutdown_connections 2024-05-08T18:34:18.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.284+0000 7ff274aca640 1 --2- 172.21.15.53:0/2601676088 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7ff25003d2b0 0x7ff25003f770 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:18.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.284+0000 7ff274aca640 1 --2- 172.21.15.53:0/2601676088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff270070850 0x7ff27011a440 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:18.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.284+0000 7ff274aca640 1 -- 172.21.15.53:0/2601676088 >> 172.21.15.53:0/2601676088 conn(0x7ff27009ff90 msgr2=0x7ff2701b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:18.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.284+0000 7ff274aca640 1 -- 172.21.15.53:0/2601676088 shutdown_connections 2024-05-08T18:34:18.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.284+0000 7ff274aca640 1 -- 172.21.15.53:0/2601676088 wait complete. 2024-05-08T18:34:18.295 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:34:18.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.399+0000 7f25a8cdb640 1 Processor -- start 2024-05-08T18:34:18.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.399+0000 7f25a8cdb640 1 -- start start 2024-05-08T18:34:18.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.399+0000 7f25a8cdb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f25a406fe20 0x7f25a4128e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:18.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.399+0000 7f25a8cdb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a4072dc0 con 0x7f25a4129390 2024-05-08T18:34:18.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.399+0000 7f25a8cdb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f25a4128ad0 con 0x7f25a406fe20 2024-05-08T18:34:18.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.399+0000 7f25a259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f25a406fe20 0x7f25a4128e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:18.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.399+0000 7f25a1d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f25a4129390 0x7f25a412c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41038/0 (socket says 172.21.15.53:41038) 2024-05-08T18:34:18.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.399+0000 7f25a1d9b640 1 -- 172.21.15.53:0/3042412948 learned_addr learned my addr 172.21.15.53:0/3042412948 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:34:18.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.400+0000 7f25a259c640 1 -- 172.21.15.53:0/3042412948 >> v1:172.21.15.53:6789/0 conn(0x7f25a4129390 legacy=0x7f25a412c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:18.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.400+0000 7f25a259c640 1 -- 172.21.15.53:0/3042412948 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a40739e0 con 0x7f25a406fe20 2024-05-08T18:34:18.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.400+0000 7f25a259c640 1 --2- 172.21.15.53:0/3042412948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a406fe20 0x7f25a4128e50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f2594009720 tx=0x7f259402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d709941012eb97 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:18.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.401+0000 7f25a159a640 1 -- 172.21.15.53:0/3042412948 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25940316d0 con 0x7f25a406fe20 2024-05-08T18:34:18.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.401+0000 7f25a159a640 1 -- 172.21.15.53:0/3042412948 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2594037070 con 0x7f25a406fe20 2024-05-08T18:34:18.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.401+0000 7f25a159a640 1 -- 172.21.15.53:0/3042412948 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25940319c0 con 0x7f25a406fe20 2024-05-08T18:34:18.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.401+0000 7f25a8cdb640 1 -- 172.21.15.53:0/3042412948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a406fe20 msgr2=0x7f25a4128e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:18.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.401+0000 7f25a8cdb640 1 --2- 172.21.15.53:0/3042412948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a406fe20 0x7f25a4128e50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f2594009720 tx=0x7f259402b840 comp rx=0 tx=0).stop 2024-05-08T18:34:18.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.401+0000 7f25a8cdb640 1 -- 172.21.15.53:0/3042412948 shutdown_connections 2024-05-08T18:34:18.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.401+0000 7f25a8cdb640 1 --2- 172.21.15.53:0/3042412948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a406fe20 0x7f25a4128e50 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:18.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.401+0000 7f25a8cdb640 1 -- 172.21.15.53:0/3042412948 >> 172.21.15.53:0/3042412948 conn(0x7f25a409a910 msgr2=0x7f25a406e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:18.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.401+0000 7f25a8cdb640 1 -- 172.21.15.53:0/3042412948 shutdown_connections 2024-05-08T18:34:18.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.401+0000 7f25a8cdb640 1 -- 172.21.15.53:0/3042412948 wait complete. 2024-05-08T18:34:18.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.402+0000 7f25a8cdb640 1 Processor -- start 2024-05-08T18:34:18.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.402+0000 7f25a8cdb640 1 -- start start 2024-05-08T18:34:18.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.403+0000 7f25a8cdb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a406fe20 0x7f25a4113db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:18.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.403+0000 7f25a8cdb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f25a41299a0 con 0x7f25a406fe20 2024-05-08T18:34:18.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.403+0000 7f25a259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a406fe20 0x7f25a4113db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.403+0000 7f25a259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a406fe20 0x7f25a4113db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41310/0 (socket says 172.21.15.53:41310) 2024-05-08T18:34:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.403+0000 7f25a259c640 1 -- 172.21.15.53:0/671454213 learned_addr learned my addr 172.21.15.53:0/671454213 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:34:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.403+0000 7f25a259c640 1 -- 172.21.15.53:0/671454213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a41156b0 con 0x7f25a406fe20 2024-05-08T18:34:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.403+0000 7f25a259c640 1 --2- 172.21.15.53:0/671454213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a406fe20 0x7f25a4113db0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2594034040 tx=0x7f25940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.403+0000 7f2592ffd640 1 -- 172.21.15.53:0/671454213 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2594032770 con 0x7f25a406fe20 2024-05-08T18:34:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.403+0000 7f2592ffd640 1 -- 172.21.15.53:0/671454213 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2594032910 con 0x7f25a406fe20 2024-05-08T18:34:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.403+0000 7f25a8cdb640 1 -- 172.21.15.53:0/671454213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a4116100 con 0x7f25a406fe20 2024-05-08T18:34:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.403+0000 7f2592ffd640 1 -- 172.21.15.53:0/671454213 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2594032c30 con 0x7f25a406fe20 2024-05-08T18:34:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.403+0000 7f25a8cdb640 1 -- 172.21.15.53:0/671454213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a4126020 con 0x7f25a406fe20 2024-05-08T18:34:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.404+0000 7f2592ffd640 1 -- 172.21.15.53:0/671454213 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f259404c060 con 0x7f25a406fe20 2024-05-08T18:34:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.404+0000 7f25a8cdb640 1 -- 172.21.15.53:0/671454213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a409c810 con 0x7f25a406fe20 2024-05-08T18:34:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.405+0000 7f2592ffd640 1 --2- 172.21.15.53:0/671454213 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f258403d2b0 0x7f258403f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:18.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.405+0000 7f2592ffd640 1 -- 172.21.15.53:0/671454213 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f259402f050 con 0x7f25a406fe20 2024-05-08T18:34:18.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.405+0000 7f25a1d9b640 1 --2- 172.21.15.53:0/671454213 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f258403d2b0 0x7f258403f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:18.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.406+0000 7f25a1d9b640 1 --2- 172.21.15.53:0/671454213 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f258403d2b0 0x7f258403f770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2598002080 tx=0x7f2598001670 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:18.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.409+0000 7f2592ffd640 1 -- 172.21.15.53:0/671454213 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f25a409c810 con 0x7f25a406fe20 2024-05-08T18:34:18.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.595+0000 7f25a8cdb640 1 -- 172.21.15.53:0/671454213 --> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f25a4114fd0 con 0x7f258403d2b0 2024-05-08T18:34:18.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.610+0000 7f2592ffd640 1 -- 172.21.15.53:0/671454213 <== mgr.4102 v2:172.21.15.87:6824/211215191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665928 (secure 0 0 0) 0x7f259800cbf0 con 0x7f258403d2b0 2024-05-08T18:34:18.617 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:34:18.622 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:34:18.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.615+0000 7f25a8cdb640 1 -- 172.21.15.53:0/671454213 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f258403d2b0 msgr2=0x7f258403f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:18.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.616+0000 7f25a8cdb640 1 --2- 172.21.15.53:0/671454213 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f258403d2b0 0x7f258403f770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2598002080 tx=0x7f2598001670 comp rx=0 tx=0).stop 2024-05-08T18:34:18.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.616+0000 7f25a8cdb640 1 -- 172.21.15.53:0/671454213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a406fe20 msgr2=0x7f25a4113db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:18.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.616+0000 7f25a8cdb640 1 --2- 172.21.15.53:0/671454213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a406fe20 0x7f25a4113db0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2594034040 tx=0x7f25940046c0 comp rx=0 tx=0).stop 2024-05-08T18:34:18.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.616+0000 7f25a8cdb640 1 -- 172.21.15.53:0/671454213 shutdown_connections 2024-05-08T18:34:18.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.616+0000 7f25a8cdb640 1 --2- 172.21.15.53:0/671454213 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f258403d2b0 0x7f258403f770 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:18.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.616+0000 7f25a8cdb640 1 --2- 172.21.15.53:0/671454213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a406fe20 0x7f25a4113db0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:18.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.616+0000 7f25a8cdb640 1 -- 172.21.15.53:0/671454213 >> 172.21.15.53:0/671454213 conn(0x7f25a409a910 msgr2=0x7f25a40706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:18.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.616+0000 7f25a8cdb640 1 -- 172.21.15.53:0/671454213 shutdown_connections 2024-05-08T18:34:18.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:18.616+0000 7f25a8cdb640 1 -- 172.21.15.53:0/671454213 wait complete. 2024-05-08T18:34:18.626 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-05-08T18:34:18.165578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416885,"num_objects":227,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4839,"num_read_kb":4421,"num_write":2046,"num_write_kb":60584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4431,"ondisk_log_size":4431,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":173552,"kb_used_data":36368,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377313808,"statfs":{"total":386547056640,"available":386369339392,"internally_reserved":0,"allocated":37240832,"data_stored":36146218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815783,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003746"},"pg_stats":[{"pgid":"3.3f","version":"29'3","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176450+0000","last_change":"2024-05-08T18:30:58.305519+0000","last_active":"2024-05-08T18:33:03.176450+0000","last_peered":"2024-05-08T18:33:03.176450+0000","last_clean":"2024-05-08T18:33:03.176450+0000","last_became_active":"2024-05-08T18:30:58.305175+0000","last_became_peered":"2024-05-08T18:30:58.305175+0000","last_unstale":"2024-05-08T18:33:03.176450+0000","last_undegraded":"2024-05-08T18:33:03.176450+0000","last_fullsized":"2024-05-08T18:33:03.176450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:04.148371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271698+0000","last_change":"2024-05-08T18:31:00.285719+0000","last_active":"2024-05-08T18:34:07.271698+0000","last_peered":"2024-05-08T18:34:07.271698+0000","last_clean":"2024-05-08T18:34:07.271698+0000","last_became_active":"2024-05-08T18:31:00.284574+0000","last_became_peered":"2024-05-08T18:31:00.284574+0000","last_unstale":"2024-05-08T18:34:07.271698+0000","last_undegraded":"2024-05-08T18:34:07.271698+0000","last_fullsized":"2024-05-08T18:34:07.271698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:40.256644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331029+0000","last_change":"2024-05-08T18:30:58.289175+0000","last_active":"2024-05-08T18:31:45.331029+0000","last_peered":"2024-05-08T18:31:45.331029+0000","last_clean":"2024-05-08T18:31:45.331029+0000","last_became_active":"2024-05-08T18:30:58.288674+0000","last_became_peered":"2024-05-08T18:30:58.288674+0000","last_unstale":"2024-05-08T18:31:45.331029+0000","last_undegraded":"2024-05-08T18:31:45.331029+0000","last_fullsized":"2024-05-08T18:31:45.331029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:34.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329085+0000","last_change":"2024-05-08T18:31:00.299098+0000","last_active":"2024-05-08T18:31:45.329085+0000","last_peered":"2024-05-08T18:31:45.329085+0000","last_clean":"2024-05-08T18:31:45.329085+0000","last_became_active":"2024-05-08T18:31:00.298145+0000","last_became_peered":"2024-05-08T18:31:00.298145+0000","last_unstale":"2024-05-08T18:31:45.329085+0000","last_undegraded":"2024-05-08T18:31:45.329085+0000","last_fullsized":"2024-05-08T18:31:45.329085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:38.415030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331384+0000","last_change":"2024-05-08T18:30:58.306369+0000","last_active":"2024-05-08T18:31:45.331384+0000","last_peered":"2024-05-08T18:31:45.331384+0000","last_clean":"2024-05-08T18:31:45.331384+0000","last_became_active":"2024-05-08T18:30:58.304442+0000","last_became_peered":"2024-05-08T18:30:58.304442+0000","last_unstale":"2024-05-08T18:31:45.331384+0000","last_undegraded":"2024-05-08T18:31:45.331384+0000","last_fullsized":"2024-05-08T18:31:45.331384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:28.002025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328805+0000","last_change":"2024-05-08T18:31:00.298725+0000","last_active":"2024-05-08T18:31:45.328805+0000","last_peered":"2024-05-08T18:31:45.328805+0000","last_clean":"2024-05-08T18:31:45.328805+0000","last_became_active":"2024-05-08T18:31:00.297810+0000","last_became_peered":"2024-05-08T18:31:00.297810+0000","last_unstale":"2024-05-08T18:31:45.328805+0000","last_undegraded":"2024-05-08T18:31:45.328805+0000","last_fullsized":"2024-05-08T18:31:45.328805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:59.418481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330833+0000","last_change":"2024-05-08T18:30:58.295957+0000","last_active":"2024-05-08T18:31:45.330833+0000","last_peered":"2024-05-08T18:31:45.330833+0000","last_clean":"2024-05-08T18:31:45.330833+0000","last_became_active":"2024-05-08T18:30:58.295569+0000","last_became_peered":"2024-05-08T18:30:58.295569+0000","last_unstale":"2024-05-08T18:31:45.330833+0000","last_undegraded":"2024-05-08T18:31:45.330833+0000","last_fullsized":"2024-05-08T18:31:45.330833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:23:31.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271931+0000","last_change":"2024-05-08T18:31:00.296029+0000","last_active":"2024-05-08T18:34:07.271931+0000","last_peered":"2024-05-08T18:34:07.271931+0000","last_clean":"2024-05-08T18:34:07.271931+0000","last_became_active":"2024-05-08T18:31:00.295611+0000","last_became_peered":"2024-05-08T18:31:00.295611+0000","last_unstale":"2024-05-08T18:34:07.271931+0000","last_undegraded":"2024-05-08T18:34:07.271931+0000","last_fullsized":"2024-05-08T18:34:07.271931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:48.739053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328670+0000","last_change":"2024-05-08T18:30:58.313349+0000","last_active":"2024-05-08T18:31:45.328670+0000","last_peered":"2024-05-08T18:31:45.328670+0000","last_clean":"2024-05-08T18:31:45.328670+0000","last_became_active":"2024-05-08T18:30:58.313003+0000","last_became_peered":"2024-05-08T18:30:58.313003+0000","last_unstale":"2024-05-08T18:31:45.328670+0000","last_undegraded":"2024-05-08T18:31:45.328670+0000","last_fullsized":"2024-05-08T18:31:45.328670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:28.678138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'4","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.338700+0000","last_change":"2024-05-08T18:31:00.281345+0000","last_active":"2024-05-08T18:31:45.338700+0000","last_peered":"2024-05-08T18:31:45.338700+0000","last_clean":"2024-05-08T18:31:45.338700+0000","last_became_active":"2024-05-08T18:31:00.281065+0000","last_became_peered":"2024-05-08T18:31:00.281065+0000","last_unstale":"2024-05-08T18:31:45.338700+0000","last_undegraded":"2024-05-08T18:31:45.338700+0000","last_fullsized":"2024-05-08T18:31:45.338700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:58.735465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.335229+0000","last_change":"2024-05-08T18:30:58.308072+0000","last_active":"2024-05-08T18:31:45.335229+0000","last_peered":"2024-05-08T18:31:45.335229+0000","last_clean":"2024-05-08T18:31:45.335229+0000","last_became_active":"2024-05-08T18:30:58.307687+0000","last_became_peered":"2024-05-08T18:30:58.307687+0000","last_unstale":"2024-05-08T18:31:45.335229+0000","last_undegraded":"2024-05-08T18:31:45.335229+0000","last_fullsized":"2024-05-08T18:31:45.335229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:33.986082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.966056+0000","last_change":"2024-05-08T18:31:00.299642+0000","last_active":"2024-05-08T18:34:06.966056+0000","last_peered":"2024-05-08T18:34:06.966056+0000","last_clean":"2024-05-08T18:34:06.966056+0000","last_became_active":"2024-05-08T18:31:00.298978+0000","last_became_peered":"2024-05-08T18:31:00.298978+0000","last_unstale":"2024-05-08T18:34:06.966056+0000","last_undegraded":"2024-05-08T18:34:06.966056+0000","last_fullsized":"2024-05-08T18:34:06.966056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:30.577543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328768+0000","last_change":"2024-05-08T18:30:58.309859+0000","last_active":"2024-05-08T18:31:45.328768+0000","last_peered":"2024-05-08T18:31:45.328768+0000","last_clean":"2024-05-08T18:31:45.328768+0000","last_became_active":"2024-05-08T18:30:58.308931+0000","last_became_peered":"2024-05-08T18:30:58.308931+0000","last_unstale":"2024-05-08T18:31:45.328768+0000","last_undegraded":"2024-05-08T18:31:45.328768+0000","last_fullsized":"2024-05-08T18:31:45.328768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:40:28.103648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'7","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.333875+0000","last_change":"2024-05-08T18:31:00.295747+0000","last_active":"2024-05-08T18:34:07.333875+0000","last_peered":"2024-05-08T18:34:07.333875+0000","last_clean":"2024-05-08T18:34:07.333875+0000","last_became_active":"2024-05-08T18:31:00.295472+0000","last_became_peered":"2024-05-08T18:31:00.295472+0000","last_unstale":"2024-05-08T18:34:07.333875+0000","last_undegraded":"2024-05-08T18:34:07.333875+0000","last_fullsized":"2024-05-08T18:34:07.333875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:40.256644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329487+0000","last_change":"2024-05-08T18:30:58.295024+0000","last_active":"2024-05-08T18:31:45.329487+0000","last_peered":"2024-05-08T18:31:45.329487+0000","last_clean":"2024-05-08T18:31:45.329487+0000","last_became_active":"2024-05-08T18:30:58.294511+0000","last_became_peered":"2024-05-08T18:30:58.294511+0000","last_unstale":"2024-05-08T18:31:45.329487+0000","last_undegraded":"2024-05-08T18:31:45.329487+0000","last_fullsized":"2024-05-08T18:31:45.329487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:33.046479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.581305+0000","last_change":"2024-05-08T18:31:00.291471+0000","last_active":"2024-05-08T18:33:06.581305+0000","last_peered":"2024-05-08T18:33:06.581305+0000","last_clean":"2024-05-08T18:33:06.581305+0000","last_became_active":"2024-05-08T18:31:00.291203+0000","last_became_peered":"2024-05-08T18:31:00.291203+0000","last_unstale":"2024-05-08T18:33:06.581305+0000","last_undegraded":"2024-05-08T18:33:06.581305+0000","last_fullsized":"2024-05-08T18:33:06.581305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:21.913096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196716+0000","last_change":"2024-05-08T18:31:00.291351+0000","last_active":"2024-05-08T18:34:07.196716+0000","last_peered":"2024-05-08T18:34:07.196716+0000","last_clean":"2024-05-08T18:34:07.196716+0000","last_became_active":"2024-05-08T18:31:00.290806+0000","last_became_peered":"2024-05-08T18:31:00.290806+0000","last_unstale":"2024-05-08T18:34:07.196716+0000","last_undegraded":"2024-05-08T18:34:07.196716+0000","last_fullsized":"2024-05-08T18:34:07.196716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:21:46.897549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.919314+0000","last_change":"2024-05-08T18:30:58.305311+0000","last_active":"2024-05-08T18:34:06.919314+0000","last_peered":"2024-05-08T18:34:06.919314+0000","last_clean":"2024-05-08T18:34:06.919314+0000","last_became_active":"2024-05-08T18:30:58.304685+0000","last_became_peered":"2024-05-08T18:30:58.304685+0000","last_unstale":"2024-05-08T18:34:06.919314+0000","last_undegraded":"2024-05-08T18:34:06.919314+0000","last_fullsized":"2024-05-08T18:34:06.919314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:11.650120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'14","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.335357+0000","last_change":"2024-05-08T18:31:00.283453+0000","last_active":"2024-05-08T18:31:45.335357+0000","last_peered":"2024-05-08T18:31:45.335357+0000","last_clean":"2024-05-08T18:31:45.335357+0000","last_became_active":"2024-05-08T18:31:00.281816+0000","last_became_peered":"2024-05-08T18:31:00.281816+0000","last_unstale":"2024-05-08T18:31:45.335357+0000","last_undegraded":"2024-05-08T18:31:45.335357+0000","last_fullsized":"2024-05-08T18:31:45.335357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:29.461384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337199+0000","last_change":"2024-05-08T18:30:58.307205+0000","last_active":"2024-05-08T18:31:45.337199+0000","last_peered":"2024-05-08T18:31:45.337199+0000","last_clean":"2024-05-08T18:31:45.337199+0000","last_became_active":"2024-05-08T18:30:58.306545+0000","last_became_peered":"2024-05-08T18:30:58.306545+0000","last_unstale":"2024-05-08T18:31:45.337199+0000","last_undegraded":"2024-05-08T18:31:45.337199+0000","last_fullsized":"2024-05-08T18:31:45.337199+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:33.046479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.272025+0000","last_change":"2024-05-08T18:31:00.283417+0000","last_active":"2024-05-08T18:34:07.272025+0000","last_peered":"2024-05-08T18:34:07.272025+0000","last_clean":"2024-05-08T18:34:07.272025+0000","last_became_active":"2024-05-08T18:31:00.283048+0000","last_became_peered":"2024-05-08T18:31:00.283048+0000","last_unstale":"2024-05-08T18:34:07.272025+0000","last_undegraded":"2024-05-08T18:34:07.272025+0000","last_fullsized":"2024-05-08T18:34:07.272025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:16:11.480889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337235+0000","last_change":"2024-05-08T18:30:58.302648+0000","last_active":"2024-05-08T18:31:45.337235+0000","last_peered":"2024-05-08T18:31:45.337235+0000","last_clean":"2024-05-08T18:31:45.337235+0000","last_became_active":"2024-05-08T18:30:58.302245+0000","last_became_peered":"2024-05-08T18:30:58.302245+0000","last_unstale":"2024-05-08T18:31:45.337235+0000","last_undegraded":"2024-05-08T18:31:45.337235+0000","last_fullsized":"2024-05-08T18:31:45.337235+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:18.354135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'10","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196741+0000","last_change":"2024-05-08T18:31:45.338509+0000","last_active":"2024-05-08T18:34:07.196741+0000","last_peered":"2024-05-08T18:34:07.196741+0000","last_clean":"2024-05-08T18:34:07.196741+0000","last_became_active":"2024-05-08T18:31:45.338192+0000","last_became_peered":"2024-05-08T18:31:45.338192+0000","last_unstale":"2024-05-08T18:34:07.196741+0000","last_undegraded":"2024-05-08T18:34:07.196741+0000","last_fullsized":"2024-05-08T18:34:07.196741+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:50.426519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.559767+0000","last_change":"2024-05-08T18:30:58.306070+0000","last_active":"2024-05-08T18:33:06.559767+0000","last_peered":"2024-05-08T18:33:06.559767+0000","last_clean":"2024-05-08T18:33:06.559767+0000","last_became_active":"2024-05-08T18:30:58.304222+0000","last_became_peered":"2024-05-08T18:30:58.304222+0000","last_unstale":"2024-05-08T18:33:06.559767+0000","last_undegraded":"2024-05-08T18:33:06.559767+0000","last_fullsized":"2024-05-08T18:33:06.559767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:33:08.890455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"27'6","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331878+0000","last_change":"2024-05-08T18:31:00.296365+0000","last_active":"2024-05-08T18:31:45.331878+0000","last_peered":"2024-05-08T18:31:45.331878+0000","last_clean":"2024-05-08T18:31:45.331878+0000","last_became_active":"2024-05-08T18:31:00.295990+0000","last_became_peered":"2024-05-08T18:31:00.295990+0000","last_unstale":"2024-05-08T18:31:45.331878+0000","last_undegraded":"2024-05-08T18:31:45.331878+0000","last_fullsized":"2024-05-08T18:31:45.331878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:22:54.136553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330650+0000","last_change":"2024-05-08T18:30:58.285289+0000","last_active":"2024-05-08T18:31:45.330650+0000","last_peered":"2024-05-08T18:31:45.330650+0000","last_clean":"2024-05-08T18:31:45.330650+0000","last_became_active":"2024-05-08T18:30:58.283821+0000","last_became_peered":"2024-05-08T18:30:58.283821+0000","last_unstale":"2024-05-08T18:31:45.330650+0000","last_undegraded":"2024-05-08T18:31:45.330650+0000","last_fullsized":"2024-05-08T18:31:45.330650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:26.528845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'12","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196862+0000","last_change":"2024-05-08T18:31:00.282011+0000","last_active":"2024-05-08T18:34:07.196862+0000","last_peered":"2024-05-08T18:34:07.196862+0000","last_clean":"2024-05-08T18:34:07.196862+0000","last_became_active":"2024-05-08T18:31:00.280827+0000","last_became_peered":"2024-05-08T18:31:00.280827+0000","last_unstale":"2024-05-08T18:34:07.196862+0000","last_undegraded":"2024-05-08T18:34:07.196862+0000","last_fullsized":"2024-05-08T18:34:07.196862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:43.107566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328805+0000","last_change":"2024-05-08T18:30:58.306076+0000","last_active":"2024-05-08T18:31:45.328805+0000","last_peered":"2024-05-08T18:31:45.328805+0000","last_clean":"2024-05-08T18:31:45.328805+0000","last_became_active":"2024-05-08T18:30:58.305571+0000","last_became_peered":"2024-05-08T18:30:58.305571+0000","last_unstale":"2024-05-08T18:31:45.328805+0000","last_undegraded":"2024-05-08T18:31:45.328805+0000","last_fullsized":"2024-05-08T18:31:45.328805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:50.476345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.219476+0000","last_change":"2024-05-08T18:31:08.318466+0000","last_active":"2024-05-08T18:34:07.219476+0000","last_peered":"2024-05-08T18:34:07.219476+0000","last_clean":"2024-05-08T18:34:07.219476+0000","last_became_active":"2024-05-08T18:31:08.318181+0000","last_became_peered":"2024-05-08T18:31:08.318181+0000","last_unstale":"2024-05-08T18:34:07.219476+0000","last_undegraded":"2024-05-08T18:34:07.219476+0000","last_fullsized":"2024-05-08T18:34:07.219476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:26.315849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'12","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.869576+0000","last_change":"2024-05-08T18:31:00.296553+0000","last_active":"2024-05-08T18:32:22.869576+0000","last_peered":"2024-05-08T18:32:22.869576+0000","last_clean":"2024-05-08T18:32:22.869576+0000","last_became_active":"2024-05-08T18:31:00.296160+0000","last_became_peered":"2024-05-08T18:31:00.296160+0000","last_unstale":"2024-05-08T18:32:22.869576+0000","last_undegraded":"2024-05-08T18:32:22.869576+0000","last_fullsized":"2024-05-08T18:32:22.869576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:33.551031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328737+0000","last_change":"2024-05-08T18:30:58.317375+0000","last_active":"2024-05-08T18:31:45.328737+0000","last_peered":"2024-05-08T18:31:45.328737+0000","last_clean":"2024-05-08T18:31:45.328737+0000","last_became_active":"2024-05-08T18:30:58.315246+0000","last_became_peered":"2024-05-08T18:30:58.315246+0000","last_unstale":"2024-05-08T18:31:45.328737+0000","last_undegraded":"2024-05-08T18:31:45.328737+0000","last_fullsized":"2024-05-08T18:31:45.328737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:27.453462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329632+0000","last_change":"2024-05-08T18:31:02.290839+0000","last_active":"2024-05-08T18:31:45.329632+0000","last_peered":"2024-05-08T18:31:45.329632+0000","last_clean":"2024-05-08T18:31:45.329632+0000","last_became_active":"2024-05-08T18:31:02.290465+0000","last_became_peered":"2024-05-08T18:31:02.290465+0000","last_unstale":"2024-05-08T18:31:45.329632+0000","last_undegraded":"2024-05-08T18:31:45.329632+0000","last_fullsized":"2024-05-08T18:31:45.329632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:57.860502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.080511+0000","last_change":"2024-05-08T18:31:04.304092+0000","last_active":"2024-05-08T18:33:05.080511+0000","last_peered":"2024-05-08T18:33:05.080511+0000","last_clean":"2024-05-08T18:33:05.080511+0000","last_became_active":"2024-05-08T18:31:04.303815+0000","last_became_peered":"2024-05-08T18:31:04.303815+0000","last_unstale":"2024-05-08T18:33:05.080511+0000","last_undegraded":"2024-05-08T18:33:05.080511+0000","last_fullsized":"2024-05-08T18:33:05.080511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:57.848922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.338770+0000","last_change":"2024-05-08T18:31:06.310842+0000","last_active":"2024-05-08T18:31:45.338770+0000","last_peered":"2024-05-08T18:31:45.338770+0000","last_clean":"2024-05-08T18:31:45.338770+0000","last_became_active":"2024-05-08T18:31:06.310555+0000","last_became_peered":"2024-05-08T18:31:06.310555+0000","last_unstale":"2024-05-08T18:31:45.338770+0000","last_undegraded":"2024-05-08T18:31:45.338770+0000","last_fullsized":"2024-05-08T18:31:45.338770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:01.875049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.691129+0000","last_change":"2024-05-08T18:31:08.319311+0000","last_active":"2024-05-08T18:32:22.691129+0000","last_peered":"2024-05-08T18:32:22.691129+0000","last_clean":"2024-05-08T18:32:22.691129+0000","last_became_active":"2024-05-08T18:31:08.319009+0000","last_became_peered":"2024-05-08T18:31:08.319009+0000","last_unstale":"2024-05-08T18:32:22.691129+0000","last_undegraded":"2024-05-08T18:32:22.691129+0000","last_fullsized":"2024-05-08T18:32:22.691129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:13.936857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330446+0000","last_change":"2024-05-08T18:31:00.298856+0000","last_active":"2024-05-08T18:31:45.330446+0000","last_peered":"2024-05-08T18:31:45.330446+0000","last_clean":"2024-05-08T18:31:45.330446+0000","last_became_active":"2024-05-08T18:31:00.297497+0000","last_became_peered":"2024-05-08T18:31:00.297497+0000","last_unstale":"2024-05-08T18:31:45.330446+0000","last_undegraded":"2024-05-08T18:31:45.330446+0000","last_fullsized":"2024-05-08T18:31:45.330446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:57.260625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334952+0000","last_change":"2024-05-08T18:30:58.300036+0000","last_active":"2024-05-08T18:31:45.334952+0000","last_peered":"2024-05-08T18:31:45.334952+0000","last_clean":"2024-05-08T18:31:45.334952+0000","last_became_active":"2024-05-08T18:30:58.299649+0000","last_became_peered":"2024-05-08T18:30:58.299649+0000","last_unstale":"2024-05-08T18:31:45.334952+0000","last_undegraded":"2024-05-08T18:31:45.334952+0000","last_fullsized":"2024-05-08T18:31:45.334952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:43.233516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"20'1","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.182063+0000","last_change":"2024-05-08T18:31:02.294330+0000","last_active":"2024-05-08T18:33:06.182063+0000","last_peered":"2024-05-08T18:33:06.182063+0000","last_clean":"2024-05-08T18:33:06.182063+0000","last_became_active":"2024-05-08T18:31:02.293993+0000","last_became_peered":"2024-05-08T18:31:02.293993+0000","last_unstale":"2024-05-08T18:33:06.182063+0000","last_undegraded":"2024-05-08T18:33:06.182063+0000","last_fullsized":"2024-05-08T18:33:06.182063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:57.170520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.181520+0000","last_change":"2024-05-08T18:31:04.300424+0000","last_active":"2024-05-08T18:33:33.181520+0000","last_peered":"2024-05-08T18:33:33.181520+0000","last_clean":"2024-05-08T18:33:33.181520+0000","last_became_active":"2024-05-08T18:31:04.300059+0000","last_became_peered":"2024-05-08T18:31:04.300059+0000","last_unstale":"2024-05-08T18:33:33.181520+0000","last_undegraded":"2024-05-08T18:33:33.181520+0000","last_fullsized":"2024-05-08T18:33:33.181520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:44.348620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336322+0000","last_change":"2024-05-08T18:31:06.312948+0000","last_active":"2024-05-08T18:31:45.336322+0000","last_peered":"2024-05-08T18:31:45.336322+0000","last_clean":"2024-05-08T18:31:45.336322+0000","last_became_active":"2024-05-08T18:31:06.312651+0000","last_became_peered":"2024-05-08T18:31:06.312651+0000","last_unstale":"2024-05-08T18:31:45.336322+0000","last_undegraded":"2024-05-08T18:31:45.336322+0000","last_fullsized":"2024-05-08T18:31:45.336322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:01.719275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328702+0000","last_change":"2024-05-08T18:31:08.311373+0000","last_active":"2024-05-08T18:31:45.328702+0000","last_peered":"2024-05-08T18:31:45.328702+0000","last_clean":"2024-05-08T18:31:45.328702+0000","last_became_active":"2024-05-08T18:31:08.311048+0000","last_became_peered":"2024-05-08T18:31:08.311048+0000","last_unstale":"2024-05-08T18:31:45.328702+0000","last_undegraded":"2024-05-08T18:31:45.328702+0000","last_fullsized":"2024-05-08T18:31:45.328702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:36.670228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.242285+0000","last_change":"2024-05-08T18:31:00.296832+0000","last_active":"2024-05-08T18:34:07.242285+0000","last_peered":"2024-05-08T18:34:07.242285+0000","last_clean":"2024-05-08T18:34:07.242285+0000","last_became_active":"2024-05-08T18:31:00.296176+0000","last_became_peered":"2024-05-08T18:31:00.296176+0000","last_unstale":"2024-05-08T18:34:07.242285+0000","last_undegraded":"2024-05-08T18:34:07.242285+0000","last_fullsized":"2024-05-08T18:34:07.242285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:56.201421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327607+0000","last_change":"2024-05-08T18:30:58.310108+0000","last_active":"2024-05-08T18:31:45.327607+0000","last_peered":"2024-05-08T18:31:45.327607+0000","last_clean":"2024-05-08T18:31:45.327607+0000","last_became_active":"2024-05-08T18:30:58.309339+0000","last_became_peered":"2024-05-08T18:30:58.309339+0000","last_unstale":"2024-05-08T18:31:45.327607+0000","last_undegraded":"2024-05-08T18:31:45.327607+0000","last_fullsized":"2024-05-08T18:31:45.327607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:38.248722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:48.166352+0000","last_change":"2024-05-08T18:31:45.335793+0000","last_active":"2024-05-08T18:31:48.166352+0000","last_peered":"2024-05-08T18:31:48.166352+0000","last_clean":"2024-05-08T18:31:48.166352+0000","last_became_active":"2024-05-08T18:31:45.335489+0000","last_became_peered":"2024-05-08T18:31:45.335489+0000","last_unstale":"2024-05-08T18:31:48.166352+0000","last_undegraded":"2024-05-08T18:31:48.166352+0000","last_fullsized":"2024-05-08T18:31:48.166352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:01.179871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.180653+0000","last_change":"2024-05-08T18:31:04.300336+0000","last_active":"2024-05-08T18:33:28.180653+0000","last_peered":"2024-05-08T18:33:28.180653+0000","last_clean":"2024-05-08T18:33:28.180653+0000","last_became_active":"2024-05-08T18:31:04.300022+0000","last_became_peered":"2024-05-08T18:31:04.300022+0000","last_unstale":"2024-05-08T18:33:28.180653+0000","last_undegraded":"2024-05-08T18:33:28.180653+0000","last_fullsized":"2024-05-08T18:33:28.180653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:42.428646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'282","reported_seq":390,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370245+0000","last_change":"2024-05-08T18:31:06.307960+0000","last_active":"2024-05-08T18:34:07.370245+0000","last_peered":"2024-05-08T18:34:07.370245+0000","last_clean":"2024-05-08T18:34:07.370245+0000","last_became_active":"2024-05-08T18:31:06.306886+0000","last_became_peered":"2024-05-08T18:31:06.306886+0000","last_unstale":"2024-05-08T18:34:07.370245+0000","last_undegraded":"2024-05-08T18:34:07.370245+0000","last_fullsized":"2024-05-08T18:34:07.370245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:48.485718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.578916+0000","last_change":"2024-05-08T18:31:08.312050+0000","last_active":"2024-05-08T18:33:06.578916+0000","last_peered":"2024-05-08T18:33:06.578916+0000","last_clean":"2024-05-08T18:33:06.578916+0000","last_became_active":"2024-05-08T18:31:08.311780+0000","last_became_peered":"2024-05-08T18:31:08.311780+0000","last_unstale":"2024-05-08T18:33:06.578916+0000","last_undegraded":"2024-05-08T18:33:06.578916+0000","last_fullsized":"2024-05-08T18:33:06.578916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:11:36.751971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332003+0000","last_change":"2024-05-08T18:31:00.281650+0000","last_active":"2024-05-08T18:31:45.332003+0000","last_peered":"2024-05-08T18:31:45.332003+0000","last_clean":"2024-05-08T18:31:45.332003+0000","last_became_active":"2024-05-08T18:31:00.281268+0000","last_became_peered":"2024-05-08T18:31:00.281268+0000","last_unstale":"2024-05-08T18:31:45.332003+0000","last_undegraded":"2024-05-08T18:31:45.332003+0000","last_fullsized":"2024-05-08T18:31:45.332003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:40.256644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.186380+0000","last_change":"2024-05-08T18:30:58.306638+0000","last_active":"2024-05-08T18:34:07.186380+0000","last_peered":"2024-05-08T18:34:07.186380+0000","last_clean":"2024-05-08T18:34:07.186380+0000","last_became_active":"2024-05-08T18:30:58.303428+0000","last_became_peered":"2024-05-08T18:30:58.303428+0000","last_unstale":"2024-05-08T18:34:07.186380+0000","last_undegraded":"2024-05-08T18:34:07.186380+0000","last_fullsized":"2024-05-08T18:34:07.186380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:56.618771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332766+0000","last_change":"2024-05-08T18:31:02.292000+0000","last_active":"2024-05-08T18:31:45.332766+0000","last_peered":"2024-05-08T18:31:45.332766+0000","last_clean":"2024-05-08T18:31:45.332766+0000","last_became_active":"2024-05-08T18:31:02.291729+0000","last_became_peered":"2024-05-08T18:31:02.291729+0000","last_unstale":"2024-05-08T18:31:45.332766+0000","last_undegraded":"2024-05-08T18:31:45.332766+0000","last_fullsized":"2024-05-08T18:31:45.332766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:47:19.398957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.075273+0000","last_change":"2024-05-08T18:31:04.304611+0000","last_active":"2024-05-08T18:33:05.075273+0000","last_peered":"2024-05-08T18:33:05.075273+0000","last_clean":"2024-05-08T18:33:05.075273+0000","last_became_active":"2024-05-08T18:31:04.304347+0000","last_became_peered":"2024-05-08T18:31:04.304347+0000","last_unstale":"2024-05-08T18:33:05.075273+0000","last_undegraded":"2024-05-08T18:33:05.075273+0000","last_fullsized":"2024-05-08T18:33:05.075273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:42.690781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'282","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370399+0000","last_change":"2024-05-08T18:31:06.305903+0000","last_active":"2024-05-08T18:34:07.370399+0000","last_peered":"2024-05-08T18:34:07.370399+0000","last_clean":"2024-05-08T18:34:07.370399+0000","last_became_active":"2024-05-08T18:31:06.305591+0000","last_became_peered":"2024-05-08T18:31:06.305591+0000","last_unstale":"2024-05-08T18:34:07.370399+0000","last_undegraded":"2024-05-08T18:34:07.370399+0000","last_fullsized":"2024-05-08T18:34:07.370399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:49.125159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'10","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.272036+0000","last_change":"2024-05-08T18:31:00.291398+0000","last_active":"2024-05-08T18:34:07.272036+0000","last_peered":"2024-05-08T18:34:07.272036+0000","last_clean":"2024-05-08T18:34:07.272036+0000","last_became_active":"2024-05-08T18:31:00.290824+0000","last_became_peered":"2024-05-08T18:31:00.290824+0000","last_unstale":"2024-05-08T18:34:07.272036+0000","last_undegraded":"2024-05-08T18:34:07.272036+0000","last_fullsized":"2024-05-08T18:34:07.272036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:32.380609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333693+0000","last_change":"2024-05-08T18:30:58.301227+0000","last_active":"2024-05-08T18:31:45.333693+0000","last_peered":"2024-05-08T18:31:45.333693+0000","last_clean":"2024-05-08T18:31:45.333693+0000","last_became_active":"2024-05-08T18:30:58.300884+0000","last_became_peered":"2024-05-08T18:30:58.300884+0000","last_unstale":"2024-05-08T18:31:45.333693+0000","last_undegraded":"2024-05-08T18:31:45.333693+0000","last_fullsized":"2024-05-08T18:31:45.333693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:18.354135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334570+0000","last_change":"2024-05-08T18:31:02.291926+0000","last_active":"2024-05-08T18:31:45.334570+0000","last_peered":"2024-05-08T18:31:45.334570+0000","last_clean":"2024-05-08T18:31:45.334570+0000","last_became_active":"2024-05-08T18:31:02.291536+0000","last_became_peered":"2024-05-08T18:31:02.291536+0000","last_unstale":"2024-05-08T18:31:45.334570+0000","last_undegraded":"2024-05-08T18:31:45.334570+0000","last_fullsized":"2024-05-08T18:31:45.334570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:01.425063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'41","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.085136+0000","last_change":"2024-05-08T18:31:04.302745+0000","last_active":"2024-05-08T18:33:05.085136+0000","last_peered":"2024-05-08T18:33:05.085136+0000","last_clean":"2024-05-08T18:33:05.085136+0000","last_became_active":"2024-05-08T18:31:04.302455+0000","last_became_peered":"2024-05-08T18:31:04.302455+0000","last_unstale":"2024-05-08T18:33:05.085136+0000","last_undegraded":"2024-05-08T18:33:05.085136+0000","last_fullsized":"2024-05-08T18:33:05.085136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:32.684836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330256+0000","last_change":"2024-05-08T18:31:06.305190+0000","last_active":"2024-05-08T18:31:45.330256+0000","last_peered":"2024-05-08T18:31:45.330256+0000","last_clean":"2024-05-08T18:31:45.330256+0000","last_became_active":"2024-05-08T18:31:06.304979+0000","last_became_peered":"2024-05-08T18:31:06.304979+0000","last_unstale":"2024-05-08T18:31:45.330256+0000","last_undegraded":"2024-05-08T18:31:45.330256+0000","last_fullsized":"2024-05-08T18:31:45.330256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:43.024781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.692939+0000","last_change":"2024-05-08T18:31:08.311725+0000","last_active":"2024-05-08T18:32:22.692939+0000","last_peered":"2024-05-08T18:32:22.692939+0000","last_clean":"2024-05-08T18:32:22.692939+0000","last_became_active":"2024-05-08T18:31:08.311434+0000","last_became_peered":"2024-05-08T18:31:08.311434+0000","last_unstale":"2024-05-08T18:32:22.692939+0000","last_undegraded":"2024-05-08T18:32:22.692939+0000","last_fullsized":"2024-05-08T18:32:22.692939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:03.726123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.681210+0000","last_change":"2024-05-08T18:31:00.281267+0000","last_active":"2024-05-08T18:32:22.681210+0000","last_peered":"2024-05-08T18:32:22.681210+0000","last_clean":"2024-05-08T18:32:22.681210+0000","last_became_active":"2024-05-08T18:31:00.280969+0000","last_became_peered":"2024-05-08T18:31:00.280969+0000","last_unstale":"2024-05-08T18:32:22.681210+0000","last_undegraded":"2024-05-08T18:32:22.681210+0000","last_fullsized":"2024-05-08T18:32:22.681210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:22:54.136553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331186+0000","last_change":"2024-05-08T18:30:58.303460+0000","last_active":"2024-05-08T18:31:45.331186+0000","last_peered":"2024-05-08T18:31:45.331186+0000","last_clean":"2024-05-08T18:31:45.331186+0000","last_became_active":"2024-05-08T18:30:58.302590+0000","last_became_peered":"2024-05-08T18:30:58.302590+0000","last_unstale":"2024-05-08T18:31:45.331186+0000","last_undegraded":"2024-05-08T18:31:45.331186+0000","last_fullsized":"2024-05-08T18:31:45.331186+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:34.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329728+0000","last_change":"2024-05-08T18:31:02.289867+0000","last_active":"2024-05-08T18:31:45.329728+0000","last_peered":"2024-05-08T18:31:45.329728+0000","last_clean":"2024-05-08T18:31:45.329728+0000","last_became_active":"2024-05-08T18:31:02.289394+0000","last_became_peered":"2024-05-08T18:31:02.289394+0000","last_unstale":"2024-05-08T18:31:45.329728+0000","last_undegraded":"2024-05-08T18:31:45.329728+0000","last_fullsized":"2024-05-08T18:31:45.329728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:11.566252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.064996+0000","last_change":"2024-05-08T18:31:04.303291+0000","last_active":"2024-05-08T18:33:05.064996+0000","last_peered":"2024-05-08T18:33:05.064996+0000","last_clean":"2024-05-08T18:33:05.064996+0000","last_became_active":"2024-05-08T18:31:04.302886+0000","last_became_peered":"2024-05-08T18:31:04.302886+0000","last_unstale":"2024-05-08T18:33:05.064996+0000","last_undegraded":"2024-05-08T18:33:05.064996+0000","last_fullsized":"2024-05-08T18:33:05.064996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:19:01.413463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330112+0000","last_change":"2024-05-08T18:31:06.306937+0000","last_active":"2024-05-08T18:31:45.330112+0000","last_peered":"2024-05-08T18:31:45.330112+0000","last_clean":"2024-05-08T18:31:45.330112+0000","last_became_active":"2024-05-08T18:31:06.306607+0000","last_became_peered":"2024-05-08T18:31:06.306607+0000","last_unstale":"2024-05-08T18:31:45.330112+0000","last_undegraded":"2024-05-08T18:31:45.330112+0000","last_fullsized":"2024-05-08T18:31:45.330112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:57.121163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:17.147191+0000","last_change":"2024-05-08T18:31:08.305446+0000","last_active":"2024-05-08T18:32:17.147191+0000","last_peered":"2024-05-08T18:32:17.147191+0000","last_clean":"2024-05-08T18:32:17.147191+0000","last_became_active":"2024-05-08T18:31:08.305127+0000","last_became_peered":"2024-05-08T18:31:08.305127+0000","last_unstale":"2024-05-08T18:32:17.147191+0000","last_undegraded":"2024-05-08T18:32:17.147191+0000","last_fullsized":"2024-05-08T18:32:17.147191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:34.156497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.870768+0000","last_change":"2024-05-08T18:31:00.293425+0000","last_active":"2024-05-08T18:32:22.870768+0000","last_peered":"2024-05-08T18:32:22.870768+0000","last_clean":"2024-05-08T18:32:22.870768+0000","last_became_active":"2024-05-08T18:31:00.293170+0000","last_became_peered":"2024-05-08T18:31:00.293170+0000","last_unstale":"2024-05-08T18:32:22.870768+0000","last_undegraded":"2024-05-08T18:32:22.870768+0000","last_fullsized":"2024-05-08T18:32:22.870768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:18.374257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.486260+0000","last_change":"2024-05-08T18:30:58.316505+0000","last_active":"2024-05-08T18:33:06.486260+0000","last_peered":"2024-05-08T18:33:06.486260+0000","last_clean":"2024-05-08T18:33:06.486260+0000","last_became_active":"2024-05-08T18:30:58.314352+0000","last_became_peered":"2024-05-08T18:30:58.314352+0000","last_unstale":"2024-05-08T18:33:06.486260+0000","last_undegraded":"2024-05-08T18:33:06.486260+0000","last_fullsized":"2024-05-08T18:33:06.486260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:17.391716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:48.166253+0000","last_change":"2024-05-08T18:31:45.339752+0000","last_active":"2024-05-08T18:31:48.166253+0000","last_peered":"2024-05-08T18:31:48.166253+0000","last_clean":"2024-05-08T18:31:48.166253+0000","last_became_active":"2024-05-08T18:31:45.339423+0000","last_became_peered":"2024-05-08T18:31:45.339423+0000","last_unstale":"2024-05-08T18:31:48.166253+0000","last_undegraded":"2024-05-08T18:31:48.166253+0000","last_fullsized":"2024-05-08T18:31:48.166253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:49:36.600605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.087041+0000","last_change":"2024-05-08T18:31:04.298949+0000","last_active":"2024-05-08T18:33:05.087041+0000","last_peered":"2024-05-08T18:33:05.087041+0000","last_clean":"2024-05-08T18:33:05.087041+0000","last_became_active":"2024-05-08T18:31:04.298026+0000","last_became_peered":"2024-05-08T18:31:04.298026+0000","last_unstale":"2024-05-08T18:33:05.087041+0000","last_undegraded":"2024-05-08T18:33:05.087041+0000","last_fullsized":"2024-05-08T18:33:05.087041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:17.656617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'282","reported_seq":354,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.406177+0000","last_change":"2024-05-08T18:31:06.307022+0000","last_active":"2024-05-08T18:34:07.406177+0000","last_peered":"2024-05-08T18:34:07.406177+0000","last_clean":"2024-05-08T18:34:07.406177+0000","last_became_active":"2024-05-08T18:31:06.306655+0000","last_became_peered":"2024-05-08T18:31:06.306655+0000","last_unstale":"2024-05-08T18:34:07.406177+0000","last_undegraded":"2024-05-08T18:34:07.406177+0000","last_fullsized":"2024-05-08T18:34:07.406177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:17.968800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330293+0000","last_change":"2024-05-08T18:31:08.314593+0000","last_active":"2024-05-08T18:31:45.330293+0000","last_peered":"2024-05-08T18:31:45.330293+0000","last_clean":"2024-05-08T18:31:45.330293+0000","last_became_active":"2024-05-08T18:31:08.314273+0000","last_became_peered":"2024-05-08T18:31:08.314273+0000","last_unstale":"2024-05-08T18:31:45.330293+0000","last_undegraded":"2024-05-08T18:31:45.330293+0000","last_fullsized":"2024-05-08T18:31:45.330293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:44.629789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.869260+0000","last_change":"2024-05-08T18:31:00.283193+0000","last_active":"2024-05-08T18:32:22.869260+0000","last_peered":"2024-05-08T18:32:22.869260+0000","last_clean":"2024-05-08T18:32:22.869260+0000","last_became_active":"2024-05-08T18:31:00.282941+0000","last_became_peered":"2024-05-08T18:31:00.282941+0000","last_unstale":"2024-05-08T18:32:22.869260+0000","last_undegraded":"2024-05-08T18:32:22.869260+0000","last_fullsized":"2024-05-08T18:32:22.869260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:54.772566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328935+0000","last_change":"2024-05-08T18:30:58.316967+0000","last_active":"2024-05-08T18:31:45.328935+0000","last_peered":"2024-05-08T18:31:45.328935+0000","last_clean":"2024-05-08T18:31:45.328935+0000","last_became_active":"2024-05-08T18:30:58.313431+0000","last_became_peered":"2024-05-08T18:30:58.313431+0000","last_unstale":"2024-05-08T18:31:45.328935+0000","last_undegraded":"2024-05-08T18:31:45.328935+0000","last_fullsized":"2024-05-08T18:31:45.328935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:24.289073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329543+0000","last_change":"2024-05-08T18:31:02.290051+0000","last_active":"2024-05-08T18:31:45.329543+0000","last_peered":"2024-05-08T18:31:45.329543+0000","last_clean":"2024-05-08T18:31:45.329543+0000","last_became_active":"2024-05-08T18:31:02.289669+0000","last_became_peered":"2024-05-08T18:31:02.289669+0000","last_unstale":"2024-05-08T18:31:45.329543+0000","last_undegraded":"2024-05-08T18:31:45.329543+0000","last_fullsized":"2024-05-08T18:31:45.329543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:30.670243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'56","reported_seq":112,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.583830+0000","last_change":"2024-05-08T18:31:04.302553+0000","last_active":"2024-05-08T18:33:06.583830+0000","last_peered":"2024-05-08T18:33:06.583830+0000","last_clean":"2024-05-08T18:33:06.583830+0000","last_became_active":"2024-05-08T18:31:04.302244+0000","last_became_peered":"2024-05-08T18:31:04.302244+0000","last_unstale":"2024-05-08T18:33:06.583830+0000","last_undegraded":"2024-05-08T18:33:06.583830+0000","last_fullsized":"2024-05-08T18:33:06.583830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:46.989970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329219+0000","last_change":"2024-05-08T18:31:06.309153+0000","last_active":"2024-05-08T18:31:45.329219+0000","last_peered":"2024-05-08T18:31:45.329219+0000","last_clean":"2024-05-08T18:31:45.329219+0000","last_became_active":"2024-05-08T18:31:06.308806+0000","last_became_peered":"2024-05-08T18:31:06.308806+0000","last_unstale":"2024-05-08T18:31:45.329219+0000","last_undegraded":"2024-05-08T18:31:45.329219+0000","last_fullsized":"2024-05-08T18:31:45.329219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:11:34.745123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.381203+0000","last_change":"2024-05-08T18:31:08.319703+0000","last_active":"2024-05-08T18:34:07.381203+0000","last_peered":"2024-05-08T18:34:07.381203+0000","last_clean":"2024-05-08T18:34:07.381203+0000","last_became_active":"2024-05-08T18:31:08.319370+0000","last_became_peered":"2024-05-08T18:31:08.319370+0000","last_unstale":"2024-05-08T18:34:07.381203+0000","last_undegraded":"2024-05-08T18:34:07.381203+0000","last_fullsized":"2024-05-08T18:34:07.381203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:36.140092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.684230+0000","last_change":"2024-05-08T18:31:00.292416+0000","last_active":"2024-05-08T18:32:22.684230+0000","last_peered":"2024-05-08T18:32:22.684230+0000","last_clean":"2024-05-08T18:32:22.684230+0000","last_became_active":"2024-05-08T18:31:00.292154+0000","last_became_peered":"2024-05-08T18:31:00.292154+0000","last_unstale":"2024-05-08T18:32:22.684230+0000","last_undegraded":"2024-05-08T18:32:22.684230+0000","last_fullsized":"2024-05-08T18:32:22.684230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:03.239102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330126+0000","last_change":"2024-05-08T18:30:58.294896+0000","last_active":"2024-05-08T18:31:45.330126+0000","last_peered":"2024-05-08T18:31:45.330126+0000","last_clean":"2024-05-08T18:31:45.330126+0000","last_became_active":"2024-05-08T18:30:58.294377+0000","last_became_peered":"2024-05-08T18:30:58.294377+0000","last_unstale":"2024-05-08T18:31:45.330126+0000","last_undegraded":"2024-05-08T18:31:45.330126+0000","last_fullsized":"2024-05-08T18:31:45.330126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:04.148371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330076+0000","last_change":"2024-05-08T18:31:02.294000+0000","last_active":"2024-05-08T18:31:45.330076+0000","last_peered":"2024-05-08T18:31:45.330076+0000","last_clean":"2024-05-08T18:31:45.330076+0000","last_became_active":"2024-05-08T18:31:02.293680+0000","last_became_peered":"2024-05-08T18:31:02.293680+0000","last_unstale":"2024-05-08T18:31:45.330076+0000","last_undegraded":"2024-05-08T18:31:45.330076+0000","last_fullsized":"2024-05-08T18:31:45.330076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:49:52.687784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.069060+0000","last_change":"2024-05-08T18:31:04.301433+0000","last_active":"2024-05-08T18:33:05.069060+0000","last_peered":"2024-05-08T18:33:05.069060+0000","last_clean":"2024-05-08T18:33:05.069060+0000","last_became_active":"2024-05-08T18:31:04.301147+0000","last_became_peered":"2024-05-08T18:31:04.301147+0000","last_unstale":"2024-05-08T18:33:05.069060+0000","last_undegraded":"2024-05-08T18:33:05.069060+0000","last_fullsized":"2024-05-08T18:33:05.069060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:13.749614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332085+0000","last_change":"2024-05-08T18:31:06.309848+0000","last_active":"2024-05-08T18:31:45.332085+0000","last_peered":"2024-05-08T18:31:45.332085+0000","last_clean":"2024-05-08T18:31:45.332085+0000","last_became_active":"2024-05-08T18:31:06.308804+0000","last_became_peered":"2024-05-08T18:31:06.308804+0000","last_unstale":"2024-05-08T18:31:45.332085+0000","last_undegraded":"2024-05-08T18:31:45.332085+0000","last_fullsized":"2024-05-08T18:31:45.332085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.734033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177658+0000","last_change":"2024-05-08T18:31:08.320629+0000","last_active":"2024-05-08T18:33:08.177658+0000","last_peered":"2024-05-08T18:33:08.177658+0000","last_clean":"2024-05-08T18:33:08.177658+0000","last_became_active":"2024-05-08T18:31:08.320150+0000","last_became_peered":"2024-05-08T18:31:08.320150+0000","last_unstale":"2024-05-08T18:33:08.177658+0000","last_undegraded":"2024-05-08T18:33:08.177658+0000","last_fullsized":"2024-05-08T18:33:08.177658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:06:21.193541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.962245+0000","last_change":"2024-05-08T18:31:00.300161+0000","last_active":"2024-05-08T18:34:06.962245+0000","last_peered":"2024-05-08T18:34:06.962245+0000","last_clean":"2024-05-08T18:34:06.962245+0000","last_became_active":"2024-05-08T18:31:00.299379+0000","last_became_peered":"2024-05-08T18:31:00.299379+0000","last_unstale":"2024-05-08T18:34:06.962245+0000","last_undegraded":"2024-05-08T18:34:06.962245+0000","last_fullsized":"2024-05-08T18:34:06.962245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:30.742428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329273+0000","last_change":"2024-05-08T18:30:58.316845+0000","last_active":"2024-05-08T18:31:45.329273+0000","last_peered":"2024-05-08T18:31:45.329273+0000","last_clean":"2024-05-08T18:31:45.329273+0000","last_became_active":"2024-05-08T18:30:58.315625+0000","last_became_peered":"2024-05-08T18:30:58.315625+0000","last_unstale":"2024-05-08T18:31:45.329273+0000","last_undegraded":"2024-05-08T18:31:45.329273+0000","last_fullsized":"2024-05-08T18:31:45.329273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:06.716557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329621+0000","last_change":"2024-05-08T18:31:02.290296+0000","last_active":"2024-05-08T18:31:45.329621+0000","last_peered":"2024-05-08T18:31:45.329621+0000","last_clean":"2024-05-08T18:31:45.329621+0000","last_became_active":"2024-05-08T18:31:02.289767+0000","last_became_peered":"2024-05-08T18:31:02.289767+0000","last_unstale":"2024-05-08T18:31:45.329621+0000","last_undegraded":"2024-05-08T18:31:45.329621+0000","last_fullsized":"2024-05-08T18:31:45.329621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:25.978523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.095800+0000","last_change":"2024-05-08T18:31:04.294840+0000","last_active":"2024-05-08T18:33:05.095800+0000","last_peered":"2024-05-08T18:33:05.095800+0000","last_clean":"2024-05-08T18:33:05.095800+0000","last_became_active":"2024-05-08T18:31:04.294573+0000","last_became_peered":"2024-05-08T18:31:04.294573+0000","last_unstale":"2024-05-08T18:33:05.095800+0000","last_undegraded":"2024-05-08T18:33:05.095800+0000","last_fullsized":"2024-05-08T18:33:05.095800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:37.564647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'282","reported_seq":430,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.395855+0000","last_change":"2024-05-08T18:31:06.312484+0000","last_active":"2024-05-08T18:34:07.395855+0000","last_peered":"2024-05-08T18:34:07.395855+0000","last_clean":"2024-05-08T18:34:07.395855+0000","last_became_active":"2024-05-08T18:31:06.312203+0000","last_became_peered":"2024-05-08T18:31:06.312203+0000","last_unstale":"2024-05-08T18:34:07.395855+0000","last_undegraded":"2024-05-08T18:34:07.395855+0000","last_fullsized":"2024-05-08T18:34:07.395855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:28.017188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'14","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.250725+0000","last_change":"2024-05-08T18:31:08.314495+0000","last_active":"2024-05-08T18:34:07.250725+0000","last_peered":"2024-05-08T18:34:07.250725+0000","last_clean":"2024-05-08T18:34:07.250725+0000","last_became_active":"2024-05-08T18:31:08.314171+0000","last_became_peered":"2024-05-08T18:31:08.314171+0000","last_unstale":"2024-05-08T18:34:07.250725+0000","last_undegraded":"2024-05-08T18:34:07.250725+0000","last_fullsized":"2024-05-08T18:34:07.250725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:26.315849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.242517+0000","last_change":"2024-05-08T18:31:00.292788+0000","last_active":"2024-05-08T18:34:07.242517+0000","last_peered":"2024-05-08T18:34:07.242517+0000","last_clean":"2024-05-08T18:34:07.242517+0000","last_became_active":"2024-05-08T18:31:00.292521+0000","last_became_peered":"2024-05-08T18:31:00.292521+0000","last_unstale":"2024-05-08T18:34:07.242517+0000","last_undegraded":"2024-05-08T18:34:07.242517+0000","last_fullsized":"2024-05-08T18:34:07.242517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:09.586689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329194+0000","last_change":"2024-05-08T18:30:58.310166+0000","last_active":"2024-05-08T18:31:45.329194+0000","last_peered":"2024-05-08T18:31:45.329194+0000","last_clean":"2024-05-08T18:31:45.329194+0000","last_became_active":"2024-05-08T18:30:58.309773+0000","last_became_peered":"2024-05-08T18:30:58.309773+0000","last_unstale":"2024-05-08T18:31:45.329194+0000","last_undegraded":"2024-05-08T18:31:45.329194+0000","last_fullsized":"2024-05-08T18:31:45.329194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:07.578767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.181624+0000","last_change":"2024-05-08T18:31:02.289615+0000","last_active":"2024-05-08T18:33:06.181624+0000","last_peered":"2024-05-08T18:33:06.181624+0000","last_clean":"2024-05-08T18:33:06.181624+0000","last_became_active":"2024-05-08T18:31:02.289253+0000","last_became_peered":"2024-05-08T18:31:02.289253+0000","last_unstale":"2024-05-08T18:33:06.181624+0000","last_undegraded":"2024-05-08T18:33:06.181624+0000","last_fullsized":"2024-05-08T18:33:06.181624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:12.617698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330973+0000","last_change":"2024-05-08T18:31:04.304088+0000","last_active":"2024-05-08T18:31:45.330973+0000","last_peered":"2024-05-08T18:31:45.330973+0000","last_clean":"2024-05-08T18:31:45.330973+0000","last_became_active":"2024-05-08T18:31:04.303799+0000","last_became_peered":"2024-05-08T18:31:04.303799+0000","last_unstale":"2024-05-08T18:31:45.330973+0000","last_undegraded":"2024-05-08T18:31:45.330973+0000","last_fullsized":"2024-05-08T18:31:45.330973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:57.074860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'282","reported_seq":459,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370311+0000","last_change":"2024-05-08T18:31:06.305559+0000","last_active":"2024-05-08T18:34:07.370311+0000","last_peered":"2024-05-08T18:34:07.370311+0000","last_clean":"2024-05-08T18:34:07.370311+0000","last_became_active":"2024-05-08T18:31:06.305201+0000","last_became_peered":"2024-05-08T18:31:06.305201+0000","last_unstale":"2024-05-08T18:34:07.370311+0000","last_undegraded":"2024-05-08T18:34:07.370311+0000","last_fullsized":"2024-05-08T18:34:07.370311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:49.125159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.361146+0000","last_change":"2024-05-08T18:31:08.311212+0000","last_active":"2024-05-08T18:33:06.361146+0000","last_peered":"2024-05-08T18:33:06.361146+0000","last_clean":"2024-05-08T18:33:06.361146+0000","last_became_active":"2024-05-08T18:31:08.310906+0000","last_became_peered":"2024-05-08T18:31:08.310906+0000","last_unstale":"2024-05-08T18:33:06.361146+0000","last_undegraded":"2024-05-08T18:33:06.361146+0000","last_fullsized":"2024-05-08T18:33:06.361146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:11.717528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'14","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271660+0000","last_change":"2024-05-08T18:31:00.292227+0000","last_active":"2024-05-08T18:34:07.271660+0000","last_peered":"2024-05-08T18:34:07.271660+0000","last_clean":"2024-05-08T18:34:07.271660+0000","last_became_active":"2024-05-08T18:31:00.291563+0000","last_became_peered":"2024-05-08T18:31:00.291563+0000","last_unstale":"2024-05-08T18:34:07.271660+0000","last_undegraded":"2024-05-08T18:34:07.271660+0000","last_fullsized":"2024-05-08T18:34:07.271660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:21.530085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328340+0000","last_change":"2024-05-08T18:30:58.304032+0000","last_active":"2024-05-08T18:31:45.328340+0000","last_peered":"2024-05-08T18:31:45.328340+0000","last_clean":"2024-05-08T18:31:45.328340+0000","last_became_active":"2024-05-08T18:30:58.302966+0000","last_became_peered":"2024-05-08T18:30:58.302966+0000","last_unstale":"2024-05-08T18:31:45.328340+0000","last_undegraded":"2024-05-08T18:31:45.328340+0000","last_fullsized":"2024-05-08T18:31:45.328340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:53.183411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332859+0000","last_change":"2024-05-08T18:31:02.288493+0000","last_active":"2024-05-08T18:31:45.332859+0000","last_peered":"2024-05-08T18:31:45.332859+0000","last_clean":"2024-05-08T18:31:45.332859+0000","last_became_active":"2024-05-08T18:31:02.288232+0000","last_became_peered":"2024-05-08T18:31:02.288232+0000","last_unstale":"2024-05-08T18:31:45.332859+0000","last_undegraded":"2024-05-08T18:31:45.332859+0000","last_fullsized":"2024-05-08T18:31:45.332859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:29:42.582963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'38","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.081776+0000","last_change":"2024-05-08T18:31:04.301609+0000","last_active":"2024-05-08T18:33:05.081776+0000","last_peered":"2024-05-08T18:33:05.081776+0000","last_clean":"2024-05-08T18:33:05.081776+0000","last_became_active":"2024-05-08T18:31:04.301298+0000","last_became_peered":"2024-05-08T18:31:04.301298+0000","last_unstale":"2024-05-08T18:33:05.081776+0000","last_undegraded":"2024-05-08T18:33:05.081776+0000","last_fullsized":"2024-05-08T18:33:05.081776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:17.287554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331437+0000","last_change":"2024-05-08T18:31:06.310680+0000","last_active":"2024-05-08T18:31:45.331437+0000","last_peered":"2024-05-08T18:31:45.331437+0000","last_clean":"2024-05-08T18:31:45.331437+0000","last_became_active":"2024-05-08T18:31:06.310430+0000","last_became_peered":"2024-05-08T18:31:06.310430+0000","last_unstale":"2024-05-08T18:31:45.331437+0000","last_undegraded":"2024-05-08T18:31:45.331437+0000","last_fullsized":"2024-05-08T18:31:45.331437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:36.763558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.309458+0000","last_change":"2024-05-08T18:31:08.307711+0000","last_active":"2024-05-08T18:34:07.309458+0000","last_peered":"2024-05-08T18:34:07.309458+0000","last_clean":"2024-05-08T18:34:07.309458+0000","last_became_active":"2024-05-08T18:31:08.306492+0000","last_became_peered":"2024-05-08T18:31:08.306492+0000","last_unstale":"2024-05-08T18:34:07.309458+0000","last_undegraded":"2024-05-08T18:34:07.309458+0000","last_fullsized":"2024-05-08T18:34:07.309458+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:47:53.084160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271927+0000","last_change":"2024-05-08T18:31:00.299933+0000","last_active":"2024-05-08T18:34:07.271927+0000","last_peered":"2024-05-08T18:34:07.271927+0000","last_clean":"2024-05-08T18:34:07.271927+0000","last_became_active":"2024-05-08T18:31:00.299186+0000","last_became_peered":"2024-05-08T18:31:00.299186+0000","last_unstale":"2024-05-08T18:34:07.271927+0000","last_undegraded":"2024-05-08T18:34:07.271927+0000","last_fullsized":"2024-05-08T18:34:07.271927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:37.968339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337354+0000","last_change":"2024-05-08T18:30:49.982170+0000","last_active":"2024-05-08T18:31:45.337354+0000","last_peered":"2024-05-08T18:31:45.337354+0000","last_clean":"2024-05-08T18:31:45.337354+0000","last_became_active":"2024-05-08T18:30:49.981852+0000","last_became_peered":"2024-05-08T18:30:49.981852+0000","last_unstale":"2024-05-08T18:31:45.337354+0000","last_undegraded":"2024-05-08T18:31:45.337354+0000","last_fullsized":"2024-05-08T18:31:45.337354+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:01:54.158426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329142+0000","last_change":"2024-05-08T18:30:49.983387+0000","last_active":"2024-05-08T18:31:45.329142+0000","last_peered":"2024-05-08T18:31:45.329142+0000","last_clean":"2024-05-08T18:31:45.329142+0000","last_became_active":"2024-05-08T18:30:49.983023+0000","last_became_peered":"2024-05-08T18:30:49.983023+0000","last_unstale":"2024-05-08T18:31:45.329142+0000","last_undegraded":"2024-05-08T18:31:45.329142+0000","last_fullsized":"2024-05-08T18:31:45.329142+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:49.558123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328133+0000","last_change":"2024-05-08T18:30:58.317086+0000","last_active":"2024-05-08T18:31:45.328133+0000","last_peered":"2024-05-08T18:31:45.328133+0000","last_clean":"2024-05-08T18:31:45.328133+0000","last_became_active":"2024-05-08T18:30:58.316676+0000","last_became_peered":"2024-05-08T18:30:58.316676+0000","last_unstale":"2024-05-08T18:31:45.328133+0000","last_undegraded":"2024-05-08T18:31:45.328133+0000","last_fullsized":"2024-05-08T18:31:45.328133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:59:23.755041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.340362+0000","last_change":"2024-05-08T18:31:45.339419+0000","last_active":"2024-05-08T18:31:45.340362+0000","last_peered":"2024-05-08T18:31:45.340362+0000","last_clean":"2024-05-08T18:31:45.340362+0000","last_became_active":"2024-05-08T18:31:45.339007+0000","last_became_peered":"2024-05-08T18:31:45.339007+0000","last_unstale":"2024-05-08T18:31:45.340362+0000","last_undegraded":"2024-05-08T18:31:45.340362+0000","last_fullsized":"2024-05-08T18:31:45.340362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:27.129227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'76","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.093625+0000","last_change":"2024-05-08T18:31:04.299443+0000","last_active":"2024-05-08T18:33:05.093625+0000","last_peered":"2024-05-08T18:33:05.093625+0000","last_clean":"2024-05-08T18:33:05.093625+0000","last_became_active":"2024-05-08T18:31:04.299145+0000","last_became_peered":"2024-05-08T18:31:04.299145+0000","last_unstale":"2024-05-08T18:33:05.093625+0000","last_undegraded":"2024-05-08T18:33:05.093625+0000","last_fullsized":"2024-05-08T18:33:05.093625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:54.440135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330451+0000","last_change":"2024-05-08T18:31:06.312091+0000","last_active":"2024-05-08T18:31:45.330451+0000","last_peered":"2024-05-08T18:31:45.330451+0000","last_clean":"2024-05-08T18:31:45.330451+0000","last_became_active":"2024-05-08T18:31:06.311742+0000","last_became_peered":"2024-05-08T18:31:06.311742+0000","last_unstale":"2024-05-08T18:31:45.330451+0000","last_undegraded":"2024-05-08T18:31:45.330451+0000","last_fullsized":"2024-05-08T18:31:45.330451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:29:46.597510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'87","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.286528+0000","last_change":"2024-05-08T18:31:08.311008+0000","last_active":"2024-05-08T18:34:07.286528+0000","last_peered":"2024-05-08T18:34:07.286528+0000","last_clean":"2024-05-08T18:34:07.286528+0000","last_became_active":"2024-05-08T18:31:08.310715+0000","last_became_peered":"2024-05-08T18:31:08.310715+0000","last_unstale":"2024-05-08T18:34:07.286528+0000","last_undegraded":"2024-05-08T18:34:07.286528+0000","last_fullsized":"2024-05-08T18:34:07.286528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:34.317569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":173,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.057524+0000","last_change":"2024-05-08T18:31:00.295877+0000","last_active":"2024-05-08T18:34:07.057524+0000","last_peered":"2024-05-08T18:34:07.057524+0000","last_clean":"2024-05-08T18:34:07.057524+0000","last_became_active":"2024-05-08T18:31:00.295578+0000","last_became_peered":"2024-05-08T18:31:00.295578+0000","last_unstale":"2024-05-08T18:34:07.057524+0000","last_undegraded":"2024-05-08T18:34:07.057524+0000","last_fullsized":"2024-05-08T18:34:07.057524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:10.611116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327422+0000","last_change":"2024-05-08T18:30:49.983190+0000","last_active":"2024-05-08T18:31:45.327422+0000","last_peered":"2024-05-08T18:31:45.327422+0000","last_clean":"2024-05-08T18:31:45.327422+0000","last_became_active":"2024-05-08T18:30:49.982854+0000","last_became_peered":"2024-05-08T18:30:49.982854+0000","last_unstale":"2024-05-08T18:31:45.327422+0000","last_undegraded":"2024-05-08T18:31:45.327422+0000","last_fullsized":"2024-05-08T18:31:45.327422+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:33.902157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176047+0000","last_change":"2024-05-08T18:30:58.295078+0000","last_active":"2024-05-08T18:33:03.176047+0000","last_peered":"2024-05-08T18:33:03.176047+0000","last_clean":"2024-05-08T18:33:03.176047+0000","last_became_active":"2024-05-08T18:30:58.294153+0000","last_became_peered":"2024-05-08T18:30:58.294153+0000","last_unstale":"2024-05-08T18:33:03.176047+0000","last_undegraded":"2024-05-08T18:33:03.176047+0000","last_fullsized":"2024-05-08T18:33:03.176047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:18.354135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332227+0000","last_change":"2024-05-08T18:31:02.292269+0000","last_active":"2024-05-08T18:31:45.332227+0000","last_peered":"2024-05-08T18:31:45.332227+0000","last_clean":"2024-05-08T18:31:45.332227+0000","last_became_active":"2024-05-08T18:31:02.291979+0000","last_became_peered":"2024-05-08T18:31:02.291979+0000","last_unstale":"2024-05-08T18:31:45.332227+0000","last_undegraded":"2024-05-08T18:31:45.332227+0000","last_fullsized":"2024-05-08T18:31:45.332227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:39.010234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'274","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370443+0000","last_change":"2024-05-08T18:31:04.299833+0000","last_active":"2024-05-08T18:34:07.370443+0000","last_peered":"2024-05-08T18:34:07.370443+0000","last_clean":"2024-05-08T18:34:07.370443+0000","last_became_active":"2024-05-08T18:31:04.299494+0000","last_became_peered":"2024-05-08T18:31:04.299494+0000","last_unstale":"2024-05-08T18:34:07.370443+0000","last_undegraded":"2024-05-08T18:34:07.370443+0000","last_fullsized":"2024-05-08T18:34:07.370443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:04:48.277052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329374+0000","last_change":"2024-05-08T18:31:06.307338+0000","last_active":"2024-05-08T18:31:45.329374+0000","last_peered":"2024-05-08T18:31:45.329374+0000","last_clean":"2024-05-08T18:31:45.329374+0000","last_became_active":"2024-05-08T18:31:06.306554+0000","last_became_peered":"2024-05-08T18:31:06.306554+0000","last_unstale":"2024-05-08T18:31:45.329374+0000","last_undegraded":"2024-05-08T18:31:45.329374+0000","last_fullsized":"2024-05-08T18:31:45.329374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:32.299617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.867202+0000","last_change":"2024-05-08T18:31:08.316829+0000","last_active":"2024-05-08T18:32:22.867202+0000","last_peered":"2024-05-08T18:32:22.867202+0000","last_clean":"2024-05-08T18:32:22.867202+0000","last_became_active":"2024-05-08T18:31:08.316536+0000","last_became_peered":"2024-05-08T18:31:08.316536+0000","last_unstale":"2024-05-08T18:32:22.867202+0000","last_undegraded":"2024-05-08T18:32:22.867202+0000","last_fullsized":"2024-05-08T18:32:22.867202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:54.836108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'10","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.334094+0000","last_change":"2024-05-08T18:31:00.281674+0000","last_active":"2024-05-08T18:34:07.334094+0000","last_peered":"2024-05-08T18:34:07.334094+0000","last_clean":"2024-05-08T18:34:07.334094+0000","last_became_active":"2024-05-08T18:31:00.281359+0000","last_became_peered":"2024-05-08T18:31:00.281359+0000","last_unstale":"2024-05-08T18:34:07.334094+0000","last_undegraded":"2024-05-08T18:34:07.334094+0000","last_fullsized":"2024-05-08T18:34:07.334094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:21.913096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330082+0000","last_change":"2024-05-08T18:30:49.982800+0000","last_active":"2024-05-08T18:31:45.330082+0000","last_peered":"2024-05-08T18:31:45.330082+0000","last_clean":"2024-05-08T18:31:45.330082+0000","last_became_active":"2024-05-08T18:30:49.982438+0000","last_became_peered":"2024-05-08T18:30:49.982438+0000","last_unstale":"2024-05-08T18:31:45.330082+0000","last_undegraded":"2024-05-08T18:31:45.330082+0000","last_fullsized":"2024-05-08T18:31:45.330082+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:18.664851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328603+0000","last_change":"2024-05-08T18:30:58.294820+0000","last_active":"2024-05-08T18:31:45.328603+0000","last_peered":"2024-05-08T18:31:45.328603+0000","last_clean":"2024-05-08T18:31:45.328603+0000","last_became_active":"2024-05-08T18:30:58.294292+0000","last_became_peered":"2024-05-08T18:30:58.294292+0000","last_unstale":"2024-05-08T18:31:45.328603+0000","last_undegraded":"2024-05-08T18:31:45.328603+0000","last_fullsized":"2024-05-08T18:31:45.328603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:07.501461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330259+0000","last_change":"2024-05-08T18:31:02.292271+0000","last_active":"2024-05-08T18:31:45.330259+0000","last_peered":"2024-05-08T18:31:45.330259+0000","last_clean":"2024-05-08T18:31:45.330259+0000","last_became_active":"2024-05-08T18:31:02.291806+0000","last_became_peered":"2024-05-08T18:31:02.291806+0000","last_unstale":"2024-05-08T18:31:45.330259+0000","last_undegraded":"2024-05-08T18:31:45.330259+0000","last_fullsized":"2024-05-08T18:31:45.330259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:03.635955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370265+0000","last_change":"2024-05-08T18:31:04.303574+0000","last_active":"2024-05-08T18:34:07.370265+0000","last_peered":"2024-05-08T18:34:07.370265+0000","last_clean":"2024-05-08T18:34:07.370265+0000","last_became_active":"2024-05-08T18:31:04.303321+0000","last_became_peered":"2024-05-08T18:31:04.303321+0000","last_unstale":"2024-05-08T18:34:07.370265+0000","last_undegraded":"2024-05-08T18:34:07.370265+0000","last_fullsized":"2024-05-08T18:34:07.370265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:57:03.432097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330522+0000","last_change":"2024-05-08T18:31:06.309771+0000","last_active":"2024-05-08T18:31:45.330522+0000","last_peered":"2024-05-08T18:31:45.330522+0000","last_clean":"2024-05-08T18:31:45.330522+0000","last_became_active":"2024-05-08T18:31:06.309525+0000","last_became_peered":"2024-05-08T18:31:06.309525+0000","last_unstale":"2024-05-08T18:31:45.330522+0000","last_undegraded":"2024-05-08T18:31:45.330522+0000","last_fullsized":"2024-05-08T18:31:45.330522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:47:23.413504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'8","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327513+0000","last_change":"2024-05-08T18:31:08.314823+0000","last_active":"2024-05-08T18:31:45.327513+0000","last_peered":"2024-05-08T18:31:45.327513+0000","last_clean":"2024-05-08T18:31:45.327513+0000","last_became_active":"2024-05-08T18:31:08.314503+0000","last_became_peered":"2024-05-08T18:31:08.314503+0000","last_unstale":"2024-05-08T18:31:45.327513+0000","last_undegraded":"2024-05-08T18:31:45.327513+0000","last_fullsized":"2024-05-08T18:31:45.327513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:58.072442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.333503+0000","last_change":"2024-05-08T18:31:00.283770+0000","last_active":"2024-05-08T18:33:03.333503+0000","last_peered":"2024-05-08T18:33:03.333503+0000","last_clean":"2024-05-08T18:33:03.333503+0000","last_became_active":"2024-05-08T18:31:00.283410+0000","last_became_peered":"2024-05-08T18:31:00.283410+0000","last_unstale":"2024-05-08T18:33:03.333503+0000","last_undegraded":"2024-05-08T18:33:03.333503+0000","last_fullsized":"2024-05-08T18:33:03.333503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:56.345475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327663+0000","last_change":"2024-05-08T18:30:49.983911+0000","last_active":"2024-05-08T18:31:45.327663+0000","last_peered":"2024-05-08T18:31:45.327663+0000","last_clean":"2024-05-08T18:31:45.327663+0000","last_became_active":"2024-05-08T18:30:49.983515+0000","last_became_peered":"2024-05-08T18:30:49.983515+0000","last_unstale":"2024-05-08T18:31:45.327663+0000","last_undegraded":"2024-05-08T18:31:45.327663+0000","last_fullsized":"2024-05-08T18:31:45.327663+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:40.629929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332492+0000","last_change":"2024-05-08T18:30:58.306622+0000","last_active":"2024-05-08T18:31:45.332492+0000","last_peered":"2024-05-08T18:31:45.332492+0000","last_clean":"2024-05-08T18:31:45.332492+0000","last_became_active":"2024-05-08T18:30:58.306268+0000","last_became_peered":"2024-05-08T18:30:58.306268+0000","last_unstale":"2024-05-08T18:31:45.332492+0000","last_undegraded":"2024-05-08T18:31:45.332492+0000","last_fullsized":"2024-05-08T18:31:45.332492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:07.501461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330794+0000","last_change":"2024-05-08T18:31:02.292466+0000","last_active":"2024-05-08T18:31:45.330794+0000","last_peered":"2024-05-08T18:31:45.330794+0000","last_clean":"2024-05-08T18:31:45.330794+0000","last_became_active":"2024-05-08T18:31:02.292030+0000","last_became_peered":"2024-05-08T18:31:02.292030+0000","last_unstale":"2024-05-08T18:31:45.330794+0000","last_undegraded":"2024-05-08T18:31:45.330794+0000","last_fullsized":"2024-05-08T18:31:45.330794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:24.356014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'13","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.594211+0000","last_change":"2024-05-08T18:31:04.296591+0000","last_active":"2024-05-08T18:34:06.594211+0000","last_peered":"2024-05-08T18:34:06.594211+0000","last_clean":"2024-05-08T18:34:06.594211+0000","last_became_active":"2024-05-08T18:31:04.296257+0000","last_became_peered":"2024-05-08T18:31:04.296257+0000","last_unstale":"2024-05-08T18:34:06.594211+0000","last_undegraded":"2024-05-08T18:34:06.594211+0000","last_fullsized":"2024-05-08T18:34:06.594211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:29.136261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332452+0000","last_change":"2024-05-08T18:31:06.309173+0000","last_active":"2024-05-08T18:31:45.332452+0000","last_peered":"2024-05-08T18:31:45.332452+0000","last_clean":"2024-05-08T18:31:45.332452+0000","last_became_active":"2024-05-08T18:31:06.308892+0000","last_became_peered":"2024-05-08T18:31:06.308892+0000","last_unstale":"2024-05-08T18:31:45.332452+0000","last_undegraded":"2024-05-08T18:31:45.332452+0000","last_fullsized":"2024-05-08T18:31:45.332452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:18.093112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.340083+0000","last_change":"2024-05-08T18:31:08.319035+0000","last_active":"2024-05-08T18:33:06.340083+0000","last_peered":"2024-05-08T18:33:06.340083+0000","last_clean":"2024-05-08T18:33:06.340083+0000","last_became_active":"2024-05-08T18:31:08.318728+0000","last_became_peered":"2024-05-08T18:31:08.318728+0000","last_unstale":"2024-05-08T18:33:06.340083+0000","last_undegraded":"2024-05-08T18:33:06.340083+0000","last_fullsized":"2024-05-08T18:33:06.340083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:14.378528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'3","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:53.184078+0000","last_change":"2024-05-08T18:31:45.344716+0000","last_active":"2024-05-08T18:33:53.184078+0000","last_peered":"2024-05-08T18:33:53.184078+0000","last_clean":"2024-05-08T18:33:53.184078+0000","last_became_active":"2024-05-08T18:31:45.337785+0000","last_became_peered":"2024-05-08T18:31:45.337785+0000","last_unstale":"2024-05-08T18:33:53.184078+0000","last_undegraded":"2024-05-08T18:33:53.184078+0000","last_fullsized":"2024-05-08T18:33:53.184078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:46.808130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.419073+0000","last_change":"2024-05-08T18:30:58.302684+0000","last_active":"2024-05-08T18:33:06.419073+0000","last_peered":"2024-05-08T18:33:06.419073+0000","last_clean":"2024-05-08T18:33:06.419073+0000","last_became_active":"2024-05-08T18:30:58.302328+0000","last_became_peered":"2024-05-08T18:30:58.302328+0000","last_unstale":"2024-05-08T18:33:06.419073+0000","last_undegraded":"2024-05-08T18:33:06.419073+0000","last_fullsized":"2024-05-08T18:33:06.419073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:26.528845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330056+0000","last_change":"2024-05-08T18:30:49.983824+0000","last_active":"2024-05-08T18:31:45.330056+0000","last_peered":"2024-05-08T18:31:45.330056+0000","last_clean":"2024-05-08T18:31:45.330056+0000","last_became_active":"2024-05-08T18:30:49.983522+0000","last_became_peered":"2024-05-08T18:30:49.983522+0000","last_unstale":"2024-05-08T18:31:45.330056+0000","last_undegraded":"2024-05-08T18:31:45.330056+0000","last_fullsized":"2024-05-08T18:31:45.330056+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:18.812194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.176791+0000","last_change":"2024-05-08T18:31:02.294921+0000","last_active":"2024-05-08T18:33:08.176791+0000","last_peered":"2024-05-08T18:33:08.176791+0000","last_clean":"2024-05-08T18:33:08.176791+0000","last_became_active":"2024-05-08T18:31:02.294603+0000","last_became_peered":"2024-05-08T18:31:02.294603+0000","last_unstale":"2024-05-08T18:33:08.176791+0000","last_undegraded":"2024-05-08T18:33:08.176791+0000","last_fullsized":"2024-05-08T18:33:08.176791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:32.998440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'62","reported_seq":121,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.929072+0000","last_change":"2024-05-08T18:31:04.295377+0000","last_active":"2024-05-08T18:34:06.929072+0000","last_peered":"2024-05-08T18:34:06.929072+0000","last_clean":"2024-05-08T18:34:06.929072+0000","last_became_active":"2024-05-08T18:31:04.295090+0000","last_became_peered":"2024-05-08T18:31:04.295090+0000","last_unstale":"2024-05-08T18:34:06.929072+0000","last_undegraded":"2024-05-08T18:34:06.929072+0000","last_fullsized":"2024-05-08T18:34:06.929072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:24.176022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":61,"num_read_kb":49,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330265+0000","last_change":"2024-05-08T18:31:06.312460+0000","last_active":"2024-05-08T18:31:45.330265+0000","last_peered":"2024-05-08T18:31:45.330265+0000","last_clean":"2024-05-08T18:31:45.330265+0000","last_became_active":"2024-05-08T18:31:06.312179+0000","last_became_peered":"2024-05-08T18:31:06.312179+0000","last_unstale":"2024-05-08T18:31:45.330265+0000","last_undegraded":"2024-05-08T18:31:45.330265+0000","last_fullsized":"2024-05-08T18:31:45.330265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:03.281754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.521191+0000","last_change":"2024-05-08T18:31:08.306655+0000","last_active":"2024-05-08T18:33:06.521191+0000","last_peered":"2024-05-08T18:33:06.521191+0000","last_clean":"2024-05-08T18:33:06.521191+0000","last_became_active":"2024-05-08T18:31:08.304818+0000","last_became_peered":"2024-05-08T18:31:08.304818+0000","last_unstale":"2024-05-08T18:33:06.521191+0000","last_undegraded":"2024-05-08T18:33:06.521191+0000","last_fullsized":"2024-05-08T18:33:06.521191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:38.400920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.057661+0000","last_change":"2024-05-08T18:31:00.294763+0000","last_active":"2024-05-08T18:34:07.057661+0000","last_peered":"2024-05-08T18:34:07.057661+0000","last_clean":"2024-05-08T18:34:07.057661+0000","last_became_active":"2024-05-08T18:31:00.294157+0000","last_became_peered":"2024-05-08T18:31:00.294157+0000","last_unstale":"2024-05-08T18:34:07.057661+0000","last_undegraded":"2024-05-08T18:34:07.057661+0000","last_fullsized":"2024-05-08T18:34:07.057661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:41.794217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176107+0000","last_change":"2024-05-08T18:30:58.288464+0000","last_active":"2024-05-08T18:33:03.176107+0000","last_peered":"2024-05-08T18:33:03.176107+0000","last_clean":"2024-05-08T18:33:03.176107+0000","last_became_active":"2024-05-08T18:30:58.286578+0000","last_became_peered":"2024-05-08T18:30:58.286578+0000","last_unstale":"2024-05-08T18:33:03.176107+0000","last_undegraded":"2024-05-08T18:33:03.176107+0000","last_fullsized":"2024-05-08T18:33:03.176107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:46.459524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329948+0000","last_change":"2024-05-08T18:30:49.982777+0000","last_active":"2024-05-08T18:31:45.329948+0000","last_peered":"2024-05-08T18:31:45.329948+0000","last_clean":"2024-05-08T18:31:45.329948+0000","last_became_active":"2024-05-08T18:30:49.982471+0000","last_became_peered":"2024-05-08T18:30:49.982471+0000","last_unstale":"2024-05-08T18:31:45.329948+0000","last_undegraded":"2024-05-08T18:31:45.329948+0000","last_fullsized":"2024-05-08T18:31:45.329948+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:54.349839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327459+0000","last_change":"2024-05-08T18:31:02.288838+0000","last_active":"2024-05-08T18:31:45.327459+0000","last_peered":"2024-05-08T18:31:45.327459+0000","last_clean":"2024-05-08T18:31:45.327459+0000","last_became_active":"2024-05-08T18:31:02.287974+0000","last_became_peered":"2024-05-08T18:31:02.287974+0000","last_unstale":"2024-05-08T18:31:45.327459+0000","last_undegraded":"2024-05-08T18:31:45.327459+0000","last_fullsized":"2024-05-08T18:31:45.327459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:05.696133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'15","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178044+0000","last_change":"2024-05-08T18:31:04.301545+0000","last_active":"2024-05-08T18:33:13.178044+0000","last_peered":"2024-05-08T18:33:13.178044+0000","last_clean":"2024-05-08T18:33:13.178044+0000","last_became_active":"2024-05-08T18:31:04.301116+0000","last_became_peered":"2024-05-08T18:31:04.301116+0000","last_unstale":"2024-05-08T18:33:13.178044+0000","last_undegraded":"2024-05-08T18:33:13.178044+0000","last_fullsized":"2024-05-08T18:33:13.178044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:26.009674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'282","reported_seq":374,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370404+0000","last_change":"2024-05-08T18:31:06.308742+0000","last_active":"2024-05-08T18:34:07.370404+0000","last_peered":"2024-05-08T18:34:07.370404+0000","last_clean":"2024-05-08T18:34:07.370404+0000","last_became_active":"2024-05-08T18:31:06.308274+0000","last_became_peered":"2024-05-08T18:31:06.308274+0000","last_unstale":"2024-05-08T18:34:07.370404+0000","last_undegraded":"2024-05-08T18:34:07.370404+0000","last_fullsized":"2024-05-08T18:34:07.370404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:57.121163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331379+0000","last_change":"2024-05-08T18:31:08.318932+0000","last_active":"2024-05-08T18:31:45.331379+0000","last_peered":"2024-05-08T18:31:45.331379+0000","last_clean":"2024-05-08T18:31:45.331379+0000","last_became_active":"2024-05-08T18:31:08.318609+0000","last_became_peered":"2024-05-08T18:31:08.318609+0000","last_unstale":"2024-05-08T18:31:45.331379+0000","last_undegraded":"2024-05-08T18:31:45.331379+0000","last_fullsized":"2024-05-08T18:31:45.331379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:50.231594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328412+0000","last_change":"2024-05-08T18:31:00.291567+0000","last_active":"2024-05-08T18:31:45.328412+0000","last_peered":"2024-05-08T18:31:45.328412+0000","last_clean":"2024-05-08T18:31:45.328412+0000","last_became_active":"2024-05-08T18:31:00.291093+0000","last_became_peered":"2024-05-08T18:31:00.291093+0000","last_unstale":"2024-05-08T18:31:45.328412+0000","last_undegraded":"2024-05-08T18:31:45.328412+0000","last_fullsized":"2024-05-08T18:31:45.328412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:53.284230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333265+0000","last_change":"2024-05-08T18:30:58.306520+0000","last_active":"2024-05-08T18:31:45.333265+0000","last_peered":"2024-05-08T18:31:45.333265+0000","last_clean":"2024-05-08T18:31:45.333265+0000","last_became_active":"2024-05-08T18:30:58.305915+0000","last_became_peered":"2024-05-08T18:30:58.305915+0000","last_unstale":"2024-05-08T18:31:45.333265+0000","last_undegraded":"2024-05-08T18:31:45.333265+0000","last_fullsized":"2024-05-08T18:31:45.333265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:35.822576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330715+0000","last_change":"2024-05-08T18:30:49.982641+0000","last_active":"2024-05-08T18:31:45.330715+0000","last_peered":"2024-05-08T18:31:45.330715+0000","last_clean":"2024-05-08T18:31:45.330715+0000","last_became_active":"2024-05-08T18:30:49.982330+0000","last_became_peered":"2024-05-08T18:30:49.982330+0000","last_unstale":"2024-05-08T18:31:45.330715+0000","last_undegraded":"2024-05-08T18:31:45.330715+0000","last_fullsized":"2024-05-08T18:31:45.330715+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:18.664851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327471+0000","last_change":"2024-05-08T18:31:02.292781+0000","last_active":"2024-05-08T18:31:45.327471+0000","last_peered":"2024-05-08T18:31:45.327471+0000","last_clean":"2024-05-08T18:31:45.327471+0000","last_became_active":"2024-05-08T18:31:02.292328+0000","last_became_peered":"2024-05-08T18:31:02.292328+0000","last_unstale":"2024-05-08T18:31:45.327471+0000","last_undegraded":"2024-05-08T18:31:45.327471+0000","last_fullsized":"2024-05-08T18:31:45.327471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:57.704727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328449+0000","last_change":"2024-05-08T18:31:04.302579+0000","last_active":"2024-05-08T18:31:45.328449+0000","last_peered":"2024-05-08T18:31:45.328449+0000","last_clean":"2024-05-08T18:31:45.328449+0000","last_became_active":"2024-05-08T18:31:04.302020+0000","last_became_peered":"2024-05-08T18:31:04.302020+0000","last_unstale":"2024-05-08T18:31:45.328449+0000","last_undegraded":"2024-05-08T18:31:45.328449+0000","last_fullsized":"2024-05-08T18:31:45.328449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:32.125730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'282","reported_seq":389,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.381934+0000","last_change":"2024-05-08T18:31:06.305364+0000","last_active":"2024-05-08T18:34:07.381934+0000","last_peered":"2024-05-08T18:34:07.381934+0000","last_clean":"2024-05-08T18:34:07.381934+0000","last_became_active":"2024-05-08T18:31:06.305020+0000","last_became_peered":"2024-05-08T18:31:06.305020+0000","last_unstale":"2024-05-08T18:34:07.381934+0000","last_undegraded":"2024-05-08T18:34:07.381934+0000","last_fullsized":"2024-05-08T18:34:07.381934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:01.875049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333286+0000","last_change":"2024-05-08T18:31:08.310217+0000","last_active":"2024-05-08T18:31:45.333286+0000","last_peered":"2024-05-08T18:31:45.333286+0000","last_clean":"2024-05-08T18:31:45.333286+0000","last_became_active":"2024-05-08T18:31:08.309869+0000","last_became_peered":"2024-05-08T18:31:08.309869+0000","last_unstale":"2024-05-08T18:31:45.333286+0000","last_undegraded":"2024-05-08T18:31:45.333286+0000","last_fullsized":"2024-05-08T18:31:45.333286+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:36.670228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331588+0000","last_change":"2024-05-08T18:31:00.297171+0000","last_active":"2024-05-08T18:31:45.331588+0000","last_peered":"2024-05-08T18:31:45.331588+0000","last_clean":"2024-05-08T18:31:45.331588+0000","last_became_active":"2024-05-08T18:31:00.296431+0000","last_became_peered":"2024-05-08T18:31:00.296431+0000","last_unstale":"2024-05-08T18:31:45.331588+0000","last_undegraded":"2024-05-08T18:31:45.331588+0000","last_fullsized":"2024-05-08T18:31:45.331588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:19:18.458032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336437+0000","last_change":"2024-05-08T18:30:58.304887+0000","last_active":"2024-05-08T18:31:45.336437+0000","last_peered":"2024-05-08T18:31:45.336437+0000","last_clean":"2024-05-08T18:31:45.336437+0000","last_became_active":"2024-05-08T18:30:58.303997+0000","last_became_peered":"2024-05-08T18:30:58.303997+0000","last_unstale":"2024-05-08T18:31:45.336437+0000","last_undegraded":"2024-05-08T18:31:45.336437+0000","last_fullsized":"2024-05-08T18:31:45.336437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:34.595661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332663+0000","last_change":"2024-05-08T18:30:49.984897+0000","last_active":"2024-05-08T18:31:45.332663+0000","last_peered":"2024-05-08T18:31:45.332663+0000","last_clean":"2024-05-08T18:31:45.332663+0000","last_became_active":"2024-05-08T18:30:49.984280+0000","last_became_peered":"2024-05-08T18:30:49.984280+0000","last_unstale":"2024-05-08T18:31:45.332663+0000","last_undegraded":"2024-05-08T18:31:45.332663+0000","last_fullsized":"2024-05-08T18:31:45.332663+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:26.601806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327309+0000","last_change":"2024-05-08T18:31:02.290848+0000","last_active":"2024-05-08T18:31:45.327309+0000","last_peered":"2024-05-08T18:31:45.327309+0000","last_clean":"2024-05-08T18:31:45.327309+0000","last_became_active":"2024-05-08T18:31:02.290540+0000","last_became_peered":"2024-05-08T18:31:02.290540+0000","last_unstale":"2024-05-08T18:31:45.327309+0000","last_undegraded":"2024-05-08T18:31:45.327309+0000","last_fullsized":"2024-05-08T18:31:45.327309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:13.954253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'82","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.079634+0000","last_change":"2024-05-08T18:31:04.304969+0000","last_active":"2024-05-08T18:33:05.079634+0000","last_peered":"2024-05-08T18:33:05.079634+0000","last_clean":"2024-05-08T18:33:05.079634+0000","last_became_active":"2024-05-08T18:31:04.304669+0000","last_became_peered":"2024-05-08T18:31:04.304669+0000","last_unstale":"2024-05-08T18:33:05.079634+0000","last_undegraded":"2024-05-08T18:33:05.079634+0000","last_fullsized":"2024-05-08T18:33:05.079634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:46.499999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328793+0000","last_change":"2024-05-08T18:31:06.308900+0000","last_active":"2024-05-08T18:31:45.328793+0000","last_peered":"2024-05-08T18:31:45.328793+0000","last_clean":"2024-05-08T18:31:45.328793+0000","last_became_active":"2024-05-08T18:31:06.308621+0000","last_became_peered":"2024-05-08T18:31:06.308621+0000","last_unstale":"2024-05-08T18:31:45.328793+0000","last_undegraded":"2024-05-08T18:31:45.328793+0000","last_fullsized":"2024-05-08T18:31:45.328793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:09.710680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.335673+0000","last_change":"2024-05-08T18:31:08.308718+0000","last_active":"2024-05-08T18:34:07.335673+0000","last_peered":"2024-05-08T18:34:07.335673+0000","last_clean":"2024-05-08T18:34:07.335673+0000","last_became_active":"2024-05-08T18:31:08.308427+0000","last_became_peered":"2024-05-08T18:31:08.308427+0000","last_unstale":"2024-05-08T18:34:07.335673+0000","last_undegraded":"2024-05-08T18:34:07.335673+0000","last_fullsized":"2024-05-08T18:34:07.335673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:19.975648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330856+0000","last_change":"2024-05-08T18:31:08.315548+0000","last_active":"2024-05-08T18:31:45.330856+0000","last_peered":"2024-05-08T18:31:45.330856+0000","last_clean":"2024-05-08T18:31:45.330856+0000","last_became_active":"2024-05-08T18:31:08.315257+0000","last_became_peered":"2024-05-08T18:31:08.315257+0000","last_unstale":"2024-05-08T18:31:45.330856+0000","last_undegraded":"2024-05-08T18:31:45.330856+0000","last_fullsized":"2024-05-08T18:31:45.330856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:51.132007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'11","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.064332+0000","last_change":"2024-05-08T18:31:00.295123+0000","last_active":"2024-05-08T18:34:07.064332+0000","last_peered":"2024-05-08T18:34:07.064332+0000","last_clean":"2024-05-08T18:34:07.064332+0000","last_became_active":"2024-05-08T18:31:00.294827+0000","last_became_peered":"2024-05-08T18:31:00.294827+0000","last_unstale":"2024-05-08T18:34:07.064332+0000","last_undegraded":"2024-05-08T18:34:07.064332+0000","last_fullsized":"2024-05-08T18:34:07.064332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:55.191334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.174101+0000","last_change":"2024-05-08T18:30:58.313343+0000","last_active":"2024-05-08T18:34:07.174101+0000","last_peered":"2024-05-08T18:34:07.174101+0000","last_clean":"2024-05-08T18:34:07.174101+0000","last_became_active":"2024-05-08T18:30:58.313034+0000","last_became_peered":"2024-05-08T18:30:58.313034+0000","last_unstale":"2024-05-08T18:34:07.174101+0000","last_undegraded":"2024-05-08T18:34:07.174101+0000","last_fullsized":"2024-05-08T18:34:07.174101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:55.941415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334770+0000","last_change":"2024-05-08T18:31:02.291732+0000","last_active":"2024-05-08T18:31:45.334770+0000","last_peered":"2024-05-08T18:31:45.334770+0000","last_clean":"2024-05-08T18:31:45.334770+0000","last_became_active":"2024-05-08T18:31:02.291119+0000","last_became_peered":"2024-05-08T18:31:02.291119+0000","last_unstale":"2024-05-08T18:31:45.334770+0000","last_undegraded":"2024-05-08T18:31:45.334770+0000","last_fullsized":"2024-05-08T18:31:45.334770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:50.745635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.086081+0000","last_change":"2024-05-08T18:31:04.301279+0000","last_active":"2024-05-08T18:33:05.086081+0000","last_peered":"2024-05-08T18:33:05.086081+0000","last_clean":"2024-05-08T18:33:05.086081+0000","last_became_active":"2024-05-08T18:31:04.300990+0000","last_became_peered":"2024-05-08T18:31:04.300990+0000","last_unstale":"2024-05-08T18:33:05.086081+0000","last_undegraded":"2024-05-08T18:33:05.086081+0000","last_fullsized":"2024-05-08T18:33:05.086081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:40.615427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329018+0000","last_change":"2024-05-08T18:31:06.315203+0000","last_active":"2024-05-08T18:31:45.329018+0000","last_peered":"2024-05-08T18:31:45.329018+0000","last_clean":"2024-05-08T18:31:45.329018+0000","last_became_active":"2024-05-08T18:31:06.314696+0000","last_became_peered":"2024-05-08T18:31:06.314696+0000","last_unstale":"2024-05-08T18:31:45.329018+0000","last_undegraded":"2024-05-08T18:31:45.329018+0000","last_fullsized":"2024-05-08T18:31:45.329018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:41.839545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.795512+0000","last_change":"2024-05-08T18:31:08.319177+0000","last_active":"2024-05-08T18:33:04.795512+0000","last_peered":"2024-05-08T18:33:04.795512+0000","last_clean":"2024-05-08T18:33:04.795512+0000","last_became_active":"2024-05-08T18:31:08.318901+0000","last_became_peered":"2024-05-08T18:31:08.318901+0000","last_unstale":"2024-05-08T18:33:04.795512+0000","last_undegraded":"2024-05-08T18:33:04.795512+0000","last_fullsized":"2024-05-08T18:33:04.795512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:21.670979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.870376+0000","last_change":"2024-05-08T18:31:00.293009+0000","last_active":"2024-05-08T18:32:22.870376+0000","last_peered":"2024-05-08T18:32:22.870376+0000","last_clean":"2024-05-08T18:32:22.870376+0000","last_became_active":"2024-05-08T18:31:00.292376+0000","last_became_peered":"2024-05-08T18:31:00.292376+0000","last_unstale":"2024-05-08T18:32:22.870376+0000","last_undegraded":"2024-05-08T18:32:22.870376+0000","last_fullsized":"2024-05-08T18:32:22.870376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:09.586689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329734+0000","last_change":"2024-05-08T18:30:58.301858+0000","last_active":"2024-05-08T18:31:45.329734+0000","last_peered":"2024-05-08T18:31:45.329734+0000","last_clean":"2024-05-08T18:31:45.329734+0000","last_became_active":"2024-05-08T18:30:58.301520+0000","last_became_peered":"2024-05-08T18:30:58.301520+0000","last_unstale":"2024-05-08T18:31:45.329734+0000","last_undegraded":"2024-05-08T18:31:45.329734+0000","last_fullsized":"2024-05-08T18:31:45.329734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:46.459524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328015+0000","last_change":"2024-05-08T18:31:02.293828+0000","last_active":"2024-05-08T18:31:45.328015+0000","last_peered":"2024-05-08T18:31:45.328015+0000","last_clean":"2024-05-08T18:31:45.328015+0000","last_became_active":"2024-05-08T18:31:02.293459+0000","last_became_peered":"2024-05-08T18:31:02.293459+0000","last_unstale":"2024-05-08T18:31:45.328015+0000","last_undegraded":"2024-05-08T18:31:45.328015+0000","last_fullsized":"2024-05-08T18:31:45.328015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:45.110612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.598503+0000","last_change":"2024-05-08T18:31:04.298674+0000","last_active":"2024-05-08T18:34:06.598503+0000","last_peered":"2024-05-08T18:34:06.598503+0000","last_clean":"2024-05-08T18:34:06.598503+0000","last_became_active":"2024-05-08T18:31:04.298237+0000","last_became_peered":"2024-05-08T18:31:04.298237+0000","last_unstale":"2024-05-08T18:34:06.598503+0000","last_undegraded":"2024-05-08T18:34:06.598503+0000","last_fullsized":"2024-05-08T18:34:06.598503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:57.297845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329847+0000","last_change":"2024-05-08T18:31:06.307437+0000","last_active":"2024-05-08T18:31:45.329847+0000","last_peered":"2024-05-08T18:31:45.329847+0000","last_clean":"2024-05-08T18:31:45.329847+0000","last_became_active":"2024-05-08T18:31:06.307048+0000","last_became_peered":"2024-05-08T18:31:06.307048+0000","last_unstale":"2024-05-08T18:31:45.329847+0000","last_undegraded":"2024-05-08T18:31:45.329847+0000","last_fullsized":"2024-05-08T18:31:45.329847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:21:52.918678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329757+0000","last_change":"2024-05-08T18:31:08.314432+0000","last_active":"2024-05-08T18:31:45.329757+0000","last_peered":"2024-05-08T18:31:45.329757+0000","last_clean":"2024-05-08T18:31:45.329757+0000","last_became_active":"2024-05-08T18:31:08.313943+0000","last_became_peered":"2024-05-08T18:31:08.313943+0000","last_unstale":"2024-05-08T18:31:45.329757+0000","last_undegraded":"2024-05-08T18:31:45.329757+0000","last_fullsized":"2024-05-08T18:31:45.329757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:40.327081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271781+0000","last_change":"2024-05-08T18:31:00.286107+0000","last_active":"2024-05-08T18:34:07.271781+0000","last_peered":"2024-05-08T18:34:07.271781+0000","last_clean":"2024-05-08T18:34:07.271781+0000","last_became_active":"2024-05-08T18:31:00.285842+0000","last_became_peered":"2024-05-08T18:31:00.285842+0000","last_unstale":"2024-05-08T18:34:07.271781+0000","last_undegraded":"2024-05-08T18:34:07.271781+0000","last_fullsized":"2024-05-08T18:34:07.271781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:19.399639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336683+0000","last_change":"2024-05-08T18:30:58.303703+0000","last_active":"2024-05-08T18:31:45.336683+0000","last_peered":"2024-05-08T18:31:45.336683+0000","last_clean":"2024-05-08T18:31:45.336683+0000","last_became_active":"2024-05-08T18:30:58.303112+0000","last_became_peered":"2024-05-08T18:30:58.303112+0000","last_unstale":"2024-05-08T18:31:45.336683+0000","last_undegraded":"2024-05-08T18:31:45.336683+0000","last_fullsized":"2024-05-08T18:31:45.336683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:25.031288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331560+0000","last_change":"2024-05-08T18:31:02.295088+0000","last_active":"2024-05-08T18:31:45.331560+0000","last_peered":"2024-05-08T18:31:45.331560+0000","last_clean":"2024-05-08T18:31:45.331560+0000","last_became_active":"2024-05-08T18:31:02.294812+0000","last_became_peered":"2024-05-08T18:31:02.294812+0000","last_unstale":"2024-05-08T18:31:45.331560+0000","last_undegraded":"2024-05-08T18:31:45.331560+0000","last_fullsized":"2024-05-08T18:31:45.331560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:59.466223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'40","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.660807+0000","last_change":"2024-05-08T18:31:04.302309+0000","last_active":"2024-05-08T18:34:06.660807+0000","last_peered":"2024-05-08T18:34:06.660807+0000","last_clean":"2024-05-08T18:34:06.660807+0000","last_became_active":"2024-05-08T18:31:04.301969+0000","last_became_peered":"2024-05-08T18:31:04.301969+0000","last_unstale":"2024-05-08T18:34:06.660807+0000","last_undegraded":"2024-05-08T18:34:06.660807+0000","last_fullsized":"2024-05-08T18:34:06.660807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:14.097510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334470+0000","last_change":"2024-05-08T18:31:06.306660+0000","last_active":"2024-05-08T18:31:45.334470+0000","last_peered":"2024-05-08T18:31:45.334470+0000","last_clean":"2024-05-08T18:31:45.334470+0000","last_became_active":"2024-05-08T18:31:06.306346+0000","last_became_peered":"2024-05-08T18:31:06.306346+0000","last_unstale":"2024-05-08T18:31:45.334470+0000","last_undegraded":"2024-05-08T18:31:45.334470+0000","last_fullsized":"2024-05-08T18:31:45.334470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:47:23.413504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328038+0000","last_change":"2024-05-08T18:31:08.317029+0000","last_active":"2024-05-08T18:31:45.328038+0000","last_peered":"2024-05-08T18:31:45.328038+0000","last_clean":"2024-05-08T18:31:45.328038+0000","last_became_active":"2024-05-08T18:31:08.316673+0000","last_became_peered":"2024-05-08T18:31:08.316673+0000","last_unstale":"2024-05-08T18:31:45.328038+0000","last_undegraded":"2024-05-08T18:31:45.328038+0000","last_fullsized":"2024-05-08T18:31:45.328038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:47.053479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327883+0000","last_change":"2024-05-08T18:31:00.291577+0000","last_active":"2024-05-08T18:31:45.327883+0000","last_peered":"2024-05-08T18:31:45.327883+0000","last_clean":"2024-05-08T18:31:45.327883+0000","last_became_active":"2024-05-08T18:31:00.291163+0000","last_became_peered":"2024-05-08T18:31:00.291163+0000","last_unstale":"2024-05-08T18:31:45.327883+0000","last_undegraded":"2024-05-08T18:31:45.327883+0000","last_fullsized":"2024-05-08T18:31:45.327883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:38.677165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.323955+0000","last_change":"2024-05-08T18:30:58.305036+0000","last_active":"2024-05-08T18:33:03.323955+0000","last_peered":"2024-05-08T18:33:03.323955+0000","last_clean":"2024-05-08T18:33:03.323955+0000","last_became_active":"2024-05-08T18:30:58.304135+0000","last_became_peered":"2024-05-08T18:30:58.304135+0000","last_unstale":"2024-05-08T18:33:03.323955+0000","last_undegraded":"2024-05-08T18:33:03.323955+0000","last_fullsized":"2024-05-08T18:33:03.323955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:26.528845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327635+0000","last_change":"2024-05-08T18:31:02.290480+0000","last_active":"2024-05-08T18:31:45.327635+0000","last_peered":"2024-05-08T18:31:45.327635+0000","last_clean":"2024-05-08T18:31:45.327635+0000","last_became_active":"2024-05-08T18:31:02.290191+0000","last_became_peered":"2024-05-08T18:31:02.290191+0000","last_unstale":"2024-05-08T18:31:45.327635+0000","last_undegraded":"2024-05-08T18:31:45.327635+0000","last_fullsized":"2024-05-08T18:31:45.327635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:53.106616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.071221+0000","last_change":"2024-05-08T18:31:04.295526+0000","last_active":"2024-05-08T18:33:05.071221+0000","last_peered":"2024-05-08T18:33:05.071221+0000","last_clean":"2024-05-08T18:33:05.071221+0000","last_became_active":"2024-05-08T18:31:04.295255+0000","last_became_peered":"2024-05-08T18:31:04.295255+0000","last_unstale":"2024-05-08T18:33:05.071221+0000","last_undegraded":"2024-05-08T18:33:05.071221+0000","last_fullsized":"2024-05-08T18:33:05.071221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:47.180901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330989+0000","last_change":"2024-05-08T18:31:06.305114+0000","last_active":"2024-05-08T18:31:45.330989+0000","last_peered":"2024-05-08T18:31:45.330989+0000","last_clean":"2024-05-08T18:31:45.330989+0000","last_became_active":"2024-05-08T18:31:06.304851+0000","last_became_peered":"2024-05-08T18:31:06.304851+0000","last_unstale":"2024-05-08T18:31:45.330989+0000","last_undegraded":"2024-05-08T18:31:45.330989+0000","last_fullsized":"2024-05-08T18:31:45.330989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:36.598673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'8","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.580774+0000","last_change":"2024-05-08T18:31:45.343090+0000","last_active":"2024-05-08T18:33:06.580774+0000","last_peered":"2024-05-08T18:33:06.580774+0000","last_clean":"2024-05-08T18:33:06.580774+0000","last_became_active":"2024-05-08T18:31:45.336717+0000","last_became_peered":"2024-05-08T18:31:45.336717+0000","last_unstale":"2024-05-08T18:33:06.580774+0000","last_undegraded":"2024-05-08T18:33:06.580774+0000","last_fullsized":"2024-05-08T18:33:06.580774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:06.350550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327536+0000","last_change":"2024-05-08T18:30:58.303784+0000","last_active":"2024-05-08T18:31:45.327536+0000","last_peered":"2024-05-08T18:31:45.327536+0000","last_clean":"2024-05-08T18:31:45.327536+0000","last_became_active":"2024-05-08T18:30:58.302486+0000","last_became_peered":"2024-05-08T18:30:58.302486+0000","last_unstale":"2024-05-08T18:31:45.327536+0000","last_undegraded":"2024-05-08T18:31:45.327536+0000","last_fullsized":"2024-05-08T18:31:45.327536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:19.905174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330661+0000","last_change":"2024-05-08T18:31:02.292304+0000","last_active":"2024-05-08T18:31:45.330661+0000","last_peered":"2024-05-08T18:31:45.330661+0000","last_clean":"2024-05-08T18:31:45.330661+0000","last_became_active":"2024-05-08T18:31:02.291965+0000","last_became_peered":"2024-05-08T18:31:02.291965+0000","last_unstale":"2024-05-08T18:31:45.330661+0000","last_undegraded":"2024-05-08T18:31:45.330661+0000","last_fullsized":"2024-05-08T18:31:45.330661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:45.173868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.092410+0000","last_change":"2024-05-08T18:31:04.298401+0000","last_active":"2024-05-08T18:33:05.092410+0000","last_peered":"2024-05-08T18:33:05.092410+0000","last_clean":"2024-05-08T18:33:05.092410+0000","last_became_active":"2024-05-08T18:31:04.298061+0000","last_became_peered":"2024-05-08T18:31:04.298061+0000","last_unstale":"2024-05-08T18:33:05.092410+0000","last_undegraded":"2024-05-08T18:33:05.092410+0000","last_fullsized":"2024-05-08T18:33:05.092410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:36.394225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329659+0000","last_change":"2024-05-08T18:31:06.308566+0000","last_active":"2024-05-08T18:31:45.329659+0000","last_peered":"2024-05-08T18:31:45.329659+0000","last_clean":"2024-05-08T18:31:45.329659+0000","last_became_active":"2024-05-08T18:31:06.308247+0000","last_became_peered":"2024-05-08T18:31:06.308247+0000","last_unstale":"2024-05-08T18:31:45.329659+0000","last_undegraded":"2024-05-08T18:31:45.329659+0000","last_fullsized":"2024-05-08T18:31:45.329659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:43.989468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.059608+0000","last_change":"2024-05-08T18:31:08.314319+0000","last_active":"2024-05-08T18:34:07.059608+0000","last_peered":"2024-05-08T18:34:07.059608+0000","last_clean":"2024-05-08T18:34:07.059608+0000","last_became_active":"2024-05-08T18:31:08.313986+0000","last_became_peered":"2024-05-08T18:31:08.313986+0000","last_unstale":"2024-05-08T18:34:07.059608+0000","last_undegraded":"2024-05-08T18:34:07.059608+0000","last_fullsized":"2024-05-08T18:34:07.059608+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:34.156497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.240343+0000","last_change":"2024-05-08T18:31:00.281726+0000","last_active":"2024-05-08T18:34:07.240343+0000","last_peered":"2024-05-08T18:34:07.240343+0000","last_clean":"2024-05-08T18:34:07.240343+0000","last_became_active":"2024-05-08T18:31:00.281233+0000","last_became_peered":"2024-05-08T18:31:00.281233+0000","last_unstale":"2024-05-08T18:34:07.240343+0000","last_undegraded":"2024-05-08T18:34:07.240343+0000","last_fullsized":"2024-05-08T18:34:07.240343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:16:11.480889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334233+0000","last_change":"2024-05-08T18:30:58.290021+0000","last_active":"2024-05-08T18:31:45.334233+0000","last_peered":"2024-05-08T18:31:45.334233+0000","last_clean":"2024-05-08T18:31:45.334233+0000","last_became_active":"2024-05-08T18:30:58.289251+0000","last_became_peered":"2024-05-08T18:30:58.289251+0000","last_unstale":"2024-05-08T18:31:45.334233+0000","last_undegraded":"2024-05-08T18:31:45.334233+0000","last_fullsized":"2024-05-08T18:31:45.334233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:33.046479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332268+0000","last_change":"2024-05-08T18:31:02.293460+0000","last_active":"2024-05-08T18:31:45.332268+0000","last_peered":"2024-05-08T18:31:45.332268+0000","last_clean":"2024-05-08T18:31:45.332268+0000","last_became_active":"2024-05-08T18:31:02.293185+0000","last_became_peered":"2024-05-08T18:31:02.293185+0000","last_unstale":"2024-05-08T18:31:45.332268+0000","last_undegraded":"2024-05-08T18:31:45.332268+0000","last_fullsized":"2024-05-08T18:31:45.332268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:43.800799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.072164+0000","last_change":"2024-05-08T18:31:04.298821+0000","last_active":"2024-05-08T18:33:05.072164+0000","last_peered":"2024-05-08T18:33:05.072164+0000","last_clean":"2024-05-08T18:33:05.072164+0000","last_became_active":"2024-05-08T18:31:04.298482+0000","last_became_peered":"2024-05-08T18:31:04.298482+0000","last_unstale":"2024-05-08T18:33:05.072164+0000","last_undegraded":"2024-05-08T18:33:05.072164+0000","last_fullsized":"2024-05-08T18:33:05.072164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:16.451277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336190+0000","last_change":"2024-05-08T18:31:06.311670+0000","last_active":"2024-05-08T18:31:45.336190+0000","last_peered":"2024-05-08T18:31:45.336190+0000","last_clean":"2024-05-08T18:31:45.336190+0000","last_became_active":"2024-05-08T18:31:06.311392+0000","last_became_peered":"2024-05-08T18:31:06.311392+0000","last_unstale":"2024-05-08T18:31:45.336190+0000","last_undegraded":"2024-05-08T18:31:45.336190+0000","last_fullsized":"2024-05-08T18:31:45.336190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:17.968800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327375+0000","last_change":"2024-05-08T18:31:08.319678+0000","last_active":"2024-05-08T18:31:45.327375+0000","last_peered":"2024-05-08T18:31:45.327375+0000","last_clean":"2024-05-08T18:31:45.327375+0000","last_became_active":"2024-05-08T18:31:08.319394+0000","last_became_peered":"2024-05-08T18:31:08.319394+0000","last_unstale":"2024-05-08T18:31:45.327375+0000","last_undegraded":"2024-05-08T18:31:45.327375+0000","last_fullsized":"2024-05-08T18:31:45.327375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:16.822143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'18","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271649+0000","last_change":"2024-05-08T18:31:00.300170+0000","last_active":"2024-05-08T18:34:07.271649+0000","last_peered":"2024-05-08T18:34:07.271649+0000","last_clean":"2024-05-08T18:34:07.271649+0000","last_became_active":"2024-05-08T18:31:00.299547+0000","last_became_peered":"2024-05-08T18:31:00.299547+0000","last_unstale":"2024-05-08T18:34:07.271649+0000","last_undegraded":"2024-05-08T18:34:07.271649+0000","last_fullsized":"2024-05-08T18:34:07.271649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:21.996058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334865+0000","last_change":"2024-05-08T18:30:58.305155+0000","last_active":"2024-05-08T18:31:45.334865+0000","last_peered":"2024-05-08T18:31:45.334865+0000","last_clean":"2024-05-08T18:31:45.334865+0000","last_became_active":"2024-05-08T18:30:58.303624+0000","last_became_peered":"2024-05-08T18:30:58.303624+0000","last_unstale":"2024-05-08T18:31:45.334865+0000","last_undegraded":"2024-05-08T18:31:45.334865+0000","last_fullsized":"2024-05-08T18:31:45.334865+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:04.148371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.331693+0000","last_change":"2024-05-08T18:31:02.292792+0000","last_active":"2024-05-08T18:31:45.331693+0000","last_peered":"2024-05-08T18:31:45.331693+0000","last_clean":"2024-05-08T18:31:45.331693+0000","last_became_active":"2024-05-08T18:31:02.292498+0000","last_became_peered":"2024-05-08T18:31:02.292498+0000","last_unstale":"2024-05-08T18:31:45.331693+0000","last_undegraded":"2024-05-08T18:31:45.331693+0000","last_fullsized":"2024-05-08T18:31:45.331693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:45.114148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.090360+0000","last_change":"2024-05-08T18:31:04.297701+0000","last_active":"2024-05-08T18:33:05.090360+0000","last_peered":"2024-05-08T18:33:05.090360+0000","last_clean":"2024-05-08T18:33:05.090360+0000","last_became_active":"2024-05-08T18:31:04.297297+0000","last_became_peered":"2024-05-08T18:31:04.297297+0000","last_unstale":"2024-05-08T18:33:05.090360+0000","last_undegraded":"2024-05-08T18:33:05.090360+0000","last_fullsized":"2024-05-08T18:33:05.090360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:01.274241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330477+0000","last_change":"2024-05-08T18:31:06.305923+0000","last_active":"2024-05-08T18:31:45.330477+0000","last_peered":"2024-05-08T18:31:45.330477+0000","last_clean":"2024-05-08T18:31:45.330477+0000","last_became_active":"2024-05-08T18:31:06.305567+0000","last_became_peered":"2024-05-08T18:31:06.305567+0000","last_unstale":"2024-05-08T18:31:45.330477+0000","last_undegraded":"2024-05-08T18:31:45.330477+0000","last_fullsized":"2024-05-08T18:31:45.330477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:20.352238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'11","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.682210+0000","last_change":"2024-05-08T18:31:08.317380+0000","last_active":"2024-05-08T18:34:06.682210+0000","last_peered":"2024-05-08T18:34:06.682210+0000","last_clean":"2024-05-08T18:34:06.682210+0000","last_became_active":"2024-05-08T18:31:08.316943+0000","last_became_peered":"2024-05-08T18:31:08.316943+0000","last_unstale":"2024-05-08T18:34:06.682210+0000","last_undegraded":"2024-05-08T18:34:06.682210+0000","last_fullsized":"2024-05-08T18:34:06.682210+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:54.462045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'5","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.280149+0000","last_change":"2024-05-08T18:31:00.283641+0000","last_active":"2024-05-08T18:34:07.280149+0000","last_peered":"2024-05-08T18:34:07.280149+0000","last_clean":"2024-05-08T18:34:07.280149+0000","last_became_active":"2024-05-08T18:31:00.282923+0000","last_became_peered":"2024-05-08T18:31:00.282923+0000","last_unstale":"2024-05-08T18:34:07.280149+0000","last_undegraded":"2024-05-08T18:34:07.280149+0000","last_fullsized":"2024-05-08T18:34:07.280149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:09.586689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328361+0000","last_change":"2024-05-08T18:30:58.318535+0000","last_active":"2024-05-08T18:31:45.328361+0000","last_peered":"2024-05-08T18:31:45.328361+0000","last_clean":"2024-05-08T18:31:45.328361+0000","last_became_active":"2024-05-08T18:30:58.316980+0000","last_became_peered":"2024-05-08T18:30:58.316980+0000","last_unstale":"2024-05-08T18:31:45.328361+0000","last_undegraded":"2024-05-08T18:31:45.328361+0000","last_fullsized":"2024-05-08T18:31:45.328361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:22:52.128630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336413+0000","last_change":"2024-05-08T18:31:02.288494+0000","last_active":"2024-05-08T18:31:45.336413+0000","last_peered":"2024-05-08T18:31:45.336413+0000","last_clean":"2024-05-08T18:31:45.336413+0000","last_became_active":"2024-05-08T18:31:02.288127+0000","last_became_peered":"2024-05-08T18:31:02.288127+0000","last_unstale":"2024-05-08T18:31:45.336413+0000","last_undegraded":"2024-05-08T18:31:45.336413+0000","last_fullsized":"2024-05-08T18:31:45.336413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:58.208003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333068+0000","last_change":"2024-05-08T18:31:04.302369+0000","last_active":"2024-05-08T18:31:45.333068+0000","last_peered":"2024-05-08T18:31:45.333068+0000","last_clean":"2024-05-08T18:31:45.333068+0000","last_became_active":"2024-05-08T18:31:04.302034+0000","last_became_peered":"2024-05-08T18:31:04.302034+0000","last_unstale":"2024-05-08T18:31:45.333068+0000","last_undegraded":"2024-05-08T18:31:45.333068+0000","last_fullsized":"2024-05-08T18:31:45.333068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:50:40.916183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'282","reported_seq":406,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.370201+0000","last_change":"2024-05-08T18:31:06.311326+0000","last_active":"2024-05-08T18:34:07.370201+0000","last_peered":"2024-05-08T18:34:07.370201+0000","last_clean":"2024-05-08T18:34:07.370201+0000","last_became_active":"2024-05-08T18:31:06.311063+0000","last_became_peered":"2024-05-08T18:31:06.311063+0000","last_unstale":"2024-05-08T18:34:07.370201+0000","last_undegraded":"2024-05-08T18:34:07.370201+0000","last_fullsized":"2024-05-08T18:34:07.370201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:46.356134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327053+0000","last_change":"2024-05-08T18:31:08.320650+0000","last_active":"2024-05-08T18:31:45.327053+0000","last_peered":"2024-05-08T18:31:45.327053+0000","last_clean":"2024-05-08T18:31:45.327053+0000","last_became_active":"2024-05-08T18:31:08.320260+0000","last_became_peered":"2024-05-08T18:31:08.320260+0000","last_unstale":"2024-05-08T18:31:45.327053+0000","last_undegraded":"2024-05-08T18:31:45.327053+0000","last_fullsized":"2024-05-08T18:31:45.327053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:03.499843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.580949+0000","last_change":"2024-05-08T18:31:00.285978+0000","last_active":"2024-05-08T18:33:06.580949+0000","last_peered":"2024-05-08T18:33:06.580949+0000","last_clean":"2024-05-08T18:33:06.580949+0000","last_became_active":"2024-05-08T18:31:00.284982+0000","last_became_peered":"2024-05-08T18:31:00.284982+0000","last_unstale":"2024-05-08T18:33:06.580949+0000","last_undegraded":"2024-05-08T18:33:06.580949+0000","last_fullsized":"2024-05-08T18:33:06.580949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:19.399639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.338145+0000","last_change":"2024-05-08T18:30:58.306355+0000","last_active":"2024-05-08T18:31:45.338145+0000","last_peered":"2024-05-08T18:31:45.338145+0000","last_clean":"2024-05-08T18:31:45.338145+0000","last_became_active":"2024-05-08T18:30:58.304969+0000","last_became_peered":"2024-05-08T18:30:58.304969+0000","last_unstale":"2024-05-08T18:31:45.338145+0000","last_undegraded":"2024-05-08T18:31:45.338145+0000","last_fullsized":"2024-05-08T18:31:45.338145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:07.501461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334669+0000","last_change":"2024-05-08T18:31:02.289211+0000","last_active":"2024-05-08T18:31:45.334669+0000","last_peered":"2024-05-08T18:31:45.334669+0000","last_clean":"2024-05-08T18:31:45.334669+0000","last_became_active":"2024-05-08T18:31:02.288719+0000","last_became_peered":"2024-05-08T18:31:02.288719+0000","last_unstale":"2024-05-08T18:31:45.334669+0000","last_undegraded":"2024-05-08T18:31:45.334669+0000","last_fullsized":"2024-05-08T18:31:45.334669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:42.419001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'37","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.062940+0000","last_change":"2024-05-08T18:31:04.299750+0000","last_active":"2024-05-08T18:33:05.062940+0000","last_peered":"2024-05-08T18:33:05.062940+0000","last_clean":"2024-05-08T18:33:05.062940+0000","last_became_active":"2024-05-08T18:31:04.297013+0000","last_became_peered":"2024-05-08T18:31:04.297013+0000","last_unstale":"2024-05-08T18:33:05.062940+0000","last_undegraded":"2024-05-08T18:33:05.062940+0000","last_fullsized":"2024-05-08T18:33:05.062940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:34.756044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328787+0000","last_change":"2024-05-08T18:31:06.312037+0000","last_active":"2024-05-08T18:31:45.328787+0000","last_peered":"2024-05-08T18:31:45.328787+0000","last_clean":"2024-05-08T18:31:45.328787+0000","last_became_active":"2024-05-08T18:31:06.311767+0000","last_became_peered":"2024-05-08T18:31:06.311767+0000","last_unstale":"2024-05-08T18:31:45.328787+0000","last_undegraded":"2024-05-08T18:31:45.328787+0000","last_fullsized":"2024-05-08T18:31:45.328787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:32.310721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.985534+0000","last_change":"2024-05-08T18:31:08.313489+0000","last_active":"2024-05-08T18:34:06.985534+0000","last_peered":"2024-05-08T18:34:06.985534+0000","last_clean":"2024-05-08T18:34:06.985534+0000","last_became_active":"2024-05-08T18:31:08.312031+0000","last_became_peered":"2024-05-08T18:31:08.312031+0000","last_unstale":"2024-05-08T18:34:06.985534+0000","last_undegraded":"2024-05-08T18:34:06.985534+0000","last_fullsized":"2024-05-08T18:34:06.985534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:40.327081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.681165+0000","last_change":"2024-05-08T18:31:00.282870+0000","last_active":"2024-05-08T18:32:22.681165+0000","last_peered":"2024-05-08T18:32:22.681165+0000","last_clean":"2024-05-08T18:32:22.681165+0000","last_became_active":"2024-05-08T18:31:00.282605+0000","last_became_peered":"2024-05-08T18:31:00.282605+0000","last_unstale":"2024-05-08T18:32:22.681165+0000","last_undegraded":"2024-05-08T18:32:22.681165+0000","last_fullsized":"2024-05-08T18:32:22.681165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:30.009947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330348+0000","last_change":"2024-05-08T18:30:58.316801+0000","last_active":"2024-05-08T18:31:45.330348+0000","last_peered":"2024-05-08T18:31:45.330348+0000","last_clean":"2024-05-08T18:31:45.330348+0000","last_became_active":"2024-05-08T18:30:58.316166+0000","last_became_peered":"2024-05-08T18:30:58.316166+0000","last_unstale":"2024-05-08T18:31:45.330348+0000","last_undegraded":"2024-05-08T18:31:45.330348+0000","last_fullsized":"2024-05-08T18:31:45.330348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:24.440258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.334438+0000","last_change":"2024-05-08T18:31:02.294645+0000","last_active":"2024-05-08T18:31:45.334438+0000","last_peered":"2024-05-08T18:31:45.334438+0000","last_clean":"2024-05-08T18:31:45.334438+0000","last_became_active":"2024-05-08T18:31:02.294335+0000","last_became_peered":"2024-05-08T18:31:02.294335+0000","last_unstale":"2024-05-08T18:31:45.334438+0000","last_undegraded":"2024-05-08T18:31:45.334438+0000","last_fullsized":"2024-05-08T18:31:45.334438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:40:41.976982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.063967+0000","last_change":"2024-05-08T18:31:04.297821+0000","last_active":"2024-05-08T18:33:05.063967+0000","last_peered":"2024-05-08T18:33:05.063967+0000","last_clean":"2024-05-08T18:33:05.063967+0000","last_became_active":"2024-05-08T18:31:04.297440+0000","last_became_peered":"2024-05-08T18:31:04.297440+0000","last_unstale":"2024-05-08T18:33:05.063967+0000","last_undegraded":"2024-05-08T18:33:05.063967+0000","last_fullsized":"2024-05-08T18:33:05.063967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:14.624732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327191+0000","last_change":"2024-05-08T18:31:06.312504+0000","last_active":"2024-05-08T18:31:45.327191+0000","last_peered":"2024-05-08T18:31:45.327191+0000","last_clean":"2024-05-08T18:31:45.327191+0000","last_became_active":"2024-05-08T18:31:06.312162+0000","last_became_peered":"2024-05-08T18:31:06.312162+0000","last_unstale":"2024-05-08T18:31:45.327191+0000","last_undegraded":"2024-05-08T18:31:45.327191+0000","last_fullsized":"2024-05-08T18:31:45.327191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:25.211733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.331019+0000","last_change":"2024-05-08T18:31:08.318309+0000","last_active":"2024-05-08T18:33:03.331019+0000","last_peered":"2024-05-08T18:33:03.331019+0000","last_clean":"2024-05-08T18:33:03.331019+0000","last_became_active":"2024-05-08T18:31:08.318072+0000","last_became_peered":"2024-05-08T18:31:08.318072+0000","last_unstale":"2024-05-08T18:33:03.331019+0000","last_undegraded":"2024-05-08T18:33:03.331019+0000","last_fullsized":"2024-05-08T18:33:03.331019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:36:18.141092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'4","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.247651+0000","last_change":"2024-05-08T18:31:00.292044+0000","last_active":"2024-05-08T18:34:07.247651+0000","last_peered":"2024-05-08T18:34:07.247651+0000","last_clean":"2024-05-08T18:34:07.247651+0000","last_became_active":"2024-05-08T18:31:00.291128+0000","last_became_peered":"2024-05-08T18:31:00.291128+0000","last_unstale":"2024-05-08T18:34:07.247651+0000","last_undegraded":"2024-05-08T18:34:07.247651+0000","last_fullsized":"2024-05-08T18:34:07.247651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:28.671220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330831+0000","last_change":"2024-05-08T18:30:58.285590+0000","last_active":"2024-05-08T18:31:45.330831+0000","last_peered":"2024-05-08T18:31:45.330831+0000","last_clean":"2024-05-08T18:31:45.330831+0000","last_became_active":"2024-05-08T18:30:58.283402+0000","last_became_peered":"2024-05-08T18:30:58.283402+0000","last_unstale":"2024-05-08T18:31:45.330831+0000","last_undegraded":"2024-05-08T18:31:45.330831+0000","last_fullsized":"2024-05-08T18:31:45.330831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:43.233516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336457+0000","last_change":"2024-05-08T18:31:02.292679+0000","last_active":"2024-05-08T18:31:45.336457+0000","last_peered":"2024-05-08T18:31:45.336457+0000","last_clean":"2024-05-08T18:31:45.336457+0000","last_became_active":"2024-05-08T18:31:02.291363+0000","last_became_peered":"2024-05-08T18:31:02.291363+0000","last_unstale":"2024-05-08T18:31:45.336457+0000","last_undegraded":"2024-05-08T18:31:45.336457+0000","last_fullsized":"2024-05-08T18:31:45.336457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:40.683748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'29","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.088039+0000","last_change":"2024-05-08T18:31:04.298937+0000","last_active":"2024-05-08T18:33:05.088039+0000","last_peered":"2024-05-08T18:33:05.088039+0000","last_clean":"2024-05-08T18:33:05.088039+0000","last_became_active":"2024-05-08T18:31:04.298601+0000","last_became_peered":"2024-05-08T18:31:04.298601+0000","last_unstale":"2024-05-08T18:33:05.088039+0000","last_undegraded":"2024-05-08T18:33:05.088039+0000","last_fullsized":"2024-05-08T18:33:05.088039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:52.647996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":40,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.327562+0000","last_change":"2024-05-08T18:31:06.308361+0000","last_active":"2024-05-08T18:31:45.327562+0000","last_peered":"2024-05-08T18:31:45.327562+0000","last_clean":"2024-05-08T18:31:45.327562+0000","last_became_active":"2024-05-08T18:31:06.307801+0000","last_became_peered":"2024-05-08T18:31:06.307801+0000","last_unstale":"2024-05-08T18:31:45.327562+0000","last_undegraded":"2024-05-08T18:31:45.327562+0000","last_fullsized":"2024-05-08T18:31:45.327562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:23.188589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.098741+0000","last_change":"2024-05-08T18:31:08.319580+0000","last_active":"2024-05-08T18:33:05.098741+0000","last_peered":"2024-05-08T18:33:05.098741+0000","last_clean":"2024-05-08T18:33:05.098741+0000","last_became_active":"2024-05-08T18:31:08.319232+0000","last_became_peered":"2024-05-08T18:31:08.319232+0000","last_unstale":"2024-05-08T18:33:05.098741+0000","last_undegraded":"2024-05-08T18:33:05.098741+0000","last_fullsized":"2024-05-08T18:33:05.098741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:04.750785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.271785+0000","last_change":"2024-05-08T18:31:00.283026+0000","last_active":"2024-05-08T18:34:07.271785+0000","last_peered":"2024-05-08T18:34:07.271785+0000","last_clean":"2024-05-08T18:34:07.271785+0000","last_became_active":"2024-05-08T18:31:00.282644+0000","last_became_peered":"2024-05-08T18:31:00.282644+0000","last_unstale":"2024-05-08T18:34:07.271785+0000","last_undegraded":"2024-05-08T18:34:07.271785+0000","last_fullsized":"2024-05-08T18:34:07.271785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:26.448180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.944420+0000","last_change":"2024-05-08T18:30:58.304661+0000","last_active":"2024-05-08T18:34:06.944420+0000","last_peered":"2024-05-08T18:34:06.944420+0000","last_clean":"2024-05-08T18:34:06.944420+0000","last_became_active":"2024-05-08T18:30:58.303312+0000","last_became_peered":"2024-05-08T18:30:58.303312+0000","last_unstale":"2024-05-08T18:34:06.944420+0000","last_undegraded":"2024-05-08T18:34:06.944420+0000","last_fullsized":"2024-05-08T18:34:06.944420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:46.459524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'6","reported_seq":228,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.172197+0000","last_change":"2024-05-08T18:31:02.288759+0000","last_active":"2024-05-08T18:33:06.172197+0000","last_peered":"2024-05-08T18:33:06.172197+0000","last_clean":"2024-05-08T18:33:06.172197+0000","last_became_active":"2024-05-08T18:31:02.288433+0000","last_became_peered":"2024-05-08T18:31:02.288433+0000","last_unstale":"2024-05-08T18:33:06.172197+0000","last_undegraded":"2024-05-08T18:33:06.172197+0000","last_fullsized":"2024-05-08T18:33:06.172197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:35.557614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'32","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.599172+0000","last_change":"2024-05-08T18:31:04.299253+0000","last_active":"2024-05-08T18:34:06.599172+0000","last_peered":"2024-05-08T18:34:06.599172+0000","last_clean":"2024-05-08T18:34:06.599172+0000","last_became_active":"2024-05-08T18:31:04.298089+0000","last_became_peered":"2024-05-08T18:31:04.298089+0000","last_unstale":"2024-05-08T18:34:06.599172+0000","last_undegraded":"2024-05-08T18:34:06.599172+0000","last_fullsized":"2024-05-08T18:34:06.599172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:34.386559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329003+0000","last_change":"2024-05-08T18:31:06.312121+0000","last_active":"2024-05-08T18:31:45.329003+0000","last_peered":"2024-05-08T18:31:45.329003+0000","last_clean":"2024-05-08T18:31:45.329003+0000","last_became_active":"2024-05-08T18:31:06.311810+0000","last_became_peered":"2024-05-08T18:31:06.311810+0000","last_unstale":"2024-05-08T18:31:45.329003+0000","last_undegraded":"2024-05-08T18:31:45.329003+0000","last_fullsized":"2024-05-08T18:31:45.329003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:01.719275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.101535+0000","last_change":"2024-05-08T18:31:08.317101+0000","last_active":"2024-05-08T18:33:05.101535+0000","last_peered":"2024-05-08T18:33:05.101535+0000","last_clean":"2024-05-08T18:33:05.101535+0000","last_became_active":"2024-05-08T18:31:08.316723+0000","last_became_peered":"2024-05-08T18:31:08.316723+0000","last_unstale":"2024-05-08T18:33:05.101535+0000","last_undegraded":"2024-05-08T18:33:05.101535+0000","last_fullsized":"2024-05-08T18:33:05.101535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:49.236295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.346732+0000","last_change":"2024-05-08T18:31:45.346058+0000","last_active":"2024-05-08T18:31:45.346732+0000","last_peered":"2024-05-08T18:31:45.346732+0000","last_clean":"2024-05-08T18:31:45.346732+0000","last_became_active":"2024-05-08T18:31:45.339252+0000","last_became_peered":"2024-05-08T18:31:45.339252+0000","last_unstale":"2024-05-08T18:31:45.346732+0000","last_undegraded":"2024-05-08T18:31:45.346732+0000","last_fullsized":"2024-05-08T18:31:45.346732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:50:36.902568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176307+0000","last_change":"2024-05-08T18:30:58.308668+0000","last_active":"2024-05-08T18:33:03.176307+0000","last_peered":"2024-05-08T18:33:03.176307+0000","last_clean":"2024-05-08T18:33:03.176307+0000","last_became_active":"2024-05-08T18:30:58.308290+0000","last_became_peered":"2024-05-08T18:30:58.308290+0000","last_unstale":"2024-05-08T18:33:03.176307+0000","last_undegraded":"2024-05-08T18:33:03.176307+0000","last_fullsized":"2024-05-08T18:33:03.176307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:38.049573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.869487+0000","last_change":"2024-05-08T18:31:00.283309+0000","last_active":"2024-05-08T18:32:22.869487+0000","last_peered":"2024-05-08T18:32:22.869487+0000","last_clean":"2024-05-08T18:32:22.869487+0000","last_became_active":"2024-05-08T18:31:00.282889+0000","last_became_peered":"2024-05-08T18:31:00.282889+0000","last_unstale":"2024-05-08T18:32:22.869487+0000","last_undegraded":"2024-05-08T18:32:22.869487+0000","last_fullsized":"2024-05-08T18:32:22.869487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:30.686060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328796+0000","last_change":"2024-05-08T18:30:58.295262+0000","last_active":"2024-05-08T18:31:45.328796+0000","last_peered":"2024-05-08T18:31:45.328796+0000","last_clean":"2024-05-08T18:31:45.328796+0000","last_became_active":"2024-05-08T18:30:58.294210+0000","last_became_peered":"2024-05-08T18:30:58.294210+0000","last_unstale":"2024-05-08T18:31:45.328796+0000","last_undegraded":"2024-05-08T18:31:45.328796+0000","last_fullsized":"2024-05-08T18:31:45.328796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:11.650120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196723+0000","last_change":"2024-05-08T18:31:00.298041+0000","last_active":"2024-05-08T18:34:07.196723+0000","last_peered":"2024-05-08T18:34:07.196723+0000","last_clean":"2024-05-08T18:34:07.196723+0000","last_became_active":"2024-05-08T18:31:00.295749+0000","last_became_peered":"2024-05-08T18:31:00.295749+0000","last_unstale":"2024-05-08T18:34:07.196723+0000","last_undegraded":"2024-05-08T18:34:07.196723+0000","last_fullsized":"2024-05-08T18:34:07.196723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:10.083894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'5","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.177037+0000","last_change":"2024-05-08T18:30:58.316506+0000","last_active":"2024-05-08T18:33:03.177037+0000","last_peered":"2024-05-08T18:33:03.177037+0000","last_clean":"2024-05-08T18:33:03.177037+0000","last_became_active":"2024-05-08T18:30:58.314786+0000","last_became_peered":"2024-05-08T18:30:58.314786+0000","last_unstale":"2024-05-08T18:33:03.177037+0000","last_undegraded":"2024-05-08T18:33:03.177037+0000","last_fullsized":"2024-05-08T18:33:03.177037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:18.913736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'11","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.283079+0000","last_change":"2024-05-08T18:31:00.283309+0000","last_active":"2024-05-08T18:34:07.283079+0000","last_peered":"2024-05-08T18:34:07.283079+0000","last_clean":"2024-05-08T18:34:07.283079+0000","last_became_active":"2024-05-08T18:31:00.282863+0000","last_became_peered":"2024-05-08T18:31:00.282863+0000","last_unstale":"2024-05-08T18:34:07.283079+0000","last_undegraded":"2024-05-08T18:34:07.283079+0000","last_fullsized":"2024-05-08T18:34:07.283079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:55.191334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'3","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.671656+0000","last_change":"2024-05-08T18:30:58.289717+0000","last_active":"2024-05-08T18:32:22.671656+0000","last_peered":"2024-05-08T18:32:22.671656+0000","last_clean":"2024-05-08T18:32:22.671656+0000","last_became_active":"2024-05-08T18:30:58.289337+0000","last_became_peered":"2024-05-08T18:30:58.289337+0000","last_unstale":"2024-05-08T18:32:22.671656+0000","last_undegraded":"2024-05-08T18:32:22.671656+0000","last_fullsized":"2024-05-08T18:32:22.671656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:38.049573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.581291+0000","last_change":"2024-05-08T18:31:00.291487+0000","last_active":"2024-05-08T18:33:06.581291+0000","last_peered":"2024-05-08T18:33:06.581291+0000","last_clean":"2024-05-08T18:33:06.581291+0000","last_became_active":"2024-05-08T18:31:00.291269+0000","last_became_peered":"2024-05-08T18:31:00.291269+0000","last_unstale":"2024-05-08T18:33:06.581291+0000","last_undegraded":"2024-05-08T18:33:06.581291+0000","last_fullsized":"2024-05-08T18:33:06.581291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:30.009947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330816+0000","last_change":"2024-05-08T18:30:58.285778+0000","last_active":"2024-05-08T18:31:45.330816+0000","last_peered":"2024-05-08T18:31:45.330816+0000","last_clean":"2024-05-08T18:31:45.330816+0000","last_became_active":"2024-05-08T18:30:58.283976+0000","last_became_peered":"2024-05-08T18:30:58.283976+0000","last_unstale":"2024-05-08T18:31:45.330816+0000","last_undegraded":"2024-05-08T18:31:45.330816+0000","last_fullsized":"2024-05-08T18:31:45.330816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:23:31.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.202924+0000","last_change":"2024-05-08T18:31:00.292666+0000","last_active":"2024-05-08T18:34:07.202924+0000","last_peered":"2024-05-08T18:34:07.202924+0000","last_clean":"2024-05-08T18:34:07.202924+0000","last_became_active":"2024-05-08T18:31:00.292385+0000","last_became_peered":"2024-05-08T18:31:00.292385+0000","last_unstale":"2024-05-08T18:34:07.202924+0000","last_undegraded":"2024-05-08T18:34:07.202924+0000","last_fullsized":"2024-05-08T18:34:07.202924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:36.076362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:22.860195+0000","last_change":"2024-05-08T18:30:58.304478+0000","last_active":"2024-05-08T18:32:22.860195+0000","last_peered":"2024-05-08T18:32:22.860195+0000","last_clean":"2024-05-08T18:32:22.860195+0000","last_became_active":"2024-05-08T18:30:58.303839+0000","last_became_peered":"2024-05-08T18:30:58.303839+0000","last_unstale":"2024-05-08T18:32:22.860195+0000","last_undegraded":"2024-05-08T18:32:22.860195+0000","last_fullsized":"2024-05-08T18:32:22.860195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:23:31.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'8","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.965732+0000","last_change":"2024-05-08T18:31:00.288783+0000","last_active":"2024-05-08T18:34:06.965732+0000","last_peered":"2024-05-08T18:34:06.965732+0000","last_clean":"2024-05-08T18:34:06.965732+0000","last_became_active":"2024-05-08T18:31:00.288202+0000","last_became_peered":"2024-05-08T18:31:00.288202+0000","last_unstale":"2024-05-08T18:34:06.965732+0000","last_undegraded":"2024-05-08T18:34:06.965732+0000","last_fullsized":"2024-05-08T18:34:06.965732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:54.772566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.336793+0000","last_change":"2024-05-08T18:30:58.305905+0000","last_active":"2024-05-08T18:31:45.336793+0000","last_peered":"2024-05-08T18:31:45.336793+0000","last_clean":"2024-05-08T18:31:45.336793+0000","last_became_active":"2024-05-08T18:30:58.305116+0000","last_became_peered":"2024-05-08T18:30:58.305116+0000","last_unstale":"2024-05-08T18:31:45.336793+0000","last_undegraded":"2024-05-08T18:31:45.336793+0000","last_fullsized":"2024-05-08T18:31:45.336793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:11.650120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.581054+0000","last_change":"2024-05-08T18:31:00.285833+0000","last_active":"2024-05-08T18:33:06.581054+0000","last_peered":"2024-05-08T18:33:06.581054+0000","last_clean":"2024-05-08T18:33:06.581054+0000","last_became_active":"2024-05-08T18:31:00.284439+0000","last_became_peered":"2024-05-08T18:31:00.284439+0000","last_unstale":"2024-05-08T18:33:06.581054+0000","last_undegraded":"2024-05-08T18:33:06.581054+0000","last_fullsized":"2024-05-08T18:33:06.581054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:21.913096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.265892+0000","last_change":"2024-05-08T18:30:58.287850+0000","last_active":"2024-05-08T18:34:07.265892+0000","last_peered":"2024-05-08T18:34:07.265892+0000","last_clean":"2024-05-08T18:34:07.265892+0000","last_became_active":"2024-05-08T18:30:58.286930+0000","last_became_peered":"2024-05-08T18:30:58.286930+0000","last_unstale":"2024-05-08T18:34:07.265892+0000","last_undegraded":"2024-05-08T18:34:07.265892+0000","last_fullsized":"2024-05-08T18:34:07.265892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:33.986082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.964490+0000","last_change":"2024-05-08T18:31:00.283948+0000","last_active":"2024-05-08T18:34:06.964490+0000","last_peered":"2024-05-08T18:34:06.964490+0000","last_clean":"2024-05-08T18:34:06.964490+0000","last_became_active":"2024-05-08T18:31:00.282958+0000","last_became_peered":"2024-05-08T18:31:00.282958+0000","last_unstale":"2024-05-08T18:34:06.964490+0000","last_undegraded":"2024-05-08T18:34:06.964490+0000","last_fullsized":"2024-05-08T18:34:06.964490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:41.064447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.328195+0000","last_change":"2024-05-08T18:30:58.305701+0000","last_active":"2024-05-08T18:31:45.328195+0000","last_peered":"2024-05-08T18:31:45.328195+0000","last_clean":"2024-05-08T18:31:45.328195+0000","last_became_active":"2024-05-08T18:30:58.302051+0000","last_became_peered":"2024-05-08T18:30:58.302051+0000","last_unstale":"2024-05-08T18:31:45.328195+0000","last_undegraded":"2024-05-08T18:31:45.328195+0000","last_fullsized":"2024-05-08T18:31:45.328195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:52.764644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.332860+0000","last_change":"2024-05-08T18:31:00.299248+0000","last_active":"2024-05-08T18:31:45.332860+0000","last_peered":"2024-05-08T18:31:45.332860+0000","last_clean":"2024-05-08T18:31:45.332860+0000","last_became_active":"2024-05-08T18:31:00.297787+0000","last_became_peered":"2024-05-08T18:31:00.297787+0000","last_unstale":"2024-05-08T18:31:45.332860+0000","last_undegraded":"2024-05-08T18:31:45.332860+0000","last_fullsized":"2024-05-08T18:31:45.332860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:40.412419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.190202+0000","last_change":"2024-05-08T18:30:58.285595+0000","last_active":"2024-05-08T18:34:07.190202+0000","last_peered":"2024-05-08T18:34:07.190202+0000","last_clean":"2024-05-08T18:34:07.190202+0000","last_became_active":"2024-05-08T18:30:58.284146+0000","last_became_peered":"2024-05-08T18:30:58.284146+0000","last_unstale":"2024-05-08T18:34:07.190202+0000","last_undegraded":"2024-05-08T18:34:07.190202+0000","last_fullsized":"2024-05-08T18:34:07.190202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:25.031288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'12","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.242555+0000","last_change":"2024-05-08T18:31:00.291767+0000","last_active":"2024-05-08T18:34:07.242555+0000","last_peered":"2024-05-08T18:34:07.242555+0000","last_clean":"2024-05-08T18:34:07.242555+0000","last_became_active":"2024-05-08T18:31:00.291399+0000","last_became_peered":"2024-05-08T18:31:00.291399+0000","last_unstale":"2024-05-08T18:34:07.242555+0000","last_undegraded":"2024-05-08T18:34:07.242555+0000","last_fullsized":"2024-05-08T18:34:07.242555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:29.461384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.177075+0000","last_change":"2024-05-08T18:30:58.305891+0000","last_active":"2024-05-08T18:34:07.177075+0000","last_peered":"2024-05-08T18:34:07.177075+0000","last_clean":"2024-05-08T18:34:07.177075+0000","last_became_active":"2024-05-08T18:30:58.305523+0000","last_became_peered":"2024-05-08T18:30:58.305523+0000","last_unstale":"2024-05-08T18:34:07.177075+0000","last_undegraded":"2024-05-08T18:34:07.177075+0000","last_fullsized":"2024-05-08T18:34:07.177075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:38.049573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'14","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.196828+0000","last_change":"2024-05-08T18:31:00.281500+0000","last_active":"2024-05-08T18:34:07.196828+0000","last_peered":"2024-05-08T18:34:07.196828+0000","last_clean":"2024-05-08T18:34:07.196828+0000","last_became_active":"2024-05-08T18:31:00.281199+0000","last_became_peered":"2024-05-08T18:31:00.281199+0000","last_unstale":"2024-05-08T18:34:07.196828+0000","last_undegraded":"2024-05-08T18:34:07.196828+0000","last_fullsized":"2024-05-08T18:34:07.196828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:40:39.970400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.333475+0000","last_change":"2024-05-08T18:30:58.302582+0000","last_active":"2024-05-08T18:31:45.333475+0000","last_peered":"2024-05-08T18:31:45.333475+0000","last_clean":"2024-05-08T18:31:45.333475+0000","last_became_active":"2024-05-08T18:30:58.302218+0000","last_became_peered":"2024-05-08T18:30:58.302218+0000","last_unstale":"2024-05-08T18:31:45.333475+0000","last_undegraded":"2024-05-08T18:31:45.333475+0000","last_fullsized":"2024-05-08T18:31:45.333475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:25.031288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.057640+0000","last_change":"2024-05-08T18:31:00.294447+0000","last_active":"2024-05-08T18:34:07.057640+0000","last_peered":"2024-05-08T18:34:07.057640+0000","last_clean":"2024-05-08T18:34:07.057640+0000","last_became_active":"2024-05-08T18:31:00.294146+0000","last_became_peered":"2024-05-08T18:31:00.294146+0000","last_unstale":"2024-05-08T18:34:07.057640+0000","last_undegraded":"2024-05-08T18:34:07.057640+0000","last_fullsized":"2024-05-08T18:34:07.057640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:01.629372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329386+0000","last_change":"2024-05-08T18:30:58.317135+0000","last_active":"2024-05-08T18:31:45.329386+0000","last_peered":"2024-05-08T18:31:45.329386+0000","last_clean":"2024-05-08T18:31:45.329386+0000","last_became_active":"2024-05-08T18:30:58.314388+0000","last_became_peered":"2024-05-08T18:30:58.314388+0000","last_unstale":"2024-05-08T18:31:45.329386+0000","last_undegraded":"2024-05-08T18:31:45.329386+0000","last_fullsized":"2024-05-08T18:31:45.329386+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:19:16.450109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.239867+0000","last_change":"2024-05-08T18:31:00.283542+0000","last_active":"2024-05-08T18:34:07.239867+0000","last_peered":"2024-05-08T18:34:07.239867+0000","last_clean":"2024-05-08T18:34:07.239867+0000","last_became_active":"2024-05-08T18:31:00.281847+0000","last_became_peered":"2024-05-08T18:31:00.281847+0000","last_unstale":"2024-05-08T18:34:07.239867+0000","last_undegraded":"2024-05-08T18:34:07.239867+0000","last_fullsized":"2024-05-08T18:34:07.239867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:57.459641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.330545+0000","last_change":"2024-05-08T18:30:58.309703+0000","last_active":"2024-05-08T18:31:45.330545+0000","last_peered":"2024-05-08T18:31:45.330545+0000","last_clean":"2024-05-08T18:31:45.330545+0000","last_became_active":"2024-05-08T18:30:58.309203+0000","last_became_peered":"2024-05-08T18:30:58.309203+0000","last_unstale":"2024-05-08T18:31:45.330545+0000","last_undegraded":"2024-05-08T18:31:45.330545+0000","last_fullsized":"2024-05-08T18:31:45.330545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:16.366334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'16","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.197060+0000","last_change":"2024-05-08T18:31:00.296525+0000","last_active":"2024-05-08T18:34:07.197060+0000","last_peered":"2024-05-08T18:34:07.197060+0000","last_clean":"2024-05-08T18:34:07.197060+0000","last_became_active":"2024-05-08T18:31:00.296240+0000","last_became_peered":"2024-05-08T18:31:00.296240+0000","last_unstale":"2024-05-08T18:34:07.197060+0000","last_undegraded":"2024-05-08T18:34:07.197060+0000","last_fullsized":"2024-05-08T18:34:07.197060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:42.486383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337097+0000","last_change":"2024-05-08T18:30:58.306151+0000","last_active":"2024-05-08T18:31:45.337097+0000","last_peered":"2024-05-08T18:31:45.337097+0000","last_clean":"2024-05-08T18:31:45.337097+0000","last_became_active":"2024-05-08T18:30:58.305572+0000","last_became_peered":"2024-05-08T18:30:58.305572+0000","last_unstale":"2024-05-08T18:31:45.337097+0000","last_undegraded":"2024-05-08T18:31:45.337097+0000","last_fullsized":"2024-05-08T18:31:45.337097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:56.618771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.240162+0000","last_change":"2024-05-08T18:31:00.283388+0000","last_active":"2024-05-08T18:34:07.240162+0000","last_peered":"2024-05-08T18:34:07.240162+0000","last_clean":"2024-05-08T18:34:07.240162+0000","last_became_active":"2024-05-08T18:31:00.282414+0000","last_became_peered":"2024-05-08T18:31:00.282414+0000","last_unstale":"2024-05-08T18:34:07.240162+0000","last_undegraded":"2024-05-08T18:34:07.240162+0000","last_fullsized":"2024-05-08T18:34:07.240162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:56.345475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.179636+0000","last_change":"2024-05-08T18:30:58.308682+0000","last_active":"2024-05-08T18:33:18.179636+0000","last_peered":"2024-05-08T18:33:18.179636+0000","last_clean":"2024-05-08T18:33:18.179636+0000","last_became_active":"2024-05-08T18:30:58.304591+0000","last_became_peered":"2024-05-08T18:30:58.304591+0000","last_unstale":"2024-05-08T18:33:18.179636+0000","last_undegraded":"2024-05-08T18:33:18.179636+0000","last_fullsized":"2024-05-08T18:33:18.179636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:40.162258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.180377+0000","last_change":"2024-05-08T18:30:58.304754+0000","last_active":"2024-05-08T18:34:07.180377+0000","last_peered":"2024-05-08T18:34:07.180377+0000","last_clean":"2024-05-08T18:34:07.180377+0000","last_became_active":"2024-05-08T18:30:58.303443+0000","last_became_peered":"2024-05-08T18:30:58.303443+0000","last_unstale":"2024-05-08T18:34:07.180377+0000","last_undegraded":"2024-05-08T18:34:07.180377+0000","last_fullsized":"2024-05-08T18:34:07.180377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:56.525015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'11","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.248139+0000","last_change":"2024-05-08T18:31:00.288619+0000","last_active":"2024-05-08T18:34:07.248139+0000","last_peered":"2024-05-08T18:34:07.248139+0000","last_clean":"2024-05-08T18:34:07.248139+0000","last_became_active":"2024-05-08T18:31:00.288250+0000","last_became_peered":"2024-05-08T18:31:00.288250+0000","last_unstale":"2024-05-08T18:34:07.248139+0000","last_undegraded":"2024-05-08T18:34:07.248139+0000","last_fullsized":"2024-05-08T18:34:07.248139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:58.735465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.329134+0000","last_change":"2024-05-08T18:30:58.285795+0000","last_active":"2024-05-08T18:31:45.329134+0000","last_peered":"2024-05-08T18:31:45.329134+0000","last_clean":"2024-05-08T18:31:45.329134+0000","last_became_active":"2024-05-08T18:30:58.284090+0000","last_became_peered":"2024-05-08T18:30:58.284090+0000","last_unstale":"2024-05-08T18:31:45.329134+0000","last_undegraded":"2024-05-08T18:31:45.329134+0000","last_fullsized":"2024-05-08T18:31:45.329134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:56.618771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:31:45.337379+0000","last_change":"2024-05-08T18:31:00.291942+0000","last_active":"2024-05-08T18:31:45.337379+0000","last_peered":"2024-05-08T18:31:45.337379+0000","last_clean":"2024-05-08T18:31:45.337379+0000","last_became_active":"2024-05-08T18:31:00.291650+0000","last_became_peered":"2024-05-08T18:31:00.291650+0000","last_unstale":"2024-05-08T18:31:45.337379+0000","last_undegraded":"2024-05-08T18:31:45.337379+0000","last_fullsized":"2024-05-08T18:31:45.337379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:49:50.681202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705708,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44172,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327668,"statfs":{"total":96636764160,"available":96591532032,"internally_reserved":0,"allocated":9048064,"data_stored":8743598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44688,"kb_used_data":9352,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327152,"statfs":{"total":96636764160,"available":96591003648,"internally_reserved":0,"allocated":9576448,"data_stored":9329841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44708,"kb_used_data":9372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327132,"statfs":{"total":96636764160,"available":96590983168,"internally_reserved":0,"allocated":9596928,"data_stored":9330329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705707,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":8808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":9019392,"data_stored":8742450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:34:18.638 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.638 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.638 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.638 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.639 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.639 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.639 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.639 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.639 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.639 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.639 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.639 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.640 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.640 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.640 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.640 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.640 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.640 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.640 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.640 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.640 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.640 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.641 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.641 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.641 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.641 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.641 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.641 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.641 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.641 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.641 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.642 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.642 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.642 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.642 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.642 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.642 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.642 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.642 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.642 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.643 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.643 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.643 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.643 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.643 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.643 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.643 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.643 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.643 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.644 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.644 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.644 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.644 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.644 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.644 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.644 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.644 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.644 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.645 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.645 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.645 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.645 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.645 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.645 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.645 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.645 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.645 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.646 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.646 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.646 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.646 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.646 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.646 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.646 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.646 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.646 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.647 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.647 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.647 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.647 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.647 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.647 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.647 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.647 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.647 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.648 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.648 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.648 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.648 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.648 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.648 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.648 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.648 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.648 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.648 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.649 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.649 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.649 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.649 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.649 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.649 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.649 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.649 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.649 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.650 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.650 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.650 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.650 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.650 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.650 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.650 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.650 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.651 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.651 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.651 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.651 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.651 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.651 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.651 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.651 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.652 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.652 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.652 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.652 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.652 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.652 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.652 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.652 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.653 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.653 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.653 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.653 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.653 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.653 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.653 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.653 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.653 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.653 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.654 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.654 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.654 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.654 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.654 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.654 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.654 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.654 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.654 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.655 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.655 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.655 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.655 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.655 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.655 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.655 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.655 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.655 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.656 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.656 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.656 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.656 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.656 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.656 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.656 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.656 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.657 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.657 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.657 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.657 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.657 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.657 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.657 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.657 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.657 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.658 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.658 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.658 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.658 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.658 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.658 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.658 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.658 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.659 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.659 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.659 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.659 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.659 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.659 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.659 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.659 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.659 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.660 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.660 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.660 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.660 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.660 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.660 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.660 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.660 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.660 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.661 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.661 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.661 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.661 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.661 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.661 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.661 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.661 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.661 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.662 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.662 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.662 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.662 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.662 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.662 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.662 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.662 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.662 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.663 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.663 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.663 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.663 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.663 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.663 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.663 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.663 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.664 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.664 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.664 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.664 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.664 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.664 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.664 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.664 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.664 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.665 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.665 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.665 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.665 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.665 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.665 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.665 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.665 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.665 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.666 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.666 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.666 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.666 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.666 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.666 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.666 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.666 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.666 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.667 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.667 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.667 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.667 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.667 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.667 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.667 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.667 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.667 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.668 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.668 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.668 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.668 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:18.668 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:34:38.669 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:34:38.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.787+0000 7f3eb8949640 1 Processor -- start 2024-05-08T18:34:38.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.787+0000 7f3eb8949640 1 -- start start 2024-05-08T18:34:38.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.787+0000 7f3eb8949640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3eb4129560 0x7f3eb41313d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.787+0000 7f3eb8949640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb4072dc0 con 0x7f3eb406fe20 2024-05-08T18:34:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.787+0000 7f3eb8949640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f3eb41299f0 con 0x7f3eb4129560 2024-05-08T18:34:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.787+0000 7f3eb1d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3eb4129560 0x7f3eb41313d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.787+0000 7f3eb259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3eb406fe20 0x7f3eb4128e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51820/0 (socket says 172.21.15.53:51820) 2024-05-08T18:34:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.787+0000 7f3eb259c640 1 -- 172.21.15.53:0/2021324371 learned_addr learned my addr 172.21.15.53:0/2021324371 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:34:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.788+0000 7f3eb1d9b640 1 -- 172.21.15.53:0/2021324371 >> v1:172.21.15.53:6789/0 conn(0x7f3eb406fe20 legacy=0x7f3eb4128e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.788+0000 7f3eb1d9b640 1 -- 172.21.15.53:0/2021324371 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb4128ad0 con 0x7f3eb4129560 2024-05-08T18:34:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.788+0000 7f3eb159a640 1 -- 172.21.15.53:0/2021324371 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3153550547 0 0) 0x7f3eb4072dc0 con 0x7f3eb406fe20 2024-05-08T18:34:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.789+0000 7f3eb1d9b640 1 --2- 172.21.15.53:0/2021324371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb4129560 0x7f3eb41313d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009720 tx=0x7f3ea802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f48b72800c0345e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.789+0000 7f3eb159a640 1 -- 172.21.15.53:0/2021324371 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ea80316d0 con 0x7f3eb4129560 2024-05-08T18:34:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.789+0000 7f3eb159a640 1 -- 172.21.15.53:0/2021324371 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ea8037070 con 0x7f3eb4129560 2024-05-08T18:34:38.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.789+0000 7f3eb159a640 1 -- 172.21.15.53:0/2021324371 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ea80319c0 con 0x7f3eb4129560 2024-05-08T18:34:38.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.789+0000 7f3eb8949640 1 -- 172.21.15.53:0/2021324371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb4129560 msgr2=0x7f3eb41313d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:38.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.789+0000 7f3eb8949640 1 --2- 172.21.15.53:0/2021324371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb4129560 0x7f3eb41313d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009720 tx=0x7f3ea802b840 comp rx=0 tx=0).stop 2024-05-08T18:34:38.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.789+0000 7f3eb8949640 1 -- 172.21.15.53:0/2021324371 shutdown_connections 2024-05-08T18:34:38.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.789+0000 7f3eb8949640 1 --2- 172.21.15.53:0/2021324371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb4129560 0x7f3eb41313d0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:38.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.789+0000 7f3eb8949640 1 -- 172.21.15.53:0/2021324371 >> 172.21.15.53:0/2021324371 conn(0x7f3eb409a910 msgr2=0x7f3eb406e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:38.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.789+0000 7f3eb8949640 1 -- 172.21.15.53:0/2021324371 shutdown_connections 2024-05-08T18:34:38.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.789+0000 7f3eb8949640 1 -- 172.21.15.53:0/2021324371 wait complete. 2024-05-08T18:34:38.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.790+0000 7f3eb8949640 1 Processor -- start 2024-05-08T18:34:38.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.790+0000 7f3eb8949640 1 -- start start 2024-05-08T18:34:38.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.791+0000 7f3eb8949640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb406fe20 0x7f3eb4121680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.791+0000 7f3eb8949640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb4131910 con 0x7f3eb406fe20 2024-05-08T18:34:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.791+0000 7f3eb259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb406fe20 0x7f3eb4121680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.791+0000 7f3eb259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb406fe20 0x7f3eb4121680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41074/0 (socket says 172.21.15.53:41074) 2024-05-08T18:34:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.791+0000 7f3eb259c640 1 -- 172.21.15.53:0/592808662 learned_addr learned my addr 172.21.15.53:0/592808662 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:34:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.791+0000 7f3eb259c640 1 -- 172.21.15.53:0/592808662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb4130080 con 0x7f3eb406fe20 2024-05-08T18:34:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.791+0000 7f3eb259c640 1 --2- 172.21.15.53:0/592808662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb406fe20 0x7f3eb4121680 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400c420 tx=0x7f3ea400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.792+0000 7f3ea2ffd640 1 -- 172.21.15.53:0/592808662 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ea4018070 con 0x7f3eb406fe20 2024-05-08T18:34:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.792+0000 7f3ea2ffd640 1 -- 172.21.15.53:0/592808662 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ea40074d0 con 0x7f3eb406fe20 2024-05-08T18:34:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.792+0000 7f3eb8949640 1 -- 172.21.15.53:0/592808662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb4115150 con 0x7f3eb406fe20 2024-05-08T18:34:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.792+0000 7f3ea2ffd640 1 -- 172.21.15.53:0/592808662 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ea4004950 con 0x7f3eb406fe20 2024-05-08T18:34:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.792+0000 7f3eb8949640 1 -- 172.21.15.53:0/592808662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb41157d0 con 0x7f3eb406fe20 2024-05-08T18:34:38.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.793+0000 7f3ea2ffd640 1 -- 172.21.15.53:0/592808662 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3ea401b070 con 0x7f3eb406fe20 2024-05-08T18:34:38.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.793+0000 7f3ea2ffd640 1 --2- 172.21.15.53:0/592808662 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3e9403d2b0 0x7f3e9403f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:38.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.793+0000 7f3eb8949640 1 -- 172.21.15.53:0/592808662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eb4064010 con 0x7f3eb406fe20 2024-05-08T18:34:38.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.793+0000 7f3ea2ffd640 1 -- 172.21.15.53:0/592808662 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3ea40511c0 con 0x7f3eb406fe20 2024-05-08T18:34:38.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.793+0000 7f3eb1d9b640 1 --2- 172.21.15.53:0/592808662 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3e9403d2b0 0x7f3e9403f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:38.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.794+0000 7f3eb1d9b640 1 --2- 172.21.15.53:0/592808662 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3e9403d2b0 0x7f3e9403f770 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8036000 tx=0x7f3ea8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:38.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.798+0000 7f3ea2ffd640 1 -- 172.21.15.53:0/592808662 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3ea4010300 con 0x7f3eb406fe20 2024-05-08T18:34:38.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:38.987+0000 7f3eb8949640 1 -- 172.21.15.53:0/592808662 --> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3eb4073aa0 con 0x7f3e9403d2b0 2024-05-08T18:34:39.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:39.003+0000 7f3ea2ffd640 1 -- 172.21.15.53:0/592808662 <== mgr.4102 v2:172.21.15.87:6824/211215191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658443 (secure 0 0 0) 0x7f3eb4073aa0 con 0x7f3e9403d2b0 2024-05-08T18:34:39.010 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:34:39.016 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:34:39.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:39.008+0000 7f3eb8949640 1 -- 172.21.15.53:0/592808662 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3e9403d2b0 msgr2=0x7f3e9403f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:39.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:39.008+0000 7f3eb8949640 1 --2- 172.21.15.53:0/592808662 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3e9403d2b0 0x7f3e9403f770 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8036000 tx=0x7f3ea8008030 comp rx=0 tx=0).stop 2024-05-08T18:34:39.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:39.008+0000 7f3eb8949640 1 -- 172.21.15.53:0/592808662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb406fe20 msgr2=0x7f3eb4121680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:39.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:39.008+0000 7f3eb8949640 1 --2- 172.21.15.53:0/592808662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb406fe20 0x7f3eb4121680 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400c420 tx=0x7f3ea400c8e0 comp rx=0 tx=0).stop 2024-05-08T18:34:39.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:39.008+0000 7f3eb8949640 1 -- 172.21.15.53:0/592808662 shutdown_connections 2024-05-08T18:34:39.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:39.008+0000 7f3eb8949640 1 --2- 172.21.15.53:0/592808662 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f3e9403d2b0 0x7f3e9403f770 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:39.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:39.008+0000 7f3eb8949640 1 --2- 172.21.15.53:0/592808662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb406fe20 0x7f3eb4121680 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:39.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:39.008+0000 7f3eb8949640 1 -- 172.21.15.53:0/592808662 >> 172.21.15.53:0/592808662 conn(0x7f3eb409a910 msgr2=0x7f3eb4125760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:39.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:39.008+0000 7f3eb8949640 1 -- 172.21.15.53:0/592808662 shutdown_connections 2024-05-08T18:34:39.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:39.008+0000 7f3eb8949640 1 -- 172.21.15.53:0/592808662 wait complete. 2024-05-08T18:34:39.019 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-05-08T18:34:38.172505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5055,"num_read_kb":4641,"num_write":2119,"num_write_kb":60585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1730,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4676,"ondisk_log_size":4676,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144088,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343272,"statfs":{"total":386547056640,"available":386399510528,"internally_reserved":0,"allocated":2809856,"data_stored":1720014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1730,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003846"},"pg_stats":[{"pgid":"3.3f","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.926680+0000","last_change":"2024-05-08T18:30:58.305519+0000","last_active":"2024-05-08T18:34:13.926680+0000","last_peered":"2024-05-08T18:34:13.926680+0000","last_clean":"2024-05-08T18:34:13.926680+0000","last_became_active":"2024-05-08T18:30:58.305175+0000","last_became_peered":"2024-05-08T18:30:58.305175+0000","last_unstale":"2024-05-08T18:34:13.926680+0000","last_undegraded":"2024-05-08T18:34:13.926680+0000","last_fullsized":"2024-05-08T18:34:13.926680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.282783+0000","last_change":"2024-05-08T18:31:00.285719+0000","last_active":"2024-05-08T18:34:07.282783+0000","last_peered":"2024-05-08T18:34:07.282783+0000","last_clean":"2024-05-08T18:34:07.282783+0000","last_became_active":"2024-05-08T18:31:00.284574+0000","last_became_peered":"2024-05-08T18:31:00.284574+0000","last_unstale":"2024-05-08T18:34:07.282783+0000","last_undegraded":"2024-05-08T18:34:07.282783+0000","last_fullsized":"2024-05-08T18:34:07.282783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176148+0000","last_change":"2024-05-08T18:30:58.289175+0000","last_active":"2024-05-08T18:33:03.176148+0000","last_peered":"2024-05-08T18:33:03.176148+0000","last_clean":"2024-05-08T18:33:03.176148+0000","last_became_active":"2024-05-08T18:30:58.288674+0000","last_became_peered":"2024-05-08T18:30:58.288674+0000","last_unstale":"2024-05-08T18:33:03.176148+0000","last_undegraded":"2024-05-08T18:33:03.176148+0000","last_fullsized":"2024-05-08T18:33:03.176148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.182054+0000","last_change":"2024-05-08T18:31:00.299098+0000","last_active":"2024-05-08T18:33:33.182054+0000","last_peered":"2024-05-08T18:33:33.182054+0000","last_clean":"2024-05-08T18:33:33.182054+0000","last_became_active":"2024-05-08T18:31:00.298145+0000","last_became_peered":"2024-05-08T18:31:00.298145+0000","last_unstale":"2024-05-08T18:33:33.182054+0000","last_undegraded":"2024-05-08T18:33:33.182054+0000","last_fullsized":"2024-05-08T18:33:33.182054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.177101+0000","last_change":"2024-05-08T18:30:58.306369+0000","last_active":"2024-05-08T18:33:03.177101+0000","last_peered":"2024-05-08T18:33:03.177101+0000","last_clean":"2024-05-08T18:33:03.177101+0000","last_became_active":"2024-05-08T18:30:58.304442+0000","last_became_peered":"2024-05-08T18:30:58.304442+0000","last_unstale":"2024-05-08T18:33:03.177101+0000","last_undegraded":"2024-05-08T18:33:03.177101+0000","last_fullsized":"2024-05-08T18:33:03.177101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'10","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.182082+0000","last_change":"2024-05-08T18:31:00.298725+0000","last_active":"2024-05-08T18:33:33.182082+0000","last_peered":"2024-05-08T18:33:33.182082+0000","last_clean":"2024-05-08T18:33:33.182082+0000","last_became_active":"2024-05-08T18:31:00.297810+0000","last_became_peered":"2024-05-08T18:31:00.297810+0000","last_unstale":"2024-05-08T18:33:33.182082+0000","last_undegraded":"2024-05-08T18:33:33.182082+0000","last_fullsized":"2024-05-08T18:33:33.182082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:58.175800+0000","last_change":"2024-05-08T18:30:58.295957+0000","last_active":"2024-05-08T18:32:58.175800+0000","last_peered":"2024-05-08T18:32:58.175800+0000","last_clean":"2024-05-08T18:32:58.175800+0000","last_became_active":"2024-05-08T18:30:58.295569+0000","last_became_peered":"2024-05-08T18:30:58.295569+0000","last_unstale":"2024-05-08T18:32:58.175800+0000","last_undegraded":"2024-05-08T18:32:58.175800+0000","last_fullsized":"2024-05-08T18:32:58.175800+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.282688+0000","last_change":"2024-05-08T18:31:00.296029+0000","last_active":"2024-05-08T18:34:07.282688+0000","last_peered":"2024-05-08T18:34:07.282688+0000","last_clean":"2024-05-08T18:34:07.282688+0000","last_became_active":"2024-05-08T18:31:00.295611+0000","last_became_peered":"2024-05-08T18:31:00.295611+0000","last_unstale":"2024-05-08T18:34:07.282688+0000","last_undegraded":"2024-05-08T18:34:07.282688+0000","last_fullsized":"2024-05-08T18:34:07.282688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181331+0000","last_change":"2024-05-08T18:30:58.313349+0000","last_active":"2024-05-08T18:33:28.181331+0000","last_peered":"2024-05-08T18:33:28.181331+0000","last_clean":"2024-05-08T18:33:28.181331+0000","last_became_active":"2024-05-08T18:30:58.313003+0000","last_became_peered":"2024-05-08T18:30:58.313003+0000","last_unstale":"2024-05-08T18:33:28.181331+0000","last_undegraded":"2024-05-08T18:33:28.181331+0000","last_fullsized":"2024-05-08T18:33:28.181331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176325+0000","last_change":"2024-05-08T18:31:00.281345+0000","last_active":"2024-05-08T18:33:03.176325+0000","last_peered":"2024-05-08T18:33:03.176325+0000","last_clean":"2024-05-08T18:33:03.176325+0000","last_became_active":"2024-05-08T18:31:00.281065+0000","last_became_peered":"2024-05-08T18:31:00.281065+0000","last_unstale":"2024-05-08T18:33:03.176325+0000","last_undegraded":"2024-05-08T18:33:03.176325+0000","last_fullsized":"2024-05-08T18:33:03.176325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.180589+0000","last_change":"2024-05-08T18:30:58.308072+0000","last_active":"2024-05-08T18:33:28.180589+0000","last_peered":"2024-05-08T18:33:28.180589+0000","last_clean":"2024-05-08T18:33:28.180589+0000","last_became_active":"2024-05-08T18:30:58.307687+0000","last_became_peered":"2024-05-08T18:30:58.307687+0000","last_unstale":"2024-05-08T18:33:28.180589+0000","last_undegraded":"2024-05-08T18:33:28.180589+0000","last_fullsized":"2024-05-08T18:33:28.180589+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'12","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.974193+0000","last_change":"2024-05-08T18:31:00.299642+0000","last_active":"2024-05-08T18:34:06.974193+0000","last_peered":"2024-05-08T18:34:06.974193+0000","last_clean":"2024-05-08T18:34:06.974193+0000","last_became_active":"2024-05-08T18:31:00.298978+0000","last_became_peered":"2024-05-08T18:31:00.298978+0000","last_unstale":"2024-05-08T18:34:06.974193+0000","last_undegraded":"2024-05-08T18:34:06.974193+0000","last_fullsized":"2024-05-08T18:34:06.974193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181237+0000","last_change":"2024-05-08T18:30:58.309859+0000","last_active":"2024-05-08T18:33:28.181237+0000","last_peered":"2024-05-08T18:33:28.181237+0000","last_clean":"2024-05-08T18:33:28.181237+0000","last_became_active":"2024-05-08T18:30:58.308931+0000","last_became_peered":"2024-05-08T18:30:58.308931+0000","last_unstale":"2024-05-08T18:33:28.181237+0000","last_undegraded":"2024-05-08T18:33:28.181237+0000","last_fullsized":"2024-05-08T18:33:28.181237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'7","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.333968+0000","last_change":"2024-05-08T18:31:00.295747+0000","last_active":"2024-05-08T18:34:07.333968+0000","last_peered":"2024-05-08T18:34:07.333968+0000","last_clean":"2024-05-08T18:34:07.333968+0000","last_became_active":"2024-05-08T18:31:00.295472+0000","last_became_peered":"2024-05-08T18:31:00.295472+0000","last_unstale":"2024-05-08T18:34:07.333968+0000","last_undegraded":"2024-05-08T18:34:07.333968+0000","last_fullsized":"2024-05-08T18:34:07.333968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.180073+0000","last_change":"2024-05-08T18:30:58.295024+0000","last_active":"2024-05-08T18:33:28.180073+0000","last_peered":"2024-05-08T18:33:28.180073+0000","last_clean":"2024-05-08T18:33:28.180073+0000","last_became_active":"2024-05-08T18:30:58.294511+0000","last_became_peered":"2024-05-08T18:30:58.294511+0000","last_unstale":"2024-05-08T18:33:28.180073+0000","last_undegraded":"2024-05-08T18:33:28.180073+0000","last_fullsized":"2024-05-08T18:33:28.180073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177331+0000","last_change":"2024-05-08T18:31:00.291471+0000","last_active":"2024-05-08T18:33:08.177331+0000","last_peered":"2024-05-08T18:33:08.177331+0000","last_clean":"2024-05-08T18:33:08.177331+0000","last_became_active":"2024-05-08T18:31:00.291203+0000","last_became_peered":"2024-05-08T18:31:00.291203+0000","last_unstale":"2024-05-08T18:33:08.177331+0000","last_undegraded":"2024-05-08T18:33:08.177331+0000","last_fullsized":"2024-05-08T18:33:08.177331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.203003+0000","last_change":"2024-05-08T18:31:00.291351+0000","last_active":"2024-05-08T18:34:07.203003+0000","last_peered":"2024-05-08T18:34:07.203003+0000","last_clean":"2024-05-08T18:34:07.203003+0000","last_became_active":"2024-05-08T18:31:00.290806+0000","last_became_peered":"2024-05-08T18:31:00.290806+0000","last_unstale":"2024-05-08T18:34:07.203003+0000","last_undegraded":"2024-05-08T18:34:07.203003+0000","last_fullsized":"2024-05-08T18:34:07.203003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.924545+0000","last_change":"2024-05-08T18:30:58.305311+0000","last_active":"2024-05-08T18:34:06.924545+0000","last_peered":"2024-05-08T18:34:06.924545+0000","last_clean":"2024-05-08T18:34:06.924545+0000","last_became_active":"2024-05-08T18:30:58.304685+0000","last_became_peered":"2024-05-08T18:30:58.304685+0000","last_unstale":"2024-05-08T18:34:06.924545+0000","last_undegraded":"2024-05-08T18:34:06.924545+0000","last_fullsized":"2024-05-08T18:34:06.924545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'14","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179809+0000","last_change":"2024-05-08T18:31:00.283453+0000","last_active":"2024-05-08T18:33:23.179809+0000","last_peered":"2024-05-08T18:33:23.179809+0000","last_clean":"2024-05-08T18:33:23.179809+0000","last_became_active":"2024-05-08T18:31:00.281816+0000","last_became_peered":"2024-05-08T18:31:00.281816+0000","last_unstale":"2024-05-08T18:33:23.179809+0000","last_undegraded":"2024-05-08T18:33:23.179809+0000","last_fullsized":"2024-05-08T18:33:23.179809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179877+0000","last_change":"2024-05-08T18:30:58.307205+0000","last_active":"2024-05-08T18:33:23.179877+0000","last_peered":"2024-05-08T18:33:23.179877+0000","last_clean":"2024-05-08T18:33:23.179877+0000","last_became_active":"2024-05-08T18:30:58.306545+0000","last_became_peered":"2024-05-08T18:30:58.306545+0000","last_unstale":"2024-05-08T18:33:23.179877+0000","last_undegraded":"2024-05-08T18:33:23.179877+0000","last_fullsized":"2024-05-08T18:33:23.179877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'16","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.282787+0000","last_change":"2024-05-08T18:31:00.283417+0000","last_active":"2024-05-08T18:34:07.282787+0000","last_peered":"2024-05-08T18:34:07.282787+0000","last_clean":"2024-05-08T18:34:07.282787+0000","last_became_active":"2024-05-08T18:31:00.283048+0000","last_became_peered":"2024-05-08T18:31:00.283048+0000","last_unstale":"2024-05-08T18:34:07.282787+0000","last_undegraded":"2024-05-08T18:34:07.282787+0000","last_fullsized":"2024-05-08T18:34:07.282787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179919+0000","last_change":"2024-05-08T18:30:58.302648+0000","last_active":"2024-05-08T18:33:23.179919+0000","last_peered":"2024-05-08T18:33:23.179919+0000","last_clean":"2024-05-08T18:33:23.179919+0000","last_became_active":"2024-05-08T18:30:58.302245+0000","last_became_peered":"2024-05-08T18:30:58.302245+0000","last_unstale":"2024-05-08T18:33:23.179919+0000","last_undegraded":"2024-05-08T18:33:23.179919+0000","last_fullsized":"2024-05-08T18:33:23.179919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.203096+0000","last_change":"2024-05-08T18:31:45.338509+0000","last_active":"2024-05-08T18:34:07.203096+0000","last_peered":"2024-05-08T18:34:07.203096+0000","last_clean":"2024-05-08T18:34:07.203096+0000","last_became_active":"2024-05-08T18:31:45.338192+0000","last_became_peered":"2024-05-08T18:31:45.338192+0000","last_unstale":"2024-05-08T18:34:07.203096+0000","last_undegraded":"2024-05-08T18:34:07.203096+0000","last_fullsized":"2024-05-08T18:34:07.203096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179886+0000","last_change":"2024-05-08T18:30:58.306070+0000","last_active":"2024-05-08T18:33:23.179886+0000","last_peered":"2024-05-08T18:33:23.179886+0000","last_clean":"2024-05-08T18:33:23.179886+0000","last_became_active":"2024-05-08T18:30:58.304222+0000","last_became_peered":"2024-05-08T18:30:58.304222+0000","last_unstale":"2024-05-08T18:33:23.179886+0000","last_undegraded":"2024-05-08T18:33:23.179886+0000","last_fullsized":"2024-05-08T18:33:23.179886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"27'6","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.180672+0000","last_change":"2024-05-08T18:31:00.296365+0000","last_active":"2024-05-08T18:33:28.180672+0000","last_peered":"2024-05-08T18:33:28.180672+0000","last_clean":"2024-05-08T18:33:28.180672+0000","last_became_active":"2024-05-08T18:31:00.295990+0000","last_became_peered":"2024-05-08T18:31:00.295990+0000","last_unstale":"2024-05-08T18:33:28.180672+0000","last_undegraded":"2024-05-08T18:33:28.180672+0000","last_fullsized":"2024-05-08T18:33:28.180672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179207+0000","last_change":"2024-05-08T18:30:58.285289+0000","last_active":"2024-05-08T18:33:23.179207+0000","last_peered":"2024-05-08T18:33:23.179207+0000","last_clean":"2024-05-08T18:33:23.179207+0000","last_became_active":"2024-05-08T18:30:58.283821+0000","last_became_peered":"2024-05-08T18:30:58.283821+0000","last_unstale":"2024-05-08T18:33:23.179207+0000","last_undegraded":"2024-05-08T18:33:23.179207+0000","last_fullsized":"2024-05-08T18:33:23.179207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'12","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.203457+0000","last_change":"2024-05-08T18:31:00.282011+0000","last_active":"2024-05-08T18:34:07.203457+0000","last_peered":"2024-05-08T18:34:07.203457+0000","last_clean":"2024-05-08T18:34:07.203457+0000","last_became_active":"2024-05-08T18:31:00.280827+0000","last_became_peered":"2024-05-08T18:31:00.280827+0000","last_unstale":"2024-05-08T18:34:07.203457+0000","last_undegraded":"2024-05-08T18:34:07.203457+0000","last_fullsized":"2024-05-08T18:34:07.203457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.179492+0000","last_change":"2024-05-08T18:30:58.306076+0000","last_active":"2024-05-08T18:33:18.179492+0000","last_peered":"2024-05-08T18:33:18.179492+0000","last_clean":"2024-05-08T18:33:18.179492+0000","last_became_active":"2024-05-08T18:30:58.305571+0000","last_became_peered":"2024-05-08T18:30:58.305571+0000","last_unstale":"2024-05-08T18:33:18.179492+0000","last_undegraded":"2024-05-08T18:33:18.179492+0000","last_fullsized":"2024-05-08T18:33:18.179492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.292012+0000","last_change":"2024-05-08T18:31:08.318466+0000","last_active":"2024-05-08T18:34:07.292012+0000","last_peered":"2024-05-08T18:34:07.292012+0000","last_clean":"2024-05-08T18:34:07.292012+0000","last_became_active":"2024-05-08T18:31:08.318181+0000","last_became_peered":"2024-05-08T18:31:08.318181+0000","last_unstale":"2024-05-08T18:34:07.292012+0000","last_undegraded":"2024-05-08T18:34:07.292012+0000","last_fullsized":"2024-05-08T18:34:07.292012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.180426+0000","last_change":"2024-05-08T18:31:00.296553+0000","last_active":"2024-05-08T18:33:23.180426+0000","last_peered":"2024-05-08T18:33:23.180426+0000","last_clean":"2024-05-08T18:33:23.180426+0000","last_became_active":"2024-05-08T18:31:00.296160+0000","last_became_peered":"2024-05-08T18:31:00.296160+0000","last_unstale":"2024-05-08T18:33:23.180426+0000","last_undegraded":"2024-05-08T18:33:23.180426+0000","last_fullsized":"2024-05-08T18:33:23.180426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.179516+0000","last_change":"2024-05-08T18:30:58.317375+0000","last_active":"2024-05-08T18:33:18.179516+0000","last_peered":"2024-05-08T18:33:18.179516+0000","last_clean":"2024-05-08T18:33:18.179516+0000","last_became_active":"2024-05-08T18:30:58.315246+0000","last_became_peered":"2024-05-08T18:30:58.315246+0000","last_unstale":"2024-05-08T18:33:18.179516+0000","last_undegraded":"2024-05-08T18:33:18.179516+0000","last_fullsized":"2024-05-08T18:33:18.179516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.660068+0000","last_change":"2024-05-08T18:34:23.660113+0000","last_active":"2024-05-08T18:34:23.660068+0000","last_peered":"2024-05-08T18:34:23.660068+0000","last_clean":"2024-05-08T18:34:23.660068+0000","last_became_active":"2024-05-08T18:31:02.290465+0000","last_became_peered":"2024-05-08T18:31:02.290465+0000","last_unstale":"2024-05-08T18:34:23.660068+0000","last_undegraded":"2024-05-08T18:34:23.660068+0000","last_fullsized":"2024-05-08T18:34:23.660068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:23.659943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:23.659943+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.659943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:25.967513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'33","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.878723+0000","last_change":"2024-05-08T18:31:04.304092+0000","last_active":"2024-05-08T18:34:13.878723+0000","last_peered":"2024-05-08T18:34:13.878723+0000","last_clean":"2024-05-08T18:34:13.878723+0000","last_became_active":"2024-05-08T18:31:04.303815+0000","last_became_peered":"2024-05-08T18:31:04.303815+0000","last_unstale":"2024-05-08T18:34:13.878723+0000","last_undegraded":"2024-05-08T18:34:13.878723+0000","last_fullsized":"2024-05-08T18:34:13.878723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.889107+0000","last_change":"2024-05-08T18:34:24.889148+0000","last_active":"2024-05-08T18:34:24.889107+0000","last_peered":"2024-05-08T18:34:24.889107+0000","last_clean":"2024-05-08T18:34:24.889107+0000","last_became_active":"2024-05-08T18:31:06.310555+0000","last_became_peered":"2024-05-08T18:31:06.310555+0000","last_unstale":"2024-05-08T18:34:24.889107+0000","last_undegraded":"2024-05-08T18:34:24.889107+0000","last_fullsized":"2024-05-08T18:34:24.889107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:24.889019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:24.889019+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.889019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:06.963972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.181420+0000","last_change":"2024-05-08T18:31:08.319311+0000","last_active":"2024-05-08T18:33:33.181420+0000","last_peered":"2024-05-08T18:33:33.181420+0000","last_clean":"2024-05-08T18:33:33.181420+0000","last_became_active":"2024-05-08T18:31:08.319009+0000","last_became_peered":"2024-05-08T18:31:08.319009+0000","last_unstale":"2024-05-08T18:33:33.181420+0000","last_undegraded":"2024-05-08T18:33:33.181420+0000","last_fullsized":"2024-05-08T18:33:33.181420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181416+0000","last_change":"2024-05-08T18:31:00.298856+0000","last_active":"2024-05-08T18:33:28.181416+0000","last_peered":"2024-05-08T18:33:28.181416+0000","last_clean":"2024-05-08T18:33:28.181416+0000","last_became_active":"2024-05-08T18:31:00.297497+0000","last_became_peered":"2024-05-08T18:31:00.297497+0000","last_unstale":"2024-05-08T18:33:28.181416+0000","last_undegraded":"2024-05-08T18:33:28.181416+0000","last_fullsized":"2024-05-08T18:33:28.181416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178835+0000","last_change":"2024-05-08T18:30:58.300036+0000","last_active":"2024-05-08T18:33:18.178835+0000","last_peered":"2024-05-08T18:33:18.178835+0000","last_clean":"2024-05-08T18:33:18.178835+0000","last_became_active":"2024-05-08T18:30:58.299649+0000","last_became_peered":"2024-05-08T18:30:58.299649+0000","last_unstale":"2024-05-08T18:33:18.178835+0000","last_undegraded":"2024-05-08T18:33:18.178835+0000","last_fullsized":"2024-05-08T18:33:18.178835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"20'1","reported_seq":221,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.813977+0000","last_change":"2024-05-08T18:31:02.294330+0000","last_active":"2024-05-08T18:34:13.813977+0000","last_peered":"2024-05-08T18:34:13.813977+0000","last_clean":"2024-05-08T18:34:13.813977+0000","last_became_active":"2024-05-08T18:31:02.293993+0000","last_became_peered":"2024-05-08T18:31:02.293993+0000","last_unstale":"2024-05-08T18:34:13.813977+0000","last_undegraded":"2024-05-08T18:34:13.813977+0000","last_fullsized":"2024-05-08T18:34:13.813977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'10","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.907482+0000","last_change":"2024-05-08T18:34:23.907510+0000","last_active":"2024-05-08T18:34:23.907482+0000","last_peered":"2024-05-08T18:34:23.907482+0000","last_clean":"2024-05-08T18:34:23.907482+0000","last_became_active":"2024-05-08T18:31:04.300059+0000","last_became_peered":"2024-05-08T18:31:04.300059+0000","last_unstale":"2024-05-08T18:34:23.907482+0000","last_undegraded":"2024-05-08T18:34:23.907482+0000","last_fullsized":"2024-05-08T18:34:23.907482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:23.907379+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:23.907379+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.907379+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:16.891137+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.722083+0000","last_change":"2024-05-08T18:34:32.722108+0000","last_active":"2024-05-08T18:34:32.722083+0000","last_peered":"2024-05-08T18:34:32.722083+0000","last_clean":"2024-05-08T18:34:32.722083+0000","last_became_active":"2024-05-08T18:31:06.312651+0000","last_became_peered":"2024-05-08T18:31:06.312651+0000","last_unstale":"2024-05-08T18:34:32.722083+0000","last_undegraded":"2024-05-08T18:34:32.722083+0000","last_fullsized":"2024-05-08T18:34:32.722083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:32.721992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:32.721992+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.721992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:27.698590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.181404+0000","last_change":"2024-05-08T18:31:08.311373+0000","last_active":"2024-05-08T18:33:38.181404+0000","last_peered":"2024-05-08T18:33:38.181404+0000","last_clean":"2024-05-08T18:33:38.181404+0000","last_became_active":"2024-05-08T18:31:08.311048+0000","last_became_peered":"2024-05-08T18:31:08.311048+0000","last_unstale":"2024-05-08T18:33:38.181404+0000","last_undegraded":"2024-05-08T18:33:38.181404+0000","last_fullsized":"2024-05-08T18:33:38.181404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.247430+0000","last_change":"2024-05-08T18:31:00.296832+0000","last_active":"2024-05-08T18:34:07.247430+0000","last_peered":"2024-05-08T18:34:07.247430+0000","last_clean":"2024-05-08T18:34:07.247430+0000","last_became_active":"2024-05-08T18:31:00.296176+0000","last_became_peered":"2024-05-08T18:31:00.296176+0000","last_unstale":"2024-05-08T18:34:07.247430+0000","last_undegraded":"2024-05-08T18:34:07.247430+0000","last_fullsized":"2024-05-08T18:34:07.247430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.179441+0000","last_change":"2024-05-08T18:30:58.310108+0000","last_active":"2024-05-08T18:33:18.179441+0000","last_peered":"2024-05-08T18:33:18.179441+0000","last_clean":"2024-05-08T18:33:18.179441+0000","last_became_active":"2024-05-08T18:30:58.309339+0000","last_became_peered":"2024-05-08T18:30:58.309339+0000","last_unstale":"2024-05-08T18:33:18.179441+0000","last_undegraded":"2024-05-08T18:33:18.179441+0000","last_fullsized":"2024-05-08T18:33:18.179441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.186928+0000","last_change":"2024-05-08T18:31:45.335793+0000","last_active":"2024-05-08T18:34:13.186928+0000","last_peered":"2024-05-08T18:34:13.186928+0000","last_clean":"2024-05-08T18:34:13.186928+0000","last_became_active":"2024-05-08T18:31:45.335489+0000","last_became_peered":"2024-05-08T18:31:45.335489+0000","last_unstale":"2024-05-08T18:34:13.186928+0000","last_undegraded":"2024-05-08T18:34:13.186928+0000","last_fullsized":"2024-05-08T18:34:13.186928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'16","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.718300+0000","last_change":"2024-05-08T18:34:29.718370+0000","last_active":"2024-05-08T18:34:29.718300+0000","last_peered":"2024-05-08T18:34:29.718300+0000","last_clean":"2024-05-08T18:34:29.718300+0000","last_became_active":"2024-05-08T18:31:04.300022+0000","last_became_peered":"2024-05-08T18:31:04.300022+0000","last_unstale":"2024-05-08T18:34:29.718300+0000","last_undegraded":"2024-05-08T18:34:29.718300+0000","last_fullsized":"2024-05-08T18:34:29.718300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T18:34:29.718201+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T18:34:29.718201+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.718201+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:19.939460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'285","reported_seq":394,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.983680+0000","last_change":"2024-05-08T18:31:06.307960+0000","last_active":"2024-05-08T18:34:13.983680+0000","last_peered":"2024-05-08T18:34:13.983680+0000","last_clean":"2024-05-08T18:34:13.983680+0000","last_became_active":"2024-05-08T18:31:06.306886+0000","last_became_peered":"2024-05-08T18:31:06.306886+0000","last_unstale":"2024-05-08T18:34:13.983680+0000","last_undegraded":"2024-05-08T18:34:13.983680+0000","last_fullsized":"2024-05-08T18:34:13.983680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.182136+0000","last_change":"2024-05-08T18:31:08.312050+0000","last_active":"2024-05-08T18:33:38.182136+0000","last_peered":"2024-05-08T18:33:38.182136+0000","last_clean":"2024-05-08T18:33:38.182136+0000","last_became_active":"2024-05-08T18:31:08.311780+0000","last_became_peered":"2024-05-08T18:31:08.311780+0000","last_unstale":"2024-05-08T18:33:38.182136+0000","last_undegraded":"2024-05-08T18:33:38.182136+0000","last_fullsized":"2024-05-08T18:33:38.182136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.180213+0000","last_change":"2024-05-08T18:31:00.281650+0000","last_active":"2024-05-08T18:33:28.180213+0000","last_peered":"2024-05-08T18:33:28.180213+0000","last_clean":"2024-05-08T18:33:28.180213+0000","last_became_active":"2024-05-08T18:31:00.281268+0000","last_became_peered":"2024-05-08T18:31:00.281268+0000","last_unstale":"2024-05-08T18:33:28.180213+0000","last_undegraded":"2024-05-08T18:33:28.180213+0000","last_fullsized":"2024-05-08T18:33:28.180213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.189682+0000","last_change":"2024-05-08T18:30:58.306638+0000","last_active":"2024-05-08T18:34:07.189682+0000","last_peered":"2024-05-08T18:34:07.189682+0000","last_clean":"2024-05-08T18:34:07.189682+0000","last_became_active":"2024-05-08T18:30:58.303428+0000","last_became_peered":"2024-05-08T18:30:58.303428+0000","last_unstale":"2024-05-08T18:34:07.189682+0000","last_undegraded":"2024-05-08T18:34:07.189682+0000","last_fullsized":"2024-05-08T18:34:07.189682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.686239+0000","last_change":"2024-05-08T18:34:20.686287+0000","last_active":"2024-05-08T18:34:20.686239+0000","last_peered":"2024-05-08T18:34:20.686239+0000","last_clean":"2024-05-08T18:34:20.686239+0000","last_became_active":"2024-05-08T18:31:02.291729+0000","last_became_peered":"2024-05-08T18:31:02.291729+0000","last_unstale":"2024-05-08T18:34:20.686239+0000","last_undegraded":"2024-05-08T18:34:20.686239+0000","last_fullsized":"2024-05-08T18:34:20.686239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:20.686141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:20.686141+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.686141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:15.450176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.681287+0000","last_change":"2024-05-08T18:34:25.681329+0000","last_active":"2024-05-08T18:34:25.681287+0000","last_peered":"2024-05-08T18:34:25.681287+0000","last_clean":"2024-05-08T18:34:25.681287+0000","last_became_active":"2024-05-08T18:31:04.304347+0000","last_became_peered":"2024-05-08T18:31:04.304347+0000","last_unstale":"2024-05-08T18:34:25.681287+0000","last_undegraded":"2024-05-08T18:34:25.681287+0000","last_fullsized":"2024-05-08T18:34:25.681287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:25.681197+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:25.681197+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.681197+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:06.403836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.709773+0000","last_change":"2024-05-08T18:34:22.709806+0000","last_active":"2024-05-08T18:34:22.709773+0000","last_peered":"2024-05-08T18:34:22.709773+0000","last_clean":"2024-05-08T18:34:22.709773+0000","last_became_active":"2024-05-08T18:31:06.305591+0000","last_became_peered":"2024-05-08T18:31:06.305591+0000","last_unstale":"2024-05-08T18:34:22.709773+0000","last_undegraded":"2024-05-08T18:34:22.709773+0000","last_fullsized":"2024-05-08T18:34:22.709773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:22.709682+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:22.709682+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.709682+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:04.769028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'10","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.282978+0000","last_change":"2024-05-08T18:31:00.291398+0000","last_active":"2024-05-08T18:34:07.282978+0000","last_peered":"2024-05-08T18:34:07.282978+0000","last_clean":"2024-05-08T18:34:07.282978+0000","last_became_active":"2024-05-08T18:31:00.290824+0000","last_became_peered":"2024-05-08T18:31:00.290824+0000","last_unstale":"2024-05-08T18:34:07.282978+0000","last_undegraded":"2024-05-08T18:34:07.282978+0000","last_fullsized":"2024-05-08T18:34:07.282978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178086+0000","last_change":"2024-05-08T18:30:58.301227+0000","last_active":"2024-05-08T18:33:13.178086+0000","last_peered":"2024-05-08T18:33:13.178086+0000","last_clean":"2024-05-08T18:33:13.178086+0000","last_became_active":"2024-05-08T18:30:58.300884+0000","last_became_peered":"2024-05-08T18:30:58.300884+0000","last_unstale":"2024-05-08T18:33:13.178086+0000","last_undegraded":"2024-05-08T18:33:13.178086+0000","last_fullsized":"2024-05-08T18:33:13.178086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.781964+0000","last_change":"2024-05-08T18:34:29.781989+0000","last_active":"2024-05-08T18:34:29.781964+0000","last_peered":"2024-05-08T18:34:29.781964+0000","last_clean":"2024-05-08T18:34:29.781964+0000","last_became_active":"2024-05-08T18:31:02.291536+0000","last_became_peered":"2024-05-08T18:31:02.291536+0000","last_unstale":"2024-05-08T18:34:29.781964+0000","last_undegraded":"2024-05-08T18:34:29.781964+0000","last_fullsized":"2024-05-08T18:34:29.781964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:29.781874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:29.781874+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.781874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:12.430820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'52","reported_seq":112,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.726338+0000","last_change":"2024-05-08T18:34:27.726388+0000","last_active":"2024-05-08T18:34:27.726338+0000","last_peered":"2024-05-08T18:34:27.726338+0000","last_clean":"2024-05-08T18:34:27.726338+0000","last_became_active":"2024-05-08T18:31:04.302455+0000","last_became_peered":"2024-05-08T18:31:04.302455+0000","last_unstale":"2024-05-08T18:34:27.726338+0000","last_undegraded":"2024-05-08T18:34:27.726338+0000","last_fullsized":"2024-05-08T18:34:27.726338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'52","last_scrub_stamp":"2024-05-08T18:34:27.726254+0000","last_deep_scrub":"29'52","last_deep_scrub_stamp":"2024-05-08T18:34:27.726254+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.726254+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:57.760805+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.615602+0000","last_change":"2024-05-08T18:34:24.615646+0000","last_active":"2024-05-08T18:34:24.615602+0000","last_peered":"2024-05-08T18:34:24.615602+0000","last_clean":"2024-05-08T18:34:24.615602+0000","last_became_active":"2024-05-08T18:31:06.304979+0000","last_became_peered":"2024-05-08T18:31:06.304979+0000","last_unstale":"2024-05-08T18:34:24.615602+0000","last_undegraded":"2024-05-08T18:34:24.615602+0000","last_fullsized":"2024-05-08T18:34:24.615602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:24.615505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:24.615505+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.615505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:06.690459+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.177952+0000","last_change":"2024-05-08T18:31:08.311725+0000","last_active":"2024-05-08T18:33:13.177952+0000","last_peered":"2024-05-08T18:33:13.177952+0000","last_clean":"2024-05-08T18:33:13.177952+0000","last_became_active":"2024-05-08T18:31:08.311434+0000","last_became_peered":"2024-05-08T18:31:08.311434+0000","last_unstale":"2024-05-08T18:33:13.177952+0000","last_undegraded":"2024-05-08T18:33:13.177952+0000","last_fullsized":"2024-05-08T18:33:13.177952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178060+0000","last_change":"2024-05-08T18:31:00.281267+0000","last_active":"2024-05-08T18:33:13.178060+0000","last_peered":"2024-05-08T18:33:13.178060+0000","last_clean":"2024-05-08T18:33:13.178060+0000","last_became_active":"2024-05-08T18:31:00.280969+0000","last_became_peered":"2024-05-08T18:31:00.280969+0000","last_unstale":"2024-05-08T18:33:13.178060+0000","last_undegraded":"2024-05-08T18:33:13.178060+0000","last_fullsized":"2024-05-08T18:33:13.178060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178036+0000","last_change":"2024-05-08T18:30:58.303460+0000","last_active":"2024-05-08T18:33:13.178036+0000","last_peered":"2024-05-08T18:33:13.178036+0000","last_clean":"2024-05-08T18:33:13.178036+0000","last_became_active":"2024-05-08T18:30:58.302590+0000","last_became_peered":"2024-05-08T18:30:58.302590+0000","last_unstale":"2024-05-08T18:33:13.178036+0000","last_undegraded":"2024-05-08T18:33:13.178036+0000","last_fullsized":"2024-05-08T18:33:13.178036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.177548+0000","last_change":"2024-05-08T18:31:02.289867+0000","last_active":"2024-05-08T18:33:13.177548+0000","last_peered":"2024-05-08T18:33:13.177548+0000","last_clean":"2024-05-08T18:33:13.177548+0000","last_became_active":"2024-05-08T18:31:02.289394+0000","last_became_peered":"2024-05-08T18:31:02.289394+0000","last_unstale":"2024-05-08T18:33:13.177548+0000","last_undegraded":"2024-05-08T18:33:13.177548+0000","last_fullsized":"2024-05-08T18:33:13.177548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'34","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.948313+0000","last_change":"2024-05-08T18:31:04.303291+0000","last_active":"2024-05-08T18:34:13.948313+0000","last_peered":"2024-05-08T18:34:13.948313+0000","last_clean":"2024-05-08T18:34:13.948313+0000","last_became_active":"2024-05-08T18:31:04.302886+0000","last_became_peered":"2024-05-08T18:31:04.302886+0000","last_unstale":"2024-05-08T18:34:13.948313+0000","last_undegraded":"2024-05-08T18:34:13.948313+0000","last_fullsized":"2024-05-08T18:34:13.948313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.644103+0000","last_change":"2024-05-08T18:34:19.644132+0000","last_active":"2024-05-08T18:34:19.644103+0000","last_peered":"2024-05-08T18:34:19.644103+0000","last_clean":"2024-05-08T18:34:19.644103+0000","last_became_active":"2024-05-08T18:31:06.306607+0000","last_became_peered":"2024-05-08T18:31:06.306607+0000","last_unstale":"2024-05-08T18:34:19.644103+0000","last_undegraded":"2024-05-08T18:34:19.644103+0000","last_fullsized":"2024-05-08T18:34:19.644103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:19.644005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:19.644005+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.644005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:04:00.192002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178205+0000","last_change":"2024-05-08T18:31:08.305446+0000","last_active":"2024-05-08T18:33:13.178205+0000","last_peered":"2024-05-08T18:33:13.178205+0000","last_clean":"2024-05-08T18:33:13.178205+0000","last_became_active":"2024-05-08T18:31:08.305127+0000","last_became_peered":"2024-05-08T18:31:08.305127+0000","last_unstale":"2024-05-08T18:33:13.178205+0000","last_undegraded":"2024-05-08T18:33:13.178205+0000","last_fullsized":"2024-05-08T18:33:13.178205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.177915+0000","last_change":"2024-05-08T18:31:00.293425+0000","last_active":"2024-05-08T18:33:13.177915+0000","last_peered":"2024-05-08T18:33:13.177915+0000","last_clean":"2024-05-08T18:33:13.177915+0000","last_became_active":"2024-05-08T18:31:00.293170+0000","last_became_peered":"2024-05-08T18:31:00.293170+0000","last_unstale":"2024-05-08T18:33:13.177915+0000","last_undegraded":"2024-05-08T18:33:13.177915+0000","last_fullsized":"2024-05-08T18:33:13.177915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178671+0000","last_change":"2024-05-08T18:30:58.316505+0000","last_active":"2024-05-08T18:33:13.178671+0000","last_peered":"2024-05-08T18:33:13.178671+0000","last_clean":"2024-05-08T18:33:13.178671+0000","last_became_active":"2024-05-08T18:30:58.314352+0000","last_became_peered":"2024-05-08T18:30:58.314352+0000","last_unstale":"2024-05-08T18:33:13.178671+0000","last_undegraded":"2024-05-08T18:33:13.178671+0000","last_fullsized":"2024-05-08T18:33:13.178671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:03.185535+0000","last_change":"2024-05-08T18:31:45.339752+0000","last_active":"2024-05-08T18:34:03.185535+0000","last_peered":"2024-05-08T18:34:03.185535+0000","last_clean":"2024-05-08T18:34:03.185535+0000","last_became_active":"2024-05-08T18:31:45.339423+0000","last_became_peered":"2024-05-08T18:31:45.339423+0000","last_unstale":"2024-05-08T18:34:03.185535+0000","last_undegraded":"2024-05-08T18:34:03.185535+0000","last_fullsized":"2024-05-08T18:34:03.185535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.605942+0000","last_change":"2024-05-08T18:34:32.606003+0000","last_active":"2024-05-08T18:34:32.605942+0000","last_peered":"2024-05-08T18:34:32.605942+0000","last_clean":"2024-05-08T18:34:32.605942+0000","last_became_active":"2024-05-08T18:31:04.298026+0000","last_became_peered":"2024-05-08T18:31:04.298026+0000","last_unstale":"2024-05-08T18:34:32.605942+0000","last_undegraded":"2024-05-08T18:34:32.605942+0000","last_fullsized":"2024-05-08T18:34:32.605942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T18:34:32.605858+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T18:34:32.605858+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.605858+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:39.227348+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":366,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.673032+0000","last_change":"2024-05-08T18:34:18.673057+0000","last_active":"2024-05-08T18:34:18.673032+0000","last_peered":"2024-05-08T18:34:18.673032+0000","last_clean":"2024-05-08T18:34:18.673032+0000","last_became_active":"2024-05-08T18:31:06.306655+0000","last_became_peered":"2024-05-08T18:31:06.306655+0000","last_unstale":"2024-05-08T18:34:18.673032+0000","last_undegraded":"2024-05-08T18:34:18.673032+0000","last_fullsized":"2024-05-08T18:34:18.673032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:18.672962+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:18.672962+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.672962+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:15.669294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178617+0000","last_change":"2024-05-08T18:31:08.314593+0000","last_active":"2024-05-08T18:33:18.178617+0000","last_peered":"2024-05-08T18:33:18.178617+0000","last_clean":"2024-05-08T18:33:18.178617+0000","last_became_active":"2024-05-08T18:31:08.314273+0000","last_became_peered":"2024-05-08T18:31:08.314273+0000","last_unstale":"2024-05-08T18:33:18.178617+0000","last_undegraded":"2024-05-08T18:33:18.178617+0000","last_fullsized":"2024-05-08T18:33:18.178617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178881+0000","last_change":"2024-05-08T18:31:00.283193+0000","last_active":"2024-05-08T18:33:18.178881+0000","last_peered":"2024-05-08T18:33:18.178881+0000","last_clean":"2024-05-08T18:33:18.178881+0000","last_became_active":"2024-05-08T18:31:00.282941+0000","last_became_peered":"2024-05-08T18:31:00.282941+0000","last_unstale":"2024-05-08T18:33:18.178881+0000","last_undegraded":"2024-05-08T18:33:18.178881+0000","last_fullsized":"2024-05-08T18:33:18.178881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178604+0000","last_change":"2024-05-08T18:30:58.316967+0000","last_active":"2024-05-08T18:33:13.178604+0000","last_peered":"2024-05-08T18:33:13.178604+0000","last_clean":"2024-05-08T18:33:13.178604+0000","last_became_active":"2024-05-08T18:30:58.313431+0000","last_became_peered":"2024-05-08T18:30:58.313431+0000","last_unstale":"2024-05-08T18:33:13.178604+0000","last_undegraded":"2024-05-08T18:33:13.178604+0000","last_fullsized":"2024-05-08T18:33:13.178604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.177619+0000","last_change":"2024-05-08T18:31:02.290051+0000","last_active":"2024-05-08T18:33:13.177619+0000","last_peered":"2024-05-08T18:33:13.177619+0000","last_clean":"2024-05-08T18:33:13.177619+0000","last_became_active":"2024-05-08T18:31:02.289669+0000","last_became_peered":"2024-05-08T18:31:02.289669+0000","last_unstale":"2024-05-08T18:33:13.177619+0000","last_undegraded":"2024-05-08T18:33:13.177619+0000","last_fullsized":"2024-05-08T18:33:13.177619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'62","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.956713+0000","last_change":"2024-05-08T18:31:04.302553+0000","last_active":"2024-05-08T18:34:13.956713+0000","last_peered":"2024-05-08T18:34:13.956713+0000","last_clean":"2024-05-08T18:34:13.956713+0000","last_became_active":"2024-05-08T18:31:04.302244+0000","last_became_peered":"2024-05-08T18:31:04.302244+0000","last_unstale":"2024-05-08T18:34:13.956713+0000","last_undegraded":"2024-05-08T18:34:13.956713+0000","last_fullsized":"2024-05-08T18:34:13.956713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.686336+0000","last_change":"2024-05-08T18:34:21.686381+0000","last_active":"2024-05-08T18:34:21.686336+0000","last_peered":"2024-05-08T18:34:21.686336+0000","last_clean":"2024-05-08T18:34:21.686336+0000","last_became_active":"2024-05-08T18:31:06.308806+0000","last_became_peered":"2024-05-08T18:31:06.308806+0000","last_unstale":"2024-05-08T18:34:21.686336+0000","last_undegraded":"2024-05-08T18:34:21.686336+0000","last_fullsized":"2024-05-08T18:34:21.686336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:21.686225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:21.686225+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.686225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:12.963774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.384919+0000","last_change":"2024-05-08T18:31:08.319703+0000","last_active":"2024-05-08T18:34:07.384919+0000","last_peered":"2024-05-08T18:34:07.384919+0000","last_clean":"2024-05-08T18:34:07.384919+0000","last_became_active":"2024-05-08T18:31:08.319370+0000","last_became_peered":"2024-05-08T18:31:08.319370+0000","last_unstale":"2024-05-08T18:34:07.384919+0000","last_undegraded":"2024-05-08T18:34:07.384919+0000","last_fullsized":"2024-05-08T18:34:07.384919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.179074+0000","last_change":"2024-05-08T18:31:00.292416+0000","last_active":"2024-05-08T18:33:18.179074+0000","last_peered":"2024-05-08T18:33:18.179074+0000","last_clean":"2024-05-08T18:33:18.179074+0000","last_became_active":"2024-05-08T18:31:00.292154+0000","last_became_peered":"2024-05-08T18:31:00.292154+0000","last_unstale":"2024-05-08T18:33:18.179074+0000","last_undegraded":"2024-05-08T18:33:18.179074+0000","last_fullsized":"2024-05-08T18:33:18.179074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.177647+0000","last_change":"2024-05-08T18:30:58.294896+0000","last_active":"2024-05-08T18:33:13.177647+0000","last_peered":"2024-05-08T18:33:13.177647+0000","last_clean":"2024-05-08T18:33:13.177647+0000","last_became_active":"2024-05-08T18:30:58.294377+0000","last_became_peered":"2024-05-08T18:30:58.294377+0000","last_unstale":"2024-05-08T18:33:13.177647+0000","last_undegraded":"2024-05-08T18:33:13.177647+0000","last_fullsized":"2024-05-08T18:33:13.177647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178933+0000","last_change":"2024-05-08T18:31:02.294000+0000","last_active":"2024-05-08T18:33:18.178933+0000","last_peered":"2024-05-08T18:33:18.178933+0000","last_clean":"2024-05-08T18:33:18.178933+0000","last_became_active":"2024-05-08T18:31:02.293680+0000","last_became_peered":"2024-05-08T18:31:02.293680+0000","last_unstale":"2024-05-08T18:33:18.178933+0000","last_undegraded":"2024-05-08T18:33:18.178933+0000","last_fullsized":"2024-05-08T18:33:18.178933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'40","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.864211+0000","last_change":"2024-05-08T18:34:22.864247+0000","last_active":"2024-05-08T18:34:22.864211+0000","last_peered":"2024-05-08T18:34:22.864211+0000","last_clean":"2024-05-08T18:34:22.864211+0000","last_became_active":"2024-05-08T18:31:04.301147+0000","last_became_peered":"2024-05-08T18:31:04.301147+0000","last_unstale":"2024-05-08T18:34:22.864211+0000","last_undegraded":"2024-05-08T18:34:22.864211+0000","last_fullsized":"2024-05-08T18:34:22.864211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-08T18:34:22.864124+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-08T18:34:22.864124+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.864124+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:04.923471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.180508+0000","last_change":"2024-05-08T18:31:06.309848+0000","last_active":"2024-05-08T18:33:23.180508+0000","last_peered":"2024-05-08T18:33:23.180508+0000","last_clean":"2024-05-08T18:33:23.180508+0000","last_became_active":"2024-05-08T18:31:06.308804+0000","last_became_peered":"2024-05-08T18:31:06.308804+0000","last_unstale":"2024-05-08T18:33:23.180508+0000","last_undegraded":"2024-05-08T18:33:23.180508+0000","last_fullsized":"2024-05-08T18:33:23.180508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.337225+0000","last_change":"2024-05-08T18:31:08.320629+0000","last_active":"2024-05-08T18:34:07.337225+0000","last_peered":"2024-05-08T18:34:07.337225+0000","last_clean":"2024-05-08T18:34:07.337225+0000","last_became_active":"2024-05-08T18:31:08.320150+0000","last_became_peered":"2024-05-08T18:31:08.320150+0000","last_unstale":"2024-05-08T18:34:07.337225+0000","last_undegraded":"2024-05-08T18:34:07.337225+0000","last_fullsized":"2024-05-08T18:34:07.337225+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'4","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.629660+0000","last_change":"2024-05-08T18:34:31.629691+0000","last_active":"2024-05-08T18:34:31.629660+0000","last_peered":"2024-05-08T18:34:31.629660+0000","last_clean":"2024-05-08T18:34:31.629660+0000","last_became_active":"2024-05-08T18:31:00.299379+0000","last_became_peered":"2024-05-08T18:31:00.299379+0000","last_unstale":"2024-05-08T18:34:31.629660+0000","last_undegraded":"2024-05-08T18:34:31.629660+0000","last_fullsized":"2024-05-08T18:34:31.629660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:31.629577+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:31.629577+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.629577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:03.532639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177806+0000","last_change":"2024-05-08T18:30:58.316845+0000","last_active":"2024-05-08T18:33:08.177806+0000","last_peered":"2024-05-08T18:33:08.177806+0000","last_clean":"2024-05-08T18:33:08.177806+0000","last_became_active":"2024-05-08T18:30:58.315625+0000","last_became_peered":"2024-05-08T18:30:58.315625+0000","last_unstale":"2024-05-08T18:33:08.177806+0000","last_undegraded":"2024-05-08T18:33:08.177806+0000","last_fullsized":"2024-05-08T18:33:08.177806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178578+0000","last_change":"2024-05-08T18:31:02.290296+0000","last_active":"2024-05-08T18:33:18.178578+0000","last_peered":"2024-05-08T18:33:18.178578+0000","last_clean":"2024-05-08T18:33:18.178578+0000","last_became_active":"2024-05-08T18:31:02.289767+0000","last_became_peered":"2024-05-08T18:31:02.289767+0000","last_unstale":"2024-05-08T18:33:18.178578+0000","last_undegraded":"2024-05-08T18:33:18.178578+0000","last_fullsized":"2024-05-08T18:33:18.178578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.740564+0000","last_change":"2024-05-08T18:34:31.740604+0000","last_active":"2024-05-08T18:34:31.740564+0000","last_peered":"2024-05-08T18:34:31.740564+0000","last_clean":"2024-05-08T18:34:31.740564+0000","last_became_active":"2024-05-08T18:31:04.294573+0000","last_became_peered":"2024-05-08T18:31:04.294573+0000","last_unstale":"2024-05-08T18:34:31.740564+0000","last_undegraded":"2024-05-08T18:34:31.740564+0000","last_fullsized":"2024-05-08T18:34:31.740564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T18:34:31.740471+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T18:34:31.740471+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.740471+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:36.592489+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":442,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.729935+0000","last_change":"2024-05-08T18:34:28.729967+0000","last_active":"2024-05-08T18:34:28.729935+0000","last_peered":"2024-05-08T18:34:28.729935+0000","last_clean":"2024-05-08T18:34:28.729935+0000","last_became_active":"2024-05-08T18:31:06.312203+0000","last_became_peered":"2024-05-08T18:31:06.312203+0000","last_unstale":"2024-05-08T18:34:28.729935+0000","last_undegraded":"2024-05-08T18:34:28.729935+0000","last_fullsized":"2024-05-08T18:34:28.729935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:28.729835+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:28.729835+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.729835+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:42.916625+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'14","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.339077+0000","last_change":"2024-05-08T18:31:08.314495+0000","last_active":"2024-05-08T18:34:07.339077+0000","last_peered":"2024-05-08T18:34:07.339077+0000","last_clean":"2024-05-08T18:34:07.339077+0000","last_became_active":"2024-05-08T18:31:08.314171+0000","last_became_peered":"2024-05-08T18:31:08.314171+0000","last_unstale":"2024-05-08T18:34:07.339077+0000","last_undegraded":"2024-05-08T18:34:07.339077+0000","last_fullsized":"2024-05-08T18:34:07.339077+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.247674+0000","last_change":"2024-05-08T18:31:00.292788+0000","last_active":"2024-05-08T18:34:07.247674+0000","last_peered":"2024-05-08T18:34:07.247674+0000","last_clean":"2024-05-08T18:34:07.247674+0000","last_became_active":"2024-05-08T18:31:00.292521+0000","last_became_peered":"2024-05-08T18:31:00.292521+0000","last_unstale":"2024-05-08T18:34:07.247674+0000","last_undegraded":"2024-05-08T18:34:07.247674+0000","last_fullsized":"2024-05-08T18:34:07.247674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177769+0000","last_change":"2024-05-08T18:30:58.310166+0000","last_active":"2024-05-08T18:33:08.177769+0000","last_peered":"2024-05-08T18:33:08.177769+0000","last_clean":"2024-05-08T18:33:08.177769+0000","last_became_active":"2024-05-08T18:30:58.309773+0000","last_became_peered":"2024-05-08T18:30:58.309773+0000","last_unstale":"2024-05-08T18:33:08.177769+0000","last_undegraded":"2024-05-08T18:33:08.177769+0000","last_fullsized":"2024-05-08T18:33:08.177769+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'5","reported_seq":428,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.729392+0000","last_change":"2024-05-08T18:34:31.729420+0000","last_active":"2024-05-08T18:34:31.729392+0000","last_peered":"2024-05-08T18:34:31.729392+0000","last_clean":"2024-05-08T18:34:31.729392+0000","last_became_active":"2024-05-08T18:31:02.289253+0000","last_became_peered":"2024-05-08T18:31:02.289253+0000","last_unstale":"2024-05-08T18:34:31.729392+0000","last_undegraded":"2024-05-08T18:34:31.729392+0000","last_fullsized":"2024-05-08T18:34:31.729392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T18:34:31.729298+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T18:34:31.729298+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.729298+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:22.601345+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.180438+0000","last_change":"2024-05-08T18:31:04.304088+0000","last_active":"2024-05-08T18:33:23.180438+0000","last_peered":"2024-05-08T18:33:23.180438+0000","last_clean":"2024-05-08T18:33:23.180438+0000","last_became_active":"2024-05-08T18:31:04.303799+0000","last_became_peered":"2024-05-08T18:31:04.303799+0000","last_unstale":"2024-05-08T18:33:23.180438+0000","last_undegraded":"2024-05-08T18:33:23.180438+0000","last_fullsized":"2024-05-08T18:33:23.180438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":471,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.900060+0000","last_change":"2024-05-08T18:34:18.900106+0000","last_active":"2024-05-08T18:34:18.900060+0000","last_peered":"2024-05-08T18:34:18.900060+0000","last_clean":"2024-05-08T18:34:18.900060+0000","last_became_active":"2024-05-08T18:31:06.305201+0000","last_became_peered":"2024-05-08T18:31:06.305201+0000","last_unstale":"2024-05-08T18:34:18.900060+0000","last_undegraded":"2024-05-08T18:34:18.900060+0000","last_fullsized":"2024-05-08T18:34:18.900060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:18.899957+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:18.899957+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.899957+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:33.086747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.177901+0000","last_change":"2024-05-08T18:31:08.311212+0000","last_active":"2024-05-08T18:33:13.177901+0000","last_peered":"2024-05-08T18:33:13.177901+0000","last_clean":"2024-05-08T18:33:13.177901+0000","last_became_active":"2024-05-08T18:31:08.310906+0000","last_became_peered":"2024-05-08T18:31:08.310906+0000","last_unstale":"2024-05-08T18:33:13.177901+0000","last_undegraded":"2024-05-08T18:33:13.177901+0000","last_fullsized":"2024-05-08T18:33:13.177901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'14","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.282899+0000","last_change":"2024-05-08T18:31:00.292227+0000","last_active":"2024-05-08T18:34:07.282899+0000","last_peered":"2024-05-08T18:34:07.282899+0000","last_clean":"2024-05-08T18:34:07.282899+0000","last_became_active":"2024-05-08T18:31:00.291563+0000","last_became_peered":"2024-05-08T18:31:00.291563+0000","last_unstale":"2024-05-08T18:34:07.282899+0000","last_undegraded":"2024-05-08T18:34:07.282899+0000","last_fullsized":"2024-05-08T18:34:07.282899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177725+0000","last_change":"2024-05-08T18:30:58.304032+0000","last_active":"2024-05-08T18:33:08.177725+0000","last_peered":"2024-05-08T18:33:08.177725+0000","last_clean":"2024-05-08T18:33:08.177725+0000","last_became_active":"2024-05-08T18:30:58.302966+0000","last_became_peered":"2024-05-08T18:30:58.302966+0000","last_unstale":"2024-05-08T18:33:08.177725+0000","last_undegraded":"2024-05-08T18:33:08.177725+0000","last_fullsized":"2024-05-08T18:33:08.177725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.676566+0000","last_change":"2024-05-08T18:34:28.676588+0000","last_active":"2024-05-08T18:34:28.676566+0000","last_peered":"2024-05-08T18:34:28.676566+0000","last_clean":"2024-05-08T18:34:28.676566+0000","last_became_active":"2024-05-08T18:31:02.288232+0000","last_became_peered":"2024-05-08T18:31:02.288232+0000","last_unstale":"2024-05-08T18:34:28.676566+0000","last_undegraded":"2024-05-08T18:34:28.676566+0000","last_fullsized":"2024-05-08T18:34:28.676566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:28.676467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:28.676467+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.676467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:08.488393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'48","reported_seq":107,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.893918+0000","last_change":"2024-05-08T18:34:19.893987+0000","last_active":"2024-05-08T18:34:19.893918+0000","last_peered":"2024-05-08T18:34:19.893918+0000","last_clean":"2024-05-08T18:34:19.893918+0000","last_became_active":"2024-05-08T18:31:04.301298+0000","last_became_peered":"2024-05-08T18:31:04.301298+0000","last_unstale":"2024-05-08T18:34:19.893918+0000","last_undegraded":"2024-05-08T18:34:19.893918+0000","last_fullsized":"2024-05-08T18:34:19.893918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-05-08T18:34:19.893818+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-05-08T18:34:19.893818+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.893818+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:10.115077+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.544426+0000","last_change":"2024-05-08T18:34:18.544453+0000","last_active":"2024-05-08T18:34:18.544426+0000","last_peered":"2024-05-08T18:34:18.544426+0000","last_clean":"2024-05-08T18:34:18.544426+0000","last_became_active":"2024-05-08T18:31:06.310430+0000","last_became_peered":"2024-05-08T18:31:06.310430+0000","last_unstale":"2024-05-08T18:34:18.544426+0000","last_undegraded":"2024-05-08T18:34:18.544426+0000","last_fullsized":"2024-05-08T18:34:18.544426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:18.544327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:18.544327+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.544327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:32.447203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.383067+0000","last_change":"2024-05-08T18:31:08.307711+0000","last_active":"2024-05-08T18:34:07.383067+0000","last_peered":"2024-05-08T18:34:07.383067+0000","last_clean":"2024-05-08T18:34:07.383067+0000","last_became_active":"2024-05-08T18:31:08.306492+0000","last_became_peered":"2024-05-08T18:31:08.306492+0000","last_unstale":"2024-05-08T18:34:07.383067+0000","last_undegraded":"2024-05-08T18:34:07.383067+0000","last_fullsized":"2024-05-08T18:34:07.383067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'6","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.283010+0000","last_change":"2024-05-08T18:31:00.299933+0000","last_active":"2024-05-08T18:34:07.283010+0000","last_peered":"2024-05-08T18:34:07.283010+0000","last_clean":"2024-05-08T18:34:07.283010+0000","last_became_active":"2024-05-08T18:31:00.299186+0000","last_became_peered":"2024-05-08T18:31:00.299186+0000","last_unstale":"2024-05-08T18:34:07.283010+0000","last_undegraded":"2024-05-08T18:34:07.283010+0000","last_fullsized":"2024-05-08T18:34:07.283010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":138,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:53.175029+0000","last_change":"2024-05-08T18:30:49.982170+0000","last_active":"2024-05-08T18:32:53.175029+0000","last_peered":"2024-05-08T18:32:53.175029+0000","last_clean":"2024-05-08T18:32:53.175029+0000","last_became_active":"2024-05-08T18:30:49.981852+0000","last_became_peered":"2024-05-08T18:30:49.981852+0000","last_unstale":"2024-05-08T18:32:53.175029+0000","last_undegraded":"2024-05-08T18:32:53.175029+0000","last_fullsized":"2024-05-08T18:32:53.175029+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:58.176462+0000","last_change":"2024-05-08T18:30:49.983387+0000","last_active":"2024-05-08T18:32:58.176462+0000","last_peered":"2024-05-08T18:32:58.176462+0000","last_clean":"2024-05-08T18:32:58.176462+0000","last_became_active":"2024-05-08T18:30:49.983023+0000","last_became_peered":"2024-05-08T18:30:49.983023+0000","last_unstale":"2024-05-08T18:32:58.176462+0000","last_undegraded":"2024-05-08T18:32:58.176462+0000","last_fullsized":"2024-05-08T18:32:58.176462+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.177048+0000","last_change":"2024-05-08T18:30:58.317086+0000","last_active":"2024-05-08T18:33:03.177048+0000","last_peered":"2024-05-08T18:33:03.177048+0000","last_clean":"2024-05-08T18:33:03.177048+0000","last_became_active":"2024-05-08T18:30:58.316676+0000","last_became_peered":"2024-05-08T18:30:58.316676+0000","last_unstale":"2024-05-08T18:33:03.177048+0000","last_undegraded":"2024-05-08T18:33:03.177048+0000","last_fullsized":"2024-05-08T18:33:03.177048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177304+0000","last_change":"2024-05-08T18:31:45.339419+0000","last_active":"2024-05-08T18:33:08.177304+0000","last_peered":"2024-05-08T18:33:08.177304+0000","last_clean":"2024-05-08T18:33:08.177304+0000","last_became_active":"2024-05-08T18:31:45.339007+0000","last_became_peered":"2024-05-08T18:31:45.339007+0000","last_unstale":"2024-05-08T18:33:08.177304+0000","last_undegraded":"2024-05-08T18:33:08.177304+0000","last_fullsized":"2024-05-08T18:33:08.177304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'85","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.916695+0000","last_change":"2024-05-08T18:31:04.299443+0000","last_active":"2024-05-08T18:34:13.916695+0000","last_peered":"2024-05-08T18:34:13.916695+0000","last_clean":"2024-05-08T18:34:13.916695+0000","last_became_active":"2024-05-08T18:31:04.299145+0000","last_became_peered":"2024-05-08T18:31:04.299145+0000","last_unstale":"2024-05-08T18:34:13.916695+0000","last_undegraded":"2024-05-08T18:34:13.916695+0000","last_fullsized":"2024-05-08T18:34:13.916695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178626+0000","last_change":"2024-05-08T18:31:06.312091+0000","last_active":"2024-05-08T18:33:18.178626+0000","last_peered":"2024-05-08T18:33:18.178626+0000","last_clean":"2024-05-08T18:33:18.178626+0000","last_became_active":"2024-05-08T18:31:06.311742+0000","last_became_peered":"2024-05-08T18:31:06.311742+0000","last_unstale":"2024-05-08T18:33:18.178626+0000","last_undegraded":"2024-05-08T18:33:18.178626+0000","last_fullsized":"2024-05-08T18:33:18.178626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'87","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.290529+0000","last_change":"2024-05-08T18:31:08.311008+0000","last_active":"2024-05-08T18:34:07.290529+0000","last_peered":"2024-05-08T18:34:07.290529+0000","last_clean":"2024-05-08T18:34:07.290529+0000","last_became_active":"2024-05-08T18:31:08.310715+0000","last_became_peered":"2024-05-08T18:31:08.310715+0000","last_unstale":"2024-05-08T18:34:07.290529+0000","last_undegraded":"2024-05-08T18:34:07.290529+0000","last_fullsized":"2024-05-08T18:34:07.290529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":173,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'12","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.063034+0000","last_change":"2024-05-08T18:31:00.295877+0000","last_active":"2024-05-08T18:34:07.063034+0000","last_peered":"2024-05-08T18:34:07.063034+0000","last_clean":"2024-05-08T18:34:07.063034+0000","last_became_active":"2024-05-08T18:31:00.295578+0000","last_became_peered":"2024-05-08T18:31:00.295578+0000","last_unstale":"2024-05-08T18:34:07.063034+0000","last_undegraded":"2024-05-08T18:34:07.063034+0000","last_fullsized":"2024-05-08T18:34:07.063034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:53.175654+0000","last_change":"2024-05-08T18:30:49.983190+0000","last_active":"2024-05-08T18:32:53.175654+0000","last_peered":"2024-05-08T18:32:53.175654+0000","last_clean":"2024-05-08T18:32:53.175654+0000","last_became_active":"2024-05-08T18:30:49.982854+0000","last_became_peered":"2024-05-08T18:30:49.982854+0000","last_unstale":"2024-05-08T18:32:53.175654+0000","last_undegraded":"2024-05-08T18:32:53.175654+0000","last_fullsized":"2024-05-08T18:32:53.175654+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.926833+0000","last_change":"2024-05-08T18:30:58.295078+0000","last_active":"2024-05-08T18:34:13.926833+0000","last_peered":"2024-05-08T18:34:13.926833+0000","last_clean":"2024-05-08T18:34:13.926833+0000","last_became_active":"2024-05-08T18:30:58.294153+0000","last_became_peered":"2024-05-08T18:30:58.294153+0000","last_unstale":"2024-05-08T18:34:13.926833+0000","last_undegraded":"2024-05-08T18:34:13.926833+0000","last_fullsized":"2024-05-08T18:34:13.926833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.642307+0000","last_change":"2024-05-08T18:34:19.642347+0000","last_active":"2024-05-08T18:34:19.642307+0000","last_peered":"2024-05-08T18:34:19.642307+0000","last_clean":"2024-05-08T18:34:19.642307+0000","last_became_active":"2024-05-08T18:31:02.291979+0000","last_became_peered":"2024-05-08T18:31:02.291979+0000","last_unstale":"2024-05-08T18:34:19.642307+0000","last_undegraded":"2024-05-08T18:34:19.642307+0000","last_fullsized":"2024-05-08T18:34:19.642307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:19.642214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:19.642214+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.642214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:44.702640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'291","reported_seq":516,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.858095+0000","last_change":"2024-05-08T18:34:25.858141+0000","last_active":"2024-05-08T18:34:25.858095+0000","last_peered":"2024-05-08T18:34:25.858095+0000","last_clean":"2024-05-08T18:34:25.858095+0000","last_became_active":"2024-05-08T18:31:04.299494+0000","last_became_peered":"2024-05-08T18:31:04.299494+0000","last_unstale":"2024-05-08T18:34:25.858095+0000","last_undegraded":"2024-05-08T18:34:25.858095+0000","last_fullsized":"2024-05-08T18:34:25.858095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'291","last_scrub_stamp":"2024-05-08T18:34:25.858006+0000","last_deep_scrub":"29'291","last_deep_scrub_stamp":"2024-05-08T18:34:25.858006+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.858006+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:00.713371+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178634+0000","last_change":"2024-05-08T18:31:06.307338+0000","last_active":"2024-05-08T18:33:13.178634+0000","last_peered":"2024-05-08T18:33:13.178634+0000","last_clean":"2024-05-08T18:33:13.178634+0000","last_became_active":"2024-05-08T18:31:06.306554+0000","last_became_peered":"2024-05-08T18:31:06.306554+0000","last_unstale":"2024-05-08T18:33:13.178634+0000","last_undegraded":"2024-05-08T18:33:13.178634+0000","last_fullsized":"2024-05-08T18:33:13.178634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178987+0000","last_change":"2024-05-08T18:31:08.316829+0000","last_active":"2024-05-08T18:33:18.178987+0000","last_peered":"2024-05-08T18:33:18.178987+0000","last_clean":"2024-05-08T18:33:18.178987+0000","last_became_active":"2024-05-08T18:31:08.316536+0000","last_became_peered":"2024-05-08T18:31:08.316536+0000","last_unstale":"2024-05-08T18:33:18.178987+0000","last_undegraded":"2024-05-08T18:33:18.178987+0000","last_fullsized":"2024-05-08T18:33:18.178987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.334180+0000","last_change":"2024-05-08T18:31:00.281674+0000","last_active":"2024-05-08T18:34:07.334180+0000","last_peered":"2024-05-08T18:34:07.334180+0000","last_clean":"2024-05-08T18:34:07.334180+0000","last_became_active":"2024-05-08T18:31:00.281359+0000","last_became_peered":"2024-05-08T18:31:00.281359+0000","last_unstale":"2024-05-08T18:34:07.334180+0000","last_undegraded":"2024-05-08T18:34:07.334180+0000","last_fullsized":"2024-05-08T18:34:07.334180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:53.175040+0000","last_change":"2024-05-08T18:30:49.982800+0000","last_active":"2024-05-08T18:32:53.175040+0000","last_peered":"2024-05-08T18:32:53.175040+0000","last_clean":"2024-05-08T18:32:53.175040+0000","last_became_active":"2024-05-08T18:30:49.982438+0000","last_became_peered":"2024-05-08T18:30:49.982438+0000","last_unstale":"2024-05-08T18:32:53.175040+0000","last_undegraded":"2024-05-08T18:32:53.175040+0000","last_fullsized":"2024-05-08T18:32:53.175040+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:58.175152+0000","last_change":"2024-05-08T18:30:58.294820+0000","last_active":"2024-05-08T18:32:58.175152+0000","last_peered":"2024-05-08T18:32:58.175152+0000","last_clean":"2024-05-08T18:32:58.175152+0000","last_became_active":"2024-05-08T18:30:58.294292+0000","last_became_peered":"2024-05-08T18:30:58.294292+0000","last_unstale":"2024-05-08T18:32:58.175152+0000","last_undegraded":"2024-05-08T18:32:58.175152+0000","last_fullsized":"2024-05-08T18:32:58.175152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178023+0000","last_change":"2024-05-08T18:31:02.292271+0000","last_active":"2024-05-08T18:33:13.178023+0000","last_peered":"2024-05-08T18:33:13.178023+0000","last_clean":"2024-05-08T18:33:13.178023+0000","last_became_active":"2024-05-08T18:31:02.291806+0000","last_became_peered":"2024-05-08T18:31:02.291806+0000","last_unstale":"2024-05-08T18:33:13.178023+0000","last_undegraded":"2024-05-08T18:33:13.178023+0000","last_fullsized":"2024-05-08T18:33:13.178023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.698631+0000","last_change":"2024-05-08T18:34:26.698673+0000","last_active":"2024-05-08T18:34:26.698631+0000","last_peered":"2024-05-08T18:34:26.698631+0000","last_clean":"2024-05-08T18:34:26.698631+0000","last_became_active":"2024-05-08T18:31:04.303321+0000","last_became_peered":"2024-05-08T18:31:04.303321+0000","last_unstale":"2024-05-08T18:34:26.698631+0000","last_undegraded":"2024-05-08T18:34:26.698631+0000","last_fullsized":"2024-05-08T18:34:26.698631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-05-08T18:34:26.698537+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-05-08T18:34:26.698537+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.698537+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:44.151622+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.566377+0000","last_change":"2024-05-08T18:34:25.566404+0000","last_active":"2024-05-08T18:34:25.566377+0000","last_peered":"2024-05-08T18:34:25.566377+0000","last_clean":"2024-05-08T18:34:25.566377+0000","last_became_active":"2024-05-08T18:31:06.309525+0000","last_became_peered":"2024-05-08T18:31:06.309525+0000","last_unstale":"2024-05-08T18:34:25.566377+0000","last_undegraded":"2024-05-08T18:34:25.566377+0000","last_fullsized":"2024-05-08T18:34:25.566377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:25.566280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:25.566280+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.566280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:00.421645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'8","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.180348+0000","last_change":"2024-05-08T18:31:08.314823+0000","last_active":"2024-05-08T18:33:23.180348+0000","last_peered":"2024-05-08T18:33:23.180348+0000","last_clean":"2024-05-08T18:33:23.180348+0000","last_became_active":"2024-05-08T18:31:08.314503+0000","last_became_peered":"2024-05-08T18:31:08.314503+0000","last_unstale":"2024-05-08T18:33:23.180348+0000","last_undegraded":"2024-05-08T18:33:23.180348+0000","last_fullsized":"2024-05-08T18:33:23.180348+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.176845+0000","last_change":"2024-05-08T18:31:00.283770+0000","last_active":"2024-05-08T18:33:08.176845+0000","last_peered":"2024-05-08T18:33:08.176845+0000","last_clean":"2024-05-08T18:33:08.176845+0000","last_became_active":"2024-05-08T18:31:00.283410+0000","last_became_peered":"2024-05-08T18:31:00.283410+0000","last_unstale":"2024-05-08T18:33:08.176845+0000","last_undegraded":"2024-05-08T18:33:08.176845+0000","last_fullsized":"2024-05-08T18:33:08.176845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:53.175731+0000","last_change":"2024-05-08T18:30:49.983911+0000","last_active":"2024-05-08T18:32:53.175731+0000","last_peered":"2024-05-08T18:32:53.175731+0000","last_clean":"2024-05-08T18:32:53.175731+0000","last_became_active":"2024-05-08T18:30:49.983515+0000","last_became_peered":"2024-05-08T18:30:49.983515+0000","last_unstale":"2024-05-08T18:32:53.175731+0000","last_undegraded":"2024-05-08T18:32:53.175731+0000","last_fullsized":"2024-05-08T18:32:53.175731+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176368+0000","last_change":"2024-05-08T18:30:58.306622+0000","last_active":"2024-05-08T18:33:03.176368+0000","last_peered":"2024-05-08T18:33:03.176368+0000","last_clean":"2024-05-08T18:33:03.176368+0000","last_became_active":"2024-05-08T18:30:58.306268+0000","last_became_peered":"2024-05-08T18:30:58.306268+0000","last_unstale":"2024-05-08T18:33:03.176368+0000","last_undegraded":"2024-05-08T18:33:03.176368+0000","last_fullsized":"2024-05-08T18:33:03.176368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.176857+0000","last_change":"2024-05-08T18:31:02.292466+0000","last_active":"2024-05-08T18:33:08.176857+0000","last_peered":"2024-05-08T18:33:08.176857+0000","last_clean":"2024-05-08T18:33:08.176857+0000","last_became_active":"2024-05-08T18:31:02.292030+0000","last_became_peered":"2024-05-08T18:31:02.292030+0000","last_unstale":"2024-05-08T18:33:08.176857+0000","last_undegraded":"2024-05-08T18:33:08.176857+0000","last_fullsized":"2024-05-08T18:33:08.176857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.698435+0000","last_change":"2024-05-08T18:34:24.698478+0000","last_active":"2024-05-08T18:34:24.698435+0000","last_peered":"2024-05-08T18:34:24.698435+0000","last_clean":"2024-05-08T18:34:24.698435+0000","last_became_active":"2024-05-08T18:31:04.296257+0000","last_became_peered":"2024-05-08T18:31:04.296257+0000","last_unstale":"2024-05-08T18:34:24.698435+0000","last_undegraded":"2024-05-08T18:34:24.698435+0000","last_fullsized":"2024-05-08T18:34:24.698435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-08T18:34:24.698350+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-08T18:34:24.698350+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.698350+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:44.670942+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.179627+0000","last_change":"2024-05-08T18:31:06.309173+0000","last_active":"2024-05-08T18:33:18.179627+0000","last_peered":"2024-05-08T18:33:18.179627+0000","last_clean":"2024-05-08T18:33:18.179627+0000","last_became_active":"2024-05-08T18:31:06.308892+0000","last_became_peered":"2024-05-08T18:31:06.308892+0000","last_unstale":"2024-05-08T18:33:18.179627+0000","last_undegraded":"2024-05-08T18:33:18.179627+0000","last_fullsized":"2024-05-08T18:33:18.179627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178889+0000","last_change":"2024-05-08T18:31:08.319035+0000","last_active":"2024-05-08T18:33:18.178889+0000","last_peered":"2024-05-08T18:33:18.178889+0000","last_clean":"2024-05-08T18:33:18.178889+0000","last_became_active":"2024-05-08T18:31:08.318728+0000","last_became_peered":"2024-05-08T18:31:08.318728+0000","last_unstale":"2024-05-08T18:33:18.178889+0000","last_undegraded":"2024-05-08T18:33:18.178889+0000","last_fullsized":"2024-05-08T18:33:18.178889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'3","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.328661+0000","last_change":"2024-05-08T18:31:45.344716+0000","last_active":"2024-05-08T18:34:07.328661+0000","last_peered":"2024-05-08T18:34:07.328661+0000","last_clean":"2024-05-08T18:34:07.328661+0000","last_became_active":"2024-05-08T18:31:45.337785+0000","last_became_peered":"2024-05-08T18:31:45.337785+0000","last_unstale":"2024-05-08T18:34:07.328661+0000","last_undegraded":"2024-05-08T18:34:07.328661+0000","last_fullsized":"2024-05-08T18:34:07.328661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.421643+0000","last_change":"2024-05-08T18:30:58.302684+0000","last_active":"2024-05-08T18:33:06.421643+0000","last_peered":"2024-05-08T18:33:06.421643+0000","last_clean":"2024-05-08T18:33:06.421643+0000","last_became_active":"2024-05-08T18:30:58.302328+0000","last_became_peered":"2024-05-08T18:30:58.302328+0000","last_unstale":"2024-05-08T18:33:06.421643+0000","last_undegraded":"2024-05-08T18:33:06.421643+0000","last_fullsized":"2024-05-08T18:33:06.421643+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:58.175230+0000","last_change":"2024-05-08T18:30:49.983824+0000","last_active":"2024-05-08T18:32:58.175230+0000","last_peered":"2024-05-08T18:32:58.175230+0000","last_clean":"2024-05-08T18:32:58.175230+0000","last_became_active":"2024-05-08T18:30:49.983522+0000","last_became_peered":"2024-05-08T18:30:49.983522+0000","last_unstale":"2024-05-08T18:32:58.175230+0000","last_undegraded":"2024-05-08T18:32:58.175230+0000","last_fullsized":"2024-05-08T18:32:58.175230+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.814472+0000","last_change":"2024-05-08T18:31:02.294921+0000","last_active":"2024-05-08T18:34:13.814472+0000","last_peered":"2024-05-08T18:34:13.814472+0000","last_clean":"2024-05-08T18:34:13.814472+0000","last_became_active":"2024-05-08T18:31:02.294603+0000","last_became_peered":"2024-05-08T18:31:02.294603+0000","last_unstale":"2024-05-08T18:34:13.814472+0000","last_undegraded":"2024-05-08T18:34:13.814472+0000","last_fullsized":"2024-05-08T18:34:13.814472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'75","reported_seq":151,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.528054+0000","last_change":"2024-05-08T18:34:32.528098+0000","last_active":"2024-05-08T18:34:32.528054+0000","last_peered":"2024-05-08T18:34:32.528054+0000","last_clean":"2024-05-08T18:34:32.528054+0000","last_became_active":"2024-05-08T18:31:04.295090+0000","last_became_peered":"2024-05-08T18:31:04.295090+0000","last_unstale":"2024-05-08T18:34:32.528054+0000","last_undegraded":"2024-05-08T18:34:32.528054+0000","last_fullsized":"2024-05-08T18:34:32.528054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'75","last_scrub_stamp":"2024-05-08T18:34:32.527967+0000","last_deep_scrub":"29'75","last_deep_scrub_stamp":"2024-05-08T18:34:32.527967+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.527967+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:27.504565+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.653376+0000","last_change":"2024-05-08T18:34:24.653420+0000","last_active":"2024-05-08T18:34:24.653376+0000","last_peered":"2024-05-08T18:34:24.653376+0000","last_clean":"2024-05-08T18:34:24.653376+0000","last_became_active":"2024-05-08T18:31:06.312179+0000","last_became_peered":"2024-05-08T18:31:06.312179+0000","last_unstale":"2024-05-08T18:34:24.653376+0000","last_undegraded":"2024-05-08T18:34:24.653376+0000","last_fullsized":"2024-05-08T18:34:24.653376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:24.653263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:24.653263+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.653263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:54:11.402636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179266+0000","last_change":"2024-05-08T18:31:08.306655+0000","last_active":"2024-05-08T18:33:23.179266+0000","last_peered":"2024-05-08T18:33:23.179266+0000","last_clean":"2024-05-08T18:33:23.179266+0000","last_became_active":"2024-05-08T18:31:08.304818+0000","last_became_peered":"2024-05-08T18:31:08.304818+0000","last_unstale":"2024-05-08T18:33:23.179266+0000","last_undegraded":"2024-05-08T18:33:23.179266+0000","last_fullsized":"2024-05-08T18:33:23.179266+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'6","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.063821+0000","last_change":"2024-05-08T18:31:00.294763+0000","last_active":"2024-05-08T18:34:07.063821+0000","last_peered":"2024-05-08T18:34:07.063821+0000","last_clean":"2024-05-08T18:34:07.063821+0000","last_became_active":"2024-05-08T18:31:00.294157+0000","last_became_peered":"2024-05-08T18:31:00.294157+0000","last_unstale":"2024-05-08T18:34:07.063821+0000","last_undegraded":"2024-05-08T18:34:07.063821+0000","last_fullsized":"2024-05-08T18:34:07.063821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.926793+0000","last_change":"2024-05-08T18:30:58.288464+0000","last_active":"2024-05-08T18:34:13.926793+0000","last_peered":"2024-05-08T18:34:13.926793+0000","last_clean":"2024-05-08T18:34:13.926793+0000","last_became_active":"2024-05-08T18:30:58.286578+0000","last_became_peered":"2024-05-08T18:30:58.286578+0000","last_unstale":"2024-05-08T18:34:13.926793+0000","last_undegraded":"2024-05-08T18:34:13.926793+0000","last_fullsized":"2024-05-08T18:34:13.926793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:58.176505+0000","last_change":"2024-05-08T18:30:49.982777+0000","last_active":"2024-05-08T18:32:58.176505+0000","last_peered":"2024-05-08T18:32:58.176505+0000","last_clean":"2024-05-08T18:32:58.176505+0000","last_became_active":"2024-05-08T18:30:49.982471+0000","last_became_peered":"2024-05-08T18:30:49.982471+0000","last_unstale":"2024-05-08T18:32:58.176505+0000","last_undegraded":"2024-05-08T18:32:58.176505+0000","last_fullsized":"2024-05-08T18:32:58.176505+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.702712+0000","last_change":"2024-05-08T18:34:27.702739+0000","last_active":"2024-05-08T18:34:27.702712+0000","last_peered":"2024-05-08T18:34:27.702712+0000","last_clean":"2024-05-08T18:34:27.702712+0000","last_became_active":"2024-05-08T18:31:02.287974+0000","last_became_peered":"2024-05-08T18:31:02.287974+0000","last_unstale":"2024-05-08T18:34:27.702712+0000","last_undegraded":"2024-05-08T18:34:27.702712+0000","last_fullsized":"2024-05-08T18:34:27.702712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:27.702607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:27.702607+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.702607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:19.640531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'22","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.906735+0000","last_change":"2024-05-08T18:34:21.906780+0000","last_active":"2024-05-08T18:34:21.906735+0000","last_peered":"2024-05-08T18:34:21.906735+0000","last_clean":"2024-05-08T18:34:21.906735+0000","last_became_active":"2024-05-08T18:31:04.301116+0000","last_became_peered":"2024-05-08T18:31:04.301116+0000","last_unstale":"2024-05-08T18:34:21.906735+0000","last_undegraded":"2024-05-08T18:34:21.906735+0000","last_fullsized":"2024-05-08T18:34:21.906735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-08T18:34:21.906639+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-08T18:34:21.906639+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.906639+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:13.184187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":386,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.877959+0000","last_change":"2024-05-08T18:34:20.878020+0000","last_active":"2024-05-08T18:34:20.877959+0000","last_peered":"2024-05-08T18:34:20.877959+0000","last_clean":"2024-05-08T18:34:20.877959+0000","last_became_active":"2024-05-08T18:31:06.308274+0000","last_became_peered":"2024-05-08T18:31:06.308274+0000","last_unstale":"2024-05-08T18:34:20.877959+0000","last_undegraded":"2024-05-08T18:34:20.877959+0000","last_fullsized":"2024-05-08T18:34:20.877959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:20.877846+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:20.877846+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.877846+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:15.946216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.180498+0000","last_change":"2024-05-08T18:31:08.318932+0000","last_active":"2024-05-08T18:33:23.180498+0000","last_peered":"2024-05-08T18:33:23.180498+0000","last_clean":"2024-05-08T18:33:23.180498+0000","last_became_active":"2024-05-08T18:31:08.318609+0000","last_became_peered":"2024-05-08T18:31:08.318609+0000","last_unstale":"2024-05-08T18:33:23.180498+0000","last_undegraded":"2024-05-08T18:33:23.180498+0000","last_fullsized":"2024-05-08T18:33:23.180498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.177000+0000","last_change":"2024-05-08T18:31:00.291567+0000","last_active":"2024-05-08T18:33:03.177000+0000","last_peered":"2024-05-08T18:33:03.177000+0000","last_clean":"2024-05-08T18:33:03.177000+0000","last_became_active":"2024-05-08T18:31:00.291093+0000","last_became_peered":"2024-05-08T18:31:00.291093+0000","last_unstale":"2024-05-08T18:33:03.177000+0000","last_undegraded":"2024-05-08T18:33:03.177000+0000","last_fullsized":"2024-05-08T18:33:03.177000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177925+0000","last_change":"2024-05-08T18:30:58.306520+0000","last_active":"2024-05-08T18:33:08.177925+0000","last_peered":"2024-05-08T18:33:08.177925+0000","last_clean":"2024-05-08T18:33:08.177925+0000","last_became_active":"2024-05-08T18:30:58.305915+0000","last_became_peered":"2024-05-08T18:30:58.305915+0000","last_unstale":"2024-05-08T18:33:08.177925+0000","last_undegraded":"2024-05-08T18:33:08.177925+0000","last_fullsized":"2024-05-08T18:33:08.177925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:58.175268+0000","last_change":"2024-05-08T18:30:49.982641+0000","last_active":"2024-05-08T18:32:58.175268+0000","last_peered":"2024-05-08T18:32:58.175268+0000","last_clean":"2024-05-08T18:32:58.175268+0000","last_became_active":"2024-05-08T18:30:49.982330+0000","last_became_peered":"2024-05-08T18:30:49.982330+0000","last_unstale":"2024-05-08T18:32:58.175268+0000","last_undegraded":"2024-05-08T18:32:58.175268+0000","last_fullsized":"2024-05-08T18:32:58.175268+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.649059+0000","last_change":"2024-05-08T18:34:18.649104+0000","last_active":"2024-05-08T18:34:18.649059+0000","last_peered":"2024-05-08T18:34:18.649059+0000","last_clean":"2024-05-08T18:34:18.649059+0000","last_became_active":"2024-05-08T18:31:02.292328+0000","last_became_peered":"2024-05-08T18:31:02.292328+0000","last_unstale":"2024-05-08T18:34:18.649059+0000","last_undegraded":"2024-05-08T18:34:18.649059+0000","last_fullsized":"2024-05-08T18:34:18.649059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:18.648949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:18.648949+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.648949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:06.035748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178566+0000","last_change":"2024-05-08T18:31:04.302579+0000","last_active":"2024-05-08T18:33:13.178566+0000","last_peered":"2024-05-08T18:33:13.178566+0000","last_clean":"2024-05-08T18:33:13.178566+0000","last_became_active":"2024-05-08T18:31:04.302020+0000","last_became_peered":"2024-05-08T18:31:04.302020+0000","last_unstale":"2024-05-08T18:33:13.178566+0000","last_undegraded":"2024-05-08T18:33:13.178566+0000","last_fullsized":"2024-05-08T18:33:13.178566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.664173+0000","last_change":"2024-05-08T18:34:23.664202+0000","last_active":"2024-05-08T18:34:23.664173+0000","last_peered":"2024-05-08T18:34:23.664173+0000","last_clean":"2024-05-08T18:34:23.664173+0000","last_became_active":"2024-05-08T18:31:06.305020+0000","last_became_peered":"2024-05-08T18:31:06.305020+0000","last_unstale":"2024-05-08T18:34:23.664173+0000","last_undegraded":"2024-05-08T18:34:23.664173+0000","last_fullsized":"2024-05-08T18:34:23.664173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:23.664078+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:23.664078+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.664078+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:16.647836+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179877+0000","last_change":"2024-05-08T18:31:08.310217+0000","last_active":"2024-05-08T18:33:23.179877+0000","last_peered":"2024-05-08T18:33:23.179877+0000","last_clean":"2024-05-08T18:33:23.179877+0000","last_became_active":"2024-05-08T18:31:08.309869+0000","last_became_peered":"2024-05-08T18:31:08.309869+0000","last_unstale":"2024-05-08T18:33:23.179877+0000","last_undegraded":"2024-05-08T18:33:23.179877+0000","last_fullsized":"2024-05-08T18:33:23.179877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177148+0000","last_change":"2024-05-08T18:31:00.297171+0000","last_active":"2024-05-08T18:33:08.177148+0000","last_peered":"2024-05-08T18:33:08.177148+0000","last_clean":"2024-05-08T18:33:08.177148+0000","last_became_active":"2024-05-08T18:31:00.296431+0000","last_became_peered":"2024-05-08T18:31:00.296431+0000","last_unstale":"2024-05-08T18:33:08.177148+0000","last_undegraded":"2024-05-08T18:33:08.177148+0000","last_fullsized":"2024-05-08T18:33:08.177148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177344+0000","last_change":"2024-05-08T18:30:58.304887+0000","last_active":"2024-05-08T18:33:08.177344+0000","last_peered":"2024-05-08T18:33:08.177344+0000","last_clean":"2024-05-08T18:33:08.177344+0000","last_became_active":"2024-05-08T18:30:58.303997+0000","last_became_peered":"2024-05-08T18:30:58.303997+0000","last_unstale":"2024-05-08T18:33:08.177344+0000","last_undegraded":"2024-05-08T18:33:08.177344+0000","last_fullsized":"2024-05-08T18:33:08.177344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:58.176553+0000","last_change":"2024-05-08T18:30:49.984897+0000","last_active":"2024-05-08T18:32:58.176553+0000","last_peered":"2024-05-08T18:32:58.176553+0000","last_clean":"2024-05-08T18:32:58.176553+0000","last_became_active":"2024-05-08T18:30:49.984280+0000","last_became_peered":"2024-05-08T18:30:49.984280+0000","last_unstale":"2024-05-08T18:32:58.176553+0000","last_undegraded":"2024-05-08T18:32:58.176553+0000","last_fullsized":"2024-05-08T18:32:58.176553+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.647885+0000","last_change":"2024-05-08T18:34:21.647908+0000","last_active":"2024-05-08T18:34:21.647885+0000","last_peered":"2024-05-08T18:34:21.647885+0000","last_clean":"2024-05-08T18:34:21.647885+0000","last_became_active":"2024-05-08T18:31:02.290540+0000","last_became_peered":"2024-05-08T18:31:02.290540+0000","last_unstale":"2024-05-08T18:34:21.647885+0000","last_undegraded":"2024-05-08T18:34:21.647885+0000","last_fullsized":"2024-05-08T18:34:21.647885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:21.647799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:21.647799+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.647799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:43:40.019529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.670588+0000","last_change":"2024-05-08T18:34:23.670650+0000","last_active":"2024-05-08T18:34:23.670588+0000","last_peered":"2024-05-08T18:34:23.670588+0000","last_clean":"2024-05-08T18:34:23.670588+0000","last_became_active":"2024-05-08T18:31:04.304669+0000","last_became_peered":"2024-05-08T18:31:04.304669+0000","last_unstale":"2024-05-08T18:34:23.670588+0000","last_undegraded":"2024-05-08T18:34:23.670588+0000","last_fullsized":"2024-05-08T18:34:23.670588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-05-08T18:34:23.670475+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-05-08T18:34:23.670475+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.670475+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.365929+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:17.640092+0000","last_change":"2024-05-08T18:34:17.640131+0000","last_active":"2024-05-08T18:34:17.640092+0000","last_peered":"2024-05-08T18:34:17.640092+0000","last_clean":"2024-05-08T18:34:17.640092+0000","last_became_active":"2024-05-08T18:31:06.308621+0000","last_became_peered":"2024-05-08T18:31:06.308621+0000","last_unstale":"2024-05-08T18:34:17.640092+0000","last_undegraded":"2024-05-08T18:34:17.640092+0000","last_fullsized":"2024-05-08T18:34:17.640092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:17.639997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:17.639997+0000","last_clean_scrub_stamp":"2024-05-08T18:34:17.639997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:50.847042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.736117+0000","last_change":"2024-05-08T18:34:32.736144+0000","last_active":"2024-05-08T18:34:32.736117+0000","last_peered":"2024-05-08T18:34:32.736117+0000","last_clean":"2024-05-08T18:34:32.736117+0000","last_became_active":"2024-05-08T18:31:08.308427+0000","last_became_peered":"2024-05-08T18:31:08.308427+0000","last_unstale":"2024-05-08T18:34:32.736117+0000","last_undegraded":"2024-05-08T18:34:32.736117+0000","last_fullsized":"2024-05-08T18:34:32.736117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:32.736032+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:32.736032+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.736032+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:14.795378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178071+0000","last_change":"2024-05-08T18:31:08.315548+0000","last_active":"2024-05-08T18:33:13.178071+0000","last_peered":"2024-05-08T18:33:13.178071+0000","last_clean":"2024-05-08T18:33:13.178071+0000","last_became_active":"2024-05-08T18:31:08.315257+0000","last_became_peered":"2024-05-08T18:31:08.315257+0000","last_unstale":"2024-05-08T18:33:13.178071+0000","last_undegraded":"2024-05-08T18:33:13.178071+0000","last_fullsized":"2024-05-08T18:33:13.178071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'11","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.331246+0000","last_change":"2024-05-08T18:31:00.295123+0000","last_active":"2024-05-08T18:34:07.331246+0000","last_peered":"2024-05-08T18:34:07.331246+0000","last_clean":"2024-05-08T18:34:07.331246+0000","last_became_active":"2024-05-08T18:31:00.294827+0000","last_became_peered":"2024-05-08T18:31:00.294827+0000","last_unstale":"2024-05-08T18:34:07.331246+0000","last_undegraded":"2024-05-08T18:34:07.331246+0000","last_fullsized":"2024-05-08T18:34:07.331246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.176670+0000","last_change":"2024-05-08T18:30:58.313343+0000","last_active":"2024-05-08T18:34:07.176670+0000","last_peered":"2024-05-08T18:34:07.176670+0000","last_clean":"2024-05-08T18:34:07.176670+0000","last_became_active":"2024-05-08T18:30:58.313034+0000","last_became_peered":"2024-05-08T18:30:58.313034+0000","last_unstale":"2024-05-08T18:34:07.176670+0000","last_undegraded":"2024-05-08T18:34:07.176670+0000","last_fullsized":"2024-05-08T18:34:07.176670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.763311+0000","last_change":"2024-05-08T18:34:30.763337+0000","last_active":"2024-05-08T18:34:30.763311+0000","last_peered":"2024-05-08T18:34:30.763311+0000","last_clean":"2024-05-08T18:34:30.763311+0000","last_became_active":"2024-05-08T18:31:02.291119+0000","last_became_peered":"2024-05-08T18:31:02.291119+0000","last_unstale":"2024-05-08T18:34:30.763311+0000","last_undegraded":"2024-05-08T18:34:30.763311+0000","last_fullsized":"2024-05-08T18:34:30.763311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:30.763186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:30.763186+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.763186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:48.428188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'36","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.895427+0000","last_change":"2024-05-08T18:31:04.301279+0000","last_active":"2024-05-08T18:34:13.895427+0000","last_peered":"2024-05-08T18:34:13.895427+0000","last_clean":"2024-05-08T18:34:13.895427+0000","last_became_active":"2024-05-08T18:31:04.300990+0000","last_became_peered":"2024-05-08T18:31:04.300990+0000","last_unstale":"2024-05-08T18:34:13.895427+0000","last_undegraded":"2024-05-08T18:34:13.895427+0000","last_fullsized":"2024-05-08T18:34:13.895427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181152+0000","last_change":"2024-05-08T18:31:06.315203+0000","last_active":"2024-05-08T18:33:28.181152+0000","last_peered":"2024-05-08T18:33:28.181152+0000","last_clean":"2024-05-08T18:33:28.181152+0000","last_became_active":"2024-05-08T18:31:06.314696+0000","last_became_peered":"2024-05-08T18:31:06.314696+0000","last_unstale":"2024-05-08T18:33:28.181152+0000","last_undegraded":"2024-05-08T18:33:28.181152+0000","last_fullsized":"2024-05-08T18:33:28.181152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.176870+0000","last_change":"2024-05-08T18:31:08.319177+0000","last_active":"2024-05-08T18:33:08.176870+0000","last_peered":"2024-05-08T18:33:08.176870+0000","last_clean":"2024-05-08T18:33:08.176870+0000","last_became_active":"2024-05-08T18:31:08.318901+0000","last_became_peered":"2024-05-08T18:31:08.318901+0000","last_unstale":"2024-05-08T18:33:08.176870+0000","last_undegraded":"2024-05-08T18:33:08.176870+0000","last_fullsized":"2024-05-08T18:33:08.176870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179843+0000","last_change":"2024-05-08T18:31:00.293009+0000","last_active":"2024-05-08T18:33:23.179843+0000","last_peered":"2024-05-08T18:33:23.179843+0000","last_clean":"2024-05-08T18:33:23.179843+0000","last_became_active":"2024-05-08T18:31:00.292376+0000","last_became_peered":"2024-05-08T18:31:00.292376+0000","last_unstale":"2024-05-08T18:33:23.179843+0000","last_undegraded":"2024-05-08T18:33:23.179843+0000","last_fullsized":"2024-05-08T18:33:23.179843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179812+0000","last_change":"2024-05-08T18:30:58.301858+0000","last_active":"2024-05-08T18:33:23.179812+0000","last_peered":"2024-05-08T18:33:23.179812+0000","last_clean":"2024-05-08T18:33:23.179812+0000","last_became_active":"2024-05-08T18:30:58.301520+0000","last_became_peered":"2024-05-08T18:30:58.301520+0000","last_unstale":"2024-05-08T18:33:23.179812+0000","last_undegraded":"2024-05-08T18:33:23.179812+0000","last_fullsized":"2024-05-08T18:33:23.179812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.673362+0000","last_change":"2024-05-08T18:34:22.673400+0000","last_active":"2024-05-08T18:34:22.673362+0000","last_peered":"2024-05-08T18:34:22.673362+0000","last_clean":"2024-05-08T18:34:22.673362+0000","last_became_active":"2024-05-08T18:31:02.293459+0000","last_became_peered":"2024-05-08T18:31:02.293459+0000","last_unstale":"2024-05-08T18:34:22.673362+0000","last_undegraded":"2024-05-08T18:34:22.673362+0000","last_fullsized":"2024-05-08T18:34:22.673362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:22.673274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:22.673274+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.673274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:39.064779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.593729+0000","last_change":"2024-05-08T18:34:27.593763+0000","last_active":"2024-05-08T18:34:27.593729+0000","last_peered":"2024-05-08T18:34:27.593729+0000","last_clean":"2024-05-08T18:34:27.593729+0000","last_became_active":"2024-05-08T18:31:04.298237+0000","last_became_peered":"2024-05-08T18:31:04.298237+0000","last_unstale":"2024-05-08T18:34:27.593729+0000","last_undegraded":"2024-05-08T18:34:27.593729+0000","last_fullsized":"2024-05-08T18:34:27.593729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:27.593625+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:27.593625+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.593625+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:11.004092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.656405+0000","last_change":"2024-05-08T18:34:21.656429+0000","last_active":"2024-05-08T18:34:21.656405+0000","last_peered":"2024-05-08T18:34:21.656405+0000","last_clean":"2024-05-08T18:34:21.656405+0000","last_became_active":"2024-05-08T18:31:06.307048+0000","last_became_peered":"2024-05-08T18:31:06.307048+0000","last_unstale":"2024-05-08T18:34:21.656405+0000","last_undegraded":"2024-05-08T18:34:21.656405+0000","last_fullsized":"2024-05-08T18:34:21.656405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:21.656318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:21.656318+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.656318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:04.597248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.181483+0000","last_change":"2024-05-08T18:31:08.314432+0000","last_active":"2024-05-08T18:33:38.181483+0000","last_peered":"2024-05-08T18:33:38.181483+0000","last_clean":"2024-05-08T18:33:38.181483+0000","last_became_active":"2024-05-08T18:31:08.313943+0000","last_became_peered":"2024-05-08T18:31:08.313943+0000","last_unstale":"2024-05-08T18:33:38.181483+0000","last_undegraded":"2024-05-08T18:33:38.181483+0000","last_fullsized":"2024-05-08T18:33:38.181483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.280162+0000","last_change":"2024-05-08T18:31:00.286107+0000","last_active":"2024-05-08T18:34:07.280162+0000","last_peered":"2024-05-08T18:34:07.280162+0000","last_clean":"2024-05-08T18:34:07.280162+0000","last_became_active":"2024-05-08T18:31:00.285842+0000","last_became_peered":"2024-05-08T18:31:00.285842+0000","last_unstale":"2024-05-08T18:34:07.280162+0000","last_undegraded":"2024-05-08T18:34:07.280162+0000","last_fullsized":"2024-05-08T18:34:07.280162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179862+0000","last_change":"2024-05-08T18:30:58.303703+0000","last_active":"2024-05-08T18:33:23.179862+0000","last_peered":"2024-05-08T18:33:23.179862+0000","last_clean":"2024-05-08T18:33:23.179862+0000","last_became_active":"2024-05-08T18:30:58.303112+0000","last_became_peered":"2024-05-08T18:30:58.303112+0000","last_unstale":"2024-05-08T18:33:23.179862+0000","last_undegraded":"2024-05-08T18:33:23.179862+0000","last_fullsized":"2024-05-08T18:33:23.179862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179674+0000","last_change":"2024-05-08T18:31:02.295088+0000","last_active":"2024-05-08T18:33:23.179674+0000","last_peered":"2024-05-08T18:33:23.179674+0000","last_clean":"2024-05-08T18:33:23.179674+0000","last_became_active":"2024-05-08T18:31:02.294812+0000","last_became_peered":"2024-05-08T18:31:02.294812+0000","last_unstale":"2024-05-08T18:33:23.179674+0000","last_undegraded":"2024-05-08T18:33:23.179674+0000","last_fullsized":"2024-05-08T18:33:23.179674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'47","reported_seq":119,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.562009+0000","last_change":"2024-05-08T18:34:26.562049+0000","last_active":"2024-05-08T18:34:26.562009+0000","last_peered":"2024-05-08T18:34:26.562009+0000","last_clean":"2024-05-08T18:34:26.562009+0000","last_became_active":"2024-05-08T18:31:04.301969+0000","last_became_peered":"2024-05-08T18:31:04.301969+0000","last_unstale":"2024-05-08T18:34:26.562009+0000","last_undegraded":"2024-05-08T18:34:26.562009+0000","last_fullsized":"2024-05-08T18:34:26.562009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-08T18:34:26.561918+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-08T18:34:26.561918+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.561918+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:56.265527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:17.922204+0000","last_change":"2024-05-08T18:34:17.922228+0000","last_active":"2024-05-08T18:34:17.922204+0000","last_peered":"2024-05-08T18:34:17.922204+0000","last_clean":"2024-05-08T18:34:17.922204+0000","last_became_active":"2024-05-08T18:31:06.306346+0000","last_became_peered":"2024-05-08T18:31:06.306346+0000","last_unstale":"2024-05-08T18:34:17.922204+0000","last_undegraded":"2024-05-08T18:34:17.922204+0000","last_fullsized":"2024-05-08T18:34:17.922204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:17.922113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:17.922113+0000","last_clean_scrub_stamp":"2024-05-08T18:34:17.922113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:34.597084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.182884+0000","last_change":"2024-05-08T18:31:08.317029+0000","last_active":"2024-05-08T18:33:38.182884+0000","last_peered":"2024-05-08T18:33:38.182884+0000","last_clean":"2024-05-08T18:33:38.182884+0000","last_became_active":"2024-05-08T18:31:08.316673+0000","last_became_peered":"2024-05-08T18:31:08.316673+0000","last_unstale":"2024-05-08T18:33:38.182884+0000","last_undegraded":"2024-05-08T18:33:38.182884+0000","last_fullsized":"2024-05-08T18:33:38.182884+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.180221+0000","last_change":"2024-05-08T18:31:00.291577+0000","last_active":"2024-05-08T18:33:23.180221+0000","last_peered":"2024-05-08T18:33:23.180221+0000","last_clean":"2024-05-08T18:33:23.180221+0000","last_became_active":"2024-05-08T18:31:00.291163+0000","last_became_peered":"2024-05-08T18:31:00.291163+0000","last_unstale":"2024-05-08T18:33:23.180221+0000","last_undegraded":"2024-05-08T18:33:23.180221+0000","last_fullsized":"2024-05-08T18:33:23.180221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179961+0000","last_change":"2024-05-08T18:30:58.305036+0000","last_active":"2024-05-08T18:33:23.179961+0000","last_peered":"2024-05-08T18:33:23.179961+0000","last_clean":"2024-05-08T18:33:23.179961+0000","last_became_active":"2024-05-08T18:30:58.304135+0000","last_became_peered":"2024-05-08T18:30:58.304135+0000","last_unstale":"2024-05-08T18:33:23.179961+0000","last_undegraded":"2024-05-08T18:33:23.179961+0000","last_fullsized":"2024-05-08T18:33:23.179961+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.724006+0000","last_change":"2024-05-08T18:34:25.724048+0000","last_active":"2024-05-08T18:34:25.724006+0000","last_peered":"2024-05-08T18:34:25.724006+0000","last_clean":"2024-05-08T18:34:25.724006+0000","last_became_active":"2024-05-08T18:31:02.290191+0000","last_became_peered":"2024-05-08T18:31:02.290191+0000","last_unstale":"2024-05-08T18:34:25.724006+0000","last_undegraded":"2024-05-08T18:34:25.724006+0000","last_fullsized":"2024-05-08T18:34:25.724006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:25.723912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:25.723912+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.723912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:20.514292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.740088+0000","last_change":"2024-05-08T18:34:30.740127+0000","last_active":"2024-05-08T18:34:30.740088+0000","last_peered":"2024-05-08T18:34:30.740088+0000","last_clean":"2024-05-08T18:34:30.740088+0000","last_became_active":"2024-05-08T18:31:04.295255+0000","last_became_peered":"2024-05-08T18:31:04.295255+0000","last_unstale":"2024-05-08T18:34:30.740088+0000","last_undegraded":"2024-05-08T18:34:30.740088+0000","last_fullsized":"2024-05-08T18:34:30.740088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:30.740000+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:30.740000+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.740000+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:21.689161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.619965+0000","last_change":"2024-05-08T18:34:22.620008+0000","last_active":"2024-05-08T18:34:22.619965+0000","last_peered":"2024-05-08T18:34:22.619965+0000","last_clean":"2024-05-08T18:34:22.619965+0000","last_became_active":"2024-05-08T18:31:06.304851+0000","last_became_peered":"2024-05-08T18:31:06.304851+0000","last_unstale":"2024-05-08T18:34:22.619965+0000","last_undegraded":"2024-05-08T18:34:22.619965+0000","last_fullsized":"2024-05-08T18:34:22.619965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:22.619859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:22.619859+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.619859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:19.090940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'8","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:53.184190+0000","last_change":"2024-05-08T18:31:45.343090+0000","last_active":"2024-05-08T18:33:53.184190+0000","last_peered":"2024-05-08T18:33:53.184190+0000","last_clean":"2024-05-08T18:33:53.184190+0000","last_became_active":"2024-05-08T18:31:45.336717+0000","last_became_peered":"2024-05-08T18:31:45.336717+0000","last_unstale":"2024-05-08T18:33:53.184190+0000","last_undegraded":"2024-05-08T18:33:53.184190+0000","last_fullsized":"2024-05-08T18:33:53.184190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.180198+0000","last_change":"2024-05-08T18:30:58.303784+0000","last_active":"2024-05-08T18:33:23.180198+0000","last_peered":"2024-05-08T18:33:23.180198+0000","last_clean":"2024-05-08T18:33:23.180198+0000","last_became_active":"2024-05-08T18:30:58.302486+0000","last_became_peered":"2024-05-08T18:30:58.302486+0000","last_unstale":"2024-05-08T18:33:23.180198+0000","last_undegraded":"2024-05-08T18:33:23.180198+0000","last_fullsized":"2024-05-08T18:33:23.180198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176135+0000","last_change":"2024-05-08T18:31:02.292304+0000","last_active":"2024-05-08T18:33:03.176135+0000","last_peered":"2024-05-08T18:33:03.176135+0000","last_clean":"2024-05-08T18:33:03.176135+0000","last_became_active":"2024-05-08T18:31:02.291965+0000","last_became_peered":"2024-05-08T18:31:02.291965+0000","last_unstale":"2024-05-08T18:33:03.176135+0000","last_undegraded":"2024-05-08T18:33:03.176135+0000","last_fullsized":"2024-05-08T18:33:03.176135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.589859+0000","last_change":"2024-05-08T18:34:28.589897+0000","last_active":"2024-05-08T18:34:28.589859+0000","last_peered":"2024-05-08T18:34:28.589859+0000","last_clean":"2024-05-08T18:34:28.589859+0000","last_became_active":"2024-05-08T18:31:04.298061+0000","last_became_peered":"2024-05-08T18:31:04.298061+0000","last_unstale":"2024-05-08T18:34:28.589859+0000","last_undegraded":"2024-05-08T18:34:28.589859+0000","last_fullsized":"2024-05-08T18:34:28.589859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-08T18:34:28.589758+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-08T18:34:28.589758+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.589758+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.082408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.571868+0000","last_change":"2024-05-08T18:34:19.571892+0000","last_active":"2024-05-08T18:34:19.571868+0000","last_peered":"2024-05-08T18:34:19.571868+0000","last_clean":"2024-05-08T18:34:19.571868+0000","last_became_active":"2024-05-08T18:31:06.308247+0000","last_became_peered":"2024-05-08T18:31:06.308247+0000","last_unstale":"2024-05-08T18:34:19.571868+0000","last_undegraded":"2024-05-08T18:34:19.571868+0000","last_fullsized":"2024-05-08T18:34:19.571868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:19.571752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:19.571752+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.571752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:10.353530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.065388+0000","last_change":"2024-05-08T18:31:08.314319+0000","last_active":"2024-05-08T18:34:07.065388+0000","last_peered":"2024-05-08T18:34:07.065388+0000","last_clean":"2024-05-08T18:34:07.065388+0000","last_became_active":"2024-05-08T18:31:08.313986+0000","last_became_peered":"2024-05-08T18:31:08.313986+0000","last_unstale":"2024-05-08T18:34:07.065388+0000","last_undegraded":"2024-05-08T18:34:07.065388+0000","last_fullsized":"2024-05-08T18:34:07.065388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.248146+0000","last_change":"2024-05-08T18:31:00.281726+0000","last_active":"2024-05-08T18:34:07.248146+0000","last_peered":"2024-05-08T18:34:07.248146+0000","last_clean":"2024-05-08T18:34:07.248146+0000","last_became_active":"2024-05-08T18:31:00.281233+0000","last_became_peered":"2024-05-08T18:31:00.281233+0000","last_unstale":"2024-05-08T18:34:07.248146+0000","last_undegraded":"2024-05-08T18:34:07.248146+0000","last_fullsized":"2024-05-08T18:34:07.248146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179768+0000","last_change":"2024-05-08T18:30:58.290021+0000","last_active":"2024-05-08T18:33:23.179768+0000","last_peered":"2024-05-08T18:33:23.179768+0000","last_clean":"2024-05-08T18:33:23.179768+0000","last_became_active":"2024-05-08T18:30:58.289251+0000","last_became_peered":"2024-05-08T18:30:58.289251+0000","last_unstale":"2024-05-08T18:33:23.179768+0000","last_undegraded":"2024-05-08T18:33:23.179768+0000","last_fullsized":"2024-05-08T18:33:23.179768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177317+0000","last_change":"2024-05-08T18:31:02.293460+0000","last_active":"2024-05-08T18:33:08.177317+0000","last_peered":"2024-05-08T18:33:08.177317+0000","last_clean":"2024-05-08T18:33:08.177317+0000","last_became_active":"2024-05-08T18:31:02.293185+0000","last_became_peered":"2024-05-08T18:31:02.293185+0000","last_unstale":"2024-05-08T18:33:08.177317+0000","last_undegraded":"2024-05-08T18:33:08.177317+0000","last_fullsized":"2024-05-08T18:33:08.177317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.735819+0000","last_change":"2024-05-08T18:34:26.735863+0000","last_active":"2024-05-08T18:34:26.735819+0000","last_peered":"2024-05-08T18:34:26.735819+0000","last_clean":"2024-05-08T18:34:26.735819+0000","last_became_active":"2024-05-08T18:31:04.298482+0000","last_became_peered":"2024-05-08T18:31:04.298482+0000","last_unstale":"2024-05-08T18:34:26.735819+0000","last_undegraded":"2024-05-08T18:34:26.735819+0000","last_fullsized":"2024-05-08T18:34:26.735819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T18:34:26.735726+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T18:34:26.735726+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.735726+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:38.610782+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.785527+0000","last_change":"2024-05-08T18:34:28.785567+0000","last_active":"2024-05-08T18:34:28.785527+0000","last_peered":"2024-05-08T18:34:28.785527+0000","last_clean":"2024-05-08T18:34:28.785527+0000","last_became_active":"2024-05-08T18:31:06.311392+0000","last_became_peered":"2024-05-08T18:31:06.311392+0000","last_unstale":"2024-05-08T18:34:28.785527+0000","last_undegraded":"2024-05-08T18:34:28.785527+0000","last_fullsized":"2024-05-08T18:34:28.785527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:28.785418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:28.785418+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.785418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.278068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181260+0000","last_change":"2024-05-08T18:31:08.319678+0000","last_active":"2024-05-08T18:33:28.181260+0000","last_peered":"2024-05-08T18:33:28.181260+0000","last_clean":"2024-05-08T18:33:28.181260+0000","last_became_active":"2024-05-08T18:31:08.319394+0000","last_became_peered":"2024-05-08T18:31:08.319394+0000","last_unstale":"2024-05-08T18:33:28.181260+0000","last_undegraded":"2024-05-08T18:33:28.181260+0000","last_fullsized":"2024-05-08T18:33:28.181260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'18","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.687783+0000","last_change":"2024-05-08T18:34:29.687812+0000","last_active":"2024-05-08T18:34:29.687783+0000","last_peered":"2024-05-08T18:34:29.687783+0000","last_clean":"2024-05-08T18:34:29.687783+0000","last_became_active":"2024-05-08T18:31:00.299547+0000","last_became_peered":"2024-05-08T18:31:00.299547+0000","last_unstale":"2024-05-08T18:34:29.687783+0000","last_undegraded":"2024-05-08T18:34:29.687783+0000","last_fullsized":"2024-05-08T18:34:29.687783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-05-08T18:34:29.687669+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-05-08T18:34:29.687669+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.687669+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:34:50.822109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.180662+0000","last_change":"2024-05-08T18:30:58.305155+0000","last_active":"2024-05-08T18:33:28.180662+0000","last_peered":"2024-05-08T18:33:28.180662+0000","last_clean":"2024-05-08T18:33:28.180662+0000","last_became_active":"2024-05-08T18:30:58.303624+0000","last_became_peered":"2024-05-08T18:30:58.303624+0000","last_unstale":"2024-05-08T18:33:28.180662+0000","last_undegraded":"2024-05-08T18:33:28.180662+0000","last_fullsized":"2024-05-08T18:33:28.180662+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.181446+0000","last_change":"2024-05-08T18:31:02.292792+0000","last_active":"2024-05-08T18:33:33.181446+0000","last_peered":"2024-05-08T18:33:33.181446+0000","last_clean":"2024-05-08T18:33:33.181446+0000","last_became_active":"2024-05-08T18:31:02.292498+0000","last_became_peered":"2024-05-08T18:31:02.292498+0000","last_unstale":"2024-05-08T18:33:33.181446+0000","last_undegraded":"2024-05-08T18:33:33.181446+0000","last_fullsized":"2024-05-08T18:33:33.181446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'39","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.519904+0000","last_change":"2024-05-08T18:34:31.519937+0000","last_active":"2024-05-08T18:34:31.519904+0000","last_peered":"2024-05-08T18:34:31.519904+0000","last_clean":"2024-05-08T18:34:31.519904+0000","last_became_active":"2024-05-08T18:31:04.297297+0000","last_became_peered":"2024-05-08T18:31:04.297297+0000","last_unstale":"2024-05-08T18:34:31.519904+0000","last_undegraded":"2024-05-08T18:34:31.519904+0000","last_fullsized":"2024-05-08T18:34:31.519904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-08T18:34:31.519820+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-08T18:34:31.519820+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.519820+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:29.500105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.647709+0000","last_change":"2024-05-08T18:34:20.647756+0000","last_active":"2024-05-08T18:34:20.647709+0000","last_peered":"2024-05-08T18:34:20.647709+0000","last_clean":"2024-05-08T18:34:20.647709+0000","last_became_active":"2024-05-08T18:31:06.305567+0000","last_became_peered":"2024-05-08T18:31:06.305567+0000","last_unstale":"2024-05-08T18:34:20.647709+0000","last_undegraded":"2024-05-08T18:34:20.647709+0000","last_fullsized":"2024-05-08T18:34:20.647709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:20.647576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:20.647576+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.647576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:11.596737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'11","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.968893+0000","last_change":"2024-05-08T18:31:08.317380+0000","last_active":"2024-05-08T18:34:06.968893+0000","last_peered":"2024-05-08T18:34:06.968893+0000","last_clean":"2024-05-08T18:34:06.968893+0000","last_became_active":"2024-05-08T18:31:08.316943+0000","last_became_peered":"2024-05-08T18:31:08.316943+0000","last_unstale":"2024-05-08T18:34:06.968893+0000","last_undegraded":"2024-05-08T18:34:06.968893+0000","last_fullsized":"2024-05-08T18:34:06.968893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'5","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.331291+0000","last_change":"2024-05-08T18:31:00.283641+0000","last_active":"2024-05-08T18:34:07.331291+0000","last_peered":"2024-05-08T18:34:07.331291+0000","last_clean":"2024-05-08T18:34:07.331291+0000","last_became_active":"2024-05-08T18:31:00.282923+0000","last_became_peered":"2024-05-08T18:31:00.282923+0000","last_unstale":"2024-05-08T18:34:07.331291+0000","last_undegraded":"2024-05-08T18:34:07.331291+0000","last_fullsized":"2024-05-08T18:34:07.331291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181312+0000","last_change":"2024-05-08T18:30:58.318535+0000","last_active":"2024-05-08T18:33:28.181312+0000","last_peered":"2024-05-08T18:33:28.181312+0000","last_clean":"2024-05-08T18:33:28.181312+0000","last_became_active":"2024-05-08T18:30:58.316980+0000","last_became_peered":"2024-05-08T18:30:58.316980+0000","last_unstale":"2024-05-08T18:33:28.181312+0000","last_undegraded":"2024-05-08T18:33:28.181312+0000","last_fullsized":"2024-05-08T18:33:28.181312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.181488+0000","last_change":"2024-05-08T18:31:02.288494+0000","last_active":"2024-05-08T18:33:33.181488+0000","last_peered":"2024-05-08T18:33:33.181488+0000","last_clean":"2024-05-08T18:33:33.181488+0000","last_became_active":"2024-05-08T18:31:02.288127+0000","last_became_peered":"2024-05-08T18:31:02.288127+0000","last_unstale":"2024-05-08T18:33:33.181488+0000","last_undegraded":"2024-05-08T18:33:33.181488+0000","last_fullsized":"2024-05-08T18:33:33.181488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177896+0000","last_change":"2024-05-08T18:31:04.302369+0000","last_active":"2024-05-08T18:33:08.177896+0000","last_peered":"2024-05-08T18:33:08.177896+0000","last_clean":"2024-05-08T18:33:08.177896+0000","last_became_active":"2024-05-08T18:31:04.302034+0000","last_became_peered":"2024-05-08T18:31:04.302034+0000","last_unstale":"2024-05-08T18:33:08.177896+0000","last_undegraded":"2024-05-08T18:33:08.177896+0000","last_fullsized":"2024-05-08T18:33:08.177896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":418,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.617019+0000","last_change":"2024-05-08T18:34:20.617045+0000","last_active":"2024-05-08T18:34:20.617019+0000","last_peered":"2024-05-08T18:34:20.617019+0000","last_clean":"2024-05-08T18:34:20.617019+0000","last_became_active":"2024-05-08T18:31:06.311063+0000","last_became_peered":"2024-05-08T18:31:06.311063+0000","last_unstale":"2024-05-08T18:34:20.617019+0000","last_undegraded":"2024-05-08T18:34:20.617019+0000","last_fullsized":"2024-05-08T18:34:20.617019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:20.616926+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:20.616926+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.616926+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:07.788306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181095+0000","last_change":"2024-05-08T18:31:08.320650+0000","last_active":"2024-05-08T18:33:28.181095+0000","last_peered":"2024-05-08T18:33:28.181095+0000","last_clean":"2024-05-08T18:33:28.181095+0000","last_became_active":"2024-05-08T18:31:08.320260+0000","last_became_peered":"2024-05-08T18:31:08.320260+0000","last_unstale":"2024-05-08T18:33:28.181095+0000","last_undegraded":"2024-05-08T18:33:28.181095+0000","last_fullsized":"2024-05-08T18:33:28.181095+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.181404+0000","last_change":"2024-05-08T18:31:00.285978+0000","last_active":"2024-05-08T18:33:33.181404+0000","last_peered":"2024-05-08T18:33:33.181404+0000","last_clean":"2024-05-08T18:33:33.181404+0000","last_became_active":"2024-05-08T18:31:00.284982+0000","last_became_peered":"2024-05-08T18:31:00.284982+0000","last_unstale":"2024-05-08T18:33:33.181404+0000","last_undegraded":"2024-05-08T18:33:33.181404+0000","last_fullsized":"2024-05-08T18:33:33.181404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.180718+0000","last_change":"2024-05-08T18:30:58.306355+0000","last_active":"2024-05-08T18:33:28.180718+0000","last_peered":"2024-05-08T18:33:28.180718+0000","last_clean":"2024-05-08T18:33:28.180718+0000","last_became_active":"2024-05-08T18:30:58.304969+0000","last_became_peered":"2024-05-08T18:30:58.304969+0000","last_unstale":"2024-05-08T18:33:28.180718+0000","last_undegraded":"2024-05-08T18:33:28.180718+0000","last_fullsized":"2024-05-08T18:33:28.180718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.181440+0000","last_change":"2024-05-08T18:31:02.289211+0000","last_active":"2024-05-08T18:33:33.181440+0000","last_peered":"2024-05-08T18:33:33.181440+0000","last_clean":"2024-05-08T18:33:33.181440+0000","last_became_active":"2024-05-08T18:31:02.288719+0000","last_became_peered":"2024-05-08T18:31:02.288719+0000","last_unstale":"2024-05-08T18:33:33.181440+0000","last_undegraded":"2024-05-08T18:33:33.181440+0000","last_fullsized":"2024-05-08T18:33:33.181440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'46","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.817834+0000","last_change":"2024-05-08T18:34:26.817876+0000","last_active":"2024-05-08T18:34:26.817834+0000","last_peered":"2024-05-08T18:34:26.817834+0000","last_clean":"2024-05-08T18:34:26.817834+0000","last_became_active":"2024-05-08T18:31:04.297013+0000","last_became_peered":"2024-05-08T18:31:04.297013+0000","last_unstale":"2024-05-08T18:34:26.817834+0000","last_undegraded":"2024-05-08T18:34:26.817834+0000","last_fullsized":"2024-05-08T18:34:26.817834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-05-08T18:34:26.817745+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-05-08T18:34:26.817745+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.817745+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:56.521354+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.591169+0000","last_change":"2024-05-08T18:34:29.591218+0000","last_active":"2024-05-08T18:34:29.591169+0000","last_peered":"2024-05-08T18:34:29.591169+0000","last_clean":"2024-05-08T18:34:29.591169+0000","last_became_active":"2024-05-08T18:31:06.311767+0000","last_became_peered":"2024-05-08T18:31:06.311767+0000","last_unstale":"2024-05-08T18:34:29.591169+0000","last_undegraded":"2024-05-08T18:34:29.591169+0000","last_fullsized":"2024-05-08T18:34:29.591169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:29.591069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:29.591069+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.591069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:12.240015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.200829+0000","last_change":"2024-05-08T18:31:08.313489+0000","last_active":"2024-05-08T18:34:07.200829+0000","last_peered":"2024-05-08T18:34:07.200829+0000","last_clean":"2024-05-08T18:34:07.200829+0000","last_became_active":"2024-05-08T18:31:08.312031+0000","last_became_peered":"2024-05-08T18:31:08.312031+0000","last_unstale":"2024-05-08T18:34:07.200829+0000","last_undegraded":"2024-05-08T18:34:07.200829+0000","last_fullsized":"2024-05-08T18:34:07.200829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'10","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.181359+0000","last_change":"2024-05-08T18:31:00.282870+0000","last_active":"2024-05-08T18:33:33.181359+0000","last_peered":"2024-05-08T18:33:33.181359+0000","last_clean":"2024-05-08T18:33:33.181359+0000","last_became_active":"2024-05-08T18:31:00.282605+0000","last_became_peered":"2024-05-08T18:31:00.282605+0000","last_unstale":"2024-05-08T18:33:33.181359+0000","last_undegraded":"2024-05-08T18:33:33.181359+0000","last_fullsized":"2024-05-08T18:33:33.181359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181406+0000","last_change":"2024-05-08T18:30:58.316801+0000","last_active":"2024-05-08T18:33:28.181406+0000","last_peered":"2024-05-08T18:33:28.181406+0000","last_clean":"2024-05-08T18:33:28.181406+0000","last_became_active":"2024-05-08T18:30:58.316166+0000","last_became_peered":"2024-05-08T18:30:58.316166+0000","last_unstale":"2024-05-08T18:33:28.181406+0000","last_undegraded":"2024-05-08T18:33:28.181406+0000","last_fullsized":"2024-05-08T18:33:28.181406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.181419+0000","last_change":"2024-05-08T18:31:02.294645+0000","last_active":"2024-05-08T18:33:33.181419+0000","last_peered":"2024-05-08T18:33:33.181419+0000","last_clean":"2024-05-08T18:33:33.181419+0000","last_became_active":"2024-05-08T18:31:02.294335+0000","last_became_peered":"2024-05-08T18:31:02.294335+0000","last_unstale":"2024-05-08T18:33:33.181419+0000","last_undegraded":"2024-05-08T18:33:33.181419+0000","last_fullsized":"2024-05-08T18:33:33.181419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.557478+0000","last_change":"2024-05-08T18:34:30.557516+0000","last_active":"2024-05-08T18:34:30.557478+0000","last_peered":"2024-05-08T18:34:30.557478+0000","last_clean":"2024-05-08T18:34:30.557478+0000","last_became_active":"2024-05-08T18:31:04.297440+0000","last_became_peered":"2024-05-08T18:31:04.297440+0000","last_unstale":"2024-05-08T18:34:30.557478+0000","last_undegraded":"2024-05-08T18:34:30.557478+0000","last_fullsized":"2024-05-08T18:34:30.557478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:30.557382+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:30.557382+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.557382+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:48.222384+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.182019+0000","last_change":"2024-05-08T18:31:06.312504+0000","last_active":"2024-05-08T18:33:33.182019+0000","last_peered":"2024-05-08T18:33:33.182019+0000","last_clean":"2024-05-08T18:33:33.182019+0000","last_became_active":"2024-05-08T18:31:06.312162+0000","last_became_peered":"2024-05-08T18:31:06.312162+0000","last_unstale":"2024-05-08T18:33:33.182019+0000","last_undegraded":"2024-05-08T18:33:33.182019+0000","last_fullsized":"2024-05-08T18:33:33.182019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.182202+0000","last_change":"2024-05-08T18:31:08.318309+0000","last_active":"2024-05-08T18:33:33.182202+0000","last_peered":"2024-05-08T18:33:33.182202+0000","last_clean":"2024-05-08T18:33:33.182202+0000","last_became_active":"2024-05-08T18:31:08.318072+0000","last_became_peered":"2024-05-08T18:31:08.318072+0000","last_unstale":"2024-05-08T18:33:33.182202+0000","last_undegraded":"2024-05-08T18:33:33.182202+0000","last_fullsized":"2024-05-08T18:33:33.182202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'4","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.249519+0000","last_change":"2024-05-08T18:31:00.292044+0000","last_active":"2024-05-08T18:34:07.249519+0000","last_peered":"2024-05-08T18:34:07.249519+0000","last_clean":"2024-05-08T18:34:07.249519+0000","last_became_active":"2024-05-08T18:31:00.291128+0000","last_became_peered":"2024-05-08T18:31:00.291128+0000","last_unstale":"2024-05-08T18:34:07.249519+0000","last_undegraded":"2024-05-08T18:34:07.249519+0000","last_fullsized":"2024-05-08T18:34:07.249519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:58.175277+0000","last_change":"2024-05-08T18:30:58.285590+0000","last_active":"2024-05-08T18:32:58.175277+0000","last_peered":"2024-05-08T18:32:58.175277+0000","last_clean":"2024-05-08T18:32:58.175277+0000","last_became_active":"2024-05-08T18:30:58.283402+0000","last_became_peered":"2024-05-08T18:30:58.283402+0000","last_unstale":"2024-05-08T18:32:58.175277+0000","last_undegraded":"2024-05-08T18:32:58.175277+0000","last_fullsized":"2024-05-08T18:32:58.175277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.819622+0000","last_change":"2024-05-08T18:34:27.819657+0000","last_active":"2024-05-08T18:34:27.819622+0000","last_peered":"2024-05-08T18:34:27.819622+0000","last_clean":"2024-05-08T18:34:27.819622+0000","last_became_active":"2024-05-08T18:31:02.291363+0000","last_became_peered":"2024-05-08T18:31:02.291363+0000","last_unstale":"2024-05-08T18:34:27.819622+0000","last_undegraded":"2024-05-08T18:34:27.819622+0000","last_fullsized":"2024-05-08T18:34:27.819622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:27.819512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:27.819512+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.819512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:11.229979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'33","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.643094+0000","last_change":"2024-05-08T18:34:30.643128+0000","last_active":"2024-05-08T18:34:30.643094+0000","last_peered":"2024-05-08T18:34:30.643094+0000","last_clean":"2024-05-08T18:34:30.643094+0000","last_became_active":"2024-05-08T18:31:04.298601+0000","last_became_peered":"2024-05-08T18:31:04.298601+0000","last_unstale":"2024-05-08T18:34:30.643094+0000","last_undegraded":"2024-05-08T18:34:30.643094+0000","last_fullsized":"2024-05-08T18:34:30.643094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2024-05-08T18:34:30.643006+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2024-05-08T18:34:30.643006+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.643006+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:15.159268+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":49,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.182820+0000","last_change":"2024-05-08T18:31:06.308361+0000","last_active":"2024-05-08T18:33:38.182820+0000","last_peered":"2024-05-08T18:33:38.182820+0000","last_clean":"2024-05-08T18:33:38.182820+0000","last_became_active":"2024-05-08T18:31:06.307801+0000","last_became_peered":"2024-05-08T18:31:06.307801+0000","last_unstale":"2024-05-08T18:33:38.182820+0000","last_undegraded":"2024-05-08T18:33:38.182820+0000","last_fullsized":"2024-05-08T18:33:38.182820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.182134+0000","last_change":"2024-05-08T18:31:08.319580+0000","last_active":"2024-05-08T18:33:33.182134+0000","last_peered":"2024-05-08T18:33:33.182134+0000","last_clean":"2024-05-08T18:33:33.182134+0000","last_became_active":"2024-05-08T18:31:08.319232+0000","last_became_peered":"2024-05-08T18:31:08.319232+0000","last_unstale":"2024-05-08T18:33:33.182134+0000","last_undegraded":"2024-05-08T18:33:33.182134+0000","last_fullsized":"2024-05-08T18:33:33.182134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.279814+0000","last_change":"2024-05-08T18:31:00.283026+0000","last_active":"2024-05-08T18:34:07.279814+0000","last_peered":"2024-05-08T18:34:07.279814+0000","last_clean":"2024-05-08T18:34:07.279814+0000","last_became_active":"2024-05-08T18:31:00.282644+0000","last_became_peered":"2024-05-08T18:31:00.282644+0000","last_unstale":"2024-05-08T18:34:07.279814+0000","last_undegraded":"2024-05-08T18:34:07.279814+0000","last_fullsized":"2024-05-08T18:34:07.279814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.946935+0000","last_change":"2024-05-08T18:30:58.304661+0000","last_active":"2024-05-08T18:34:06.946935+0000","last_peered":"2024-05-08T18:34:06.946935+0000","last_clean":"2024-05-08T18:34:06.946935+0000","last_became_active":"2024-05-08T18:30:58.303312+0000","last_became_peered":"2024-05-08T18:30:58.303312+0000","last_unstale":"2024-05-08T18:34:06.946935+0000","last_undegraded":"2024-05-08T18:34:06.946935+0000","last_fullsized":"2024-05-08T18:34:06.946935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'6","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.802449+0000","last_change":"2024-05-08T18:31:02.288759+0000","last_active":"2024-05-08T18:34:13.802449+0000","last_peered":"2024-05-08T18:34:13.802449+0000","last_clean":"2024-05-08T18:34:13.802449+0000","last_became_active":"2024-05-08T18:31:02.288433+0000","last_became_peered":"2024-05-08T18:31:02.288433+0000","last_unstale":"2024-05-08T18:34:13.802449+0000","last_undegraded":"2024-05-08T18:34:13.802449+0000","last_fullsized":"2024-05-08T18:34:13.802449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'35","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.910229+0000","last_change":"2024-05-08T18:31:04.299253+0000","last_active":"2024-05-08T18:34:13.910229+0000","last_peered":"2024-05-08T18:34:13.910229+0000","last_clean":"2024-05-08T18:34:13.910229+0000","last_became_active":"2024-05-08T18:31:04.298089+0000","last_became_peered":"2024-05-08T18:31:04.298089+0000","last_unstale":"2024-05-08T18:34:13.910229+0000","last_undegraded":"2024-05-08T18:34:13.910229+0000","last_fullsized":"2024-05-08T18:34:13.910229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:03.276302+0000","last_clean_scrub_stamp":"2024-05-08T18:31:03.276302+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.181439+0000","last_change":"2024-05-08T18:31:06.312121+0000","last_active":"2024-05-08T18:33:38.181439+0000","last_peered":"2024-05-08T18:33:38.181439+0000","last_clean":"2024-05-08T18:33:38.181439+0000","last_became_active":"2024-05-08T18:31:06.311810+0000","last_became_peered":"2024-05-08T18:31:06.311810+0000","last_unstale":"2024-05-08T18:33:38.181439+0000","last_undegraded":"2024-05-08T18:33:38.181439+0000","last_fullsized":"2024-05-08T18:33:38.181439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181355+0000","last_change":"2024-05-08T18:31:08.317101+0000","last_active":"2024-05-08T18:33:28.181355+0000","last_peered":"2024-05-08T18:33:28.181355+0000","last_clean":"2024-05-08T18:33:28.181355+0000","last_became_active":"2024-05-08T18:31:08.316723+0000","last_became_peered":"2024-05-08T18:31:08.316723+0000","last_unstale":"2024-05-08T18:33:28.181355+0000","last_undegraded":"2024-05-08T18:33:28.181355+0000","last_fullsized":"2024-05-08T18:33:28.181355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178260+0000","last_change":"2024-05-08T18:31:45.346058+0000","last_active":"2024-05-08T18:33:13.178260+0000","last_peered":"2024-05-08T18:33:13.178260+0000","last_clean":"2024-05-08T18:33:13.178260+0000","last_became_active":"2024-05-08T18:31:45.339252+0000","last_became_peered":"2024-05-08T18:31:45.339252+0000","last_unstale":"2024-05-08T18:33:13.178260+0000","last_undegraded":"2024-05-08T18:33:13.178260+0000","last_fullsized":"2024-05-08T18:33:13.178260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.926784+0000","last_change":"2024-05-08T18:30:58.308668+0000","last_active":"2024-05-08T18:34:13.926784+0000","last_peered":"2024-05-08T18:34:13.926784+0000","last_clean":"2024-05-08T18:34:13.926784+0000","last_became_active":"2024-05-08T18:30:58.308290+0000","last_became_peered":"2024-05-08T18:30:58.308290+0000","last_unstale":"2024-05-08T18:34:13.926784+0000","last_undegraded":"2024-05-08T18:34:13.926784+0000","last_fullsized":"2024-05-08T18:34:13.926784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.177722+0000","last_change":"2024-05-08T18:31:00.283309+0000","last_active":"2024-05-08T18:33:13.177722+0000","last_peered":"2024-05-08T18:33:13.177722+0000","last_clean":"2024-05-08T18:33:13.177722+0000","last_became_active":"2024-05-08T18:31:00.282889+0000","last_became_peered":"2024-05-08T18:31:00.282889+0000","last_unstale":"2024-05-08T18:33:13.177722+0000","last_undegraded":"2024-05-08T18:33:13.177722+0000","last_fullsized":"2024-05-08T18:33:13.177722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176030+0000","last_change":"2024-05-08T18:30:58.295262+0000","last_active":"2024-05-08T18:33:03.176030+0000","last_peered":"2024-05-08T18:33:03.176030+0000","last_clean":"2024-05-08T18:33:03.176030+0000","last_became_active":"2024-05-08T18:30:58.294210+0000","last_became_peered":"2024-05-08T18:30:58.294210+0000","last_unstale":"2024-05-08T18:33:03.176030+0000","last_undegraded":"2024-05-08T18:33:03.176030+0000","last_fullsized":"2024-05-08T18:33:03.176030+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.203059+0000","last_change":"2024-05-08T18:31:00.298041+0000","last_active":"2024-05-08T18:34:07.203059+0000","last_peered":"2024-05-08T18:34:07.203059+0000","last_clean":"2024-05-08T18:34:07.203059+0000","last_became_active":"2024-05-08T18:31:00.295749+0000","last_became_peered":"2024-05-08T18:31:00.295749+0000","last_unstale":"2024-05-08T18:34:07.203059+0000","last_undegraded":"2024-05-08T18:34:07.203059+0000","last_fullsized":"2024-05-08T18:34:07.203059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'6","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.927893+0000","last_change":"2024-05-08T18:30:58.316506+0000","last_active":"2024-05-08T18:34:13.927893+0000","last_peered":"2024-05-08T18:34:13.927893+0000","last_clean":"2024-05-08T18:34:13.927893+0000","last_became_active":"2024-05-08T18:30:58.314786+0000","last_became_peered":"2024-05-08T18:30:58.314786+0000","last_unstale":"2024-05-08T18:34:13.927893+0000","last_undegraded":"2024-05-08T18:34:13.927893+0000","last_fullsized":"2024-05-08T18:34:13.927893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'11","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.331296+0000","last_change":"2024-05-08T18:31:00.283309+0000","last_active":"2024-05-08T18:34:07.331296+0000","last_peered":"2024-05-08T18:34:07.331296+0000","last_clean":"2024-05-08T18:34:07.331296+0000","last_became_active":"2024-05-08T18:31:00.282863+0000","last_became_peered":"2024-05-08T18:31:00.282863+0000","last_unstale":"2024-05-08T18:34:07.331296+0000","last_undegraded":"2024-05-08T18:34:07.331296+0000","last_fullsized":"2024-05-08T18:34:07.331296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'3","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176084+0000","last_change":"2024-05-08T18:30:58.289717+0000","last_active":"2024-05-08T18:33:03.176084+0000","last_peered":"2024-05-08T18:33:03.176084+0000","last_clean":"2024-05-08T18:33:03.176084+0000","last_became_active":"2024-05-08T18:30:58.289337+0000","last_became_peered":"2024-05-08T18:30:58.289337+0000","last_unstale":"2024-05-08T18:33:03.176084+0000","last_undegraded":"2024-05-08T18:33:03.176084+0000","last_fullsized":"2024-05-08T18:33:03.176084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.176803+0000","last_change":"2024-05-08T18:31:00.291487+0000","last_active":"2024-05-08T18:33:08.176803+0000","last_peered":"2024-05-08T18:33:08.176803+0000","last_clean":"2024-05-08T18:33:08.176803+0000","last_became_active":"2024-05-08T18:31:00.291269+0000","last_became_peered":"2024-05-08T18:31:00.291269+0000","last_unstale":"2024-05-08T18:33:08.176803+0000","last_undegraded":"2024-05-08T18:33:08.176803+0000","last_fullsized":"2024-05-08T18:33:08.176803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.176832+0000","last_change":"2024-05-08T18:30:58.285778+0000","last_active":"2024-05-08T18:33:08.176832+0000","last_peered":"2024-05-08T18:33:08.176832+0000","last_clean":"2024-05-08T18:33:08.176832+0000","last_became_active":"2024-05-08T18:30:58.283976+0000","last_became_peered":"2024-05-08T18:30:58.283976+0000","last_unstale":"2024-05-08T18:33:08.176832+0000","last_undegraded":"2024-05-08T18:33:08.176832+0000","last_fullsized":"2024-05-08T18:33:08.176832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'5","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.331316+0000","last_change":"2024-05-08T18:31:00.292666+0000","last_active":"2024-05-08T18:34:07.331316+0000","last_peered":"2024-05-08T18:34:07.331316+0000","last_clean":"2024-05-08T18:34:07.331316+0000","last_became_active":"2024-05-08T18:31:00.292385+0000","last_became_peered":"2024-05-08T18:31:00.292385+0000","last_unstale":"2024-05-08T18:34:07.331316+0000","last_undegraded":"2024-05-08T18:34:07.331316+0000","last_fullsized":"2024-05-08T18:34:07.331316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"29'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177323+0000","last_change":"2024-05-08T18:30:58.304478+0000","last_active":"2024-05-08T18:33:08.177323+0000","last_peered":"2024-05-08T18:33:08.177323+0000","last_clean":"2024-05-08T18:33:08.177323+0000","last_became_active":"2024-05-08T18:30:58.303839+0000","last_became_peered":"2024-05-08T18:30:58.303839+0000","last_unstale":"2024-05-08T18:33:08.177323+0000","last_undegraded":"2024-05-08T18:33:08.177323+0000","last_fullsized":"2024-05-08T18:33:08.177323+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'8","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.971272+0000","last_change":"2024-05-08T18:31:00.288783+0000","last_active":"2024-05-08T18:34:06.971272+0000","last_peered":"2024-05-08T18:34:06.971272+0000","last_clean":"2024-05-08T18:34:06.971272+0000","last_became_active":"2024-05-08T18:31:00.288202+0000","last_became_peered":"2024-05-08T18:31:00.288202+0000","last_unstale":"2024-05-08T18:34:06.971272+0000","last_undegraded":"2024-05-08T18:34:06.971272+0000","last_fullsized":"2024-05-08T18:34:06.971272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177260+0000","last_change":"2024-05-08T18:30:58.305905+0000","last_active":"2024-05-08T18:33:08.177260+0000","last_peered":"2024-05-08T18:33:08.177260+0000","last_clean":"2024-05-08T18:33:08.177260+0000","last_became_active":"2024-05-08T18:30:58.305116+0000","last_became_peered":"2024-05-08T18:30:58.305116+0000","last_unstale":"2024-05-08T18:33:08.177260+0000","last_undegraded":"2024-05-08T18:33:08.177260+0000","last_fullsized":"2024-05-08T18:33:08.177260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177204+0000","last_change":"2024-05-08T18:31:00.285833+0000","last_active":"2024-05-08T18:33:08.177204+0000","last_peered":"2024-05-08T18:33:08.177204+0000","last_clean":"2024-05-08T18:33:08.177204+0000","last_became_active":"2024-05-08T18:31:00.284439+0000","last_became_peered":"2024-05-08T18:31:00.284439+0000","last_unstale":"2024-05-08T18:33:08.177204+0000","last_undegraded":"2024-05-08T18:33:08.177204+0000","last_fullsized":"2024-05-08T18:33:08.177204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.268652+0000","last_change":"2024-05-08T18:30:58.287850+0000","last_active":"2024-05-08T18:34:07.268652+0000","last_peered":"2024-05-08T18:34:07.268652+0000","last_clean":"2024-05-08T18:34:07.268652+0000","last_became_active":"2024-05-08T18:30:58.286930+0000","last_became_peered":"2024-05-08T18:30:58.286930+0000","last_unstale":"2024-05-08T18:34:07.268652+0000","last_undegraded":"2024-05-08T18:34:07.268652+0000","last_fullsized":"2024-05-08T18:34:07.268652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.971274+0000","last_change":"2024-05-08T18:31:00.283948+0000","last_active":"2024-05-08T18:34:06.971274+0000","last_peered":"2024-05-08T18:34:06.971274+0000","last_clean":"2024-05-08T18:34:06.971274+0000","last_became_active":"2024-05-08T18:31:00.282958+0000","last_became_peered":"2024-05-08T18:31:00.282958+0000","last_unstale":"2024-05-08T18:34:06.971274+0000","last_undegraded":"2024-05-08T18:34:06.971274+0000","last_fullsized":"2024-05-08T18:34:06.971274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177700+0000","last_change":"2024-05-08T18:30:58.305701+0000","last_active":"2024-05-08T18:33:08.177700+0000","last_peered":"2024-05-08T18:33:08.177700+0000","last_clean":"2024-05-08T18:33:08.177700+0000","last_became_active":"2024-05-08T18:30:58.302051+0000","last_became_peered":"2024-05-08T18:30:58.302051+0000","last_unstale":"2024-05-08T18:33:08.177700+0000","last_undegraded":"2024-05-08T18:33:08.177700+0000","last_fullsized":"2024-05-08T18:33:08.177700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.180479+0000","last_change":"2024-05-08T18:31:00.299248+0000","last_active":"2024-05-08T18:33:23.180479+0000","last_peered":"2024-05-08T18:33:23.180479+0000","last_clean":"2024-05-08T18:33:23.180479+0000","last_became_active":"2024-05-08T18:31:00.297787+0000","last_became_peered":"2024-05-08T18:31:00.297787+0000","last_unstale":"2024-05-08T18:33:23.180479+0000","last_undegraded":"2024-05-08T18:33:23.180479+0000","last_fullsized":"2024-05-08T18:33:23.180479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.193529+0000","last_change":"2024-05-08T18:30:58.285595+0000","last_active":"2024-05-08T18:34:07.193529+0000","last_peered":"2024-05-08T18:34:07.193529+0000","last_clean":"2024-05-08T18:34:07.193529+0000","last_became_active":"2024-05-08T18:30:58.284146+0000","last_became_peered":"2024-05-08T18:30:58.284146+0000","last_unstale":"2024-05-08T18:34:07.193529+0000","last_undegraded":"2024-05-08T18:34:07.193529+0000","last_fullsized":"2024-05-08T18:34:07.193529+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'12","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.249755+0000","last_change":"2024-05-08T18:31:00.291767+0000","last_active":"2024-05-08T18:34:07.249755+0000","last_peered":"2024-05-08T18:34:07.249755+0000","last_clean":"2024-05-08T18:34:07.249755+0000","last_became_active":"2024-05-08T18:31:00.291399+0000","last_became_peered":"2024-05-08T18:31:00.291399+0000","last_unstale":"2024-05-08T18:34:07.249755+0000","last_undegraded":"2024-05-08T18:34:07.249755+0000","last_fullsized":"2024-05-08T18:34:07.249755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.179806+0000","last_change":"2024-05-08T18:30:58.305891+0000","last_active":"2024-05-08T18:34:07.179806+0000","last_peered":"2024-05-08T18:34:07.179806+0000","last_clean":"2024-05-08T18:34:07.179806+0000","last_became_active":"2024-05-08T18:30:58.305523+0000","last_became_peered":"2024-05-08T18:30:58.305523+0000","last_unstale":"2024-05-08T18:34:07.179806+0000","last_undegraded":"2024-05-08T18:34:07.179806+0000","last_fullsized":"2024-05-08T18:34:07.179806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'14","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.202906+0000","last_change":"2024-05-08T18:31:00.281500+0000","last_active":"2024-05-08T18:34:07.202906+0000","last_peered":"2024-05-08T18:34:07.202906+0000","last_clean":"2024-05-08T18:34:07.202906+0000","last_became_active":"2024-05-08T18:31:00.281199+0000","last_became_peered":"2024-05-08T18:31:00.281199+0000","last_unstale":"2024-05-08T18:34:07.202906+0000","last_undegraded":"2024-05-08T18:34:07.202906+0000","last_fullsized":"2024-05-08T18:34:07.202906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178137+0000","last_change":"2024-05-08T18:30:58.302582+0000","last_active":"2024-05-08T18:33:13.178137+0000","last_peered":"2024-05-08T18:33:13.178137+0000","last_clean":"2024-05-08T18:33:13.178137+0000","last_became_active":"2024-05-08T18:30:58.302218+0000","last_became_peered":"2024-05-08T18:30:58.302218+0000","last_unstale":"2024-05-08T18:33:13.178137+0000","last_undegraded":"2024-05-08T18:33:13.178137+0000","last_fullsized":"2024-05-08T18:33:13.178137+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.064209+0000","last_change":"2024-05-08T18:31:00.294447+0000","last_active":"2024-05-08T18:34:07.064209+0000","last_peered":"2024-05-08T18:34:07.064209+0000","last_clean":"2024-05-08T18:34:07.064209+0000","last_became_active":"2024-05-08T18:31:00.294146+0000","last_became_peered":"2024-05-08T18:31:00.294146+0000","last_unstale":"2024-05-08T18:34:07.064209+0000","last_undegraded":"2024-05-08T18:34:07.064209+0000","last_fullsized":"2024-05-08T18:34:07.064209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178618+0000","last_change":"2024-05-08T18:30:58.317135+0000","last_active":"2024-05-08T18:33:13.178618+0000","last_peered":"2024-05-08T18:33:13.178618+0000","last_clean":"2024-05-08T18:33:13.178618+0000","last_became_active":"2024-05-08T18:30:58.314388+0000","last_became_peered":"2024-05-08T18:30:58.314388+0000","last_unstale":"2024-05-08T18:33:13.178618+0000","last_undegraded":"2024-05-08T18:33:13.178618+0000","last_fullsized":"2024-05-08T18:33:13.178618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.247629+0000","last_change":"2024-05-08T18:31:00.283542+0000","last_active":"2024-05-08T18:34:07.247629+0000","last_peered":"2024-05-08T18:34:07.247629+0000","last_clean":"2024-05-08T18:34:07.247629+0000","last_became_active":"2024-05-08T18:31:00.281847+0000","last_became_peered":"2024-05-08T18:31:00.281847+0000","last_unstale":"2024-05-08T18:34:07.247629+0000","last_undegraded":"2024-05-08T18:34:07.247629+0000","last_fullsized":"2024-05-08T18:34:07.247629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178661+0000","last_change":"2024-05-08T18:30:58.309703+0000","last_active":"2024-05-08T18:33:13.178661+0000","last_peered":"2024-05-08T18:33:13.178661+0000","last_clean":"2024-05-08T18:33:13.178661+0000","last_became_active":"2024-05-08T18:30:58.309203+0000","last_became_peered":"2024-05-08T18:30:58.309203+0000","last_unstale":"2024-05-08T18:33:13.178661+0000","last_undegraded":"2024-05-08T18:33:13.178661+0000","last_fullsized":"2024-05-08T18:33:13.178661+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'16","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.205625+0000","last_change":"2024-05-08T18:31:00.296525+0000","last_active":"2024-05-08T18:34:07.205625+0000","last_peered":"2024-05-08T18:34:07.205625+0000","last_clean":"2024-05-08T18:34:07.205625+0000","last_became_active":"2024-05-08T18:31:00.296240+0000","last_became_peered":"2024-05-08T18:31:00.296240+0000","last_unstale":"2024-05-08T18:34:07.205625+0000","last_undegraded":"2024-05-08T18:34:07.205625+0000","last_fullsized":"2024-05-08T18:34:07.205625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178989+0000","last_change":"2024-05-08T18:30:58.306151+0000","last_active":"2024-05-08T18:33:18.178989+0000","last_peered":"2024-05-08T18:33:18.178989+0000","last_clean":"2024-05-08T18:33:18.178989+0000","last_became_active":"2024-05-08T18:30:58.305572+0000","last_became_peered":"2024-05-08T18:30:58.305572+0000","last_unstale":"2024-05-08T18:33:18.178989+0000","last_undegraded":"2024-05-08T18:33:18.178989+0000","last_fullsized":"2024-05-08T18:33:18.178989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'12","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.247661+0000","last_change":"2024-05-08T18:31:00.283388+0000","last_active":"2024-05-08T18:34:07.247661+0000","last_peered":"2024-05-08T18:34:07.247661+0000","last_clean":"2024-05-08T18:34:07.247661+0000","last_became_active":"2024-05-08T18:31:00.282414+0000","last_became_peered":"2024-05-08T18:31:00.282414+0000","last_unstale":"2024-05-08T18:34:07.247661+0000","last_undegraded":"2024-05-08T18:34:07.247661+0000","last_fullsized":"2024-05-08T18:34:07.247661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.926883+0000","last_change":"2024-05-08T18:30:58.308682+0000","last_active":"2024-05-08T18:34:13.926883+0000","last_peered":"2024-05-08T18:34:13.926883+0000","last_clean":"2024-05-08T18:34:13.926883+0000","last_became_active":"2024-05-08T18:30:58.304591+0000","last_became_peered":"2024-05-08T18:30:58.304591+0000","last_unstale":"2024-05-08T18:34:13.926883+0000","last_undegraded":"2024-05-08T18:34:13.926883+0000","last_fullsized":"2024-05-08T18:34:13.926883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.926923+0000","last_change":"2024-05-08T18:30:58.304754+0000","last_active":"2024-05-08T18:34:13.926923+0000","last_peered":"2024-05-08T18:34:13.926923+0000","last_clean":"2024-05-08T18:34:13.926923+0000","last_became_active":"2024-05-08T18:30:58.303443+0000","last_became_peered":"2024-05-08T18:30:58.303443+0000","last_unstale":"2024-05-08T18:34:13.926923+0000","last_undegraded":"2024-05-08T18:34:13.926923+0000","last_fullsized":"2024-05-08T18:34:13.926923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'11","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.331350+0000","last_change":"2024-05-08T18:31:00.288619+0000","last_active":"2024-05-08T18:34:07.331350+0000","last_peered":"2024-05-08T18:34:07.331350+0000","last_clean":"2024-05-08T18:34:07.331350+0000","last_became_active":"2024-05-08T18:31:00.288250+0000","last_became_peered":"2024-05-08T18:31:00.288250+0000","last_unstale":"2024-05-08T18:34:07.331350+0000","last_undegraded":"2024-05-08T18:34:07.331350+0000","last_fullsized":"2024-05-08T18:34:07.331350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178515+0000","last_change":"2024-05-08T18:30:58.285795+0000","last_active":"2024-05-08T18:33:18.178515+0000","last_peered":"2024-05-08T18:33:18.178515+0000","last_clean":"2024-05-08T18:33:18.178515+0000","last_became_active":"2024-05-08T18:30:58.284090+0000","last_became_peered":"2024-05-08T18:30:58.284090+0000","last_unstale":"2024-05-08T18:33:18.178515+0000","last_undegraded":"2024-05-08T18:33:18.178515+0000","last_fullsized":"2024-05-08T18:33:18.178515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.180796+0000","last_change":"2024-05-08T18:31:00.291942+0000","last_active":"2024-05-08T18:33:28.180796+0000","last_peered":"2024-05-08T18:33:28.180796+0000","last_clean":"2024-05-08T18:33:28.180796+0000","last_became_active":"2024-05-08T18:31:00.291650+0000","last_became_peered":"2024-05-08T18:31:00.291650+0000","last_unstale":"2024-05-08T18:33:28.180796+0000","last_undegraded":"2024-05-08T18:33:28.180796+0000","last_fullsized":"2024-05-08T18:33:28.180796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1730,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1487,"ondisk_log_size":1487,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705712,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":136192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705713,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335556,"statfs":{"total":96636764160,"available":96599609344,"internally_reserved":0,"allocated":970752,"data_stored":724145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705712,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36304,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335536,"statfs":{"total":96636764160,"available":96599588864,"internally_reserved":0,"allocated":991232,"data_stored":724633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":409600,"data_stored":135044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:34:39.071 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.072 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.072 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.072 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.072 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.072 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.072 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.072 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.072 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.072 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.073 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.073 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.073 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.073 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.073 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.073 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.073 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.073 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.073 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.073 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.074 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.074 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.074 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.074 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.074 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.074 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.074 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.074 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.074 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.075 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.075 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.075 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.075 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.075 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.075 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.075 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.075 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.075 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.075 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.076 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.076 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.076 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.076 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.076 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.076 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.076 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.076 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.077 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.077 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.077 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.077 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.077 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.077 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.078 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.078 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.078 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.078 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.078 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.078 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.078 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.078 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.079 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.079 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.079 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.079 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.079 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.079 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.079 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.079 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.080 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.080 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.080 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.080 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.080 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.080 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.080 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.080 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.081 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.081 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.081 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.081 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.081 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.081 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.081 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.081 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.081 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.081 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.082 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.082 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.082 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.082 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.082 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.082 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.082 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.082 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.082 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.083 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.083 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.083 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.083 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.083 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.083 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.083 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.083 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.083 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.084 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.084 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.084 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.084 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.084 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.084 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.084 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.084 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.085 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.085 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.085 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.085 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.085 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.085 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.085 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.085 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.085 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.086 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.086 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.086 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.086 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.086 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.086 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.086 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.086 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.087 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.087 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.087 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.087 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.087 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.087 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.087 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.087 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.087 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.088 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.088 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.088 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.088 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.088 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.088 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.088 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.088 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.089 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.089 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.089 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.089 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.089 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.089 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.089 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.089 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.089 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.090 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.090 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.090 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.090 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.090 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.090 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.090 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.090 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.090 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-08T18:31:03.276302+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.091 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.091 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.091 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.091 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.091 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.091 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.091 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.091 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.091 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.091 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.092 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.092 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.092 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.092 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.092 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.092 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.093 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.093 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.093 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.093 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.093 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.093 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.093 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.093 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.093 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.093 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.094 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.094 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.094 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.094 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.094 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.094 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.094 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.094 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.094 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.095 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.095 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.095 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:39.095 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:34:59.096 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:34:59.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.214+0000 7fc0c1aa7640 1 Processor -- start 2024-05-08T18:34:59.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.214+0000 7fc0c1aa7640 1 -- start start 2024-05-08T18:34:59.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.214+0000 7fc0c1aa7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc0bc12bdd0 0x7fc0bc12c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:59.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.214+0000 7fc0c1aa7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0bc0719e0 con 0x7fc0bc1282e0 2024-05-08T18:34:59.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.214+0000 7fc0c1aa7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fc0bc12b9a0 con 0x7fc0bc12bdd0 2024-05-08T18:34:59.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.214+0000 7fc0bb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc0bc12bdd0 0x7fc0bc12c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:59.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.214+0000 7fc0baffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc0bc1282e0 0x7fc0bc128730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45420/0 (socket says 172.21.15.53:45420) 2024-05-08T18:34:59.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.214+0000 7fc0baffd640 1 -- 172.21.15.53:0/3545260854 learned_addr learned my addr 172.21.15.53:0/3545260854 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:34:59.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.215+0000 7fc0bb7fe640 1 -- 172.21.15.53:0/3545260854 >> v1:172.21.15.53:6789/0 conn(0x7fc0bc1282e0 legacy=0x7fc0bc128730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:59.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.215+0000 7fc0bb7fe640 1 -- 172.21.15.53:0/3545260854 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0bc072330 con 0x7fc0bc12bdd0 2024-05-08T18:34:59.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.215+0000 7fc0bb7fe640 1 --2- 172.21.15.53:0/3545260854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0bc12bdd0 0x7fc0bc12c1b0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00a8c0 tx=0x7fc0ac02cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad3d22505ca221 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:59.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.216+0000 7fc0ba7fc640 1 -- 172.21.15.53:0/3545260854 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0ac03a070 con 0x7fc0bc12bdd0 2024-05-08T18:34:59.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.216+0000 7fc0ba7fc640 1 -- 172.21.15.53:0/3545260854 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0ac02da00 con 0x7fc0bc12bdd0 2024-05-08T18:34:59.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.216+0000 7fc0ba7fc640 1 -- 172.21.15.53:0/3545260854 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0ac00b040 con 0x7fc0bc12bdd0 2024-05-08T18:34:59.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.216+0000 7fc0c1aa7640 1 -- 172.21.15.53:0/3545260854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0bc12bdd0 msgr2=0x7fc0bc12c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:59.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.216+0000 7fc0c1aa7640 1 --2- 172.21.15.53:0/3545260854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0bc12bdd0 0x7fc0bc12c1b0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00a8c0 tx=0x7fc0ac02cd20 comp rx=0 tx=0).stop 2024-05-08T18:34:59.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.216+0000 7fc0c1aa7640 1 -- 172.21.15.53:0/3545260854 shutdown_connections 2024-05-08T18:34:59.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.216+0000 7fc0c1aa7640 1 --2- 172.21.15.53:0/3545260854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0bc12bdd0 0x7fc0bc12c1b0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:59.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.216+0000 7fc0c1aa7640 1 -- 172.21.15.53:0/3545260854 >> 172.21.15.53:0/3545260854 conn(0x7fc0bc09a910 msgr2=0x7fc0bc06e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:59.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.216+0000 7fc0c1aa7640 1 -- 172.21.15.53:0/3545260854 shutdown_connections 2024-05-08T18:34:59.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.216+0000 7fc0c1aa7640 1 -- 172.21.15.53:0/3545260854 wait complete. 2024-05-08T18:34:59.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.217+0000 7fc0c1aa7640 1 Processor -- start 2024-05-08T18:34:59.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.217+0000 7fc0c1aa7640 1 -- start start 2024-05-08T18:34:59.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.218+0000 7fc0c1aa7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0bc1282e0 0x7fc0bc129870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:59.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.218+0000 7fc0c1aa7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc073110 con 0x7fc0bc1282e0 2024-05-08T18:34:59.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.218+0000 7fc0bb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0bc1282e0 0x7fc0bc129870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:59.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.218+0000 7fc0bb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0bc1282e0 0x7fc0bc129870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41576/0 (socket says 172.21.15.53:41576) 2024-05-08T18:34:59.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.218+0000 7fc0bb7fe640 1 -- 172.21.15.53:0/2831407204 learned_addr learned my addr 172.21.15.53:0/2831407204 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:34:59.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.218+0000 7fc0bb7fe640 1 -- 172.21.15.53:0/2831407204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0bc1193f0 con 0x7fc0bc1282e0 2024-05-08T18:34:59.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.218+0000 7fc0bb7fe640 1 --2- 172.21.15.53:0/2831407204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0bc1282e0 0x7fc0bc129870 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac038040 tx=0x7fc0ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:59.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.218+0000 7fc0a3fff640 1 -- 172.21.15.53:0/2831407204 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0ac045070 con 0x7fc0bc1282e0 2024-05-08T18:34:59.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.218+0000 7fc0a3fff640 1 -- 172.21.15.53:0/2831407204 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0ac036d90 con 0x7fc0bc1282e0 2024-05-08T18:34:59.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.219+0000 7fc0c1aa7640 1 -- 172.21.15.53:0/2831407204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0bc129db0 con 0x7fc0bc1282e0 2024-05-08T18:34:59.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.219+0000 7fc0a3fff640 1 -- 172.21.15.53:0/2831407204 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0ac03a070 con 0x7fc0bc1282e0 2024-05-08T18:34:59.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.219+0000 7fc0c1aa7640 1 -- 172.21.15.53:0/2831407204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0bc12a280 con 0x7fc0bc1282e0 2024-05-08T18:34:59.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.219+0000 7fc0c1aa7640 1 -- 172.21.15.53:0/2831407204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0bc0712c0 con 0x7fc0bc1282e0 2024-05-08T18:34:59.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.220+0000 7fc0a3fff640 1 -- 172.21.15.53:0/2831407204 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc0ac048070 con 0x7fc0bc1282e0 2024-05-08T18:34:59.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.220+0000 7fc0a3fff640 1 --2- 172.21.15.53:0/2831407204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc0a803d260 0x7fc0a803f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:34:59.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.220+0000 7fc0a3fff640 1 -- 172.21.15.53:0/2831407204 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fc0ac073910 con 0x7fc0bc1282e0 2024-05-08T18:34:59.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.220+0000 7fc0baffd640 1 --2- 172.21.15.53:0/2831407204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc0a803d260 0x7fc0a803f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:34:59.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.221+0000 7fc0baffd640 1 --2- 172.21.15.53:0/2831407204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc0a803d260 0x7fc0a803f720 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0007fd0 tx=0x7fc0b0007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:34:59.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.224+0000 7fc0a3fff640 1 -- 172.21.15.53:0/2831407204 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc0bc0712c0 con 0x7fc0bc1282e0 2024-05-08T18:34:59.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.411+0000 7fc0c1aa7640 1 -- 172.21.15.53:0/2831407204 --> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0bc12b640 con 0x7fc0a803d260 2024-05-08T18:34:59.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.426+0000 7fc0a3fff640 1 -- 172.21.15.53:0/2831407204 <== mgr.4102 v2:172.21.15.87:6824/211215191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+661571 (secure 0 0 0) 0x7fc0bc12b640 con 0x7fc0a803d260 2024-05-08T18:34:59.434 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:34:59.440 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:34:59.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.431+0000 7fc0c1aa7640 1 -- 172.21.15.53:0/2831407204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc0a803d260 msgr2=0x7fc0a803f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:59.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.431+0000 7fc0c1aa7640 1 --2- 172.21.15.53:0/2831407204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc0a803d260 0x7fc0a803f720 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0007fd0 tx=0x7fc0b0007ac0 comp rx=0 tx=0).stop 2024-05-08T18:34:59.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.431+0000 7fc0c1aa7640 1 -- 172.21.15.53:0/2831407204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0bc1282e0 msgr2=0x7fc0bc129870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:34:59.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.431+0000 7fc0c1aa7640 1 --2- 172.21.15.53:0/2831407204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0bc1282e0 0x7fc0bc129870 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac038040 tx=0x7fc0ac0046c0 comp rx=0 tx=0).stop 2024-05-08T18:34:59.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.431+0000 7fc0c1aa7640 1 -- 172.21.15.53:0/2831407204 shutdown_connections 2024-05-08T18:34:59.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.431+0000 7fc0c1aa7640 1 --2- 172.21.15.53:0/2831407204 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7fc0a803d260 0x7fc0a803f720 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:59.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.431+0000 7fc0c1aa7640 1 --2- 172.21.15.53:0/2831407204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0bc1282e0 0x7fc0bc129870 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:34:59.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.431+0000 7fc0c1aa7640 1 -- 172.21.15.53:0/2831407204 >> 172.21.15.53:0/2831407204 conn(0x7fc0bc09a910 msgr2=0x7fc0bc122f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:34:59.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.431+0000 7fc0c1aa7640 1 -- 172.21.15.53:0/2831407204 shutdown_connections 2024-05-08T18:34:59.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:34:59.431+0000 7fc0c1aa7640 1 -- 172.21.15.53:0/2831407204 wait complete. 2024-05-08T18:34:59.444 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-05-08T18:34:58.179272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5055,"num_read_kb":4641,"num_write":2119,"num_write_kb":60585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3169,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4723,"ondisk_log_size":4723,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148248,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339112,"statfs":{"total":386547056640,"available":386395250688,"internally_reserved":0,"allocated":2809856,"data_stored":1720014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003700"},"pg_stats":[{"pgid":"3.3f","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.926680+0000","last_change":"2024-05-08T18:30:58.305519+0000","last_active":"2024-05-08T18:34:13.926680+0000","last_peered":"2024-05-08T18:34:13.926680+0000","last_clean":"2024-05-08T18:34:13.926680+0000","last_became_active":"2024-05-08T18:30:58.305175+0000","last_became_peered":"2024-05-08T18:30:58.305175+0000","last_unstale":"2024-05-08T18:34:13.926680+0000","last_undegraded":"2024-05-08T18:34:13.926680+0000","last_fullsized":"2024-05-08T18:34:13.926680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.282783+0000","last_change":"2024-05-08T18:31:00.285719+0000","last_active":"2024-05-08T18:34:07.282783+0000","last_peered":"2024-05-08T18:34:07.282783+0000","last_clean":"2024-05-08T18:34:07.282783+0000","last_became_active":"2024-05-08T18:31:00.284574+0000","last_became_peered":"2024-05-08T18:31:00.284574+0000","last_unstale":"2024-05-08T18:34:07.282783+0000","last_undegraded":"2024-05-08T18:34:07.282783+0000","last_fullsized":"2024-05-08T18:34:07.282783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176148+0000","last_change":"2024-05-08T18:30:58.289175+0000","last_active":"2024-05-08T18:33:03.176148+0000","last_peered":"2024-05-08T18:33:03.176148+0000","last_clean":"2024-05-08T18:33:03.176148+0000","last_became_active":"2024-05-08T18:30:58.288674+0000","last_became_peered":"2024-05-08T18:30:58.288674+0000","last_unstale":"2024-05-08T18:33:03.176148+0000","last_undegraded":"2024-05-08T18:33:03.176148+0000","last_fullsized":"2024-05-08T18:33:03.176148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:37.548543+0000","last_change":"2024-05-08T18:34:37.548605+0000","last_active":"2024-05-08T18:34:37.548543+0000","last_peered":"2024-05-08T18:34:37.548543+0000","last_clean":"2024-05-08T18:34:37.548543+0000","last_became_active":"2024-05-08T18:31:00.298145+0000","last_became_peered":"2024-05-08T18:31:00.298145+0000","last_unstale":"2024-05-08T18:34:37.548543+0000","last_undegraded":"2024-05-08T18:34:37.548543+0000","last_fullsized":"2024-05-08T18:34:37.548543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:34:37.548430+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:34:37.548430+0000","last_clean_scrub_stamp":"2024-05-08T18:34:37.548430+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:11.432050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.177101+0000","last_change":"2024-05-08T18:30:58.306369+0000","last_active":"2024-05-08T18:33:03.177101+0000","last_peered":"2024-05-08T18:33:03.177101+0000","last_clean":"2024-05-08T18:33:03.177101+0000","last_became_active":"2024-05-08T18:30:58.304442+0000","last_became_peered":"2024-05-08T18:30:58.304442+0000","last_unstale":"2024-05-08T18:33:03.177101+0000","last_undegraded":"2024-05-08T18:33:03.177101+0000","last_fullsized":"2024-05-08T18:33:03.177101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'10","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:52.416583+0000","last_change":"2024-05-08T18:34:52.416630+0000","last_active":"2024-05-08T18:34:52.416583+0000","last_peered":"2024-05-08T18:34:52.416583+0000","last_clean":"2024-05-08T18:34:52.416583+0000","last_became_active":"2024-05-08T18:31:00.297810+0000","last_became_peered":"2024-05-08T18:31:00.297810+0000","last_unstale":"2024-05-08T18:34:52.416583+0000","last_undegraded":"2024-05-08T18:34:52.416583+0000","last_fullsized":"2024-05-08T18:34:52.416583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:34:52.416478+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:34:52.416478+0000","last_clean_scrub_stamp":"2024-05-08T18:34:52.416478+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:32.357386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:58.175800+0000","last_change":"2024-05-08T18:30:58.295957+0000","last_active":"2024-05-08T18:32:58.175800+0000","last_peered":"2024-05-08T18:32:58.175800+0000","last_clean":"2024-05-08T18:32:58.175800+0000","last_became_active":"2024-05-08T18:30:58.295569+0000","last_became_peered":"2024-05-08T18:30:58.295569+0000","last_unstale":"2024-05-08T18:32:58.175800+0000","last_undegraded":"2024-05-08T18:32:58.175800+0000","last_fullsized":"2024-05-08T18:32:58.175800+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.282688+0000","last_change":"2024-05-08T18:31:00.296029+0000","last_active":"2024-05-08T18:34:07.282688+0000","last_peered":"2024-05-08T18:34:07.282688+0000","last_clean":"2024-05-08T18:34:07.282688+0000","last_became_active":"2024-05-08T18:31:00.295611+0000","last_became_peered":"2024-05-08T18:31:00.295611+0000","last_unstale":"2024-05-08T18:34:07.282688+0000","last_undegraded":"2024-05-08T18:34:07.282688+0000","last_fullsized":"2024-05-08T18:34:07.282688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181331+0000","last_change":"2024-05-08T18:30:58.313349+0000","last_active":"2024-05-08T18:33:28.181331+0000","last_peered":"2024-05-08T18:33:28.181331+0000","last_clean":"2024-05-08T18:33:28.181331+0000","last_became_active":"2024-05-08T18:30:58.313003+0000","last_became_peered":"2024-05-08T18:30:58.313003+0000","last_unstale":"2024-05-08T18:33:28.181331+0000","last_undegraded":"2024-05-08T18:33:28.181331+0000","last_fullsized":"2024-05-08T18:33:28.181331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'4","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:46.649363+0000","last_change":"2024-05-08T18:34:46.649407+0000","last_active":"2024-05-08T18:34:46.649363+0000","last_peered":"2024-05-08T18:34:46.649363+0000","last_clean":"2024-05-08T18:34:46.649363+0000","last_became_active":"2024-05-08T18:31:00.281065+0000","last_became_peered":"2024-05-08T18:31:00.281065+0000","last_unstale":"2024-05-08T18:34:46.649363+0000","last_undegraded":"2024-05-08T18:34:46.649363+0000","last_fullsized":"2024-05-08T18:34:46.649363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:34:46.649258+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:34:46.649258+0000","last_clean_scrub_stamp":"2024-05-08T18:34:46.649258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:36.416236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:47.845721+0000","last_change":"2024-05-08T18:34:47.845746+0000","last_active":"2024-05-08T18:34:47.845721+0000","last_peered":"2024-05-08T18:34:47.845721+0000","last_clean":"2024-05-08T18:34:47.845721+0000","last_became_active":"2024-05-08T18:30:58.307687+0000","last_became_peered":"2024-05-08T18:30:58.307687+0000","last_unstale":"2024-05-08T18:34:47.845721+0000","last_undegraded":"2024-05-08T18:34:47.845721+0000","last_fullsized":"2024-05-08T18:34:47.845721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:47.845617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:47.845617+0000","last_clean_scrub_stamp":"2024-05-08T18:34:47.845617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:35.232416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'12","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:35.603625+0000","last_change":"2024-05-08T18:34:35.603652+0000","last_active":"2024-05-08T18:34:35.603625+0000","last_peered":"2024-05-08T18:34:35.603625+0000","last_clean":"2024-05-08T18:34:35.603625+0000","last_became_active":"2024-05-08T18:31:00.298978+0000","last_became_peered":"2024-05-08T18:31:00.298978+0000","last_unstale":"2024-05-08T18:34:35.603625+0000","last_undegraded":"2024-05-08T18:34:35.603625+0000","last_fullsized":"2024-05-08T18:34:35.603625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:35.603538+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:35.603538+0000","last_clean_scrub_stamp":"2024-05-08T18:34:35.603538+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.163546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181237+0000","last_change":"2024-05-08T18:30:58.309859+0000","last_active":"2024-05-08T18:33:28.181237+0000","last_peered":"2024-05-08T18:33:28.181237+0000","last_clean":"2024-05-08T18:33:28.181237+0000","last_became_active":"2024-05-08T18:30:58.308931+0000","last_became_peered":"2024-05-08T18:30:58.308931+0000","last_unstale":"2024-05-08T18:33:28.181237+0000","last_undegraded":"2024-05-08T18:33:28.181237+0000","last_fullsized":"2024-05-08T18:33:28.181237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'7","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.333968+0000","last_change":"2024-05-08T18:31:00.295747+0000","last_active":"2024-05-08T18:34:07.333968+0000","last_peered":"2024-05-08T18:34:07.333968+0000","last_clean":"2024-05-08T18:34:07.333968+0000","last_became_active":"2024-05-08T18:31:00.295472+0000","last_became_peered":"2024-05-08T18:31:00.295472+0000","last_unstale":"2024-05-08T18:34:07.333968+0000","last_undegraded":"2024-05-08T18:34:07.333968+0000","last_fullsized":"2024-05-08T18:34:07.333968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:52.757826+0000","last_change":"2024-05-08T18:34:52.757867+0000","last_active":"2024-05-08T18:34:52.757826+0000","last_peered":"2024-05-08T18:34:52.757826+0000","last_clean":"2024-05-08T18:34:52.757826+0000","last_became_active":"2024-05-08T18:30:58.294511+0000","last_became_peered":"2024-05-08T18:30:58.294511+0000","last_unstale":"2024-05-08T18:34:52.757826+0000","last_undegraded":"2024-05-08T18:34:52.757826+0000","last_fullsized":"2024-05-08T18:34:52.757826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:52.757734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:52.757734+0000","last_clean_scrub_stamp":"2024-05-08T18:34:52.757734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:46.902960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:48.805092+0000","last_change":"2024-05-08T18:34:48.805144+0000","last_active":"2024-05-08T18:34:48.805092+0000","last_peered":"2024-05-08T18:34:48.805092+0000","last_clean":"2024-05-08T18:34:48.805092+0000","last_became_active":"2024-05-08T18:31:00.291203+0000","last_became_peered":"2024-05-08T18:31:00.291203+0000","last_unstale":"2024-05-08T18:34:48.805092+0000","last_undegraded":"2024-05-08T18:34:48.805092+0000","last_fullsized":"2024-05-08T18:34:48.805092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:48.804997+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:48.804997+0000","last_clean_scrub_stamp":"2024-05-08T18:34:48.804997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:13.865424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.203003+0000","last_change":"2024-05-08T18:31:00.291351+0000","last_active":"2024-05-08T18:34:07.203003+0000","last_peered":"2024-05-08T18:34:07.203003+0000","last_clean":"2024-05-08T18:34:07.203003+0000","last_became_active":"2024-05-08T18:31:00.290806+0000","last_became_peered":"2024-05-08T18:31:00.290806+0000","last_unstale":"2024-05-08T18:34:07.203003+0000","last_undegraded":"2024-05-08T18:34:07.203003+0000","last_fullsized":"2024-05-08T18:34:07.203003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.924545+0000","last_change":"2024-05-08T18:30:58.305311+0000","last_active":"2024-05-08T18:34:06.924545+0000","last_peered":"2024-05-08T18:34:06.924545+0000","last_clean":"2024-05-08T18:34:06.924545+0000","last_became_active":"2024-05-08T18:30:58.304685+0000","last_became_peered":"2024-05-08T18:30:58.304685+0000","last_unstale":"2024-05-08T18:34:06.924545+0000","last_undegraded":"2024-05-08T18:34:06.924545+0000","last_fullsized":"2024-05-08T18:34:06.924545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'14","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:52.646305+0000","last_change":"2024-05-08T18:34:52.646329+0000","last_active":"2024-05-08T18:34:52.646305+0000","last_peered":"2024-05-08T18:34:52.646305+0000","last_clean":"2024-05-08T18:34:52.646305+0000","last_became_active":"2024-05-08T18:31:00.281816+0000","last_became_peered":"2024-05-08T18:31:00.281816+0000","last_unstale":"2024-05-08T18:34:52.646305+0000","last_undegraded":"2024-05-08T18:34:52.646305+0000","last_fullsized":"2024-05-08T18:34:52.646305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-05-08T18:34:52.646217+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-05-08T18:34:52.646217+0000","last_clean_scrub_stamp":"2024-05-08T18:34:52.646217+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:59.267706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:49.823572+0000","last_change":"2024-05-08T18:34:49.823601+0000","last_active":"2024-05-08T18:34:49.823572+0000","last_peered":"2024-05-08T18:34:49.823572+0000","last_clean":"2024-05-08T18:34:49.823572+0000","last_became_active":"2024-05-08T18:30:58.306545+0000","last_became_peered":"2024-05-08T18:30:58.306545+0000","last_unstale":"2024-05-08T18:34:49.823572+0000","last_undegraded":"2024-05-08T18:34:49.823572+0000","last_fullsized":"2024-05-08T18:34:49.823572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:49.823481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:49.823481+0000","last_clean_scrub_stamp":"2024-05-08T18:34:49.823481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:44.587517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'16","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.282787+0000","last_change":"2024-05-08T18:31:00.283417+0000","last_active":"2024-05-08T18:34:07.282787+0000","last_peered":"2024-05-08T18:34:07.282787+0000","last_clean":"2024-05-08T18:34:07.282787+0000","last_became_active":"2024-05-08T18:31:00.283048+0000","last_became_peered":"2024-05-08T18:31:00.283048+0000","last_unstale":"2024-05-08T18:34:07.282787+0000","last_undegraded":"2024-05-08T18:34:07.282787+0000","last_fullsized":"2024-05-08T18:34:07.282787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179919+0000","last_change":"2024-05-08T18:30:58.302648+0000","last_active":"2024-05-08T18:33:23.179919+0000","last_peered":"2024-05-08T18:33:23.179919+0000","last_clean":"2024-05-08T18:33:23.179919+0000","last_became_active":"2024-05-08T18:30:58.302245+0000","last_became_peered":"2024-05-08T18:30:58.302245+0000","last_unstale":"2024-05-08T18:33:23.179919+0000","last_undegraded":"2024-05-08T18:33:23.179919+0000","last_fullsized":"2024-05-08T18:33:23.179919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.203096+0000","last_change":"2024-05-08T18:31:45.338509+0000","last_active":"2024-05-08T18:34:07.203096+0000","last_peered":"2024-05-08T18:34:07.203096+0000","last_clean":"2024-05-08T18:34:07.203096+0000","last_became_active":"2024-05-08T18:31:45.338192+0000","last_became_peered":"2024-05-08T18:31:45.338192+0000","last_unstale":"2024-05-08T18:34:07.203096+0000","last_undegraded":"2024-05-08T18:34:07.203096+0000","last_fullsized":"2024-05-08T18:34:07.203096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179886+0000","last_change":"2024-05-08T18:30:58.306070+0000","last_active":"2024-05-08T18:33:23.179886+0000","last_peered":"2024-05-08T18:33:23.179886+0000","last_clean":"2024-05-08T18:33:23.179886+0000","last_became_active":"2024-05-08T18:30:58.304222+0000","last_became_peered":"2024-05-08T18:30:58.304222+0000","last_unstale":"2024-05-08T18:33:23.179886+0000","last_undegraded":"2024-05-08T18:33:23.179886+0000","last_fullsized":"2024-05-08T18:33:23.179886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"27'6","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.180672+0000","last_change":"2024-05-08T18:31:00.296365+0000","last_active":"2024-05-08T18:33:28.180672+0000","last_peered":"2024-05-08T18:33:28.180672+0000","last_clean":"2024-05-08T18:33:28.180672+0000","last_became_active":"2024-05-08T18:31:00.295990+0000","last_became_peered":"2024-05-08T18:31:00.295990+0000","last_unstale":"2024-05-08T18:33:28.180672+0000","last_undegraded":"2024-05-08T18:33:28.180672+0000","last_fullsized":"2024-05-08T18:33:28.180672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179207+0000","last_change":"2024-05-08T18:30:58.285289+0000","last_active":"2024-05-08T18:33:23.179207+0000","last_peered":"2024-05-08T18:33:23.179207+0000","last_clean":"2024-05-08T18:33:23.179207+0000","last_became_active":"2024-05-08T18:30:58.283821+0000","last_became_peered":"2024-05-08T18:30:58.283821+0000","last_unstale":"2024-05-08T18:33:23.179207+0000","last_undegraded":"2024-05-08T18:33:23.179207+0000","last_fullsized":"2024-05-08T18:33:23.179207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:48.577008+0000","last_change":"2024-05-08T18:34:48.577045+0000","last_active":"2024-05-08T18:34:48.577008+0000","last_peered":"2024-05-08T18:34:48.577008+0000","last_clean":"2024-05-08T18:34:48.577008+0000","last_became_active":"2024-05-08T18:31:00.280827+0000","last_became_peered":"2024-05-08T18:31:00.280827+0000","last_unstale":"2024-05-08T18:34:48.577008+0000","last_undegraded":"2024-05-08T18:34:48.577008+0000","last_fullsized":"2024-05-08T18:34:48.577008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:48.576925+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:48.576925+0000","last_clean_scrub_stamp":"2024-05-08T18:34:48.576925+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:44.850249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.179492+0000","last_change":"2024-05-08T18:30:58.306076+0000","last_active":"2024-05-08T18:33:18.179492+0000","last_peered":"2024-05-08T18:33:18.179492+0000","last_clean":"2024-05-08T18:33:18.179492+0000","last_became_active":"2024-05-08T18:30:58.305571+0000","last_became_peered":"2024-05-08T18:30:58.305571+0000","last_unstale":"2024-05-08T18:33:18.179492+0000","last_undegraded":"2024-05-08T18:33:18.179492+0000","last_fullsized":"2024-05-08T18:33:18.179492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.292012+0000","last_change":"2024-05-08T18:31:08.318466+0000","last_active":"2024-05-08T18:34:07.292012+0000","last_peered":"2024-05-08T18:34:07.292012+0000","last_clean":"2024-05-08T18:34:07.292012+0000","last_became_active":"2024-05-08T18:31:08.318181+0000","last_became_peered":"2024-05-08T18:31:08.318181+0000","last_unstale":"2024-05-08T18:34:07.292012+0000","last_undegraded":"2024-05-08T18:34:07.292012+0000","last_fullsized":"2024-05-08T18:34:07.292012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.180426+0000","last_change":"2024-05-08T18:31:00.296553+0000","last_active":"2024-05-08T18:33:23.180426+0000","last_peered":"2024-05-08T18:33:23.180426+0000","last_clean":"2024-05-08T18:33:23.180426+0000","last_became_active":"2024-05-08T18:31:00.296160+0000","last_became_peered":"2024-05-08T18:31:00.296160+0000","last_unstale":"2024-05-08T18:33:23.180426+0000","last_undegraded":"2024-05-08T18:33:23.180426+0000","last_fullsized":"2024-05-08T18:33:23.180426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.179516+0000","last_change":"2024-05-08T18:30:58.317375+0000","last_active":"2024-05-08T18:33:18.179516+0000","last_peered":"2024-05-08T18:33:18.179516+0000","last_clean":"2024-05-08T18:33:18.179516+0000","last_became_active":"2024-05-08T18:30:58.315246+0000","last_became_peered":"2024-05-08T18:30:58.315246+0000","last_unstale":"2024-05-08T18:33:18.179516+0000","last_undegraded":"2024-05-08T18:33:18.179516+0000","last_fullsized":"2024-05-08T18:33:18.179516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.660068+0000","last_change":"2024-05-08T18:34:23.660113+0000","last_active":"2024-05-08T18:34:23.660068+0000","last_peered":"2024-05-08T18:34:23.660068+0000","last_clean":"2024-05-08T18:34:23.660068+0000","last_became_active":"2024-05-08T18:31:02.290465+0000","last_became_peered":"2024-05-08T18:31:02.290465+0000","last_unstale":"2024-05-08T18:34:23.660068+0000","last_undegraded":"2024-05-08T18:34:23.660068+0000","last_fullsized":"2024-05-08T18:34:23.660068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:23.659943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:23.659943+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.659943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:25.967513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:43.420662+0000","last_change":"2024-05-08T18:34:43.420702+0000","last_active":"2024-05-08T18:34:43.420662+0000","last_peered":"2024-05-08T18:34:43.420662+0000","last_clean":"2024-05-08T18:34:43.420662+0000","last_became_active":"2024-05-08T18:31:04.303815+0000","last_became_peered":"2024-05-08T18:31:04.303815+0000","last_unstale":"2024-05-08T18:34:43.420662+0000","last_undegraded":"2024-05-08T18:34:43.420662+0000","last_fullsized":"2024-05-08T18:34:43.420662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:43.420568+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:43.420568+0000","last_clean_scrub_stamp":"2024-05-08T18:34:43.420568+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:05.585424+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.889107+0000","last_change":"2024-05-08T18:34:24.889148+0000","last_active":"2024-05-08T18:34:24.889107+0000","last_peered":"2024-05-08T18:34:24.889107+0000","last_clean":"2024-05-08T18:34:24.889107+0000","last_became_active":"2024-05-08T18:31:06.310555+0000","last_became_peered":"2024-05-08T18:31:06.310555+0000","last_unstale":"2024-05-08T18:34:24.889107+0000","last_undegraded":"2024-05-08T18:34:24.889107+0000","last_fullsized":"2024-05-08T18:34:24.889107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:24.889019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:24.889019+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.889019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:06.963972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.181420+0000","last_change":"2024-05-08T18:31:08.319311+0000","last_active":"2024-05-08T18:33:33.181420+0000","last_peered":"2024-05-08T18:33:33.181420+0000","last_clean":"2024-05-08T18:33:33.181420+0000","last_became_active":"2024-05-08T18:31:08.319009+0000","last_became_peered":"2024-05-08T18:31:08.319009+0000","last_unstale":"2024-05-08T18:33:33.181420+0000","last_undegraded":"2024-05-08T18:33:33.181420+0000","last_fullsized":"2024-05-08T18:33:33.181420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:39.555342+0000","last_change":"2024-05-08T18:34:39.555368+0000","last_active":"2024-05-08T18:34:39.555342+0000","last_peered":"2024-05-08T18:34:39.555342+0000","last_clean":"2024-05-08T18:34:39.555342+0000","last_became_active":"2024-05-08T18:31:00.297497+0000","last_became_peered":"2024-05-08T18:31:00.297497+0000","last_unstale":"2024-05-08T18:34:39.555342+0000","last_undegraded":"2024-05-08T18:34:39.555342+0000","last_fullsized":"2024-05-08T18:34:39.555342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:34:39.555243+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:34:39.555243+0000","last_clean_scrub_stamp":"2024-05-08T18:34:39.555243+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:16.257470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178835+0000","last_change":"2024-05-08T18:30:58.300036+0000","last_active":"2024-05-08T18:33:18.178835+0000","last_peered":"2024-05-08T18:33:18.178835+0000","last_clean":"2024-05-08T18:33:18.178835+0000","last_became_active":"2024-05-08T18:30:58.299649+0000","last_became_peered":"2024-05-08T18:30:58.299649+0000","last_unstale":"2024-05-08T18:33:18.178835+0000","last_undegraded":"2024-05-08T18:33:18.178835+0000","last_fullsized":"2024-05-08T18:33:18.178835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"29'2","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:35.582295+0000","last_change":"2024-05-08T18:34:35.582330+0000","last_active":"2024-05-08T18:34:35.582295+0000","last_peered":"2024-05-08T18:34:35.582295+0000","last_clean":"2024-05-08T18:34:35.582295+0000","last_became_active":"2024-05-08T18:31:02.293993+0000","last_became_peered":"2024-05-08T18:31:02.293993+0000","last_unstale":"2024-05-08T18:34:35.582295+0000","last_undegraded":"2024-05-08T18:34:35.582295+0000","last_fullsized":"2024-05-08T18:34:35.582295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:35.582207+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:35.582207+0000","last_clean_scrub_stamp":"2024-05-08T18:34:35.582207+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:12.476691+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'10","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.907482+0000","last_change":"2024-05-08T18:34:23.907510+0000","last_active":"2024-05-08T18:34:23.907482+0000","last_peered":"2024-05-08T18:34:23.907482+0000","last_clean":"2024-05-08T18:34:23.907482+0000","last_became_active":"2024-05-08T18:31:04.300059+0000","last_became_peered":"2024-05-08T18:31:04.300059+0000","last_unstale":"2024-05-08T18:34:23.907482+0000","last_undegraded":"2024-05-08T18:34:23.907482+0000","last_fullsized":"2024-05-08T18:34:23.907482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:23.907379+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:23.907379+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.907379+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:16.891137+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.722083+0000","last_change":"2024-05-08T18:34:32.722108+0000","last_active":"2024-05-08T18:34:32.722083+0000","last_peered":"2024-05-08T18:34:32.722083+0000","last_clean":"2024-05-08T18:34:32.722083+0000","last_became_active":"2024-05-08T18:31:06.312651+0000","last_became_peered":"2024-05-08T18:31:06.312651+0000","last_unstale":"2024-05-08T18:34:32.722083+0000","last_undegraded":"2024-05-08T18:34:32.722083+0000","last_fullsized":"2024-05-08T18:34:32.722083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:32.721992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:32.721992+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.721992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:27.698590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:45.631065+0000","last_change":"2024-05-08T18:34:45.631098+0000","last_active":"2024-05-08T18:34:45.631065+0000","last_peered":"2024-05-08T18:34:45.631065+0000","last_clean":"2024-05-08T18:34:45.631065+0000","last_became_active":"2024-05-08T18:31:08.311048+0000","last_became_peered":"2024-05-08T18:31:08.311048+0000","last_unstale":"2024-05-08T18:34:45.631065+0000","last_undegraded":"2024-05-08T18:34:45.631065+0000","last_fullsized":"2024-05-08T18:34:45.631065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:45.630966+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:45.630966+0000","last_clean_scrub_stamp":"2024-05-08T18:34:45.630966+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:57.506022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.247430+0000","last_change":"2024-05-08T18:31:00.296832+0000","last_active":"2024-05-08T18:34:07.247430+0000","last_peered":"2024-05-08T18:34:07.247430+0000","last_clean":"2024-05-08T18:34:07.247430+0000","last_became_active":"2024-05-08T18:31:00.296176+0000","last_became_peered":"2024-05-08T18:31:00.296176+0000","last_unstale":"2024-05-08T18:34:07.247430+0000","last_undegraded":"2024-05-08T18:34:07.247430+0000","last_fullsized":"2024-05-08T18:34:07.247430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.179441+0000","last_change":"2024-05-08T18:30:58.310108+0000","last_active":"2024-05-08T18:33:18.179441+0000","last_peered":"2024-05-08T18:33:18.179441+0000","last_clean":"2024-05-08T18:33:18.179441+0000","last_became_active":"2024-05-08T18:30:58.309339+0000","last_became_peered":"2024-05-08T18:30:58.309339+0000","last_unstale":"2024-05-08T18:33:18.179441+0000","last_undegraded":"2024-05-08T18:33:18.179441+0000","last_fullsized":"2024-05-08T18:33:18.179441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.186928+0000","last_change":"2024-05-08T18:31:45.335793+0000","last_active":"2024-05-08T18:34:13.186928+0000","last_peered":"2024-05-08T18:34:13.186928+0000","last_clean":"2024-05-08T18:34:13.186928+0000","last_became_active":"2024-05-08T18:31:45.335489+0000","last_became_peered":"2024-05-08T18:31:45.335489+0000","last_unstale":"2024-05-08T18:34:13.186928+0000","last_undegraded":"2024-05-08T18:34:13.186928+0000","last_fullsized":"2024-05-08T18:34:13.186928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'16","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.718300+0000","last_change":"2024-05-08T18:34:29.718370+0000","last_active":"2024-05-08T18:34:29.718300+0000","last_peered":"2024-05-08T18:34:29.718300+0000","last_clean":"2024-05-08T18:34:29.718300+0000","last_became_active":"2024-05-08T18:31:04.300022+0000","last_became_peered":"2024-05-08T18:31:04.300022+0000","last_unstale":"2024-05-08T18:34:29.718300+0000","last_undegraded":"2024-05-08T18:34:29.718300+0000","last_fullsized":"2024-05-08T18:34:29.718300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T18:34:29.718201+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T18:34:29.718201+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.718201+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:19.939460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'285","reported_seq":402,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:40.541175+0000","last_change":"2024-05-08T18:34:40.541202+0000","last_active":"2024-05-08T18:34:40.541175+0000","last_peered":"2024-05-08T18:34:40.541175+0000","last_clean":"2024-05-08T18:34:40.541175+0000","last_became_active":"2024-05-08T18:31:06.306886+0000","last_became_peered":"2024-05-08T18:31:06.306886+0000","last_unstale":"2024-05-08T18:34:40.541175+0000","last_undegraded":"2024-05-08T18:34:40.541175+0000","last_fullsized":"2024-05-08T18:34:40.541175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:40.541078+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:40.541078+0000","last_clean_scrub_stamp":"2024-05-08T18:34:40.541078+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:11:57.055230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.182136+0000","last_change":"2024-05-08T18:31:08.312050+0000","last_active":"2024-05-08T18:33:38.182136+0000","last_peered":"2024-05-08T18:33:38.182136+0000","last_clean":"2024-05-08T18:33:38.182136+0000","last_became_active":"2024-05-08T18:31:08.311780+0000","last_became_peered":"2024-05-08T18:31:08.311780+0000","last_unstale":"2024-05-08T18:33:38.182136+0000","last_undegraded":"2024-05-08T18:33:38.182136+0000","last_fullsized":"2024-05-08T18:33:38.182136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:47.606707+0000","last_change":"2024-05-08T18:34:47.606735+0000","last_active":"2024-05-08T18:34:47.606707+0000","last_peered":"2024-05-08T18:34:47.606707+0000","last_clean":"2024-05-08T18:34:47.606707+0000","last_became_active":"2024-05-08T18:31:00.281268+0000","last_became_peered":"2024-05-08T18:31:00.281268+0000","last_unstale":"2024-05-08T18:34:47.606707+0000","last_undegraded":"2024-05-08T18:34:47.606707+0000","last_fullsized":"2024-05-08T18:34:47.606707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:34:47.606608+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:34:47.606608+0000","last_clean_scrub_stamp":"2024-05-08T18:34:47.606608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:22:11.586979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:51.636588+0000","last_change":"2024-05-08T18:34:51.636616+0000","last_active":"2024-05-08T18:34:51.636588+0000","last_peered":"2024-05-08T18:34:51.636588+0000","last_clean":"2024-05-08T18:34:51.636588+0000","last_became_active":"2024-05-08T18:30:58.303428+0000","last_became_peered":"2024-05-08T18:30:58.303428+0000","last_unstale":"2024-05-08T18:34:51.636588+0000","last_undegraded":"2024-05-08T18:34:51.636588+0000","last_fullsized":"2024-05-08T18:34:51.636588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:51.636503+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:51.636503+0000","last_clean_scrub_stamp":"2024-05-08T18:34:51.636503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:33.197546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.686239+0000","last_change":"2024-05-08T18:34:20.686287+0000","last_active":"2024-05-08T18:34:20.686239+0000","last_peered":"2024-05-08T18:34:20.686239+0000","last_clean":"2024-05-08T18:34:20.686239+0000","last_became_active":"2024-05-08T18:31:02.291729+0000","last_became_peered":"2024-05-08T18:31:02.291729+0000","last_unstale":"2024-05-08T18:34:20.686239+0000","last_undegraded":"2024-05-08T18:34:20.686239+0000","last_fullsized":"2024-05-08T18:34:20.686239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:20.686141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:20.686141+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.686141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:15.450176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.681287+0000","last_change":"2024-05-08T18:34:25.681329+0000","last_active":"2024-05-08T18:34:25.681287+0000","last_peered":"2024-05-08T18:34:25.681287+0000","last_clean":"2024-05-08T18:34:25.681287+0000","last_became_active":"2024-05-08T18:31:04.304347+0000","last_became_peered":"2024-05-08T18:31:04.304347+0000","last_unstale":"2024-05-08T18:34:25.681287+0000","last_undegraded":"2024-05-08T18:34:25.681287+0000","last_fullsized":"2024-05-08T18:34:25.681287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:25.681197+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:25.681197+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.681197+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:06.403836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.709773+0000","last_change":"2024-05-08T18:34:22.709806+0000","last_active":"2024-05-08T18:34:22.709773+0000","last_peered":"2024-05-08T18:34:22.709773+0000","last_clean":"2024-05-08T18:34:22.709773+0000","last_became_active":"2024-05-08T18:31:06.305591+0000","last_became_peered":"2024-05-08T18:31:06.305591+0000","last_unstale":"2024-05-08T18:34:22.709773+0000","last_undegraded":"2024-05-08T18:34:22.709773+0000","last_fullsized":"2024-05-08T18:34:22.709773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:22.709682+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:22.709682+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.709682+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:04.769028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'10","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.282978+0000","last_change":"2024-05-08T18:31:00.291398+0000","last_active":"2024-05-08T18:34:07.282978+0000","last_peered":"2024-05-08T18:34:07.282978+0000","last_clean":"2024-05-08T18:34:07.282978+0000","last_became_active":"2024-05-08T18:31:00.290824+0000","last_became_peered":"2024-05-08T18:31:00.290824+0000","last_unstale":"2024-05-08T18:34:07.282978+0000","last_undegraded":"2024-05-08T18:34:07.282978+0000","last_fullsized":"2024-05-08T18:34:07.282978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178086+0000","last_change":"2024-05-08T18:30:58.301227+0000","last_active":"2024-05-08T18:33:13.178086+0000","last_peered":"2024-05-08T18:33:13.178086+0000","last_clean":"2024-05-08T18:33:13.178086+0000","last_became_active":"2024-05-08T18:30:58.300884+0000","last_became_peered":"2024-05-08T18:30:58.300884+0000","last_unstale":"2024-05-08T18:33:13.178086+0000","last_undegraded":"2024-05-08T18:33:13.178086+0000","last_fullsized":"2024-05-08T18:33:13.178086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.781964+0000","last_change":"2024-05-08T18:34:29.781989+0000","last_active":"2024-05-08T18:34:29.781964+0000","last_peered":"2024-05-08T18:34:29.781964+0000","last_clean":"2024-05-08T18:34:29.781964+0000","last_became_active":"2024-05-08T18:31:02.291536+0000","last_became_peered":"2024-05-08T18:31:02.291536+0000","last_unstale":"2024-05-08T18:34:29.781964+0000","last_undegraded":"2024-05-08T18:34:29.781964+0000","last_fullsized":"2024-05-08T18:34:29.781964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:29.781874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:29.781874+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.781874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:12.430820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'52","reported_seq":112,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.726338+0000","last_change":"2024-05-08T18:34:27.726388+0000","last_active":"2024-05-08T18:34:27.726338+0000","last_peered":"2024-05-08T18:34:27.726338+0000","last_clean":"2024-05-08T18:34:27.726338+0000","last_became_active":"2024-05-08T18:31:04.302455+0000","last_became_peered":"2024-05-08T18:31:04.302455+0000","last_unstale":"2024-05-08T18:34:27.726338+0000","last_undegraded":"2024-05-08T18:34:27.726338+0000","last_fullsized":"2024-05-08T18:34:27.726338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'52","last_scrub_stamp":"2024-05-08T18:34:27.726254+0000","last_deep_scrub":"29'52","last_deep_scrub_stamp":"2024-05-08T18:34:27.726254+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.726254+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:57.760805+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.615602+0000","last_change":"2024-05-08T18:34:24.615646+0000","last_active":"2024-05-08T18:34:24.615602+0000","last_peered":"2024-05-08T18:34:24.615602+0000","last_clean":"2024-05-08T18:34:24.615602+0000","last_became_active":"2024-05-08T18:31:06.304979+0000","last_became_peered":"2024-05-08T18:31:06.304979+0000","last_unstale":"2024-05-08T18:34:24.615602+0000","last_undegraded":"2024-05-08T18:34:24.615602+0000","last_fullsized":"2024-05-08T18:34:24.615602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:24.615505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:24.615505+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.615505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:06.690459+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.177952+0000","last_change":"2024-05-08T18:31:08.311725+0000","last_active":"2024-05-08T18:33:13.177952+0000","last_peered":"2024-05-08T18:33:13.177952+0000","last_clean":"2024-05-08T18:33:13.177952+0000","last_became_active":"2024-05-08T18:31:08.311434+0000","last_became_peered":"2024-05-08T18:31:08.311434+0000","last_unstale":"2024-05-08T18:33:13.177952+0000","last_undegraded":"2024-05-08T18:33:13.177952+0000","last_fullsized":"2024-05-08T18:33:13.177952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:49.625721+0000","last_change":"2024-05-08T18:34:49.625755+0000","last_active":"2024-05-08T18:34:49.625721+0000","last_peered":"2024-05-08T18:34:49.625721+0000","last_clean":"2024-05-08T18:34:49.625721+0000","last_became_active":"2024-05-08T18:31:00.280969+0000","last_became_peered":"2024-05-08T18:31:00.280969+0000","last_unstale":"2024-05-08T18:34:49.625721+0000","last_undegraded":"2024-05-08T18:34:49.625721+0000","last_fullsized":"2024-05-08T18:34:49.625721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:49.625593+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:49.625593+0000","last_clean_scrub_stamp":"2024-05-08T18:34:49.625593+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:50.500448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178036+0000","last_change":"2024-05-08T18:30:58.303460+0000","last_active":"2024-05-08T18:33:13.178036+0000","last_peered":"2024-05-08T18:33:13.178036+0000","last_clean":"2024-05-08T18:33:13.178036+0000","last_became_active":"2024-05-08T18:30:58.302590+0000","last_became_peered":"2024-05-08T18:30:58.302590+0000","last_unstale":"2024-05-08T18:33:13.178036+0000","last_undegraded":"2024-05-08T18:33:13.178036+0000","last_fullsized":"2024-05-08T18:33:13.178036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:42.569371+0000","last_change":"2024-05-08T18:34:42.569395+0000","last_active":"2024-05-08T18:34:42.569371+0000","last_peered":"2024-05-08T18:34:42.569371+0000","last_clean":"2024-05-08T18:34:42.569371+0000","last_became_active":"2024-05-08T18:31:02.289394+0000","last_became_peered":"2024-05-08T18:31:02.289394+0000","last_unstale":"2024-05-08T18:34:42.569371+0000","last_undegraded":"2024-05-08T18:34:42.569371+0000","last_fullsized":"2024-05-08T18:34:42.569371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:42.569274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:42.569274+0000","last_clean_scrub_stamp":"2024-05-08T18:34:42.569274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:44.876844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'38","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:45.366976+0000","last_change":"2024-05-08T18:34:45.367013+0000","last_active":"2024-05-08T18:34:45.366976+0000","last_peered":"2024-05-08T18:34:45.366976+0000","last_clean":"2024-05-08T18:34:45.366976+0000","last_became_active":"2024-05-08T18:31:04.302886+0000","last_became_peered":"2024-05-08T18:31:04.302886+0000","last_unstale":"2024-05-08T18:34:45.366976+0000","last_undegraded":"2024-05-08T18:34:45.366976+0000","last_fullsized":"2024-05-08T18:34:45.366976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-08T18:34:45.366871+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-08T18:34:45.366871+0000","last_clean_scrub_stamp":"2024-05-08T18:34:45.366871+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:13.940428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.644103+0000","last_change":"2024-05-08T18:34:19.644132+0000","last_active":"2024-05-08T18:34:19.644103+0000","last_peered":"2024-05-08T18:34:19.644103+0000","last_clean":"2024-05-08T18:34:19.644103+0000","last_became_active":"2024-05-08T18:31:06.306607+0000","last_became_peered":"2024-05-08T18:31:06.306607+0000","last_unstale":"2024-05-08T18:34:19.644103+0000","last_undegraded":"2024-05-08T18:34:19.644103+0000","last_fullsized":"2024-05-08T18:34:19.644103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:19.644005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:19.644005+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.644005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:04:00.192002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:36.713752+0000","last_change":"2024-05-08T18:34:36.713780+0000","last_active":"2024-05-08T18:34:36.713752+0000","last_peered":"2024-05-08T18:34:36.713752+0000","last_clean":"2024-05-08T18:34:36.713752+0000","last_became_active":"2024-05-08T18:31:08.305127+0000","last_became_peered":"2024-05-08T18:31:08.305127+0000","last_unstale":"2024-05-08T18:34:36.713752+0000","last_undegraded":"2024-05-08T18:34:36.713752+0000","last_fullsized":"2024-05-08T18:34:36.713752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:36.713654+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:36.713654+0000","last_clean_scrub_stamp":"2024-05-08T18:34:36.713654+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:58.222971+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:52.890720+0000","last_change":"2024-05-08T18:34:52.890746+0000","last_active":"2024-05-08T18:34:52.890720+0000","last_peered":"2024-05-08T18:34:52.890720+0000","last_clean":"2024-05-08T18:34:52.890720+0000","last_became_active":"2024-05-08T18:31:00.293170+0000","last_became_peered":"2024-05-08T18:31:00.293170+0000","last_unstale":"2024-05-08T18:34:52.890720+0000","last_undegraded":"2024-05-08T18:34:52.890720+0000","last_fullsized":"2024-05-08T18:34:52.890720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:52.890630+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:52.890630+0000","last_clean_scrub_stamp":"2024-05-08T18:34:52.890630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:55.198199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178671+0000","last_change":"2024-05-08T18:30:58.316505+0000","last_active":"2024-05-08T18:33:13.178671+0000","last_peered":"2024-05-08T18:33:13.178671+0000","last_clean":"2024-05-08T18:33:13.178671+0000","last_became_active":"2024-05-08T18:30:58.314352+0000","last_became_peered":"2024-05-08T18:30:58.314352+0000","last_unstale":"2024-05-08T18:33:13.178671+0000","last_undegraded":"2024-05-08T18:33:13.178671+0000","last_fullsized":"2024-05-08T18:33:13.178671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:03.185535+0000","last_change":"2024-05-08T18:31:45.339752+0000","last_active":"2024-05-08T18:34:03.185535+0000","last_peered":"2024-05-08T18:34:03.185535+0000","last_clean":"2024-05-08T18:34:03.185535+0000","last_became_active":"2024-05-08T18:31:45.339423+0000","last_became_peered":"2024-05-08T18:31:45.339423+0000","last_unstale":"2024-05-08T18:34:03.185535+0000","last_undegraded":"2024-05-08T18:34:03.185535+0000","last_fullsized":"2024-05-08T18:34:03.185535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.605942+0000","last_change":"2024-05-08T18:34:32.606003+0000","last_active":"2024-05-08T18:34:32.605942+0000","last_peered":"2024-05-08T18:34:32.605942+0000","last_clean":"2024-05-08T18:34:32.605942+0000","last_became_active":"2024-05-08T18:31:04.298026+0000","last_became_peered":"2024-05-08T18:31:04.298026+0000","last_unstale":"2024-05-08T18:34:32.605942+0000","last_undegraded":"2024-05-08T18:34:32.605942+0000","last_fullsized":"2024-05-08T18:34:32.605942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T18:34:32.605858+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T18:34:32.605858+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.605858+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:39.227348+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":366,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.673032+0000","last_change":"2024-05-08T18:34:18.673057+0000","last_active":"2024-05-08T18:34:18.673032+0000","last_peered":"2024-05-08T18:34:18.673032+0000","last_clean":"2024-05-08T18:34:18.673032+0000","last_became_active":"2024-05-08T18:31:06.306655+0000","last_became_peered":"2024-05-08T18:31:06.306655+0000","last_unstale":"2024-05-08T18:34:18.673032+0000","last_undegraded":"2024-05-08T18:34:18.673032+0000","last_fullsized":"2024-05-08T18:34:18.673032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:18.672962+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:18.672962+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.672962+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:15.669294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178617+0000","last_change":"2024-05-08T18:31:08.314593+0000","last_active":"2024-05-08T18:33:18.178617+0000","last_peered":"2024-05-08T18:33:18.178617+0000","last_clean":"2024-05-08T18:33:18.178617+0000","last_became_active":"2024-05-08T18:31:08.314273+0000","last_became_peered":"2024-05-08T18:31:08.314273+0000","last_unstale":"2024-05-08T18:33:18.178617+0000","last_undegraded":"2024-05-08T18:33:18.178617+0000","last_fullsized":"2024-05-08T18:33:18.178617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:44.889160+0000","last_change":"2024-05-08T18:34:44.889203+0000","last_active":"2024-05-08T18:34:44.889160+0000","last_peered":"2024-05-08T18:34:44.889160+0000","last_clean":"2024-05-08T18:34:44.889160+0000","last_became_active":"2024-05-08T18:31:00.282941+0000","last_became_peered":"2024-05-08T18:31:00.282941+0000","last_unstale":"2024-05-08T18:34:44.889160+0000","last_undegraded":"2024-05-08T18:34:44.889160+0000","last_fullsized":"2024-05-08T18:34:44.889160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:44.889056+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:44.889056+0000","last_clean_scrub_stamp":"2024-05-08T18:34:44.889056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:44:35.228659+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178604+0000","last_change":"2024-05-08T18:30:58.316967+0000","last_active":"2024-05-08T18:33:13.178604+0000","last_peered":"2024-05-08T18:33:13.178604+0000","last_clean":"2024-05-08T18:33:13.178604+0000","last_became_active":"2024-05-08T18:30:58.313431+0000","last_became_peered":"2024-05-08T18:30:58.313431+0000","last_unstale":"2024-05-08T18:33:13.178604+0000","last_undegraded":"2024-05-08T18:33:13.178604+0000","last_fullsized":"2024-05-08T18:33:13.178604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:40.577730+0000","last_change":"2024-05-08T18:34:40.577762+0000","last_active":"2024-05-08T18:34:40.577730+0000","last_peered":"2024-05-08T18:34:40.577730+0000","last_clean":"2024-05-08T18:34:40.577730+0000","last_became_active":"2024-05-08T18:31:02.289669+0000","last_became_peered":"2024-05-08T18:31:02.289669+0000","last_unstale":"2024-05-08T18:34:40.577730+0000","last_undegraded":"2024-05-08T18:34:40.577730+0000","last_fullsized":"2024-05-08T18:34:40.577730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:40.577639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:40.577639+0000","last_clean_scrub_stamp":"2024-05-08T18:34:40.577639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:06.519788+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'67","reported_seq":140,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:48.381000+0000","last_change":"2024-05-08T18:34:48.381040+0000","last_active":"2024-05-08T18:34:48.381000+0000","last_peered":"2024-05-08T18:34:48.381000+0000","last_clean":"2024-05-08T18:34:48.381000+0000","last_became_active":"2024-05-08T18:31:04.302244+0000","last_became_peered":"2024-05-08T18:31:04.302244+0000","last_unstale":"2024-05-08T18:34:48.381000+0000","last_undegraded":"2024-05-08T18:34:48.381000+0000","last_fullsized":"2024-05-08T18:34:48.381000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'67","last_scrub_stamp":"2024-05-08T18:34:48.380911+0000","last_deep_scrub":"29'67","last_deep_scrub_stamp":"2024-05-08T18:34:48.380911+0000","last_clean_scrub_stamp":"2024-05-08T18:34:48.380911+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:33.160250+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.686336+0000","last_change":"2024-05-08T18:34:21.686381+0000","last_active":"2024-05-08T18:34:21.686336+0000","last_peered":"2024-05-08T18:34:21.686336+0000","last_clean":"2024-05-08T18:34:21.686336+0000","last_became_active":"2024-05-08T18:31:06.308806+0000","last_became_peered":"2024-05-08T18:31:06.308806+0000","last_unstale":"2024-05-08T18:34:21.686336+0000","last_undegraded":"2024-05-08T18:34:21.686336+0000","last_fullsized":"2024-05-08T18:34:21.686336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:21.686225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:21.686225+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.686225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:12.963774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.384919+0000","last_change":"2024-05-08T18:31:08.319703+0000","last_active":"2024-05-08T18:34:07.384919+0000","last_peered":"2024-05-08T18:34:07.384919+0000","last_clean":"2024-05-08T18:34:07.384919+0000","last_became_active":"2024-05-08T18:31:08.319370+0000","last_became_peered":"2024-05-08T18:31:08.319370+0000","last_unstale":"2024-05-08T18:34:07.384919+0000","last_undegraded":"2024-05-08T18:34:07.384919+0000","last_fullsized":"2024-05-08T18:34:07.384919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'6","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:42.729020+0000","last_change":"2024-05-08T18:34:42.729045+0000","last_active":"2024-05-08T18:34:42.729020+0000","last_peered":"2024-05-08T18:34:42.729020+0000","last_clean":"2024-05-08T18:34:42.729020+0000","last_became_active":"2024-05-08T18:31:00.292154+0000","last_became_peered":"2024-05-08T18:31:00.292154+0000","last_unstale":"2024-05-08T18:34:42.729020+0000","last_undegraded":"2024-05-08T18:34:42.729020+0000","last_fullsized":"2024-05-08T18:34:42.729020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:42.728933+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:42.728933+0000","last_clean_scrub_stamp":"2024-05-08T18:34:42.728933+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:45.036503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.177647+0000","last_change":"2024-05-08T18:30:58.294896+0000","last_active":"2024-05-08T18:33:13.177647+0000","last_peered":"2024-05-08T18:33:13.177647+0000","last_clean":"2024-05-08T18:33:13.177647+0000","last_became_active":"2024-05-08T18:30:58.294377+0000","last_became_peered":"2024-05-08T18:30:58.294377+0000","last_unstale":"2024-05-08T18:33:13.177647+0000","last_undegraded":"2024-05-08T18:33:13.177647+0000","last_fullsized":"2024-05-08T18:33:13.177647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:35.836892+0000","last_change":"2024-05-08T18:34:35.836915+0000","last_active":"2024-05-08T18:34:35.836892+0000","last_peered":"2024-05-08T18:34:35.836892+0000","last_clean":"2024-05-08T18:34:35.836892+0000","last_became_active":"2024-05-08T18:31:02.293680+0000","last_became_peered":"2024-05-08T18:31:02.293680+0000","last_unstale":"2024-05-08T18:34:35.836892+0000","last_undegraded":"2024-05-08T18:34:35.836892+0000","last_fullsized":"2024-05-08T18:34:35.836892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:35.836803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:35.836803+0000","last_clean_scrub_stamp":"2024-05-08T18:34:35.836803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:43:05.540412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'40","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.864211+0000","last_change":"2024-05-08T18:34:22.864247+0000","last_active":"2024-05-08T18:34:22.864211+0000","last_peered":"2024-05-08T18:34:22.864211+0000","last_clean":"2024-05-08T18:34:22.864211+0000","last_became_active":"2024-05-08T18:31:04.301147+0000","last_became_peered":"2024-05-08T18:31:04.301147+0000","last_unstale":"2024-05-08T18:34:22.864211+0000","last_undegraded":"2024-05-08T18:34:22.864211+0000","last_fullsized":"2024-05-08T18:34:22.864211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-08T18:34:22.864124+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-08T18:34:22.864124+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.864124+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:04.923471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:50.411251+0000","last_change":"2024-05-08T18:34:50.411290+0000","last_active":"2024-05-08T18:34:50.411251+0000","last_peered":"2024-05-08T18:34:50.411251+0000","last_clean":"2024-05-08T18:34:50.411251+0000","last_became_active":"2024-05-08T18:31:06.308804+0000","last_became_peered":"2024-05-08T18:31:06.308804+0000","last_unstale":"2024-05-08T18:34:50.411251+0000","last_undegraded":"2024-05-08T18:34:50.411251+0000","last_fullsized":"2024-05-08T18:34:50.411251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:50.411147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:50.411147+0000","last_clean_scrub_stamp":"2024-05-08T18:34:50.411147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:30.290258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.337225+0000","last_change":"2024-05-08T18:31:08.320629+0000","last_active":"2024-05-08T18:34:07.337225+0000","last_peered":"2024-05-08T18:34:07.337225+0000","last_clean":"2024-05-08T18:34:07.337225+0000","last_became_active":"2024-05-08T18:31:08.320150+0000","last_became_peered":"2024-05-08T18:31:08.320150+0000","last_unstale":"2024-05-08T18:34:07.337225+0000","last_undegraded":"2024-05-08T18:34:07.337225+0000","last_fullsized":"2024-05-08T18:34:07.337225+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'4","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.629660+0000","last_change":"2024-05-08T18:34:31.629691+0000","last_active":"2024-05-08T18:34:31.629660+0000","last_peered":"2024-05-08T18:34:31.629660+0000","last_clean":"2024-05-08T18:34:31.629660+0000","last_became_active":"2024-05-08T18:31:00.299379+0000","last_became_peered":"2024-05-08T18:31:00.299379+0000","last_unstale":"2024-05-08T18:34:31.629660+0000","last_undegraded":"2024-05-08T18:34:31.629660+0000","last_fullsized":"2024-05-08T18:34:31.629660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:31.629577+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:31.629577+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.629577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:03.532639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177806+0000","last_change":"2024-05-08T18:30:58.316845+0000","last_active":"2024-05-08T18:33:08.177806+0000","last_peered":"2024-05-08T18:33:08.177806+0000","last_clean":"2024-05-08T18:33:08.177806+0000","last_became_active":"2024-05-08T18:30:58.315625+0000","last_became_peered":"2024-05-08T18:30:58.315625+0000","last_unstale":"2024-05-08T18:33:08.177806+0000","last_undegraded":"2024-05-08T18:33:08.177806+0000","last_fullsized":"2024-05-08T18:33:08.177806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:39.588566+0000","last_change":"2024-05-08T18:34:39.588620+0000","last_active":"2024-05-08T18:34:39.588566+0000","last_peered":"2024-05-08T18:34:39.588566+0000","last_clean":"2024-05-08T18:34:39.588566+0000","last_became_active":"2024-05-08T18:31:02.289767+0000","last_became_peered":"2024-05-08T18:31:02.289767+0000","last_unstale":"2024-05-08T18:34:39.588566+0000","last_undegraded":"2024-05-08T18:34:39.588566+0000","last_fullsized":"2024-05-08T18:34:39.588566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:39.588473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:39.588473+0000","last_clean_scrub_stamp":"2024-05-08T18:34:39.588473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:21.718736+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.740564+0000","last_change":"2024-05-08T18:34:31.740604+0000","last_active":"2024-05-08T18:34:31.740564+0000","last_peered":"2024-05-08T18:34:31.740564+0000","last_clean":"2024-05-08T18:34:31.740564+0000","last_became_active":"2024-05-08T18:31:04.294573+0000","last_became_peered":"2024-05-08T18:31:04.294573+0000","last_unstale":"2024-05-08T18:34:31.740564+0000","last_undegraded":"2024-05-08T18:34:31.740564+0000","last_fullsized":"2024-05-08T18:34:31.740564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T18:34:31.740471+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T18:34:31.740471+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.740471+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:36.592489+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":442,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.729935+0000","last_change":"2024-05-08T18:34:28.729967+0000","last_active":"2024-05-08T18:34:28.729935+0000","last_peered":"2024-05-08T18:34:28.729935+0000","last_clean":"2024-05-08T18:34:28.729935+0000","last_became_active":"2024-05-08T18:31:06.312203+0000","last_became_peered":"2024-05-08T18:31:06.312203+0000","last_unstale":"2024-05-08T18:34:28.729935+0000","last_undegraded":"2024-05-08T18:34:28.729935+0000","last_fullsized":"2024-05-08T18:34:28.729935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:28.729835+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:28.729835+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.729835+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:42.916625+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'14","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.339077+0000","last_change":"2024-05-08T18:31:08.314495+0000","last_active":"2024-05-08T18:34:07.339077+0000","last_peered":"2024-05-08T18:34:07.339077+0000","last_clean":"2024-05-08T18:34:07.339077+0000","last_became_active":"2024-05-08T18:31:08.314171+0000","last_became_peered":"2024-05-08T18:31:08.314171+0000","last_unstale":"2024-05-08T18:34:07.339077+0000","last_undegraded":"2024-05-08T18:34:07.339077+0000","last_fullsized":"2024-05-08T18:34:07.339077+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:50.816803+0000","last_change":"2024-05-08T18:34:50.816833+0000","last_active":"2024-05-08T18:34:50.816803+0000","last_peered":"2024-05-08T18:34:50.816803+0000","last_clean":"2024-05-08T18:34:50.816803+0000","last_became_active":"2024-05-08T18:31:00.292521+0000","last_became_peered":"2024-05-08T18:31:00.292521+0000","last_unstale":"2024-05-08T18:34:50.816803+0000","last_undegraded":"2024-05-08T18:34:50.816803+0000","last_fullsized":"2024-05-08T18:34:50.816803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:50.816688+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:50.816688+0000","last_clean_scrub_stamp":"2024-05-08T18:34:50.816688+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:09.188418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177769+0000","last_change":"2024-05-08T18:30:58.310166+0000","last_active":"2024-05-08T18:33:08.177769+0000","last_peered":"2024-05-08T18:33:08.177769+0000","last_clean":"2024-05-08T18:33:08.177769+0000","last_became_active":"2024-05-08T18:30:58.309773+0000","last_became_peered":"2024-05-08T18:30:58.309773+0000","last_unstale":"2024-05-08T18:33:08.177769+0000","last_undegraded":"2024-05-08T18:33:08.177769+0000","last_fullsized":"2024-05-08T18:33:08.177769+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'5","reported_seq":428,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.729392+0000","last_change":"2024-05-08T18:34:31.729420+0000","last_active":"2024-05-08T18:34:31.729392+0000","last_peered":"2024-05-08T18:34:31.729392+0000","last_clean":"2024-05-08T18:34:31.729392+0000","last_became_active":"2024-05-08T18:31:02.289253+0000","last_became_peered":"2024-05-08T18:31:02.289253+0000","last_unstale":"2024-05-08T18:34:31.729392+0000","last_undegraded":"2024-05-08T18:34:31.729392+0000","last_fullsized":"2024-05-08T18:34:31.729392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T18:34:31.729298+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T18:34:31.729298+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.729298+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:22.601345+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:44.374109+0000","last_change":"2024-05-08T18:34:44.374141+0000","last_active":"2024-05-08T18:34:44.374109+0000","last_peered":"2024-05-08T18:34:44.374109+0000","last_clean":"2024-05-08T18:34:44.374109+0000","last_became_active":"2024-05-08T18:31:04.303799+0000","last_became_peered":"2024-05-08T18:31:04.303799+0000","last_unstale":"2024-05-08T18:34:44.374109+0000","last_undegraded":"2024-05-08T18:34:44.374109+0000","last_fullsized":"2024-05-08T18:34:44.374109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T18:34:44.374025+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T18:34:44.374025+0000","last_clean_scrub_stamp":"2024-05-08T18:34:44.374025+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:13:06.326093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":471,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.900060+0000","last_change":"2024-05-08T18:34:18.900106+0000","last_active":"2024-05-08T18:34:18.900060+0000","last_peered":"2024-05-08T18:34:18.900060+0000","last_clean":"2024-05-08T18:34:18.900060+0000","last_became_active":"2024-05-08T18:31:06.305201+0000","last_became_peered":"2024-05-08T18:31:06.305201+0000","last_unstale":"2024-05-08T18:34:18.900060+0000","last_undegraded":"2024-05-08T18:34:18.900060+0000","last_fullsized":"2024-05-08T18:34:18.900060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:18.899957+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:18.899957+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.899957+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:33.086747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:40.831044+0000","last_change":"2024-05-08T18:34:40.831088+0000","last_active":"2024-05-08T18:34:40.831044+0000","last_peered":"2024-05-08T18:34:40.831044+0000","last_clean":"2024-05-08T18:34:40.831044+0000","last_became_active":"2024-05-08T18:31:08.310906+0000","last_became_peered":"2024-05-08T18:31:08.310906+0000","last_unstale":"2024-05-08T18:34:40.831044+0000","last_undegraded":"2024-05-08T18:34:40.831044+0000","last_fullsized":"2024-05-08T18:34:40.831044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:40.830900+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:40.830900+0000","last_clean_scrub_stamp":"2024-05-08T18:34:40.830900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:40.154817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'14","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:43.689136+0000","last_change":"2024-05-08T18:34:43.689169+0000","last_active":"2024-05-08T18:34:43.689136+0000","last_peered":"2024-05-08T18:34:43.689136+0000","last_clean":"2024-05-08T18:34:43.689136+0000","last_became_active":"2024-05-08T18:31:00.291563+0000","last_became_peered":"2024-05-08T18:31:00.291563+0000","last_unstale":"2024-05-08T18:34:43.689136+0000","last_undegraded":"2024-05-08T18:34:43.689136+0000","last_fullsized":"2024-05-08T18:34:43.689136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-08T18:34:43.689041+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-08T18:34:43.689041+0000","last_clean_scrub_stamp":"2024-05-08T18:34:43.689041+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:40.499135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177725+0000","last_change":"2024-05-08T18:30:58.304032+0000","last_active":"2024-05-08T18:33:08.177725+0000","last_peered":"2024-05-08T18:33:08.177725+0000","last_clean":"2024-05-08T18:33:08.177725+0000","last_became_active":"2024-05-08T18:30:58.302966+0000","last_became_peered":"2024-05-08T18:30:58.302966+0000","last_unstale":"2024-05-08T18:33:08.177725+0000","last_undegraded":"2024-05-08T18:33:08.177725+0000","last_fullsized":"2024-05-08T18:33:08.177725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.676566+0000","last_change":"2024-05-08T18:34:28.676588+0000","last_active":"2024-05-08T18:34:28.676566+0000","last_peered":"2024-05-08T18:34:28.676566+0000","last_clean":"2024-05-08T18:34:28.676566+0000","last_became_active":"2024-05-08T18:31:02.288232+0000","last_became_peered":"2024-05-08T18:31:02.288232+0000","last_unstale":"2024-05-08T18:34:28.676566+0000","last_undegraded":"2024-05-08T18:34:28.676566+0000","last_fullsized":"2024-05-08T18:34:28.676566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:28.676467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:28.676467+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.676467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:08.488393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'48","reported_seq":107,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.893918+0000","last_change":"2024-05-08T18:34:19.893987+0000","last_active":"2024-05-08T18:34:19.893918+0000","last_peered":"2024-05-08T18:34:19.893918+0000","last_clean":"2024-05-08T18:34:19.893918+0000","last_became_active":"2024-05-08T18:31:04.301298+0000","last_became_peered":"2024-05-08T18:31:04.301298+0000","last_unstale":"2024-05-08T18:34:19.893918+0000","last_undegraded":"2024-05-08T18:34:19.893918+0000","last_fullsized":"2024-05-08T18:34:19.893918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-05-08T18:34:19.893818+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-05-08T18:34:19.893818+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.893818+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:10.115077+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.544426+0000","last_change":"2024-05-08T18:34:18.544453+0000","last_active":"2024-05-08T18:34:18.544426+0000","last_peered":"2024-05-08T18:34:18.544426+0000","last_clean":"2024-05-08T18:34:18.544426+0000","last_became_active":"2024-05-08T18:31:06.310430+0000","last_became_peered":"2024-05-08T18:31:06.310430+0000","last_unstale":"2024-05-08T18:34:18.544426+0000","last_undegraded":"2024-05-08T18:34:18.544426+0000","last_fullsized":"2024-05-08T18:34:18.544426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:18.544327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:18.544327+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.544327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:32.447203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'7","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:40.709835+0000","last_change":"2024-05-08T18:34:40.709867+0000","last_active":"2024-05-08T18:34:40.709835+0000","last_peered":"2024-05-08T18:34:40.709835+0000","last_clean":"2024-05-08T18:34:40.709835+0000","last_became_active":"2024-05-08T18:31:08.306492+0000","last_became_peered":"2024-05-08T18:31:08.306492+0000","last_unstale":"2024-05-08T18:34:40.709835+0000","last_undegraded":"2024-05-08T18:34:40.709835+0000","last_fullsized":"2024-05-08T18:34:40.709835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T18:34:40.709748+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T18:34:40.709748+0000","last_clean_scrub_stamp":"2024-05-08T18:34:40.709748+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:06.651897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:33.577009+0000","last_change":"2024-05-08T18:34:33.577031+0000","last_active":"2024-05-08T18:34:33.577009+0000","last_peered":"2024-05-08T18:34:33.577009+0000","last_clean":"2024-05-08T18:34:33.577009+0000","last_became_active":"2024-05-08T18:31:00.299186+0000","last_became_peered":"2024-05-08T18:31:00.299186+0000","last_unstale":"2024-05-08T18:34:33.577009+0000","last_undegraded":"2024-05-08T18:34:33.577009+0000","last_fullsized":"2024-05-08T18:34:33.577009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:33.576927+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:33.576927+0000","last_clean_scrub_stamp":"2024-05-08T18:34:33.576927+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:41.675591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":139,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:17.361164+0000","last_change":"2024-05-08T18:30:49.982170+0000","last_active":"2024-05-08T18:34:17.361164+0000","last_peered":"2024-05-08T18:34:17.361164+0000","last_clean":"2024-05-08T18:34:17.361164+0000","last_became_active":"2024-05-08T18:30:49.981852+0000","last_became_peered":"2024-05-08T18:30:49.981852+0000","last_unstale":"2024-05-08T18:34:17.361164+0000","last_undegraded":"2024-05-08T18:34:17.361164+0000","last_fullsized":"2024-05-08T18:34:17.361164+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:58.176462+0000","last_change":"2024-05-08T18:30:49.983387+0000","last_active":"2024-05-08T18:32:58.176462+0000","last_peered":"2024-05-08T18:32:58.176462+0000","last_clean":"2024-05-08T18:32:58.176462+0000","last_became_active":"2024-05-08T18:30:49.983023+0000","last_became_peered":"2024-05-08T18:30:49.983023+0000","last_unstale":"2024-05-08T18:32:58.176462+0000","last_undegraded":"2024-05-08T18:32:58.176462+0000","last_fullsized":"2024-05-08T18:32:58.176462+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.177048+0000","last_change":"2024-05-08T18:30:58.317086+0000","last_active":"2024-05-08T18:33:03.177048+0000","last_peered":"2024-05-08T18:33:03.177048+0000","last_clean":"2024-05-08T18:33:03.177048+0000","last_became_active":"2024-05-08T18:30:58.316676+0000","last_became_peered":"2024-05-08T18:30:58.316676+0000","last_unstale":"2024-05-08T18:33:03.177048+0000","last_undegraded":"2024-05-08T18:33:03.177048+0000","last_fullsized":"2024-05-08T18:33:03.177048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177304+0000","last_change":"2024-05-08T18:31:45.339419+0000","last_active":"2024-05-08T18:33:08.177304+0000","last_peered":"2024-05-08T18:33:08.177304+0000","last_clean":"2024-05-08T18:33:08.177304+0000","last_became_active":"2024-05-08T18:31:45.339007+0000","last_became_peered":"2024-05-08T18:31:45.339007+0000","last_unstale":"2024-05-08T18:33:08.177304+0000","last_undegraded":"2024-05-08T18:33:08.177304+0000","last_fullsized":"2024-05-08T18:33:08.177304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'87","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:38.512085+0000","last_change":"2024-05-08T18:34:38.512120+0000","last_active":"2024-05-08T18:34:38.512085+0000","last_peered":"2024-05-08T18:34:38.512085+0000","last_clean":"2024-05-08T18:34:38.512085+0000","last_became_active":"2024-05-08T18:31:04.299145+0000","last_became_peered":"2024-05-08T18:31:04.299145+0000","last_unstale":"2024-05-08T18:34:38.512085+0000","last_undegraded":"2024-05-08T18:34:38.512085+0000","last_fullsized":"2024-05-08T18:34:38.512085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-08T18:34:38.511998+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-08T18:34:38.511998+0000","last_clean_scrub_stamp":"2024-05-08T18:34:38.511998+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:35:51.196766+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:33.515814+0000","last_change":"2024-05-08T18:34:33.515836+0000","last_active":"2024-05-08T18:34:33.515814+0000","last_peered":"2024-05-08T18:34:33.515814+0000","last_clean":"2024-05-08T18:34:33.515814+0000","last_became_active":"2024-05-08T18:31:06.311742+0000","last_became_peered":"2024-05-08T18:31:06.311742+0000","last_unstale":"2024-05-08T18:34:33.515814+0000","last_undegraded":"2024-05-08T18:34:33.515814+0000","last_fullsized":"2024-05-08T18:34:33.515814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:33.515721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:33.515721+0000","last_clean_scrub_stamp":"2024-05-08T18:34:33.515721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:27.574406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'87","reported_seq":179,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:36.847453+0000","last_change":"2024-05-08T18:34:36.847497+0000","last_active":"2024-05-08T18:34:36.847453+0000","last_peered":"2024-05-08T18:34:36.847453+0000","last_clean":"2024-05-08T18:34:36.847453+0000","last_became_active":"2024-05-08T18:31:08.310715+0000","last_became_peered":"2024-05-08T18:31:08.310715+0000","last_unstale":"2024-05-08T18:34:36.847453+0000","last_undegraded":"2024-05-08T18:34:36.847453+0000","last_fullsized":"2024-05-08T18:34:36.847453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-08T18:34:36.847334+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-08T18:34:36.847334+0000","last_clean_scrub_stamp":"2024-05-08T18:34:36.847334+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:13.088821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":173,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'12","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.063034+0000","last_change":"2024-05-08T18:31:00.295877+0000","last_active":"2024-05-08T18:34:07.063034+0000","last_peered":"2024-05-08T18:34:07.063034+0000","last_clean":"2024-05-08T18:34:07.063034+0000","last_became_active":"2024-05-08T18:31:00.295578+0000","last_became_peered":"2024-05-08T18:31:00.295578+0000","last_unstale":"2024-05-08T18:34:07.063034+0000","last_undegraded":"2024-05-08T18:34:07.063034+0000","last_fullsized":"2024-05-08T18:34:07.063034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.284173+0000","last_change":"2024-05-08T18:30:49.983190+0000","last_active":"2024-05-08T18:34:18.284173+0000","last_peered":"2024-05-08T18:34:18.284173+0000","last_clean":"2024-05-08T18:34:18.284173+0000","last_became_active":"2024-05-08T18:30:49.982854+0000","last_became_peered":"2024-05-08T18:30:49.982854+0000","last_unstale":"2024-05-08T18:34:18.284173+0000","last_undegraded":"2024-05-08T18:34:18.284173+0000","last_fullsized":"2024-05-08T18:34:18.284173+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:50.687542+0000","last_change":"2024-05-08T18:34:50.687618+0000","last_active":"2024-05-08T18:34:50.687542+0000","last_peered":"2024-05-08T18:34:50.687542+0000","last_clean":"2024-05-08T18:34:50.687542+0000","last_became_active":"2024-05-08T18:30:58.294153+0000","last_became_peered":"2024-05-08T18:30:58.294153+0000","last_unstale":"2024-05-08T18:34:50.687542+0000","last_undegraded":"2024-05-08T18:34:50.687542+0000","last_fullsized":"2024-05-08T18:34:50.687542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:50.687422+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:50.687422+0000","last_clean_scrub_stamp":"2024-05-08T18:34:50.687422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:13.071573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.642307+0000","last_change":"2024-05-08T18:34:19.642347+0000","last_active":"2024-05-08T18:34:19.642307+0000","last_peered":"2024-05-08T18:34:19.642307+0000","last_clean":"2024-05-08T18:34:19.642307+0000","last_became_active":"2024-05-08T18:31:02.291979+0000","last_became_peered":"2024-05-08T18:31:02.291979+0000","last_unstale":"2024-05-08T18:34:19.642307+0000","last_undegraded":"2024-05-08T18:34:19.642307+0000","last_fullsized":"2024-05-08T18:34:19.642307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:19.642214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:19.642214+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.642214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:44.702640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'291","reported_seq":516,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.858095+0000","last_change":"2024-05-08T18:34:25.858141+0000","last_active":"2024-05-08T18:34:25.858095+0000","last_peered":"2024-05-08T18:34:25.858095+0000","last_clean":"2024-05-08T18:34:25.858095+0000","last_became_active":"2024-05-08T18:31:04.299494+0000","last_became_peered":"2024-05-08T18:31:04.299494+0000","last_unstale":"2024-05-08T18:34:25.858095+0000","last_undegraded":"2024-05-08T18:34:25.858095+0000","last_fullsized":"2024-05-08T18:34:25.858095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'291","last_scrub_stamp":"2024-05-08T18:34:25.858006+0000","last_deep_scrub":"29'291","last_deep_scrub_stamp":"2024-05-08T18:34:25.858006+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.858006+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:00.713371+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:41.505255+0000","last_change":"2024-05-08T18:34:41.505277+0000","last_active":"2024-05-08T18:34:41.505255+0000","last_peered":"2024-05-08T18:34:41.505255+0000","last_clean":"2024-05-08T18:34:41.505255+0000","last_became_active":"2024-05-08T18:31:06.306554+0000","last_became_peered":"2024-05-08T18:31:06.306554+0000","last_unstale":"2024-05-08T18:34:41.505255+0000","last_undegraded":"2024-05-08T18:34:41.505255+0000","last_fullsized":"2024-05-08T18:34:41.505255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:41.505127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:41.505127+0000","last_clean_scrub_stamp":"2024-05-08T18:34:41.505127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:29.470827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178987+0000","last_change":"2024-05-08T18:31:08.316829+0000","last_active":"2024-05-08T18:33:18.178987+0000","last_peered":"2024-05-08T18:33:18.178987+0000","last_clean":"2024-05-08T18:33:18.178987+0000","last_became_active":"2024-05-08T18:31:08.316536+0000","last_became_peered":"2024-05-08T18:31:08.316536+0000","last_unstale":"2024-05-08T18:33:18.178987+0000","last_undegraded":"2024-05-08T18:33:18.178987+0000","last_fullsized":"2024-05-08T18:33:18.178987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'12","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:49.663169+0000","last_change":"2024-05-08T18:34:49.663199+0000","last_active":"2024-05-08T18:34:49.663169+0000","last_peered":"2024-05-08T18:34:49.663169+0000","last_clean":"2024-05-08T18:34:49.663169+0000","last_became_active":"2024-05-08T18:31:00.281359+0000","last_became_peered":"2024-05-08T18:31:00.281359+0000","last_unstale":"2024-05-08T18:34:49.663169+0000","last_undegraded":"2024-05-08T18:34:49.663169+0000","last_fullsized":"2024-05-08T18:34:49.663169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:49.663075+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:49.663075+0000","last_clean_scrub_stamp":"2024-05-08T18:34:49.663075+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:42.088380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:53.175040+0000","last_change":"2024-05-08T18:30:49.982800+0000","last_active":"2024-05-08T18:32:53.175040+0000","last_peered":"2024-05-08T18:32:53.175040+0000","last_clean":"2024-05-08T18:32:53.175040+0000","last_became_active":"2024-05-08T18:30:49.982438+0000","last_became_peered":"2024-05-08T18:30:49.982438+0000","last_unstale":"2024-05-08T18:32:53.175040+0000","last_undegraded":"2024-05-08T18:32:53.175040+0000","last_fullsized":"2024-05-08T18:32:53.175040+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:58.175152+0000","last_change":"2024-05-08T18:30:58.294820+0000","last_active":"2024-05-08T18:32:58.175152+0000","last_peered":"2024-05-08T18:32:58.175152+0000","last_clean":"2024-05-08T18:32:58.175152+0000","last_became_active":"2024-05-08T18:30:58.294292+0000","last_became_peered":"2024-05-08T18:30:58.294292+0000","last_unstale":"2024-05-08T18:32:58.175152+0000","last_undegraded":"2024-05-08T18:32:58.175152+0000","last_fullsized":"2024-05-08T18:32:58.175152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:39.826438+0000","last_change":"2024-05-08T18:34:39.826486+0000","last_active":"2024-05-08T18:34:39.826438+0000","last_peered":"2024-05-08T18:34:39.826438+0000","last_clean":"2024-05-08T18:34:39.826438+0000","last_became_active":"2024-05-08T18:31:02.291806+0000","last_became_peered":"2024-05-08T18:31:02.291806+0000","last_unstale":"2024-05-08T18:34:39.826438+0000","last_undegraded":"2024-05-08T18:34:39.826438+0000","last_fullsized":"2024-05-08T18:34:39.826438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:39.826333+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:39.826333+0000","last_clean_scrub_stamp":"2024-05-08T18:34:39.826333+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:07.772048+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.698631+0000","last_change":"2024-05-08T18:34:26.698673+0000","last_active":"2024-05-08T18:34:26.698631+0000","last_peered":"2024-05-08T18:34:26.698631+0000","last_clean":"2024-05-08T18:34:26.698631+0000","last_became_active":"2024-05-08T18:31:04.303321+0000","last_became_peered":"2024-05-08T18:31:04.303321+0000","last_unstale":"2024-05-08T18:34:26.698631+0000","last_undegraded":"2024-05-08T18:34:26.698631+0000","last_fullsized":"2024-05-08T18:34:26.698631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-05-08T18:34:26.698537+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-05-08T18:34:26.698537+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.698537+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:44.151622+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.566377+0000","last_change":"2024-05-08T18:34:25.566404+0000","last_active":"2024-05-08T18:34:25.566377+0000","last_peered":"2024-05-08T18:34:25.566377+0000","last_clean":"2024-05-08T18:34:25.566377+0000","last_became_active":"2024-05-08T18:31:06.309525+0000","last_became_peered":"2024-05-08T18:31:06.309525+0000","last_unstale":"2024-05-08T18:34:25.566377+0000","last_undegraded":"2024-05-08T18:34:25.566377+0000","last_fullsized":"2024-05-08T18:34:25.566377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:25.566280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:25.566280+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.566280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:00.421645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'8","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.180348+0000","last_change":"2024-05-08T18:31:08.314823+0000","last_active":"2024-05-08T18:33:23.180348+0000","last_peered":"2024-05-08T18:33:23.180348+0000","last_clean":"2024-05-08T18:33:23.180348+0000","last_became_active":"2024-05-08T18:31:08.314503+0000","last_became_peered":"2024-05-08T18:31:08.314503+0000","last_unstale":"2024-05-08T18:33:23.180348+0000","last_undegraded":"2024-05-08T18:33:23.180348+0000","last_fullsized":"2024-05-08T18:33:23.180348+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.176845+0000","last_change":"2024-05-08T18:31:00.283770+0000","last_active":"2024-05-08T18:33:08.176845+0000","last_peered":"2024-05-08T18:33:08.176845+0000","last_clean":"2024-05-08T18:33:08.176845+0000","last_became_active":"2024-05-08T18:31:00.283410+0000","last_became_peered":"2024-05-08T18:31:00.283410+0000","last_unstale":"2024-05-08T18:33:08.176845+0000","last_undegraded":"2024-05-08T18:33:08.176845+0000","last_fullsized":"2024-05-08T18:33:08.176845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:53.175731+0000","last_change":"2024-05-08T18:30:49.983911+0000","last_active":"2024-05-08T18:32:53.175731+0000","last_peered":"2024-05-08T18:32:53.175731+0000","last_clean":"2024-05-08T18:32:53.175731+0000","last_became_active":"2024-05-08T18:30:49.983515+0000","last_became_peered":"2024-05-08T18:30:49.983515+0000","last_unstale":"2024-05-08T18:32:53.175731+0000","last_undegraded":"2024-05-08T18:32:53.175731+0000","last_fullsized":"2024-05-08T18:32:53.175731+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:51.854758+0000","last_change":"2024-05-08T18:34:51.854795+0000","last_active":"2024-05-08T18:34:51.854758+0000","last_peered":"2024-05-08T18:34:51.854758+0000","last_clean":"2024-05-08T18:34:51.854758+0000","last_became_active":"2024-05-08T18:30:58.306268+0000","last_became_peered":"2024-05-08T18:30:58.306268+0000","last_unstale":"2024-05-08T18:34:51.854758+0000","last_undegraded":"2024-05-08T18:34:51.854758+0000","last_fullsized":"2024-05-08T18:34:51.854758+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:51.854640+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:51.854640+0000","last_clean_scrub_stamp":"2024-05-08T18:34:51.854640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:08.246146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:36.627371+0000","last_change":"2024-05-08T18:34:36.627397+0000","last_active":"2024-05-08T18:34:36.627371+0000","last_peered":"2024-05-08T18:34:36.627371+0000","last_clean":"2024-05-08T18:34:36.627371+0000","last_became_active":"2024-05-08T18:31:02.292030+0000","last_became_peered":"2024-05-08T18:31:02.292030+0000","last_unstale":"2024-05-08T18:34:36.627371+0000","last_undegraded":"2024-05-08T18:34:36.627371+0000","last_fullsized":"2024-05-08T18:34:36.627371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:36.627276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:36.627276+0000","last_clean_scrub_stamp":"2024-05-08T18:34:36.627276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:58.136593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.698435+0000","last_change":"2024-05-08T18:34:24.698478+0000","last_active":"2024-05-08T18:34:24.698435+0000","last_peered":"2024-05-08T18:34:24.698435+0000","last_clean":"2024-05-08T18:34:24.698435+0000","last_became_active":"2024-05-08T18:31:04.296257+0000","last_became_peered":"2024-05-08T18:31:04.296257+0000","last_unstale":"2024-05-08T18:34:24.698435+0000","last_undegraded":"2024-05-08T18:34:24.698435+0000","last_fullsized":"2024-05-08T18:34:24.698435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-08T18:34:24.698350+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-08T18:34:24.698350+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.698350+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:44.670942+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:46.392962+0000","last_change":"2024-05-08T18:34:46.393005+0000","last_active":"2024-05-08T18:34:46.392962+0000","last_peered":"2024-05-08T18:34:46.392962+0000","last_clean":"2024-05-08T18:34:46.392962+0000","last_became_active":"2024-05-08T18:31:06.308892+0000","last_became_peered":"2024-05-08T18:31:06.308892+0000","last_unstale":"2024-05-08T18:34:46.392962+0000","last_undegraded":"2024-05-08T18:34:46.392962+0000","last_fullsized":"2024-05-08T18:34:46.392962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:46.392855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:46.392855+0000","last_clean_scrub_stamp":"2024-05-08T18:34:46.392855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:12.321949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178889+0000","last_change":"2024-05-08T18:31:08.319035+0000","last_active":"2024-05-08T18:33:18.178889+0000","last_peered":"2024-05-08T18:33:18.178889+0000","last_clean":"2024-05-08T18:33:18.178889+0000","last_became_active":"2024-05-08T18:31:08.318728+0000","last_became_peered":"2024-05-08T18:31:08.318728+0000","last_unstale":"2024-05-08T18:33:18.178889+0000","last_undegraded":"2024-05-08T18:33:18.178889+0000","last_fullsized":"2024-05-08T18:33:18.178889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'3","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.328661+0000","last_change":"2024-05-08T18:31:45.344716+0000","last_active":"2024-05-08T18:34:07.328661+0000","last_peered":"2024-05-08T18:34:07.328661+0000","last_clean":"2024-05-08T18:34:07.328661+0000","last_became_active":"2024-05-08T18:31:45.337785+0000","last_became_peered":"2024-05-08T18:31:45.337785+0000","last_unstale":"2024-05-08T18:34:07.328661+0000","last_undegraded":"2024-05-08T18:34:07.328661+0000","last_fullsized":"2024-05-08T18:34:07.328661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.421643+0000","last_change":"2024-05-08T18:30:58.302684+0000","last_active":"2024-05-08T18:33:06.421643+0000","last_peered":"2024-05-08T18:33:06.421643+0000","last_clean":"2024-05-08T18:33:06.421643+0000","last_became_active":"2024-05-08T18:30:58.302328+0000","last_became_peered":"2024-05-08T18:30:58.302328+0000","last_unstale":"2024-05-08T18:33:06.421643+0000","last_undegraded":"2024-05-08T18:33:06.421643+0000","last_fullsized":"2024-05-08T18:33:06.421643+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:58.175230+0000","last_change":"2024-05-08T18:30:49.983824+0000","last_active":"2024-05-08T18:32:58.175230+0000","last_peered":"2024-05-08T18:32:58.175230+0000","last_clean":"2024-05-08T18:32:58.175230+0000","last_became_active":"2024-05-08T18:30:49.983522+0000","last_became_peered":"2024-05-08T18:30:49.983522+0000","last_unstale":"2024-05-08T18:32:58.175230+0000","last_undegraded":"2024-05-08T18:32:58.175230+0000","last_fullsized":"2024-05-08T18:32:58.175230+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:34.565099+0000","last_change":"2024-05-08T18:34:34.565146+0000","last_active":"2024-05-08T18:34:34.565099+0000","last_peered":"2024-05-08T18:34:34.565099+0000","last_clean":"2024-05-08T18:34:34.565099+0000","last_became_active":"2024-05-08T18:31:02.294603+0000","last_became_peered":"2024-05-08T18:31:02.294603+0000","last_unstale":"2024-05-08T18:34:34.565099+0000","last_undegraded":"2024-05-08T18:34:34.565099+0000","last_fullsized":"2024-05-08T18:34:34.565099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-05-08T18:34:34.564981+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-05-08T18:34:34.564981+0000","last_clean_scrub_stamp":"2024-05-08T18:34:34.564981+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:44:24.904584+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'75","reported_seq":151,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.528054+0000","last_change":"2024-05-08T18:34:32.528098+0000","last_active":"2024-05-08T18:34:32.528054+0000","last_peered":"2024-05-08T18:34:32.528054+0000","last_clean":"2024-05-08T18:34:32.528054+0000","last_became_active":"2024-05-08T18:31:04.295090+0000","last_became_peered":"2024-05-08T18:31:04.295090+0000","last_unstale":"2024-05-08T18:34:32.528054+0000","last_undegraded":"2024-05-08T18:34:32.528054+0000","last_fullsized":"2024-05-08T18:34:32.528054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'75","last_scrub_stamp":"2024-05-08T18:34:32.527967+0000","last_deep_scrub":"29'75","last_deep_scrub_stamp":"2024-05-08T18:34:32.527967+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.527967+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:27.504565+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.653376+0000","last_change":"2024-05-08T18:34:24.653420+0000","last_active":"2024-05-08T18:34:24.653376+0000","last_peered":"2024-05-08T18:34:24.653376+0000","last_clean":"2024-05-08T18:34:24.653376+0000","last_became_active":"2024-05-08T18:31:06.312179+0000","last_became_peered":"2024-05-08T18:31:06.312179+0000","last_unstale":"2024-05-08T18:34:24.653376+0000","last_undegraded":"2024-05-08T18:34:24.653376+0000","last_fullsized":"2024-05-08T18:34:24.653376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:24.653263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:24.653263+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.653263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:54:11.402636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:41.580819+0000","last_change":"2024-05-08T18:34:41.580867+0000","last_active":"2024-05-08T18:34:41.580819+0000","last_peered":"2024-05-08T18:34:41.580819+0000","last_clean":"2024-05-08T18:34:41.580819+0000","last_became_active":"2024-05-08T18:31:08.304818+0000","last_became_peered":"2024-05-08T18:31:08.304818+0000","last_unstale":"2024-05-08T18:34:41.580819+0000","last_undegraded":"2024-05-08T18:34:41.580819+0000","last_fullsized":"2024-05-08T18:34:41.580819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-08T18:34:41.580713+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-08T18:34:41.580713+0000","last_clean_scrub_stamp":"2024-05-08T18:34:41.580713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.972218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:37.695927+0000","last_change":"2024-05-08T18:34:37.695951+0000","last_active":"2024-05-08T18:34:37.695927+0000","last_peered":"2024-05-08T18:34:37.695927+0000","last_clean":"2024-05-08T18:34:37.695927+0000","last_became_active":"2024-05-08T18:31:00.294157+0000","last_became_peered":"2024-05-08T18:31:00.294157+0000","last_unstale":"2024-05-08T18:34:37.695927+0000","last_undegraded":"2024-05-08T18:34:37.695927+0000","last_fullsized":"2024-05-08T18:34:37.695927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:37.695840+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:37.695840+0000","last_clean_scrub_stamp":"2024-05-08T18:34:37.695840+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:25.082640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.926793+0000","last_change":"2024-05-08T18:30:58.288464+0000","last_active":"2024-05-08T18:34:13.926793+0000","last_peered":"2024-05-08T18:34:13.926793+0000","last_clean":"2024-05-08T18:34:13.926793+0000","last_became_active":"2024-05-08T18:30:58.286578+0000","last_became_peered":"2024-05-08T18:30:58.286578+0000","last_unstale":"2024-05-08T18:34:13.926793+0000","last_undegraded":"2024-05-08T18:34:13.926793+0000","last_fullsized":"2024-05-08T18:34:13.926793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:58.176505+0000","last_change":"2024-05-08T18:30:49.982777+0000","last_active":"2024-05-08T18:32:58.176505+0000","last_peered":"2024-05-08T18:32:58.176505+0000","last_clean":"2024-05-08T18:32:58.176505+0000","last_became_active":"2024-05-08T18:30:49.982471+0000","last_became_peered":"2024-05-08T18:30:49.982471+0000","last_unstale":"2024-05-08T18:32:58.176505+0000","last_undegraded":"2024-05-08T18:32:58.176505+0000","last_fullsized":"2024-05-08T18:32:58.176505+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.702712+0000","last_change":"2024-05-08T18:34:27.702739+0000","last_active":"2024-05-08T18:34:27.702712+0000","last_peered":"2024-05-08T18:34:27.702712+0000","last_clean":"2024-05-08T18:34:27.702712+0000","last_became_active":"2024-05-08T18:31:02.287974+0000","last_became_peered":"2024-05-08T18:31:02.287974+0000","last_unstale":"2024-05-08T18:34:27.702712+0000","last_undegraded":"2024-05-08T18:34:27.702712+0000","last_fullsized":"2024-05-08T18:34:27.702712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:27.702607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:27.702607+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.702607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:19.640531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'22","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.906735+0000","last_change":"2024-05-08T18:34:21.906780+0000","last_active":"2024-05-08T18:34:21.906735+0000","last_peered":"2024-05-08T18:34:21.906735+0000","last_clean":"2024-05-08T18:34:21.906735+0000","last_became_active":"2024-05-08T18:31:04.301116+0000","last_became_peered":"2024-05-08T18:31:04.301116+0000","last_unstale":"2024-05-08T18:34:21.906735+0000","last_undegraded":"2024-05-08T18:34:21.906735+0000","last_fullsized":"2024-05-08T18:34:21.906735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-08T18:34:21.906639+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-08T18:34:21.906639+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.906639+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:13.184187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":386,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.877959+0000","last_change":"2024-05-08T18:34:20.878020+0000","last_active":"2024-05-08T18:34:20.877959+0000","last_peered":"2024-05-08T18:34:20.877959+0000","last_clean":"2024-05-08T18:34:20.877959+0000","last_became_active":"2024-05-08T18:31:06.308274+0000","last_became_peered":"2024-05-08T18:31:06.308274+0000","last_unstale":"2024-05-08T18:34:20.877959+0000","last_undegraded":"2024-05-08T18:34:20.877959+0000","last_fullsized":"2024-05-08T18:34:20.877959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:20.877846+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:20.877846+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.877846+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:15.946216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.180498+0000","last_change":"2024-05-08T18:31:08.318932+0000","last_active":"2024-05-08T18:33:23.180498+0000","last_peered":"2024-05-08T18:33:23.180498+0000","last_clean":"2024-05-08T18:33:23.180498+0000","last_became_active":"2024-05-08T18:31:08.318609+0000","last_became_peered":"2024-05-08T18:31:08.318609+0000","last_unstale":"2024-05-08T18:33:23.180498+0000","last_undegraded":"2024-05-08T18:33:23.180498+0000","last_fullsized":"2024-05-08T18:33:23.180498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.177000+0000","last_change":"2024-05-08T18:31:00.291567+0000","last_active":"2024-05-08T18:33:03.177000+0000","last_peered":"2024-05-08T18:33:03.177000+0000","last_clean":"2024-05-08T18:33:03.177000+0000","last_became_active":"2024-05-08T18:31:00.291093+0000","last_became_peered":"2024-05-08T18:31:00.291093+0000","last_unstale":"2024-05-08T18:33:03.177000+0000","last_undegraded":"2024-05-08T18:33:03.177000+0000","last_fullsized":"2024-05-08T18:33:03.177000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177925+0000","last_change":"2024-05-08T18:30:58.306520+0000","last_active":"2024-05-08T18:33:08.177925+0000","last_peered":"2024-05-08T18:33:08.177925+0000","last_clean":"2024-05-08T18:33:08.177925+0000","last_became_active":"2024-05-08T18:30:58.305915+0000","last_became_peered":"2024-05-08T18:30:58.305915+0000","last_unstale":"2024-05-08T18:33:08.177925+0000","last_undegraded":"2024-05-08T18:33:08.177925+0000","last_fullsized":"2024-05-08T18:33:08.177925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:58.175268+0000","last_change":"2024-05-08T18:30:49.982641+0000","last_active":"2024-05-08T18:32:58.175268+0000","last_peered":"2024-05-08T18:32:58.175268+0000","last_clean":"2024-05-08T18:32:58.175268+0000","last_became_active":"2024-05-08T18:30:49.982330+0000","last_became_peered":"2024-05-08T18:30:49.982330+0000","last_unstale":"2024-05-08T18:32:58.175268+0000","last_undegraded":"2024-05-08T18:32:58.175268+0000","last_fullsized":"2024-05-08T18:32:58.175268+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.649059+0000","last_change":"2024-05-08T18:34:18.649104+0000","last_active":"2024-05-08T18:34:18.649059+0000","last_peered":"2024-05-08T18:34:18.649059+0000","last_clean":"2024-05-08T18:34:18.649059+0000","last_became_active":"2024-05-08T18:31:02.292328+0000","last_became_peered":"2024-05-08T18:31:02.292328+0000","last_unstale":"2024-05-08T18:34:18.649059+0000","last_undegraded":"2024-05-08T18:34:18.649059+0000","last_fullsized":"2024-05-08T18:34:18.649059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:18.648949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:18.648949+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.648949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:06.035748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:47.396282+0000","last_change":"2024-05-08T18:34:47.396324+0000","last_active":"2024-05-08T18:34:47.396282+0000","last_peered":"2024-05-08T18:34:47.396282+0000","last_clean":"2024-05-08T18:34:47.396282+0000","last_became_active":"2024-05-08T18:31:04.302020+0000","last_became_peered":"2024-05-08T18:31:04.302020+0000","last_unstale":"2024-05-08T18:34:47.396282+0000","last_undegraded":"2024-05-08T18:34:47.396282+0000","last_fullsized":"2024-05-08T18:34:47.396282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T18:34:47.396183+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T18:34:47.396183+0000","last_clean_scrub_stamp":"2024-05-08T18:34:47.396183+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:55.696682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.664173+0000","last_change":"2024-05-08T18:34:23.664202+0000","last_active":"2024-05-08T18:34:23.664173+0000","last_peered":"2024-05-08T18:34:23.664173+0000","last_clean":"2024-05-08T18:34:23.664173+0000","last_became_active":"2024-05-08T18:31:06.305020+0000","last_became_peered":"2024-05-08T18:31:06.305020+0000","last_unstale":"2024-05-08T18:34:23.664173+0000","last_undegraded":"2024-05-08T18:34:23.664173+0000","last_fullsized":"2024-05-08T18:34:23.664173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:23.664078+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:23.664078+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.664078+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:16.647836+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:44.668213+0000","last_change":"2024-05-08T18:34:44.668260+0000","last_active":"2024-05-08T18:34:44.668213+0000","last_peered":"2024-05-08T18:34:44.668213+0000","last_clean":"2024-05-08T18:34:44.668213+0000","last_became_active":"2024-05-08T18:31:08.309869+0000","last_became_peered":"2024-05-08T18:31:08.309869+0000","last_unstale":"2024-05-08T18:34:44.668213+0000","last_undegraded":"2024-05-08T18:34:44.668213+0000","last_fullsized":"2024-05-08T18:34:44.668213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:34:44.668104+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:34:44.668104+0000","last_clean_scrub_stamp":"2024-05-08T18:34:44.668104+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:43.032453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:41.850932+0000","last_change":"2024-05-08T18:34:41.850994+0000","last_active":"2024-05-08T18:34:41.850932+0000","last_peered":"2024-05-08T18:34:41.850932+0000","last_clean":"2024-05-08T18:34:41.850932+0000","last_became_active":"2024-05-08T18:31:00.296431+0000","last_became_peered":"2024-05-08T18:31:00.296431+0000","last_unstale":"2024-05-08T18:34:41.850932+0000","last_undegraded":"2024-05-08T18:34:41.850932+0000","last_fullsized":"2024-05-08T18:34:41.850932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:41.850804+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:41.850804+0000","last_clean_scrub_stamp":"2024-05-08T18:34:41.850804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:26:55.361491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177344+0000","last_change":"2024-05-08T18:30:58.304887+0000","last_active":"2024-05-08T18:33:08.177344+0000","last_peered":"2024-05-08T18:33:08.177344+0000","last_clean":"2024-05-08T18:33:08.177344+0000","last_became_active":"2024-05-08T18:30:58.303997+0000","last_became_peered":"2024-05-08T18:30:58.303997+0000","last_unstale":"2024-05-08T18:33:08.177344+0000","last_undegraded":"2024-05-08T18:33:08.177344+0000","last_fullsized":"2024-05-08T18:33:08.177344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:58.176553+0000","last_change":"2024-05-08T18:30:49.984897+0000","last_active":"2024-05-08T18:32:58.176553+0000","last_peered":"2024-05-08T18:32:58.176553+0000","last_clean":"2024-05-08T18:32:58.176553+0000","last_became_active":"2024-05-08T18:30:49.984280+0000","last_became_peered":"2024-05-08T18:30:49.984280+0000","last_unstale":"2024-05-08T18:32:58.176553+0000","last_undegraded":"2024-05-08T18:32:58.176553+0000","last_fullsized":"2024-05-08T18:32:58.176553+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.647885+0000","last_change":"2024-05-08T18:34:21.647908+0000","last_active":"2024-05-08T18:34:21.647885+0000","last_peered":"2024-05-08T18:34:21.647885+0000","last_clean":"2024-05-08T18:34:21.647885+0000","last_became_active":"2024-05-08T18:31:02.290540+0000","last_became_peered":"2024-05-08T18:31:02.290540+0000","last_unstale":"2024-05-08T18:34:21.647885+0000","last_undegraded":"2024-05-08T18:34:21.647885+0000","last_fullsized":"2024-05-08T18:34:21.647885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:21.647799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:21.647799+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.647799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:43:40.019529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.670588+0000","last_change":"2024-05-08T18:34:23.670650+0000","last_active":"2024-05-08T18:34:23.670588+0000","last_peered":"2024-05-08T18:34:23.670588+0000","last_clean":"2024-05-08T18:34:23.670588+0000","last_became_active":"2024-05-08T18:31:04.304669+0000","last_became_peered":"2024-05-08T18:31:04.304669+0000","last_unstale":"2024-05-08T18:34:23.670588+0000","last_undegraded":"2024-05-08T18:34:23.670588+0000","last_fullsized":"2024-05-08T18:34:23.670588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-05-08T18:34:23.670475+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-05-08T18:34:23.670475+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.670475+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.365929+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:17.640092+0000","last_change":"2024-05-08T18:34:17.640131+0000","last_active":"2024-05-08T18:34:17.640092+0000","last_peered":"2024-05-08T18:34:17.640092+0000","last_clean":"2024-05-08T18:34:17.640092+0000","last_became_active":"2024-05-08T18:31:06.308621+0000","last_became_peered":"2024-05-08T18:31:06.308621+0000","last_unstale":"2024-05-08T18:34:17.640092+0000","last_undegraded":"2024-05-08T18:34:17.640092+0000","last_fullsized":"2024-05-08T18:34:17.640092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:17.639997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:17.639997+0000","last_clean_scrub_stamp":"2024-05-08T18:34:17.639997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:50.847042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.736117+0000","last_change":"2024-05-08T18:34:32.736144+0000","last_active":"2024-05-08T18:34:32.736117+0000","last_peered":"2024-05-08T18:34:32.736117+0000","last_clean":"2024-05-08T18:34:32.736117+0000","last_became_active":"2024-05-08T18:31:08.308427+0000","last_became_peered":"2024-05-08T18:31:08.308427+0000","last_unstale":"2024-05-08T18:34:32.736117+0000","last_undegraded":"2024-05-08T18:34:32.736117+0000","last_fullsized":"2024-05-08T18:34:32.736117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:32.736032+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:32.736032+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.736032+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:14.795378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178071+0000","last_change":"2024-05-08T18:31:08.315548+0000","last_active":"2024-05-08T18:33:13.178071+0000","last_peered":"2024-05-08T18:33:13.178071+0000","last_clean":"2024-05-08T18:33:13.178071+0000","last_became_active":"2024-05-08T18:31:08.315257+0000","last_became_peered":"2024-05-08T18:31:08.315257+0000","last_unstale":"2024-05-08T18:33:13.178071+0000","last_undegraded":"2024-05-08T18:33:13.178071+0000","last_fullsized":"2024-05-08T18:33:13.178071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'11","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.331246+0000","last_change":"2024-05-08T18:31:00.295123+0000","last_active":"2024-05-08T18:34:07.331246+0000","last_peered":"2024-05-08T18:34:07.331246+0000","last_clean":"2024-05-08T18:34:07.331246+0000","last_became_active":"2024-05-08T18:31:00.294827+0000","last_became_peered":"2024-05-08T18:31:00.294827+0000","last_unstale":"2024-05-08T18:34:07.331246+0000","last_undegraded":"2024-05-08T18:34:07.331246+0000","last_fullsized":"2024-05-08T18:34:07.331246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.176670+0000","last_change":"2024-05-08T18:30:58.313343+0000","last_active":"2024-05-08T18:34:07.176670+0000","last_peered":"2024-05-08T18:34:07.176670+0000","last_clean":"2024-05-08T18:34:07.176670+0000","last_became_active":"2024-05-08T18:30:58.313034+0000","last_became_peered":"2024-05-08T18:30:58.313034+0000","last_unstale":"2024-05-08T18:34:07.176670+0000","last_undegraded":"2024-05-08T18:34:07.176670+0000","last_fullsized":"2024-05-08T18:34:07.176670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.763311+0000","last_change":"2024-05-08T18:34:30.763337+0000","last_active":"2024-05-08T18:34:30.763311+0000","last_peered":"2024-05-08T18:34:30.763311+0000","last_clean":"2024-05-08T18:34:30.763311+0000","last_became_active":"2024-05-08T18:31:02.291119+0000","last_became_peered":"2024-05-08T18:31:02.291119+0000","last_unstale":"2024-05-08T18:34:30.763311+0000","last_undegraded":"2024-05-08T18:34:30.763311+0000","last_fullsized":"2024-05-08T18:34:30.763311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:30.763186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:30.763186+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.763186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:48.428188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'41","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:51.439127+0000","last_change":"2024-05-08T18:34:51.439168+0000","last_active":"2024-05-08T18:34:51.439127+0000","last_peered":"2024-05-08T18:34:51.439127+0000","last_clean":"2024-05-08T18:34:51.439127+0000","last_became_active":"2024-05-08T18:31:04.300990+0000","last_became_peered":"2024-05-08T18:31:04.300990+0000","last_unstale":"2024-05-08T18:34:51.439127+0000","last_undegraded":"2024-05-08T18:34:51.439127+0000","last_fullsized":"2024-05-08T18:34:51.439127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-05-08T18:34:51.439030+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-05-08T18:34:51.439030+0000","last_clean_scrub_stamp":"2024-05-08T18:34:51.439030+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:18.253390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181152+0000","last_change":"2024-05-08T18:31:06.315203+0000","last_active":"2024-05-08T18:33:28.181152+0000","last_peered":"2024-05-08T18:33:28.181152+0000","last_clean":"2024-05-08T18:33:28.181152+0000","last_became_active":"2024-05-08T18:31:06.314696+0000","last_became_peered":"2024-05-08T18:31:06.314696+0000","last_unstale":"2024-05-08T18:33:28.181152+0000","last_undegraded":"2024-05-08T18:33:28.181152+0000","last_fullsized":"2024-05-08T18:33:28.181152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.176870+0000","last_change":"2024-05-08T18:31:08.319177+0000","last_active":"2024-05-08T18:33:08.176870+0000","last_peered":"2024-05-08T18:33:08.176870+0000","last_clean":"2024-05-08T18:33:08.176870+0000","last_became_active":"2024-05-08T18:31:08.318901+0000","last_became_peered":"2024-05-08T18:31:08.318901+0000","last_unstale":"2024-05-08T18:33:08.176870+0000","last_undegraded":"2024-05-08T18:33:08.176870+0000","last_fullsized":"2024-05-08T18:33:08.176870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:39.751848+0000","last_change":"2024-05-08T18:34:39.751907+0000","last_active":"2024-05-08T18:34:39.751848+0000","last_peered":"2024-05-08T18:34:39.751848+0000","last_clean":"2024-05-08T18:34:39.751848+0000","last_became_active":"2024-05-08T18:31:00.292376+0000","last_became_peered":"2024-05-08T18:31:00.292376+0000","last_unstale":"2024-05-08T18:34:39.751848+0000","last_undegraded":"2024-05-08T18:34:39.751848+0000","last_fullsized":"2024-05-08T18:34:39.751848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:39.751747+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:39.751747+0000","last_clean_scrub_stamp":"2024-05-08T18:34:39.751747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:21.882010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179812+0000","last_change":"2024-05-08T18:30:58.301858+0000","last_active":"2024-05-08T18:33:23.179812+0000","last_peered":"2024-05-08T18:33:23.179812+0000","last_clean":"2024-05-08T18:33:23.179812+0000","last_became_active":"2024-05-08T18:30:58.301520+0000","last_became_peered":"2024-05-08T18:30:58.301520+0000","last_unstale":"2024-05-08T18:33:23.179812+0000","last_undegraded":"2024-05-08T18:33:23.179812+0000","last_fullsized":"2024-05-08T18:33:23.179812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.673362+0000","last_change":"2024-05-08T18:34:22.673400+0000","last_active":"2024-05-08T18:34:22.673362+0000","last_peered":"2024-05-08T18:34:22.673362+0000","last_clean":"2024-05-08T18:34:22.673362+0000","last_became_active":"2024-05-08T18:31:02.293459+0000","last_became_peered":"2024-05-08T18:31:02.293459+0000","last_unstale":"2024-05-08T18:34:22.673362+0000","last_undegraded":"2024-05-08T18:34:22.673362+0000","last_fullsized":"2024-05-08T18:34:22.673362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:22.673274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:22.673274+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.673274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:39.064779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.593729+0000","last_change":"2024-05-08T18:34:27.593763+0000","last_active":"2024-05-08T18:34:27.593729+0000","last_peered":"2024-05-08T18:34:27.593729+0000","last_clean":"2024-05-08T18:34:27.593729+0000","last_became_active":"2024-05-08T18:31:04.298237+0000","last_became_peered":"2024-05-08T18:31:04.298237+0000","last_unstale":"2024-05-08T18:34:27.593729+0000","last_undegraded":"2024-05-08T18:34:27.593729+0000","last_fullsized":"2024-05-08T18:34:27.593729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:27.593625+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:27.593625+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.593625+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:11.004092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.656405+0000","last_change":"2024-05-08T18:34:21.656429+0000","last_active":"2024-05-08T18:34:21.656405+0000","last_peered":"2024-05-08T18:34:21.656405+0000","last_clean":"2024-05-08T18:34:21.656405+0000","last_became_active":"2024-05-08T18:31:06.307048+0000","last_became_peered":"2024-05-08T18:31:06.307048+0000","last_unstale":"2024-05-08T18:34:21.656405+0000","last_undegraded":"2024-05-08T18:34:21.656405+0000","last_fullsized":"2024-05-08T18:34:21.656405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:21.656318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:21.656318+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.656318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:04.597248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.181483+0000","last_change":"2024-05-08T18:31:08.314432+0000","last_active":"2024-05-08T18:33:38.181483+0000","last_peered":"2024-05-08T18:33:38.181483+0000","last_clean":"2024-05-08T18:33:38.181483+0000","last_became_active":"2024-05-08T18:31:08.313943+0000","last_became_peered":"2024-05-08T18:31:08.313943+0000","last_unstale":"2024-05-08T18:33:38.181483+0000","last_undegraded":"2024-05-08T18:33:38.181483+0000","last_fullsized":"2024-05-08T18:33:38.181483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.280162+0000","last_change":"2024-05-08T18:31:00.286107+0000","last_active":"2024-05-08T18:34:07.280162+0000","last_peered":"2024-05-08T18:34:07.280162+0000","last_clean":"2024-05-08T18:34:07.280162+0000","last_became_active":"2024-05-08T18:31:00.285842+0000","last_became_peered":"2024-05-08T18:31:00.285842+0000","last_unstale":"2024-05-08T18:34:07.280162+0000","last_undegraded":"2024-05-08T18:34:07.280162+0000","last_fullsized":"2024-05-08T18:34:07.280162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179862+0000","last_change":"2024-05-08T18:30:58.303703+0000","last_active":"2024-05-08T18:33:23.179862+0000","last_peered":"2024-05-08T18:33:23.179862+0000","last_clean":"2024-05-08T18:33:23.179862+0000","last_became_active":"2024-05-08T18:30:58.303112+0000","last_became_peered":"2024-05-08T18:30:58.303112+0000","last_unstale":"2024-05-08T18:33:23.179862+0000","last_undegraded":"2024-05-08T18:33:23.179862+0000","last_fullsized":"2024-05-08T18:33:23.179862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:33.767319+0000","last_change":"2024-05-08T18:34:33.767349+0000","last_active":"2024-05-08T18:34:33.767319+0000","last_peered":"2024-05-08T18:34:33.767319+0000","last_clean":"2024-05-08T18:34:33.767319+0000","last_became_active":"2024-05-08T18:31:02.294812+0000","last_became_peered":"2024-05-08T18:31:02.294812+0000","last_unstale":"2024-05-08T18:34:33.767319+0000","last_undegraded":"2024-05-08T18:34:33.767319+0000","last_fullsized":"2024-05-08T18:34:33.767319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:33.767215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:33.767215+0000","last_clean_scrub_stamp":"2024-05-08T18:34:33.767215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:26.750973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'47","reported_seq":119,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.562009+0000","last_change":"2024-05-08T18:34:26.562049+0000","last_active":"2024-05-08T18:34:26.562009+0000","last_peered":"2024-05-08T18:34:26.562009+0000","last_clean":"2024-05-08T18:34:26.562009+0000","last_became_active":"2024-05-08T18:31:04.301969+0000","last_became_peered":"2024-05-08T18:31:04.301969+0000","last_unstale":"2024-05-08T18:34:26.562009+0000","last_undegraded":"2024-05-08T18:34:26.562009+0000","last_fullsized":"2024-05-08T18:34:26.562009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-08T18:34:26.561918+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-08T18:34:26.561918+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.561918+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:56.265527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:17.922204+0000","last_change":"2024-05-08T18:34:17.922228+0000","last_active":"2024-05-08T18:34:17.922204+0000","last_peered":"2024-05-08T18:34:17.922204+0000","last_clean":"2024-05-08T18:34:17.922204+0000","last_became_active":"2024-05-08T18:31:06.306346+0000","last_became_peered":"2024-05-08T18:31:06.306346+0000","last_unstale":"2024-05-08T18:34:17.922204+0000","last_undegraded":"2024-05-08T18:34:17.922204+0000","last_fullsized":"2024-05-08T18:34:17.922204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:17.922113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:17.922113+0000","last_clean_scrub_stamp":"2024-05-08T18:34:17.922113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:34.597084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.182884+0000","last_change":"2024-05-08T18:31:08.317029+0000","last_active":"2024-05-08T18:33:38.182884+0000","last_peered":"2024-05-08T18:33:38.182884+0000","last_clean":"2024-05-08T18:33:38.182884+0000","last_became_active":"2024-05-08T18:31:08.316673+0000","last_became_peered":"2024-05-08T18:31:08.316673+0000","last_unstale":"2024-05-08T18:33:38.182884+0000","last_undegraded":"2024-05-08T18:33:38.182884+0000","last_fullsized":"2024-05-08T18:33:38.182884+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.180221+0000","last_change":"2024-05-08T18:31:00.291577+0000","last_active":"2024-05-08T18:33:23.180221+0000","last_peered":"2024-05-08T18:33:23.180221+0000","last_clean":"2024-05-08T18:33:23.180221+0000","last_became_active":"2024-05-08T18:31:00.291163+0000","last_became_peered":"2024-05-08T18:31:00.291163+0000","last_unstale":"2024-05-08T18:33:23.180221+0000","last_undegraded":"2024-05-08T18:33:23.180221+0000","last_fullsized":"2024-05-08T18:33:23.180221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179961+0000","last_change":"2024-05-08T18:30:58.305036+0000","last_active":"2024-05-08T18:33:23.179961+0000","last_peered":"2024-05-08T18:33:23.179961+0000","last_clean":"2024-05-08T18:33:23.179961+0000","last_became_active":"2024-05-08T18:30:58.304135+0000","last_became_peered":"2024-05-08T18:30:58.304135+0000","last_unstale":"2024-05-08T18:33:23.179961+0000","last_undegraded":"2024-05-08T18:33:23.179961+0000","last_fullsized":"2024-05-08T18:33:23.179961+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.724006+0000","last_change":"2024-05-08T18:34:25.724048+0000","last_active":"2024-05-08T18:34:25.724006+0000","last_peered":"2024-05-08T18:34:25.724006+0000","last_clean":"2024-05-08T18:34:25.724006+0000","last_became_active":"2024-05-08T18:31:02.290191+0000","last_became_peered":"2024-05-08T18:31:02.290191+0000","last_unstale":"2024-05-08T18:34:25.724006+0000","last_undegraded":"2024-05-08T18:34:25.724006+0000","last_fullsized":"2024-05-08T18:34:25.724006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:25.723912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:25.723912+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.723912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:20.514292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.740088+0000","last_change":"2024-05-08T18:34:30.740127+0000","last_active":"2024-05-08T18:34:30.740088+0000","last_peered":"2024-05-08T18:34:30.740088+0000","last_clean":"2024-05-08T18:34:30.740088+0000","last_became_active":"2024-05-08T18:31:04.295255+0000","last_became_peered":"2024-05-08T18:31:04.295255+0000","last_unstale":"2024-05-08T18:34:30.740088+0000","last_undegraded":"2024-05-08T18:34:30.740088+0000","last_fullsized":"2024-05-08T18:34:30.740088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:30.740000+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:30.740000+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.740000+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:21.689161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.619965+0000","last_change":"2024-05-08T18:34:22.620008+0000","last_active":"2024-05-08T18:34:22.619965+0000","last_peered":"2024-05-08T18:34:22.619965+0000","last_clean":"2024-05-08T18:34:22.619965+0000","last_became_active":"2024-05-08T18:31:06.304851+0000","last_became_peered":"2024-05-08T18:31:06.304851+0000","last_unstale":"2024-05-08T18:34:22.619965+0000","last_undegraded":"2024-05-08T18:34:22.619965+0000","last_fullsized":"2024-05-08T18:34:22.619965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:22.619859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:22.619859+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.619859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:19.090940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'8","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:53.184190+0000","last_change":"2024-05-08T18:31:45.343090+0000","last_active":"2024-05-08T18:33:53.184190+0000","last_peered":"2024-05-08T18:33:53.184190+0000","last_clean":"2024-05-08T18:33:53.184190+0000","last_became_active":"2024-05-08T18:31:45.336717+0000","last_became_peered":"2024-05-08T18:31:45.336717+0000","last_unstale":"2024-05-08T18:33:53.184190+0000","last_undegraded":"2024-05-08T18:33:53.184190+0000","last_fullsized":"2024-05-08T18:33:53.184190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.180198+0000","last_change":"2024-05-08T18:30:58.303784+0000","last_active":"2024-05-08T18:33:23.180198+0000","last_peered":"2024-05-08T18:33:23.180198+0000","last_clean":"2024-05-08T18:33:23.180198+0000","last_became_active":"2024-05-08T18:30:58.302486+0000","last_became_peered":"2024-05-08T18:30:58.302486+0000","last_unstale":"2024-05-08T18:33:23.180198+0000","last_undegraded":"2024-05-08T18:33:23.180198+0000","last_fullsized":"2024-05-08T18:33:23.180198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:38.630213+0000","last_change":"2024-05-08T18:34:38.630273+0000","last_active":"2024-05-08T18:34:38.630213+0000","last_peered":"2024-05-08T18:34:38.630213+0000","last_clean":"2024-05-08T18:34:38.630213+0000","last_became_active":"2024-05-08T18:31:02.291965+0000","last_became_peered":"2024-05-08T18:31:02.291965+0000","last_unstale":"2024-05-08T18:34:38.630213+0000","last_undegraded":"2024-05-08T18:34:38.630213+0000","last_fullsized":"2024-05-08T18:34:38.630213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:38.630108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:38.630108+0000","last_clean_scrub_stamp":"2024-05-08T18:34:38.630108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:03.690534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.589859+0000","last_change":"2024-05-08T18:34:28.589897+0000","last_active":"2024-05-08T18:34:28.589859+0000","last_peered":"2024-05-08T18:34:28.589859+0000","last_clean":"2024-05-08T18:34:28.589859+0000","last_became_active":"2024-05-08T18:31:04.298061+0000","last_became_peered":"2024-05-08T18:31:04.298061+0000","last_unstale":"2024-05-08T18:34:28.589859+0000","last_undegraded":"2024-05-08T18:34:28.589859+0000","last_fullsized":"2024-05-08T18:34:28.589859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-08T18:34:28.589758+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-08T18:34:28.589758+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.589758+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.082408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.571868+0000","last_change":"2024-05-08T18:34:19.571892+0000","last_active":"2024-05-08T18:34:19.571868+0000","last_peered":"2024-05-08T18:34:19.571868+0000","last_clean":"2024-05-08T18:34:19.571868+0000","last_became_active":"2024-05-08T18:31:06.308247+0000","last_became_peered":"2024-05-08T18:31:06.308247+0000","last_unstale":"2024-05-08T18:34:19.571868+0000","last_undegraded":"2024-05-08T18:34:19.571868+0000","last_fullsized":"2024-05-08T18:34:19.571868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:19.571752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:19.571752+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.571752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:10.353530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.065388+0000","last_change":"2024-05-08T18:31:08.314319+0000","last_active":"2024-05-08T18:34:07.065388+0000","last_peered":"2024-05-08T18:34:07.065388+0000","last_clean":"2024-05-08T18:34:07.065388+0000","last_became_active":"2024-05-08T18:31:08.313986+0000","last_became_peered":"2024-05-08T18:31:08.313986+0000","last_unstale":"2024-05-08T18:34:07.065388+0000","last_undegraded":"2024-05-08T18:34:07.065388+0000","last_fullsized":"2024-05-08T18:34:07.065388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:51.729110+0000","last_change":"2024-05-08T18:34:51.729136+0000","last_active":"2024-05-08T18:34:51.729110+0000","last_peered":"2024-05-08T18:34:51.729110+0000","last_clean":"2024-05-08T18:34:51.729110+0000","last_became_active":"2024-05-08T18:31:00.281233+0000","last_became_peered":"2024-05-08T18:31:00.281233+0000","last_unstale":"2024-05-08T18:34:51.729110+0000","last_undegraded":"2024-05-08T18:34:51.729110+0000","last_fullsized":"2024-05-08T18:34:51.729110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:51.729017+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:51.729017+0000","last_clean_scrub_stamp":"2024-05-08T18:34:51.729017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:23.632079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.179768+0000","last_change":"2024-05-08T18:30:58.290021+0000","last_active":"2024-05-08T18:33:23.179768+0000","last_peered":"2024-05-08T18:33:23.179768+0000","last_clean":"2024-05-08T18:33:23.179768+0000","last_became_active":"2024-05-08T18:30:58.289251+0000","last_became_peered":"2024-05-08T18:30:58.289251+0000","last_unstale":"2024-05-08T18:33:23.179768+0000","last_undegraded":"2024-05-08T18:33:23.179768+0000","last_fullsized":"2024-05-08T18:33:23.179768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:37.837360+0000","last_change":"2024-05-08T18:34:37.837401+0000","last_active":"2024-05-08T18:34:37.837360+0000","last_peered":"2024-05-08T18:34:37.837360+0000","last_clean":"2024-05-08T18:34:37.837360+0000","last_became_active":"2024-05-08T18:31:02.293185+0000","last_became_peered":"2024-05-08T18:31:02.293185+0000","last_unstale":"2024-05-08T18:34:37.837360+0000","last_undegraded":"2024-05-08T18:34:37.837360+0000","last_fullsized":"2024-05-08T18:34:37.837360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:37.837258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:37.837258+0000","last_clean_scrub_stamp":"2024-05-08T18:34:37.837258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:28.286615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.735819+0000","last_change":"2024-05-08T18:34:26.735863+0000","last_active":"2024-05-08T18:34:26.735819+0000","last_peered":"2024-05-08T18:34:26.735819+0000","last_clean":"2024-05-08T18:34:26.735819+0000","last_became_active":"2024-05-08T18:31:04.298482+0000","last_became_peered":"2024-05-08T18:31:04.298482+0000","last_unstale":"2024-05-08T18:34:26.735819+0000","last_undegraded":"2024-05-08T18:34:26.735819+0000","last_fullsized":"2024-05-08T18:34:26.735819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T18:34:26.735726+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T18:34:26.735726+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.735726+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:38.610782+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.785527+0000","last_change":"2024-05-08T18:34:28.785567+0000","last_active":"2024-05-08T18:34:28.785527+0000","last_peered":"2024-05-08T18:34:28.785527+0000","last_clean":"2024-05-08T18:34:28.785527+0000","last_became_active":"2024-05-08T18:31:06.311392+0000","last_became_peered":"2024-05-08T18:31:06.311392+0000","last_unstale":"2024-05-08T18:34:28.785527+0000","last_undegraded":"2024-05-08T18:34:28.785527+0000","last_fullsized":"2024-05-08T18:34:28.785527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:28.785418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:28.785418+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.785418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.278068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181260+0000","last_change":"2024-05-08T18:31:08.319678+0000","last_active":"2024-05-08T18:33:28.181260+0000","last_peered":"2024-05-08T18:33:28.181260+0000","last_clean":"2024-05-08T18:33:28.181260+0000","last_became_active":"2024-05-08T18:31:08.319394+0000","last_became_peered":"2024-05-08T18:31:08.319394+0000","last_unstale":"2024-05-08T18:33:28.181260+0000","last_undegraded":"2024-05-08T18:33:28.181260+0000","last_fullsized":"2024-05-08T18:33:28.181260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'18","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.687783+0000","last_change":"2024-05-08T18:34:29.687812+0000","last_active":"2024-05-08T18:34:29.687783+0000","last_peered":"2024-05-08T18:34:29.687783+0000","last_clean":"2024-05-08T18:34:29.687783+0000","last_became_active":"2024-05-08T18:31:00.299547+0000","last_became_peered":"2024-05-08T18:31:00.299547+0000","last_unstale":"2024-05-08T18:34:29.687783+0000","last_undegraded":"2024-05-08T18:34:29.687783+0000","last_fullsized":"2024-05-08T18:34:29.687783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-05-08T18:34:29.687669+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-05-08T18:34:29.687669+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.687669+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:34:50.822109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.180662+0000","last_change":"2024-05-08T18:30:58.305155+0000","last_active":"2024-05-08T18:33:28.180662+0000","last_peered":"2024-05-08T18:33:28.180662+0000","last_clean":"2024-05-08T18:33:28.180662+0000","last_became_active":"2024-05-08T18:30:58.303624+0000","last_became_peered":"2024-05-08T18:30:58.303624+0000","last_unstale":"2024-05-08T18:33:28.180662+0000","last_undegraded":"2024-05-08T18:33:28.180662+0000","last_fullsized":"2024-05-08T18:33:28.180662+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:38.801676+0000","last_change":"2024-05-08T18:34:38.801732+0000","last_active":"2024-05-08T18:34:38.801676+0000","last_peered":"2024-05-08T18:34:38.801676+0000","last_clean":"2024-05-08T18:34:38.801676+0000","last_became_active":"2024-05-08T18:31:02.292498+0000","last_became_peered":"2024-05-08T18:31:02.292498+0000","last_unstale":"2024-05-08T18:34:38.801676+0000","last_undegraded":"2024-05-08T18:34:38.801676+0000","last_fullsized":"2024-05-08T18:34:38.801676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:38.801554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:38.801554+0000","last_clean_scrub_stamp":"2024-05-08T18:34:38.801554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:02.934641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'39","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.519904+0000","last_change":"2024-05-08T18:34:31.519937+0000","last_active":"2024-05-08T18:34:31.519904+0000","last_peered":"2024-05-08T18:34:31.519904+0000","last_clean":"2024-05-08T18:34:31.519904+0000","last_became_active":"2024-05-08T18:31:04.297297+0000","last_became_peered":"2024-05-08T18:31:04.297297+0000","last_unstale":"2024-05-08T18:34:31.519904+0000","last_undegraded":"2024-05-08T18:34:31.519904+0000","last_fullsized":"2024-05-08T18:34:31.519904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-08T18:34:31.519820+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-08T18:34:31.519820+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.519820+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:29.500105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.647709+0000","last_change":"2024-05-08T18:34:20.647756+0000","last_active":"2024-05-08T18:34:20.647709+0000","last_peered":"2024-05-08T18:34:20.647709+0000","last_clean":"2024-05-08T18:34:20.647709+0000","last_became_active":"2024-05-08T18:31:06.305567+0000","last_became_peered":"2024-05-08T18:31:06.305567+0000","last_unstale":"2024-05-08T18:34:20.647709+0000","last_undegraded":"2024-05-08T18:34:20.647709+0000","last_fullsized":"2024-05-08T18:34:20.647709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:20.647576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:20.647576+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.647576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:11.596737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'11","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.968893+0000","last_change":"2024-05-08T18:31:08.317380+0000","last_active":"2024-05-08T18:34:06.968893+0000","last_peered":"2024-05-08T18:34:06.968893+0000","last_clean":"2024-05-08T18:34:06.968893+0000","last_became_active":"2024-05-08T18:31:08.316943+0000","last_became_peered":"2024-05-08T18:31:08.316943+0000","last_unstale":"2024-05-08T18:34:06.968893+0000","last_undegraded":"2024-05-08T18:34:06.968893+0000","last_fullsized":"2024-05-08T18:34:06.968893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'5","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.331291+0000","last_change":"2024-05-08T18:31:00.283641+0000","last_active":"2024-05-08T18:34:07.331291+0000","last_peered":"2024-05-08T18:34:07.331291+0000","last_clean":"2024-05-08T18:34:07.331291+0000","last_became_active":"2024-05-08T18:31:00.282923+0000","last_became_peered":"2024-05-08T18:31:00.282923+0000","last_unstale":"2024-05-08T18:34:07.331291+0000","last_undegraded":"2024-05-08T18:34:07.331291+0000","last_fullsized":"2024-05-08T18:34:07.331291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181312+0000","last_change":"2024-05-08T18:30:58.318535+0000","last_active":"2024-05-08T18:33:28.181312+0000","last_peered":"2024-05-08T18:33:28.181312+0000","last_clean":"2024-05-08T18:33:28.181312+0000","last_became_active":"2024-05-08T18:30:58.316980+0000","last_became_peered":"2024-05-08T18:30:58.316980+0000","last_unstale":"2024-05-08T18:33:28.181312+0000","last_undegraded":"2024-05-08T18:33:28.181312+0000","last_fullsized":"2024-05-08T18:33:28.181312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:35.723926+0000","last_change":"2024-05-08T18:34:35.723966+0000","last_active":"2024-05-08T18:34:35.723926+0000","last_peered":"2024-05-08T18:34:35.723926+0000","last_clean":"2024-05-08T18:34:35.723926+0000","last_became_active":"2024-05-08T18:31:02.288127+0000","last_became_peered":"2024-05-08T18:31:02.288127+0000","last_unstale":"2024-05-08T18:34:35.723926+0000","last_undegraded":"2024-05-08T18:34:35.723926+0000","last_fullsized":"2024-05-08T18:34:35.723926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:35.723797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:35.723797+0000","last_clean_scrub_stamp":"2024-05-08T18:34:35.723797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:17.046313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:49.428068+0000","last_change":"2024-05-08T18:34:49.428140+0000","last_active":"2024-05-08T18:34:49.428068+0000","last_peered":"2024-05-08T18:34:49.428068+0000","last_clean":"2024-05-08T18:34:49.428068+0000","last_became_active":"2024-05-08T18:31:04.302034+0000","last_became_peered":"2024-05-08T18:31:04.302034+0000","last_unstale":"2024-05-08T18:34:49.428068+0000","last_undegraded":"2024-05-08T18:34:49.428068+0000","last_fullsized":"2024-05-08T18:34:49.428068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T18:34:49.427967+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T18:34:49.427967+0000","last_clean_scrub_stamp":"2024-05-08T18:34:49.427967+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:40.814614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":418,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.617019+0000","last_change":"2024-05-08T18:34:20.617045+0000","last_active":"2024-05-08T18:34:20.617019+0000","last_peered":"2024-05-08T18:34:20.617019+0000","last_clean":"2024-05-08T18:34:20.617019+0000","last_became_active":"2024-05-08T18:31:06.311063+0000","last_became_peered":"2024-05-08T18:31:06.311063+0000","last_unstale":"2024-05-08T18:34:20.617019+0000","last_undegraded":"2024-05-08T18:34:20.617019+0000","last_fullsized":"2024-05-08T18:34:20.617019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:20.616926+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:20.616926+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.616926+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:07.788306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181095+0000","last_change":"2024-05-08T18:31:08.320650+0000","last_active":"2024-05-08T18:33:28.181095+0000","last_peered":"2024-05-08T18:33:28.181095+0000","last_clean":"2024-05-08T18:33:28.181095+0000","last_became_active":"2024-05-08T18:31:08.320260+0000","last_became_peered":"2024-05-08T18:31:08.320260+0000","last_unstale":"2024-05-08T18:33:28.181095+0000","last_undegraded":"2024-05-08T18:33:28.181095+0000","last_fullsized":"2024-05-08T18:33:28.181095+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:46.862485+0000","last_change":"2024-05-08T18:34:46.862513+0000","last_active":"2024-05-08T18:34:46.862485+0000","last_peered":"2024-05-08T18:34:46.862485+0000","last_clean":"2024-05-08T18:34:46.862485+0000","last_became_active":"2024-05-08T18:31:00.284982+0000","last_became_peered":"2024-05-08T18:31:00.284982+0000","last_unstale":"2024-05-08T18:34:46.862485+0000","last_undegraded":"2024-05-08T18:34:46.862485+0000","last_fullsized":"2024-05-08T18:34:46.862485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:46.862388+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:46.862388+0000","last_clean_scrub_stamp":"2024-05-08T18:34:46.862388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:08.371704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.180718+0000","last_change":"2024-05-08T18:30:58.306355+0000","last_active":"2024-05-08T18:33:28.180718+0000","last_peered":"2024-05-08T18:33:28.180718+0000","last_clean":"2024-05-08T18:33:28.180718+0000","last_became_active":"2024-05-08T18:30:58.304969+0000","last_became_peered":"2024-05-08T18:30:58.304969+0000","last_unstale":"2024-05-08T18:33:28.180718+0000","last_undegraded":"2024-05-08T18:33:28.180718+0000","last_fullsized":"2024-05-08T18:33:28.180718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:33.755080+0000","last_change":"2024-05-08T18:34:33.755105+0000","last_active":"2024-05-08T18:34:33.755080+0000","last_peered":"2024-05-08T18:34:33.755080+0000","last_clean":"2024-05-08T18:34:33.755080+0000","last_became_active":"2024-05-08T18:31:02.288719+0000","last_became_peered":"2024-05-08T18:31:02.288719+0000","last_unstale":"2024-05-08T18:34:33.755080+0000","last_undegraded":"2024-05-08T18:34:33.755080+0000","last_fullsized":"2024-05-08T18:34:33.755080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:33.754990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:33.754990+0000","last_clean_scrub_stamp":"2024-05-08T18:34:33.754990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:27.813675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'46","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.817834+0000","last_change":"2024-05-08T18:34:26.817876+0000","last_active":"2024-05-08T18:34:26.817834+0000","last_peered":"2024-05-08T18:34:26.817834+0000","last_clean":"2024-05-08T18:34:26.817834+0000","last_became_active":"2024-05-08T18:31:04.297013+0000","last_became_peered":"2024-05-08T18:31:04.297013+0000","last_unstale":"2024-05-08T18:34:26.817834+0000","last_undegraded":"2024-05-08T18:34:26.817834+0000","last_fullsized":"2024-05-08T18:34:26.817834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-05-08T18:34:26.817745+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-05-08T18:34:26.817745+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.817745+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:56.521354+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.591169+0000","last_change":"2024-05-08T18:34:29.591218+0000","last_active":"2024-05-08T18:34:29.591169+0000","last_peered":"2024-05-08T18:34:29.591169+0000","last_clean":"2024-05-08T18:34:29.591169+0000","last_became_active":"2024-05-08T18:31:06.311767+0000","last_became_peered":"2024-05-08T18:31:06.311767+0000","last_unstale":"2024-05-08T18:34:29.591169+0000","last_undegraded":"2024-05-08T18:34:29.591169+0000","last_fullsized":"2024-05-08T18:34:29.591169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:29.591069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:29.591069+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.591069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:12.240015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.200829+0000","last_change":"2024-05-08T18:31:08.313489+0000","last_active":"2024-05-08T18:34:07.200829+0000","last_peered":"2024-05-08T18:34:07.200829+0000","last_clean":"2024-05-08T18:34:07.200829+0000","last_became_active":"2024-05-08T18:31:08.312031+0000","last_became_peered":"2024-05-08T18:31:08.312031+0000","last_unstale":"2024-05-08T18:34:07.200829+0000","last_undegraded":"2024-05-08T18:34:07.200829+0000","last_fullsized":"2024-05-08T18:34:07.200829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:43.845914+0000","last_change":"2024-05-08T18:34:43.845941+0000","last_active":"2024-05-08T18:34:43.845914+0000","last_peered":"2024-05-08T18:34:43.845914+0000","last_clean":"2024-05-08T18:34:43.845914+0000","last_became_active":"2024-05-08T18:31:00.282605+0000","last_became_peered":"2024-05-08T18:31:00.282605+0000","last_unstale":"2024-05-08T18:34:43.845914+0000","last_undegraded":"2024-05-08T18:34:43.845914+0000","last_fullsized":"2024-05-08T18:34:43.845914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:43.845805+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:43.845805+0000","last_clean_scrub_stamp":"2024-05-08T18:34:43.845805+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:33.890772+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181406+0000","last_change":"2024-05-08T18:30:58.316801+0000","last_active":"2024-05-08T18:33:28.181406+0000","last_peered":"2024-05-08T18:33:28.181406+0000","last_clean":"2024-05-08T18:33:28.181406+0000","last_became_active":"2024-05-08T18:30:58.316166+0000","last_became_peered":"2024-05-08T18:30:58.316166+0000","last_unstale":"2024-05-08T18:33:28.181406+0000","last_undegraded":"2024-05-08T18:33:28.181406+0000","last_fullsized":"2024-05-08T18:33:28.181406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:34.793858+0000","last_change":"2024-05-08T18:34:34.793883+0000","last_active":"2024-05-08T18:34:34.793858+0000","last_peered":"2024-05-08T18:34:34.793858+0000","last_clean":"2024-05-08T18:34:34.793858+0000","last_became_active":"2024-05-08T18:31:02.294335+0000","last_became_peered":"2024-05-08T18:31:02.294335+0000","last_unstale":"2024-05-08T18:34:34.793858+0000","last_undegraded":"2024-05-08T18:34:34.793858+0000","last_fullsized":"2024-05-08T18:34:34.793858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:34.793770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:34.793770+0000","last_clean_scrub_stamp":"2024-05-08T18:34:34.793770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:10.718458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.557478+0000","last_change":"2024-05-08T18:34:30.557516+0000","last_active":"2024-05-08T18:34:30.557478+0000","last_peered":"2024-05-08T18:34:30.557478+0000","last_clean":"2024-05-08T18:34:30.557478+0000","last_became_active":"2024-05-08T18:31:04.297440+0000","last_became_peered":"2024-05-08T18:31:04.297440+0000","last_unstale":"2024-05-08T18:34:30.557478+0000","last_undegraded":"2024-05-08T18:34:30.557478+0000","last_fullsized":"2024-05-08T18:34:30.557478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:30.557382+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:30.557382+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.557382+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:48.222384+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.182019+0000","last_change":"2024-05-08T18:31:06.312504+0000","last_active":"2024-05-08T18:33:33.182019+0000","last_peered":"2024-05-08T18:33:33.182019+0000","last_clean":"2024-05-08T18:33:33.182019+0000","last_became_active":"2024-05-08T18:31:06.312162+0000","last_became_peered":"2024-05-08T18:31:06.312162+0000","last_unstale":"2024-05-08T18:33:33.182019+0000","last_undegraded":"2024-05-08T18:33:33.182019+0000","last_fullsized":"2024-05-08T18:33:33.182019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:05.283816+0000","last_clean_scrub_stamp":"2024-05-08T18:31:05.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.182202+0000","last_change":"2024-05-08T18:31:08.318309+0000","last_active":"2024-05-08T18:33:33.182202+0000","last_peered":"2024-05-08T18:33:33.182202+0000","last_clean":"2024-05-08T18:33:33.182202+0000","last_became_active":"2024-05-08T18:31:08.318072+0000","last_became_peered":"2024-05-08T18:31:08.318072+0000","last_unstale":"2024-05-08T18:33:33.182202+0000","last_undegraded":"2024-05-08T18:33:33.182202+0000","last_fullsized":"2024-05-08T18:33:33.182202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'4","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.249519+0000","last_change":"2024-05-08T18:31:00.292044+0000","last_active":"2024-05-08T18:34:07.249519+0000","last_peered":"2024-05-08T18:34:07.249519+0000","last_clean":"2024-05-08T18:34:07.249519+0000","last_became_active":"2024-05-08T18:31:00.291128+0000","last_became_peered":"2024-05-08T18:31:00.291128+0000","last_unstale":"2024-05-08T18:34:07.249519+0000","last_undegraded":"2024-05-08T18:34:07.249519+0000","last_fullsized":"2024-05-08T18:34:07.249519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:32:58.175277+0000","last_change":"2024-05-08T18:30:58.285590+0000","last_active":"2024-05-08T18:32:58.175277+0000","last_peered":"2024-05-08T18:32:58.175277+0000","last_clean":"2024-05-08T18:32:58.175277+0000","last_became_active":"2024-05-08T18:30:58.283402+0000","last_became_peered":"2024-05-08T18:30:58.283402+0000","last_unstale":"2024-05-08T18:32:58.175277+0000","last_undegraded":"2024-05-08T18:32:58.175277+0000","last_fullsized":"2024-05-08T18:32:58.175277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.819622+0000","last_change":"2024-05-08T18:34:27.819657+0000","last_active":"2024-05-08T18:34:27.819622+0000","last_peered":"2024-05-08T18:34:27.819622+0000","last_clean":"2024-05-08T18:34:27.819622+0000","last_became_active":"2024-05-08T18:31:02.291363+0000","last_became_peered":"2024-05-08T18:31:02.291363+0000","last_unstale":"2024-05-08T18:34:27.819622+0000","last_undegraded":"2024-05-08T18:34:27.819622+0000","last_fullsized":"2024-05-08T18:34:27.819622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:27.819512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:27.819512+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.819512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:11.229979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'33","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.643094+0000","last_change":"2024-05-08T18:34:30.643128+0000","last_active":"2024-05-08T18:34:30.643094+0000","last_peered":"2024-05-08T18:34:30.643094+0000","last_clean":"2024-05-08T18:34:30.643094+0000","last_became_active":"2024-05-08T18:31:04.298601+0000","last_became_peered":"2024-05-08T18:31:04.298601+0000","last_unstale":"2024-05-08T18:34:30.643094+0000","last_undegraded":"2024-05-08T18:34:30.643094+0000","last_fullsized":"2024-05-08T18:34:30.643094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2024-05-08T18:34:30.643006+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2024-05-08T18:34:30.643006+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.643006+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:15.159268+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":49,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:42.467334+0000","last_change":"2024-05-08T18:34:42.467363+0000","last_active":"2024-05-08T18:34:42.467334+0000","last_peered":"2024-05-08T18:34:42.467334+0000","last_clean":"2024-05-08T18:34:42.467334+0000","last_became_active":"2024-05-08T18:31:06.307801+0000","last_became_peered":"2024-05-08T18:31:06.307801+0000","last_unstale":"2024-05-08T18:34:42.467334+0000","last_undegraded":"2024-05-08T18:34:42.467334+0000","last_fullsized":"2024-05-08T18:34:42.467334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:42.467239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:42.467239+0000","last_clean_scrub_stamp":"2024-05-08T18:34:42.467239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:11.945138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.182134+0000","last_change":"2024-05-08T18:31:08.319580+0000","last_active":"2024-05-08T18:33:33.182134+0000","last_peered":"2024-05-08T18:33:33.182134+0000","last_clean":"2024-05-08T18:33:33.182134+0000","last_became_active":"2024-05-08T18:31:08.319232+0000","last_became_peered":"2024-05-08T18:31:08.319232+0000","last_unstale":"2024-05-08T18:33:33.182134+0000","last_undegraded":"2024-05-08T18:33:33.182134+0000","last_fullsized":"2024-05-08T18:33:33.182134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:42.804909+0000","last_change":"2024-05-08T18:34:42.804933+0000","last_active":"2024-05-08T18:34:42.804909+0000","last_peered":"2024-05-08T18:34:42.804909+0000","last_clean":"2024-05-08T18:34:42.804909+0000","last_became_active":"2024-05-08T18:31:00.282644+0000","last_became_peered":"2024-05-08T18:31:00.282644+0000","last_unstale":"2024-05-08T18:34:42.804909+0000","last_undegraded":"2024-05-08T18:34:42.804909+0000","last_fullsized":"2024-05-08T18:34:42.804909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:42.804809+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:42.804809+0000","last_clean_scrub_stamp":"2024-05-08T18:34:42.804809+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:20:23.898115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.946935+0000","last_change":"2024-05-08T18:30:58.304661+0000","last_active":"2024-05-08T18:34:06.946935+0000","last_peered":"2024-05-08T18:34:06.946935+0000","last_clean":"2024-05-08T18:34:06.946935+0000","last_became_active":"2024-05-08T18:30:58.303312+0000","last_became_peered":"2024-05-08T18:30:58.303312+0000","last_unstale":"2024-05-08T18:34:06.946935+0000","last_undegraded":"2024-05-08T18:34:06.946935+0000","last_fullsized":"2024-05-08T18:34:06.946935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'8","reported_seq":241,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:34.738076+0000","last_change":"2024-05-08T18:34:34.738123+0000","last_active":"2024-05-08T18:34:34.738076+0000","last_peered":"2024-05-08T18:34:34.738076+0000","last_clean":"2024-05-08T18:34:34.738076+0000","last_became_active":"2024-05-08T18:31:02.288433+0000","last_became_peered":"2024-05-08T18:31:02.288433+0000","last_unstale":"2024-05-08T18:34:34.738076+0000","last_undegraded":"2024-05-08T18:34:34.738076+0000","last_fullsized":"2024-05-08T18:34:34.738076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:34.737972+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:34.737972+0000","last_clean_scrub_stamp":"2024-05-08T18:34:34.737972+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:06.780418+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:34.593136+0000","last_change":"2024-05-08T18:34:34.593167+0000","last_active":"2024-05-08T18:34:34.593136+0000","last_peered":"2024-05-08T18:34:34.593136+0000","last_clean":"2024-05-08T18:34:34.593136+0000","last_became_active":"2024-05-08T18:31:04.298089+0000","last_became_peered":"2024-05-08T18:31:04.298089+0000","last_unstale":"2024-05-08T18:34:34.593136+0000","last_undegraded":"2024-05-08T18:34:34.593136+0000","last_fullsized":"2024-05-08T18:34:34.593136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-08T18:34:34.593039+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-08T18:34:34.593039+0000","last_clean_scrub_stamp":"2024-05-08T18:34:34.593039+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:54.680394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:37.668827+0000","last_change":"2024-05-08T18:34:37.668853+0000","last_active":"2024-05-08T18:34:37.668827+0000","last_peered":"2024-05-08T18:34:37.668827+0000","last_clean":"2024-05-08T18:34:37.668827+0000","last_became_active":"2024-05-08T18:31:06.311810+0000","last_became_peered":"2024-05-08T18:31:06.311810+0000","last_unstale":"2024-05-08T18:34:37.668827+0000","last_undegraded":"2024-05-08T18:34:37.668827+0000","last_fullsized":"2024-05-08T18:34:37.668827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:37.668735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:37.668735+0000","last_clean_scrub_stamp":"2024-05-08T18:34:37.668735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:25.055534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181355+0000","last_change":"2024-05-08T18:31:08.317101+0000","last_active":"2024-05-08T18:33:28.181355+0000","last_peered":"2024-05-08T18:33:28.181355+0000","last_clean":"2024-05-08T18:33:28.181355+0000","last_became_active":"2024-05-08T18:31:08.316723+0000","last_became_peered":"2024-05-08T18:31:08.316723+0000","last_unstale":"2024-05-08T18:33:28.181355+0000","last_undegraded":"2024-05-08T18:33:28.181355+0000","last_fullsized":"2024-05-08T18:33:28.181355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178260+0000","last_change":"2024-05-08T18:31:45.346058+0000","last_active":"2024-05-08T18:33:13.178260+0000","last_peered":"2024-05-08T18:33:13.178260+0000","last_clean":"2024-05-08T18:33:13.178260+0000","last_became_active":"2024-05-08T18:31:45.339252+0000","last_became_peered":"2024-05-08T18:31:45.339252+0000","last_unstale":"2024-05-08T18:33:13.178260+0000","last_undegraded":"2024-05-08T18:33:13.178260+0000","last_fullsized":"2024-05-08T18:33:13.178260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:45.897092+0000","last_change":"2024-05-08T18:34:45.897118+0000","last_active":"2024-05-08T18:34:45.897092+0000","last_peered":"2024-05-08T18:34:45.897092+0000","last_clean":"2024-05-08T18:34:45.897092+0000","last_became_active":"2024-05-08T18:30:58.308290+0000","last_became_peered":"2024-05-08T18:30:58.308290+0000","last_unstale":"2024-05-08T18:34:45.897092+0000","last_undegraded":"2024-05-08T18:34:45.897092+0000","last_fullsized":"2024-05-08T18:34:45.897092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:45.897004+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:45.897004+0000","last_clean_scrub_stamp":"2024-05-08T18:34:45.897004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:42.049005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.177722+0000","last_change":"2024-05-08T18:31:00.283309+0000","last_active":"2024-05-08T18:33:13.177722+0000","last_peered":"2024-05-08T18:33:13.177722+0000","last_clean":"2024-05-08T18:33:13.177722+0000","last_became_active":"2024-05-08T18:31:00.282889+0000","last_became_peered":"2024-05-08T18:31:00.282889+0000","last_unstale":"2024-05-08T18:33:13.177722+0000","last_undegraded":"2024-05-08T18:33:13.177722+0000","last_fullsized":"2024-05-08T18:33:13.177722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:48.628059+0000","last_change":"2024-05-08T18:34:48.628085+0000","last_active":"2024-05-08T18:34:48.628059+0000","last_peered":"2024-05-08T18:34:48.628059+0000","last_clean":"2024-05-08T18:34:48.628059+0000","last_became_active":"2024-05-08T18:30:58.294210+0000","last_became_peered":"2024-05-08T18:30:58.294210+0000","last_unstale":"2024-05-08T18:34:48.628059+0000","last_undegraded":"2024-05-08T18:34:48.628059+0000","last_fullsized":"2024-05-08T18:34:48.628059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:48.627966+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:48.627966+0000","last_clean_scrub_stamp":"2024-05-08T18:34:48.627966+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:09.762407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.203059+0000","last_change":"2024-05-08T18:31:00.298041+0000","last_active":"2024-05-08T18:34:07.203059+0000","last_peered":"2024-05-08T18:34:07.203059+0000","last_clean":"2024-05-08T18:34:07.203059+0000","last_became_active":"2024-05-08T18:31:00.295749+0000","last_became_peered":"2024-05-08T18:31:00.295749+0000","last_unstale":"2024-05-08T18:34:07.203059+0000","last_undegraded":"2024-05-08T18:34:07.203059+0000","last_fullsized":"2024-05-08T18:34:07.203059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'6","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.927893+0000","last_change":"2024-05-08T18:30:58.316506+0000","last_active":"2024-05-08T18:34:13.927893+0000","last_peered":"2024-05-08T18:34:13.927893+0000","last_clean":"2024-05-08T18:34:13.927893+0000","last_became_active":"2024-05-08T18:30:58.314786+0000","last_became_peered":"2024-05-08T18:30:58.314786+0000","last_unstale":"2024-05-08T18:34:13.927893+0000","last_undegraded":"2024-05-08T18:34:13.927893+0000","last_fullsized":"2024-05-08T18:34:13.927893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'11","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.331296+0000","last_change":"2024-05-08T18:31:00.283309+0000","last_active":"2024-05-08T18:34:07.331296+0000","last_peered":"2024-05-08T18:34:07.331296+0000","last_clean":"2024-05-08T18:34:07.331296+0000","last_became_active":"2024-05-08T18:31:00.282863+0000","last_became_peered":"2024-05-08T18:31:00.282863+0000","last_unstale":"2024-05-08T18:34:07.331296+0000","last_undegraded":"2024-05-08T18:34:07.331296+0000","last_fullsized":"2024-05-08T18:34:07.331296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'3","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.176084+0000","last_change":"2024-05-08T18:30:58.289717+0000","last_active":"2024-05-08T18:33:03.176084+0000","last_peered":"2024-05-08T18:33:03.176084+0000","last_clean":"2024-05-08T18:33:03.176084+0000","last_became_active":"2024-05-08T18:30:58.289337+0000","last_became_peered":"2024-05-08T18:30:58.289337+0000","last_unstale":"2024-05-08T18:33:03.176084+0000","last_undegraded":"2024-05-08T18:33:03.176084+0000","last_fullsized":"2024-05-08T18:33:03.176084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'8","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:44.639259+0000","last_change":"2024-05-08T18:34:44.639287+0000","last_active":"2024-05-08T18:34:44.639259+0000","last_peered":"2024-05-08T18:34:44.639259+0000","last_clean":"2024-05-08T18:34:44.639259+0000","last_became_active":"2024-05-08T18:31:00.291269+0000","last_became_peered":"2024-05-08T18:31:00.291269+0000","last_unstale":"2024-05-08T18:34:44.639259+0000","last_undegraded":"2024-05-08T18:34:44.639259+0000","last_fullsized":"2024-05-08T18:34:44.639259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:44.639159+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:44.639159+0000","last_clean_scrub_stamp":"2024-05-08T18:34:44.639159+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:39.429539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.176832+0000","last_change":"2024-05-08T18:30:58.285778+0000","last_active":"2024-05-08T18:33:08.176832+0000","last_peered":"2024-05-08T18:33:08.176832+0000","last_clean":"2024-05-08T18:33:08.176832+0000","last_became_active":"2024-05-08T18:30:58.283976+0000","last_became_peered":"2024-05-08T18:30:58.283976+0000","last_unstale":"2024-05-08T18:33:08.176832+0000","last_undegraded":"2024-05-08T18:33:08.176832+0000","last_fullsized":"2024-05-08T18:33:08.176832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:41.755584+0000","last_change":"2024-05-08T18:34:41.755623+0000","last_active":"2024-05-08T18:34:41.755584+0000","last_peered":"2024-05-08T18:34:41.755584+0000","last_clean":"2024-05-08T18:34:41.755584+0000","last_became_active":"2024-05-08T18:31:00.292385+0000","last_became_peered":"2024-05-08T18:31:00.292385+0000","last_unstale":"2024-05-08T18:34:41.755584+0000","last_undegraded":"2024-05-08T18:34:41.755584+0000","last_fullsized":"2024-05-08T18:34:41.755584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:41.755496+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:41.755496+0000","last_clean_scrub_stamp":"2024-05-08T18:34:41.755496+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:08:19.929979+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"29'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177323+0000","last_change":"2024-05-08T18:30:58.304478+0000","last_active":"2024-05-08T18:33:08.177323+0000","last_peered":"2024-05-08T18:33:08.177323+0000","last_clean":"2024-05-08T18:33:08.177323+0000","last_became_active":"2024-05-08T18:30:58.303839+0000","last_became_peered":"2024-05-08T18:30:58.303839+0000","last_unstale":"2024-05-08T18:33:08.177323+0000","last_undegraded":"2024-05-08T18:33:08.177323+0000","last_fullsized":"2024-05-08T18:33:08.177323+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'8","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:46.597838+0000","last_change":"2024-05-08T18:34:46.597867+0000","last_active":"2024-05-08T18:34:46.597838+0000","last_peered":"2024-05-08T18:34:46.597838+0000","last_clean":"2024-05-08T18:34:46.597838+0000","last_became_active":"2024-05-08T18:31:00.288202+0000","last_became_peered":"2024-05-08T18:31:00.288202+0000","last_unstale":"2024-05-08T18:34:46.597838+0000","last_undegraded":"2024-05-08T18:34:46.597838+0000","last_fullsized":"2024-05-08T18:34:46.597838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:46.597745+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:46.597745+0000","last_clean_scrub_stamp":"2024-05-08T18:34:46.597745+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:38.535670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177260+0000","last_change":"2024-05-08T18:30:58.305905+0000","last_active":"2024-05-08T18:33:08.177260+0000","last_peered":"2024-05-08T18:33:08.177260+0000","last_clean":"2024-05-08T18:33:08.177260+0000","last_became_active":"2024-05-08T18:30:58.305116+0000","last_became_peered":"2024-05-08T18:30:58.305116+0000","last_unstale":"2024-05-08T18:33:08.177260+0000","last_undegraded":"2024-05-08T18:33:08.177260+0000","last_fullsized":"2024-05-08T18:33:08.177260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177204+0000","last_change":"2024-05-08T18:31:00.285833+0000","last_active":"2024-05-08T18:33:08.177204+0000","last_peered":"2024-05-08T18:33:08.177204+0000","last_clean":"2024-05-08T18:33:08.177204+0000","last_became_active":"2024-05-08T18:31:00.284439+0000","last_became_peered":"2024-05-08T18:31:00.284439+0000","last_unstale":"2024-05-08T18:33:08.177204+0000","last_undegraded":"2024-05-08T18:33:08.177204+0000","last_fullsized":"2024-05-08T18:33:08.177204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.268652+0000","last_change":"2024-05-08T18:30:58.287850+0000","last_active":"2024-05-08T18:34:07.268652+0000","last_peered":"2024-05-08T18:34:07.268652+0000","last_clean":"2024-05-08T18:34:07.268652+0000","last_became_active":"2024-05-08T18:30:58.286930+0000","last_became_peered":"2024-05-08T18:30:58.286930+0000","last_unstale":"2024-05-08T18:34:07.268652+0000","last_undegraded":"2024-05-08T18:34:07.268652+0000","last_fullsized":"2024-05-08T18:34:07.268652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.971274+0000","last_change":"2024-05-08T18:31:00.283948+0000","last_active":"2024-05-08T18:34:06.971274+0000","last_peered":"2024-05-08T18:34:06.971274+0000","last_clean":"2024-05-08T18:34:06.971274+0000","last_became_active":"2024-05-08T18:31:00.282958+0000","last_became_peered":"2024-05-08T18:31:00.282958+0000","last_unstale":"2024-05-08T18:34:06.971274+0000","last_undegraded":"2024-05-08T18:34:06.971274+0000","last_fullsized":"2024-05-08T18:34:06.971274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177700+0000","last_change":"2024-05-08T18:30:58.305701+0000","last_active":"2024-05-08T18:33:08.177700+0000","last_peered":"2024-05-08T18:33:08.177700+0000","last_clean":"2024-05-08T18:33:08.177700+0000","last_became_active":"2024-05-08T18:30:58.302051+0000","last_became_peered":"2024-05-08T18:30:58.302051+0000","last_unstale":"2024-05-08T18:33:08.177700+0000","last_undegraded":"2024-05-08T18:33:08.177700+0000","last_fullsized":"2024-05-08T18:33:08.177700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:36.575212+0000","last_change":"2024-05-08T18:34:36.575238+0000","last_active":"2024-05-08T18:34:36.575212+0000","last_peered":"2024-05-08T18:34:36.575212+0000","last_clean":"2024-05-08T18:34:36.575212+0000","last_became_active":"2024-05-08T18:31:00.297787+0000","last_became_peered":"2024-05-08T18:31:00.297787+0000","last_unstale":"2024-05-08T18:34:36.575212+0000","last_undegraded":"2024-05-08T18:34:36.575212+0000","last_fullsized":"2024-05-08T18:34:36.575212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:36.575101+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:36.575101+0000","last_clean_scrub_stamp":"2024-05-08T18:34:36.575101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:18.442678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.193529+0000","last_change":"2024-05-08T18:30:58.285595+0000","last_active":"2024-05-08T18:34:07.193529+0000","last_peered":"2024-05-08T18:34:07.193529+0000","last_clean":"2024-05-08T18:34:07.193529+0000","last_became_active":"2024-05-08T18:30:58.284146+0000","last_became_peered":"2024-05-08T18:30:58.284146+0000","last_unstale":"2024-05-08T18:34:07.193529+0000","last_undegraded":"2024-05-08T18:34:07.193529+0000","last_fullsized":"2024-05-08T18:34:07.193529+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'12","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:43.589648+0000","last_change":"2024-05-08T18:34:43.589692+0000","last_active":"2024-05-08T18:34:43.589648+0000","last_peered":"2024-05-08T18:34:43.589648+0000","last_clean":"2024-05-08T18:34:43.589648+0000","last_became_active":"2024-05-08T18:31:00.291399+0000","last_became_peered":"2024-05-08T18:31:00.291399+0000","last_unstale":"2024-05-08T18:34:43.589648+0000","last_undegraded":"2024-05-08T18:34:43.589648+0000","last_fullsized":"2024-05-08T18:34:43.589648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:43.589557+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:43.589557+0000","last_clean_scrub_stamp":"2024-05-08T18:34:43.589557+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:03.562149+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.179806+0000","last_change":"2024-05-08T18:30:58.305891+0000","last_active":"2024-05-08T18:34:07.179806+0000","last_peered":"2024-05-08T18:34:07.179806+0000","last_clean":"2024-05-08T18:34:07.179806+0000","last_became_active":"2024-05-08T18:30:58.305523+0000","last_became_peered":"2024-05-08T18:30:58.305523+0000","last_unstale":"2024-05-08T18:34:07.179806+0000","last_undegraded":"2024-05-08T18:34:07.179806+0000","last_fullsized":"2024-05-08T18:34:07.179806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'14","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:47.605732+0000","last_change":"2024-05-08T18:34:47.605779+0000","last_active":"2024-05-08T18:34:47.605732+0000","last_peered":"2024-05-08T18:34:47.605732+0000","last_clean":"2024-05-08T18:34:47.605732+0000","last_became_active":"2024-05-08T18:31:00.281199+0000","last_became_peered":"2024-05-08T18:31:00.281199+0000","last_unstale":"2024-05-08T18:34:47.605732+0000","last_undegraded":"2024-05-08T18:34:47.605732+0000","last_fullsized":"2024-05-08T18:34:47.605732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-08T18:34:47.605617+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-08T18:34:47.605617+0000","last_clean_scrub_stamp":"2024-05-08T18:34:47.605617+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:27.417542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178137+0000","last_change":"2024-05-08T18:30:58.302582+0000","last_active":"2024-05-08T18:33:13.178137+0000","last_peered":"2024-05-08T18:33:13.178137+0000","last_clean":"2024-05-08T18:33:13.178137+0000","last_became_active":"2024-05-08T18:30:58.302218+0000","last_became_peered":"2024-05-08T18:30:58.302218+0000","last_unstale":"2024-05-08T18:33:13.178137+0000","last_undegraded":"2024-05-08T18:33:13.178137+0000","last_fullsized":"2024-05-08T18:33:13.178137+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:38.713807+0000","last_change":"2024-05-08T18:34:38.713843+0000","last_active":"2024-05-08T18:34:38.713807+0000","last_peered":"2024-05-08T18:34:38.713807+0000","last_clean":"2024-05-08T18:34:38.713807+0000","last_became_active":"2024-05-08T18:31:00.294146+0000","last_became_peered":"2024-05-08T18:31:00.294146+0000","last_unstale":"2024-05-08T18:34:38.713807+0000","last_undegraded":"2024-05-08T18:34:38.713807+0000","last_fullsized":"2024-05-08T18:34:38.713807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:38.713718+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:38.713718+0000","last_clean_scrub_stamp":"2024-05-08T18:34:38.713718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:03.774145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178618+0000","last_change":"2024-05-08T18:30:58.317135+0000","last_active":"2024-05-08T18:33:13.178618+0000","last_peered":"2024-05-08T18:33:13.178618+0000","last_clean":"2024-05-08T18:33:13.178618+0000","last_became_active":"2024-05-08T18:30:58.314388+0000","last_became_peered":"2024-05-08T18:30:58.314388+0000","last_unstale":"2024-05-08T18:33:13.178618+0000","last_undegraded":"2024-05-08T18:33:13.178618+0000","last_fullsized":"2024-05-08T18:33:13.178618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.247629+0000","last_change":"2024-05-08T18:31:00.283542+0000","last_active":"2024-05-08T18:34:07.247629+0000","last_peered":"2024-05-08T18:34:07.247629+0000","last_clean":"2024-05-08T18:34:07.247629+0000","last_became_active":"2024-05-08T18:31:00.281847+0000","last_became_peered":"2024-05-08T18:31:00.281847+0000","last_unstale":"2024-05-08T18:34:07.247629+0000","last_undegraded":"2024-05-08T18:34:07.247629+0000","last_fullsized":"2024-05-08T18:34:07.247629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178661+0000","last_change":"2024-05-08T18:30:58.309703+0000","last_active":"2024-05-08T18:33:13.178661+0000","last_peered":"2024-05-08T18:33:13.178661+0000","last_clean":"2024-05-08T18:33:13.178661+0000","last_became_active":"2024-05-08T18:30:58.309203+0000","last_became_peered":"2024-05-08T18:30:58.309203+0000","last_unstale":"2024-05-08T18:33:13.178661+0000","last_undegraded":"2024-05-08T18:33:13.178661+0000","last_fullsized":"2024-05-08T18:33:13.178661+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'16","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.205625+0000","last_change":"2024-05-08T18:31:00.296525+0000","last_active":"2024-05-08T18:34:07.205625+0000","last_peered":"2024-05-08T18:34:07.205625+0000","last_clean":"2024-05-08T18:34:07.205625+0000","last_became_active":"2024-05-08T18:31:00.296240+0000","last_became_peered":"2024-05-08T18:31:00.296240+0000","last_unstale":"2024-05-08T18:34:07.205625+0000","last_undegraded":"2024-05-08T18:34:07.205625+0000","last_fullsized":"2024-05-08T18:34:07.205625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178989+0000","last_change":"2024-05-08T18:30:58.306151+0000","last_active":"2024-05-08T18:33:18.178989+0000","last_peered":"2024-05-08T18:33:18.178989+0000","last_clean":"2024-05-08T18:33:18.178989+0000","last_became_active":"2024-05-08T18:30:58.305572+0000","last_became_peered":"2024-05-08T18:30:58.305572+0000","last_unstale":"2024-05-08T18:33:18.178989+0000","last_undegraded":"2024-05-08T18:33:18.178989+0000","last_fullsized":"2024-05-08T18:33:18.178989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'12","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:50.632409+0000","last_change":"2024-05-08T18:34:50.632438+0000","last_active":"2024-05-08T18:34:50.632409+0000","last_peered":"2024-05-08T18:34:50.632409+0000","last_clean":"2024-05-08T18:34:50.632409+0000","last_became_active":"2024-05-08T18:31:00.282414+0000","last_became_peered":"2024-05-08T18:31:00.282414+0000","last_unstale":"2024-05-08T18:34:50.632409+0000","last_undegraded":"2024-05-08T18:34:50.632409+0000","last_fullsized":"2024-05-08T18:34:50.632409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:50.632283+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:50.632283+0000","last_clean_scrub_stamp":"2024-05-08T18:34:50.632283+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:35.148546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.926883+0000","last_change":"2024-05-08T18:30:58.308682+0000","last_active":"2024-05-08T18:34:13.926883+0000","last_peered":"2024-05-08T18:34:13.926883+0000","last_clean":"2024-05-08T18:34:13.926883+0000","last_became_active":"2024-05-08T18:30:58.304591+0000","last_became_peered":"2024-05-08T18:30:58.304591+0000","last_unstale":"2024-05-08T18:34:13.926883+0000","last_undegraded":"2024-05-08T18:34:13.926883+0000","last_fullsized":"2024-05-08T18:34:13.926883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.926923+0000","last_change":"2024-05-08T18:30:58.304754+0000","last_active":"2024-05-08T18:34:13.926923+0000","last_peered":"2024-05-08T18:34:13.926923+0000","last_clean":"2024-05-08T18:34:13.926923+0000","last_became_active":"2024-05-08T18:30:58.303443+0000","last_became_peered":"2024-05-08T18:30:58.303443+0000","last_unstale":"2024-05-08T18:34:13.926923+0000","last_undegraded":"2024-05-08T18:34:13.926923+0000","last_fullsized":"2024-05-08T18:34:13.926923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'11","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.331350+0000","last_change":"2024-05-08T18:31:00.288619+0000","last_active":"2024-05-08T18:34:07.331350+0000","last_peered":"2024-05-08T18:34:07.331350+0000","last_clean":"2024-05-08T18:34:07.331350+0000","last_became_active":"2024-05-08T18:31:00.288250+0000","last_became_peered":"2024-05-08T18:31:00.288250+0000","last_unstale":"2024-05-08T18:34:07.331350+0000","last_undegraded":"2024-05-08T18:34:07.331350+0000","last_fullsized":"2024-05-08T18:34:07.331350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178515+0000","last_change":"2024-05-08T18:30:58.285795+0000","last_active":"2024-05-08T18:33:18.178515+0000","last_peered":"2024-05-08T18:33:18.178515+0000","last_clean":"2024-05-08T18:33:18.178515+0000","last_became_active":"2024-05-08T18:30:58.284090+0000","last_became_peered":"2024-05-08T18:30:58.284090+0000","last_unstale":"2024-05-08T18:33:18.178515+0000","last_undegraded":"2024-05-08T18:33:18.178515+0000","last_fullsized":"2024-05-08T18:33:18.178515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:45.638589+0000","last_change":"2024-05-08T18:34:45.638617+0000","last_active":"2024-05-08T18:34:45.638589+0000","last_peered":"2024-05-08T18:34:45.638589+0000","last_clean":"2024-05-08T18:34:45.638589+0000","last_became_active":"2024-05-08T18:31:00.291650+0000","last_became_peered":"2024-05-08T18:31:00.291650+0000","last_unstale":"2024-05-08T18:34:45.638589+0000","last_undegraded":"2024-05-08T18:34:45.638589+0000","last_fullsized":"2024-05-08T18:34:45.638589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:45.638483+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:45.638483+0000","last_clean_scrub_stamp":"2024-05-08T18:34:45.638483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:17:56.483101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":476,"ondisk_log_size":476,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705716,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":136192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705717,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40444,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331396,"statfs":{"total":96636764160,"available":96595349504,"internally_reserved":0,"allocated":970752,"data_stored":724145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705716,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36304,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335536,"statfs":{"total":96636764160,"available":96599588864,"internally_reserved":0,"allocated":991232,"data_stored":724633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":409600,"data_stored":135044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:34:59.456 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.457 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.457 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.457 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.457 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.457 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.457 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.457 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.458 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.458 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.458 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.458 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.458 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.458 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.458 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.458 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.459 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.459 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.459 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.459 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.459 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.459 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.459 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.459 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.460 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.460 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.460 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.460 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.460 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.460 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.460 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.461 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.461 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.461 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.461 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.461 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.461 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.462 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.462 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.462 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.462 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.462 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.462 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.462 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.463 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.463 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.463 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.463 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.463 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.463 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.463 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.464 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.464 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.464 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.464 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.464 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.464 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.464 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.465 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.465 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.465 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.465 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.465 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.465 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.465 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.466 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.466 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.466 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.466 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.466 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.466 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.466 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.467 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.467 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.467 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.467 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.467 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.467 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.467 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.468 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.468 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.468 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.468 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.468 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.468 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.468 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.469 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.469 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.469 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.469 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.469 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.469 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-08T18:31:05.283816+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=5, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.469 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.469 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.470 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.470 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.470 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.470 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.470 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.470 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.470 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.471 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.471 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.471 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.471 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.471 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.471 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.471 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.472 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.472 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.472 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.472 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.472 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.472 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.472 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.472 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.473 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.473 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.473 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.473 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.473 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.473 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.473 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:34:59.473 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:35:19.474 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:35:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.591+0000 7f1a6ad17640 1 Processor -- start 2024-05-08T18:35:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.591+0000 7f1a6ad17640 1 -- start start 2024-05-08T18:35:19.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.592+0000 7f1a6ad17640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1a6412eb90 0x7f1a64130f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:35:19.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.592+0000 7f1a6ad17640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a640719e0 con 0x7f1a6412bdd0 2024-05-08T18:35:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.592+0000 7f1a6ad17640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f1a6412b9a0 con 0x7f1a6412eb90 2024-05-08T18:35:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.592+0000 7f1a63fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1a6412eb90 0x7f1a64130f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:35:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.592+0000 7f1a63fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1a6412eb90 0x7f1a64130f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52222/0 (socket says 172.21.15.53:52222) 2024-05-08T18:35:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.592+0000 7f1a68ab3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1a6412bdd0 0x7f1a6412c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40190/0 (socket says 172.21.15.53:40190) 2024-05-08T18:35:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.592+0000 7f1a63fff640 1 -- 172.21.15.53:0/884638945 learned_addr learned my addr 172.21.15.53:0/884638945 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:35:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.592+0000 7f1a63fff640 1 -- 172.21.15.53:0/884638945 >> v1:172.21.15.53:6789/0 conn(0x7f1a6412bdd0 legacy=0x7f1a6412c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:35:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.592+0000 7f1a63fff640 1 -- 172.21.15.53:0/884638945 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a64072330 con 0x7f1a6412eb90 2024-05-08T18:35:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.593+0000 7f1a63fff640 1 --2- 172.21.15.53:0/884638945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6412eb90 0x7f1a64130f80 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800ba90 tx=0x7f1a5802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402ab0306483da2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:35:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.593+0000 7f1a637fe640 1 -- 172.21.15.53:0/884638945 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a5803b070 con 0x7f1a6412eb90 2024-05-08T18:35:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.593+0000 7f1a637fe640 1 -- 172.21.15.53:0/884638945 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5802edc0 con 0x7f1a6412eb90 2024-05-08T18:35:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.593+0000 7f1a637fe640 1 -- 172.21.15.53:0/884638945 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a58036590 con 0x7f1a6412eb90 2024-05-08T18:35:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.594+0000 7f1a6ad17640 1 -- 172.21.15.53:0/884638945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6412eb90 msgr2=0x7f1a64130f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:35:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.594+0000 7f1a6ad17640 1 --2- 172.21.15.53:0/884638945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6412eb90 0x7f1a64130f80 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800ba90 tx=0x7f1a5802e0e0 comp rx=0 tx=0).stop 2024-05-08T18:35:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.594+0000 7f1a6ad17640 1 -- 172.21.15.53:0/884638945 shutdown_connections 2024-05-08T18:35:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.594+0000 7f1a6ad17640 1 --2- 172.21.15.53:0/884638945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6412eb90 0x7f1a64130f80 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:35:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.594+0000 7f1a6ad17640 1 -- 172.21.15.53:0/884638945 >> 172.21.15.53:0/884638945 conn(0x7f1a6409a910 msgr2=0x7f1a6406e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:35:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.594+0000 7f1a6ad17640 1 -- 172.21.15.53:0/884638945 shutdown_connections 2024-05-08T18:35:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.594+0000 7f1a6ad17640 1 -- 172.21.15.53:0/884638945 wait complete. 2024-05-08T18:35:19.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.595+0000 7f1a6ad17640 1 Processor -- start 2024-05-08T18:35:19.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.595+0000 7f1a6ad17640 1 -- start start 2024-05-08T18:35:19.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.595+0000 7f1a6ad17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6412bdd0 0x7f1a641bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:35:19.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.595+0000 7f1a6ad17640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1a64073290 con 0x7f1a6412bdd0 2024-05-08T18:35:19.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.595+0000 7f1a68ab3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6412bdd0 0x7f1a641bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:35:19.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.595+0000 7f1a68ab3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6412bdd0 0x7f1a641bfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52232/0 (socket says 172.21.15.53:52232) 2024-05-08T18:35:19.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.595+0000 7f1a68ab3640 1 -- 172.21.15.53:0/563824803 learned_addr learned my addr 172.21.15.53:0/563824803 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:35:19.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.596+0000 7f1a68ab3640 1 -- 172.21.15.53:0/563824803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a64116980 con 0x7f1a6412bdd0 2024-05-08T18:35:19.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.596+0000 7f1a68ab3640 1 --2- 172.21.15.53:0/563824803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6412bdd0 0x7f1a641bfd40 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400c450 tx=0x7f1a5400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:35:19.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.596+0000 7f1a617fa640 1 -- 172.21.15.53:0/563824803 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a54007410 con 0x7f1a6412bdd0 2024-05-08T18:35:19.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.596+0000 7f1a617fa640 1 -- 172.21.15.53:0/563824803 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a540075b0 con 0x7f1a6412bdd0 2024-05-08T18:35:19.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.596+0000 7f1a6ad17640 1 -- 172.21.15.53:0/563824803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a64115450 con 0x7f1a6412bdd0 2024-05-08T18:35:19.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.596+0000 7f1a617fa640 1 -- 172.21.15.53:0/563824803 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a54004910 con 0x7f1a6412bdd0 2024-05-08T18:35:19.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.596+0000 7f1a6ad17640 1 -- 172.21.15.53:0/563824803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a641163f0 con 0x7f1a6412bdd0 2024-05-08T18:35:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.597+0000 7f1a6ad17640 1 -- 172.21.15.53:0/563824803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a64064010 con 0x7f1a6412bdd0 2024-05-08T18:35:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.597+0000 7f1a617fa640 1 -- 172.21.15.53:0/563824803 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1a5401a020 con 0x7f1a6412bdd0 2024-05-08T18:35:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.597+0000 7f1a617fa640 1 --2- 172.21.15.53:0/563824803 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1a5003d2b0 0x7f1a5003f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:35:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.597+0000 7f1a617fa640 1 -- 172.21.15.53:0/563824803 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f1a54051640 con 0x7f1a6412bdd0 2024-05-08T18:35:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.598+0000 7f1a63fff640 1 --2- 172.21.15.53:0/563824803 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1a5003d2b0 0x7f1a5003f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:35:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.598+0000 7f1a63fff640 1 --2- 172.21.15.53:0/563824803 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1a5003d2b0 0x7f1a5003f770 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1a58038000 tx=0x7f1a58032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:35:19.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.602+0000 7f1a617fa640 1 -- 172.21.15.53:0/563824803 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1a540113a0 con 0x7f1a6412bdd0 2024-05-08T18:35:19.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.788+0000 7f1a6ad17640 1 -- 172.21.15.53:0/563824803 --> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a640008d0 con 0x7f1a5003d2b0 2024-05-08T18:35:19.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.803+0000 7f1a617fa640 1 -- 172.21.15.53:0/563824803 <== mgr.4102 v2:172.21.15.87:6824/211215191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664668 (secure 0 0 0) 0x7f1a640008d0 con 0x7f1a5003d2b0 2024-05-08T18:35:19.808 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:35:19.813 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:35:19.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.808+0000 7f1a6ad17640 1 -- 172.21.15.53:0/563824803 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1a5003d2b0 msgr2=0x7f1a5003f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:35:19.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.808+0000 7f1a6ad17640 1 --2- 172.21.15.53:0/563824803 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1a5003d2b0 0x7f1a5003f770 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1a58038000 tx=0x7f1a58032000 comp rx=0 tx=0).stop 2024-05-08T18:35:19.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.808+0000 7f1a6ad17640 1 -- 172.21.15.53:0/563824803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6412bdd0 msgr2=0x7f1a641bfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:35:19.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.808+0000 7f1a6ad17640 1 --2- 172.21.15.53:0/563824803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6412bdd0 0x7f1a641bfd40 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400c450 tx=0x7f1a5400c910 comp rx=0 tx=0).stop 2024-05-08T18:35:19.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.808+0000 7f1a6ad17640 1 -- 172.21.15.53:0/563824803 shutdown_connections 2024-05-08T18:35:19.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.808+0000 7f1a6ad17640 1 --2- 172.21.15.53:0/563824803 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f1a5003d2b0 0x7f1a5003f770 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:35:19.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.808+0000 7f1a6ad17640 1 --2- 172.21.15.53:0/563824803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6412bdd0 0x7f1a641bfd40 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:35:19.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.808+0000 7f1a6ad17640 1 -- 172.21.15.53:0/563824803 >> 172.21.15.53:0/563824803 conn(0x7f1a6409a910 msgr2=0x7f1a6409c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:35:19.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.808+0000 7f1a6ad17640 1 -- 172.21.15.53:0/563824803 shutdown_connections 2024-05-08T18:35:19.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:19.808+0000 7f1a6ad17640 1 -- 172.21.15.53:0/563824803 wait complete. 2024-05-08T18:35:19.817 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-05-08T18:35:18.185831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5055,"num_read_kb":4641,"num_write":2119,"num_write_kb":60585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3169,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4732,"ondisk_log_size":4732,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148248,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339112,"statfs":{"total":386547056640,"available":386395250688,"internally_reserved":0,"allocated":2809856,"data_stored":1720014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003589"},"pg_stats":[{"pgid":"3.3f","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:57.851976+0000","last_change":"2024-05-08T18:34:57.851976+0000","last_active":"2024-05-08T18:34:57.851976+0000","last_peered":"2024-05-08T18:34:57.851976+0000","last_clean":"2024-05-08T18:34:57.851976+0000","last_became_active":"2024-05-08T18:30:58.305175+0000","last_became_peered":"2024-05-08T18:30:58.305175+0000","last_unstale":"2024-05-08T18:34:57.851976+0000","last_undegraded":"2024-05-08T18:34:57.851976+0000","last_fullsized":"2024-05-08T18:34:57.851976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:57.851844+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:57.851844+0000","last_clean_scrub_stamp":"2024-05-08T18:34:57.851844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:37.663769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'8","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:00.657644+0000","last_change":"2024-05-08T18:35:00.657698+0000","last_active":"2024-05-08T18:35:00.657644+0000","last_peered":"2024-05-08T18:35:00.657644+0000","last_clean":"2024-05-08T18:35:00.657644+0000","last_became_active":"2024-05-08T18:31:00.284574+0000","last_became_peered":"2024-05-08T18:31:00.284574+0000","last_unstale":"2024-05-08T18:35:00.657644+0000","last_undegraded":"2024-05-08T18:35:00.657644+0000","last_fullsized":"2024-05-08T18:35:00.657644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:35:00.657541+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:35:00.657541+0000","last_clean_scrub_stamp":"2024-05-08T18:35:00.657541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:37.359769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:00.642294+0000","last_change":"2024-05-08T18:35:00.642294+0000","last_active":"2024-05-08T18:35:00.642294+0000","last_peered":"2024-05-08T18:35:00.642294+0000","last_clean":"2024-05-08T18:35:00.642294+0000","last_became_active":"2024-05-08T18:30:58.288674+0000","last_became_peered":"2024-05-08T18:30:58.288674+0000","last_unstale":"2024-05-08T18:35:00.642294+0000","last_undegraded":"2024-05-08T18:35:00.642294+0000","last_fullsized":"2024-05-08T18:35:00.642294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:00.642171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:00.642171+0000","last_clean_scrub_stamp":"2024-05-08T18:35:00.642171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:52.334568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:37.548543+0000","last_change":"2024-05-08T18:34:37.548605+0000","last_active":"2024-05-08T18:34:37.548543+0000","last_peered":"2024-05-08T18:34:37.548543+0000","last_clean":"2024-05-08T18:34:37.548543+0000","last_became_active":"2024-05-08T18:31:00.298145+0000","last_became_peered":"2024-05-08T18:31:00.298145+0000","last_unstale":"2024-05-08T18:34:37.548543+0000","last_undegraded":"2024-05-08T18:34:37.548543+0000","last_fullsized":"2024-05-08T18:34:37.548543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:34:37.548430+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:34:37.548430+0000","last_clean_scrub_stamp":"2024-05-08T18:34:37.548430+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:11.432050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.284681+0000","last_change":"2024-05-08T18:30:58.306369+0000","last_active":"2024-05-08T18:34:18.284681+0000","last_peered":"2024-05-08T18:34:18.284681+0000","last_clean":"2024-05-08T18:34:18.284681+0000","last_became_active":"2024-05-08T18:30:58.304442+0000","last_became_peered":"2024-05-08T18:30:58.304442+0000","last_unstale":"2024-05-08T18:34:18.284681+0000","last_undegraded":"2024-05-08T18:34:18.284681+0000","last_fullsized":"2024-05-08T18:34:18.284681+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'10","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:52.416583+0000","last_change":"2024-05-08T18:34:52.416630+0000","last_active":"2024-05-08T18:34:52.416583+0000","last_peered":"2024-05-08T18:34:52.416583+0000","last_clean":"2024-05-08T18:34:52.416583+0000","last_became_active":"2024-05-08T18:31:00.297810+0000","last_became_peered":"2024-05-08T18:31:00.297810+0000","last_unstale":"2024-05-08T18:34:52.416583+0000","last_undegraded":"2024-05-08T18:34:52.416583+0000","last_fullsized":"2024-05-08T18:34:52.416583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:34:52.416478+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:34:52.416478+0000","last_clean_scrub_stamp":"2024-05-08T18:34:52.416478+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:32.357386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:59.863278+0000","last_change":"2024-05-08T18:34:59.863300+0000","last_active":"2024-05-08T18:34:59.863278+0000","last_peered":"2024-05-08T18:34:59.863278+0000","last_clean":"2024-05-08T18:34:59.863278+0000","last_became_active":"2024-05-08T18:30:58.295569+0000","last_became_peered":"2024-05-08T18:30:58.295569+0000","last_unstale":"2024-05-08T18:34:59.863278+0000","last_undegraded":"2024-05-08T18:34:59.863278+0000","last_fullsized":"2024-05-08T18:34:59.863278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:59.863190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:59.863190+0000","last_clean_scrub_stamp":"2024-05-08T18:34:59.863190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:44.379452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:59.340771+0000","last_change":"2024-05-08T18:34:59.340801+0000","last_active":"2024-05-08T18:34:59.340771+0000","last_peered":"2024-05-08T18:34:59.340771+0000","last_clean":"2024-05-08T18:34:59.340771+0000","last_became_active":"2024-05-08T18:31:00.295611+0000","last_became_peered":"2024-05-08T18:31:00.295611+0000","last_unstale":"2024-05-08T18:34:59.340771+0000","last_undegraded":"2024-05-08T18:34:59.340771+0000","last_fullsized":"2024-05-08T18:34:59.340771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:59.340664+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:59.340664+0000","last_clean_scrub_stamp":"2024-05-08T18:34:59.340664+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:43.577418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181331+0000","last_change":"2024-05-08T18:30:58.313349+0000","last_active":"2024-05-08T18:33:28.181331+0000","last_peered":"2024-05-08T18:33:28.181331+0000","last_clean":"2024-05-08T18:33:28.181331+0000","last_became_active":"2024-05-08T18:30:58.313003+0000","last_became_peered":"2024-05-08T18:30:58.313003+0000","last_unstale":"2024-05-08T18:33:28.181331+0000","last_undegraded":"2024-05-08T18:33:28.181331+0000","last_fullsized":"2024-05-08T18:33:28.181331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'4","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:46.649407+0000","last_change":"2024-05-08T18:34:46.649407+0000","last_active":"2024-05-08T18:34:46.649407+0000","last_peered":"2024-05-08T18:34:46.649407+0000","last_clean":"2024-05-08T18:34:46.649407+0000","last_became_active":"2024-05-08T18:31:00.281065+0000","last_became_peered":"2024-05-08T18:31:00.281065+0000","last_unstale":"2024-05-08T18:34:46.649407+0000","last_undegraded":"2024-05-08T18:34:46.649407+0000","last_fullsized":"2024-05-08T18:34:46.649407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:34:46.649258+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:34:46.649258+0000","last_clean_scrub_stamp":"2024-05-08T18:34:46.649258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:36.416236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:47.845721+0000","last_change":"2024-05-08T18:34:47.845746+0000","last_active":"2024-05-08T18:34:47.845721+0000","last_peered":"2024-05-08T18:34:47.845721+0000","last_clean":"2024-05-08T18:34:47.845721+0000","last_became_active":"2024-05-08T18:30:58.307687+0000","last_became_peered":"2024-05-08T18:30:58.307687+0000","last_unstale":"2024-05-08T18:34:47.845721+0000","last_undegraded":"2024-05-08T18:34:47.845721+0000","last_fullsized":"2024-05-08T18:34:47.845721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:47.845617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:47.845617+0000","last_clean_scrub_stamp":"2024-05-08T18:34:47.845617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:35.232416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'12","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:35.603652+0000","last_change":"2024-05-08T18:34:35.603652+0000","last_active":"2024-05-08T18:34:35.603652+0000","last_peered":"2024-05-08T18:34:35.603652+0000","last_clean":"2024-05-08T18:34:35.603652+0000","last_became_active":"2024-05-08T18:31:00.298978+0000","last_became_peered":"2024-05-08T18:31:00.298978+0000","last_unstale":"2024-05-08T18:34:35.603652+0000","last_undegraded":"2024-05-08T18:34:35.603652+0000","last_fullsized":"2024-05-08T18:34:35.603652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:35.603538+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:35.603538+0000","last_clean_scrub_stamp":"2024-05-08T18:34:35.603538+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.163546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181237+0000","last_change":"2024-05-08T18:30:58.309859+0000","last_active":"2024-05-08T18:33:28.181237+0000","last_peered":"2024-05-08T18:33:28.181237+0000","last_clean":"2024-05-08T18:33:28.181237+0000","last_became_active":"2024-05-08T18:30:58.308931+0000","last_became_peered":"2024-05-08T18:30:58.308931+0000","last_unstale":"2024-05-08T18:33:28.181237+0000","last_undegraded":"2024-05-08T18:33:28.181237+0000","last_fullsized":"2024-05-08T18:33:28.181237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'10","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:56.873085+0000","last_change":"2024-05-08T18:34:56.873085+0000","last_active":"2024-05-08T18:34:56.873085+0000","last_peered":"2024-05-08T18:34:56.873085+0000","last_clean":"2024-05-08T18:34:56.873085+0000","last_became_active":"2024-05-08T18:31:00.295472+0000","last_became_peered":"2024-05-08T18:31:00.295472+0000","last_unstale":"2024-05-08T18:34:56.873085+0000","last_undegraded":"2024-05-08T18:34:56.873085+0000","last_fullsized":"2024-05-08T18:34:56.873085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:56.872968+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:56.872968+0000","last_clean_scrub_stamp":"2024-05-08T18:34:56.872968+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:48.810892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:52.757826+0000","last_change":"2024-05-08T18:34:52.757867+0000","last_active":"2024-05-08T18:34:52.757826+0000","last_peered":"2024-05-08T18:34:52.757826+0000","last_clean":"2024-05-08T18:34:52.757826+0000","last_became_active":"2024-05-08T18:30:58.294511+0000","last_became_peered":"2024-05-08T18:30:58.294511+0000","last_unstale":"2024-05-08T18:34:52.757826+0000","last_undegraded":"2024-05-08T18:34:52.757826+0000","last_fullsized":"2024-05-08T18:34:52.757826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:52.757734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:52.757734+0000","last_clean_scrub_stamp":"2024-05-08T18:34:52.757734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:46.902960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'4","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:48.805144+0000","last_change":"2024-05-08T18:34:48.805144+0000","last_active":"2024-05-08T18:34:48.805144+0000","last_peered":"2024-05-08T18:34:48.805144+0000","last_clean":"2024-05-08T18:34:48.805144+0000","last_became_active":"2024-05-08T18:31:00.291203+0000","last_became_peered":"2024-05-08T18:31:00.291203+0000","last_unstale":"2024-05-08T18:34:48.805144+0000","last_undegraded":"2024-05-08T18:34:48.805144+0000","last_fullsized":"2024-05-08T18:34:48.805144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:48.804997+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:48.804997+0000","last_clean_scrub_stamp":"2024-05-08T18:34:48.804997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:13.865424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:07.345913+0000","last_change":"2024-05-08T18:35:07.345938+0000","last_active":"2024-05-08T18:35:07.345913+0000","last_peered":"2024-05-08T18:35:07.345913+0000","last_clean":"2024-05-08T18:35:07.345913+0000","last_became_active":"2024-05-08T18:31:00.290806+0000","last_became_peered":"2024-05-08T18:31:00.290806+0000","last_unstale":"2024-05-08T18:35:07.345913+0000","last_undegraded":"2024-05-08T18:35:07.345913+0000","last_fullsized":"2024-05-08T18:35:07.345913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:07.345824+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:07.345824+0000","last_clean_scrub_stamp":"2024-05-08T18:35:07.345824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:28.605906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:59.618993+0000","last_change":"2024-05-08T18:34:59.619045+0000","last_active":"2024-05-08T18:34:59.618993+0000","last_peered":"2024-05-08T18:34:59.618993+0000","last_clean":"2024-05-08T18:34:59.618993+0000","last_became_active":"2024-05-08T18:30:58.304685+0000","last_became_peered":"2024-05-08T18:30:58.304685+0000","last_unstale":"2024-05-08T18:34:59.618993+0000","last_undegraded":"2024-05-08T18:34:59.618993+0000","last_fullsized":"2024-05-08T18:34:59.618993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:59.618879+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:59.618879+0000","last_clean_scrub_stamp":"2024-05-08T18:34:59.618879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:12.303648+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'14","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:52.646305+0000","last_change":"2024-05-08T18:34:52.646329+0000","last_active":"2024-05-08T18:34:52.646305+0000","last_peered":"2024-05-08T18:34:52.646305+0000","last_clean":"2024-05-08T18:34:52.646305+0000","last_became_active":"2024-05-08T18:31:00.281816+0000","last_became_peered":"2024-05-08T18:31:00.281816+0000","last_unstale":"2024-05-08T18:34:52.646305+0000","last_undegraded":"2024-05-08T18:34:52.646305+0000","last_fullsized":"2024-05-08T18:34:52.646305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-05-08T18:34:52.646217+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-05-08T18:34:52.646217+0000","last_clean_scrub_stamp":"2024-05-08T18:34:52.646217+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:59.267706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:49.823572+0000","last_change":"2024-05-08T18:34:49.823601+0000","last_active":"2024-05-08T18:34:49.823572+0000","last_peered":"2024-05-08T18:34:49.823572+0000","last_clean":"2024-05-08T18:34:49.823572+0000","last_became_active":"2024-05-08T18:30:58.306545+0000","last_became_peered":"2024-05-08T18:30:58.306545+0000","last_unstale":"2024-05-08T18:34:49.823572+0000","last_undegraded":"2024-05-08T18:34:49.823572+0000","last_fullsized":"2024-05-08T18:34:49.823572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:49.823481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:49.823481+0000","last_clean_scrub_stamp":"2024-05-08T18:34:49.823481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:44.587517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'16","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:56.719741+0000","last_change":"2024-05-08T18:34:56.719785+0000","last_active":"2024-05-08T18:34:56.719741+0000","last_peered":"2024-05-08T18:34:56.719741+0000","last_clean":"2024-05-08T18:34:56.719741+0000","last_became_active":"2024-05-08T18:31:00.283048+0000","last_became_peered":"2024-05-08T18:31:00.283048+0000","last_unstale":"2024-05-08T18:34:56.719741+0000","last_undegraded":"2024-05-08T18:34:56.719741+0000","last_fullsized":"2024-05-08T18:34:56.719741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T18:34:56.719626+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T18:34:56.719626+0000","last_clean_scrub_stamp":"2024-05-08T18:34:56.719626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:52.054400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:05.812246+0000","last_change":"2024-05-08T18:35:05.812269+0000","last_active":"2024-05-08T18:35:05.812246+0000","last_peered":"2024-05-08T18:35:05.812246+0000","last_clean":"2024-05-08T18:35:05.812246+0000","last_became_active":"2024-05-08T18:30:58.302245+0000","last_became_peered":"2024-05-08T18:30:58.302245+0000","last_unstale":"2024-05-08T18:35:05.812246+0000","last_undegraded":"2024-05-08T18:35:05.812246+0000","last_fullsized":"2024-05-08T18:35:05.812246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:05.812147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:05.812147+0000","last_clean_scrub_stamp":"2024-05-08T18:35:05.812147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:59.880065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.203096+0000","last_change":"2024-05-08T18:31:45.338509+0000","last_active":"2024-05-08T18:34:07.203096+0000","last_peered":"2024-05-08T18:34:07.203096+0000","last_clean":"2024-05-08T18:34:07.203096+0000","last_became_active":"2024-05-08T18:31:45.338192+0000","last_became_peered":"2024-05-08T18:31:45.338192+0000","last_unstale":"2024-05-08T18:34:07.203096+0000","last_undegraded":"2024-05-08T18:34:07.203096+0000","last_fullsized":"2024-05-08T18:34:07.203096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:55.692820+0000","last_change":"2024-05-08T18:34:55.692849+0000","last_active":"2024-05-08T18:34:55.692820+0000","last_peered":"2024-05-08T18:34:55.692820+0000","last_clean":"2024-05-08T18:34:55.692820+0000","last_became_active":"2024-05-08T18:30:58.304222+0000","last_became_peered":"2024-05-08T18:30:58.304222+0000","last_unstale":"2024-05-08T18:34:55.692820+0000","last_undegraded":"2024-05-08T18:34:55.692820+0000","last_fullsized":"2024-05-08T18:34:55.692820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:55.692727+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:55.692727+0000","last_clean_scrub_stamp":"2024-05-08T18:34:55.692727+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:35.252735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"27'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:06.897466+0000","last_change":"2024-05-08T18:35:06.897509+0000","last_active":"2024-05-08T18:35:06.897466+0000","last_peered":"2024-05-08T18:35:06.897466+0000","last_clean":"2024-05-08T18:35:06.897466+0000","last_became_active":"2024-05-08T18:31:00.295990+0000","last_became_peered":"2024-05-08T18:31:00.295990+0000","last_unstale":"2024-05-08T18:35:06.897466+0000","last_undegraded":"2024-05-08T18:35:06.897466+0000","last_fullsized":"2024-05-08T18:35:06.897466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:35:06.897377+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:35:06.897377+0000","last_clean_scrub_stamp":"2024-05-08T18:35:06.897377+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:08.737527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:05.742297+0000","last_change":"2024-05-08T18:35:05.742326+0000","last_active":"2024-05-08T18:35:05.742297+0000","last_peered":"2024-05-08T18:35:05.742297+0000","last_clean":"2024-05-08T18:35:05.742297+0000","last_became_active":"2024-05-08T18:30:58.283821+0000","last_became_peered":"2024-05-08T18:30:58.283821+0000","last_unstale":"2024-05-08T18:35:05.742297+0000","last_undegraded":"2024-05-08T18:35:05.742297+0000","last_fullsized":"2024-05-08T18:35:05.742297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:05.742198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:05.742198+0000","last_clean_scrub_stamp":"2024-05-08T18:35:05.742198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:23.572628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:48.577008+0000","last_change":"2024-05-08T18:34:48.577045+0000","last_active":"2024-05-08T18:34:48.577008+0000","last_peered":"2024-05-08T18:34:48.577008+0000","last_clean":"2024-05-08T18:34:48.577008+0000","last_became_active":"2024-05-08T18:31:00.280827+0000","last_became_peered":"2024-05-08T18:31:00.280827+0000","last_unstale":"2024-05-08T18:34:48.577008+0000","last_undegraded":"2024-05-08T18:34:48.577008+0000","last_fullsized":"2024-05-08T18:34:48.577008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:48.576925+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:48.576925+0000","last_clean_scrub_stamp":"2024-05-08T18:34:48.576925+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:44.850249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.179492+0000","last_change":"2024-05-08T18:30:58.306076+0000","last_active":"2024-05-08T18:33:18.179492+0000","last_peered":"2024-05-08T18:33:18.179492+0000","last_clean":"2024-05-08T18:33:18.179492+0000","last_became_active":"2024-05-08T18:30:58.305571+0000","last_became_peered":"2024-05-08T18:30:58.305571+0000","last_unstale":"2024-05-08T18:33:18.179492+0000","last_undegraded":"2024-05-08T18:33:18.179492+0000","last_fullsized":"2024-05-08T18:33:18.179492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.292012+0000","last_change":"2024-05-08T18:31:08.318466+0000","last_active":"2024-05-08T18:34:07.292012+0000","last_peered":"2024-05-08T18:34:07.292012+0000","last_clean":"2024-05-08T18:34:07.292012+0000","last_became_active":"2024-05-08T18:31:08.318181+0000","last_became_peered":"2024-05-08T18:31:08.318181+0000","last_unstale":"2024-05-08T18:34:07.292012+0000","last_undegraded":"2024-05-08T18:34:07.292012+0000","last_fullsized":"2024-05-08T18:34:07.292012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'12","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:57.319629+0000","last_change":"2024-05-08T18:34:57.319658+0000","last_active":"2024-05-08T18:34:57.319629+0000","last_peered":"2024-05-08T18:34:57.319629+0000","last_clean":"2024-05-08T18:34:57.319629+0000","last_became_active":"2024-05-08T18:31:00.296160+0000","last_became_peered":"2024-05-08T18:31:00.296160+0000","last_unstale":"2024-05-08T18:34:57.319629+0000","last_undegraded":"2024-05-08T18:34:57.319629+0000","last_fullsized":"2024-05-08T18:34:57.319629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:57.319548+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:57.319548+0000","last_clean_scrub_stamp":"2024-05-08T18:34:57.319548+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:19.261625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:09.370027+0000","last_change":"2024-05-08T18:35:09.370064+0000","last_active":"2024-05-08T18:35:09.370027+0000","last_peered":"2024-05-08T18:35:09.370027+0000","last_clean":"2024-05-08T18:35:09.370027+0000","last_became_active":"2024-05-08T18:30:58.315246+0000","last_became_peered":"2024-05-08T18:30:58.315246+0000","last_unstale":"2024-05-08T18:35:09.370027+0000","last_undegraded":"2024-05-08T18:35:09.370027+0000","last_fullsized":"2024-05-08T18:35:09.370027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:09.369913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:09.369913+0000","last_clean_scrub_stamp":"2024-05-08T18:35:09.369913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:01.660528+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.660068+0000","last_change":"2024-05-08T18:34:23.660113+0000","last_active":"2024-05-08T18:34:23.660068+0000","last_peered":"2024-05-08T18:34:23.660068+0000","last_clean":"2024-05-08T18:34:23.660068+0000","last_became_active":"2024-05-08T18:31:02.290465+0000","last_became_peered":"2024-05-08T18:31:02.290465+0000","last_unstale":"2024-05-08T18:34:23.660068+0000","last_undegraded":"2024-05-08T18:34:23.660068+0000","last_fullsized":"2024-05-08T18:34:23.660068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:23.659943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:23.659943+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.659943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:25.967513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:43.420662+0000","last_change":"2024-05-08T18:34:43.420702+0000","last_active":"2024-05-08T18:34:43.420662+0000","last_peered":"2024-05-08T18:34:43.420662+0000","last_clean":"2024-05-08T18:34:43.420662+0000","last_became_active":"2024-05-08T18:31:04.303815+0000","last_became_peered":"2024-05-08T18:31:04.303815+0000","last_unstale":"2024-05-08T18:34:43.420662+0000","last_undegraded":"2024-05-08T18:34:43.420662+0000","last_fullsized":"2024-05-08T18:34:43.420662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:43.420568+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:43.420568+0000","last_clean_scrub_stamp":"2024-05-08T18:34:43.420568+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:05.585424+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.889107+0000","last_change":"2024-05-08T18:34:24.889148+0000","last_active":"2024-05-08T18:34:24.889107+0000","last_peered":"2024-05-08T18:34:24.889107+0000","last_clean":"2024-05-08T18:34:24.889107+0000","last_became_active":"2024-05-08T18:31:06.310555+0000","last_became_peered":"2024-05-08T18:31:06.310555+0000","last_unstale":"2024-05-08T18:34:24.889107+0000","last_undegraded":"2024-05-08T18:34:24.889107+0000","last_fullsized":"2024-05-08T18:34:24.889107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:24.889019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:24.889019+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.889019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:06.963972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.181420+0000","last_change":"2024-05-08T18:31:08.319311+0000","last_active":"2024-05-08T18:33:33.181420+0000","last_peered":"2024-05-08T18:33:33.181420+0000","last_clean":"2024-05-08T18:33:33.181420+0000","last_became_active":"2024-05-08T18:31:08.319009+0000","last_became_peered":"2024-05-08T18:31:08.319009+0000","last_unstale":"2024-05-08T18:33:33.181420+0000","last_undegraded":"2024-05-08T18:33:33.181420+0000","last_fullsized":"2024-05-08T18:33:33.181420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:39.555342+0000","last_change":"2024-05-08T18:34:39.555368+0000","last_active":"2024-05-08T18:34:39.555342+0000","last_peered":"2024-05-08T18:34:39.555342+0000","last_clean":"2024-05-08T18:34:39.555342+0000","last_became_active":"2024-05-08T18:31:00.297497+0000","last_became_peered":"2024-05-08T18:31:00.297497+0000","last_unstale":"2024-05-08T18:34:39.555342+0000","last_undegraded":"2024-05-08T18:34:39.555342+0000","last_fullsized":"2024-05-08T18:34:39.555342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:34:39.555243+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:34:39.555243+0000","last_clean_scrub_stamp":"2024-05-08T18:34:39.555243+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:16.257470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:00.888978+0000","last_change":"2024-05-08T18:35:00.889004+0000","last_active":"2024-05-08T18:35:00.888978+0000","last_peered":"2024-05-08T18:35:00.888978+0000","last_clean":"2024-05-08T18:35:00.888978+0000","last_became_active":"2024-05-08T18:30:58.299649+0000","last_became_peered":"2024-05-08T18:30:58.299649+0000","last_unstale":"2024-05-08T18:35:00.888978+0000","last_undegraded":"2024-05-08T18:35:00.888978+0000","last_fullsized":"2024-05-08T18:35:00.888978+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:00.888891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:00.888891+0000","last_clean_scrub_stamp":"2024-05-08T18:35:00.888891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:32.791953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"29'2","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:35.582295+0000","last_change":"2024-05-08T18:34:35.582330+0000","last_active":"2024-05-08T18:34:35.582295+0000","last_peered":"2024-05-08T18:34:35.582295+0000","last_clean":"2024-05-08T18:34:35.582295+0000","last_became_active":"2024-05-08T18:31:02.293993+0000","last_became_peered":"2024-05-08T18:31:02.293993+0000","last_unstale":"2024-05-08T18:34:35.582295+0000","last_undegraded":"2024-05-08T18:34:35.582295+0000","last_fullsized":"2024-05-08T18:34:35.582295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:35.582207+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:35.582207+0000","last_clean_scrub_stamp":"2024-05-08T18:34:35.582207+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:12.476691+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'10","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.907482+0000","last_change":"2024-05-08T18:34:23.907510+0000","last_active":"2024-05-08T18:34:23.907482+0000","last_peered":"2024-05-08T18:34:23.907482+0000","last_clean":"2024-05-08T18:34:23.907482+0000","last_became_active":"2024-05-08T18:31:04.300059+0000","last_became_peered":"2024-05-08T18:31:04.300059+0000","last_unstale":"2024-05-08T18:34:23.907482+0000","last_undegraded":"2024-05-08T18:34:23.907482+0000","last_fullsized":"2024-05-08T18:34:23.907482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:23.907379+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:23.907379+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.907379+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:16.891137+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.722083+0000","last_change":"2024-05-08T18:34:32.722108+0000","last_active":"2024-05-08T18:34:32.722083+0000","last_peered":"2024-05-08T18:34:32.722083+0000","last_clean":"2024-05-08T18:34:32.722083+0000","last_became_active":"2024-05-08T18:31:06.312651+0000","last_became_peered":"2024-05-08T18:31:06.312651+0000","last_unstale":"2024-05-08T18:34:32.722083+0000","last_undegraded":"2024-05-08T18:34:32.722083+0000","last_fullsized":"2024-05-08T18:34:32.722083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:32.721992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:32.721992+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.721992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:27.698590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:45.631065+0000","last_change":"2024-05-08T18:34:45.631098+0000","last_active":"2024-05-08T18:34:45.631065+0000","last_peered":"2024-05-08T18:34:45.631065+0000","last_clean":"2024-05-08T18:34:45.631065+0000","last_became_active":"2024-05-08T18:31:08.311048+0000","last_became_peered":"2024-05-08T18:31:08.311048+0000","last_unstale":"2024-05-08T18:34:45.631065+0000","last_undegraded":"2024-05-08T18:34:45.631065+0000","last_fullsized":"2024-05-08T18:34:45.631065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:45.630966+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:45.630966+0000","last_clean_scrub_stamp":"2024-05-08T18:34:45.630966+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:57.506022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:56.366418+0000","last_change":"2024-05-08T18:34:56.366442+0000","last_active":"2024-05-08T18:34:56.366418+0000","last_peered":"2024-05-08T18:34:56.366418+0000","last_clean":"2024-05-08T18:34:56.366418+0000","last_became_active":"2024-05-08T18:31:00.296176+0000","last_became_peered":"2024-05-08T18:31:00.296176+0000","last_unstale":"2024-05-08T18:34:56.366418+0000","last_undegraded":"2024-05-08T18:34:56.366418+0000","last_fullsized":"2024-05-08T18:34:56.366418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:56.366327+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:56.366327+0000","last_clean_scrub_stamp":"2024-05-08T18:34:56.366327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:16.210517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.179441+0000","last_change":"2024-05-08T18:30:58.310108+0000","last_active":"2024-05-08T18:33:18.179441+0000","last_peered":"2024-05-08T18:33:18.179441+0000","last_clean":"2024-05-08T18:33:18.179441+0000","last_became_active":"2024-05-08T18:30:58.309339+0000","last_became_peered":"2024-05-08T18:30:58.309339+0000","last_unstale":"2024-05-08T18:33:18.179441+0000","last_undegraded":"2024-05-08T18:33:18.179441+0000","last_fullsized":"2024-05-08T18:33:18.179441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:10.919269+0000","last_change":"2024-05-08T18:35:10.919291+0000","last_active":"2024-05-08T18:35:10.919269+0000","last_peered":"2024-05-08T18:35:10.919269+0000","last_clean":"2024-05-08T18:35:10.919269+0000","last_became_active":"2024-05-08T18:31:45.335489+0000","last_became_peered":"2024-05-08T18:31:45.335489+0000","last_unstale":"2024-05-08T18:35:10.919269+0000","last_undegraded":"2024-05-08T18:35:10.919269+0000","last_fullsized":"2024-05-08T18:35:10.919269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:10.919188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:10.919188+0000","last_clean_scrub_stamp":"2024-05-08T18:35:10.919188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:39.522232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'16","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.718300+0000","last_change":"2024-05-08T18:34:29.718370+0000","last_active":"2024-05-08T18:34:29.718300+0000","last_peered":"2024-05-08T18:34:29.718300+0000","last_clean":"2024-05-08T18:34:29.718300+0000","last_became_active":"2024-05-08T18:31:04.300022+0000","last_became_peered":"2024-05-08T18:31:04.300022+0000","last_unstale":"2024-05-08T18:34:29.718300+0000","last_undegraded":"2024-05-08T18:34:29.718300+0000","last_fullsized":"2024-05-08T18:34:29.718300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T18:34:29.718201+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T18:34:29.718201+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.718201+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:19.939460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'285","reported_seq":402,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:40.541175+0000","last_change":"2024-05-08T18:34:40.541202+0000","last_active":"2024-05-08T18:34:40.541175+0000","last_peered":"2024-05-08T18:34:40.541175+0000","last_clean":"2024-05-08T18:34:40.541175+0000","last_became_active":"2024-05-08T18:31:06.306886+0000","last_became_peered":"2024-05-08T18:31:06.306886+0000","last_unstale":"2024-05-08T18:34:40.541175+0000","last_undegraded":"2024-05-08T18:34:40.541175+0000","last_fullsized":"2024-05-08T18:34:40.541175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:40.541078+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:40.541078+0000","last_clean_scrub_stamp":"2024-05-08T18:34:40.541078+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:11:57.055230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:08.958587+0000","last_change":"2024-05-08T18:35:08.958615+0000","last_active":"2024-05-08T18:35:08.958587+0000","last_peered":"2024-05-08T18:35:08.958587+0000","last_clean":"2024-05-08T18:35:08.958587+0000","last_became_active":"2024-05-08T18:31:08.311780+0000","last_became_peered":"2024-05-08T18:31:08.311780+0000","last_unstale":"2024-05-08T18:35:08.958587+0000","last_undegraded":"2024-05-08T18:35:08.958587+0000","last_fullsized":"2024-05-08T18:35:08.958587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:08.958503+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:08.958503+0000","last_clean_scrub_stamp":"2024-05-08T18:35:08.958503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:45.660730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:47.606707+0000","last_change":"2024-05-08T18:34:47.606735+0000","last_active":"2024-05-08T18:34:47.606707+0000","last_peered":"2024-05-08T18:34:47.606707+0000","last_clean":"2024-05-08T18:34:47.606707+0000","last_became_active":"2024-05-08T18:31:00.281268+0000","last_became_peered":"2024-05-08T18:31:00.281268+0000","last_unstale":"2024-05-08T18:34:47.606707+0000","last_undegraded":"2024-05-08T18:34:47.606707+0000","last_fullsized":"2024-05-08T18:34:47.606707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:34:47.606608+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:34:47.606608+0000","last_clean_scrub_stamp":"2024-05-08T18:34:47.606608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:22:11.586979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:51.636588+0000","last_change":"2024-05-08T18:34:51.636616+0000","last_active":"2024-05-08T18:34:51.636588+0000","last_peered":"2024-05-08T18:34:51.636588+0000","last_clean":"2024-05-08T18:34:51.636588+0000","last_became_active":"2024-05-08T18:30:58.303428+0000","last_became_peered":"2024-05-08T18:30:58.303428+0000","last_unstale":"2024-05-08T18:34:51.636588+0000","last_undegraded":"2024-05-08T18:34:51.636588+0000","last_fullsized":"2024-05-08T18:34:51.636588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:51.636503+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:51.636503+0000","last_clean_scrub_stamp":"2024-05-08T18:34:51.636503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:33.197546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.686239+0000","last_change":"2024-05-08T18:34:20.686287+0000","last_active":"2024-05-08T18:34:20.686239+0000","last_peered":"2024-05-08T18:34:20.686239+0000","last_clean":"2024-05-08T18:34:20.686239+0000","last_became_active":"2024-05-08T18:31:02.291729+0000","last_became_peered":"2024-05-08T18:31:02.291729+0000","last_unstale":"2024-05-08T18:34:20.686239+0000","last_undegraded":"2024-05-08T18:34:20.686239+0000","last_fullsized":"2024-05-08T18:34:20.686239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:20.686141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:20.686141+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.686141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:15.450176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.681287+0000","last_change":"2024-05-08T18:34:25.681329+0000","last_active":"2024-05-08T18:34:25.681287+0000","last_peered":"2024-05-08T18:34:25.681287+0000","last_clean":"2024-05-08T18:34:25.681287+0000","last_became_active":"2024-05-08T18:31:04.304347+0000","last_became_peered":"2024-05-08T18:31:04.304347+0000","last_unstale":"2024-05-08T18:34:25.681287+0000","last_undegraded":"2024-05-08T18:34:25.681287+0000","last_fullsized":"2024-05-08T18:34:25.681287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:25.681197+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:25.681197+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.681197+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:06.403836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.709773+0000","last_change":"2024-05-08T18:34:22.709806+0000","last_active":"2024-05-08T18:34:22.709773+0000","last_peered":"2024-05-08T18:34:22.709773+0000","last_clean":"2024-05-08T18:34:22.709773+0000","last_became_active":"2024-05-08T18:31:06.305591+0000","last_became_peered":"2024-05-08T18:31:06.305591+0000","last_unstale":"2024-05-08T18:34:22.709773+0000","last_undegraded":"2024-05-08T18:34:22.709773+0000","last_fullsized":"2024-05-08T18:34:22.709773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:22.709682+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:22.709682+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.709682+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:04.769028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'10","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:05.305605+0000","last_change":"2024-05-08T18:35:05.305632+0000","last_active":"2024-05-08T18:35:05.305605+0000","last_peered":"2024-05-08T18:35:05.305605+0000","last_clean":"2024-05-08T18:35:05.305605+0000","last_became_active":"2024-05-08T18:31:00.290824+0000","last_became_peered":"2024-05-08T18:31:00.290824+0000","last_unstale":"2024-05-08T18:35:05.305605+0000","last_undegraded":"2024-05-08T18:35:05.305605+0000","last_fullsized":"2024-05-08T18:35:05.305605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:35:05.305518+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:35:05.305518+0000","last_clean_scrub_stamp":"2024-05-08T18:35:05.305518+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:25.824273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:01.846007+0000","last_change":"2024-05-08T18:35:01.846057+0000","last_active":"2024-05-08T18:35:01.846007+0000","last_peered":"2024-05-08T18:35:01.846007+0000","last_clean":"2024-05-08T18:35:01.846007+0000","last_became_active":"2024-05-08T18:30:58.300884+0000","last_became_peered":"2024-05-08T18:30:58.300884+0000","last_unstale":"2024-05-08T18:35:01.846007+0000","last_undegraded":"2024-05-08T18:35:01.846007+0000","last_fullsized":"2024-05-08T18:35:01.846007+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:01.845907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:01.845907+0000","last_clean_scrub_stamp":"2024-05-08T18:35:01.845907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:08.467397+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.781964+0000","last_change":"2024-05-08T18:34:29.781989+0000","last_active":"2024-05-08T18:34:29.781964+0000","last_peered":"2024-05-08T18:34:29.781964+0000","last_clean":"2024-05-08T18:34:29.781964+0000","last_became_active":"2024-05-08T18:31:02.291536+0000","last_became_peered":"2024-05-08T18:31:02.291536+0000","last_unstale":"2024-05-08T18:34:29.781964+0000","last_undegraded":"2024-05-08T18:34:29.781964+0000","last_fullsized":"2024-05-08T18:34:29.781964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:29.781874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:29.781874+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.781874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:12.430820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'52","reported_seq":112,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.726338+0000","last_change":"2024-05-08T18:34:27.726388+0000","last_active":"2024-05-08T18:34:27.726338+0000","last_peered":"2024-05-08T18:34:27.726338+0000","last_clean":"2024-05-08T18:34:27.726338+0000","last_became_active":"2024-05-08T18:31:04.302455+0000","last_became_peered":"2024-05-08T18:31:04.302455+0000","last_unstale":"2024-05-08T18:34:27.726338+0000","last_undegraded":"2024-05-08T18:34:27.726338+0000","last_fullsized":"2024-05-08T18:34:27.726338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'52","last_scrub_stamp":"2024-05-08T18:34:27.726254+0000","last_deep_scrub":"29'52","last_deep_scrub_stamp":"2024-05-08T18:34:27.726254+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.726254+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:57.760805+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.615602+0000","last_change":"2024-05-08T18:34:24.615646+0000","last_active":"2024-05-08T18:34:24.615602+0000","last_peered":"2024-05-08T18:34:24.615602+0000","last_clean":"2024-05-08T18:34:24.615602+0000","last_became_active":"2024-05-08T18:31:06.304979+0000","last_became_peered":"2024-05-08T18:31:06.304979+0000","last_unstale":"2024-05-08T18:34:24.615602+0000","last_undegraded":"2024-05-08T18:34:24.615602+0000","last_fullsized":"2024-05-08T18:34:24.615602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:24.615505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:24.615505+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.615505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:06.690459+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:07.918318+0000","last_change":"2024-05-08T18:35:07.918347+0000","last_active":"2024-05-08T18:35:07.918318+0000","last_peered":"2024-05-08T18:35:07.918318+0000","last_clean":"2024-05-08T18:35:07.918318+0000","last_became_active":"2024-05-08T18:31:08.311434+0000","last_became_peered":"2024-05-08T18:31:08.311434+0000","last_unstale":"2024-05-08T18:35:07.918318+0000","last_undegraded":"2024-05-08T18:35:07.918318+0000","last_fullsized":"2024-05-08T18:35:07.918318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T18:35:07.918233+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T18:35:07.918233+0000","last_clean_scrub_stamp":"2024-05-08T18:35:07.918233+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:20.603001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:49.625721+0000","last_change":"2024-05-08T18:34:49.625755+0000","last_active":"2024-05-08T18:34:49.625721+0000","last_peered":"2024-05-08T18:34:49.625721+0000","last_clean":"2024-05-08T18:34:49.625721+0000","last_became_active":"2024-05-08T18:31:00.280969+0000","last_became_peered":"2024-05-08T18:31:00.280969+0000","last_unstale":"2024-05-08T18:34:49.625721+0000","last_undegraded":"2024-05-08T18:34:49.625721+0000","last_fullsized":"2024-05-08T18:34:49.625721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:49.625593+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:49.625593+0000","last_clean_scrub_stamp":"2024-05-08T18:34:49.625593+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:50.500448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:04.885581+0000","last_change":"2024-05-08T18:35:04.885607+0000","last_active":"2024-05-08T18:35:04.885581+0000","last_peered":"2024-05-08T18:35:04.885581+0000","last_clean":"2024-05-08T18:35:04.885581+0000","last_became_active":"2024-05-08T18:30:58.302590+0000","last_became_peered":"2024-05-08T18:30:58.302590+0000","last_unstale":"2024-05-08T18:35:04.885581+0000","last_undegraded":"2024-05-08T18:35:04.885581+0000","last_fullsized":"2024-05-08T18:35:04.885581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:04.885481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:04.885481+0000","last_clean_scrub_stamp":"2024-05-08T18:35:04.885481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:41.364341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:42.569371+0000","last_change":"2024-05-08T18:34:42.569395+0000","last_active":"2024-05-08T18:34:42.569371+0000","last_peered":"2024-05-08T18:34:42.569371+0000","last_clean":"2024-05-08T18:34:42.569371+0000","last_became_active":"2024-05-08T18:31:02.289394+0000","last_became_peered":"2024-05-08T18:31:02.289394+0000","last_unstale":"2024-05-08T18:34:42.569371+0000","last_undegraded":"2024-05-08T18:34:42.569371+0000","last_fullsized":"2024-05-08T18:34:42.569371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:42.569274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:42.569274+0000","last_clean_scrub_stamp":"2024-05-08T18:34:42.569274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:44.876844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'38","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:45.366976+0000","last_change":"2024-05-08T18:34:45.367013+0000","last_active":"2024-05-08T18:34:45.366976+0000","last_peered":"2024-05-08T18:34:45.366976+0000","last_clean":"2024-05-08T18:34:45.366976+0000","last_became_active":"2024-05-08T18:31:04.302886+0000","last_became_peered":"2024-05-08T18:31:04.302886+0000","last_unstale":"2024-05-08T18:34:45.366976+0000","last_undegraded":"2024-05-08T18:34:45.366976+0000","last_fullsized":"2024-05-08T18:34:45.366976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-08T18:34:45.366871+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-08T18:34:45.366871+0000","last_clean_scrub_stamp":"2024-05-08T18:34:45.366871+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:13.940428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.644103+0000","last_change":"2024-05-08T18:34:19.644132+0000","last_active":"2024-05-08T18:34:19.644103+0000","last_peered":"2024-05-08T18:34:19.644103+0000","last_clean":"2024-05-08T18:34:19.644103+0000","last_became_active":"2024-05-08T18:31:06.306607+0000","last_became_peered":"2024-05-08T18:31:06.306607+0000","last_unstale":"2024-05-08T18:34:19.644103+0000","last_undegraded":"2024-05-08T18:34:19.644103+0000","last_fullsized":"2024-05-08T18:34:19.644103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:19.644005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:19.644005+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.644005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:04:00.192002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:36.713752+0000","last_change":"2024-05-08T18:34:36.713780+0000","last_active":"2024-05-08T18:34:36.713752+0000","last_peered":"2024-05-08T18:34:36.713752+0000","last_clean":"2024-05-08T18:34:36.713752+0000","last_became_active":"2024-05-08T18:31:08.305127+0000","last_became_peered":"2024-05-08T18:31:08.305127+0000","last_unstale":"2024-05-08T18:34:36.713752+0000","last_undegraded":"2024-05-08T18:34:36.713752+0000","last_fullsized":"2024-05-08T18:34:36.713752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:36.713654+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:36.713654+0000","last_clean_scrub_stamp":"2024-05-08T18:34:36.713654+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:58.222971+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:52.890720+0000","last_change":"2024-05-08T18:34:52.890746+0000","last_active":"2024-05-08T18:34:52.890720+0000","last_peered":"2024-05-08T18:34:52.890720+0000","last_clean":"2024-05-08T18:34:52.890720+0000","last_became_active":"2024-05-08T18:31:00.293170+0000","last_became_peered":"2024-05-08T18:31:00.293170+0000","last_unstale":"2024-05-08T18:34:52.890720+0000","last_undegraded":"2024-05-08T18:34:52.890720+0000","last_fullsized":"2024-05-08T18:34:52.890720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:52.890630+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:52.890630+0000","last_clean_scrub_stamp":"2024-05-08T18:34:52.890630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:55.198199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178671+0000","last_change":"2024-05-08T18:30:58.316505+0000","last_active":"2024-05-08T18:33:13.178671+0000","last_peered":"2024-05-08T18:33:13.178671+0000","last_clean":"2024-05-08T18:33:13.178671+0000","last_became_active":"2024-05-08T18:30:58.314352+0000","last_became_peered":"2024-05-08T18:30:58.314352+0000","last_unstale":"2024-05-08T18:33:13.178671+0000","last_undegraded":"2024-05-08T18:33:13.178671+0000","last_fullsized":"2024-05-08T18:33:13.178671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:11.876148+0000","last_change":"2024-05-08T18:35:11.876173+0000","last_active":"2024-05-08T18:35:11.876148+0000","last_peered":"2024-05-08T18:35:11.876148+0000","last_clean":"2024-05-08T18:35:11.876148+0000","last_became_active":"2024-05-08T18:31:45.339423+0000","last_became_peered":"2024-05-08T18:31:45.339423+0000","last_unstale":"2024-05-08T18:35:11.876148+0000","last_undegraded":"2024-05-08T18:35:11.876148+0000","last_fullsized":"2024-05-08T18:35:11.876148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:11.876047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:11.876047+0000","last_clean_scrub_stamp":"2024-05-08T18:35:11.876047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:49.524641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.605942+0000","last_change":"2024-05-08T18:34:32.606003+0000","last_active":"2024-05-08T18:34:32.605942+0000","last_peered":"2024-05-08T18:34:32.605942+0000","last_clean":"2024-05-08T18:34:32.605942+0000","last_became_active":"2024-05-08T18:31:04.298026+0000","last_became_peered":"2024-05-08T18:31:04.298026+0000","last_unstale":"2024-05-08T18:34:32.605942+0000","last_undegraded":"2024-05-08T18:34:32.605942+0000","last_fullsized":"2024-05-08T18:34:32.605942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T18:34:32.605858+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T18:34:32.605858+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.605858+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:39.227348+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":366,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.673032+0000","last_change":"2024-05-08T18:34:18.673057+0000","last_active":"2024-05-08T18:34:18.673032+0000","last_peered":"2024-05-08T18:34:18.673032+0000","last_clean":"2024-05-08T18:34:18.673032+0000","last_became_active":"2024-05-08T18:31:06.306655+0000","last_became_peered":"2024-05-08T18:31:06.306655+0000","last_unstale":"2024-05-08T18:34:18.673032+0000","last_undegraded":"2024-05-08T18:34:18.673032+0000","last_fullsized":"2024-05-08T18:34:18.673032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:18.672962+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:18.672962+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.672962+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:15.669294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178617+0000","last_change":"2024-05-08T18:31:08.314593+0000","last_active":"2024-05-08T18:33:18.178617+0000","last_peered":"2024-05-08T18:33:18.178617+0000","last_clean":"2024-05-08T18:33:18.178617+0000","last_became_active":"2024-05-08T18:31:08.314273+0000","last_became_peered":"2024-05-08T18:31:08.314273+0000","last_unstale":"2024-05-08T18:33:18.178617+0000","last_undegraded":"2024-05-08T18:33:18.178617+0000","last_fullsized":"2024-05-08T18:33:18.178617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:44.889160+0000","last_change":"2024-05-08T18:34:44.889203+0000","last_active":"2024-05-08T18:34:44.889160+0000","last_peered":"2024-05-08T18:34:44.889160+0000","last_clean":"2024-05-08T18:34:44.889160+0000","last_became_active":"2024-05-08T18:31:00.282941+0000","last_became_peered":"2024-05-08T18:31:00.282941+0000","last_unstale":"2024-05-08T18:34:44.889160+0000","last_undegraded":"2024-05-08T18:34:44.889160+0000","last_fullsized":"2024-05-08T18:34:44.889160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:44.889056+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:44.889056+0000","last_clean_scrub_stamp":"2024-05-08T18:34:44.889056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:44:35.228659+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178604+0000","last_change":"2024-05-08T18:30:58.316967+0000","last_active":"2024-05-08T18:33:13.178604+0000","last_peered":"2024-05-08T18:33:13.178604+0000","last_clean":"2024-05-08T18:33:13.178604+0000","last_became_active":"2024-05-08T18:30:58.313431+0000","last_became_peered":"2024-05-08T18:30:58.313431+0000","last_unstale":"2024-05-08T18:33:13.178604+0000","last_undegraded":"2024-05-08T18:33:13.178604+0000","last_fullsized":"2024-05-08T18:33:13.178604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:40.577730+0000","last_change":"2024-05-08T18:34:40.577762+0000","last_active":"2024-05-08T18:34:40.577730+0000","last_peered":"2024-05-08T18:34:40.577730+0000","last_clean":"2024-05-08T18:34:40.577730+0000","last_became_active":"2024-05-08T18:31:02.289669+0000","last_became_peered":"2024-05-08T18:31:02.289669+0000","last_unstale":"2024-05-08T18:34:40.577730+0000","last_undegraded":"2024-05-08T18:34:40.577730+0000","last_fullsized":"2024-05-08T18:34:40.577730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:40.577639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:40.577639+0000","last_clean_scrub_stamp":"2024-05-08T18:34:40.577639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:06.519788+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'67","reported_seq":140,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:48.381000+0000","last_change":"2024-05-08T18:34:48.381040+0000","last_active":"2024-05-08T18:34:48.381000+0000","last_peered":"2024-05-08T18:34:48.381000+0000","last_clean":"2024-05-08T18:34:48.381000+0000","last_became_active":"2024-05-08T18:31:04.302244+0000","last_became_peered":"2024-05-08T18:31:04.302244+0000","last_unstale":"2024-05-08T18:34:48.381000+0000","last_undegraded":"2024-05-08T18:34:48.381000+0000","last_fullsized":"2024-05-08T18:34:48.381000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'67","last_scrub_stamp":"2024-05-08T18:34:48.380911+0000","last_deep_scrub":"29'67","last_deep_scrub_stamp":"2024-05-08T18:34:48.380911+0000","last_clean_scrub_stamp":"2024-05-08T18:34:48.380911+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:33.160250+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.686336+0000","last_change":"2024-05-08T18:34:21.686381+0000","last_active":"2024-05-08T18:34:21.686336+0000","last_peered":"2024-05-08T18:34:21.686336+0000","last_clean":"2024-05-08T18:34:21.686336+0000","last_became_active":"2024-05-08T18:31:06.308806+0000","last_became_peered":"2024-05-08T18:31:06.308806+0000","last_unstale":"2024-05-08T18:34:21.686336+0000","last_undegraded":"2024-05-08T18:34:21.686336+0000","last_fullsized":"2024-05-08T18:34:21.686336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:21.686225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:21.686225+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.686225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:12.963774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.384919+0000","last_change":"2024-05-08T18:31:08.319703+0000","last_active":"2024-05-08T18:34:07.384919+0000","last_peered":"2024-05-08T18:34:07.384919+0000","last_clean":"2024-05-08T18:34:07.384919+0000","last_became_active":"2024-05-08T18:31:08.319370+0000","last_became_peered":"2024-05-08T18:31:08.319370+0000","last_unstale":"2024-05-08T18:34:07.384919+0000","last_undegraded":"2024-05-08T18:34:07.384919+0000","last_fullsized":"2024-05-08T18:34:07.384919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'6","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:42.729020+0000","last_change":"2024-05-08T18:34:42.729045+0000","last_active":"2024-05-08T18:34:42.729020+0000","last_peered":"2024-05-08T18:34:42.729020+0000","last_clean":"2024-05-08T18:34:42.729020+0000","last_became_active":"2024-05-08T18:31:00.292154+0000","last_became_peered":"2024-05-08T18:31:00.292154+0000","last_unstale":"2024-05-08T18:34:42.729020+0000","last_undegraded":"2024-05-08T18:34:42.729020+0000","last_fullsized":"2024-05-08T18:34:42.729020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:42.728933+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:42.728933+0000","last_clean_scrub_stamp":"2024-05-08T18:34:42.728933+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:45.036503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:54.775318+0000","last_change":"2024-05-08T18:34:54.775346+0000","last_active":"2024-05-08T18:34:54.775318+0000","last_peered":"2024-05-08T18:34:54.775318+0000","last_clean":"2024-05-08T18:34:54.775318+0000","last_became_active":"2024-05-08T18:30:58.294377+0000","last_became_peered":"2024-05-08T18:30:58.294377+0000","last_unstale":"2024-05-08T18:34:54.775318+0000","last_undegraded":"2024-05-08T18:34:54.775318+0000","last_fullsized":"2024-05-08T18:34:54.775318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:54.775224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:54.775224+0000","last_clean_scrub_stamp":"2024-05-08T18:34:54.775224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:43:21.245618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:35.836892+0000","last_change":"2024-05-08T18:34:35.836915+0000","last_active":"2024-05-08T18:34:35.836892+0000","last_peered":"2024-05-08T18:34:35.836892+0000","last_clean":"2024-05-08T18:34:35.836892+0000","last_became_active":"2024-05-08T18:31:02.293680+0000","last_became_peered":"2024-05-08T18:31:02.293680+0000","last_unstale":"2024-05-08T18:34:35.836892+0000","last_undegraded":"2024-05-08T18:34:35.836892+0000","last_fullsized":"2024-05-08T18:34:35.836892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:35.836803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:35.836803+0000","last_clean_scrub_stamp":"2024-05-08T18:34:35.836803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:43:05.540412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'40","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.864211+0000","last_change":"2024-05-08T18:34:22.864247+0000","last_active":"2024-05-08T18:34:22.864211+0000","last_peered":"2024-05-08T18:34:22.864211+0000","last_clean":"2024-05-08T18:34:22.864211+0000","last_became_active":"2024-05-08T18:31:04.301147+0000","last_became_peered":"2024-05-08T18:31:04.301147+0000","last_unstale":"2024-05-08T18:34:22.864211+0000","last_undegraded":"2024-05-08T18:34:22.864211+0000","last_fullsized":"2024-05-08T18:34:22.864211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-08T18:34:22.864124+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-08T18:34:22.864124+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.864124+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:04.923471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:50.411251+0000","last_change":"2024-05-08T18:34:50.411290+0000","last_active":"2024-05-08T18:34:50.411251+0000","last_peered":"2024-05-08T18:34:50.411251+0000","last_clean":"2024-05-08T18:34:50.411251+0000","last_became_active":"2024-05-08T18:31:06.308804+0000","last_became_peered":"2024-05-08T18:31:06.308804+0000","last_unstale":"2024-05-08T18:34:50.411251+0000","last_undegraded":"2024-05-08T18:34:50.411251+0000","last_fullsized":"2024-05-08T18:34:50.411251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:50.411147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:50.411147+0000","last_clean_scrub_stamp":"2024-05-08T18:34:50.411147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:30.290258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.285520+0000","last_change":"2024-05-08T18:31:08.320629+0000","last_active":"2024-05-08T18:34:18.285520+0000","last_peered":"2024-05-08T18:34:18.285520+0000","last_clean":"2024-05-08T18:34:18.285520+0000","last_became_active":"2024-05-08T18:31:08.320150+0000","last_became_peered":"2024-05-08T18:31:08.320150+0000","last_unstale":"2024-05-08T18:34:18.285520+0000","last_undegraded":"2024-05-08T18:34:18.285520+0000","last_fullsized":"2024-05-08T18:34:18.285520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'4","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.629660+0000","last_change":"2024-05-08T18:34:31.629691+0000","last_active":"2024-05-08T18:34:31.629660+0000","last_peered":"2024-05-08T18:34:31.629660+0000","last_clean":"2024-05-08T18:34:31.629660+0000","last_became_active":"2024-05-08T18:31:00.299379+0000","last_became_peered":"2024-05-08T18:31:00.299379+0000","last_unstale":"2024-05-08T18:34:31.629660+0000","last_undegraded":"2024-05-08T18:34:31.629660+0000","last_fullsized":"2024-05-08T18:34:31.629660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:31.629577+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:31.629577+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.629577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:03.532639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177806+0000","last_change":"2024-05-08T18:30:58.316845+0000","last_active":"2024-05-08T18:33:08.177806+0000","last_peered":"2024-05-08T18:33:08.177806+0000","last_clean":"2024-05-08T18:33:08.177806+0000","last_became_active":"2024-05-08T18:30:58.315625+0000","last_became_peered":"2024-05-08T18:30:58.315625+0000","last_unstale":"2024-05-08T18:33:08.177806+0000","last_undegraded":"2024-05-08T18:33:08.177806+0000","last_fullsized":"2024-05-08T18:33:08.177806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:39.588566+0000","last_change":"2024-05-08T18:34:39.588620+0000","last_active":"2024-05-08T18:34:39.588566+0000","last_peered":"2024-05-08T18:34:39.588566+0000","last_clean":"2024-05-08T18:34:39.588566+0000","last_became_active":"2024-05-08T18:31:02.289767+0000","last_became_peered":"2024-05-08T18:31:02.289767+0000","last_unstale":"2024-05-08T18:34:39.588566+0000","last_undegraded":"2024-05-08T18:34:39.588566+0000","last_fullsized":"2024-05-08T18:34:39.588566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:39.588473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:39.588473+0000","last_clean_scrub_stamp":"2024-05-08T18:34:39.588473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:21.718736+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.740564+0000","last_change":"2024-05-08T18:34:31.740604+0000","last_active":"2024-05-08T18:34:31.740564+0000","last_peered":"2024-05-08T18:34:31.740564+0000","last_clean":"2024-05-08T18:34:31.740564+0000","last_became_active":"2024-05-08T18:31:04.294573+0000","last_became_peered":"2024-05-08T18:31:04.294573+0000","last_unstale":"2024-05-08T18:34:31.740564+0000","last_undegraded":"2024-05-08T18:34:31.740564+0000","last_fullsized":"2024-05-08T18:34:31.740564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T18:34:31.740471+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T18:34:31.740471+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.740471+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:36.592489+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":442,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.729935+0000","last_change":"2024-05-08T18:34:28.729967+0000","last_active":"2024-05-08T18:34:28.729935+0000","last_peered":"2024-05-08T18:34:28.729935+0000","last_clean":"2024-05-08T18:34:28.729935+0000","last_became_active":"2024-05-08T18:31:06.312203+0000","last_became_peered":"2024-05-08T18:31:06.312203+0000","last_unstale":"2024-05-08T18:34:28.729935+0000","last_undegraded":"2024-05-08T18:34:28.729935+0000","last_fullsized":"2024-05-08T18:34:28.729935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:28.729835+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:28.729835+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.729835+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:42.916625+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'14","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.339077+0000","last_change":"2024-05-08T18:31:08.314495+0000","last_active":"2024-05-08T18:34:07.339077+0000","last_peered":"2024-05-08T18:34:07.339077+0000","last_clean":"2024-05-08T18:34:07.339077+0000","last_became_active":"2024-05-08T18:31:08.314171+0000","last_became_peered":"2024-05-08T18:31:08.314171+0000","last_unstale":"2024-05-08T18:34:07.339077+0000","last_undegraded":"2024-05-08T18:34:07.339077+0000","last_fullsized":"2024-05-08T18:34:07.339077+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:50.816803+0000","last_change":"2024-05-08T18:34:50.816833+0000","last_active":"2024-05-08T18:34:50.816803+0000","last_peered":"2024-05-08T18:34:50.816803+0000","last_clean":"2024-05-08T18:34:50.816803+0000","last_became_active":"2024-05-08T18:31:00.292521+0000","last_became_peered":"2024-05-08T18:31:00.292521+0000","last_unstale":"2024-05-08T18:34:50.816803+0000","last_undegraded":"2024-05-08T18:34:50.816803+0000","last_fullsized":"2024-05-08T18:34:50.816803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:50.816688+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:50.816688+0000","last_clean_scrub_stamp":"2024-05-08T18:34:50.816688+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:09.188418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:12.318551+0000","last_change":"2024-05-08T18:35:12.318580+0000","last_active":"2024-05-08T18:35:12.318551+0000","last_peered":"2024-05-08T18:35:12.318551+0000","last_clean":"2024-05-08T18:35:12.318551+0000","last_became_active":"2024-05-08T18:30:58.309773+0000","last_became_peered":"2024-05-08T18:30:58.309773+0000","last_unstale":"2024-05-08T18:35:12.318551+0000","last_undegraded":"2024-05-08T18:35:12.318551+0000","last_fullsized":"2024-05-08T18:35:12.318551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:12.318456+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:12.318456+0000","last_clean_scrub_stamp":"2024-05-08T18:35:12.318456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:58:49.908816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'5","reported_seq":428,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.729392+0000","last_change":"2024-05-08T18:34:31.729420+0000","last_active":"2024-05-08T18:34:31.729392+0000","last_peered":"2024-05-08T18:34:31.729392+0000","last_clean":"2024-05-08T18:34:31.729392+0000","last_became_active":"2024-05-08T18:31:02.289253+0000","last_became_peered":"2024-05-08T18:31:02.289253+0000","last_unstale":"2024-05-08T18:34:31.729392+0000","last_undegraded":"2024-05-08T18:34:31.729392+0000","last_fullsized":"2024-05-08T18:34:31.729392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T18:34:31.729298+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T18:34:31.729298+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.729298+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:22.601345+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:44.374109+0000","last_change":"2024-05-08T18:34:44.374141+0000","last_active":"2024-05-08T18:34:44.374109+0000","last_peered":"2024-05-08T18:34:44.374109+0000","last_clean":"2024-05-08T18:34:44.374109+0000","last_became_active":"2024-05-08T18:31:04.303799+0000","last_became_peered":"2024-05-08T18:31:04.303799+0000","last_unstale":"2024-05-08T18:34:44.374109+0000","last_undegraded":"2024-05-08T18:34:44.374109+0000","last_fullsized":"2024-05-08T18:34:44.374109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T18:34:44.374025+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T18:34:44.374025+0000","last_clean_scrub_stamp":"2024-05-08T18:34:44.374025+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:13:06.326093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":471,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.900060+0000","last_change":"2024-05-08T18:34:18.900106+0000","last_active":"2024-05-08T18:34:18.900060+0000","last_peered":"2024-05-08T18:34:18.900060+0000","last_clean":"2024-05-08T18:34:18.900060+0000","last_became_active":"2024-05-08T18:31:06.305201+0000","last_became_peered":"2024-05-08T18:31:06.305201+0000","last_unstale":"2024-05-08T18:34:18.900060+0000","last_undegraded":"2024-05-08T18:34:18.900060+0000","last_fullsized":"2024-05-08T18:34:18.900060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:18.899957+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:18.899957+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.899957+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:33.086747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:40.831044+0000","last_change":"2024-05-08T18:34:40.831088+0000","last_active":"2024-05-08T18:34:40.831044+0000","last_peered":"2024-05-08T18:34:40.831044+0000","last_clean":"2024-05-08T18:34:40.831044+0000","last_became_active":"2024-05-08T18:31:08.310906+0000","last_became_peered":"2024-05-08T18:31:08.310906+0000","last_unstale":"2024-05-08T18:34:40.831044+0000","last_undegraded":"2024-05-08T18:34:40.831044+0000","last_fullsized":"2024-05-08T18:34:40.831044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:40.830900+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:40.830900+0000","last_clean_scrub_stamp":"2024-05-08T18:34:40.830900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:40.154817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'14","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:43.689136+0000","last_change":"2024-05-08T18:34:43.689169+0000","last_active":"2024-05-08T18:34:43.689136+0000","last_peered":"2024-05-08T18:34:43.689136+0000","last_clean":"2024-05-08T18:34:43.689136+0000","last_became_active":"2024-05-08T18:31:00.291563+0000","last_became_peered":"2024-05-08T18:31:00.291563+0000","last_unstale":"2024-05-08T18:34:43.689136+0000","last_undegraded":"2024-05-08T18:34:43.689136+0000","last_fullsized":"2024-05-08T18:34:43.689136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-08T18:34:43.689041+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-08T18:34:43.689041+0000","last_clean_scrub_stamp":"2024-05-08T18:34:43.689041+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:40.499135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177725+0000","last_change":"2024-05-08T18:30:58.304032+0000","last_active":"2024-05-08T18:33:08.177725+0000","last_peered":"2024-05-08T18:33:08.177725+0000","last_clean":"2024-05-08T18:33:08.177725+0000","last_became_active":"2024-05-08T18:30:58.302966+0000","last_became_peered":"2024-05-08T18:30:58.302966+0000","last_unstale":"2024-05-08T18:33:08.177725+0000","last_undegraded":"2024-05-08T18:33:08.177725+0000","last_fullsized":"2024-05-08T18:33:08.177725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.676566+0000","last_change":"2024-05-08T18:34:28.676588+0000","last_active":"2024-05-08T18:34:28.676566+0000","last_peered":"2024-05-08T18:34:28.676566+0000","last_clean":"2024-05-08T18:34:28.676566+0000","last_became_active":"2024-05-08T18:31:02.288232+0000","last_became_peered":"2024-05-08T18:31:02.288232+0000","last_unstale":"2024-05-08T18:34:28.676566+0000","last_undegraded":"2024-05-08T18:34:28.676566+0000","last_fullsized":"2024-05-08T18:34:28.676566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:28.676467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:28.676467+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.676467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:08.488393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'48","reported_seq":107,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.893918+0000","last_change":"2024-05-08T18:34:19.893987+0000","last_active":"2024-05-08T18:34:19.893918+0000","last_peered":"2024-05-08T18:34:19.893918+0000","last_clean":"2024-05-08T18:34:19.893918+0000","last_became_active":"2024-05-08T18:31:04.301298+0000","last_became_peered":"2024-05-08T18:31:04.301298+0000","last_unstale":"2024-05-08T18:34:19.893918+0000","last_undegraded":"2024-05-08T18:34:19.893918+0000","last_fullsized":"2024-05-08T18:34:19.893918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-05-08T18:34:19.893818+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-05-08T18:34:19.893818+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.893818+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:10.115077+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.544426+0000","last_change":"2024-05-08T18:34:18.544453+0000","last_active":"2024-05-08T18:34:18.544426+0000","last_peered":"2024-05-08T18:34:18.544426+0000","last_clean":"2024-05-08T18:34:18.544426+0000","last_became_active":"2024-05-08T18:31:06.310430+0000","last_became_peered":"2024-05-08T18:31:06.310430+0000","last_unstale":"2024-05-08T18:34:18.544426+0000","last_undegraded":"2024-05-08T18:34:18.544426+0000","last_fullsized":"2024-05-08T18:34:18.544426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:18.544327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:18.544327+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.544327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:32.447203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'7","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:40.709835+0000","last_change":"2024-05-08T18:34:40.709867+0000","last_active":"2024-05-08T18:34:40.709835+0000","last_peered":"2024-05-08T18:34:40.709835+0000","last_clean":"2024-05-08T18:34:40.709835+0000","last_became_active":"2024-05-08T18:31:08.306492+0000","last_became_peered":"2024-05-08T18:31:08.306492+0000","last_unstale":"2024-05-08T18:34:40.709835+0000","last_undegraded":"2024-05-08T18:34:40.709835+0000","last_fullsized":"2024-05-08T18:34:40.709835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T18:34:40.709748+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T18:34:40.709748+0000","last_clean_scrub_stamp":"2024-05-08T18:34:40.709748+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:06.651897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'6","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:33.577031+0000","last_change":"2024-05-08T18:34:33.577031+0000","last_active":"2024-05-08T18:34:33.577031+0000","last_peered":"2024-05-08T18:34:33.577031+0000","last_clean":"2024-05-08T18:34:33.577031+0000","last_became_active":"2024-05-08T18:31:00.299186+0000","last_became_peered":"2024-05-08T18:31:00.299186+0000","last_unstale":"2024-05-08T18:34:33.577031+0000","last_undegraded":"2024-05-08T18:34:33.577031+0000","last_fullsized":"2024-05-08T18:34:33.577031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:33.576927+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:33.576927+0000","last_clean_scrub_stamp":"2024-05-08T18:34:33.576927+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:41.675591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'74","reported_seq":149,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:02.747774+0000","last_change":"2024-05-08T18:35:02.747810+0000","last_active":"2024-05-08T18:35:02.747774+0000","last_peered":"2024-05-08T18:35:02.747774+0000","last_clean":"2024-05-08T18:35:02.747774+0000","last_became_active":"2024-05-08T18:30:49.981852+0000","last_became_peered":"2024-05-08T18:30:49.981852+0000","last_unstale":"2024-05-08T18:35:02.747774+0000","last_undegraded":"2024-05-08T18:35:02.747774+0000","last_fullsized":"2024-05-08T18:35:02.747774+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'74","last_scrub_stamp":"2024-05-08T18:35:02.747676+0000","last_deep_scrub":"29'74","last_deep_scrub_stamp":"2024-05-08T18:35:02.747676+0000","last_clean_scrub_stamp":"2024-05-08T18:35:02.747676+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:50.713376+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.284159+0000","last_change":"2024-05-08T18:30:49.983387+0000","last_active":"2024-05-08T18:34:18.284159+0000","last_peered":"2024-05-08T18:34:18.284159+0000","last_clean":"2024-05-08T18:34:18.284159+0000","last_became_active":"2024-05-08T18:30:49.983023+0000","last_became_peered":"2024-05-08T18:30:49.983023+0000","last_unstale":"2024-05-08T18:34:18.284159+0000","last_undegraded":"2024-05-08T18:34:18.284159+0000","last_fullsized":"2024-05-08T18:34:18.284159+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.284225+0000","last_change":"2024-05-08T18:30:58.317086+0000","last_active":"2024-05-08T18:34:18.284225+0000","last_peered":"2024-05-08T18:34:18.284225+0000","last_clean":"2024-05-08T18:34:18.284225+0000","last_became_active":"2024-05-08T18:30:58.316676+0000","last_became_peered":"2024-05-08T18:30:58.316676+0000","last_unstale":"2024-05-08T18:34:18.284225+0000","last_undegraded":"2024-05-08T18:34:18.284225+0000","last_fullsized":"2024-05-08T18:34:18.284225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:17.361897+0000","last_change":"2024-05-08T18:31:45.339419+0000","last_active":"2024-05-08T18:34:17.361897+0000","last_peered":"2024-05-08T18:34:17.361897+0000","last_clean":"2024-05-08T18:34:17.361897+0000","last_became_active":"2024-05-08T18:31:45.339007+0000","last_became_peered":"2024-05-08T18:31:45.339007+0000","last_unstale":"2024-05-08T18:34:17.361897+0000","last_undegraded":"2024-05-08T18:34:17.361897+0000","last_fullsized":"2024-05-08T18:34:17.361897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:01.269269+0000","last_clean_scrub_stamp":"2024-05-08T18:31:01.269269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'87","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:38.512085+0000","last_change":"2024-05-08T18:34:38.512120+0000","last_active":"2024-05-08T18:34:38.512085+0000","last_peered":"2024-05-08T18:34:38.512085+0000","last_clean":"2024-05-08T18:34:38.512085+0000","last_became_active":"2024-05-08T18:31:04.299145+0000","last_became_peered":"2024-05-08T18:31:04.299145+0000","last_unstale":"2024-05-08T18:34:38.512085+0000","last_undegraded":"2024-05-08T18:34:38.512085+0000","last_fullsized":"2024-05-08T18:34:38.512085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-08T18:34:38.511998+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-08T18:34:38.511998+0000","last_clean_scrub_stamp":"2024-05-08T18:34:38.511998+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:35:51.196766+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:33.515814+0000","last_change":"2024-05-08T18:34:33.515836+0000","last_active":"2024-05-08T18:34:33.515814+0000","last_peered":"2024-05-08T18:34:33.515814+0000","last_clean":"2024-05-08T18:34:33.515814+0000","last_became_active":"2024-05-08T18:31:06.311742+0000","last_became_peered":"2024-05-08T18:31:06.311742+0000","last_unstale":"2024-05-08T18:34:33.515814+0000","last_undegraded":"2024-05-08T18:34:33.515814+0000","last_fullsized":"2024-05-08T18:34:33.515814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:33.515721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:33.515721+0000","last_clean_scrub_stamp":"2024-05-08T18:34:33.515721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:27.574406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'87","reported_seq":179,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:36.847453+0000","last_change":"2024-05-08T18:34:36.847497+0000","last_active":"2024-05-08T18:34:36.847453+0000","last_peered":"2024-05-08T18:34:36.847453+0000","last_clean":"2024-05-08T18:34:36.847453+0000","last_became_active":"2024-05-08T18:31:08.310715+0000","last_became_peered":"2024-05-08T18:31:08.310715+0000","last_unstale":"2024-05-08T18:34:36.847453+0000","last_undegraded":"2024-05-08T18:34:36.847453+0000","last_fullsized":"2024-05-08T18:34:36.847453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-08T18:34:36.847334+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-08T18:34:36.847334+0000","last_clean_scrub_stamp":"2024-05-08T18:34:36.847334+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:13.088821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":173,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'12","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:00.304502+0000","last_change":"2024-05-08T18:35:00.304543+0000","last_active":"2024-05-08T18:35:00.304502+0000","last_peered":"2024-05-08T18:35:00.304502+0000","last_clean":"2024-05-08T18:35:00.304502+0000","last_became_active":"2024-05-08T18:31:00.295578+0000","last_became_peered":"2024-05-08T18:31:00.295578+0000","last_unstale":"2024-05-08T18:35:00.304502+0000","last_undegraded":"2024-05-08T18:35:00.304502+0000","last_fullsized":"2024-05-08T18:35:00.304502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:35:00.304389+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:35:00.304389+0000","last_clean_scrub_stamp":"2024-05-08T18:35:00.304389+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:10.730098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.284173+0000","last_change":"2024-05-08T18:30:49.983190+0000","last_active":"2024-05-08T18:34:18.284173+0000","last_peered":"2024-05-08T18:34:18.284173+0000","last_clean":"2024-05-08T18:34:18.284173+0000","last_became_active":"2024-05-08T18:30:49.982854+0000","last_became_peered":"2024-05-08T18:30:49.982854+0000","last_unstale":"2024-05-08T18:34:18.284173+0000","last_undegraded":"2024-05-08T18:34:18.284173+0000","last_fullsized":"2024-05-08T18:34:18.284173+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:50.687618+0000","last_change":"2024-05-08T18:34:50.687618+0000","last_active":"2024-05-08T18:34:50.687618+0000","last_peered":"2024-05-08T18:34:50.687618+0000","last_clean":"2024-05-08T18:34:50.687618+0000","last_became_active":"2024-05-08T18:30:58.294153+0000","last_became_peered":"2024-05-08T18:30:58.294153+0000","last_unstale":"2024-05-08T18:34:50.687618+0000","last_undegraded":"2024-05-08T18:34:50.687618+0000","last_fullsized":"2024-05-08T18:34:50.687618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:50.687422+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:50.687422+0000","last_clean_scrub_stamp":"2024-05-08T18:34:50.687422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:13.071573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.642307+0000","last_change":"2024-05-08T18:34:19.642347+0000","last_active":"2024-05-08T18:34:19.642307+0000","last_peered":"2024-05-08T18:34:19.642307+0000","last_clean":"2024-05-08T18:34:19.642307+0000","last_became_active":"2024-05-08T18:31:02.291979+0000","last_became_peered":"2024-05-08T18:31:02.291979+0000","last_unstale":"2024-05-08T18:34:19.642307+0000","last_undegraded":"2024-05-08T18:34:19.642307+0000","last_fullsized":"2024-05-08T18:34:19.642307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:19.642214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:19.642214+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.642214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:44.702640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'291","reported_seq":516,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.858095+0000","last_change":"2024-05-08T18:34:25.858141+0000","last_active":"2024-05-08T18:34:25.858095+0000","last_peered":"2024-05-08T18:34:25.858095+0000","last_clean":"2024-05-08T18:34:25.858095+0000","last_became_active":"2024-05-08T18:31:04.299494+0000","last_became_peered":"2024-05-08T18:31:04.299494+0000","last_unstale":"2024-05-08T18:34:25.858095+0000","last_undegraded":"2024-05-08T18:34:25.858095+0000","last_fullsized":"2024-05-08T18:34:25.858095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'291","last_scrub_stamp":"2024-05-08T18:34:25.858006+0000","last_deep_scrub":"29'291","last_deep_scrub_stamp":"2024-05-08T18:34:25.858006+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.858006+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:00.713371+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:41.505255+0000","last_change":"2024-05-08T18:34:41.505277+0000","last_active":"2024-05-08T18:34:41.505255+0000","last_peered":"2024-05-08T18:34:41.505255+0000","last_clean":"2024-05-08T18:34:41.505255+0000","last_became_active":"2024-05-08T18:31:06.306554+0000","last_became_peered":"2024-05-08T18:31:06.306554+0000","last_unstale":"2024-05-08T18:34:41.505255+0000","last_undegraded":"2024-05-08T18:34:41.505255+0000","last_fullsized":"2024-05-08T18:34:41.505255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:41.505127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:41.505127+0000","last_clean_scrub_stamp":"2024-05-08T18:34:41.505127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:29.470827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:12.700256+0000","last_change":"2024-05-08T18:35:12.700281+0000","last_active":"2024-05-08T18:35:12.700256+0000","last_peered":"2024-05-08T18:35:12.700256+0000","last_clean":"2024-05-08T18:35:12.700256+0000","last_became_active":"2024-05-08T18:31:08.316536+0000","last_became_peered":"2024-05-08T18:31:08.316536+0000","last_unstale":"2024-05-08T18:35:12.700256+0000","last_undegraded":"2024-05-08T18:35:12.700256+0000","last_fullsized":"2024-05-08T18:35:12.700256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T18:35:12.700165+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T18:35:12.700165+0000","last_clean_scrub_stamp":"2024-05-08T18:35:12.700165+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:38:06.882396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'12","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:49.663169+0000","last_change":"2024-05-08T18:34:49.663199+0000","last_active":"2024-05-08T18:34:49.663169+0000","last_peered":"2024-05-08T18:34:49.663169+0000","last_clean":"2024-05-08T18:34:49.663169+0000","last_became_active":"2024-05-08T18:31:00.281359+0000","last_became_peered":"2024-05-08T18:31:00.281359+0000","last_unstale":"2024-05-08T18:34:49.663169+0000","last_undegraded":"2024-05-08T18:34:49.663169+0000","last_fullsized":"2024-05-08T18:34:49.663169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:49.663075+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:49.663075+0000","last_clean_scrub_stamp":"2024-05-08T18:34:49.663075+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:42.088380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:58.815500+0000","last_change":"2024-05-08T18:34:58.815524+0000","last_active":"2024-05-08T18:34:58.815500+0000","last_peered":"2024-05-08T18:34:58.815500+0000","last_clean":"2024-05-08T18:34:58.815500+0000","last_became_active":"2024-05-08T18:30:49.982438+0000","last_became_peered":"2024-05-08T18:30:49.982438+0000","last_unstale":"2024-05-08T18:34:58.815500+0000","last_undegraded":"2024-05-08T18:34:58.815500+0000","last_fullsized":"2024-05-08T18:34:58.815500+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:58.815417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:58.815417+0000","last_clean_scrub_stamp":"2024-05-08T18:34:58.815417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:19.949858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:56.776237+0000","last_change":"2024-05-08T18:34:56.776237+0000","last_active":"2024-05-08T18:34:56.776237+0000","last_peered":"2024-05-08T18:34:56.776237+0000","last_clean":"2024-05-08T18:34:56.776237+0000","last_became_active":"2024-05-08T18:30:58.294292+0000","last_became_peered":"2024-05-08T18:30:58.294292+0000","last_unstale":"2024-05-08T18:34:56.776237+0000","last_undegraded":"2024-05-08T18:34:56.776237+0000","last_fullsized":"2024-05-08T18:34:56.776237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:56.776056+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:56.776056+0000","last_clean_scrub_stamp":"2024-05-08T18:34:56.776056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:32.295347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:39.826438+0000","last_change":"2024-05-08T18:34:39.826486+0000","last_active":"2024-05-08T18:34:39.826438+0000","last_peered":"2024-05-08T18:34:39.826438+0000","last_clean":"2024-05-08T18:34:39.826438+0000","last_became_active":"2024-05-08T18:31:02.291806+0000","last_became_peered":"2024-05-08T18:31:02.291806+0000","last_unstale":"2024-05-08T18:34:39.826438+0000","last_undegraded":"2024-05-08T18:34:39.826438+0000","last_fullsized":"2024-05-08T18:34:39.826438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:39.826333+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:39.826333+0000","last_clean_scrub_stamp":"2024-05-08T18:34:39.826333+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:07.772048+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.698631+0000","last_change":"2024-05-08T18:34:26.698673+0000","last_active":"2024-05-08T18:34:26.698631+0000","last_peered":"2024-05-08T18:34:26.698631+0000","last_clean":"2024-05-08T18:34:26.698631+0000","last_became_active":"2024-05-08T18:31:04.303321+0000","last_became_peered":"2024-05-08T18:31:04.303321+0000","last_unstale":"2024-05-08T18:34:26.698631+0000","last_undegraded":"2024-05-08T18:34:26.698631+0000","last_fullsized":"2024-05-08T18:34:26.698631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-05-08T18:34:26.698537+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-05-08T18:34:26.698537+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.698537+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:44.151622+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.566377+0000","last_change":"2024-05-08T18:34:25.566404+0000","last_active":"2024-05-08T18:34:25.566377+0000","last_peered":"2024-05-08T18:34:25.566377+0000","last_clean":"2024-05-08T18:34:25.566377+0000","last_became_active":"2024-05-08T18:31:06.309525+0000","last_became_peered":"2024-05-08T18:31:06.309525+0000","last_unstale":"2024-05-08T18:34:25.566377+0000","last_undegraded":"2024-05-08T18:34:25.566377+0000","last_fullsized":"2024-05-08T18:34:25.566377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:25.566280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:25.566280+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.566280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:00.421645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'8","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:02.261778+0000","last_change":"2024-05-08T18:35:02.261818+0000","last_active":"2024-05-08T18:35:02.261778+0000","last_peered":"2024-05-08T18:35:02.261778+0000","last_clean":"2024-05-08T18:35:02.261778+0000","last_became_active":"2024-05-08T18:31:08.314503+0000","last_became_peered":"2024-05-08T18:31:08.314503+0000","last_unstale":"2024-05-08T18:35:02.261778+0000","last_undegraded":"2024-05-08T18:35:02.261778+0000","last_fullsized":"2024-05-08T18:35:02.261778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:35:02.261651+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:35:02.261651+0000","last_clean_scrub_stamp":"2024-05-08T18:35:02.261651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:26.632114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'6","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:59.672032+0000","last_change":"2024-05-08T18:34:59.672032+0000","last_active":"2024-05-08T18:34:59.672032+0000","last_peered":"2024-05-08T18:34:59.672032+0000","last_clean":"2024-05-08T18:34:59.672032+0000","last_became_active":"2024-05-08T18:31:00.283410+0000","last_became_peered":"2024-05-08T18:31:00.283410+0000","last_unstale":"2024-05-08T18:34:59.672032+0000","last_undegraded":"2024-05-08T18:34:59.672032+0000","last_fullsized":"2024-05-08T18:34:59.672032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:59.671941+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:59.671941+0000","last_clean_scrub_stamp":"2024-05-08T18:34:59.671941+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:36.374168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.284159+0000","last_change":"2024-05-08T18:30:49.983911+0000","last_active":"2024-05-08T18:34:18.284159+0000","last_peered":"2024-05-08T18:34:18.284159+0000","last_clean":"2024-05-08T18:34:18.284159+0000","last_became_active":"2024-05-08T18:30:49.983515+0000","last_became_peered":"2024-05-08T18:30:49.983515+0000","last_unstale":"2024-05-08T18:34:18.284159+0000","last_undegraded":"2024-05-08T18:34:18.284159+0000","last_fullsized":"2024-05-08T18:34:18.284159+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:51.854795+0000","last_change":"2024-05-08T18:34:51.854795+0000","last_active":"2024-05-08T18:34:51.854795+0000","last_peered":"2024-05-08T18:34:51.854795+0000","last_clean":"2024-05-08T18:34:51.854795+0000","last_became_active":"2024-05-08T18:30:58.306268+0000","last_became_peered":"2024-05-08T18:30:58.306268+0000","last_unstale":"2024-05-08T18:34:51.854795+0000","last_undegraded":"2024-05-08T18:34:51.854795+0000","last_fullsized":"2024-05-08T18:34:51.854795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:51.854640+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:51.854640+0000","last_clean_scrub_stamp":"2024-05-08T18:34:51.854640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:08.246146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:36.627397+0000","last_change":"2024-05-08T18:34:36.627397+0000","last_active":"2024-05-08T18:34:36.627397+0000","last_peered":"2024-05-08T18:34:36.627397+0000","last_clean":"2024-05-08T18:34:36.627397+0000","last_became_active":"2024-05-08T18:31:02.292030+0000","last_became_peered":"2024-05-08T18:31:02.292030+0000","last_unstale":"2024-05-08T18:34:36.627397+0000","last_undegraded":"2024-05-08T18:34:36.627397+0000","last_fullsized":"2024-05-08T18:34:36.627397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:36.627276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:36.627276+0000","last_clean_scrub_stamp":"2024-05-08T18:34:36.627276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:58.136593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.698435+0000","last_change":"2024-05-08T18:34:24.698478+0000","last_active":"2024-05-08T18:34:24.698435+0000","last_peered":"2024-05-08T18:34:24.698435+0000","last_clean":"2024-05-08T18:34:24.698435+0000","last_became_active":"2024-05-08T18:31:04.296257+0000","last_became_peered":"2024-05-08T18:31:04.296257+0000","last_unstale":"2024-05-08T18:34:24.698435+0000","last_undegraded":"2024-05-08T18:34:24.698435+0000","last_fullsized":"2024-05-08T18:34:24.698435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-08T18:34:24.698350+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-08T18:34:24.698350+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.698350+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:44.670942+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:46.392962+0000","last_change":"2024-05-08T18:34:46.393005+0000","last_active":"2024-05-08T18:34:46.392962+0000","last_peered":"2024-05-08T18:34:46.392962+0000","last_clean":"2024-05-08T18:34:46.392962+0000","last_became_active":"2024-05-08T18:31:06.308892+0000","last_became_peered":"2024-05-08T18:31:06.308892+0000","last_unstale":"2024-05-08T18:34:46.392962+0000","last_undegraded":"2024-05-08T18:34:46.392962+0000","last_fullsized":"2024-05-08T18:34:46.392962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:46.392855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:46.392855+0000","last_clean_scrub_stamp":"2024-05-08T18:34:46.392855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:12.321949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.178889+0000","last_change":"2024-05-08T18:31:08.319035+0000","last_active":"2024-05-08T18:33:18.178889+0000","last_peered":"2024-05-08T18:33:18.178889+0000","last_clean":"2024-05-08T18:33:18.178889+0000","last_became_active":"2024-05-08T18:31:08.318728+0000","last_became_peered":"2024-05-08T18:31:08.318728+0000","last_unstale":"2024-05-08T18:33:18.178889+0000","last_undegraded":"2024-05-08T18:33:18.178889+0000","last_fullsized":"2024-05-08T18:33:18.178889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'3","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.328661+0000","last_change":"2024-05-08T18:31:45.344716+0000","last_active":"2024-05-08T18:34:07.328661+0000","last_peered":"2024-05-08T18:34:07.328661+0000","last_clean":"2024-05-08T18:34:07.328661+0000","last_became_active":"2024-05-08T18:31:45.337785+0000","last_became_peered":"2024-05-08T18:31:45.337785+0000","last_unstale":"2024-05-08T18:34:07.328661+0000","last_undegraded":"2024-05-08T18:34:07.328661+0000","last_fullsized":"2024-05-08T18:34:07.328661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:03.840567+0000","last_change":"2024-05-08T18:35:03.840567+0000","last_active":"2024-05-08T18:35:03.840567+0000","last_peered":"2024-05-08T18:35:03.840567+0000","last_clean":"2024-05-08T18:35:03.840567+0000","last_became_active":"2024-05-08T18:30:58.302328+0000","last_became_peered":"2024-05-08T18:30:58.302328+0000","last_unstale":"2024-05-08T18:35:03.840567+0000","last_undegraded":"2024-05-08T18:35:03.840567+0000","last_fullsized":"2024-05-08T18:35:03.840567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:03.840399+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:03.840399+0000","last_clean_scrub_stamp":"2024-05-08T18:35:03.840399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:23.927754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:04.757625+0000","last_change":"2024-05-08T18:35:04.757702+0000","last_active":"2024-05-08T18:35:04.757625+0000","last_peered":"2024-05-08T18:35:04.757625+0000","last_clean":"2024-05-08T18:35:04.757625+0000","last_became_active":"2024-05-08T18:30:49.983522+0000","last_became_peered":"2024-05-08T18:30:49.983522+0000","last_unstale":"2024-05-08T18:35:04.757625+0000","last_undegraded":"2024-05-08T18:35:04.757625+0000","last_fullsized":"2024-05-08T18:35:04.757625+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:04.757514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:04.757514+0000","last_clean_scrub_stamp":"2024-05-08T18:35:04.757514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:13:26.709582+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:34.565146+0000","last_change":"2024-05-08T18:34:34.565146+0000","last_active":"2024-05-08T18:34:34.565146+0000","last_peered":"2024-05-08T18:34:34.565146+0000","last_clean":"2024-05-08T18:34:34.565146+0000","last_became_active":"2024-05-08T18:31:02.294603+0000","last_became_peered":"2024-05-08T18:31:02.294603+0000","last_unstale":"2024-05-08T18:34:34.565146+0000","last_undegraded":"2024-05-08T18:34:34.565146+0000","last_fullsized":"2024-05-08T18:34:34.565146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-05-08T18:34:34.564981+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-05-08T18:34:34.564981+0000","last_clean_scrub_stamp":"2024-05-08T18:34:34.564981+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:44:24.904584+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'75","reported_seq":152,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.528098+0000","last_change":"2024-05-08T18:34:32.528098+0000","last_active":"2024-05-08T18:34:32.528098+0000","last_peered":"2024-05-08T18:34:32.528098+0000","last_clean":"2024-05-08T18:34:32.528098+0000","last_became_active":"2024-05-08T18:31:04.295090+0000","last_became_peered":"2024-05-08T18:31:04.295090+0000","last_unstale":"2024-05-08T18:34:32.528098+0000","last_undegraded":"2024-05-08T18:34:32.528098+0000","last_fullsized":"2024-05-08T18:34:32.528098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'75","last_scrub_stamp":"2024-05-08T18:34:32.527967+0000","last_deep_scrub":"29'75","last_deep_scrub_stamp":"2024-05-08T18:34:32.527967+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.527967+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:27.504565+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.653376+0000","last_change":"2024-05-08T18:34:24.653420+0000","last_active":"2024-05-08T18:34:24.653376+0000","last_peered":"2024-05-08T18:34:24.653376+0000","last_clean":"2024-05-08T18:34:24.653376+0000","last_became_active":"2024-05-08T18:31:06.312179+0000","last_became_peered":"2024-05-08T18:31:06.312179+0000","last_unstale":"2024-05-08T18:34:24.653376+0000","last_undegraded":"2024-05-08T18:34:24.653376+0000","last_fullsized":"2024-05-08T18:34:24.653376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:24.653263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:24.653263+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.653263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:54:11.402636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:41.580819+0000","last_change":"2024-05-08T18:34:41.580867+0000","last_active":"2024-05-08T18:34:41.580819+0000","last_peered":"2024-05-08T18:34:41.580819+0000","last_clean":"2024-05-08T18:34:41.580819+0000","last_became_active":"2024-05-08T18:31:08.304818+0000","last_became_peered":"2024-05-08T18:31:08.304818+0000","last_unstale":"2024-05-08T18:34:41.580819+0000","last_undegraded":"2024-05-08T18:34:41.580819+0000","last_fullsized":"2024-05-08T18:34:41.580819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-08T18:34:41.580713+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-08T18:34:41.580713+0000","last_clean_scrub_stamp":"2024-05-08T18:34:41.580713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.972218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'6","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:37.695951+0000","last_change":"2024-05-08T18:34:37.695951+0000","last_active":"2024-05-08T18:34:37.695951+0000","last_peered":"2024-05-08T18:34:37.695951+0000","last_clean":"2024-05-08T18:34:37.695951+0000","last_became_active":"2024-05-08T18:31:00.294157+0000","last_became_peered":"2024-05-08T18:31:00.294157+0000","last_unstale":"2024-05-08T18:34:37.695951+0000","last_undegraded":"2024-05-08T18:34:37.695951+0000","last_fullsized":"2024-05-08T18:34:37.695951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:37.695840+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:37.695840+0000","last_clean_scrub_stamp":"2024-05-08T18:34:37.695840+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:25.082640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:02.698114+0000","last_change":"2024-05-08T18:35:02.698114+0000","last_active":"2024-05-08T18:35:02.698114+0000","last_peered":"2024-05-08T18:35:02.698114+0000","last_clean":"2024-05-08T18:35:02.698114+0000","last_became_active":"2024-05-08T18:30:58.286578+0000","last_became_peered":"2024-05-08T18:30:58.286578+0000","last_unstale":"2024-05-08T18:35:02.698114+0000","last_undegraded":"2024-05-08T18:35:02.698114+0000","last_fullsized":"2024-05-08T18:35:02.698114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:02.697942+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:02.697942+0000","last_clean_scrub_stamp":"2024-05-08T18:35:02.697942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:40.346535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.284172+0000","last_change":"2024-05-08T18:30:49.982777+0000","last_active":"2024-05-08T18:34:18.284172+0000","last_peered":"2024-05-08T18:34:18.284172+0000","last_clean":"2024-05-08T18:34:18.284172+0000","last_became_active":"2024-05-08T18:30:49.982471+0000","last_became_peered":"2024-05-08T18:30:49.982471+0000","last_unstale":"2024-05-08T18:34:18.284172+0000","last_undegraded":"2024-05-08T18:34:18.284172+0000","last_fullsized":"2024-05-08T18:34:18.284172+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.702739+0000","last_change":"2024-05-08T18:34:27.702739+0000","last_active":"2024-05-08T18:34:27.702739+0000","last_peered":"2024-05-08T18:34:27.702739+0000","last_clean":"2024-05-08T18:34:27.702739+0000","last_became_active":"2024-05-08T18:31:02.287974+0000","last_became_peered":"2024-05-08T18:31:02.287974+0000","last_unstale":"2024-05-08T18:34:27.702739+0000","last_undegraded":"2024-05-08T18:34:27.702739+0000","last_fullsized":"2024-05-08T18:34:27.702739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:27.702607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:27.702607+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.702607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:19.640531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'22","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.906735+0000","last_change":"2024-05-08T18:34:21.906780+0000","last_active":"2024-05-08T18:34:21.906735+0000","last_peered":"2024-05-08T18:34:21.906735+0000","last_clean":"2024-05-08T18:34:21.906735+0000","last_became_active":"2024-05-08T18:31:04.301116+0000","last_became_peered":"2024-05-08T18:31:04.301116+0000","last_unstale":"2024-05-08T18:34:21.906735+0000","last_undegraded":"2024-05-08T18:34:21.906735+0000","last_fullsized":"2024-05-08T18:34:21.906735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-08T18:34:21.906639+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-08T18:34:21.906639+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.906639+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:13.184187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":387,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.878020+0000","last_change":"2024-05-08T18:34:20.878020+0000","last_active":"2024-05-08T18:34:20.878020+0000","last_peered":"2024-05-08T18:34:20.878020+0000","last_clean":"2024-05-08T18:34:20.878020+0000","last_became_active":"2024-05-08T18:31:06.308274+0000","last_became_peered":"2024-05-08T18:31:06.308274+0000","last_unstale":"2024-05-08T18:34:20.878020+0000","last_undegraded":"2024-05-08T18:34:20.878020+0000","last_fullsized":"2024-05-08T18:34:20.878020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:20.877846+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:20.877846+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.877846+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:15.946216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.180498+0000","last_change":"2024-05-08T18:31:08.318932+0000","last_active":"2024-05-08T18:33:23.180498+0000","last_peered":"2024-05-08T18:33:23.180498+0000","last_clean":"2024-05-08T18:33:23.180498+0000","last_became_active":"2024-05-08T18:31:08.318609+0000","last_became_peered":"2024-05-08T18:31:08.318609+0000","last_unstale":"2024-05-08T18:33:23.180498+0000","last_undegraded":"2024-05-08T18:33:23.180498+0000","last_fullsized":"2024-05-08T18:33:23.180498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:04.290347+0000","last_change":"2024-05-08T18:35:04.290371+0000","last_active":"2024-05-08T18:35:04.290347+0000","last_peered":"2024-05-08T18:35:04.290347+0000","last_clean":"2024-05-08T18:35:04.290347+0000","last_became_active":"2024-05-08T18:31:00.291093+0000","last_became_peered":"2024-05-08T18:31:00.291093+0000","last_unstale":"2024-05-08T18:35:04.290347+0000","last_undegraded":"2024-05-08T18:35:04.290347+0000","last_fullsized":"2024-05-08T18:35:04.290347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:04.290261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:04.290261+0000","last_clean_scrub_stamp":"2024-05-08T18:35:04.290261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:18.897471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177925+0000","last_change":"2024-05-08T18:30:58.306520+0000","last_active":"2024-05-08T18:33:08.177925+0000","last_peered":"2024-05-08T18:33:08.177925+0000","last_clean":"2024-05-08T18:33:08.177925+0000","last_became_active":"2024-05-08T18:30:58.305915+0000","last_became_peered":"2024-05-08T18:30:58.305915+0000","last_unstale":"2024-05-08T18:33:08.177925+0000","last_undegraded":"2024-05-08T18:33:08.177925+0000","last_fullsized":"2024-05-08T18:33:08.177925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:03.711951+0000","last_change":"2024-05-08T18:35:03.711951+0000","last_active":"2024-05-08T18:35:03.711951+0000","last_peered":"2024-05-08T18:35:03.711951+0000","last_clean":"2024-05-08T18:35:03.711951+0000","last_became_active":"2024-05-08T18:30:49.982330+0000","last_became_peered":"2024-05-08T18:30:49.982330+0000","last_unstale":"2024-05-08T18:35:03.711951+0000","last_undegraded":"2024-05-08T18:35:03.711951+0000","last_fullsized":"2024-05-08T18:35:03.711951+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:03.711830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:03.711830+0000","last_clean_scrub_stamp":"2024-05-08T18:35:03.711830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:44.102855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.649104+0000","last_change":"2024-05-08T18:34:18.649104+0000","last_active":"2024-05-08T18:34:18.649104+0000","last_peered":"2024-05-08T18:34:18.649104+0000","last_clean":"2024-05-08T18:34:18.649104+0000","last_became_active":"2024-05-08T18:31:02.292328+0000","last_became_peered":"2024-05-08T18:31:02.292328+0000","last_unstale":"2024-05-08T18:34:18.649104+0000","last_undegraded":"2024-05-08T18:34:18.649104+0000","last_fullsized":"2024-05-08T18:34:18.649104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:18.648949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:18.648949+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.648949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:06.035748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:47.396282+0000","last_change":"2024-05-08T18:34:47.396324+0000","last_active":"2024-05-08T18:34:47.396282+0000","last_peered":"2024-05-08T18:34:47.396282+0000","last_clean":"2024-05-08T18:34:47.396282+0000","last_became_active":"2024-05-08T18:31:04.302020+0000","last_became_peered":"2024-05-08T18:31:04.302020+0000","last_unstale":"2024-05-08T18:34:47.396282+0000","last_undegraded":"2024-05-08T18:34:47.396282+0000","last_fullsized":"2024-05-08T18:34:47.396282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T18:34:47.396183+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T18:34:47.396183+0000","last_clean_scrub_stamp":"2024-05-08T18:34:47.396183+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:55.696682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.664173+0000","last_change":"2024-05-08T18:34:23.664202+0000","last_active":"2024-05-08T18:34:23.664173+0000","last_peered":"2024-05-08T18:34:23.664173+0000","last_clean":"2024-05-08T18:34:23.664173+0000","last_became_active":"2024-05-08T18:31:06.305020+0000","last_became_peered":"2024-05-08T18:31:06.305020+0000","last_unstale":"2024-05-08T18:34:23.664173+0000","last_undegraded":"2024-05-08T18:34:23.664173+0000","last_fullsized":"2024-05-08T18:34:23.664173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:23.664078+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:23.664078+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.664078+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:16.647836+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:44.668213+0000","last_change":"2024-05-08T18:34:44.668260+0000","last_active":"2024-05-08T18:34:44.668213+0000","last_peered":"2024-05-08T18:34:44.668213+0000","last_clean":"2024-05-08T18:34:44.668213+0000","last_became_active":"2024-05-08T18:31:08.309869+0000","last_became_peered":"2024-05-08T18:31:08.309869+0000","last_unstale":"2024-05-08T18:34:44.668213+0000","last_undegraded":"2024-05-08T18:34:44.668213+0000","last_fullsized":"2024-05-08T18:34:44.668213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:34:44.668104+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:34:44.668104+0000","last_clean_scrub_stamp":"2024-05-08T18:34:44.668104+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:43.032453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:41.850994+0000","last_change":"2024-05-08T18:34:41.850994+0000","last_active":"2024-05-08T18:34:41.850994+0000","last_peered":"2024-05-08T18:34:41.850994+0000","last_clean":"2024-05-08T18:34:41.850994+0000","last_became_active":"2024-05-08T18:31:00.296431+0000","last_became_peered":"2024-05-08T18:31:00.296431+0000","last_unstale":"2024-05-08T18:34:41.850994+0000","last_undegraded":"2024-05-08T18:34:41.850994+0000","last_fullsized":"2024-05-08T18:34:41.850994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:41.850804+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:41.850804+0000","last_clean_scrub_stamp":"2024-05-08T18:34:41.850804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:26:55.361491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:08.785600+0000","last_change":"2024-05-08T18:35:08.785644+0000","last_active":"2024-05-08T18:35:08.785600+0000","last_peered":"2024-05-08T18:35:08.785600+0000","last_clean":"2024-05-08T18:35:08.785600+0000","last_became_active":"2024-05-08T18:30:58.303997+0000","last_became_peered":"2024-05-08T18:30:58.303997+0000","last_unstale":"2024-05-08T18:35:08.785600+0000","last_undegraded":"2024-05-08T18:35:08.785600+0000","last_fullsized":"2024-05-08T18:35:08.785600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:08.785470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:08.785470+0000","last_clean_scrub_stamp":"2024-05-08T18:35:08.785470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:40:17.085969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.284197+0000","last_change":"2024-05-08T18:30:49.984897+0000","last_active":"2024-05-08T18:34:18.284197+0000","last_peered":"2024-05-08T18:34:18.284197+0000","last_clean":"2024-05-08T18:34:18.284197+0000","last_became_active":"2024-05-08T18:30:49.984280+0000","last_became_peered":"2024-05-08T18:30:49.984280+0000","last_unstale":"2024-05-08T18:34:18.284197+0000","last_undegraded":"2024-05-08T18:34:18.284197+0000","last_fullsized":"2024-05-08T18:34:18.284197+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:48.974503+0000","last_clean_scrub_stamp":"2024-05-08T18:30:48.974503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.647908+0000","last_change":"2024-05-08T18:34:21.647908+0000","last_active":"2024-05-08T18:34:21.647908+0000","last_peered":"2024-05-08T18:34:21.647908+0000","last_clean":"2024-05-08T18:34:21.647908+0000","last_became_active":"2024-05-08T18:31:02.290540+0000","last_became_peered":"2024-05-08T18:31:02.290540+0000","last_unstale":"2024-05-08T18:34:21.647908+0000","last_undegraded":"2024-05-08T18:34:21.647908+0000","last_fullsized":"2024-05-08T18:34:21.647908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:21.647799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:21.647799+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.647799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:43:40.019529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.670588+0000","last_change":"2024-05-08T18:34:23.670650+0000","last_active":"2024-05-08T18:34:23.670588+0000","last_peered":"2024-05-08T18:34:23.670588+0000","last_clean":"2024-05-08T18:34:23.670588+0000","last_became_active":"2024-05-08T18:31:04.304669+0000","last_became_peered":"2024-05-08T18:31:04.304669+0000","last_unstale":"2024-05-08T18:34:23.670588+0000","last_undegraded":"2024-05-08T18:34:23.670588+0000","last_fullsized":"2024-05-08T18:34:23.670588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-05-08T18:34:23.670475+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-05-08T18:34:23.670475+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.670475+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.365929+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:17.640092+0000","last_change":"2024-05-08T18:34:17.640131+0000","last_active":"2024-05-08T18:34:17.640092+0000","last_peered":"2024-05-08T18:34:17.640092+0000","last_clean":"2024-05-08T18:34:17.640092+0000","last_became_active":"2024-05-08T18:31:06.308621+0000","last_became_peered":"2024-05-08T18:31:06.308621+0000","last_unstale":"2024-05-08T18:34:17.640092+0000","last_undegraded":"2024-05-08T18:34:17.640092+0000","last_fullsized":"2024-05-08T18:34:17.640092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:17.639997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:17.639997+0000","last_clean_scrub_stamp":"2024-05-08T18:34:17.639997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:50.847042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.736117+0000","last_change":"2024-05-08T18:34:32.736144+0000","last_active":"2024-05-08T18:34:32.736117+0000","last_peered":"2024-05-08T18:34:32.736117+0000","last_clean":"2024-05-08T18:34:32.736117+0000","last_became_active":"2024-05-08T18:31:08.308427+0000","last_became_peered":"2024-05-08T18:31:08.308427+0000","last_unstale":"2024-05-08T18:34:32.736117+0000","last_undegraded":"2024-05-08T18:34:32.736117+0000","last_fullsized":"2024-05-08T18:34:32.736117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:32.736032+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:32.736032+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.736032+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:14.795378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:09.918305+0000","last_change":"2024-05-08T18:35:09.918330+0000","last_active":"2024-05-08T18:35:09.918305+0000","last_peered":"2024-05-08T18:35:09.918305+0000","last_clean":"2024-05-08T18:35:09.918305+0000","last_became_active":"2024-05-08T18:31:08.315257+0000","last_became_peered":"2024-05-08T18:31:08.315257+0000","last_unstale":"2024-05-08T18:35:09.918305+0000","last_undegraded":"2024-05-08T18:35:09.918305+0000","last_fullsized":"2024-05-08T18:35:09.918305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:09.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:09.918223+0000","last_clean_scrub_stamp":"2024-05-08T18:35:09.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:01.610620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'12","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:54.880253+0000","last_change":"2024-05-08T18:34:54.880286+0000","last_active":"2024-05-08T18:34:54.880253+0000","last_peered":"2024-05-08T18:34:54.880253+0000","last_clean":"2024-05-08T18:34:54.880253+0000","last_became_active":"2024-05-08T18:31:00.294827+0000","last_became_peered":"2024-05-08T18:31:00.294827+0000","last_unstale":"2024-05-08T18:34:54.880253+0000","last_undegraded":"2024-05-08T18:34:54.880253+0000","last_fullsized":"2024-05-08T18:34:54.880253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:54.880168+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:54.880168+0000","last_clean_scrub_stamp":"2024-05-08T18:34:54.880168+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:49.670548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:07.176670+0000","last_change":"2024-05-08T18:30:58.313343+0000","last_active":"2024-05-08T18:34:07.176670+0000","last_peered":"2024-05-08T18:34:07.176670+0000","last_clean":"2024-05-08T18:34:07.176670+0000","last_became_active":"2024-05-08T18:30:58.313034+0000","last_became_peered":"2024-05-08T18:30:58.313034+0000","last_unstale":"2024-05-08T18:34:07.176670+0000","last_undegraded":"2024-05-08T18:34:07.176670+0000","last_fullsized":"2024-05-08T18:34:07.176670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.763311+0000","last_change":"2024-05-08T18:34:30.763337+0000","last_active":"2024-05-08T18:34:30.763311+0000","last_peered":"2024-05-08T18:34:30.763311+0000","last_clean":"2024-05-08T18:34:30.763311+0000","last_became_active":"2024-05-08T18:31:02.291119+0000","last_became_peered":"2024-05-08T18:31:02.291119+0000","last_unstale":"2024-05-08T18:34:30.763311+0000","last_undegraded":"2024-05-08T18:34:30.763311+0000","last_fullsized":"2024-05-08T18:34:30.763311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:30.763186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:30.763186+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.763186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:48.428188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'41","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:51.439127+0000","last_change":"2024-05-08T18:34:51.439168+0000","last_active":"2024-05-08T18:34:51.439127+0000","last_peered":"2024-05-08T18:34:51.439127+0000","last_clean":"2024-05-08T18:34:51.439127+0000","last_became_active":"2024-05-08T18:31:04.300990+0000","last_became_peered":"2024-05-08T18:31:04.300990+0000","last_unstale":"2024-05-08T18:34:51.439127+0000","last_undegraded":"2024-05-08T18:34:51.439127+0000","last_fullsized":"2024-05-08T18:34:51.439127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-05-08T18:34:51.439030+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-05-08T18:34:51.439030+0000","last_clean_scrub_stamp":"2024-05-08T18:34:51.439030+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:18.253390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:58.305653+0000","last_change":"2024-05-08T18:34:58.305690+0000","last_active":"2024-05-08T18:34:58.305653+0000","last_peered":"2024-05-08T18:34:58.305653+0000","last_clean":"2024-05-08T18:34:58.305653+0000","last_became_active":"2024-05-08T18:31:06.314696+0000","last_became_peered":"2024-05-08T18:31:06.314696+0000","last_unstale":"2024-05-08T18:34:58.305653+0000","last_undegraded":"2024-05-08T18:34:58.305653+0000","last_fullsized":"2024-05-08T18:34:58.305653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:58.305535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:58.305535+0000","last_clean_scrub_stamp":"2024-05-08T18:34:58.305535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:16.613195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:16.903195+0000","last_change":"2024-05-08T18:31:08.319177+0000","last_active":"2024-05-08T18:34:16.903195+0000","last_peered":"2024-05-08T18:34:16.903195+0000","last_clean":"2024-05-08T18:34:16.903195+0000","last_became_active":"2024-05-08T18:31:08.318901+0000","last_became_peered":"2024-05-08T18:31:08.318901+0000","last_unstale":"2024-05-08T18:34:16.903195+0000","last_undegraded":"2024-05-08T18:34:16.903195+0000","last_fullsized":"2024-05-08T18:34:16.903195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:39.751848+0000","last_change":"2024-05-08T18:34:39.751907+0000","last_active":"2024-05-08T18:34:39.751848+0000","last_peered":"2024-05-08T18:34:39.751848+0000","last_clean":"2024-05-08T18:34:39.751848+0000","last_became_active":"2024-05-08T18:31:00.292376+0000","last_became_peered":"2024-05-08T18:31:00.292376+0000","last_unstale":"2024-05-08T18:34:39.751848+0000","last_undegraded":"2024-05-08T18:34:39.751848+0000","last_fullsized":"2024-05-08T18:34:39.751848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:39.751747+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:39.751747+0000","last_clean_scrub_stamp":"2024-05-08T18:34:39.751747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:21.882010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:02.862804+0000","last_change":"2024-05-08T18:35:02.862829+0000","last_active":"2024-05-08T18:35:02.862804+0000","last_peered":"2024-05-08T18:35:02.862804+0000","last_clean":"2024-05-08T18:35:02.862804+0000","last_became_active":"2024-05-08T18:30:58.301520+0000","last_became_peered":"2024-05-08T18:30:58.301520+0000","last_unstale":"2024-05-08T18:35:02.862804+0000","last_undegraded":"2024-05-08T18:35:02.862804+0000","last_fullsized":"2024-05-08T18:35:02.862804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:02.862701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:02.862701+0000","last_clean_scrub_stamp":"2024-05-08T18:35:02.862701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:10.961365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.673362+0000","last_change":"2024-05-08T18:34:22.673400+0000","last_active":"2024-05-08T18:34:22.673362+0000","last_peered":"2024-05-08T18:34:22.673362+0000","last_clean":"2024-05-08T18:34:22.673362+0000","last_became_active":"2024-05-08T18:31:02.293459+0000","last_became_peered":"2024-05-08T18:31:02.293459+0000","last_unstale":"2024-05-08T18:34:22.673362+0000","last_undegraded":"2024-05-08T18:34:22.673362+0000","last_fullsized":"2024-05-08T18:34:22.673362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:22.673274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:22.673274+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.673274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:39.064779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.593729+0000","last_change":"2024-05-08T18:34:27.593763+0000","last_active":"2024-05-08T18:34:27.593729+0000","last_peered":"2024-05-08T18:34:27.593729+0000","last_clean":"2024-05-08T18:34:27.593729+0000","last_became_active":"2024-05-08T18:31:04.298237+0000","last_became_peered":"2024-05-08T18:31:04.298237+0000","last_unstale":"2024-05-08T18:34:27.593729+0000","last_undegraded":"2024-05-08T18:34:27.593729+0000","last_fullsized":"2024-05-08T18:34:27.593729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:27.593625+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:27.593625+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.593625+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:11.004092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.656405+0000","last_change":"2024-05-08T18:34:21.656429+0000","last_active":"2024-05-08T18:34:21.656405+0000","last_peered":"2024-05-08T18:34:21.656405+0000","last_clean":"2024-05-08T18:34:21.656405+0000","last_became_active":"2024-05-08T18:31:06.307048+0000","last_became_peered":"2024-05-08T18:31:06.307048+0000","last_unstale":"2024-05-08T18:34:21.656405+0000","last_undegraded":"2024-05-08T18:34:21.656405+0000","last_fullsized":"2024-05-08T18:34:21.656405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:21.656318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:21.656318+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.656318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:04.597248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.181483+0000","last_change":"2024-05-08T18:31:08.314432+0000","last_active":"2024-05-08T18:33:38.181483+0000","last_peered":"2024-05-08T18:33:38.181483+0000","last_clean":"2024-05-08T18:33:38.181483+0000","last_became_active":"2024-05-08T18:31:08.313943+0000","last_became_peered":"2024-05-08T18:31:08.313943+0000","last_unstale":"2024-05-08T18:33:38.181483+0000","last_undegraded":"2024-05-08T18:33:38.181483+0000","last_fullsized":"2024-05-08T18:33:38.181483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:01.648622+0000","last_change":"2024-05-08T18:35:01.648672+0000","last_active":"2024-05-08T18:35:01.648622+0000","last_peered":"2024-05-08T18:35:01.648622+0000","last_clean":"2024-05-08T18:35:01.648622+0000","last_became_active":"2024-05-08T18:31:00.285842+0000","last_became_peered":"2024-05-08T18:31:00.285842+0000","last_unstale":"2024-05-08T18:35:01.648622+0000","last_undegraded":"2024-05-08T18:35:01.648622+0000","last_fullsized":"2024-05-08T18:35:01.648622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:01.648519+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:01.648519+0000","last_clean_scrub_stamp":"2024-05-08T18:35:01.648519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:30.251562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:05.877745+0000","last_change":"2024-05-08T18:35:05.877771+0000","last_active":"2024-05-08T18:35:05.877745+0000","last_peered":"2024-05-08T18:35:05.877745+0000","last_clean":"2024-05-08T18:35:05.877745+0000","last_became_active":"2024-05-08T18:30:58.303112+0000","last_became_peered":"2024-05-08T18:30:58.303112+0000","last_unstale":"2024-05-08T18:35:05.877745+0000","last_undegraded":"2024-05-08T18:35:05.877745+0000","last_fullsized":"2024-05-08T18:35:05.877745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:05.877646+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:05.877646+0000","last_clean_scrub_stamp":"2024-05-08T18:35:05.877646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:41.396937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:33.767319+0000","last_change":"2024-05-08T18:34:33.767349+0000","last_active":"2024-05-08T18:34:33.767319+0000","last_peered":"2024-05-08T18:34:33.767319+0000","last_clean":"2024-05-08T18:34:33.767319+0000","last_became_active":"2024-05-08T18:31:02.294812+0000","last_became_peered":"2024-05-08T18:31:02.294812+0000","last_unstale":"2024-05-08T18:34:33.767319+0000","last_undegraded":"2024-05-08T18:34:33.767319+0000","last_fullsized":"2024-05-08T18:34:33.767319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:33.767215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:33.767215+0000","last_clean_scrub_stamp":"2024-05-08T18:34:33.767215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:26.750973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'47","reported_seq":119,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.562009+0000","last_change":"2024-05-08T18:34:26.562049+0000","last_active":"2024-05-08T18:34:26.562009+0000","last_peered":"2024-05-08T18:34:26.562009+0000","last_clean":"2024-05-08T18:34:26.562009+0000","last_became_active":"2024-05-08T18:31:04.301969+0000","last_became_peered":"2024-05-08T18:31:04.301969+0000","last_unstale":"2024-05-08T18:34:26.562009+0000","last_undegraded":"2024-05-08T18:34:26.562009+0000","last_fullsized":"2024-05-08T18:34:26.562009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-08T18:34:26.561918+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-08T18:34:26.561918+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.561918+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:56.265527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:17.922204+0000","last_change":"2024-05-08T18:34:17.922228+0000","last_active":"2024-05-08T18:34:17.922204+0000","last_peered":"2024-05-08T18:34:17.922204+0000","last_clean":"2024-05-08T18:34:17.922204+0000","last_became_active":"2024-05-08T18:31:06.306346+0000","last_became_peered":"2024-05-08T18:31:06.306346+0000","last_unstale":"2024-05-08T18:34:17.922204+0000","last_undegraded":"2024-05-08T18:34:17.922204+0000","last_fullsized":"2024-05-08T18:34:17.922204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:17.922113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:17.922113+0000","last_clean_scrub_stamp":"2024-05-08T18:34:17.922113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:34.597084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:10.321449+0000","last_change":"2024-05-08T18:35:10.321477+0000","last_active":"2024-05-08T18:35:10.321449+0000","last_peered":"2024-05-08T18:35:10.321449+0000","last_clean":"2024-05-08T18:35:10.321449+0000","last_became_active":"2024-05-08T18:31:08.316673+0000","last_became_peered":"2024-05-08T18:31:08.316673+0000","last_unstale":"2024-05-08T18:35:10.321449+0000","last_undegraded":"2024-05-08T18:35:10.321449+0000","last_fullsized":"2024-05-08T18:35:10.321449+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:10.321358+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:10.321358+0000","last_clean_scrub_stamp":"2024-05-08T18:35:10.321358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:22.456143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'6","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:03.275590+0000","last_change":"2024-05-08T18:35:03.275613+0000","last_active":"2024-05-08T18:35:03.275590+0000","last_peered":"2024-05-08T18:35:03.275590+0000","last_clean":"2024-05-08T18:35:03.275590+0000","last_became_active":"2024-05-08T18:31:00.291163+0000","last_became_peered":"2024-05-08T18:31:00.291163+0000","last_unstale":"2024-05-08T18:35:03.275590+0000","last_undegraded":"2024-05-08T18:35:03.275590+0000","last_fullsized":"2024-05-08T18:35:03.275590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:35:03.275501+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:35:03.275501+0000","last_clean_scrub_stamp":"2024-05-08T18:35:03.275501+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:18.779161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:09.827464+0000","last_change":"2024-05-08T18:35:09.827502+0000","last_active":"2024-05-08T18:35:09.827464+0000","last_peered":"2024-05-08T18:35:09.827464+0000","last_clean":"2024-05-08T18:35:09.827464+0000","last_became_active":"2024-05-08T18:30:58.304135+0000","last_became_peered":"2024-05-08T18:30:58.304135+0000","last_unstale":"2024-05-08T18:35:09.827464+0000","last_undegraded":"2024-05-08T18:35:09.827464+0000","last_fullsized":"2024-05-08T18:35:09.827464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:09.827356+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:09.827356+0000","last_clean_scrub_stamp":"2024-05-08T18:35:09.827356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:19.346446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.724006+0000","last_change":"2024-05-08T18:34:25.724048+0000","last_active":"2024-05-08T18:34:25.724006+0000","last_peered":"2024-05-08T18:34:25.724006+0000","last_clean":"2024-05-08T18:34:25.724006+0000","last_became_active":"2024-05-08T18:31:02.290191+0000","last_became_peered":"2024-05-08T18:31:02.290191+0000","last_unstale":"2024-05-08T18:34:25.724006+0000","last_undegraded":"2024-05-08T18:34:25.724006+0000","last_fullsized":"2024-05-08T18:34:25.724006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:25.723912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:25.723912+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.723912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:20.514292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.740088+0000","last_change":"2024-05-08T18:34:30.740127+0000","last_active":"2024-05-08T18:34:30.740088+0000","last_peered":"2024-05-08T18:34:30.740088+0000","last_clean":"2024-05-08T18:34:30.740088+0000","last_became_active":"2024-05-08T18:31:04.295255+0000","last_became_peered":"2024-05-08T18:31:04.295255+0000","last_unstale":"2024-05-08T18:34:30.740088+0000","last_undegraded":"2024-05-08T18:34:30.740088+0000","last_fullsized":"2024-05-08T18:34:30.740088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:30.740000+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:30.740000+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.740000+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:21.689161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.619965+0000","last_change":"2024-05-08T18:34:22.620008+0000","last_active":"2024-05-08T18:34:22.619965+0000","last_peered":"2024-05-08T18:34:22.619965+0000","last_clean":"2024-05-08T18:34:22.619965+0000","last_became_active":"2024-05-08T18:31:06.304851+0000","last_became_peered":"2024-05-08T18:31:06.304851+0000","last_unstale":"2024-05-08T18:34:22.619965+0000","last_undegraded":"2024-05-08T18:34:22.619965+0000","last_fullsized":"2024-05-08T18:34:22.619965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:22.619859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:22.619859+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.619859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:19.090940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'8","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:12.829932+0000","last_change":"2024-05-08T18:35:12.829981+0000","last_active":"2024-05-08T18:35:12.829932+0000","last_peered":"2024-05-08T18:35:12.829932+0000","last_clean":"2024-05-08T18:35:12.829932+0000","last_became_active":"2024-05-08T18:31:45.336717+0000","last_became_peered":"2024-05-08T18:31:45.336717+0000","last_unstale":"2024-05-08T18:35:12.829932+0000","last_undegraded":"2024-05-08T18:35:12.829932+0000","last_fullsized":"2024-05-08T18:35:12.829932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:35:12.829847+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:35:12.829847+0000","last_clean_scrub_stamp":"2024-05-08T18:35:12.829847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:53.220872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.180198+0000","last_change":"2024-05-08T18:30:58.303784+0000","last_active":"2024-05-08T18:33:23.180198+0000","last_peered":"2024-05-08T18:33:23.180198+0000","last_clean":"2024-05-08T18:33:23.180198+0000","last_became_active":"2024-05-08T18:30:58.302486+0000","last_became_peered":"2024-05-08T18:30:58.302486+0000","last_unstale":"2024-05-08T18:33:23.180198+0000","last_undegraded":"2024-05-08T18:33:23.180198+0000","last_fullsized":"2024-05-08T18:33:23.180198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:38.630273+0000","last_change":"2024-05-08T18:34:38.630273+0000","last_active":"2024-05-08T18:34:38.630273+0000","last_peered":"2024-05-08T18:34:38.630273+0000","last_clean":"2024-05-08T18:34:38.630273+0000","last_became_active":"2024-05-08T18:31:02.291965+0000","last_became_peered":"2024-05-08T18:31:02.291965+0000","last_unstale":"2024-05-08T18:34:38.630273+0000","last_undegraded":"2024-05-08T18:34:38.630273+0000","last_fullsized":"2024-05-08T18:34:38.630273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:38.630108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:38.630108+0000","last_clean_scrub_stamp":"2024-05-08T18:34:38.630108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:03.690534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.589859+0000","last_change":"2024-05-08T18:34:28.589897+0000","last_active":"2024-05-08T18:34:28.589859+0000","last_peered":"2024-05-08T18:34:28.589859+0000","last_clean":"2024-05-08T18:34:28.589859+0000","last_became_active":"2024-05-08T18:31:04.298061+0000","last_became_peered":"2024-05-08T18:31:04.298061+0000","last_unstale":"2024-05-08T18:34:28.589859+0000","last_undegraded":"2024-05-08T18:34:28.589859+0000","last_fullsized":"2024-05-08T18:34:28.589859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-08T18:34:28.589758+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-08T18:34:28.589758+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.589758+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.082408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.571868+0000","last_change":"2024-05-08T18:34:19.571892+0000","last_active":"2024-05-08T18:34:19.571868+0000","last_peered":"2024-05-08T18:34:19.571868+0000","last_clean":"2024-05-08T18:34:19.571868+0000","last_became_active":"2024-05-08T18:31:06.308247+0000","last_became_peered":"2024-05-08T18:31:06.308247+0000","last_unstale":"2024-05-08T18:34:19.571868+0000","last_undegraded":"2024-05-08T18:34:19.571868+0000","last_fullsized":"2024-05-08T18:34:19.571868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:19.571752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:19.571752+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.571752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:10.353530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:12.721881+0000","last_change":"2024-05-08T18:35:12.721905+0000","last_active":"2024-05-08T18:35:12.721881+0000","last_peered":"2024-05-08T18:35:12.721881+0000","last_clean":"2024-05-08T18:35:12.721881+0000","last_became_active":"2024-05-08T18:31:08.313986+0000","last_became_peered":"2024-05-08T18:31:08.313986+0000","last_unstale":"2024-05-08T18:35:12.721881+0000","last_undegraded":"2024-05-08T18:35:12.721881+0000","last_fullsized":"2024-05-08T18:35:12.721881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T18:35:12.721785+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T18:35:12.721785+0000","last_clean_scrub_stamp":"2024-05-08T18:35:12.721785+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:52.662693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:51.729136+0000","last_change":"2024-05-08T18:34:51.729136+0000","last_active":"2024-05-08T18:34:51.729136+0000","last_peered":"2024-05-08T18:34:51.729136+0000","last_clean":"2024-05-08T18:34:51.729136+0000","last_became_active":"2024-05-08T18:31:00.281233+0000","last_became_peered":"2024-05-08T18:31:00.281233+0000","last_unstale":"2024-05-08T18:34:51.729136+0000","last_undegraded":"2024-05-08T18:34:51.729136+0000","last_fullsized":"2024-05-08T18:34:51.729136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:51.729017+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:51.729017+0000","last_clean_scrub_stamp":"2024-05-08T18:34:51.729017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:23.632079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:03.775023+0000","last_change":"2024-05-08T18:35:03.775049+0000","last_active":"2024-05-08T18:35:03.775023+0000","last_peered":"2024-05-08T18:35:03.775023+0000","last_clean":"2024-05-08T18:35:03.775023+0000","last_became_active":"2024-05-08T18:30:58.289251+0000","last_became_peered":"2024-05-08T18:30:58.289251+0000","last_unstale":"2024-05-08T18:35:03.775023+0000","last_undegraded":"2024-05-08T18:35:03.775023+0000","last_fullsized":"2024-05-08T18:35:03.775023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:03.774929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:03.774929+0000","last_clean_scrub_stamp":"2024-05-08T18:35:03.774929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:33.252828+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:37.837401+0000","last_change":"2024-05-08T18:34:37.837401+0000","last_active":"2024-05-08T18:34:37.837401+0000","last_peered":"2024-05-08T18:34:37.837401+0000","last_clean":"2024-05-08T18:34:37.837401+0000","last_became_active":"2024-05-08T18:31:02.293185+0000","last_became_peered":"2024-05-08T18:31:02.293185+0000","last_unstale":"2024-05-08T18:34:37.837401+0000","last_undegraded":"2024-05-08T18:34:37.837401+0000","last_fullsized":"2024-05-08T18:34:37.837401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:37.837258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:37.837258+0000","last_clean_scrub_stamp":"2024-05-08T18:34:37.837258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:28.286615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.735819+0000","last_change":"2024-05-08T18:34:26.735863+0000","last_active":"2024-05-08T18:34:26.735819+0000","last_peered":"2024-05-08T18:34:26.735819+0000","last_clean":"2024-05-08T18:34:26.735819+0000","last_became_active":"2024-05-08T18:31:04.298482+0000","last_became_peered":"2024-05-08T18:31:04.298482+0000","last_unstale":"2024-05-08T18:34:26.735819+0000","last_undegraded":"2024-05-08T18:34:26.735819+0000","last_fullsized":"2024-05-08T18:34:26.735819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T18:34:26.735726+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T18:34:26.735726+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.735726+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:38.610782+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.785527+0000","last_change":"2024-05-08T18:34:28.785567+0000","last_active":"2024-05-08T18:34:28.785527+0000","last_peered":"2024-05-08T18:34:28.785527+0000","last_clean":"2024-05-08T18:34:28.785527+0000","last_became_active":"2024-05-08T18:31:06.311392+0000","last_became_peered":"2024-05-08T18:31:06.311392+0000","last_unstale":"2024-05-08T18:34:28.785527+0000","last_undegraded":"2024-05-08T18:34:28.785527+0000","last_fullsized":"2024-05-08T18:34:28.785527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:28.785418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:28.785418+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.785418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.278068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181260+0000","last_change":"2024-05-08T18:31:08.319678+0000","last_active":"2024-05-08T18:33:28.181260+0000","last_peered":"2024-05-08T18:33:28.181260+0000","last_clean":"2024-05-08T18:33:28.181260+0000","last_became_active":"2024-05-08T18:31:08.319394+0000","last_became_peered":"2024-05-08T18:31:08.319394+0000","last_unstale":"2024-05-08T18:33:28.181260+0000","last_undegraded":"2024-05-08T18:33:28.181260+0000","last_fullsized":"2024-05-08T18:33:28.181260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'18","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.687783+0000","last_change":"2024-05-08T18:34:29.687812+0000","last_active":"2024-05-08T18:34:29.687783+0000","last_peered":"2024-05-08T18:34:29.687783+0000","last_clean":"2024-05-08T18:34:29.687783+0000","last_became_active":"2024-05-08T18:31:00.299547+0000","last_became_peered":"2024-05-08T18:31:00.299547+0000","last_unstale":"2024-05-08T18:34:29.687783+0000","last_undegraded":"2024-05-08T18:34:29.687783+0000","last_fullsized":"2024-05-08T18:34:29.687783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-05-08T18:34:29.687669+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-05-08T18:34:29.687669+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.687669+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:34:50.822109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:01.708108+0000","last_change":"2024-05-08T18:35:01.708135+0000","last_active":"2024-05-08T18:35:01.708108+0000","last_peered":"2024-05-08T18:35:01.708108+0000","last_clean":"2024-05-08T18:35:01.708108+0000","last_became_active":"2024-05-08T18:30:58.303624+0000","last_became_peered":"2024-05-08T18:30:58.303624+0000","last_unstale":"2024-05-08T18:35:01.708108+0000","last_undegraded":"2024-05-08T18:35:01.708108+0000","last_fullsized":"2024-05-08T18:35:01.708108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:01.708010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:01.708010+0000","last_clean_scrub_stamp":"2024-05-08T18:35:01.708010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:18.222162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:38.801676+0000","last_change":"2024-05-08T18:34:38.801732+0000","last_active":"2024-05-08T18:34:38.801676+0000","last_peered":"2024-05-08T18:34:38.801676+0000","last_clean":"2024-05-08T18:34:38.801676+0000","last_became_active":"2024-05-08T18:31:02.292498+0000","last_became_peered":"2024-05-08T18:31:02.292498+0000","last_unstale":"2024-05-08T18:34:38.801676+0000","last_undegraded":"2024-05-08T18:34:38.801676+0000","last_fullsized":"2024-05-08T18:34:38.801676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:38.801554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:38.801554+0000","last_clean_scrub_stamp":"2024-05-08T18:34:38.801554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:02.934641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'39","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.519904+0000","last_change":"2024-05-08T18:34:31.519937+0000","last_active":"2024-05-08T18:34:31.519904+0000","last_peered":"2024-05-08T18:34:31.519904+0000","last_clean":"2024-05-08T18:34:31.519904+0000","last_became_active":"2024-05-08T18:31:04.297297+0000","last_became_peered":"2024-05-08T18:31:04.297297+0000","last_unstale":"2024-05-08T18:34:31.519904+0000","last_undegraded":"2024-05-08T18:34:31.519904+0000","last_fullsized":"2024-05-08T18:34:31.519904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-08T18:34:31.519820+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-08T18:34:31.519820+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.519820+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:29.500105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.647756+0000","last_change":"2024-05-08T18:34:20.647756+0000","last_active":"2024-05-08T18:34:20.647756+0000","last_peered":"2024-05-08T18:34:20.647756+0000","last_clean":"2024-05-08T18:34:20.647756+0000","last_became_active":"2024-05-08T18:31:06.305567+0000","last_became_peered":"2024-05-08T18:31:06.305567+0000","last_unstale":"2024-05-08T18:34:20.647756+0000","last_undegraded":"2024-05-08T18:34:20.647756+0000","last_fullsized":"2024-05-08T18:34:20.647756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:20.647576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:20.647576+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.647576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:11.596737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'11","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.968893+0000","last_change":"2024-05-08T18:31:08.317380+0000","last_active":"2024-05-08T18:34:06.968893+0000","last_peered":"2024-05-08T18:34:06.968893+0000","last_clean":"2024-05-08T18:34:06.968893+0000","last_became_active":"2024-05-08T18:31:08.316943+0000","last_became_peered":"2024-05-08T18:31:08.316943+0000","last_unstale":"2024-05-08T18:34:06.968893+0000","last_undegraded":"2024-05-08T18:34:06.968893+0000","last_fullsized":"2024-05-08T18:34:06.968893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'6","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:57.746662+0000","last_change":"2024-05-08T18:34:57.746715+0000","last_active":"2024-05-08T18:34:57.746662+0000","last_peered":"2024-05-08T18:34:57.746662+0000","last_clean":"2024-05-08T18:34:57.746662+0000","last_became_active":"2024-05-08T18:31:00.282923+0000","last_became_peered":"2024-05-08T18:31:00.282923+0000","last_unstale":"2024-05-08T18:34:57.746662+0000","last_undegraded":"2024-05-08T18:34:57.746662+0000","last_fullsized":"2024-05-08T18:34:57.746662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:57.746576+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:57.746576+0000","last_clean_scrub_stamp":"2024-05-08T18:34:57.746576+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:59.586725+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:08.377452+0000","last_change":"2024-05-08T18:35:08.377482+0000","last_active":"2024-05-08T18:35:08.377452+0000","last_peered":"2024-05-08T18:35:08.377452+0000","last_clean":"2024-05-08T18:35:08.377452+0000","last_became_active":"2024-05-08T18:30:58.316980+0000","last_became_peered":"2024-05-08T18:30:58.316980+0000","last_unstale":"2024-05-08T18:35:08.377452+0000","last_undegraded":"2024-05-08T18:35:08.377452+0000","last_fullsized":"2024-05-08T18:35:08.377452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:08.377353+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:08.377353+0000","last_clean_scrub_stamp":"2024-05-08T18:35:08.377353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:31:18.567645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:35.723926+0000","last_change":"2024-05-08T18:34:35.723966+0000","last_active":"2024-05-08T18:34:35.723926+0000","last_peered":"2024-05-08T18:34:35.723926+0000","last_clean":"2024-05-08T18:34:35.723926+0000","last_became_active":"2024-05-08T18:31:02.288127+0000","last_became_peered":"2024-05-08T18:31:02.288127+0000","last_unstale":"2024-05-08T18:34:35.723926+0000","last_undegraded":"2024-05-08T18:34:35.723926+0000","last_fullsized":"2024-05-08T18:34:35.723926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:35.723797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:35.723797+0000","last_clean_scrub_stamp":"2024-05-08T18:34:35.723797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:17.046313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:49.428140+0000","last_change":"2024-05-08T18:34:49.428140+0000","last_active":"2024-05-08T18:34:49.428140+0000","last_peered":"2024-05-08T18:34:49.428140+0000","last_clean":"2024-05-08T18:34:49.428140+0000","last_became_active":"2024-05-08T18:31:04.302034+0000","last_became_peered":"2024-05-08T18:31:04.302034+0000","last_unstale":"2024-05-08T18:34:49.428140+0000","last_undegraded":"2024-05-08T18:34:49.428140+0000","last_fullsized":"2024-05-08T18:34:49.428140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T18:34:49.427967+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T18:34:49.427967+0000","last_clean_scrub_stamp":"2024-05-08T18:34:49.427967+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:40.814614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":418,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.617019+0000","last_change":"2024-05-08T18:34:20.617045+0000","last_active":"2024-05-08T18:34:20.617019+0000","last_peered":"2024-05-08T18:34:20.617019+0000","last_clean":"2024-05-08T18:34:20.617019+0000","last_became_active":"2024-05-08T18:31:06.311063+0000","last_became_peered":"2024-05-08T18:31:06.311063+0000","last_unstale":"2024-05-08T18:34:20.617019+0000","last_undegraded":"2024-05-08T18:34:20.617019+0000","last_fullsized":"2024-05-08T18:34:20.617019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:20.616926+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:20.616926+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.616926+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:07.788306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181095+0000","last_change":"2024-05-08T18:31:08.320650+0000","last_active":"2024-05-08T18:33:28.181095+0000","last_peered":"2024-05-08T18:33:28.181095+0000","last_clean":"2024-05-08T18:33:28.181095+0000","last_became_active":"2024-05-08T18:31:08.320260+0000","last_became_peered":"2024-05-08T18:31:08.320260+0000","last_unstale":"2024-05-08T18:33:28.181095+0000","last_undegraded":"2024-05-08T18:33:28.181095+0000","last_fullsized":"2024-05-08T18:33:28.181095+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:46.862485+0000","last_change":"2024-05-08T18:34:46.862513+0000","last_active":"2024-05-08T18:34:46.862485+0000","last_peered":"2024-05-08T18:34:46.862485+0000","last_clean":"2024-05-08T18:34:46.862485+0000","last_became_active":"2024-05-08T18:31:00.284982+0000","last_became_peered":"2024-05-08T18:31:00.284982+0000","last_unstale":"2024-05-08T18:34:46.862485+0000","last_undegraded":"2024-05-08T18:34:46.862485+0000","last_fullsized":"2024-05-08T18:34:46.862485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:46.862388+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:46.862388+0000","last_clean_scrub_stamp":"2024-05-08T18:34:46.862388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:08.371704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:53.644293+0000","last_change":"2024-05-08T18:34:53.644358+0000","last_active":"2024-05-08T18:34:53.644293+0000","last_peered":"2024-05-08T18:34:53.644293+0000","last_clean":"2024-05-08T18:34:53.644293+0000","last_became_active":"2024-05-08T18:30:58.304969+0000","last_became_peered":"2024-05-08T18:30:58.304969+0000","last_unstale":"2024-05-08T18:34:53.644293+0000","last_undegraded":"2024-05-08T18:34:53.644293+0000","last_fullsized":"2024-05-08T18:34:53.644293+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:53.644191+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:53.644191+0000","last_clean_scrub_stamp":"2024-05-08T18:34:53.644191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:01.742855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:33.755080+0000","last_change":"2024-05-08T18:34:33.755105+0000","last_active":"2024-05-08T18:34:33.755080+0000","last_peered":"2024-05-08T18:34:33.755080+0000","last_clean":"2024-05-08T18:34:33.755080+0000","last_became_active":"2024-05-08T18:31:02.288719+0000","last_became_peered":"2024-05-08T18:31:02.288719+0000","last_unstale":"2024-05-08T18:34:33.755080+0000","last_undegraded":"2024-05-08T18:34:33.755080+0000","last_fullsized":"2024-05-08T18:34:33.755080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:33.754990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:33.754990+0000","last_clean_scrub_stamp":"2024-05-08T18:34:33.754990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:27.813675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'46","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.817834+0000","last_change":"2024-05-08T18:34:26.817876+0000","last_active":"2024-05-08T18:34:26.817834+0000","last_peered":"2024-05-08T18:34:26.817834+0000","last_clean":"2024-05-08T18:34:26.817834+0000","last_became_active":"2024-05-08T18:31:04.297013+0000","last_became_peered":"2024-05-08T18:31:04.297013+0000","last_unstale":"2024-05-08T18:34:26.817834+0000","last_undegraded":"2024-05-08T18:34:26.817834+0000","last_fullsized":"2024-05-08T18:34:26.817834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-05-08T18:34:26.817745+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-05-08T18:34:26.817745+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.817745+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:56.521354+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.591169+0000","last_change":"2024-05-08T18:34:29.591218+0000","last_active":"2024-05-08T18:34:29.591169+0000","last_peered":"2024-05-08T18:34:29.591169+0000","last_clean":"2024-05-08T18:34:29.591169+0000","last_became_active":"2024-05-08T18:31:06.311767+0000","last_became_peered":"2024-05-08T18:31:06.311767+0000","last_unstale":"2024-05-08T18:34:29.591169+0000","last_undegraded":"2024-05-08T18:34:29.591169+0000","last_fullsized":"2024-05-08T18:34:29.591169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:29.591069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:29.591069+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.591069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:12.240015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:11.749571+0000","last_change":"2024-05-08T18:35:11.749595+0000","last_active":"2024-05-08T18:35:11.749571+0000","last_peered":"2024-05-08T18:35:11.749571+0000","last_clean":"2024-05-08T18:35:11.749571+0000","last_became_active":"2024-05-08T18:31:08.312031+0000","last_became_peered":"2024-05-08T18:31:08.312031+0000","last_unstale":"2024-05-08T18:35:11.749571+0000","last_undegraded":"2024-05-08T18:35:11.749571+0000","last_fullsized":"2024-05-08T18:35:11.749571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:11.749487+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:11.749487+0000","last_clean_scrub_stamp":"2024-05-08T18:35:11.749487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:51.628598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:43.845914+0000","last_change":"2024-05-08T18:34:43.845941+0000","last_active":"2024-05-08T18:34:43.845914+0000","last_peered":"2024-05-08T18:34:43.845914+0000","last_clean":"2024-05-08T18:34:43.845914+0000","last_became_active":"2024-05-08T18:31:00.282605+0000","last_became_peered":"2024-05-08T18:31:00.282605+0000","last_unstale":"2024-05-08T18:34:43.845914+0000","last_undegraded":"2024-05-08T18:34:43.845914+0000","last_fullsized":"2024-05-08T18:34:43.845914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:43.845805+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:43.845805+0000","last_clean_scrub_stamp":"2024-05-08T18:34:43.845805+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:33.890772+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181406+0000","last_change":"2024-05-08T18:30:58.316801+0000","last_active":"2024-05-08T18:33:28.181406+0000","last_peered":"2024-05-08T18:33:28.181406+0000","last_clean":"2024-05-08T18:33:28.181406+0000","last_became_active":"2024-05-08T18:30:58.316166+0000","last_became_peered":"2024-05-08T18:30:58.316166+0000","last_unstale":"2024-05-08T18:33:28.181406+0000","last_undegraded":"2024-05-08T18:33:28.181406+0000","last_fullsized":"2024-05-08T18:33:28.181406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:34.793858+0000","last_change":"2024-05-08T18:34:34.793883+0000","last_active":"2024-05-08T18:34:34.793858+0000","last_peered":"2024-05-08T18:34:34.793858+0000","last_clean":"2024-05-08T18:34:34.793858+0000","last_became_active":"2024-05-08T18:31:02.294335+0000","last_became_peered":"2024-05-08T18:31:02.294335+0000","last_unstale":"2024-05-08T18:34:34.793858+0000","last_undegraded":"2024-05-08T18:34:34.793858+0000","last_fullsized":"2024-05-08T18:34:34.793858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:34.793770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:34.793770+0000","last_clean_scrub_stamp":"2024-05-08T18:34:34.793770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:10.718458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.557478+0000","last_change":"2024-05-08T18:34:30.557516+0000","last_active":"2024-05-08T18:34:30.557478+0000","last_peered":"2024-05-08T18:34:30.557478+0000","last_clean":"2024-05-08T18:34:30.557478+0000","last_became_active":"2024-05-08T18:31:04.297440+0000","last_became_peered":"2024-05-08T18:31:04.297440+0000","last_unstale":"2024-05-08T18:34:30.557478+0000","last_undegraded":"2024-05-08T18:34:30.557478+0000","last_fullsized":"2024-05-08T18:34:30.557478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:30.557382+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:30.557382+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.557382+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:48.222384+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:54.392740+0000","last_change":"2024-05-08T18:34:54.392771+0000","last_active":"2024-05-08T18:34:54.392740+0000","last_peered":"2024-05-08T18:34:54.392740+0000","last_clean":"2024-05-08T18:34:54.392740+0000","last_became_active":"2024-05-08T18:31:06.312162+0000","last_became_peered":"2024-05-08T18:31:06.312162+0000","last_unstale":"2024-05-08T18:34:54.392740+0000","last_undegraded":"2024-05-08T18:34:54.392740+0000","last_fullsized":"2024-05-08T18:34:54.392740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:54.392629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:54.392629+0000","last_clean_scrub_stamp":"2024-05-08T18:34:54.392629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:33.529929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.182202+0000","last_change":"2024-05-08T18:31:08.318309+0000","last_active":"2024-05-08T18:33:33.182202+0000","last_peered":"2024-05-08T18:33:33.182202+0000","last_clean":"2024-05-08T18:33:33.182202+0000","last_became_active":"2024-05-08T18:31:08.318072+0000","last_became_peered":"2024-05-08T18:31:08.318072+0000","last_unstale":"2024-05-08T18:33:33.182202+0000","last_undegraded":"2024-05-08T18:33:33.182202+0000","last_fullsized":"2024-05-08T18:33:33.182202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:01.256070+0000","last_change":"2024-05-08T18:35:01.256104+0000","last_active":"2024-05-08T18:35:01.256070+0000","last_peered":"2024-05-08T18:35:01.256070+0000","last_clean":"2024-05-08T18:35:01.256070+0000","last_became_active":"2024-05-08T18:31:00.291128+0000","last_became_peered":"2024-05-08T18:31:00.291128+0000","last_unstale":"2024-05-08T18:35:01.256070+0000","last_undegraded":"2024-05-08T18:35:01.256070+0000","last_fullsized":"2024-05-08T18:35:01.256070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:01.255984+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:01.255984+0000","last_clean_scrub_stamp":"2024-05-08T18:35:01.255984+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:31.249730+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:06.725851+0000","last_change":"2024-05-08T18:35:06.725876+0000","last_active":"2024-05-08T18:35:06.725851+0000","last_peered":"2024-05-08T18:35:06.725851+0000","last_clean":"2024-05-08T18:35:06.725851+0000","last_became_active":"2024-05-08T18:30:58.283402+0000","last_became_peered":"2024-05-08T18:30:58.283402+0000","last_unstale":"2024-05-08T18:35:06.725851+0000","last_undegraded":"2024-05-08T18:35:06.725851+0000","last_fullsized":"2024-05-08T18:35:06.725851+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:06.725759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:06.725759+0000","last_clean_scrub_stamp":"2024-05-08T18:35:06.725759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:32.654853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.819622+0000","last_change":"2024-05-08T18:34:27.819657+0000","last_active":"2024-05-08T18:34:27.819622+0000","last_peered":"2024-05-08T18:34:27.819622+0000","last_clean":"2024-05-08T18:34:27.819622+0000","last_became_active":"2024-05-08T18:31:02.291363+0000","last_became_peered":"2024-05-08T18:31:02.291363+0000","last_unstale":"2024-05-08T18:34:27.819622+0000","last_undegraded":"2024-05-08T18:34:27.819622+0000","last_fullsized":"2024-05-08T18:34:27.819622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:27.819512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:27.819512+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.819512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:11.229979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'33","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.643094+0000","last_change":"2024-05-08T18:34:30.643128+0000","last_active":"2024-05-08T18:34:30.643094+0000","last_peered":"2024-05-08T18:34:30.643094+0000","last_clean":"2024-05-08T18:34:30.643094+0000","last_became_active":"2024-05-08T18:31:04.298601+0000","last_became_peered":"2024-05-08T18:31:04.298601+0000","last_unstale":"2024-05-08T18:34:30.643094+0000","last_undegraded":"2024-05-08T18:34:30.643094+0000","last_fullsized":"2024-05-08T18:34:30.643094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2024-05-08T18:34:30.643006+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2024-05-08T18:34:30.643006+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.643006+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:15.159268+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":49,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:42.467334+0000","last_change":"2024-05-08T18:34:42.467363+0000","last_active":"2024-05-08T18:34:42.467334+0000","last_peered":"2024-05-08T18:34:42.467334+0000","last_clean":"2024-05-08T18:34:42.467334+0000","last_became_active":"2024-05-08T18:31:06.307801+0000","last_became_peered":"2024-05-08T18:31:06.307801+0000","last_unstale":"2024-05-08T18:34:42.467334+0000","last_undegraded":"2024-05-08T18:34:42.467334+0000","last_fullsized":"2024-05-08T18:34:42.467334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:42.467239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:42.467239+0000","last_clean_scrub_stamp":"2024-05-08T18:34:42.467239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:11.945138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.182134+0000","last_change":"2024-05-08T18:31:08.319580+0000","last_active":"2024-05-08T18:33:33.182134+0000","last_peered":"2024-05-08T18:33:33.182134+0000","last_clean":"2024-05-08T18:33:33.182134+0000","last_became_active":"2024-05-08T18:31:08.319232+0000","last_became_peered":"2024-05-08T18:31:08.319232+0000","last_unstale":"2024-05-08T18:33:33.182134+0000","last_undegraded":"2024-05-08T18:33:33.182134+0000","last_fullsized":"2024-05-08T18:33:33.182134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:42.804909+0000","last_change":"2024-05-08T18:34:42.804933+0000","last_active":"2024-05-08T18:34:42.804909+0000","last_peered":"2024-05-08T18:34:42.804909+0000","last_clean":"2024-05-08T18:34:42.804909+0000","last_became_active":"2024-05-08T18:31:00.282644+0000","last_became_peered":"2024-05-08T18:31:00.282644+0000","last_unstale":"2024-05-08T18:34:42.804909+0000","last_undegraded":"2024-05-08T18:34:42.804909+0000","last_fullsized":"2024-05-08T18:34:42.804909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:42.804809+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:42.804809+0000","last_clean_scrub_stamp":"2024-05-08T18:34:42.804809+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:20:23.898115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:07.775086+0000","last_change":"2024-05-08T18:35:07.775086+0000","last_active":"2024-05-08T18:35:07.775086+0000","last_peered":"2024-05-08T18:35:07.775086+0000","last_clean":"2024-05-08T18:35:07.775086+0000","last_became_active":"2024-05-08T18:30:58.303312+0000","last_became_peered":"2024-05-08T18:30:58.303312+0000","last_unstale":"2024-05-08T18:35:07.775086+0000","last_undegraded":"2024-05-08T18:35:07.775086+0000","last_fullsized":"2024-05-08T18:35:07.775086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:07.774913+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:07.774913+0000","last_clean_scrub_stamp":"2024-05-08T18:35:07.774913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:33.704007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'8","reported_seq":241,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:34.738076+0000","last_change":"2024-05-08T18:34:34.738123+0000","last_active":"2024-05-08T18:34:34.738076+0000","last_peered":"2024-05-08T18:34:34.738076+0000","last_clean":"2024-05-08T18:34:34.738076+0000","last_became_active":"2024-05-08T18:31:02.288433+0000","last_became_peered":"2024-05-08T18:31:02.288433+0000","last_unstale":"2024-05-08T18:34:34.738076+0000","last_undegraded":"2024-05-08T18:34:34.738076+0000","last_fullsized":"2024-05-08T18:34:34.738076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:34.737972+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:34.737972+0000","last_clean_scrub_stamp":"2024-05-08T18:34:34.737972+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:06.780418+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:34.593136+0000","last_change":"2024-05-08T18:34:34.593167+0000","last_active":"2024-05-08T18:34:34.593136+0000","last_peered":"2024-05-08T18:34:34.593136+0000","last_clean":"2024-05-08T18:34:34.593136+0000","last_became_active":"2024-05-08T18:31:04.298089+0000","last_became_peered":"2024-05-08T18:31:04.298089+0000","last_unstale":"2024-05-08T18:34:34.593136+0000","last_undegraded":"2024-05-08T18:34:34.593136+0000","last_fullsized":"2024-05-08T18:34:34.593136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-08T18:34:34.593039+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-08T18:34:34.593039+0000","last_clean_scrub_stamp":"2024-05-08T18:34:34.593039+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:54.680394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:37.668827+0000","last_change":"2024-05-08T18:34:37.668853+0000","last_active":"2024-05-08T18:34:37.668827+0000","last_peered":"2024-05-08T18:34:37.668827+0000","last_clean":"2024-05-08T18:34:37.668827+0000","last_became_active":"2024-05-08T18:31:06.311810+0000","last_became_peered":"2024-05-08T18:31:06.311810+0000","last_unstale":"2024-05-08T18:34:37.668827+0000","last_undegraded":"2024-05-08T18:34:37.668827+0000","last_fullsized":"2024-05-08T18:34:37.668827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:37.668735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:37.668735+0000","last_clean_scrub_stamp":"2024-05-08T18:34:37.668735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:25.055534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:06.325438+0000","last_change":"2024-05-08T18:35:06.325466+0000","last_active":"2024-05-08T18:35:06.325438+0000","last_peered":"2024-05-08T18:35:06.325438+0000","last_clean":"2024-05-08T18:35:06.325438+0000","last_became_active":"2024-05-08T18:31:08.316723+0000","last_became_peered":"2024-05-08T18:31:08.316723+0000","last_unstale":"2024-05-08T18:35:06.325438+0000","last_undegraded":"2024-05-08T18:35:06.325438+0000","last_fullsized":"2024-05-08T18:35:06.325438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:06.325330+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:06.325330+0000","last_clean_scrub_stamp":"2024-05-08T18:35:06.325330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:40.905872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178260+0000","last_change":"2024-05-08T18:31:45.346058+0000","last_active":"2024-05-08T18:33:13.178260+0000","last_peered":"2024-05-08T18:33:13.178260+0000","last_clean":"2024-05-08T18:33:13.178260+0000","last_became_active":"2024-05-08T18:31:45.339252+0000","last_became_peered":"2024-05-08T18:31:45.339252+0000","last_unstale":"2024-05-08T18:33:13.178260+0000","last_undegraded":"2024-05-08T18:33:13.178260+0000","last_fullsized":"2024-05-08T18:33:13.178260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:59.262687+0000","last_clean_scrub_stamp":"2024-05-08T18:30:59.262687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:45.897118+0000","last_change":"2024-05-08T18:34:45.897118+0000","last_active":"2024-05-08T18:34:45.897118+0000","last_peered":"2024-05-08T18:34:45.897118+0000","last_clean":"2024-05-08T18:34:45.897118+0000","last_became_active":"2024-05-08T18:30:58.308290+0000","last_became_peered":"2024-05-08T18:30:58.308290+0000","last_unstale":"2024-05-08T18:34:45.897118+0000","last_undegraded":"2024-05-08T18:34:45.897118+0000","last_fullsized":"2024-05-08T18:34:45.897118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:45.897004+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:45.897004+0000","last_clean_scrub_stamp":"2024-05-08T18:34:45.897004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:42.049005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:55.818904+0000","last_change":"2024-05-08T18:34:55.818929+0000","last_active":"2024-05-08T18:34:55.818904+0000","last_peered":"2024-05-08T18:34:55.818904+0000","last_clean":"2024-05-08T18:34:55.818904+0000","last_became_active":"2024-05-08T18:31:00.282889+0000","last_became_peered":"2024-05-08T18:31:00.282889+0000","last_unstale":"2024-05-08T18:34:55.818904+0000","last_undegraded":"2024-05-08T18:34:55.818904+0000","last_fullsized":"2024-05-08T18:34:55.818904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:55.818809+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:55.818809+0000","last_clean_scrub_stamp":"2024-05-08T18:34:55.818809+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:32.297670+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:48.628085+0000","last_change":"2024-05-08T18:34:48.628085+0000","last_active":"2024-05-08T18:34:48.628085+0000","last_peered":"2024-05-08T18:34:48.628085+0000","last_clean":"2024-05-08T18:34:48.628085+0000","last_became_active":"2024-05-08T18:30:58.294210+0000","last_became_peered":"2024-05-08T18:30:58.294210+0000","last_unstale":"2024-05-08T18:34:48.628085+0000","last_undegraded":"2024-05-08T18:34:48.628085+0000","last_fullsized":"2024-05-08T18:34:48.628085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:48.627966+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:48.627966+0000","last_clean_scrub_stamp":"2024-05-08T18:34:48.627966+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:09.762407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:53.379795+0000","last_change":"2024-05-08T18:34:53.379822+0000","last_active":"2024-05-08T18:34:53.379795+0000","last_peered":"2024-05-08T18:34:53.379795+0000","last_clean":"2024-05-08T18:34:53.379795+0000","last_became_active":"2024-05-08T18:31:00.295749+0000","last_became_peered":"2024-05-08T18:31:00.295749+0000","last_unstale":"2024-05-08T18:34:53.379795+0000","last_undegraded":"2024-05-08T18:34:53.379795+0000","last_fullsized":"2024-05-08T18:34:53.379795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:53.379693+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:53.379693+0000","last_clean_scrub_stamp":"2024-05-08T18:34:53.379693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:03.913931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.284468+0000","last_change":"2024-05-08T18:30:58.316506+0000","last_active":"2024-05-08T18:34:18.284468+0000","last_peered":"2024-05-08T18:34:18.284468+0000","last_clean":"2024-05-08T18:34:18.284468+0000","last_became_active":"2024-05-08T18:30:58.314786+0000","last_became_peered":"2024-05-08T18:30:58.314786+0000","last_unstale":"2024-05-08T18:34:18.284468+0000","last_undegraded":"2024-05-08T18:34:18.284468+0000","last_fullsized":"2024-05-08T18:34:18.284468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:53.768343+0000","last_change":"2024-05-08T18:34:53.768373+0000","last_active":"2024-05-08T18:34:53.768343+0000","last_peered":"2024-05-08T18:34:53.768343+0000","last_clean":"2024-05-08T18:34:53.768343+0000","last_became_active":"2024-05-08T18:31:00.282863+0000","last_became_peered":"2024-05-08T18:31:00.282863+0000","last_unstale":"2024-05-08T18:34:53.768343+0000","last_undegraded":"2024-05-08T18:34:53.768343+0000","last_fullsized":"2024-05-08T18:34:53.768343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:53.768253+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:53.768253+0000","last_clean_scrub_stamp":"2024-05-08T18:34:53.768253+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:55.153778+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'3","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:58.706266+0000","last_change":"2024-05-08T18:34:58.706266+0000","last_active":"2024-05-08T18:34:58.706266+0000","last_peered":"2024-05-08T18:34:58.706266+0000","last_clean":"2024-05-08T18:34:58.706266+0000","last_became_active":"2024-05-08T18:30:58.289337+0000","last_became_peered":"2024-05-08T18:30:58.289337+0000","last_unstale":"2024-05-08T18:34:58.706266+0000","last_undegraded":"2024-05-08T18:34:58.706266+0000","last_fullsized":"2024-05-08T18:34:58.706266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-08T18:34:58.706124+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-08T18:34:58.706124+0000","last_clean_scrub_stamp":"2024-05-08T18:34:58.706124+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:11.390893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'8","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:44.639287+0000","last_change":"2024-05-08T18:34:44.639287+0000","last_active":"2024-05-08T18:34:44.639287+0000","last_peered":"2024-05-08T18:34:44.639287+0000","last_clean":"2024-05-08T18:34:44.639287+0000","last_became_active":"2024-05-08T18:31:00.291269+0000","last_became_peered":"2024-05-08T18:31:00.291269+0000","last_unstale":"2024-05-08T18:34:44.639287+0000","last_undegraded":"2024-05-08T18:34:44.639287+0000","last_fullsized":"2024-05-08T18:34:44.639287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:44.639159+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:44.639159+0000","last_clean_scrub_stamp":"2024-05-08T18:34:44.639159+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:39.429539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:09.735475+0000","last_change":"2024-05-08T18:35:09.735499+0000","last_active":"2024-05-08T18:35:09.735475+0000","last_peered":"2024-05-08T18:35:09.735475+0000","last_clean":"2024-05-08T18:35:09.735475+0000","last_became_active":"2024-05-08T18:30:58.283976+0000","last_became_peered":"2024-05-08T18:30:58.283976+0000","last_unstale":"2024-05-08T18:35:09.735475+0000","last_undegraded":"2024-05-08T18:35:09.735475+0000","last_fullsized":"2024-05-08T18:35:09.735475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:09.735360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:09.735360+0000","last_clean_scrub_stamp":"2024-05-08T18:35:09.735360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:01.122007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:41.755623+0000","last_change":"2024-05-08T18:34:41.755623+0000","last_active":"2024-05-08T18:34:41.755623+0000","last_peered":"2024-05-08T18:34:41.755623+0000","last_clean":"2024-05-08T18:34:41.755623+0000","last_became_active":"2024-05-08T18:31:00.292385+0000","last_became_peered":"2024-05-08T18:31:00.292385+0000","last_unstale":"2024-05-08T18:34:41.755623+0000","last_undegraded":"2024-05-08T18:34:41.755623+0000","last_fullsized":"2024-05-08T18:34:41.755623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:41.755496+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:41.755496+0000","last_clean_scrub_stamp":"2024-05-08T18:34:41.755496+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:08:19.929979+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:06.799211+0000","last_change":"2024-05-08T18:35:06.799236+0000","last_active":"2024-05-08T18:35:06.799211+0000","last_peered":"2024-05-08T18:35:06.799211+0000","last_clean":"2024-05-08T18:35:06.799211+0000","last_became_active":"2024-05-08T18:30:58.303839+0000","last_became_peered":"2024-05-08T18:30:58.303839+0000","last_unstale":"2024-05-08T18:35:06.799211+0000","last_undegraded":"2024-05-08T18:35:06.799211+0000","last_fullsized":"2024-05-08T18:35:06.799211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:06.799126+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:06.799126+0000","last_clean_scrub_stamp":"2024-05-08T18:35:06.799126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'8","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:46.597867+0000","last_change":"2024-05-08T18:34:46.597867+0000","last_active":"2024-05-08T18:34:46.597867+0000","last_peered":"2024-05-08T18:34:46.597867+0000","last_clean":"2024-05-08T18:34:46.597867+0000","last_became_active":"2024-05-08T18:31:00.288202+0000","last_became_peered":"2024-05-08T18:31:00.288202+0000","last_unstale":"2024-05-08T18:34:46.597867+0000","last_undegraded":"2024-05-08T18:34:46.597867+0000","last_fullsized":"2024-05-08T18:34:46.597867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:46.597745+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:46.597745+0000","last_clean_scrub_stamp":"2024-05-08T18:34:46.597745+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:38.535670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:55.867100+0000","last_change":"2024-05-08T18:34:55.867126+0000","last_active":"2024-05-08T18:34:55.867100+0000","last_peered":"2024-05-08T18:34:55.867100+0000","last_clean":"2024-05-08T18:34:55.867100+0000","last_became_active":"2024-05-08T18:30:58.305116+0000","last_became_peered":"2024-05-08T18:30:58.305116+0000","last_unstale":"2024-05-08T18:34:55.867100+0000","last_undegraded":"2024-05-08T18:34:55.867100+0000","last_fullsized":"2024-05-08T18:34:55.867100+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:55.867010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:55.867010+0000","last_clean_scrub_stamp":"2024-05-08T18:34:55.867010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:11:07.742066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'4","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:10.786108+0000","last_change":"2024-05-08T18:35:10.786108+0000","last_active":"2024-05-08T18:35:10.786108+0000","last_peered":"2024-05-08T18:35:10.786108+0000","last_clean":"2024-05-08T18:35:10.786108+0000","last_became_active":"2024-05-08T18:31:00.284439+0000","last_became_peered":"2024-05-08T18:31:00.284439+0000","last_unstale":"2024-05-08T18:35:10.786108+0000","last_undegraded":"2024-05-08T18:35:10.786108+0000","last_fullsized":"2024-05-08T18:35:10.786108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:10.785970+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:10.785970+0000","last_clean_scrub_stamp":"2024-05-08T18:35:10.785970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:58.520232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:10.709116+0000","last_change":"2024-05-08T18:35:10.709145+0000","last_active":"2024-05-08T18:35:10.709116+0000","last_peered":"2024-05-08T18:35:10.709116+0000","last_clean":"2024-05-08T18:35:10.709116+0000","last_became_active":"2024-05-08T18:30:58.286930+0000","last_became_peered":"2024-05-08T18:30:58.286930+0000","last_unstale":"2024-05-08T18:35:10.709116+0000","last_undegraded":"2024-05-08T18:35:10.709116+0000","last_fullsized":"2024-05-08T18:35:10.709116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:10.709019+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:10.709019+0000","last_clean_scrub_stamp":"2024-05-08T18:35:10.709019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:50.588130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:58.663344+0000","last_change":"2024-05-08T18:34:58.663390+0000","last_active":"2024-05-08T18:34:58.663344+0000","last_peered":"2024-05-08T18:34:58.663344+0000","last_clean":"2024-05-08T18:34:58.663344+0000","last_became_active":"2024-05-08T18:31:00.282958+0000","last_became_peered":"2024-05-08T18:31:00.282958+0000","last_unstale":"2024-05-08T18:34:58.663344+0000","last_undegraded":"2024-05-08T18:34:58.663344+0000","last_fullsized":"2024-05-08T18:34:58.663344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:58.663254+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:58.663254+0000","last_clean_scrub_stamp":"2024-05-08T18:34:58.663254+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:32.546874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.177700+0000","last_change":"2024-05-08T18:30:58.305701+0000","last_active":"2024-05-08T18:33:08.177700+0000","last_peered":"2024-05-08T18:33:08.177700+0000","last_clean":"2024-05-08T18:33:08.177700+0000","last_became_active":"2024-05-08T18:30:58.302051+0000","last_became_peered":"2024-05-08T18:30:58.302051+0000","last_unstale":"2024-05-08T18:33:08.177700+0000","last_undegraded":"2024-05-08T18:33:08.177700+0000","last_fullsized":"2024-05-08T18:33:08.177700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:36.575212+0000","last_change":"2024-05-08T18:34:36.575238+0000","last_active":"2024-05-08T18:34:36.575212+0000","last_peered":"2024-05-08T18:34:36.575212+0000","last_clean":"2024-05-08T18:34:36.575212+0000","last_became_active":"2024-05-08T18:31:00.297787+0000","last_became_peered":"2024-05-08T18:31:00.297787+0000","last_unstale":"2024-05-08T18:34:36.575212+0000","last_undegraded":"2024-05-08T18:34:36.575212+0000","last_fullsized":"2024-05-08T18:34:36.575212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:36.575101+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:36.575101+0000","last_clean_scrub_stamp":"2024-05-08T18:34:36.575101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:18.442678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'4","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:07.731209+0000","last_change":"2024-05-08T18:35:07.731242+0000","last_active":"2024-05-08T18:35:07.731209+0000","last_peered":"2024-05-08T18:35:07.731209+0000","last_clean":"2024-05-08T18:35:07.731209+0000","last_became_active":"2024-05-08T18:30:58.284146+0000","last_became_peered":"2024-05-08T18:30:58.284146+0000","last_unstale":"2024-05-08T18:35:07.731209+0000","last_undegraded":"2024-05-08T18:35:07.731209+0000","last_fullsized":"2024-05-08T18:35:07.731209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:07.731120+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:07.731120+0000","last_clean_scrub_stamp":"2024-05-08T18:35:07.731120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:40:16.031619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'12","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:43.589648+0000","last_change":"2024-05-08T18:34:43.589692+0000","last_active":"2024-05-08T18:34:43.589648+0000","last_peered":"2024-05-08T18:34:43.589648+0000","last_clean":"2024-05-08T18:34:43.589648+0000","last_became_active":"2024-05-08T18:31:00.291399+0000","last_became_peered":"2024-05-08T18:31:00.291399+0000","last_unstale":"2024-05-08T18:34:43.589648+0000","last_undegraded":"2024-05-08T18:34:43.589648+0000","last_fullsized":"2024-05-08T18:34:43.589648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:43.589557+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:43.589557+0000","last_clean_scrub_stamp":"2024-05-08T18:34:43.589557+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:03.562149+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:57.674623+0000","last_change":"2024-05-08T18:34:57.674663+0000","last_active":"2024-05-08T18:34:57.674623+0000","last_peered":"2024-05-08T18:34:57.674623+0000","last_clean":"2024-05-08T18:34:57.674623+0000","last_became_active":"2024-05-08T18:30:58.305523+0000","last_became_peered":"2024-05-08T18:30:58.305523+0000","last_unstale":"2024-05-08T18:34:57.674623+0000","last_undegraded":"2024-05-08T18:34:57.674623+0000","last_fullsized":"2024-05-08T18:34:57.674623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:57.674531+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:57.674531+0000","last_clean_scrub_stamp":"2024-05-08T18:34:57.674531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:49.819400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'14","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:47.605732+0000","last_change":"2024-05-08T18:34:47.605779+0000","last_active":"2024-05-08T18:34:47.605732+0000","last_peered":"2024-05-08T18:34:47.605732+0000","last_clean":"2024-05-08T18:34:47.605732+0000","last_became_active":"2024-05-08T18:31:00.281199+0000","last_became_peered":"2024-05-08T18:31:00.281199+0000","last_unstale":"2024-05-08T18:34:47.605732+0000","last_undegraded":"2024-05-08T18:34:47.605732+0000","last_fullsized":"2024-05-08T18:34:47.605732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-08T18:34:47.605617+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-08T18:34:47.605617+0000","last_clean_scrub_stamp":"2024-05-08T18:34:47.605617+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:27.417542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:04.773882+0000","last_change":"2024-05-08T18:35:04.773925+0000","last_active":"2024-05-08T18:35:04.773882+0000","last_peered":"2024-05-08T18:35:04.773882+0000","last_clean":"2024-05-08T18:35:04.773882+0000","last_became_active":"2024-05-08T18:30:58.302218+0000","last_became_peered":"2024-05-08T18:30:58.302218+0000","last_unstale":"2024-05-08T18:35:04.773882+0000","last_undegraded":"2024-05-08T18:35:04.773882+0000","last_fullsized":"2024-05-08T18:35:04.773882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:04.773780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:04.773780+0000","last_clean_scrub_stamp":"2024-05-08T18:35:04.773780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:26.938636+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:38.713807+0000","last_change":"2024-05-08T18:34:38.713843+0000","last_active":"2024-05-08T18:34:38.713807+0000","last_peered":"2024-05-08T18:34:38.713807+0000","last_clean":"2024-05-08T18:34:38.713807+0000","last_became_active":"2024-05-08T18:31:00.294146+0000","last_became_peered":"2024-05-08T18:31:00.294146+0000","last_unstale":"2024-05-08T18:34:38.713807+0000","last_undegraded":"2024-05-08T18:34:38.713807+0000","last_fullsized":"2024-05-08T18:34:38.713807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:38.713718+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:38.713718+0000","last_clean_scrub_stamp":"2024-05-08T18:34:38.713718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:03.774145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:11.344687+0000","last_change":"2024-05-08T18:35:11.344730+0000","last_active":"2024-05-08T18:35:11.344687+0000","last_peered":"2024-05-08T18:35:11.344687+0000","last_clean":"2024-05-08T18:35:11.344687+0000","last_became_active":"2024-05-08T18:30:58.314388+0000","last_became_peered":"2024-05-08T18:30:58.314388+0000","last_unstale":"2024-05-08T18:35:11.344687+0000","last_undegraded":"2024-05-08T18:35:11.344687+0000","last_fullsized":"2024-05-08T18:35:11.344687+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:11.344574+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:11.344574+0000","last_clean_scrub_stamp":"2024-05-08T18:35:11.344574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:49:14.135686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:54.661141+0000","last_change":"2024-05-08T18:34:54.661169+0000","last_active":"2024-05-08T18:34:54.661141+0000","last_peered":"2024-05-08T18:34:54.661141+0000","last_clean":"2024-05-08T18:34:54.661141+0000","last_became_active":"2024-05-08T18:31:00.281847+0000","last_became_peered":"2024-05-08T18:31:00.281847+0000","last_unstale":"2024-05-08T18:34:54.661141+0000","last_undegraded":"2024-05-08T18:34:54.661141+0000","last_fullsized":"2024-05-08T18:34:54.661141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:54.661048+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:54.661048+0000","last_clean_scrub_stamp":"2024-05-08T18:34:54.661048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:14.748403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.178661+0000","last_change":"2024-05-08T18:30:58.309703+0000","last_active":"2024-05-08T18:33:13.178661+0000","last_peered":"2024-05-08T18:33:13.178661+0000","last_clean":"2024-05-08T18:33:13.178661+0000","last_became_active":"2024-05-08T18:30:58.309203+0000","last_became_peered":"2024-05-08T18:30:58.309203+0000","last_unstale":"2024-05-08T18:33:13.178661+0000","last_undegraded":"2024-05-08T18:33:13.178661+0000","last_fullsized":"2024-05-08T18:33:13.178661+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'16","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:55.365253+0000","last_change":"2024-05-08T18:34:55.365295+0000","last_active":"2024-05-08T18:34:55.365253+0000","last_peered":"2024-05-08T18:34:55.365253+0000","last_clean":"2024-05-08T18:34:55.365253+0000","last_became_active":"2024-05-08T18:31:00.296240+0000","last_became_peered":"2024-05-08T18:31:00.296240+0000","last_unstale":"2024-05-08T18:34:55.365253+0000","last_undegraded":"2024-05-08T18:34:55.365253+0000","last_fullsized":"2024-05-08T18:34:55.365253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T18:34:55.365128+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T18:34:55.365128+0000","last_clean_scrub_stamp":"2024-05-08T18:34:55.365128+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:53.044461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:53.889999+0000","last_change":"2024-05-08T18:34:53.890035+0000","last_active":"2024-05-08T18:34:53.889999+0000","last_peered":"2024-05-08T18:34:53.889999+0000","last_clean":"2024-05-08T18:34:53.889999+0000","last_became_active":"2024-05-08T18:30:58.305572+0000","last_became_peered":"2024-05-08T18:30:58.305572+0000","last_unstale":"2024-05-08T18:34:53.889999+0000","last_undegraded":"2024-05-08T18:34:53.889999+0000","last_fullsized":"2024-05-08T18:34:53.889999+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:53.889909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:53.889909+0000","last_clean_scrub_stamp":"2024-05-08T18:34:53.889909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.862500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'12","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:50.632409+0000","last_change":"2024-05-08T18:34:50.632438+0000","last_active":"2024-05-08T18:34:50.632409+0000","last_peered":"2024-05-08T18:34:50.632409+0000","last_clean":"2024-05-08T18:34:50.632409+0000","last_became_active":"2024-05-08T18:31:00.282414+0000","last_became_peered":"2024-05-08T18:31:00.282414+0000","last_unstale":"2024-05-08T18:34:50.632409+0000","last_undegraded":"2024-05-08T18:34:50.632409+0000","last_fullsized":"2024-05-08T18:34:50.632409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:50.632283+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:50.632283+0000","last_clean_scrub_stamp":"2024-05-08T18:34:50.632283+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:35.148546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.926883+0000","last_change":"2024-05-08T18:30:58.308682+0000","last_active":"2024-05-08T18:34:13.926883+0000","last_peered":"2024-05-08T18:34:13.926883+0000","last_clean":"2024-05-08T18:34:13.926883+0000","last_became_active":"2024-05-08T18:30:58.304591+0000","last_became_peered":"2024-05-08T18:30:58.304591+0000","last_unstale":"2024-05-08T18:34:13.926883+0000","last_undegraded":"2024-05-08T18:34:13.926883+0000","last_fullsized":"2024-05-08T18:34:13.926883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:13.926923+0000","last_change":"2024-05-08T18:30:58.304754+0000","last_active":"2024-05-08T18:34:13.926923+0000","last_peered":"2024-05-08T18:34:13.926923+0000","last_clean":"2024-05-08T18:34:13.926923+0000","last_became_active":"2024-05-08T18:30:58.303443+0000","last_became_peered":"2024-05-08T18:30:58.303443+0000","last_unstale":"2024-05-08T18:34:13.926923+0000","last_undegraded":"2024-05-08T18:34:13.926923+0000","last_fullsized":"2024-05-08T18:34:13.926923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'12","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:11.731246+0000","last_change":"2024-05-08T18:35:11.731274+0000","last_active":"2024-05-08T18:35:11.731246+0000","last_peered":"2024-05-08T18:35:11.731246+0000","last_clean":"2024-05-08T18:35:11.731246+0000","last_became_active":"2024-05-08T18:31:00.288250+0000","last_became_peered":"2024-05-08T18:31:00.288250+0000","last_unstale":"2024-05-08T18:35:11.731246+0000","last_undegraded":"2024-05-08T18:35:11.731246+0000","last_fullsized":"2024-05-08T18:35:11.731246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:35:11.731157+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:35:11.731157+0000","last_clean_scrub_stamp":"2024-05-08T18:35:11.731157+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:38:05.913388+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:08.772135+0000","last_change":"2024-05-08T18:35:08.772168+0000","last_active":"2024-05-08T18:35:08.772135+0000","last_peered":"2024-05-08T18:35:08.772135+0000","last_clean":"2024-05-08T18:35:08.772135+0000","last_became_active":"2024-05-08T18:30:58.284090+0000","last_became_peered":"2024-05-08T18:30:58.284090+0000","last_unstale":"2024-05-08T18:35:08.772135+0000","last_undegraded":"2024-05-08T18:35:08.772135+0000","last_fullsized":"2024-05-08T18:35:08.772135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:08.772024+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:08.772024+0000","last_clean_scrub_stamp":"2024-05-08T18:35:08.772024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:53.551363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:45.638589+0000","last_change":"2024-05-08T18:34:45.638617+0000","last_active":"2024-05-08T18:34:45.638589+0000","last_peered":"2024-05-08T18:34:45.638589+0000","last_clean":"2024-05-08T18:34:45.638589+0000","last_became_active":"2024-05-08T18:31:00.291650+0000","last_became_peered":"2024-05-08T18:31:00.291650+0000","last_unstale":"2024-05-08T18:34:45.638589+0000","last_undegraded":"2024-05-08T18:34:45.638589+0000","last_fullsized":"2024-05-08T18:34:45.638589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:45.638483+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:45.638483+0000","last_clean_scrub_stamp":"2024-05-08T18:34:45.638483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:17:56.483101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705720,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":136192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705721,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40444,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331396,"statfs":{"total":96636764160,"available":96595349504,"internally_reserved":0,"allocated":970752,"data_stored":724145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705720,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36304,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335536,"statfs":{"total":96636764160,"available":96599588864,"internally_reserved":0,"allocated":991232,"data_stored":724633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":409600,"data_stored":135044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:35:19.827 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.827 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.827 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.828 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.828 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.828 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.828 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.828 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.829 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.829 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.829 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.829 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.829 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.829 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.830 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.830 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.830 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.830 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.830 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-08T18:31:01.269269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.830 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.831 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.831 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.831 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.831 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.831 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.831 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.831 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T18:30:48.974503+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.832 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.832 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.832 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.832 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.832 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.833 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.833 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.833 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.833 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.833 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.833 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-08T18:30:59.262687+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.834 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.834 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.834 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.834 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.834 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:19.834 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:35:39.835 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:35:39.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.954+0000 7f9b39b52640 1 Processor -- start 2024-05-08T18:35:39.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.954+0000 7f9b39b52640 1 -- start start 2024-05-08T18:35:39.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.954+0000 7f9b39b52640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9b34130520 0x7f9b34132910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:35:39.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.954+0000 7f9b39b52640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b3412d590 con 0x7f9b3412d1b0 2024-05-08T18:35:39.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.954+0000 7f9b39b52640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f9b34114de0 con 0x7f9b34130520 2024-05-08T18:35:39.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.954+0000 7f9b32ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9b34130520 0x7f9b34132910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:35:39.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.954+0000 7f9b337fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9b3412d1b0 0x7f9b3412d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53836/0 (socket says 172.21.15.53:53836) 2024-05-08T18:35:39.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.954+0000 7f9b32ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9b34130520 0x7f9b34132910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34814/0 (socket says 172.21.15.53:34814) 2024-05-08T18:35:39.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.954+0000 7f9b337fe640 1 -- 172.21.15.53:0/60295555 learned_addr learned my addr 172.21.15.53:0/60295555 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:35:39.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.955+0000 7f9b32ffd640 1 -- 172.21.15.53:0/60295555 >> v1:172.21.15.53:6789/0 conn(0x7f9b3412d1b0 legacy=0x7f9b3412d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:35:39.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.955+0000 7f9b32ffd640 1 -- 172.21.15.53:0/60295555 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b34113c30 con 0x7f9b34130520 2024-05-08T18:35:39.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.955+0000 7f9b327fc640 1 -- 172.21.15.53:0/60295555 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2675983149 0 0) 0x7f9b3412d590 con 0x7f9b3412d1b0 2024-05-08T18:35:39.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.955+0000 7f9b32ffd640 1 --2- 172.21.15.53:0/60295555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b34130520 0x7f9b34132910 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009720 tx=0x7f9b2802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897e92d083b97a59 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:35:39.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.956+0000 7f9b327fc640 1 -- 172.21.15.53:0/60295555 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b280316d0 con 0x7f9b34130520 2024-05-08T18:35:39.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.956+0000 7f9b327fc640 1 -- 172.21.15.53:0/60295555 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b28037070 con 0x7f9b34130520 2024-05-08T18:35:39.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.956+0000 7f9b327fc640 1 -- 172.21.15.53:0/60295555 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b280319c0 con 0x7f9b34130520 2024-05-08T18:35:39.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.956+0000 7f9b39b52640 1 -- 172.21.15.53:0/60295555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b34130520 msgr2=0x7f9b34132910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:35:39.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.956+0000 7f9b39b52640 1 --2- 172.21.15.53:0/60295555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b34130520 0x7f9b34132910 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009720 tx=0x7f9b2802b840 comp rx=0 tx=0).stop 2024-05-08T18:35:39.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.956+0000 7f9b39b52640 1 -- 172.21.15.53:0/60295555 shutdown_connections 2024-05-08T18:35:39.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.956+0000 7f9b39b52640 1 --2- 172.21.15.53:0/60295555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b34130520 0x7f9b34132910 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:35:39.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.956+0000 7f9b39b52640 1 -- 172.21.15.53:0/60295555 >> 172.21.15.53:0/60295555 conn(0x7f9b3409a910 msgr2=0x7f9b3406e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:35:39.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.956+0000 7f9b39b52640 1 -- 172.21.15.53:0/60295555 shutdown_connections 2024-05-08T18:35:39.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.956+0000 7f9b39b52640 1 -- 172.21.15.53:0/60295555 wait complete. 2024-05-08T18:35:39.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.957+0000 7f9b39b52640 1 Processor -- start 2024-05-08T18:35:39.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.957+0000 7f9b39b52640 1 -- start start 2024-05-08T18:35:39.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.958+0000 7f9b39b52640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3412d1b0 0x7f9b34122810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:35:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.958+0000 7f9b39b52640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9b34132fd0 con 0x7f9b3412d1b0 2024-05-08T18:35:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.958+0000 7f9b337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3412d1b0 0x7f9b34122810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:35:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.958+0000 7f9b337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3412d1b0 0x7f9b34122810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34828/0 (socket says 172.21.15.53:34828) 2024-05-08T18:35:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.958+0000 7f9b337fe640 1 -- 172.21.15.53:0/3761301940 learned_addr learned my addr 172.21.15.53:0/3761301940 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:35:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.958+0000 7f9b337fe640 1 -- 172.21.15.53:0/3761301940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b34115900 con 0x7f9b3412d1b0 2024-05-08T18:35:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.958+0000 7f9b337fe640 1 --2- 172.21.15.53:0/3761301940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3412d1b0 0x7f9b34122810 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400c420 tx=0x7f9b2400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:35:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.958+0000 7f9b1bfff640 1 -- 172.21.15.53:0/3761301940 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b24018070 con 0x7f9b3412d1b0 2024-05-08T18:35:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.958+0000 7f9b1bfff640 1 -- 172.21.15.53:0/3761301940 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b240074d0 con 0x7f9b3412d1b0 2024-05-08T18:35:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.958+0000 7f9b39b52640 1 -- 172.21.15.53:0/3761301940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3412a520 con 0x7f9b3412d1b0 2024-05-08T18:35:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.959+0000 7f9b1bfff640 1 -- 172.21.15.53:0/3761301940 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b24004950 con 0x7f9b3412d1b0 2024-05-08T18:35:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.959+0000 7f9b39b52640 1 -- 172.21.15.53:0/3761301940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b34122d50 con 0x7f9b3412d1b0 2024-05-08T18:35:39.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.959+0000 7f9b1bfff640 1 -- 172.21.15.53:0/3761301940 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9b2401b070 con 0x7f9b3412d1b0 2024-05-08T18:35:39.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.960+0000 7f9b1bfff640 1 --2- 172.21.15.53:0/3761301940 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b2003d2b0 0x7f9b2003f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:35:39.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.960+0000 7f9b39b52640 1 -- 172.21.15.53:0/3761301940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b34115500 con 0x7f9b3412d1b0 2024-05-08T18:35:39.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.960+0000 7f9b1bfff640 1 -- 172.21.15.53:0/3761301940 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f9b24051280 con 0x7f9b3412d1b0 2024-05-08T18:35:39.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.960+0000 7f9b32ffd640 1 --2- 172.21.15.53:0/3761301940 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b2003d2b0 0x7f9b2003f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:35:39.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.961+0000 7f9b32ffd640 1 --2- 172.21.15.53:0/3761301940 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b2003d2b0 0x7f9b2003f770 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9b28036000 tx=0x7f9b28008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:35:39.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:39.965+0000 7f9b1bfff640 1 -- 172.21.15.53:0/3761301940 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9b24010300 con 0x7f9b3412d1b0 2024-05-08T18:35:40.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:40.149+0000 7f9b39b52640 1 -- 172.21.15.53:0/3761301940 --> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9b34115160 con 0x7f9b2003d2b0 2024-05-08T18:35:40.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:40.164+0000 7f9b1bfff640 1 -- 172.21.15.53:0/3761301940 <== mgr.4102 v2:172.21.15.87:6824/211215191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665896 (secure 0 0 0) 0x7f9b34115160 con 0x7f9b2003d2b0 2024-05-08T18:35:40.171 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:35:40.177 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:35:40.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:40.169+0000 7f9b39b52640 1 -- 172.21.15.53:0/3761301940 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b2003d2b0 msgr2=0x7f9b2003f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:35:40.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:40.169+0000 7f9b39b52640 1 --2- 172.21.15.53:0/3761301940 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b2003d2b0 0x7f9b2003f770 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9b28036000 tx=0x7f9b28008030 comp rx=0 tx=0).stop 2024-05-08T18:35:40.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:40.169+0000 7f9b39b52640 1 -- 172.21.15.53:0/3761301940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3412d1b0 msgr2=0x7f9b34122810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:35:40.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:40.169+0000 7f9b39b52640 1 --2- 172.21.15.53:0/3761301940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3412d1b0 0x7f9b34122810 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400c420 tx=0x7f9b2400c8e0 comp rx=0 tx=0).stop 2024-05-08T18:35:40.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:40.169+0000 7f9b39b52640 1 -- 172.21.15.53:0/3761301940 shutdown_connections 2024-05-08T18:35:40.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:40.169+0000 7f9b39b52640 1 --2- 172.21.15.53:0/3761301940 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f9b2003d2b0 0x7f9b2003f770 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:35:40.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:40.169+0000 7f9b39b52640 1 --2- 172.21.15.53:0/3761301940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3412d1b0 0x7f9b34122810 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:35:40.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:40.169+0000 7f9b39b52640 1 -- 172.21.15.53:0/3761301940 >> 172.21.15.53:0/3761301940 conn(0x7f9b3409a910 msgr2=0x7f9b3412ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:35:40.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:40.169+0000 7f9b39b52640 1 -- 172.21.15.53:0/3761301940 shutdown_connections 2024-05-08T18:35:40.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:35:40.169+0000 7f9b39b52640 1 -- 172.21.15.53:0/3761301940 wait complete. 2024-05-08T18:35:40.181 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2024-05-08T18:35:38.192917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5055,"num_read_kb":4641,"num_write":2119,"num_write_kb":60585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4738,"ondisk_log_size":4738,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148248,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339112,"statfs":{"total":386547056640,"available":386395250688,"internally_reserved":0,"allocated":2809856,"data_stored":1720014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004282"},"pg_stats":[{"pgid":"3.3f","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:57.851976+0000","last_change":"2024-05-08T18:34:57.851976+0000","last_active":"2024-05-08T18:34:57.851976+0000","last_peered":"2024-05-08T18:34:57.851976+0000","last_clean":"2024-05-08T18:34:57.851976+0000","last_became_active":"2024-05-08T18:30:58.305175+0000","last_became_peered":"2024-05-08T18:30:58.305175+0000","last_unstale":"2024-05-08T18:34:57.851976+0000","last_undegraded":"2024-05-08T18:34:57.851976+0000","last_fullsized":"2024-05-08T18:34:57.851976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:57.851844+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:57.851844+0000","last_clean_scrub_stamp":"2024-05-08T18:34:57.851844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:37.663769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'8","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:00.657644+0000","last_change":"2024-05-08T18:35:00.657698+0000","last_active":"2024-05-08T18:35:00.657644+0000","last_peered":"2024-05-08T18:35:00.657644+0000","last_clean":"2024-05-08T18:35:00.657644+0000","last_became_active":"2024-05-08T18:31:00.284574+0000","last_became_peered":"2024-05-08T18:31:00.284574+0000","last_unstale":"2024-05-08T18:35:00.657644+0000","last_undegraded":"2024-05-08T18:35:00.657644+0000","last_fullsized":"2024-05-08T18:35:00.657644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:35:00.657541+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:35:00.657541+0000","last_clean_scrub_stamp":"2024-05-08T18:35:00.657541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:37.359769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:00.642294+0000","last_change":"2024-05-08T18:35:00.642294+0000","last_active":"2024-05-08T18:35:00.642294+0000","last_peered":"2024-05-08T18:35:00.642294+0000","last_clean":"2024-05-08T18:35:00.642294+0000","last_became_active":"2024-05-08T18:30:58.288674+0000","last_became_peered":"2024-05-08T18:30:58.288674+0000","last_unstale":"2024-05-08T18:35:00.642294+0000","last_undegraded":"2024-05-08T18:35:00.642294+0000","last_fullsized":"2024-05-08T18:35:00.642294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:00.642171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:00.642171+0000","last_clean_scrub_stamp":"2024-05-08T18:35:00.642171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:52.334568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:37.548543+0000","last_change":"2024-05-08T18:34:37.548605+0000","last_active":"2024-05-08T18:34:37.548543+0000","last_peered":"2024-05-08T18:34:37.548543+0000","last_clean":"2024-05-08T18:34:37.548543+0000","last_became_active":"2024-05-08T18:31:00.298145+0000","last_became_peered":"2024-05-08T18:31:00.298145+0000","last_unstale":"2024-05-08T18:34:37.548543+0000","last_undegraded":"2024-05-08T18:34:37.548543+0000","last_fullsized":"2024-05-08T18:34:37.548543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:34:37.548430+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:34:37.548430+0000","last_clean_scrub_stamp":"2024-05-08T18:34:37.548430+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:11.432050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:25.408395+0000","last_change":"2024-05-08T18:35:25.408446+0000","last_active":"2024-05-08T18:35:25.408395+0000","last_peered":"2024-05-08T18:35:25.408395+0000","last_clean":"2024-05-08T18:35:25.408395+0000","last_became_active":"2024-05-08T18:30:58.304442+0000","last_became_peered":"2024-05-08T18:30:58.304442+0000","last_unstale":"2024-05-08T18:35:25.408395+0000","last_undegraded":"2024-05-08T18:35:25.408395+0000","last_fullsized":"2024-05-08T18:35:25.408395+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:25.408286+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:25.408286+0000","last_clean_scrub_stamp":"2024-05-08T18:35:25.408286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:37:59.786769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'10","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:52.416583+0000","last_change":"2024-05-08T18:34:52.416630+0000","last_active":"2024-05-08T18:34:52.416583+0000","last_peered":"2024-05-08T18:34:52.416583+0000","last_clean":"2024-05-08T18:34:52.416583+0000","last_became_active":"2024-05-08T18:31:00.297810+0000","last_became_peered":"2024-05-08T18:31:00.297810+0000","last_unstale":"2024-05-08T18:34:52.416583+0000","last_undegraded":"2024-05-08T18:34:52.416583+0000","last_fullsized":"2024-05-08T18:34:52.416583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:34:52.416478+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:34:52.416478+0000","last_clean_scrub_stamp":"2024-05-08T18:34:52.416478+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:32.357386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:59.863278+0000","last_change":"2024-05-08T18:34:59.863300+0000","last_active":"2024-05-08T18:34:59.863278+0000","last_peered":"2024-05-08T18:34:59.863278+0000","last_clean":"2024-05-08T18:34:59.863278+0000","last_became_active":"2024-05-08T18:30:58.295569+0000","last_became_peered":"2024-05-08T18:30:58.295569+0000","last_unstale":"2024-05-08T18:34:59.863278+0000","last_undegraded":"2024-05-08T18:34:59.863278+0000","last_fullsized":"2024-05-08T18:34:59.863278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:59.863190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:59.863190+0000","last_clean_scrub_stamp":"2024-05-08T18:34:59.863190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:44.379452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:59.340771+0000","last_change":"2024-05-08T18:34:59.340801+0000","last_active":"2024-05-08T18:34:59.340771+0000","last_peered":"2024-05-08T18:34:59.340771+0000","last_clean":"2024-05-08T18:34:59.340771+0000","last_became_active":"2024-05-08T18:31:00.295611+0000","last_became_peered":"2024-05-08T18:31:00.295611+0000","last_unstale":"2024-05-08T18:34:59.340771+0000","last_undegraded":"2024-05-08T18:34:59.340771+0000","last_fullsized":"2024-05-08T18:34:59.340771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:59.340664+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:59.340664+0000","last_clean_scrub_stamp":"2024-05-08T18:34:59.340664+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:43.577418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:16.329413+0000","last_change":"2024-05-08T18:35:16.329442+0000","last_active":"2024-05-08T18:35:16.329413+0000","last_peered":"2024-05-08T18:35:16.329413+0000","last_clean":"2024-05-08T18:35:16.329413+0000","last_became_active":"2024-05-08T18:30:58.313003+0000","last_became_peered":"2024-05-08T18:30:58.313003+0000","last_unstale":"2024-05-08T18:35:16.329413+0000","last_undegraded":"2024-05-08T18:35:16.329413+0000","last_fullsized":"2024-05-08T18:35:16.329413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:16.329315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:16.329315+0000","last_clean_scrub_stamp":"2024-05-08T18:35:16.329315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:39.163134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'4","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:46.649407+0000","last_change":"2024-05-08T18:34:46.649407+0000","last_active":"2024-05-08T18:34:46.649407+0000","last_peered":"2024-05-08T18:34:46.649407+0000","last_clean":"2024-05-08T18:34:46.649407+0000","last_became_active":"2024-05-08T18:31:00.281065+0000","last_became_peered":"2024-05-08T18:31:00.281065+0000","last_unstale":"2024-05-08T18:34:46.649407+0000","last_undegraded":"2024-05-08T18:34:46.649407+0000","last_fullsized":"2024-05-08T18:34:46.649407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:34:46.649258+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:34:46.649258+0000","last_clean_scrub_stamp":"2024-05-08T18:34:46.649258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:36.416236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:47.845721+0000","last_change":"2024-05-08T18:34:47.845746+0000","last_active":"2024-05-08T18:34:47.845721+0000","last_peered":"2024-05-08T18:34:47.845721+0000","last_clean":"2024-05-08T18:34:47.845721+0000","last_became_active":"2024-05-08T18:30:58.307687+0000","last_became_peered":"2024-05-08T18:30:58.307687+0000","last_unstale":"2024-05-08T18:34:47.845721+0000","last_undegraded":"2024-05-08T18:34:47.845721+0000","last_fullsized":"2024-05-08T18:34:47.845721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:47.845617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:47.845617+0000","last_clean_scrub_stamp":"2024-05-08T18:34:47.845617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:35.232416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'12","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:35.603652+0000","last_change":"2024-05-08T18:34:35.603652+0000","last_active":"2024-05-08T18:34:35.603652+0000","last_peered":"2024-05-08T18:34:35.603652+0000","last_clean":"2024-05-08T18:34:35.603652+0000","last_became_active":"2024-05-08T18:31:00.298978+0000","last_became_peered":"2024-05-08T18:31:00.298978+0000","last_unstale":"2024-05-08T18:34:35.603652+0000","last_undegraded":"2024-05-08T18:34:35.603652+0000","last_fullsized":"2024-05-08T18:34:35.603652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:35.603538+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:35.603538+0000","last_clean_scrub_stamp":"2024-05-08T18:34:35.603538+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.163546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:15.327281+0000","last_change":"2024-05-08T18:35:15.327309+0000","last_active":"2024-05-08T18:35:15.327281+0000","last_peered":"2024-05-08T18:35:15.327281+0000","last_clean":"2024-05-08T18:35:15.327281+0000","last_became_active":"2024-05-08T18:30:58.308931+0000","last_became_peered":"2024-05-08T18:30:58.308931+0000","last_unstale":"2024-05-08T18:35:15.327281+0000","last_undegraded":"2024-05-08T18:35:15.327281+0000","last_fullsized":"2024-05-08T18:35:15.327281+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:15.327191+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:15.327191+0000","last_clean_scrub_stamp":"2024-05-08T18:35:15.327191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:13.790526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'10","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:56.873085+0000","last_change":"2024-05-08T18:34:56.873085+0000","last_active":"2024-05-08T18:34:56.873085+0000","last_peered":"2024-05-08T18:34:56.873085+0000","last_clean":"2024-05-08T18:34:56.873085+0000","last_became_active":"2024-05-08T18:31:00.295472+0000","last_became_peered":"2024-05-08T18:31:00.295472+0000","last_unstale":"2024-05-08T18:34:56.873085+0000","last_undegraded":"2024-05-08T18:34:56.873085+0000","last_fullsized":"2024-05-08T18:34:56.873085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:56.872968+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:56.872968+0000","last_clean_scrub_stamp":"2024-05-08T18:34:56.872968+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:48.810892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:52.757826+0000","last_change":"2024-05-08T18:34:52.757867+0000","last_active":"2024-05-08T18:34:52.757826+0000","last_peered":"2024-05-08T18:34:52.757826+0000","last_clean":"2024-05-08T18:34:52.757826+0000","last_became_active":"2024-05-08T18:30:58.294511+0000","last_became_peered":"2024-05-08T18:30:58.294511+0000","last_unstale":"2024-05-08T18:34:52.757826+0000","last_undegraded":"2024-05-08T18:34:52.757826+0000","last_fullsized":"2024-05-08T18:34:52.757826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:52.757734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:52.757734+0000","last_clean_scrub_stamp":"2024-05-08T18:34:52.757734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:46.902960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'4","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:48.805144+0000","last_change":"2024-05-08T18:34:48.805144+0000","last_active":"2024-05-08T18:34:48.805144+0000","last_peered":"2024-05-08T18:34:48.805144+0000","last_clean":"2024-05-08T18:34:48.805144+0000","last_became_active":"2024-05-08T18:31:00.291203+0000","last_became_peered":"2024-05-08T18:31:00.291203+0000","last_unstale":"2024-05-08T18:34:48.805144+0000","last_undegraded":"2024-05-08T18:34:48.805144+0000","last_fullsized":"2024-05-08T18:34:48.805144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:48.804997+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:48.804997+0000","last_clean_scrub_stamp":"2024-05-08T18:34:48.804997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:13.865424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:07.345913+0000","last_change":"2024-05-08T18:35:07.345938+0000","last_active":"2024-05-08T18:35:07.345913+0000","last_peered":"2024-05-08T18:35:07.345913+0000","last_clean":"2024-05-08T18:35:07.345913+0000","last_became_active":"2024-05-08T18:31:00.290806+0000","last_became_peered":"2024-05-08T18:31:00.290806+0000","last_unstale":"2024-05-08T18:35:07.345913+0000","last_undegraded":"2024-05-08T18:35:07.345913+0000","last_fullsized":"2024-05-08T18:35:07.345913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:07.345824+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:07.345824+0000","last_clean_scrub_stamp":"2024-05-08T18:35:07.345824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:28.605906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:59.618993+0000","last_change":"2024-05-08T18:34:59.619045+0000","last_active":"2024-05-08T18:34:59.618993+0000","last_peered":"2024-05-08T18:34:59.618993+0000","last_clean":"2024-05-08T18:34:59.618993+0000","last_became_active":"2024-05-08T18:30:58.304685+0000","last_became_peered":"2024-05-08T18:30:58.304685+0000","last_unstale":"2024-05-08T18:34:59.618993+0000","last_undegraded":"2024-05-08T18:34:59.618993+0000","last_fullsized":"2024-05-08T18:34:59.618993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:59.618879+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:59.618879+0000","last_clean_scrub_stamp":"2024-05-08T18:34:59.618879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:12.303648+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'14","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:52.646305+0000","last_change":"2024-05-08T18:34:52.646329+0000","last_active":"2024-05-08T18:34:52.646305+0000","last_peered":"2024-05-08T18:34:52.646305+0000","last_clean":"2024-05-08T18:34:52.646305+0000","last_became_active":"2024-05-08T18:31:00.281816+0000","last_became_peered":"2024-05-08T18:31:00.281816+0000","last_unstale":"2024-05-08T18:34:52.646305+0000","last_undegraded":"2024-05-08T18:34:52.646305+0000","last_fullsized":"2024-05-08T18:34:52.646305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-05-08T18:34:52.646217+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-05-08T18:34:52.646217+0000","last_clean_scrub_stamp":"2024-05-08T18:34:52.646217+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:59.267706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:49.823572+0000","last_change":"2024-05-08T18:34:49.823601+0000","last_active":"2024-05-08T18:34:49.823572+0000","last_peered":"2024-05-08T18:34:49.823572+0000","last_clean":"2024-05-08T18:34:49.823572+0000","last_became_active":"2024-05-08T18:30:58.306545+0000","last_became_peered":"2024-05-08T18:30:58.306545+0000","last_unstale":"2024-05-08T18:34:49.823572+0000","last_undegraded":"2024-05-08T18:34:49.823572+0000","last_fullsized":"2024-05-08T18:34:49.823572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:49.823481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:49.823481+0000","last_clean_scrub_stamp":"2024-05-08T18:34:49.823481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:44.587517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'16","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:56.719741+0000","last_change":"2024-05-08T18:34:56.719785+0000","last_active":"2024-05-08T18:34:56.719741+0000","last_peered":"2024-05-08T18:34:56.719741+0000","last_clean":"2024-05-08T18:34:56.719741+0000","last_became_active":"2024-05-08T18:31:00.283048+0000","last_became_peered":"2024-05-08T18:31:00.283048+0000","last_unstale":"2024-05-08T18:34:56.719741+0000","last_undegraded":"2024-05-08T18:34:56.719741+0000","last_fullsized":"2024-05-08T18:34:56.719741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T18:34:56.719626+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T18:34:56.719626+0000","last_clean_scrub_stamp":"2024-05-08T18:34:56.719626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:52.054400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:05.812246+0000","last_change":"2024-05-08T18:35:05.812269+0000","last_active":"2024-05-08T18:35:05.812246+0000","last_peered":"2024-05-08T18:35:05.812246+0000","last_clean":"2024-05-08T18:35:05.812246+0000","last_became_active":"2024-05-08T18:30:58.302245+0000","last_became_peered":"2024-05-08T18:30:58.302245+0000","last_unstale":"2024-05-08T18:35:05.812246+0000","last_undegraded":"2024-05-08T18:35:05.812246+0000","last_fullsized":"2024-05-08T18:35:05.812246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:05.812147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:05.812147+0000","last_clean_scrub_stamp":"2024-05-08T18:35:05.812147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:59.880065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'10","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:18.806880+0000","last_change":"2024-05-08T18:35:18.806908+0000","last_active":"2024-05-08T18:35:18.806880+0000","last_peered":"2024-05-08T18:35:18.806880+0000","last_clean":"2024-05-08T18:35:18.806880+0000","last_became_active":"2024-05-08T18:31:45.338192+0000","last_became_peered":"2024-05-08T18:31:45.338192+0000","last_unstale":"2024-05-08T18:35:18.806880+0000","last_undegraded":"2024-05-08T18:35:18.806880+0000","last_fullsized":"2024-05-08T18:35:18.806880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:35:18.806789+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:35:18.806789+0000","last_clean_scrub_stamp":"2024-05-08T18:35:18.806789+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:32.718896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:55.692820+0000","last_change":"2024-05-08T18:34:55.692849+0000","last_active":"2024-05-08T18:34:55.692820+0000","last_peered":"2024-05-08T18:34:55.692820+0000","last_clean":"2024-05-08T18:34:55.692820+0000","last_became_active":"2024-05-08T18:30:58.304222+0000","last_became_peered":"2024-05-08T18:30:58.304222+0000","last_unstale":"2024-05-08T18:34:55.692820+0000","last_undegraded":"2024-05-08T18:34:55.692820+0000","last_fullsized":"2024-05-08T18:34:55.692820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:55.692727+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:55.692727+0000","last_clean_scrub_stamp":"2024-05-08T18:34:55.692727+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:35.252735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"27'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:06.897466+0000","last_change":"2024-05-08T18:35:06.897509+0000","last_active":"2024-05-08T18:35:06.897466+0000","last_peered":"2024-05-08T18:35:06.897466+0000","last_clean":"2024-05-08T18:35:06.897466+0000","last_became_active":"2024-05-08T18:31:00.295990+0000","last_became_peered":"2024-05-08T18:31:00.295990+0000","last_unstale":"2024-05-08T18:35:06.897466+0000","last_undegraded":"2024-05-08T18:35:06.897466+0000","last_fullsized":"2024-05-08T18:35:06.897466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:35:06.897377+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:35:06.897377+0000","last_clean_scrub_stamp":"2024-05-08T18:35:06.897377+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:08.737527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:05.742297+0000","last_change":"2024-05-08T18:35:05.742326+0000","last_active":"2024-05-08T18:35:05.742297+0000","last_peered":"2024-05-08T18:35:05.742297+0000","last_clean":"2024-05-08T18:35:05.742297+0000","last_became_active":"2024-05-08T18:30:58.283821+0000","last_became_peered":"2024-05-08T18:30:58.283821+0000","last_unstale":"2024-05-08T18:35:05.742297+0000","last_undegraded":"2024-05-08T18:35:05.742297+0000","last_fullsized":"2024-05-08T18:35:05.742297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:05.742198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:05.742198+0000","last_clean_scrub_stamp":"2024-05-08T18:35:05.742198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:23.572628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:48.577008+0000","last_change":"2024-05-08T18:34:48.577045+0000","last_active":"2024-05-08T18:34:48.577008+0000","last_peered":"2024-05-08T18:34:48.577008+0000","last_clean":"2024-05-08T18:34:48.577008+0000","last_became_active":"2024-05-08T18:31:00.280827+0000","last_became_peered":"2024-05-08T18:31:00.280827+0000","last_unstale":"2024-05-08T18:34:48.577008+0000","last_undegraded":"2024-05-08T18:34:48.577008+0000","last_fullsized":"2024-05-08T18:34:48.577008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:48.576925+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:48.576925+0000","last_clean_scrub_stamp":"2024-05-08T18:34:48.576925+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:44.850249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:27.354008+0000","last_change":"2024-05-08T18:35:27.354052+0000","last_active":"2024-05-08T18:35:27.354008+0000","last_peered":"2024-05-08T18:35:27.354008+0000","last_clean":"2024-05-08T18:35:27.354008+0000","last_became_active":"2024-05-08T18:30:58.305571+0000","last_became_peered":"2024-05-08T18:30:58.305571+0000","last_unstale":"2024-05-08T18:35:27.354008+0000","last_undegraded":"2024-05-08T18:35:27.354008+0000","last_fullsized":"2024-05-08T18:35:27.354008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:27.353880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:27.353880+0000","last_clean_scrub_stamp":"2024-05-08T18:35:27.353880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:26.384339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'36","reported_seq":109,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:13.715248+0000","last_change":"2024-05-08T18:35:13.715294+0000","last_active":"2024-05-08T18:35:13.715248+0000","last_peered":"2024-05-08T18:35:13.715248+0000","last_clean":"2024-05-08T18:35:13.715248+0000","last_became_active":"2024-05-08T18:31:08.318181+0000","last_became_peered":"2024-05-08T18:31:08.318181+0000","last_unstale":"2024-05-08T18:35:13.715248+0000","last_undegraded":"2024-05-08T18:35:13.715248+0000","last_fullsized":"2024-05-08T18:35:13.715248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:35:13.715142+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:35:13.715142+0000","last_clean_scrub_stamp":"2024-05-08T18:35:13.715142+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:53.656049+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'12","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:57.319629+0000","last_change":"2024-05-08T18:34:57.319658+0000","last_active":"2024-05-08T18:34:57.319629+0000","last_peered":"2024-05-08T18:34:57.319629+0000","last_clean":"2024-05-08T18:34:57.319629+0000","last_became_active":"2024-05-08T18:31:00.296160+0000","last_became_peered":"2024-05-08T18:31:00.296160+0000","last_unstale":"2024-05-08T18:34:57.319629+0000","last_undegraded":"2024-05-08T18:34:57.319629+0000","last_fullsized":"2024-05-08T18:34:57.319629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:57.319548+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:57.319548+0000","last_clean_scrub_stamp":"2024-05-08T18:34:57.319548+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:19.261625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:09.370027+0000","last_change":"2024-05-08T18:35:09.370064+0000","last_active":"2024-05-08T18:35:09.370027+0000","last_peered":"2024-05-08T18:35:09.370027+0000","last_clean":"2024-05-08T18:35:09.370027+0000","last_became_active":"2024-05-08T18:30:58.315246+0000","last_became_peered":"2024-05-08T18:30:58.315246+0000","last_unstale":"2024-05-08T18:35:09.370027+0000","last_undegraded":"2024-05-08T18:35:09.370027+0000","last_fullsized":"2024-05-08T18:35:09.370027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:09.369913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:09.369913+0000","last_clean_scrub_stamp":"2024-05-08T18:35:09.369913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:01.660528+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.660068+0000","last_change":"2024-05-08T18:34:23.660113+0000","last_active":"2024-05-08T18:34:23.660068+0000","last_peered":"2024-05-08T18:34:23.660068+0000","last_clean":"2024-05-08T18:34:23.660068+0000","last_became_active":"2024-05-08T18:31:02.290465+0000","last_became_peered":"2024-05-08T18:31:02.290465+0000","last_unstale":"2024-05-08T18:34:23.660068+0000","last_undegraded":"2024-05-08T18:34:23.660068+0000","last_fullsized":"2024-05-08T18:34:23.660068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:23.659943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:23.659943+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.659943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:25.967513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:43.420662+0000","last_change":"2024-05-08T18:34:43.420702+0000","last_active":"2024-05-08T18:34:43.420662+0000","last_peered":"2024-05-08T18:34:43.420662+0000","last_clean":"2024-05-08T18:34:43.420662+0000","last_became_active":"2024-05-08T18:31:04.303815+0000","last_became_peered":"2024-05-08T18:31:04.303815+0000","last_unstale":"2024-05-08T18:34:43.420662+0000","last_undegraded":"2024-05-08T18:34:43.420662+0000","last_fullsized":"2024-05-08T18:34:43.420662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:43.420568+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:43.420568+0000","last_clean_scrub_stamp":"2024-05-08T18:34:43.420568+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:05.585424+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.889107+0000","last_change":"2024-05-08T18:34:24.889148+0000","last_active":"2024-05-08T18:34:24.889107+0000","last_peered":"2024-05-08T18:34:24.889107+0000","last_clean":"2024-05-08T18:34:24.889107+0000","last_became_active":"2024-05-08T18:31:06.310555+0000","last_became_peered":"2024-05-08T18:31:06.310555+0000","last_unstale":"2024-05-08T18:34:24.889107+0000","last_undegraded":"2024-05-08T18:34:24.889107+0000","last_fullsized":"2024-05-08T18:34:24.889107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:24.889019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:24.889019+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.889019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:06.963972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:15.643171+0000","last_change":"2024-05-08T18:35:15.643198+0000","last_active":"2024-05-08T18:35:15.643171+0000","last_peered":"2024-05-08T18:35:15.643171+0000","last_clean":"2024-05-08T18:35:15.643171+0000","last_became_active":"2024-05-08T18:31:08.319009+0000","last_became_peered":"2024-05-08T18:31:08.319009+0000","last_unstale":"2024-05-08T18:35:15.643171+0000","last_undegraded":"2024-05-08T18:35:15.643171+0000","last_fullsized":"2024-05-08T18:35:15.643171+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T18:35:15.643079+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T18:35:15.643079+0000","last_clean_scrub_stamp":"2024-05-08T18:35:15.643079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:20:35.673819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:39.555342+0000","last_change":"2024-05-08T18:34:39.555368+0000","last_active":"2024-05-08T18:34:39.555342+0000","last_peered":"2024-05-08T18:34:39.555342+0000","last_clean":"2024-05-08T18:34:39.555342+0000","last_became_active":"2024-05-08T18:31:00.297497+0000","last_became_peered":"2024-05-08T18:31:00.297497+0000","last_unstale":"2024-05-08T18:34:39.555342+0000","last_undegraded":"2024-05-08T18:34:39.555342+0000","last_fullsized":"2024-05-08T18:34:39.555342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:34:39.555243+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:34:39.555243+0000","last_clean_scrub_stamp":"2024-05-08T18:34:39.555243+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:16.257470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:00.888978+0000","last_change":"2024-05-08T18:35:00.889004+0000","last_active":"2024-05-08T18:35:00.888978+0000","last_peered":"2024-05-08T18:35:00.888978+0000","last_clean":"2024-05-08T18:35:00.888978+0000","last_became_active":"2024-05-08T18:30:58.299649+0000","last_became_peered":"2024-05-08T18:30:58.299649+0000","last_unstale":"2024-05-08T18:35:00.888978+0000","last_undegraded":"2024-05-08T18:35:00.888978+0000","last_fullsized":"2024-05-08T18:35:00.888978+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:00.888891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:00.888891+0000","last_clean_scrub_stamp":"2024-05-08T18:35:00.888891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:32.791953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"29'2","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:35.582295+0000","last_change":"2024-05-08T18:34:35.582330+0000","last_active":"2024-05-08T18:34:35.582295+0000","last_peered":"2024-05-08T18:34:35.582295+0000","last_clean":"2024-05-08T18:34:35.582295+0000","last_became_active":"2024-05-08T18:31:02.293993+0000","last_became_peered":"2024-05-08T18:31:02.293993+0000","last_unstale":"2024-05-08T18:34:35.582295+0000","last_undegraded":"2024-05-08T18:34:35.582295+0000","last_fullsized":"2024-05-08T18:34:35.582295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:35.582207+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:35.582207+0000","last_clean_scrub_stamp":"2024-05-08T18:34:35.582207+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:12.476691+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'10","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.907482+0000","last_change":"2024-05-08T18:34:23.907510+0000","last_active":"2024-05-08T18:34:23.907482+0000","last_peered":"2024-05-08T18:34:23.907482+0000","last_clean":"2024-05-08T18:34:23.907482+0000","last_became_active":"2024-05-08T18:31:04.300059+0000","last_became_peered":"2024-05-08T18:31:04.300059+0000","last_unstale":"2024-05-08T18:34:23.907482+0000","last_undegraded":"2024-05-08T18:34:23.907482+0000","last_fullsized":"2024-05-08T18:34:23.907482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:23.907379+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:23.907379+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.907379+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:16.891137+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.722083+0000","last_change":"2024-05-08T18:34:32.722108+0000","last_active":"2024-05-08T18:34:32.722083+0000","last_peered":"2024-05-08T18:34:32.722083+0000","last_clean":"2024-05-08T18:34:32.722083+0000","last_became_active":"2024-05-08T18:31:06.312651+0000","last_became_peered":"2024-05-08T18:31:06.312651+0000","last_unstale":"2024-05-08T18:34:32.722083+0000","last_undegraded":"2024-05-08T18:34:32.722083+0000","last_fullsized":"2024-05-08T18:34:32.722083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:32.721992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:32.721992+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.721992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:27.698590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:45.631065+0000","last_change":"2024-05-08T18:34:45.631098+0000","last_active":"2024-05-08T18:34:45.631065+0000","last_peered":"2024-05-08T18:34:45.631065+0000","last_clean":"2024-05-08T18:34:45.631065+0000","last_became_active":"2024-05-08T18:31:08.311048+0000","last_became_peered":"2024-05-08T18:31:08.311048+0000","last_unstale":"2024-05-08T18:34:45.631065+0000","last_undegraded":"2024-05-08T18:34:45.631065+0000","last_fullsized":"2024-05-08T18:34:45.631065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:45.630966+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:45.630966+0000","last_clean_scrub_stamp":"2024-05-08T18:34:45.630966+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:57.506022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:56.366418+0000","last_change":"2024-05-08T18:34:56.366442+0000","last_active":"2024-05-08T18:34:56.366418+0000","last_peered":"2024-05-08T18:34:56.366418+0000","last_clean":"2024-05-08T18:34:56.366418+0000","last_became_active":"2024-05-08T18:31:00.296176+0000","last_became_peered":"2024-05-08T18:31:00.296176+0000","last_unstale":"2024-05-08T18:34:56.366418+0000","last_undegraded":"2024-05-08T18:34:56.366418+0000","last_fullsized":"2024-05-08T18:34:56.366418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:56.366327+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:56.366327+0000","last_clean_scrub_stamp":"2024-05-08T18:34:56.366327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:16.210517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:13.324173+0000","last_change":"2024-05-08T18:35:13.324198+0000","last_active":"2024-05-08T18:35:13.324173+0000","last_peered":"2024-05-08T18:35:13.324173+0000","last_clean":"2024-05-08T18:35:13.324173+0000","last_became_active":"2024-05-08T18:30:58.309339+0000","last_became_peered":"2024-05-08T18:30:58.309339+0000","last_unstale":"2024-05-08T18:35:13.324173+0000","last_undegraded":"2024-05-08T18:35:13.324173+0000","last_fullsized":"2024-05-08T18:35:13.324173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:13.324078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:13.324078+0000","last_clean_scrub_stamp":"2024-05-08T18:35:13.324078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:41.496180+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:10.919269+0000","last_change":"2024-05-08T18:35:10.919291+0000","last_active":"2024-05-08T18:35:10.919269+0000","last_peered":"2024-05-08T18:35:10.919269+0000","last_clean":"2024-05-08T18:35:10.919269+0000","last_became_active":"2024-05-08T18:31:45.335489+0000","last_became_peered":"2024-05-08T18:31:45.335489+0000","last_unstale":"2024-05-08T18:35:10.919269+0000","last_undegraded":"2024-05-08T18:35:10.919269+0000","last_fullsized":"2024-05-08T18:35:10.919269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:10.919188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:10.919188+0000","last_clean_scrub_stamp":"2024-05-08T18:35:10.919188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:39.522232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'16","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.718300+0000","last_change":"2024-05-08T18:34:29.718370+0000","last_active":"2024-05-08T18:34:29.718300+0000","last_peered":"2024-05-08T18:34:29.718300+0000","last_clean":"2024-05-08T18:34:29.718300+0000","last_became_active":"2024-05-08T18:31:04.300022+0000","last_became_peered":"2024-05-08T18:31:04.300022+0000","last_unstale":"2024-05-08T18:34:29.718300+0000","last_undegraded":"2024-05-08T18:34:29.718300+0000","last_fullsized":"2024-05-08T18:34:29.718300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T18:34:29.718201+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T18:34:29.718201+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.718201+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:19.939460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'285","reported_seq":402,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:40.541175+0000","last_change":"2024-05-08T18:34:40.541202+0000","last_active":"2024-05-08T18:34:40.541175+0000","last_peered":"2024-05-08T18:34:40.541175+0000","last_clean":"2024-05-08T18:34:40.541175+0000","last_became_active":"2024-05-08T18:31:06.306886+0000","last_became_peered":"2024-05-08T18:31:06.306886+0000","last_unstale":"2024-05-08T18:34:40.541175+0000","last_undegraded":"2024-05-08T18:34:40.541175+0000","last_fullsized":"2024-05-08T18:34:40.541175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:40.541078+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:40.541078+0000","last_clean_scrub_stamp":"2024-05-08T18:34:40.541078+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:11:57.055230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:08.958587+0000","last_change":"2024-05-08T18:35:08.958615+0000","last_active":"2024-05-08T18:35:08.958587+0000","last_peered":"2024-05-08T18:35:08.958587+0000","last_clean":"2024-05-08T18:35:08.958587+0000","last_became_active":"2024-05-08T18:31:08.311780+0000","last_became_peered":"2024-05-08T18:31:08.311780+0000","last_unstale":"2024-05-08T18:35:08.958587+0000","last_undegraded":"2024-05-08T18:35:08.958587+0000","last_fullsized":"2024-05-08T18:35:08.958587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:08.958503+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:08.958503+0000","last_clean_scrub_stamp":"2024-05-08T18:35:08.958503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:45.660730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:47.606707+0000","last_change":"2024-05-08T18:34:47.606735+0000","last_active":"2024-05-08T18:34:47.606707+0000","last_peered":"2024-05-08T18:34:47.606707+0000","last_clean":"2024-05-08T18:34:47.606707+0000","last_became_active":"2024-05-08T18:31:00.281268+0000","last_became_peered":"2024-05-08T18:31:00.281268+0000","last_unstale":"2024-05-08T18:34:47.606707+0000","last_undegraded":"2024-05-08T18:34:47.606707+0000","last_fullsized":"2024-05-08T18:34:47.606707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:34:47.606608+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:34:47.606608+0000","last_clean_scrub_stamp":"2024-05-08T18:34:47.606608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:22:11.586979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:51.636588+0000","last_change":"2024-05-08T18:34:51.636616+0000","last_active":"2024-05-08T18:34:51.636588+0000","last_peered":"2024-05-08T18:34:51.636588+0000","last_clean":"2024-05-08T18:34:51.636588+0000","last_became_active":"2024-05-08T18:30:58.303428+0000","last_became_peered":"2024-05-08T18:30:58.303428+0000","last_unstale":"2024-05-08T18:34:51.636588+0000","last_undegraded":"2024-05-08T18:34:51.636588+0000","last_fullsized":"2024-05-08T18:34:51.636588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:51.636503+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:51.636503+0000","last_clean_scrub_stamp":"2024-05-08T18:34:51.636503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:33.197546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.686239+0000","last_change":"2024-05-08T18:34:20.686287+0000","last_active":"2024-05-08T18:34:20.686239+0000","last_peered":"2024-05-08T18:34:20.686239+0000","last_clean":"2024-05-08T18:34:20.686239+0000","last_became_active":"2024-05-08T18:31:02.291729+0000","last_became_peered":"2024-05-08T18:31:02.291729+0000","last_unstale":"2024-05-08T18:34:20.686239+0000","last_undegraded":"2024-05-08T18:34:20.686239+0000","last_fullsized":"2024-05-08T18:34:20.686239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:20.686141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:20.686141+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.686141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:15.450176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.681287+0000","last_change":"2024-05-08T18:34:25.681329+0000","last_active":"2024-05-08T18:34:25.681287+0000","last_peered":"2024-05-08T18:34:25.681287+0000","last_clean":"2024-05-08T18:34:25.681287+0000","last_became_active":"2024-05-08T18:31:04.304347+0000","last_became_peered":"2024-05-08T18:31:04.304347+0000","last_unstale":"2024-05-08T18:34:25.681287+0000","last_undegraded":"2024-05-08T18:34:25.681287+0000","last_fullsized":"2024-05-08T18:34:25.681287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:25.681197+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:25.681197+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.681197+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:06.403836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.709773+0000","last_change":"2024-05-08T18:34:22.709806+0000","last_active":"2024-05-08T18:34:22.709773+0000","last_peered":"2024-05-08T18:34:22.709773+0000","last_clean":"2024-05-08T18:34:22.709773+0000","last_became_active":"2024-05-08T18:31:06.305591+0000","last_became_peered":"2024-05-08T18:31:06.305591+0000","last_unstale":"2024-05-08T18:34:22.709773+0000","last_undegraded":"2024-05-08T18:34:22.709773+0000","last_fullsized":"2024-05-08T18:34:22.709773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:22.709682+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:22.709682+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.709682+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:04.769028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'10","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:05.305632+0000","last_change":"2024-05-08T18:35:05.305632+0000","last_active":"2024-05-08T18:35:05.305632+0000","last_peered":"2024-05-08T18:35:05.305632+0000","last_clean":"2024-05-08T18:35:05.305632+0000","last_became_active":"2024-05-08T18:31:00.290824+0000","last_became_peered":"2024-05-08T18:31:00.290824+0000","last_unstale":"2024-05-08T18:35:05.305632+0000","last_undegraded":"2024-05-08T18:35:05.305632+0000","last_fullsized":"2024-05-08T18:35:05.305632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:35:05.305518+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:35:05.305518+0000","last_clean_scrub_stamp":"2024-05-08T18:35:05.305518+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:25.824273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:01.846057+0000","last_change":"2024-05-08T18:35:01.846057+0000","last_active":"2024-05-08T18:35:01.846057+0000","last_peered":"2024-05-08T18:35:01.846057+0000","last_clean":"2024-05-08T18:35:01.846057+0000","last_became_active":"2024-05-08T18:30:58.300884+0000","last_became_peered":"2024-05-08T18:30:58.300884+0000","last_unstale":"2024-05-08T18:35:01.846057+0000","last_undegraded":"2024-05-08T18:35:01.846057+0000","last_fullsized":"2024-05-08T18:35:01.846057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:01.845907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:01.845907+0000","last_clean_scrub_stamp":"2024-05-08T18:35:01.845907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:08.467397+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.781989+0000","last_change":"2024-05-08T18:34:29.781989+0000","last_active":"2024-05-08T18:34:29.781989+0000","last_peered":"2024-05-08T18:34:29.781989+0000","last_clean":"2024-05-08T18:34:29.781989+0000","last_became_active":"2024-05-08T18:31:02.291536+0000","last_became_peered":"2024-05-08T18:31:02.291536+0000","last_unstale":"2024-05-08T18:34:29.781989+0000","last_undegraded":"2024-05-08T18:34:29.781989+0000","last_fullsized":"2024-05-08T18:34:29.781989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:29.781874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:29.781874+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.781874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:12.430820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'52","reported_seq":113,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.726388+0000","last_change":"2024-05-08T18:34:27.726388+0000","last_active":"2024-05-08T18:34:27.726388+0000","last_peered":"2024-05-08T18:34:27.726388+0000","last_clean":"2024-05-08T18:34:27.726388+0000","last_became_active":"2024-05-08T18:31:04.302455+0000","last_became_peered":"2024-05-08T18:31:04.302455+0000","last_unstale":"2024-05-08T18:34:27.726388+0000","last_undegraded":"2024-05-08T18:34:27.726388+0000","last_fullsized":"2024-05-08T18:34:27.726388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'52","last_scrub_stamp":"2024-05-08T18:34:27.726254+0000","last_deep_scrub":"29'52","last_deep_scrub_stamp":"2024-05-08T18:34:27.726254+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.726254+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:57.760805+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.615602+0000","last_change":"2024-05-08T18:34:24.615646+0000","last_active":"2024-05-08T18:34:24.615602+0000","last_peered":"2024-05-08T18:34:24.615602+0000","last_clean":"2024-05-08T18:34:24.615602+0000","last_became_active":"2024-05-08T18:31:06.304979+0000","last_became_peered":"2024-05-08T18:31:06.304979+0000","last_unstale":"2024-05-08T18:34:24.615602+0000","last_undegraded":"2024-05-08T18:34:24.615602+0000","last_fullsized":"2024-05-08T18:34:24.615602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:24.615505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:24.615505+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.615505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:06.690459+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:07.918347+0000","last_change":"2024-05-08T18:35:07.918347+0000","last_active":"2024-05-08T18:35:07.918347+0000","last_peered":"2024-05-08T18:35:07.918347+0000","last_clean":"2024-05-08T18:35:07.918347+0000","last_became_active":"2024-05-08T18:31:08.311434+0000","last_became_peered":"2024-05-08T18:31:08.311434+0000","last_unstale":"2024-05-08T18:35:07.918347+0000","last_undegraded":"2024-05-08T18:35:07.918347+0000","last_fullsized":"2024-05-08T18:35:07.918347+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T18:35:07.918233+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T18:35:07.918233+0000","last_clean_scrub_stamp":"2024-05-08T18:35:07.918233+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:20.603001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:49.625755+0000","last_change":"2024-05-08T18:34:49.625755+0000","last_active":"2024-05-08T18:34:49.625755+0000","last_peered":"2024-05-08T18:34:49.625755+0000","last_clean":"2024-05-08T18:34:49.625755+0000","last_became_active":"2024-05-08T18:31:00.280969+0000","last_became_peered":"2024-05-08T18:31:00.280969+0000","last_unstale":"2024-05-08T18:34:49.625755+0000","last_undegraded":"2024-05-08T18:34:49.625755+0000","last_fullsized":"2024-05-08T18:34:49.625755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:49.625593+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:49.625593+0000","last_clean_scrub_stamp":"2024-05-08T18:34:49.625593+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:50.500448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:04.885607+0000","last_change":"2024-05-08T18:35:04.885607+0000","last_active":"2024-05-08T18:35:04.885607+0000","last_peered":"2024-05-08T18:35:04.885607+0000","last_clean":"2024-05-08T18:35:04.885607+0000","last_became_active":"2024-05-08T18:30:58.302590+0000","last_became_peered":"2024-05-08T18:30:58.302590+0000","last_unstale":"2024-05-08T18:35:04.885607+0000","last_undegraded":"2024-05-08T18:35:04.885607+0000","last_fullsized":"2024-05-08T18:35:04.885607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:04.885481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:04.885481+0000","last_clean_scrub_stamp":"2024-05-08T18:35:04.885481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:41.364341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:42.569395+0000","last_change":"2024-05-08T18:34:42.569395+0000","last_active":"2024-05-08T18:34:42.569395+0000","last_peered":"2024-05-08T18:34:42.569395+0000","last_clean":"2024-05-08T18:34:42.569395+0000","last_became_active":"2024-05-08T18:31:02.289394+0000","last_became_peered":"2024-05-08T18:31:02.289394+0000","last_unstale":"2024-05-08T18:34:42.569395+0000","last_undegraded":"2024-05-08T18:34:42.569395+0000","last_fullsized":"2024-05-08T18:34:42.569395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:42.569274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:42.569274+0000","last_clean_scrub_stamp":"2024-05-08T18:34:42.569274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:44.876844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'38","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:45.366976+0000","last_change":"2024-05-08T18:34:45.367013+0000","last_active":"2024-05-08T18:34:45.366976+0000","last_peered":"2024-05-08T18:34:45.366976+0000","last_clean":"2024-05-08T18:34:45.366976+0000","last_became_active":"2024-05-08T18:31:04.302886+0000","last_became_peered":"2024-05-08T18:31:04.302886+0000","last_unstale":"2024-05-08T18:34:45.366976+0000","last_undegraded":"2024-05-08T18:34:45.366976+0000","last_fullsized":"2024-05-08T18:34:45.366976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-08T18:34:45.366871+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-08T18:34:45.366871+0000","last_clean_scrub_stamp":"2024-05-08T18:34:45.366871+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:13.940428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.644132+0000","last_change":"2024-05-08T18:34:19.644132+0000","last_active":"2024-05-08T18:34:19.644132+0000","last_peered":"2024-05-08T18:34:19.644132+0000","last_clean":"2024-05-08T18:34:19.644132+0000","last_became_active":"2024-05-08T18:31:06.306607+0000","last_became_peered":"2024-05-08T18:31:06.306607+0000","last_unstale":"2024-05-08T18:34:19.644132+0000","last_undegraded":"2024-05-08T18:34:19.644132+0000","last_fullsized":"2024-05-08T18:34:19.644132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:19.644005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:19.644005+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.644005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:04:00.192002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:36.713780+0000","last_change":"2024-05-08T18:34:36.713780+0000","last_active":"2024-05-08T18:34:36.713780+0000","last_peered":"2024-05-08T18:34:36.713780+0000","last_clean":"2024-05-08T18:34:36.713780+0000","last_became_active":"2024-05-08T18:31:08.305127+0000","last_became_peered":"2024-05-08T18:31:08.305127+0000","last_unstale":"2024-05-08T18:34:36.713780+0000","last_undegraded":"2024-05-08T18:34:36.713780+0000","last_fullsized":"2024-05-08T18:34:36.713780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:36.713654+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:36.713654+0000","last_clean_scrub_stamp":"2024-05-08T18:34:36.713654+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:58.222971+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:52.890746+0000","last_change":"2024-05-08T18:34:52.890746+0000","last_active":"2024-05-08T18:34:52.890746+0000","last_peered":"2024-05-08T18:34:52.890746+0000","last_clean":"2024-05-08T18:34:52.890746+0000","last_became_active":"2024-05-08T18:31:00.293170+0000","last_became_peered":"2024-05-08T18:31:00.293170+0000","last_unstale":"2024-05-08T18:34:52.890746+0000","last_undegraded":"2024-05-08T18:34:52.890746+0000","last_fullsized":"2024-05-08T18:34:52.890746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:52.890630+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:52.890630+0000","last_clean_scrub_stamp":"2024-05-08T18:34:52.890630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:55.198199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:18.378697+0000","last_change":"2024-05-08T18:35:18.378697+0000","last_active":"2024-05-08T18:35:18.378697+0000","last_peered":"2024-05-08T18:35:18.378697+0000","last_clean":"2024-05-08T18:35:18.378697+0000","last_became_active":"2024-05-08T18:30:58.314352+0000","last_became_peered":"2024-05-08T18:30:58.314352+0000","last_unstale":"2024-05-08T18:35:18.378697+0000","last_undegraded":"2024-05-08T18:35:18.378697+0000","last_fullsized":"2024-05-08T18:35:18.378697+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:18.378578+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:18.378578+0000","last_clean_scrub_stamp":"2024-05-08T18:35:18.378578+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:17.371008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:11.876148+0000","last_change":"2024-05-08T18:35:11.876173+0000","last_active":"2024-05-08T18:35:11.876148+0000","last_peered":"2024-05-08T18:35:11.876148+0000","last_clean":"2024-05-08T18:35:11.876148+0000","last_became_active":"2024-05-08T18:31:45.339423+0000","last_became_peered":"2024-05-08T18:31:45.339423+0000","last_unstale":"2024-05-08T18:35:11.876148+0000","last_undegraded":"2024-05-08T18:35:11.876148+0000","last_fullsized":"2024-05-08T18:35:11.876148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:11.876047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:11.876047+0000","last_clean_scrub_stamp":"2024-05-08T18:35:11.876047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:49.524641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'45","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.606003+0000","last_change":"2024-05-08T18:34:32.606003+0000","last_active":"2024-05-08T18:34:32.606003+0000","last_peered":"2024-05-08T18:34:32.606003+0000","last_clean":"2024-05-08T18:34:32.606003+0000","last_became_active":"2024-05-08T18:31:04.298026+0000","last_became_peered":"2024-05-08T18:31:04.298026+0000","last_unstale":"2024-05-08T18:34:32.606003+0000","last_undegraded":"2024-05-08T18:34:32.606003+0000","last_fullsized":"2024-05-08T18:34:32.606003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T18:34:32.605858+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T18:34:32.605858+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.605858+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:39.227348+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":367,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.673057+0000","last_change":"2024-05-08T18:34:18.673057+0000","last_active":"2024-05-08T18:34:18.673057+0000","last_peered":"2024-05-08T18:34:18.673057+0000","last_clean":"2024-05-08T18:34:18.673057+0000","last_became_active":"2024-05-08T18:31:06.306655+0000","last_became_peered":"2024-05-08T18:31:06.306655+0000","last_unstale":"2024-05-08T18:34:18.673057+0000","last_undegraded":"2024-05-08T18:34:18.673057+0000","last_fullsized":"2024-05-08T18:34:18.673057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:18.672962+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:18.672962+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.672962+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:15.669294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:15.786893+0000","last_change":"2024-05-08T18:35:15.786893+0000","last_active":"2024-05-08T18:35:15.786893+0000","last_peered":"2024-05-08T18:35:15.786893+0000","last_clean":"2024-05-08T18:35:15.786893+0000","last_became_active":"2024-05-08T18:31:08.314273+0000","last_became_peered":"2024-05-08T18:31:08.314273+0000","last_unstale":"2024-05-08T18:35:15.786893+0000","last_undegraded":"2024-05-08T18:35:15.786893+0000","last_fullsized":"2024-05-08T18:35:15.786893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:15.786775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:15.786775+0000","last_clean_scrub_stamp":"2024-05-08T18:35:15.786775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:35.385759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:44.889203+0000","last_change":"2024-05-08T18:34:44.889203+0000","last_active":"2024-05-08T18:34:44.889203+0000","last_peered":"2024-05-08T18:34:44.889203+0000","last_clean":"2024-05-08T18:34:44.889203+0000","last_became_active":"2024-05-08T18:31:00.282941+0000","last_became_peered":"2024-05-08T18:31:00.282941+0000","last_unstale":"2024-05-08T18:34:44.889203+0000","last_undegraded":"2024-05-08T18:34:44.889203+0000","last_fullsized":"2024-05-08T18:34:44.889203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:44.889056+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:44.889056+0000","last_clean_scrub_stamp":"2024-05-08T18:34:44.889056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:44:35.228659+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:26.367146+0000","last_change":"2024-05-08T18:35:26.367146+0000","last_active":"2024-05-08T18:35:26.367146+0000","last_peered":"2024-05-08T18:35:26.367146+0000","last_clean":"2024-05-08T18:35:26.367146+0000","last_became_active":"2024-05-08T18:30:58.313431+0000","last_became_peered":"2024-05-08T18:30:58.313431+0000","last_unstale":"2024-05-08T18:35:26.367146+0000","last_undegraded":"2024-05-08T18:35:26.367146+0000","last_fullsized":"2024-05-08T18:35:26.367146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:26.367020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:26.367020+0000","last_clean_scrub_stamp":"2024-05-08T18:35:26.367020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:54.052250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:40.577762+0000","last_change":"2024-05-08T18:34:40.577762+0000","last_active":"2024-05-08T18:34:40.577762+0000","last_peered":"2024-05-08T18:34:40.577762+0000","last_clean":"2024-05-08T18:34:40.577762+0000","last_became_active":"2024-05-08T18:31:02.289669+0000","last_became_peered":"2024-05-08T18:31:02.289669+0000","last_unstale":"2024-05-08T18:34:40.577762+0000","last_undegraded":"2024-05-08T18:34:40.577762+0000","last_fullsized":"2024-05-08T18:34:40.577762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:40.577639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:40.577639+0000","last_clean_scrub_stamp":"2024-05-08T18:34:40.577639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:06.519788+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'67","reported_seq":141,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:48.381040+0000","last_change":"2024-05-08T18:34:48.381040+0000","last_active":"2024-05-08T18:34:48.381040+0000","last_peered":"2024-05-08T18:34:48.381040+0000","last_clean":"2024-05-08T18:34:48.381040+0000","last_became_active":"2024-05-08T18:31:04.302244+0000","last_became_peered":"2024-05-08T18:31:04.302244+0000","last_unstale":"2024-05-08T18:34:48.381040+0000","last_undegraded":"2024-05-08T18:34:48.381040+0000","last_fullsized":"2024-05-08T18:34:48.381040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'67","last_scrub_stamp":"2024-05-08T18:34:48.380911+0000","last_deep_scrub":"29'67","last_deep_scrub_stamp":"2024-05-08T18:34:48.380911+0000","last_clean_scrub_stamp":"2024-05-08T18:34:48.380911+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:33.160250+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.686381+0000","last_change":"2024-05-08T18:34:21.686381+0000","last_active":"2024-05-08T18:34:21.686381+0000","last_peered":"2024-05-08T18:34:21.686381+0000","last_clean":"2024-05-08T18:34:21.686381+0000","last_became_active":"2024-05-08T18:31:06.308806+0000","last_became_peered":"2024-05-08T18:31:06.308806+0000","last_unstale":"2024-05-08T18:34:21.686381+0000","last_undegraded":"2024-05-08T18:34:21.686381+0000","last_fullsized":"2024-05-08T18:34:21.686381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:21.686225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:21.686225+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.686225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:12.963774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'21","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:17.814168+0000","last_change":"2024-05-08T18:35:17.814168+0000","last_active":"2024-05-08T18:35:17.814168+0000","last_peered":"2024-05-08T18:35:17.814168+0000","last_clean":"2024-05-08T18:35:17.814168+0000","last_became_active":"2024-05-08T18:31:08.319370+0000","last_became_peered":"2024-05-08T18:31:08.319370+0000","last_unstale":"2024-05-08T18:35:17.814168+0000","last_undegraded":"2024-05-08T18:35:17.814168+0000","last_fullsized":"2024-05-08T18:35:17.814168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-05-08T18:35:17.814017+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-05-08T18:35:17.814017+0000","last_clean_scrub_stamp":"2024-05-08T18:35:17.814017+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:18.291246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'6","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:42.729045+0000","last_change":"2024-05-08T18:34:42.729045+0000","last_active":"2024-05-08T18:34:42.729045+0000","last_peered":"2024-05-08T18:34:42.729045+0000","last_clean":"2024-05-08T18:34:42.729045+0000","last_became_active":"2024-05-08T18:31:00.292154+0000","last_became_peered":"2024-05-08T18:31:00.292154+0000","last_unstale":"2024-05-08T18:34:42.729045+0000","last_undegraded":"2024-05-08T18:34:42.729045+0000","last_fullsized":"2024-05-08T18:34:42.729045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:42.728933+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:42.728933+0000","last_clean_scrub_stamp":"2024-05-08T18:34:42.728933+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:45.036503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:54.775346+0000","last_change":"2024-05-08T18:34:54.775346+0000","last_active":"2024-05-08T18:34:54.775346+0000","last_peered":"2024-05-08T18:34:54.775346+0000","last_clean":"2024-05-08T18:34:54.775346+0000","last_became_active":"2024-05-08T18:30:58.294377+0000","last_became_peered":"2024-05-08T18:30:58.294377+0000","last_unstale":"2024-05-08T18:34:54.775346+0000","last_undegraded":"2024-05-08T18:34:54.775346+0000","last_fullsized":"2024-05-08T18:34:54.775346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:54.775224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:54.775224+0000","last_clean_scrub_stamp":"2024-05-08T18:34:54.775224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:43:21.245618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:35.836915+0000","last_change":"2024-05-08T18:34:35.836915+0000","last_active":"2024-05-08T18:34:35.836915+0000","last_peered":"2024-05-08T18:34:35.836915+0000","last_clean":"2024-05-08T18:34:35.836915+0000","last_became_active":"2024-05-08T18:31:02.293680+0000","last_became_peered":"2024-05-08T18:31:02.293680+0000","last_unstale":"2024-05-08T18:34:35.836915+0000","last_undegraded":"2024-05-08T18:34:35.836915+0000","last_fullsized":"2024-05-08T18:34:35.836915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:35.836803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:35.836803+0000","last_clean_scrub_stamp":"2024-05-08T18:34:35.836803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:43:05.540412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'40","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.864211+0000","last_change":"2024-05-08T18:34:22.864247+0000","last_active":"2024-05-08T18:34:22.864211+0000","last_peered":"2024-05-08T18:34:22.864211+0000","last_clean":"2024-05-08T18:34:22.864211+0000","last_became_active":"2024-05-08T18:31:04.301147+0000","last_became_peered":"2024-05-08T18:31:04.301147+0000","last_unstale":"2024-05-08T18:34:22.864211+0000","last_undegraded":"2024-05-08T18:34:22.864211+0000","last_fullsized":"2024-05-08T18:34:22.864211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-08T18:34:22.864124+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-08T18:34:22.864124+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.864124+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:04.923471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:50.411251+0000","last_change":"2024-05-08T18:34:50.411290+0000","last_active":"2024-05-08T18:34:50.411251+0000","last_peered":"2024-05-08T18:34:50.411251+0000","last_clean":"2024-05-08T18:34:50.411251+0000","last_became_active":"2024-05-08T18:31:06.308804+0000","last_became_peered":"2024-05-08T18:31:06.308804+0000","last_unstale":"2024-05-08T18:34:50.411251+0000","last_undegraded":"2024-05-08T18:34:50.411251+0000","last_fullsized":"2024-05-08T18:34:50.411251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:50.411147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:50.411147+0000","last_clean_scrub_stamp":"2024-05-08T18:34:50.411147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:30.290258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.285520+0000","last_change":"2024-05-08T18:31:08.320629+0000","last_active":"2024-05-08T18:34:18.285520+0000","last_peered":"2024-05-08T18:34:18.285520+0000","last_clean":"2024-05-08T18:34:18.285520+0000","last_became_active":"2024-05-08T18:31:08.320150+0000","last_became_peered":"2024-05-08T18:31:08.320150+0000","last_unstale":"2024-05-08T18:34:18.285520+0000","last_undegraded":"2024-05-08T18:34:18.285520+0000","last_fullsized":"2024-05-08T18:34:18.285520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'4","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.629691+0000","last_change":"2024-05-08T18:34:31.629691+0000","last_active":"2024-05-08T18:34:31.629691+0000","last_peered":"2024-05-08T18:34:31.629691+0000","last_clean":"2024-05-08T18:34:31.629691+0000","last_became_active":"2024-05-08T18:31:00.299379+0000","last_became_peered":"2024-05-08T18:31:00.299379+0000","last_unstale":"2024-05-08T18:34:31.629691+0000","last_undegraded":"2024-05-08T18:34:31.629691+0000","last_fullsized":"2024-05-08T18:34:31.629691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:31.629577+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:31.629577+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.629577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:03.532639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:24.442872+0000","last_change":"2024-05-08T18:35:24.442909+0000","last_active":"2024-05-08T18:35:24.442872+0000","last_peered":"2024-05-08T18:35:24.442872+0000","last_clean":"2024-05-08T18:35:24.442872+0000","last_became_active":"2024-05-08T18:30:58.315625+0000","last_became_peered":"2024-05-08T18:30:58.315625+0000","last_unstale":"2024-05-08T18:35:24.442872+0000","last_undegraded":"2024-05-08T18:35:24.442872+0000","last_fullsized":"2024-05-08T18:35:24.442872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:24.442772+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:24.442772+0000","last_clean_scrub_stamp":"2024-05-08T18:35:24.442772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:56.207323+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:39.588620+0000","last_change":"2024-05-08T18:34:39.588620+0000","last_active":"2024-05-08T18:34:39.588620+0000","last_peered":"2024-05-08T18:34:39.588620+0000","last_clean":"2024-05-08T18:34:39.588620+0000","last_became_active":"2024-05-08T18:31:02.289767+0000","last_became_peered":"2024-05-08T18:31:02.289767+0000","last_unstale":"2024-05-08T18:34:39.588620+0000","last_undegraded":"2024-05-08T18:34:39.588620+0000","last_fullsized":"2024-05-08T18:34:39.588620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:39.588473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:39.588473+0000","last_clean_scrub_stamp":"2024-05-08T18:34:39.588473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:21.718736+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.740564+0000","last_change":"2024-05-08T18:34:31.740604+0000","last_active":"2024-05-08T18:34:31.740564+0000","last_peered":"2024-05-08T18:34:31.740564+0000","last_clean":"2024-05-08T18:34:31.740564+0000","last_became_active":"2024-05-08T18:31:04.294573+0000","last_became_peered":"2024-05-08T18:31:04.294573+0000","last_unstale":"2024-05-08T18:34:31.740564+0000","last_undegraded":"2024-05-08T18:34:31.740564+0000","last_fullsized":"2024-05-08T18:34:31.740564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T18:34:31.740471+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T18:34:31.740471+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.740471+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:36.592489+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":442,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.729935+0000","last_change":"2024-05-08T18:34:28.729967+0000","last_active":"2024-05-08T18:34:28.729935+0000","last_peered":"2024-05-08T18:34:28.729935+0000","last_clean":"2024-05-08T18:34:28.729935+0000","last_became_active":"2024-05-08T18:31:06.312203+0000","last_became_peered":"2024-05-08T18:31:06.312203+0000","last_unstale":"2024-05-08T18:34:28.729935+0000","last_undegraded":"2024-05-08T18:34:28.729935+0000","last_fullsized":"2024-05-08T18:34:28.729935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:28.729835+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:28.729835+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.729835+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:42.916625+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'15","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:14.747872+0000","last_change":"2024-05-08T18:35:14.747872+0000","last_active":"2024-05-08T18:35:14.747872+0000","last_peered":"2024-05-08T18:35:14.747872+0000","last_clean":"2024-05-08T18:35:14.747872+0000","last_became_active":"2024-05-08T18:31:08.314171+0000","last_became_peered":"2024-05-08T18:31:08.314171+0000","last_unstale":"2024-05-08T18:35:14.747872+0000","last_undegraded":"2024-05-08T18:35:14.747872+0000","last_fullsized":"2024-05-08T18:35:14.747872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T18:35:14.747755+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T18:35:14.747755+0000","last_clean_scrub_stamp":"2024-05-08T18:35:14.747755+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:20:34.778495+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:50.816833+0000","last_change":"2024-05-08T18:34:50.816833+0000","last_active":"2024-05-08T18:34:50.816833+0000","last_peered":"2024-05-08T18:34:50.816833+0000","last_clean":"2024-05-08T18:34:50.816833+0000","last_became_active":"2024-05-08T18:31:00.292521+0000","last_became_peered":"2024-05-08T18:31:00.292521+0000","last_unstale":"2024-05-08T18:34:50.816833+0000","last_undegraded":"2024-05-08T18:34:50.816833+0000","last_fullsized":"2024-05-08T18:34:50.816833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:50.816688+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:50.816688+0000","last_clean_scrub_stamp":"2024-05-08T18:34:50.816688+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:09.188418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:12.318580+0000","last_change":"2024-05-08T18:35:12.318580+0000","last_active":"2024-05-08T18:35:12.318580+0000","last_peered":"2024-05-08T18:35:12.318580+0000","last_clean":"2024-05-08T18:35:12.318580+0000","last_became_active":"2024-05-08T18:30:58.309773+0000","last_became_peered":"2024-05-08T18:30:58.309773+0000","last_unstale":"2024-05-08T18:35:12.318580+0000","last_undegraded":"2024-05-08T18:35:12.318580+0000","last_fullsized":"2024-05-08T18:35:12.318580+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:12.318456+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:12.318456+0000","last_clean_scrub_stamp":"2024-05-08T18:35:12.318456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:58:49.908816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'5","reported_seq":429,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.729420+0000","last_change":"2024-05-08T18:34:31.729420+0000","last_active":"2024-05-08T18:34:31.729420+0000","last_peered":"2024-05-08T18:34:31.729420+0000","last_clean":"2024-05-08T18:34:31.729420+0000","last_became_active":"2024-05-08T18:31:02.289253+0000","last_became_peered":"2024-05-08T18:31:02.289253+0000","last_unstale":"2024-05-08T18:34:31.729420+0000","last_undegraded":"2024-05-08T18:34:31.729420+0000","last_fullsized":"2024-05-08T18:34:31.729420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T18:34:31.729298+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T18:34:31.729298+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.729298+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:22.601345+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:44.374109+0000","last_change":"2024-05-08T18:34:44.374141+0000","last_active":"2024-05-08T18:34:44.374109+0000","last_peered":"2024-05-08T18:34:44.374109+0000","last_clean":"2024-05-08T18:34:44.374109+0000","last_became_active":"2024-05-08T18:31:04.303799+0000","last_became_peered":"2024-05-08T18:31:04.303799+0000","last_unstale":"2024-05-08T18:34:44.374109+0000","last_undegraded":"2024-05-08T18:34:44.374109+0000","last_fullsized":"2024-05-08T18:34:44.374109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T18:34:44.374025+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T18:34:44.374025+0000","last_clean_scrub_stamp":"2024-05-08T18:34:44.374025+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:13:06.326093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":471,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.900060+0000","last_change":"2024-05-08T18:34:18.900106+0000","last_active":"2024-05-08T18:34:18.900060+0000","last_peered":"2024-05-08T18:34:18.900060+0000","last_clean":"2024-05-08T18:34:18.900060+0000","last_became_active":"2024-05-08T18:31:06.305201+0000","last_became_peered":"2024-05-08T18:31:06.305201+0000","last_unstale":"2024-05-08T18:34:18.900060+0000","last_undegraded":"2024-05-08T18:34:18.900060+0000","last_fullsized":"2024-05-08T18:34:18.900060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:18.899957+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:18.899957+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.899957+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:33.086747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:40.831088+0000","last_change":"2024-05-08T18:34:40.831088+0000","last_active":"2024-05-08T18:34:40.831088+0000","last_peered":"2024-05-08T18:34:40.831088+0000","last_clean":"2024-05-08T18:34:40.831088+0000","last_became_active":"2024-05-08T18:31:08.310906+0000","last_became_peered":"2024-05-08T18:31:08.310906+0000","last_unstale":"2024-05-08T18:34:40.831088+0000","last_undegraded":"2024-05-08T18:34:40.831088+0000","last_fullsized":"2024-05-08T18:34:40.831088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:40.830900+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:40.830900+0000","last_clean_scrub_stamp":"2024-05-08T18:34:40.830900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:40.154817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'14","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:43.689169+0000","last_change":"2024-05-08T18:34:43.689169+0000","last_active":"2024-05-08T18:34:43.689169+0000","last_peered":"2024-05-08T18:34:43.689169+0000","last_clean":"2024-05-08T18:34:43.689169+0000","last_became_active":"2024-05-08T18:31:00.291563+0000","last_became_peered":"2024-05-08T18:31:00.291563+0000","last_unstale":"2024-05-08T18:34:43.689169+0000","last_undegraded":"2024-05-08T18:34:43.689169+0000","last_fullsized":"2024-05-08T18:34:43.689169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-08T18:34:43.689041+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-08T18:34:43.689041+0000","last_clean_scrub_stamp":"2024-05-08T18:34:43.689041+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:40.499135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.284333+0000","last_change":"2024-05-08T18:30:58.304032+0000","last_active":"2024-05-08T18:34:18.284333+0000","last_peered":"2024-05-08T18:34:18.284333+0000","last_clean":"2024-05-08T18:34:18.284333+0000","last_became_active":"2024-05-08T18:30:58.302966+0000","last_became_peered":"2024-05-08T18:30:58.302966+0000","last_unstale":"2024-05-08T18:34:18.284333+0000","last_undegraded":"2024-05-08T18:34:18.284333+0000","last_fullsized":"2024-05-08T18:34:18.284333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.676588+0000","last_change":"2024-05-08T18:34:28.676588+0000","last_active":"2024-05-08T18:34:28.676588+0000","last_peered":"2024-05-08T18:34:28.676588+0000","last_clean":"2024-05-08T18:34:28.676588+0000","last_became_active":"2024-05-08T18:31:02.288232+0000","last_became_peered":"2024-05-08T18:31:02.288232+0000","last_unstale":"2024-05-08T18:34:28.676588+0000","last_undegraded":"2024-05-08T18:34:28.676588+0000","last_fullsized":"2024-05-08T18:34:28.676588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:28.676467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:28.676467+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.676467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:08.488393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'48","reported_seq":107,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.893918+0000","last_change":"2024-05-08T18:34:19.893987+0000","last_active":"2024-05-08T18:34:19.893918+0000","last_peered":"2024-05-08T18:34:19.893918+0000","last_clean":"2024-05-08T18:34:19.893918+0000","last_became_active":"2024-05-08T18:31:04.301298+0000","last_became_peered":"2024-05-08T18:31:04.301298+0000","last_unstale":"2024-05-08T18:34:19.893918+0000","last_undegraded":"2024-05-08T18:34:19.893918+0000","last_fullsized":"2024-05-08T18:34:19.893918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-05-08T18:34:19.893818+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-05-08T18:34:19.893818+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.893818+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:10.115077+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.544426+0000","last_change":"2024-05-08T18:34:18.544453+0000","last_active":"2024-05-08T18:34:18.544426+0000","last_peered":"2024-05-08T18:34:18.544426+0000","last_clean":"2024-05-08T18:34:18.544426+0000","last_became_active":"2024-05-08T18:31:06.310430+0000","last_became_peered":"2024-05-08T18:31:06.310430+0000","last_unstale":"2024-05-08T18:34:18.544426+0000","last_undegraded":"2024-05-08T18:34:18.544426+0000","last_fullsized":"2024-05-08T18:34:18.544426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:18.544327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:18.544327+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.544327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:32.447203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:40.709867+0000","last_change":"2024-05-08T18:34:40.709867+0000","last_active":"2024-05-08T18:34:40.709867+0000","last_peered":"2024-05-08T18:34:40.709867+0000","last_clean":"2024-05-08T18:34:40.709867+0000","last_became_active":"2024-05-08T18:31:08.306492+0000","last_became_peered":"2024-05-08T18:31:08.306492+0000","last_unstale":"2024-05-08T18:34:40.709867+0000","last_undegraded":"2024-05-08T18:34:40.709867+0000","last_fullsized":"2024-05-08T18:34:40.709867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T18:34:40.709748+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T18:34:40.709748+0000","last_clean_scrub_stamp":"2024-05-08T18:34:40.709748+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:06.651897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'6","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:33.577031+0000","last_change":"2024-05-08T18:34:33.577031+0000","last_active":"2024-05-08T18:34:33.577031+0000","last_peered":"2024-05-08T18:34:33.577031+0000","last_clean":"2024-05-08T18:34:33.577031+0000","last_became_active":"2024-05-08T18:31:00.299186+0000","last_became_peered":"2024-05-08T18:31:00.299186+0000","last_unstale":"2024-05-08T18:34:33.577031+0000","last_undegraded":"2024-05-08T18:34:33.577031+0000","last_fullsized":"2024-05-08T18:34:33.577031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:33.576927+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:33.576927+0000","last_clean_scrub_stamp":"2024-05-08T18:34:33.576927+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:41.675591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'74","reported_seq":149,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:02.747774+0000","last_change":"2024-05-08T18:35:02.747810+0000","last_active":"2024-05-08T18:35:02.747774+0000","last_peered":"2024-05-08T18:35:02.747774+0000","last_clean":"2024-05-08T18:35:02.747774+0000","last_became_active":"2024-05-08T18:30:49.981852+0000","last_became_peered":"2024-05-08T18:30:49.981852+0000","last_unstale":"2024-05-08T18:35:02.747774+0000","last_undegraded":"2024-05-08T18:35:02.747774+0000","last_fullsized":"2024-05-08T18:35:02.747774+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'74","last_scrub_stamp":"2024-05-08T18:35:02.747676+0000","last_deep_scrub":"29'74","last_deep_scrub_stamp":"2024-05-08T18:35:02.747676+0000","last_clean_scrub_stamp":"2024-05-08T18:35:02.747676+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:50.713376+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:30.402942+0000","last_change":"2024-05-08T18:35:30.402978+0000","last_active":"2024-05-08T18:35:30.402942+0000","last_peered":"2024-05-08T18:35:30.402942+0000","last_clean":"2024-05-08T18:35:30.402942+0000","last_became_active":"2024-05-08T18:30:49.983023+0000","last_became_peered":"2024-05-08T18:30:49.983023+0000","last_unstale":"2024-05-08T18:35:30.402942+0000","last_undegraded":"2024-05-08T18:35:30.402942+0000","last_fullsized":"2024-05-08T18:35:30.402942+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:30.402808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:30.402808+0000","last_clean_scrub_stamp":"2024-05-08T18:35:30.402808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:52:50.730400+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.284225+0000","last_change":"2024-05-08T18:30:58.317086+0000","last_active":"2024-05-08T18:34:18.284225+0000","last_peered":"2024-05-08T18:34:18.284225+0000","last_clean":"2024-05-08T18:34:18.284225+0000","last_became_active":"2024-05-08T18:30:58.316676+0000","last_became_peered":"2024-05-08T18:30:58.316676+0000","last_unstale":"2024-05-08T18:34:18.284225+0000","last_undegraded":"2024-05-08T18:34:18.284225+0000","last_fullsized":"2024-05-08T18:34:18.284225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:16.651913+0000","last_change":"2024-05-08T18:35:16.651949+0000","last_active":"2024-05-08T18:35:16.651913+0000","last_peered":"2024-05-08T18:35:16.651913+0000","last_clean":"2024-05-08T18:35:16.651913+0000","last_became_active":"2024-05-08T18:31:45.339007+0000","last_became_peered":"2024-05-08T18:31:45.339007+0000","last_unstale":"2024-05-08T18:35:16.651913+0000","last_undegraded":"2024-05-08T18:35:16.651913+0000","last_fullsized":"2024-05-08T18:35:16.651913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:16.651792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:16.651792+0000","last_clean_scrub_stamp":"2024-05-08T18:35:16.651792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:36.250777+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'87","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:38.512120+0000","last_change":"2024-05-08T18:34:38.512120+0000","last_active":"2024-05-08T18:34:38.512120+0000","last_peered":"2024-05-08T18:34:38.512120+0000","last_clean":"2024-05-08T18:34:38.512120+0000","last_became_active":"2024-05-08T18:31:04.299145+0000","last_became_peered":"2024-05-08T18:31:04.299145+0000","last_unstale":"2024-05-08T18:34:38.512120+0000","last_undegraded":"2024-05-08T18:34:38.512120+0000","last_fullsized":"2024-05-08T18:34:38.512120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-08T18:34:38.511998+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-08T18:34:38.511998+0000","last_clean_scrub_stamp":"2024-05-08T18:34:38.511998+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:35:51.196766+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:33.515836+0000","last_change":"2024-05-08T18:34:33.515836+0000","last_active":"2024-05-08T18:34:33.515836+0000","last_peered":"2024-05-08T18:34:33.515836+0000","last_clean":"2024-05-08T18:34:33.515836+0000","last_became_active":"2024-05-08T18:31:06.311742+0000","last_became_peered":"2024-05-08T18:31:06.311742+0000","last_unstale":"2024-05-08T18:34:33.515836+0000","last_undegraded":"2024-05-08T18:34:33.515836+0000","last_fullsized":"2024-05-08T18:34:33.515836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:33.515721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:33.515721+0000","last_clean_scrub_stamp":"2024-05-08T18:34:33.515721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:27.574406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'87","reported_seq":180,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:36.847497+0000","last_change":"2024-05-08T18:34:36.847497+0000","last_active":"2024-05-08T18:34:36.847497+0000","last_peered":"2024-05-08T18:34:36.847497+0000","last_clean":"2024-05-08T18:34:36.847497+0000","last_became_active":"2024-05-08T18:31:08.310715+0000","last_became_peered":"2024-05-08T18:31:08.310715+0000","last_unstale":"2024-05-08T18:34:36.847497+0000","last_undegraded":"2024-05-08T18:34:36.847497+0000","last_fullsized":"2024-05-08T18:34:36.847497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-08T18:34:36.847334+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-08T18:34:36.847334+0000","last_clean_scrub_stamp":"2024-05-08T18:34:36.847334+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:13.088821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":173,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:00.304543+0000","last_change":"2024-05-08T18:35:00.304543+0000","last_active":"2024-05-08T18:35:00.304543+0000","last_peered":"2024-05-08T18:35:00.304543+0000","last_clean":"2024-05-08T18:35:00.304543+0000","last_became_active":"2024-05-08T18:31:00.295578+0000","last_became_peered":"2024-05-08T18:31:00.295578+0000","last_unstale":"2024-05-08T18:35:00.304543+0000","last_undegraded":"2024-05-08T18:35:00.304543+0000","last_fullsized":"2024-05-08T18:35:00.304543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:35:00.304389+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:35:00.304389+0000","last_clean_scrub_stamp":"2024-05-08T18:35:00.304389+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:10.730098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:29.354156+0000","last_change":"2024-05-08T18:35:29.354180+0000","last_active":"2024-05-08T18:35:29.354156+0000","last_peered":"2024-05-08T18:35:29.354156+0000","last_clean":"2024-05-08T18:35:29.354156+0000","last_became_active":"2024-05-08T18:30:49.982854+0000","last_became_peered":"2024-05-08T18:30:49.982854+0000","last_unstale":"2024-05-08T18:35:29.354156+0000","last_undegraded":"2024-05-08T18:35:29.354156+0000","last_fullsized":"2024-05-08T18:35:29.354156+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:29.354063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:29.354063+0000","last_clean_scrub_stamp":"2024-05-08T18:35:29.354063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:54.595824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:50.687618+0000","last_change":"2024-05-08T18:34:50.687618+0000","last_active":"2024-05-08T18:34:50.687618+0000","last_peered":"2024-05-08T18:34:50.687618+0000","last_clean":"2024-05-08T18:34:50.687618+0000","last_became_active":"2024-05-08T18:30:58.294153+0000","last_became_peered":"2024-05-08T18:30:58.294153+0000","last_unstale":"2024-05-08T18:34:50.687618+0000","last_undegraded":"2024-05-08T18:34:50.687618+0000","last_fullsized":"2024-05-08T18:34:50.687618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:50.687422+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:50.687422+0000","last_clean_scrub_stamp":"2024-05-08T18:34:50.687422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:13.071573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.642347+0000","last_change":"2024-05-08T18:34:19.642347+0000","last_active":"2024-05-08T18:34:19.642347+0000","last_peered":"2024-05-08T18:34:19.642347+0000","last_clean":"2024-05-08T18:34:19.642347+0000","last_became_active":"2024-05-08T18:31:02.291979+0000","last_became_peered":"2024-05-08T18:31:02.291979+0000","last_unstale":"2024-05-08T18:34:19.642347+0000","last_undegraded":"2024-05-08T18:34:19.642347+0000","last_fullsized":"2024-05-08T18:34:19.642347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:19.642214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:19.642214+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.642214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:44.702640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'291","reported_seq":517,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.858141+0000","last_change":"2024-05-08T18:34:25.858141+0000","last_active":"2024-05-08T18:34:25.858141+0000","last_peered":"2024-05-08T18:34:25.858141+0000","last_clean":"2024-05-08T18:34:25.858141+0000","last_became_active":"2024-05-08T18:31:04.299494+0000","last_became_peered":"2024-05-08T18:31:04.299494+0000","last_unstale":"2024-05-08T18:34:25.858141+0000","last_undegraded":"2024-05-08T18:34:25.858141+0000","last_fullsized":"2024-05-08T18:34:25.858141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'291","last_scrub_stamp":"2024-05-08T18:34:25.858006+0000","last_deep_scrub":"29'291","last_deep_scrub_stamp":"2024-05-08T18:34:25.858006+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.858006+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:00.713371+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:41.505277+0000","last_change":"2024-05-08T18:34:41.505277+0000","last_active":"2024-05-08T18:34:41.505277+0000","last_peered":"2024-05-08T18:34:41.505277+0000","last_clean":"2024-05-08T18:34:41.505277+0000","last_became_active":"2024-05-08T18:31:06.306554+0000","last_became_peered":"2024-05-08T18:31:06.306554+0000","last_unstale":"2024-05-08T18:34:41.505277+0000","last_undegraded":"2024-05-08T18:34:41.505277+0000","last_fullsized":"2024-05-08T18:34:41.505277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:41.505127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:41.505127+0000","last_clean_scrub_stamp":"2024-05-08T18:34:41.505127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:29.470827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:12.700281+0000","last_change":"2024-05-08T18:35:12.700281+0000","last_active":"2024-05-08T18:35:12.700281+0000","last_peered":"2024-05-08T18:35:12.700281+0000","last_clean":"2024-05-08T18:35:12.700281+0000","last_became_active":"2024-05-08T18:31:08.316536+0000","last_became_peered":"2024-05-08T18:31:08.316536+0000","last_unstale":"2024-05-08T18:35:12.700281+0000","last_undegraded":"2024-05-08T18:35:12.700281+0000","last_fullsized":"2024-05-08T18:35:12.700281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T18:35:12.700165+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T18:35:12.700165+0000","last_clean_scrub_stamp":"2024-05-08T18:35:12.700165+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:38:06.882396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'12","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:49.663199+0000","last_change":"2024-05-08T18:34:49.663199+0000","last_active":"2024-05-08T18:34:49.663199+0000","last_peered":"2024-05-08T18:34:49.663199+0000","last_clean":"2024-05-08T18:34:49.663199+0000","last_became_active":"2024-05-08T18:31:00.281359+0000","last_became_peered":"2024-05-08T18:31:00.281359+0000","last_unstale":"2024-05-08T18:34:49.663199+0000","last_undegraded":"2024-05-08T18:34:49.663199+0000","last_fullsized":"2024-05-08T18:34:49.663199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:49.663075+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:49.663075+0000","last_clean_scrub_stamp":"2024-05-08T18:34:49.663075+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:42.088380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:58.815500+0000","last_change":"2024-05-08T18:34:58.815524+0000","last_active":"2024-05-08T18:34:58.815500+0000","last_peered":"2024-05-08T18:34:58.815500+0000","last_clean":"2024-05-08T18:34:58.815500+0000","last_became_active":"2024-05-08T18:30:49.982438+0000","last_became_peered":"2024-05-08T18:30:49.982438+0000","last_unstale":"2024-05-08T18:34:58.815500+0000","last_undegraded":"2024-05-08T18:34:58.815500+0000","last_fullsized":"2024-05-08T18:34:58.815500+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:58.815417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:58.815417+0000","last_clean_scrub_stamp":"2024-05-08T18:34:58.815417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:19.949858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:56.776237+0000","last_change":"2024-05-08T18:34:56.776237+0000","last_active":"2024-05-08T18:34:56.776237+0000","last_peered":"2024-05-08T18:34:56.776237+0000","last_clean":"2024-05-08T18:34:56.776237+0000","last_became_active":"2024-05-08T18:30:58.294292+0000","last_became_peered":"2024-05-08T18:30:58.294292+0000","last_unstale":"2024-05-08T18:34:56.776237+0000","last_undegraded":"2024-05-08T18:34:56.776237+0000","last_fullsized":"2024-05-08T18:34:56.776237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:56.776056+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:56.776056+0000","last_clean_scrub_stamp":"2024-05-08T18:34:56.776056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:32.295347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:39.826486+0000","last_change":"2024-05-08T18:34:39.826486+0000","last_active":"2024-05-08T18:34:39.826486+0000","last_peered":"2024-05-08T18:34:39.826486+0000","last_clean":"2024-05-08T18:34:39.826486+0000","last_became_active":"2024-05-08T18:31:02.291806+0000","last_became_peered":"2024-05-08T18:31:02.291806+0000","last_unstale":"2024-05-08T18:34:39.826486+0000","last_undegraded":"2024-05-08T18:34:39.826486+0000","last_fullsized":"2024-05-08T18:34:39.826486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:39.826333+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:39.826333+0000","last_clean_scrub_stamp":"2024-05-08T18:34:39.826333+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:07.772048+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.698673+0000","last_change":"2024-05-08T18:34:26.698673+0000","last_active":"2024-05-08T18:34:26.698673+0000","last_peered":"2024-05-08T18:34:26.698673+0000","last_clean":"2024-05-08T18:34:26.698673+0000","last_became_active":"2024-05-08T18:31:04.303321+0000","last_became_peered":"2024-05-08T18:31:04.303321+0000","last_unstale":"2024-05-08T18:34:26.698673+0000","last_undegraded":"2024-05-08T18:34:26.698673+0000","last_fullsized":"2024-05-08T18:34:26.698673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-05-08T18:34:26.698537+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-05-08T18:34:26.698537+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.698537+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:44.151622+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.566404+0000","last_change":"2024-05-08T18:34:25.566404+0000","last_active":"2024-05-08T18:34:25.566404+0000","last_peered":"2024-05-08T18:34:25.566404+0000","last_clean":"2024-05-08T18:34:25.566404+0000","last_became_active":"2024-05-08T18:31:06.309525+0000","last_became_peered":"2024-05-08T18:31:06.309525+0000","last_unstale":"2024-05-08T18:34:25.566404+0000","last_undegraded":"2024-05-08T18:34:25.566404+0000","last_fullsized":"2024-05-08T18:34:25.566404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:25.566280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:25.566280+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.566280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:00.421645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'8","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:02.261778+0000","last_change":"2024-05-08T18:35:02.261818+0000","last_active":"2024-05-08T18:35:02.261778+0000","last_peered":"2024-05-08T18:35:02.261778+0000","last_clean":"2024-05-08T18:35:02.261778+0000","last_became_active":"2024-05-08T18:31:08.314503+0000","last_became_peered":"2024-05-08T18:31:08.314503+0000","last_unstale":"2024-05-08T18:35:02.261778+0000","last_undegraded":"2024-05-08T18:35:02.261778+0000","last_fullsized":"2024-05-08T18:35:02.261778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:35:02.261651+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:35:02.261651+0000","last_clean_scrub_stamp":"2024-05-08T18:35:02.261651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:26.632114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'6","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:59.672032+0000","last_change":"2024-05-08T18:34:59.672032+0000","last_active":"2024-05-08T18:34:59.672032+0000","last_peered":"2024-05-08T18:34:59.672032+0000","last_clean":"2024-05-08T18:34:59.672032+0000","last_became_active":"2024-05-08T18:31:00.283410+0000","last_became_peered":"2024-05-08T18:31:00.283410+0000","last_unstale":"2024-05-08T18:34:59.672032+0000","last_undegraded":"2024-05-08T18:34:59.672032+0000","last_fullsized":"2024-05-08T18:34:59.672032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:59.671941+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:59.671941+0000","last_clean_scrub_stamp":"2024-05-08T18:34:59.671941+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:36.374168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:31.451675+0000","last_change":"2024-05-08T18:35:31.451699+0000","last_active":"2024-05-08T18:35:31.451675+0000","last_peered":"2024-05-08T18:35:31.451675+0000","last_clean":"2024-05-08T18:35:31.451675+0000","last_became_active":"2024-05-08T18:30:49.983515+0000","last_became_peered":"2024-05-08T18:30:49.983515+0000","last_unstale":"2024-05-08T18:35:31.451675+0000","last_undegraded":"2024-05-08T18:35:31.451675+0000","last_fullsized":"2024-05-08T18:35:31.451675+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:31.451567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:31.451567+0000","last_clean_scrub_stamp":"2024-05-08T18:35:31.451567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:18.862553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:51.854795+0000","last_change":"2024-05-08T18:34:51.854795+0000","last_active":"2024-05-08T18:34:51.854795+0000","last_peered":"2024-05-08T18:34:51.854795+0000","last_clean":"2024-05-08T18:34:51.854795+0000","last_became_active":"2024-05-08T18:30:58.306268+0000","last_became_peered":"2024-05-08T18:30:58.306268+0000","last_unstale":"2024-05-08T18:34:51.854795+0000","last_undegraded":"2024-05-08T18:34:51.854795+0000","last_fullsized":"2024-05-08T18:34:51.854795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:51.854640+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:51.854640+0000","last_clean_scrub_stamp":"2024-05-08T18:34:51.854640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:08.246146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:36.627397+0000","last_change":"2024-05-08T18:34:36.627397+0000","last_active":"2024-05-08T18:34:36.627397+0000","last_peered":"2024-05-08T18:34:36.627397+0000","last_clean":"2024-05-08T18:34:36.627397+0000","last_became_active":"2024-05-08T18:31:02.292030+0000","last_became_peered":"2024-05-08T18:31:02.292030+0000","last_unstale":"2024-05-08T18:34:36.627397+0000","last_undegraded":"2024-05-08T18:34:36.627397+0000","last_fullsized":"2024-05-08T18:34:36.627397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:36.627276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:36.627276+0000","last_clean_scrub_stamp":"2024-05-08T18:34:36.627276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:58.136593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.698478+0000","last_change":"2024-05-08T18:34:24.698478+0000","last_active":"2024-05-08T18:34:24.698478+0000","last_peered":"2024-05-08T18:34:24.698478+0000","last_clean":"2024-05-08T18:34:24.698478+0000","last_became_active":"2024-05-08T18:31:04.296257+0000","last_became_peered":"2024-05-08T18:31:04.296257+0000","last_unstale":"2024-05-08T18:34:24.698478+0000","last_undegraded":"2024-05-08T18:34:24.698478+0000","last_fullsized":"2024-05-08T18:34:24.698478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-08T18:34:24.698350+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-08T18:34:24.698350+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.698350+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:44.670942+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:46.393005+0000","last_change":"2024-05-08T18:34:46.393005+0000","last_active":"2024-05-08T18:34:46.393005+0000","last_peered":"2024-05-08T18:34:46.393005+0000","last_clean":"2024-05-08T18:34:46.393005+0000","last_became_active":"2024-05-08T18:31:06.308892+0000","last_became_peered":"2024-05-08T18:31:06.308892+0000","last_unstale":"2024-05-08T18:34:46.393005+0000","last_undegraded":"2024-05-08T18:34:46.393005+0000","last_fullsized":"2024-05-08T18:34:46.393005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:46.392855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:46.392855+0000","last_clean_scrub_stamp":"2024-05-08T18:34:46.392855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:12.321949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:14.687446+0000","last_change":"2024-05-08T18:35:14.687446+0000","last_active":"2024-05-08T18:35:14.687446+0000","last_peered":"2024-05-08T18:35:14.687446+0000","last_clean":"2024-05-08T18:35:14.687446+0000","last_became_active":"2024-05-08T18:31:08.318728+0000","last_became_peered":"2024-05-08T18:31:08.318728+0000","last_unstale":"2024-05-08T18:35:14.687446+0000","last_undegraded":"2024-05-08T18:35:14.687446+0000","last_fullsized":"2024-05-08T18:35:14.687446+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:14.687300+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:14.687300+0000","last_clean_scrub_stamp":"2024-05-08T18:35:14.687300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:25.221538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:13.819445+0000","last_change":"2024-05-08T18:35:13.819477+0000","last_active":"2024-05-08T18:35:13.819445+0000","last_peered":"2024-05-08T18:35:13.819445+0000","last_clean":"2024-05-08T18:35:13.819445+0000","last_became_active":"2024-05-08T18:31:45.337785+0000","last_became_peered":"2024-05-08T18:31:45.337785+0000","last_unstale":"2024-05-08T18:35:13.819445+0000","last_undegraded":"2024-05-08T18:35:13.819445+0000","last_fullsized":"2024-05-08T18:35:13.819445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:13.819362+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:13.819362+0000","last_clean_scrub_stamp":"2024-05-08T18:35:13.819362+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:13:35.771430+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:03.840567+0000","last_change":"2024-05-08T18:35:03.840567+0000","last_active":"2024-05-08T18:35:03.840567+0000","last_peered":"2024-05-08T18:35:03.840567+0000","last_clean":"2024-05-08T18:35:03.840567+0000","last_became_active":"2024-05-08T18:30:58.302328+0000","last_became_peered":"2024-05-08T18:30:58.302328+0000","last_unstale":"2024-05-08T18:35:03.840567+0000","last_undegraded":"2024-05-08T18:35:03.840567+0000","last_fullsized":"2024-05-08T18:35:03.840567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:03.840399+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:03.840399+0000","last_clean_scrub_stamp":"2024-05-08T18:35:03.840399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:23.927754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:04.757625+0000","last_change":"2024-05-08T18:35:04.757702+0000","last_active":"2024-05-08T18:35:04.757625+0000","last_peered":"2024-05-08T18:35:04.757625+0000","last_clean":"2024-05-08T18:35:04.757625+0000","last_became_active":"2024-05-08T18:30:49.983522+0000","last_became_peered":"2024-05-08T18:30:49.983522+0000","last_unstale":"2024-05-08T18:35:04.757625+0000","last_undegraded":"2024-05-08T18:35:04.757625+0000","last_fullsized":"2024-05-08T18:35:04.757625+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:04.757514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:04.757514+0000","last_clean_scrub_stamp":"2024-05-08T18:35:04.757514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:13:26.709582+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:34.565146+0000","last_change":"2024-05-08T18:34:34.565146+0000","last_active":"2024-05-08T18:34:34.565146+0000","last_peered":"2024-05-08T18:34:34.565146+0000","last_clean":"2024-05-08T18:34:34.565146+0000","last_became_active":"2024-05-08T18:31:02.294603+0000","last_became_peered":"2024-05-08T18:31:02.294603+0000","last_unstale":"2024-05-08T18:34:34.565146+0000","last_undegraded":"2024-05-08T18:34:34.565146+0000","last_fullsized":"2024-05-08T18:34:34.565146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-05-08T18:34:34.564981+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-05-08T18:34:34.564981+0000","last_clean_scrub_stamp":"2024-05-08T18:34:34.564981+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:44:24.904584+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'75","reported_seq":152,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.528098+0000","last_change":"2024-05-08T18:34:32.528098+0000","last_active":"2024-05-08T18:34:32.528098+0000","last_peered":"2024-05-08T18:34:32.528098+0000","last_clean":"2024-05-08T18:34:32.528098+0000","last_became_active":"2024-05-08T18:31:04.295090+0000","last_became_peered":"2024-05-08T18:31:04.295090+0000","last_unstale":"2024-05-08T18:34:32.528098+0000","last_undegraded":"2024-05-08T18:34:32.528098+0000","last_fullsized":"2024-05-08T18:34:32.528098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'75","last_scrub_stamp":"2024-05-08T18:34:32.527967+0000","last_deep_scrub":"29'75","last_deep_scrub_stamp":"2024-05-08T18:34:32.527967+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.527967+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:27.504565+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.653420+0000","last_change":"2024-05-08T18:34:24.653420+0000","last_active":"2024-05-08T18:34:24.653420+0000","last_peered":"2024-05-08T18:34:24.653420+0000","last_clean":"2024-05-08T18:34:24.653420+0000","last_became_active":"2024-05-08T18:31:06.312179+0000","last_became_peered":"2024-05-08T18:31:06.312179+0000","last_unstale":"2024-05-08T18:34:24.653420+0000","last_undegraded":"2024-05-08T18:34:24.653420+0000","last_fullsized":"2024-05-08T18:34:24.653420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:24.653263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:24.653263+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.653263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:54:11.402636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:41.580819+0000","last_change":"2024-05-08T18:34:41.580867+0000","last_active":"2024-05-08T18:34:41.580819+0000","last_peered":"2024-05-08T18:34:41.580819+0000","last_clean":"2024-05-08T18:34:41.580819+0000","last_became_active":"2024-05-08T18:31:08.304818+0000","last_became_peered":"2024-05-08T18:31:08.304818+0000","last_unstale":"2024-05-08T18:34:41.580819+0000","last_undegraded":"2024-05-08T18:34:41.580819+0000","last_fullsized":"2024-05-08T18:34:41.580819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-08T18:34:41.580713+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-08T18:34:41.580713+0000","last_clean_scrub_stamp":"2024-05-08T18:34:41.580713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.972218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'6","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:37.695951+0000","last_change":"2024-05-08T18:34:37.695951+0000","last_active":"2024-05-08T18:34:37.695951+0000","last_peered":"2024-05-08T18:34:37.695951+0000","last_clean":"2024-05-08T18:34:37.695951+0000","last_became_active":"2024-05-08T18:31:00.294157+0000","last_became_peered":"2024-05-08T18:31:00.294157+0000","last_unstale":"2024-05-08T18:34:37.695951+0000","last_undegraded":"2024-05-08T18:34:37.695951+0000","last_fullsized":"2024-05-08T18:34:37.695951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:37.695840+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:37.695840+0000","last_clean_scrub_stamp":"2024-05-08T18:34:37.695840+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:25.082640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:02.698114+0000","last_change":"2024-05-08T18:35:02.698114+0000","last_active":"2024-05-08T18:35:02.698114+0000","last_peered":"2024-05-08T18:35:02.698114+0000","last_clean":"2024-05-08T18:35:02.698114+0000","last_became_active":"2024-05-08T18:30:58.286578+0000","last_became_peered":"2024-05-08T18:30:58.286578+0000","last_unstale":"2024-05-08T18:35:02.698114+0000","last_undegraded":"2024-05-08T18:35:02.698114+0000","last_fullsized":"2024-05-08T18:35:02.698114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:02.697942+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:02.697942+0000","last_clean_scrub_stamp":"2024-05-08T18:35:02.697942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:40.346535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:28.318172+0000","last_change":"2024-05-08T18:35:28.318201+0000","last_active":"2024-05-08T18:35:28.318172+0000","last_peered":"2024-05-08T18:35:28.318172+0000","last_clean":"2024-05-08T18:35:28.318172+0000","last_became_active":"2024-05-08T18:30:49.982471+0000","last_became_peered":"2024-05-08T18:30:49.982471+0000","last_unstale":"2024-05-08T18:35:28.318172+0000","last_undegraded":"2024-05-08T18:35:28.318172+0000","last_fullsized":"2024-05-08T18:35:28.318172+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:28.318048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:28.318048+0000","last_clean_scrub_stamp":"2024-05-08T18:35:28.318048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:32.899402+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.702739+0000","last_change":"2024-05-08T18:34:27.702739+0000","last_active":"2024-05-08T18:34:27.702739+0000","last_peered":"2024-05-08T18:34:27.702739+0000","last_clean":"2024-05-08T18:34:27.702739+0000","last_became_active":"2024-05-08T18:31:02.287974+0000","last_became_peered":"2024-05-08T18:31:02.287974+0000","last_unstale":"2024-05-08T18:34:27.702739+0000","last_undegraded":"2024-05-08T18:34:27.702739+0000","last_fullsized":"2024-05-08T18:34:27.702739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:27.702607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:27.702607+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.702607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:19.640531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'22","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.906780+0000","last_change":"2024-05-08T18:34:21.906780+0000","last_active":"2024-05-08T18:34:21.906780+0000","last_peered":"2024-05-08T18:34:21.906780+0000","last_clean":"2024-05-08T18:34:21.906780+0000","last_became_active":"2024-05-08T18:31:04.301116+0000","last_became_peered":"2024-05-08T18:31:04.301116+0000","last_unstale":"2024-05-08T18:34:21.906780+0000","last_undegraded":"2024-05-08T18:34:21.906780+0000","last_fullsized":"2024-05-08T18:34:21.906780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-08T18:34:21.906639+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-08T18:34:21.906639+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.906639+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:13.184187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":387,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.878020+0000","last_change":"2024-05-08T18:34:20.878020+0000","last_active":"2024-05-08T18:34:20.878020+0000","last_peered":"2024-05-08T18:34:20.878020+0000","last_clean":"2024-05-08T18:34:20.878020+0000","last_became_active":"2024-05-08T18:31:06.308274+0000","last_became_peered":"2024-05-08T18:31:06.308274+0000","last_unstale":"2024-05-08T18:34:20.878020+0000","last_undegraded":"2024-05-08T18:34:20.878020+0000","last_fullsized":"2024-05-08T18:34:20.878020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:20.877846+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:20.877846+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.877846+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:15.946216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.180498+0000","last_change":"2024-05-08T18:31:08.318932+0000","last_active":"2024-05-08T18:33:23.180498+0000","last_peered":"2024-05-08T18:33:23.180498+0000","last_clean":"2024-05-08T18:33:23.180498+0000","last_became_active":"2024-05-08T18:31:08.318609+0000","last_became_peered":"2024-05-08T18:31:08.318609+0000","last_unstale":"2024-05-08T18:33:23.180498+0000","last_undegraded":"2024-05-08T18:33:23.180498+0000","last_fullsized":"2024-05-08T18:33:23.180498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:04.290347+0000","last_change":"2024-05-08T18:35:04.290371+0000","last_active":"2024-05-08T18:35:04.290347+0000","last_peered":"2024-05-08T18:35:04.290347+0000","last_clean":"2024-05-08T18:35:04.290347+0000","last_became_active":"2024-05-08T18:31:00.291093+0000","last_became_peered":"2024-05-08T18:31:00.291093+0000","last_unstale":"2024-05-08T18:35:04.290347+0000","last_undegraded":"2024-05-08T18:35:04.290347+0000","last_fullsized":"2024-05-08T18:35:04.290347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:04.290261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:04.290261+0000","last_clean_scrub_stamp":"2024-05-08T18:35:04.290261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:18.897471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:23.425372+0000","last_change":"2024-05-08T18:35:23.425417+0000","last_active":"2024-05-08T18:35:23.425372+0000","last_peered":"2024-05-08T18:35:23.425372+0000","last_clean":"2024-05-08T18:35:23.425372+0000","last_became_active":"2024-05-08T18:30:58.305915+0000","last_became_peered":"2024-05-08T18:30:58.305915+0000","last_unstale":"2024-05-08T18:35:23.425372+0000","last_undegraded":"2024-05-08T18:35:23.425372+0000","last_fullsized":"2024-05-08T18:35:23.425372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:23.425253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:23.425253+0000","last_clean_scrub_stamp":"2024-05-08T18:35:23.425253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:03.755517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:03.711951+0000","last_change":"2024-05-08T18:35:03.711951+0000","last_active":"2024-05-08T18:35:03.711951+0000","last_peered":"2024-05-08T18:35:03.711951+0000","last_clean":"2024-05-08T18:35:03.711951+0000","last_became_active":"2024-05-08T18:30:49.982330+0000","last_became_peered":"2024-05-08T18:30:49.982330+0000","last_unstale":"2024-05-08T18:35:03.711951+0000","last_undegraded":"2024-05-08T18:35:03.711951+0000","last_fullsized":"2024-05-08T18:35:03.711951+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:03.711830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:03.711830+0000","last_clean_scrub_stamp":"2024-05-08T18:35:03.711830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:44.102855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.649104+0000","last_change":"2024-05-08T18:34:18.649104+0000","last_active":"2024-05-08T18:34:18.649104+0000","last_peered":"2024-05-08T18:34:18.649104+0000","last_clean":"2024-05-08T18:34:18.649104+0000","last_became_active":"2024-05-08T18:31:02.292328+0000","last_became_peered":"2024-05-08T18:31:02.292328+0000","last_unstale":"2024-05-08T18:34:18.649104+0000","last_undegraded":"2024-05-08T18:34:18.649104+0000","last_fullsized":"2024-05-08T18:34:18.649104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:18.648949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:18.648949+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.648949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:06.035748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:47.396324+0000","last_change":"2024-05-08T18:34:47.396324+0000","last_active":"2024-05-08T18:34:47.396324+0000","last_peered":"2024-05-08T18:34:47.396324+0000","last_clean":"2024-05-08T18:34:47.396324+0000","last_became_active":"2024-05-08T18:31:04.302020+0000","last_became_peered":"2024-05-08T18:31:04.302020+0000","last_unstale":"2024-05-08T18:34:47.396324+0000","last_undegraded":"2024-05-08T18:34:47.396324+0000","last_fullsized":"2024-05-08T18:34:47.396324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T18:34:47.396183+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T18:34:47.396183+0000","last_clean_scrub_stamp":"2024-05-08T18:34:47.396183+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:55.696682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":402,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.664202+0000","last_change":"2024-05-08T18:34:23.664202+0000","last_active":"2024-05-08T18:34:23.664202+0000","last_peered":"2024-05-08T18:34:23.664202+0000","last_clean":"2024-05-08T18:34:23.664202+0000","last_became_active":"2024-05-08T18:31:06.305020+0000","last_became_peered":"2024-05-08T18:31:06.305020+0000","last_unstale":"2024-05-08T18:34:23.664202+0000","last_undegraded":"2024-05-08T18:34:23.664202+0000","last_fullsized":"2024-05-08T18:34:23.664202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:23.664078+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:23.664078+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.664078+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:16.647836+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:44.668213+0000","last_change":"2024-05-08T18:34:44.668260+0000","last_active":"2024-05-08T18:34:44.668213+0000","last_peered":"2024-05-08T18:34:44.668213+0000","last_clean":"2024-05-08T18:34:44.668213+0000","last_became_active":"2024-05-08T18:31:08.309869+0000","last_became_peered":"2024-05-08T18:31:08.309869+0000","last_unstale":"2024-05-08T18:34:44.668213+0000","last_undegraded":"2024-05-08T18:34:44.668213+0000","last_fullsized":"2024-05-08T18:34:44.668213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:34:44.668104+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:34:44.668104+0000","last_clean_scrub_stamp":"2024-05-08T18:34:44.668104+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:43.032453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:41.850994+0000","last_change":"2024-05-08T18:34:41.850994+0000","last_active":"2024-05-08T18:34:41.850994+0000","last_peered":"2024-05-08T18:34:41.850994+0000","last_clean":"2024-05-08T18:34:41.850994+0000","last_became_active":"2024-05-08T18:31:00.296431+0000","last_became_peered":"2024-05-08T18:31:00.296431+0000","last_unstale":"2024-05-08T18:34:41.850994+0000","last_undegraded":"2024-05-08T18:34:41.850994+0000","last_fullsized":"2024-05-08T18:34:41.850994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:41.850804+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:41.850804+0000","last_clean_scrub_stamp":"2024-05-08T18:34:41.850804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:26:55.361491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:08.785644+0000","last_change":"2024-05-08T18:35:08.785644+0000","last_active":"2024-05-08T18:35:08.785644+0000","last_peered":"2024-05-08T18:35:08.785644+0000","last_clean":"2024-05-08T18:35:08.785644+0000","last_became_active":"2024-05-08T18:30:58.303997+0000","last_became_peered":"2024-05-08T18:30:58.303997+0000","last_unstale":"2024-05-08T18:35:08.785644+0000","last_undegraded":"2024-05-08T18:35:08.785644+0000","last_fullsized":"2024-05-08T18:35:08.785644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:08.785470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:08.785470+0000","last_clean_scrub_stamp":"2024-05-08T18:35:08.785470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:40:17.085969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:32.487007+0000","last_change":"2024-05-08T18:35:32.487045+0000","last_active":"2024-05-08T18:35:32.487007+0000","last_peered":"2024-05-08T18:35:32.487007+0000","last_clean":"2024-05-08T18:35:32.487007+0000","last_became_active":"2024-05-08T18:30:49.984280+0000","last_became_peered":"2024-05-08T18:30:49.984280+0000","last_unstale":"2024-05-08T18:35:32.487007+0000","last_undegraded":"2024-05-08T18:35:32.487007+0000","last_fullsized":"2024-05-08T18:35:32.487007+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:32.486911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:32.486911+0000","last_clean_scrub_stamp":"2024-05-08T18:35:32.486911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:59.170114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.647908+0000","last_change":"2024-05-08T18:34:21.647908+0000","last_active":"2024-05-08T18:34:21.647908+0000","last_peered":"2024-05-08T18:34:21.647908+0000","last_clean":"2024-05-08T18:34:21.647908+0000","last_became_active":"2024-05-08T18:31:02.290540+0000","last_became_peered":"2024-05-08T18:31:02.290540+0000","last_unstale":"2024-05-08T18:34:21.647908+0000","last_undegraded":"2024-05-08T18:34:21.647908+0000","last_fullsized":"2024-05-08T18:34:21.647908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:21.647799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:21.647799+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.647799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:43:40.019529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.670650+0000","last_change":"2024-05-08T18:34:23.670650+0000","last_active":"2024-05-08T18:34:23.670650+0000","last_peered":"2024-05-08T18:34:23.670650+0000","last_clean":"2024-05-08T18:34:23.670650+0000","last_became_active":"2024-05-08T18:31:04.304669+0000","last_became_peered":"2024-05-08T18:31:04.304669+0000","last_unstale":"2024-05-08T18:34:23.670650+0000","last_undegraded":"2024-05-08T18:34:23.670650+0000","last_fullsized":"2024-05-08T18:34:23.670650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-05-08T18:34:23.670475+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-05-08T18:34:23.670475+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.670475+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.365929+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:17.640131+0000","last_change":"2024-05-08T18:34:17.640131+0000","last_active":"2024-05-08T18:34:17.640131+0000","last_peered":"2024-05-08T18:34:17.640131+0000","last_clean":"2024-05-08T18:34:17.640131+0000","last_became_active":"2024-05-08T18:31:06.308621+0000","last_became_peered":"2024-05-08T18:31:06.308621+0000","last_unstale":"2024-05-08T18:34:17.640131+0000","last_undegraded":"2024-05-08T18:34:17.640131+0000","last_fullsized":"2024-05-08T18:34:17.640131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:17.639997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:17.639997+0000","last_clean_scrub_stamp":"2024-05-08T18:34:17.639997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:50.847042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.736117+0000","last_change":"2024-05-08T18:34:32.736144+0000","last_active":"2024-05-08T18:34:32.736117+0000","last_peered":"2024-05-08T18:34:32.736117+0000","last_clean":"2024-05-08T18:34:32.736117+0000","last_became_active":"2024-05-08T18:31:08.308427+0000","last_became_peered":"2024-05-08T18:31:08.308427+0000","last_unstale":"2024-05-08T18:34:32.736117+0000","last_undegraded":"2024-05-08T18:34:32.736117+0000","last_fullsized":"2024-05-08T18:34:32.736117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:32.736032+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:32.736032+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.736032+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:14.795378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:09.918330+0000","last_change":"2024-05-08T18:35:09.918330+0000","last_active":"2024-05-08T18:35:09.918330+0000","last_peered":"2024-05-08T18:35:09.918330+0000","last_clean":"2024-05-08T18:35:09.918330+0000","last_became_active":"2024-05-08T18:31:08.315257+0000","last_became_peered":"2024-05-08T18:31:08.315257+0000","last_unstale":"2024-05-08T18:35:09.918330+0000","last_undegraded":"2024-05-08T18:35:09.918330+0000","last_fullsized":"2024-05-08T18:35:09.918330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:09.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:09.918223+0000","last_clean_scrub_stamp":"2024-05-08T18:35:09.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:01.610620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'12","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:54.880253+0000","last_change":"2024-05-08T18:34:54.880286+0000","last_active":"2024-05-08T18:34:54.880253+0000","last_peered":"2024-05-08T18:34:54.880253+0000","last_clean":"2024-05-08T18:34:54.880253+0000","last_became_active":"2024-05-08T18:31:00.294827+0000","last_became_peered":"2024-05-08T18:31:00.294827+0000","last_unstale":"2024-05-08T18:34:54.880253+0000","last_undegraded":"2024-05-08T18:34:54.880253+0000","last_fullsized":"2024-05-08T18:34:54.880253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:54.880168+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:54.880168+0000","last_clean_scrub_stamp":"2024-05-08T18:34:54.880168+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:49.670548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:14.351095+0000","last_change":"2024-05-08T18:35:14.351140+0000","last_active":"2024-05-08T18:35:14.351095+0000","last_peered":"2024-05-08T18:35:14.351095+0000","last_clean":"2024-05-08T18:35:14.351095+0000","last_became_active":"2024-05-08T18:30:58.313034+0000","last_became_peered":"2024-05-08T18:30:58.313034+0000","last_unstale":"2024-05-08T18:35:14.351095+0000","last_undegraded":"2024-05-08T18:35:14.351095+0000","last_fullsized":"2024-05-08T18:35:14.351095+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:14.350985+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:14.350985+0000","last_clean_scrub_stamp":"2024-05-08T18:35:14.350985+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:28.132388+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.763311+0000","last_change":"2024-05-08T18:34:30.763337+0000","last_active":"2024-05-08T18:34:30.763311+0000","last_peered":"2024-05-08T18:34:30.763311+0000","last_clean":"2024-05-08T18:34:30.763311+0000","last_became_active":"2024-05-08T18:31:02.291119+0000","last_became_peered":"2024-05-08T18:31:02.291119+0000","last_unstale":"2024-05-08T18:34:30.763311+0000","last_undegraded":"2024-05-08T18:34:30.763311+0000","last_fullsized":"2024-05-08T18:34:30.763311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:30.763186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:30.763186+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.763186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:48.428188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'41","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:51.439127+0000","last_change":"2024-05-08T18:34:51.439168+0000","last_active":"2024-05-08T18:34:51.439127+0000","last_peered":"2024-05-08T18:34:51.439127+0000","last_clean":"2024-05-08T18:34:51.439127+0000","last_became_active":"2024-05-08T18:31:04.300990+0000","last_became_peered":"2024-05-08T18:31:04.300990+0000","last_unstale":"2024-05-08T18:34:51.439127+0000","last_undegraded":"2024-05-08T18:34:51.439127+0000","last_fullsized":"2024-05-08T18:34:51.439127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-05-08T18:34:51.439030+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-05-08T18:34:51.439030+0000","last_clean_scrub_stamp":"2024-05-08T18:34:51.439030+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:18.253390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:58.305653+0000","last_change":"2024-05-08T18:34:58.305690+0000","last_active":"2024-05-08T18:34:58.305653+0000","last_peered":"2024-05-08T18:34:58.305653+0000","last_clean":"2024-05-08T18:34:58.305653+0000","last_became_active":"2024-05-08T18:31:06.314696+0000","last_became_peered":"2024-05-08T18:31:06.314696+0000","last_unstale":"2024-05-08T18:34:58.305653+0000","last_undegraded":"2024-05-08T18:34:58.305653+0000","last_fullsized":"2024-05-08T18:34:58.305653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:58.305535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:58.305535+0000","last_clean_scrub_stamp":"2024-05-08T18:34:58.305535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:16.613195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:16.834710+0000","last_change":"2024-05-08T18:35:16.834736+0000","last_active":"2024-05-08T18:35:16.834710+0000","last_peered":"2024-05-08T18:35:16.834710+0000","last_clean":"2024-05-08T18:35:16.834710+0000","last_became_active":"2024-05-08T18:31:08.318901+0000","last_became_peered":"2024-05-08T18:31:08.318901+0000","last_unstale":"2024-05-08T18:35:16.834710+0000","last_undegraded":"2024-05-08T18:35:16.834710+0000","last_fullsized":"2024-05-08T18:35:16.834710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-08T18:35:16.834621+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-08T18:35:16.834621+0000","last_clean_scrub_stamp":"2024-05-08T18:35:16.834621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:15:16.824610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:39.751848+0000","last_change":"2024-05-08T18:34:39.751907+0000","last_active":"2024-05-08T18:34:39.751848+0000","last_peered":"2024-05-08T18:34:39.751848+0000","last_clean":"2024-05-08T18:34:39.751848+0000","last_became_active":"2024-05-08T18:31:00.292376+0000","last_became_peered":"2024-05-08T18:31:00.292376+0000","last_unstale":"2024-05-08T18:34:39.751848+0000","last_undegraded":"2024-05-08T18:34:39.751848+0000","last_fullsized":"2024-05-08T18:34:39.751848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:39.751747+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:39.751747+0000","last_clean_scrub_stamp":"2024-05-08T18:34:39.751747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:21.882010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:02.862804+0000","last_change":"2024-05-08T18:35:02.862829+0000","last_active":"2024-05-08T18:35:02.862804+0000","last_peered":"2024-05-08T18:35:02.862804+0000","last_clean":"2024-05-08T18:35:02.862804+0000","last_became_active":"2024-05-08T18:30:58.301520+0000","last_became_peered":"2024-05-08T18:30:58.301520+0000","last_unstale":"2024-05-08T18:35:02.862804+0000","last_undegraded":"2024-05-08T18:35:02.862804+0000","last_fullsized":"2024-05-08T18:35:02.862804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:02.862701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:02.862701+0000","last_clean_scrub_stamp":"2024-05-08T18:35:02.862701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:10.961365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.673362+0000","last_change":"2024-05-08T18:34:22.673400+0000","last_active":"2024-05-08T18:34:22.673362+0000","last_peered":"2024-05-08T18:34:22.673362+0000","last_clean":"2024-05-08T18:34:22.673362+0000","last_became_active":"2024-05-08T18:31:02.293459+0000","last_became_peered":"2024-05-08T18:31:02.293459+0000","last_unstale":"2024-05-08T18:34:22.673362+0000","last_undegraded":"2024-05-08T18:34:22.673362+0000","last_fullsized":"2024-05-08T18:34:22.673362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:22.673274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:22.673274+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.673274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:39.064779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.593729+0000","last_change":"2024-05-08T18:34:27.593763+0000","last_active":"2024-05-08T18:34:27.593729+0000","last_peered":"2024-05-08T18:34:27.593729+0000","last_clean":"2024-05-08T18:34:27.593729+0000","last_became_active":"2024-05-08T18:31:04.298237+0000","last_became_peered":"2024-05-08T18:31:04.298237+0000","last_unstale":"2024-05-08T18:34:27.593729+0000","last_undegraded":"2024-05-08T18:34:27.593729+0000","last_fullsized":"2024-05-08T18:34:27.593729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:27.593625+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:27.593625+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.593625+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:11.004092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.656405+0000","last_change":"2024-05-08T18:34:21.656429+0000","last_active":"2024-05-08T18:34:21.656405+0000","last_peered":"2024-05-08T18:34:21.656405+0000","last_clean":"2024-05-08T18:34:21.656405+0000","last_became_active":"2024-05-08T18:31:06.307048+0000","last_became_peered":"2024-05-08T18:31:06.307048+0000","last_unstale":"2024-05-08T18:34:21.656405+0000","last_undegraded":"2024-05-08T18:34:21.656405+0000","last_fullsized":"2024-05-08T18:34:21.656405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:21.656318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:21.656318+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.656318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:04.597248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:13.750070+0000","last_change":"2024-05-08T18:35:13.750126+0000","last_active":"2024-05-08T18:35:13.750070+0000","last_peered":"2024-05-08T18:35:13.750070+0000","last_clean":"2024-05-08T18:35:13.750070+0000","last_became_active":"2024-05-08T18:31:08.313943+0000","last_became_peered":"2024-05-08T18:31:08.313943+0000","last_unstale":"2024-05-08T18:35:13.750070+0000","last_undegraded":"2024-05-08T18:35:13.750070+0000","last_fullsized":"2024-05-08T18:35:13.750070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:13.749965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:13.749965+0000","last_clean_scrub_stamp":"2024-05-08T18:35:13.749965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:24.284202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:01.648622+0000","last_change":"2024-05-08T18:35:01.648672+0000","last_active":"2024-05-08T18:35:01.648622+0000","last_peered":"2024-05-08T18:35:01.648622+0000","last_clean":"2024-05-08T18:35:01.648622+0000","last_became_active":"2024-05-08T18:31:00.285842+0000","last_became_peered":"2024-05-08T18:31:00.285842+0000","last_unstale":"2024-05-08T18:35:01.648622+0000","last_undegraded":"2024-05-08T18:35:01.648622+0000","last_fullsized":"2024-05-08T18:35:01.648622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:01.648519+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:01.648519+0000","last_clean_scrub_stamp":"2024-05-08T18:35:01.648519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:30.251562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:05.877745+0000","last_change":"2024-05-08T18:35:05.877771+0000","last_active":"2024-05-08T18:35:05.877745+0000","last_peered":"2024-05-08T18:35:05.877745+0000","last_clean":"2024-05-08T18:35:05.877745+0000","last_became_active":"2024-05-08T18:30:58.303112+0000","last_became_peered":"2024-05-08T18:30:58.303112+0000","last_unstale":"2024-05-08T18:35:05.877745+0000","last_undegraded":"2024-05-08T18:35:05.877745+0000","last_fullsized":"2024-05-08T18:35:05.877745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:05.877646+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:05.877646+0000","last_clean_scrub_stamp":"2024-05-08T18:35:05.877646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:41.396937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:33.767319+0000","last_change":"2024-05-08T18:34:33.767349+0000","last_active":"2024-05-08T18:34:33.767319+0000","last_peered":"2024-05-08T18:34:33.767319+0000","last_clean":"2024-05-08T18:34:33.767319+0000","last_became_active":"2024-05-08T18:31:02.294812+0000","last_became_peered":"2024-05-08T18:31:02.294812+0000","last_unstale":"2024-05-08T18:34:33.767319+0000","last_undegraded":"2024-05-08T18:34:33.767319+0000","last_fullsized":"2024-05-08T18:34:33.767319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:33.767215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:33.767215+0000","last_clean_scrub_stamp":"2024-05-08T18:34:33.767215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:26.750973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'47","reported_seq":119,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.562009+0000","last_change":"2024-05-08T18:34:26.562049+0000","last_active":"2024-05-08T18:34:26.562009+0000","last_peered":"2024-05-08T18:34:26.562009+0000","last_clean":"2024-05-08T18:34:26.562009+0000","last_became_active":"2024-05-08T18:31:04.301969+0000","last_became_peered":"2024-05-08T18:31:04.301969+0000","last_unstale":"2024-05-08T18:34:26.562009+0000","last_undegraded":"2024-05-08T18:34:26.562009+0000","last_fullsized":"2024-05-08T18:34:26.562009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-08T18:34:26.561918+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-08T18:34:26.561918+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.561918+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:56.265527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:17.922204+0000","last_change":"2024-05-08T18:34:17.922228+0000","last_active":"2024-05-08T18:34:17.922204+0000","last_peered":"2024-05-08T18:34:17.922204+0000","last_clean":"2024-05-08T18:34:17.922204+0000","last_became_active":"2024-05-08T18:31:06.306346+0000","last_became_peered":"2024-05-08T18:31:06.306346+0000","last_unstale":"2024-05-08T18:34:17.922204+0000","last_undegraded":"2024-05-08T18:34:17.922204+0000","last_fullsized":"2024-05-08T18:34:17.922204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:17.922113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:17.922113+0000","last_clean_scrub_stamp":"2024-05-08T18:34:17.922113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:34.597084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:10.321449+0000","last_change":"2024-05-08T18:35:10.321477+0000","last_active":"2024-05-08T18:35:10.321449+0000","last_peered":"2024-05-08T18:35:10.321449+0000","last_clean":"2024-05-08T18:35:10.321449+0000","last_became_active":"2024-05-08T18:31:08.316673+0000","last_became_peered":"2024-05-08T18:31:08.316673+0000","last_unstale":"2024-05-08T18:35:10.321449+0000","last_undegraded":"2024-05-08T18:35:10.321449+0000","last_fullsized":"2024-05-08T18:35:10.321449+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:10.321358+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:10.321358+0000","last_clean_scrub_stamp":"2024-05-08T18:35:10.321358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:22.456143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'6","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:03.275590+0000","last_change":"2024-05-08T18:35:03.275613+0000","last_active":"2024-05-08T18:35:03.275590+0000","last_peered":"2024-05-08T18:35:03.275590+0000","last_clean":"2024-05-08T18:35:03.275590+0000","last_became_active":"2024-05-08T18:31:00.291163+0000","last_became_peered":"2024-05-08T18:31:00.291163+0000","last_unstale":"2024-05-08T18:35:03.275590+0000","last_undegraded":"2024-05-08T18:35:03.275590+0000","last_fullsized":"2024-05-08T18:35:03.275590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:35:03.275501+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:35:03.275501+0000","last_clean_scrub_stamp":"2024-05-08T18:35:03.275501+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:18.779161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:09.827464+0000","last_change":"2024-05-08T18:35:09.827502+0000","last_active":"2024-05-08T18:35:09.827464+0000","last_peered":"2024-05-08T18:35:09.827464+0000","last_clean":"2024-05-08T18:35:09.827464+0000","last_became_active":"2024-05-08T18:30:58.304135+0000","last_became_peered":"2024-05-08T18:30:58.304135+0000","last_unstale":"2024-05-08T18:35:09.827464+0000","last_undegraded":"2024-05-08T18:35:09.827464+0000","last_fullsized":"2024-05-08T18:35:09.827464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:09.827356+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:09.827356+0000","last_clean_scrub_stamp":"2024-05-08T18:35:09.827356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:19.346446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.724006+0000","last_change":"2024-05-08T18:34:25.724048+0000","last_active":"2024-05-08T18:34:25.724006+0000","last_peered":"2024-05-08T18:34:25.724006+0000","last_clean":"2024-05-08T18:34:25.724006+0000","last_became_active":"2024-05-08T18:31:02.290191+0000","last_became_peered":"2024-05-08T18:31:02.290191+0000","last_unstale":"2024-05-08T18:34:25.724006+0000","last_undegraded":"2024-05-08T18:34:25.724006+0000","last_fullsized":"2024-05-08T18:34:25.724006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:25.723912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:25.723912+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.723912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:20.514292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.740088+0000","last_change":"2024-05-08T18:34:30.740127+0000","last_active":"2024-05-08T18:34:30.740088+0000","last_peered":"2024-05-08T18:34:30.740088+0000","last_clean":"2024-05-08T18:34:30.740088+0000","last_became_active":"2024-05-08T18:31:04.295255+0000","last_became_peered":"2024-05-08T18:31:04.295255+0000","last_unstale":"2024-05-08T18:34:30.740088+0000","last_undegraded":"2024-05-08T18:34:30.740088+0000","last_fullsized":"2024-05-08T18:34:30.740088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:30.740000+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:30.740000+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.740000+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:21.689161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.619965+0000","last_change":"2024-05-08T18:34:22.620008+0000","last_active":"2024-05-08T18:34:22.619965+0000","last_peered":"2024-05-08T18:34:22.619965+0000","last_clean":"2024-05-08T18:34:22.619965+0000","last_became_active":"2024-05-08T18:31:06.304851+0000","last_became_peered":"2024-05-08T18:31:06.304851+0000","last_unstale":"2024-05-08T18:34:22.619965+0000","last_undegraded":"2024-05-08T18:34:22.619965+0000","last_fullsized":"2024-05-08T18:34:22.619965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:22.619859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:22.619859+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.619859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:19.090940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'8","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:12.829932+0000","last_change":"2024-05-08T18:35:12.829981+0000","last_active":"2024-05-08T18:35:12.829932+0000","last_peered":"2024-05-08T18:35:12.829932+0000","last_clean":"2024-05-08T18:35:12.829932+0000","last_became_active":"2024-05-08T18:31:45.336717+0000","last_became_peered":"2024-05-08T18:31:45.336717+0000","last_unstale":"2024-05-08T18:35:12.829932+0000","last_undegraded":"2024-05-08T18:35:12.829932+0000","last_fullsized":"2024-05-08T18:35:12.829932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:35:12.829847+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:35:12.829847+0000","last_clean_scrub_stamp":"2024-05-08T18:35:12.829847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:53.220872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.180198+0000","last_change":"2024-05-08T18:30:58.303784+0000","last_active":"2024-05-08T18:33:23.180198+0000","last_peered":"2024-05-08T18:33:23.180198+0000","last_clean":"2024-05-08T18:33:23.180198+0000","last_became_active":"2024-05-08T18:30:58.302486+0000","last_became_peered":"2024-05-08T18:30:58.302486+0000","last_unstale":"2024-05-08T18:33:23.180198+0000","last_undegraded":"2024-05-08T18:33:23.180198+0000","last_fullsized":"2024-05-08T18:33:23.180198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:38.630273+0000","last_change":"2024-05-08T18:34:38.630273+0000","last_active":"2024-05-08T18:34:38.630273+0000","last_peered":"2024-05-08T18:34:38.630273+0000","last_clean":"2024-05-08T18:34:38.630273+0000","last_became_active":"2024-05-08T18:31:02.291965+0000","last_became_peered":"2024-05-08T18:31:02.291965+0000","last_unstale":"2024-05-08T18:34:38.630273+0000","last_undegraded":"2024-05-08T18:34:38.630273+0000","last_fullsized":"2024-05-08T18:34:38.630273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:38.630108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:38.630108+0000","last_clean_scrub_stamp":"2024-05-08T18:34:38.630108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:03.690534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.589859+0000","last_change":"2024-05-08T18:34:28.589897+0000","last_active":"2024-05-08T18:34:28.589859+0000","last_peered":"2024-05-08T18:34:28.589859+0000","last_clean":"2024-05-08T18:34:28.589859+0000","last_became_active":"2024-05-08T18:31:04.298061+0000","last_became_peered":"2024-05-08T18:31:04.298061+0000","last_unstale":"2024-05-08T18:34:28.589859+0000","last_undegraded":"2024-05-08T18:34:28.589859+0000","last_fullsized":"2024-05-08T18:34:28.589859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-08T18:34:28.589758+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-08T18:34:28.589758+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.589758+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.082408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.571868+0000","last_change":"2024-05-08T18:34:19.571892+0000","last_active":"2024-05-08T18:34:19.571868+0000","last_peered":"2024-05-08T18:34:19.571868+0000","last_clean":"2024-05-08T18:34:19.571868+0000","last_became_active":"2024-05-08T18:31:06.308247+0000","last_became_peered":"2024-05-08T18:31:06.308247+0000","last_unstale":"2024-05-08T18:34:19.571868+0000","last_undegraded":"2024-05-08T18:34:19.571868+0000","last_fullsized":"2024-05-08T18:34:19.571868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:19.571752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:19.571752+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.571752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:10.353530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:12.721881+0000","last_change":"2024-05-08T18:35:12.721905+0000","last_active":"2024-05-08T18:35:12.721881+0000","last_peered":"2024-05-08T18:35:12.721881+0000","last_clean":"2024-05-08T18:35:12.721881+0000","last_became_active":"2024-05-08T18:31:08.313986+0000","last_became_peered":"2024-05-08T18:31:08.313986+0000","last_unstale":"2024-05-08T18:35:12.721881+0000","last_undegraded":"2024-05-08T18:35:12.721881+0000","last_fullsized":"2024-05-08T18:35:12.721881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T18:35:12.721785+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T18:35:12.721785+0000","last_clean_scrub_stamp":"2024-05-08T18:35:12.721785+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:52.662693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:51.729136+0000","last_change":"2024-05-08T18:34:51.729136+0000","last_active":"2024-05-08T18:34:51.729136+0000","last_peered":"2024-05-08T18:34:51.729136+0000","last_clean":"2024-05-08T18:34:51.729136+0000","last_became_active":"2024-05-08T18:31:00.281233+0000","last_became_peered":"2024-05-08T18:31:00.281233+0000","last_unstale":"2024-05-08T18:34:51.729136+0000","last_undegraded":"2024-05-08T18:34:51.729136+0000","last_fullsized":"2024-05-08T18:34:51.729136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:51.729017+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:51.729017+0000","last_clean_scrub_stamp":"2024-05-08T18:34:51.729017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:23.632079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:03.775023+0000","last_change":"2024-05-08T18:35:03.775049+0000","last_active":"2024-05-08T18:35:03.775023+0000","last_peered":"2024-05-08T18:35:03.775023+0000","last_clean":"2024-05-08T18:35:03.775023+0000","last_became_active":"2024-05-08T18:30:58.289251+0000","last_became_peered":"2024-05-08T18:30:58.289251+0000","last_unstale":"2024-05-08T18:35:03.775023+0000","last_undegraded":"2024-05-08T18:35:03.775023+0000","last_fullsized":"2024-05-08T18:35:03.775023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:03.774929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:03.774929+0000","last_clean_scrub_stamp":"2024-05-08T18:35:03.774929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:33.252828+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:37.837401+0000","last_change":"2024-05-08T18:34:37.837401+0000","last_active":"2024-05-08T18:34:37.837401+0000","last_peered":"2024-05-08T18:34:37.837401+0000","last_clean":"2024-05-08T18:34:37.837401+0000","last_became_active":"2024-05-08T18:31:02.293185+0000","last_became_peered":"2024-05-08T18:31:02.293185+0000","last_unstale":"2024-05-08T18:34:37.837401+0000","last_undegraded":"2024-05-08T18:34:37.837401+0000","last_fullsized":"2024-05-08T18:34:37.837401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:37.837258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:37.837258+0000","last_clean_scrub_stamp":"2024-05-08T18:34:37.837258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:28.286615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.735819+0000","last_change":"2024-05-08T18:34:26.735863+0000","last_active":"2024-05-08T18:34:26.735819+0000","last_peered":"2024-05-08T18:34:26.735819+0000","last_clean":"2024-05-08T18:34:26.735819+0000","last_became_active":"2024-05-08T18:31:04.298482+0000","last_became_peered":"2024-05-08T18:31:04.298482+0000","last_unstale":"2024-05-08T18:34:26.735819+0000","last_undegraded":"2024-05-08T18:34:26.735819+0000","last_fullsized":"2024-05-08T18:34:26.735819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T18:34:26.735726+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T18:34:26.735726+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.735726+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:38.610782+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.785527+0000","last_change":"2024-05-08T18:34:28.785567+0000","last_active":"2024-05-08T18:34:28.785527+0000","last_peered":"2024-05-08T18:34:28.785527+0000","last_clean":"2024-05-08T18:34:28.785527+0000","last_became_active":"2024-05-08T18:31:06.311392+0000","last_became_peered":"2024-05-08T18:31:06.311392+0000","last_unstale":"2024-05-08T18:34:28.785527+0000","last_undegraded":"2024-05-08T18:34:28.785527+0000","last_fullsized":"2024-05-08T18:34:28.785527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:28.785418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:28.785418+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.785418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.278068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181260+0000","last_change":"2024-05-08T18:31:08.319678+0000","last_active":"2024-05-08T18:33:28.181260+0000","last_peered":"2024-05-08T18:33:28.181260+0000","last_clean":"2024-05-08T18:33:28.181260+0000","last_became_active":"2024-05-08T18:31:08.319394+0000","last_became_peered":"2024-05-08T18:31:08.319394+0000","last_unstale":"2024-05-08T18:33:28.181260+0000","last_undegraded":"2024-05-08T18:33:28.181260+0000","last_fullsized":"2024-05-08T18:33:28.181260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'18","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.687783+0000","last_change":"2024-05-08T18:34:29.687812+0000","last_active":"2024-05-08T18:34:29.687783+0000","last_peered":"2024-05-08T18:34:29.687783+0000","last_clean":"2024-05-08T18:34:29.687783+0000","last_became_active":"2024-05-08T18:31:00.299547+0000","last_became_peered":"2024-05-08T18:31:00.299547+0000","last_unstale":"2024-05-08T18:34:29.687783+0000","last_undegraded":"2024-05-08T18:34:29.687783+0000","last_fullsized":"2024-05-08T18:34:29.687783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-05-08T18:34:29.687669+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-05-08T18:34:29.687669+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.687669+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:34:50.822109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:01.708108+0000","last_change":"2024-05-08T18:35:01.708135+0000","last_active":"2024-05-08T18:35:01.708108+0000","last_peered":"2024-05-08T18:35:01.708108+0000","last_clean":"2024-05-08T18:35:01.708108+0000","last_became_active":"2024-05-08T18:30:58.303624+0000","last_became_peered":"2024-05-08T18:30:58.303624+0000","last_unstale":"2024-05-08T18:35:01.708108+0000","last_undegraded":"2024-05-08T18:35:01.708108+0000","last_fullsized":"2024-05-08T18:35:01.708108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:01.708010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:01.708010+0000","last_clean_scrub_stamp":"2024-05-08T18:35:01.708010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:18.222162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:38.801676+0000","last_change":"2024-05-08T18:34:38.801732+0000","last_active":"2024-05-08T18:34:38.801676+0000","last_peered":"2024-05-08T18:34:38.801676+0000","last_clean":"2024-05-08T18:34:38.801676+0000","last_became_active":"2024-05-08T18:31:02.292498+0000","last_became_peered":"2024-05-08T18:31:02.292498+0000","last_unstale":"2024-05-08T18:34:38.801676+0000","last_undegraded":"2024-05-08T18:34:38.801676+0000","last_fullsized":"2024-05-08T18:34:38.801676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:38.801554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:38.801554+0000","last_clean_scrub_stamp":"2024-05-08T18:34:38.801554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:02.934641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.519937+0000","last_change":"2024-05-08T18:34:31.519937+0000","last_active":"2024-05-08T18:34:31.519937+0000","last_peered":"2024-05-08T18:34:31.519937+0000","last_clean":"2024-05-08T18:34:31.519937+0000","last_became_active":"2024-05-08T18:31:04.297297+0000","last_became_peered":"2024-05-08T18:31:04.297297+0000","last_unstale":"2024-05-08T18:34:31.519937+0000","last_undegraded":"2024-05-08T18:34:31.519937+0000","last_fullsized":"2024-05-08T18:34:31.519937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-08T18:34:31.519820+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-08T18:34:31.519820+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.519820+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:29.500105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.647756+0000","last_change":"2024-05-08T18:34:20.647756+0000","last_active":"2024-05-08T18:34:20.647756+0000","last_peered":"2024-05-08T18:34:20.647756+0000","last_clean":"2024-05-08T18:34:20.647756+0000","last_became_active":"2024-05-08T18:31:06.305567+0000","last_became_peered":"2024-05-08T18:31:06.305567+0000","last_unstale":"2024-05-08T18:34:20.647756+0000","last_undegraded":"2024-05-08T18:34:20.647756+0000","last_fullsized":"2024-05-08T18:34:20.647756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:20.647576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:20.647576+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.647576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:11.596737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'11","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:06.968893+0000","last_change":"2024-05-08T18:31:08.317380+0000","last_active":"2024-05-08T18:34:06.968893+0000","last_peered":"2024-05-08T18:34:06.968893+0000","last_clean":"2024-05-08T18:34:06.968893+0000","last_became_active":"2024-05-08T18:31:08.316943+0000","last_became_peered":"2024-05-08T18:31:08.316943+0000","last_unstale":"2024-05-08T18:34:06.968893+0000","last_undegraded":"2024-05-08T18:34:06.968893+0000","last_fullsized":"2024-05-08T18:34:06.968893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'6","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:57.746662+0000","last_change":"2024-05-08T18:34:57.746715+0000","last_active":"2024-05-08T18:34:57.746662+0000","last_peered":"2024-05-08T18:34:57.746662+0000","last_clean":"2024-05-08T18:34:57.746662+0000","last_became_active":"2024-05-08T18:31:00.282923+0000","last_became_peered":"2024-05-08T18:31:00.282923+0000","last_unstale":"2024-05-08T18:34:57.746662+0000","last_undegraded":"2024-05-08T18:34:57.746662+0000","last_fullsized":"2024-05-08T18:34:57.746662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:57.746576+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:57.746576+0000","last_clean_scrub_stamp":"2024-05-08T18:34:57.746576+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:59.586725+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:08.377452+0000","last_change":"2024-05-08T18:35:08.377482+0000","last_active":"2024-05-08T18:35:08.377452+0000","last_peered":"2024-05-08T18:35:08.377452+0000","last_clean":"2024-05-08T18:35:08.377452+0000","last_became_active":"2024-05-08T18:30:58.316980+0000","last_became_peered":"2024-05-08T18:30:58.316980+0000","last_unstale":"2024-05-08T18:35:08.377452+0000","last_undegraded":"2024-05-08T18:35:08.377452+0000","last_fullsized":"2024-05-08T18:35:08.377452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:08.377353+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:08.377353+0000","last_clean_scrub_stamp":"2024-05-08T18:35:08.377353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:31:18.567645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:35.723926+0000","last_change":"2024-05-08T18:34:35.723966+0000","last_active":"2024-05-08T18:34:35.723926+0000","last_peered":"2024-05-08T18:34:35.723926+0000","last_clean":"2024-05-08T18:34:35.723926+0000","last_became_active":"2024-05-08T18:31:02.288127+0000","last_became_peered":"2024-05-08T18:31:02.288127+0000","last_unstale":"2024-05-08T18:34:35.723926+0000","last_undegraded":"2024-05-08T18:34:35.723926+0000","last_fullsized":"2024-05-08T18:34:35.723926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:35.723797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:35.723797+0000","last_clean_scrub_stamp":"2024-05-08T18:34:35.723797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:17.046313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:49.428140+0000","last_change":"2024-05-08T18:34:49.428140+0000","last_active":"2024-05-08T18:34:49.428140+0000","last_peered":"2024-05-08T18:34:49.428140+0000","last_clean":"2024-05-08T18:34:49.428140+0000","last_became_active":"2024-05-08T18:31:04.302034+0000","last_became_peered":"2024-05-08T18:31:04.302034+0000","last_unstale":"2024-05-08T18:34:49.428140+0000","last_undegraded":"2024-05-08T18:34:49.428140+0000","last_fullsized":"2024-05-08T18:34:49.428140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T18:34:49.427967+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T18:34:49.427967+0000","last_clean_scrub_stamp":"2024-05-08T18:34:49.427967+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:40.814614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":419,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.617045+0000","last_change":"2024-05-08T18:34:20.617045+0000","last_active":"2024-05-08T18:34:20.617045+0000","last_peered":"2024-05-08T18:34:20.617045+0000","last_clean":"2024-05-08T18:34:20.617045+0000","last_became_active":"2024-05-08T18:31:06.311063+0000","last_became_peered":"2024-05-08T18:31:06.311063+0000","last_unstale":"2024-05-08T18:34:20.617045+0000","last_undegraded":"2024-05-08T18:34:20.617045+0000","last_fullsized":"2024-05-08T18:34:20.617045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:20.616926+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:20.616926+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.616926+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:07.788306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.181095+0000","last_change":"2024-05-08T18:31:08.320650+0000","last_active":"2024-05-08T18:33:28.181095+0000","last_peered":"2024-05-08T18:33:28.181095+0000","last_clean":"2024-05-08T18:33:28.181095+0000","last_became_active":"2024-05-08T18:31:08.320260+0000","last_became_peered":"2024-05-08T18:31:08.320260+0000","last_unstale":"2024-05-08T18:33:28.181095+0000","last_undegraded":"2024-05-08T18:33:28.181095+0000","last_fullsized":"2024-05-08T18:33:28.181095+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:46.862485+0000","last_change":"2024-05-08T18:34:46.862513+0000","last_active":"2024-05-08T18:34:46.862485+0000","last_peered":"2024-05-08T18:34:46.862485+0000","last_clean":"2024-05-08T18:34:46.862485+0000","last_became_active":"2024-05-08T18:31:00.284982+0000","last_became_peered":"2024-05-08T18:31:00.284982+0000","last_unstale":"2024-05-08T18:34:46.862485+0000","last_undegraded":"2024-05-08T18:34:46.862485+0000","last_fullsized":"2024-05-08T18:34:46.862485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:46.862388+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:46.862388+0000","last_clean_scrub_stamp":"2024-05-08T18:34:46.862388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:08.371704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:53.644293+0000","last_change":"2024-05-08T18:34:53.644358+0000","last_active":"2024-05-08T18:34:53.644293+0000","last_peered":"2024-05-08T18:34:53.644293+0000","last_clean":"2024-05-08T18:34:53.644293+0000","last_became_active":"2024-05-08T18:30:58.304969+0000","last_became_peered":"2024-05-08T18:30:58.304969+0000","last_unstale":"2024-05-08T18:34:53.644293+0000","last_undegraded":"2024-05-08T18:34:53.644293+0000","last_fullsized":"2024-05-08T18:34:53.644293+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:53.644191+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:53.644191+0000","last_clean_scrub_stamp":"2024-05-08T18:34:53.644191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:01.742855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:33.755080+0000","last_change":"2024-05-08T18:34:33.755105+0000","last_active":"2024-05-08T18:34:33.755080+0000","last_peered":"2024-05-08T18:34:33.755080+0000","last_clean":"2024-05-08T18:34:33.755080+0000","last_became_active":"2024-05-08T18:31:02.288719+0000","last_became_peered":"2024-05-08T18:31:02.288719+0000","last_unstale":"2024-05-08T18:34:33.755080+0000","last_undegraded":"2024-05-08T18:34:33.755080+0000","last_fullsized":"2024-05-08T18:34:33.755080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:33.754990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:33.754990+0000","last_clean_scrub_stamp":"2024-05-08T18:34:33.754990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:27.813675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'46","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.817834+0000","last_change":"2024-05-08T18:34:26.817876+0000","last_active":"2024-05-08T18:34:26.817834+0000","last_peered":"2024-05-08T18:34:26.817834+0000","last_clean":"2024-05-08T18:34:26.817834+0000","last_became_active":"2024-05-08T18:31:04.297013+0000","last_became_peered":"2024-05-08T18:31:04.297013+0000","last_unstale":"2024-05-08T18:34:26.817834+0000","last_undegraded":"2024-05-08T18:34:26.817834+0000","last_fullsized":"2024-05-08T18:34:26.817834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-05-08T18:34:26.817745+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-05-08T18:34:26.817745+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.817745+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:56.521354+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.591169+0000","last_change":"2024-05-08T18:34:29.591218+0000","last_active":"2024-05-08T18:34:29.591169+0000","last_peered":"2024-05-08T18:34:29.591169+0000","last_clean":"2024-05-08T18:34:29.591169+0000","last_became_active":"2024-05-08T18:31:06.311767+0000","last_became_peered":"2024-05-08T18:31:06.311767+0000","last_unstale":"2024-05-08T18:34:29.591169+0000","last_undegraded":"2024-05-08T18:34:29.591169+0000","last_fullsized":"2024-05-08T18:34:29.591169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:29.591069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:29.591069+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.591069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:12.240015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:11.749571+0000","last_change":"2024-05-08T18:35:11.749595+0000","last_active":"2024-05-08T18:35:11.749571+0000","last_peered":"2024-05-08T18:35:11.749571+0000","last_clean":"2024-05-08T18:35:11.749571+0000","last_became_active":"2024-05-08T18:31:08.312031+0000","last_became_peered":"2024-05-08T18:31:08.312031+0000","last_unstale":"2024-05-08T18:35:11.749571+0000","last_undegraded":"2024-05-08T18:35:11.749571+0000","last_fullsized":"2024-05-08T18:35:11.749571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:11.749487+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:11.749487+0000","last_clean_scrub_stamp":"2024-05-08T18:35:11.749487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:51.628598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:43.845914+0000","last_change":"2024-05-08T18:34:43.845941+0000","last_active":"2024-05-08T18:34:43.845914+0000","last_peered":"2024-05-08T18:34:43.845914+0000","last_clean":"2024-05-08T18:34:43.845914+0000","last_became_active":"2024-05-08T18:31:00.282605+0000","last_became_peered":"2024-05-08T18:31:00.282605+0000","last_unstale":"2024-05-08T18:34:43.845914+0000","last_undegraded":"2024-05-08T18:34:43.845914+0000","last_fullsized":"2024-05-08T18:34:43.845914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:43.845805+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:43.845805+0000","last_clean_scrub_stamp":"2024-05-08T18:34:43.845805+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:33.890772+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:22.420426+0000","last_change":"2024-05-08T18:35:22.420465+0000","last_active":"2024-05-08T18:35:22.420426+0000","last_peered":"2024-05-08T18:35:22.420426+0000","last_clean":"2024-05-08T18:35:22.420426+0000","last_became_active":"2024-05-08T18:30:58.316166+0000","last_became_peered":"2024-05-08T18:30:58.316166+0000","last_unstale":"2024-05-08T18:35:22.420426+0000","last_undegraded":"2024-05-08T18:35:22.420426+0000","last_fullsized":"2024-05-08T18:35:22.420426+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:22.420297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:22.420297+0000","last_clean_scrub_stamp":"2024-05-08T18:35:22.420297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:13.158632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:34.793858+0000","last_change":"2024-05-08T18:34:34.793883+0000","last_active":"2024-05-08T18:34:34.793858+0000","last_peered":"2024-05-08T18:34:34.793858+0000","last_clean":"2024-05-08T18:34:34.793858+0000","last_became_active":"2024-05-08T18:31:02.294335+0000","last_became_peered":"2024-05-08T18:31:02.294335+0000","last_unstale":"2024-05-08T18:34:34.793858+0000","last_undegraded":"2024-05-08T18:34:34.793858+0000","last_fullsized":"2024-05-08T18:34:34.793858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:34.793770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:34.793770+0000","last_clean_scrub_stamp":"2024-05-08T18:34:34.793770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:10.718458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.557478+0000","last_change":"2024-05-08T18:34:30.557516+0000","last_active":"2024-05-08T18:34:30.557478+0000","last_peered":"2024-05-08T18:34:30.557478+0000","last_clean":"2024-05-08T18:34:30.557478+0000","last_became_active":"2024-05-08T18:31:04.297440+0000","last_became_peered":"2024-05-08T18:31:04.297440+0000","last_unstale":"2024-05-08T18:34:30.557478+0000","last_undegraded":"2024-05-08T18:34:30.557478+0000","last_fullsized":"2024-05-08T18:34:30.557478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:30.557382+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:30.557382+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.557382+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:48.222384+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:54.392740+0000","last_change":"2024-05-08T18:34:54.392771+0000","last_active":"2024-05-08T18:34:54.392740+0000","last_peered":"2024-05-08T18:34:54.392740+0000","last_clean":"2024-05-08T18:34:54.392740+0000","last_became_active":"2024-05-08T18:31:06.312162+0000","last_became_peered":"2024-05-08T18:31:06.312162+0000","last_unstale":"2024-05-08T18:34:54.392740+0000","last_undegraded":"2024-05-08T18:34:54.392740+0000","last_fullsized":"2024-05-08T18:34:54.392740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:54.392629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:54.392629+0000","last_clean_scrub_stamp":"2024-05-08T18:34:54.392629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:33.529929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.182202+0000","last_change":"2024-05-08T18:31:08.318309+0000","last_active":"2024-05-08T18:33:33.182202+0000","last_peered":"2024-05-08T18:33:33.182202+0000","last_clean":"2024-05-08T18:33:33.182202+0000","last_became_active":"2024-05-08T18:31:08.318072+0000","last_became_peered":"2024-05-08T18:31:08.318072+0000","last_unstale":"2024-05-08T18:33:33.182202+0000","last_undegraded":"2024-05-08T18:33:33.182202+0000","last_fullsized":"2024-05-08T18:33:33.182202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:01.256070+0000","last_change":"2024-05-08T18:35:01.256104+0000","last_active":"2024-05-08T18:35:01.256070+0000","last_peered":"2024-05-08T18:35:01.256070+0000","last_clean":"2024-05-08T18:35:01.256070+0000","last_became_active":"2024-05-08T18:31:00.291128+0000","last_became_peered":"2024-05-08T18:31:00.291128+0000","last_unstale":"2024-05-08T18:35:01.256070+0000","last_undegraded":"2024-05-08T18:35:01.256070+0000","last_fullsized":"2024-05-08T18:35:01.256070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:01.255984+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:01.255984+0000","last_clean_scrub_stamp":"2024-05-08T18:35:01.255984+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:31.249730+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:06.725851+0000","last_change":"2024-05-08T18:35:06.725876+0000","last_active":"2024-05-08T18:35:06.725851+0000","last_peered":"2024-05-08T18:35:06.725851+0000","last_clean":"2024-05-08T18:35:06.725851+0000","last_became_active":"2024-05-08T18:30:58.283402+0000","last_became_peered":"2024-05-08T18:30:58.283402+0000","last_unstale":"2024-05-08T18:35:06.725851+0000","last_undegraded":"2024-05-08T18:35:06.725851+0000","last_fullsized":"2024-05-08T18:35:06.725851+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:06.725759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:06.725759+0000","last_clean_scrub_stamp":"2024-05-08T18:35:06.725759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:32.654853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.819622+0000","last_change":"2024-05-08T18:34:27.819657+0000","last_active":"2024-05-08T18:34:27.819622+0000","last_peered":"2024-05-08T18:34:27.819622+0000","last_clean":"2024-05-08T18:34:27.819622+0000","last_became_active":"2024-05-08T18:31:02.291363+0000","last_became_peered":"2024-05-08T18:31:02.291363+0000","last_unstale":"2024-05-08T18:34:27.819622+0000","last_undegraded":"2024-05-08T18:34:27.819622+0000","last_fullsized":"2024-05-08T18:34:27.819622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:27.819512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:27.819512+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.819512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:11.229979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'33","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.643094+0000","last_change":"2024-05-08T18:34:30.643128+0000","last_active":"2024-05-08T18:34:30.643094+0000","last_peered":"2024-05-08T18:34:30.643094+0000","last_clean":"2024-05-08T18:34:30.643094+0000","last_became_active":"2024-05-08T18:31:04.298601+0000","last_became_peered":"2024-05-08T18:31:04.298601+0000","last_unstale":"2024-05-08T18:34:30.643094+0000","last_undegraded":"2024-05-08T18:34:30.643094+0000","last_fullsized":"2024-05-08T18:34:30.643094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2024-05-08T18:34:30.643006+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2024-05-08T18:34:30.643006+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.643006+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:15.159268+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":49,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:42.467334+0000","last_change":"2024-05-08T18:34:42.467363+0000","last_active":"2024-05-08T18:34:42.467334+0000","last_peered":"2024-05-08T18:34:42.467334+0000","last_clean":"2024-05-08T18:34:42.467334+0000","last_became_active":"2024-05-08T18:31:06.307801+0000","last_became_peered":"2024-05-08T18:31:06.307801+0000","last_unstale":"2024-05-08T18:34:42.467334+0000","last_undegraded":"2024-05-08T18:34:42.467334+0000","last_fullsized":"2024-05-08T18:34:42.467334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:42.467239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:42.467239+0000","last_clean_scrub_stamp":"2024-05-08T18:34:42.467239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:11.945138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.182134+0000","last_change":"2024-05-08T18:31:08.319580+0000","last_active":"2024-05-08T18:33:33.182134+0000","last_peered":"2024-05-08T18:33:33.182134+0000","last_clean":"2024-05-08T18:33:33.182134+0000","last_became_active":"2024-05-08T18:31:08.319232+0000","last_became_peered":"2024-05-08T18:31:08.319232+0000","last_unstale":"2024-05-08T18:33:33.182134+0000","last_undegraded":"2024-05-08T18:33:33.182134+0000","last_fullsized":"2024-05-08T18:33:33.182134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:31:07.290664+0000","last_clean_scrub_stamp":"2024-05-08T18:31:07.290664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:42.804909+0000","last_change":"2024-05-08T18:34:42.804933+0000","last_active":"2024-05-08T18:34:42.804909+0000","last_peered":"2024-05-08T18:34:42.804909+0000","last_clean":"2024-05-08T18:34:42.804909+0000","last_became_active":"2024-05-08T18:31:00.282644+0000","last_became_peered":"2024-05-08T18:31:00.282644+0000","last_unstale":"2024-05-08T18:34:42.804909+0000","last_undegraded":"2024-05-08T18:34:42.804909+0000","last_fullsized":"2024-05-08T18:34:42.804909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:42.804809+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:42.804809+0000","last_clean_scrub_stamp":"2024-05-08T18:34:42.804809+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:20:23.898115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:07.775086+0000","last_change":"2024-05-08T18:35:07.775086+0000","last_active":"2024-05-08T18:35:07.775086+0000","last_peered":"2024-05-08T18:35:07.775086+0000","last_clean":"2024-05-08T18:35:07.775086+0000","last_became_active":"2024-05-08T18:30:58.303312+0000","last_became_peered":"2024-05-08T18:30:58.303312+0000","last_unstale":"2024-05-08T18:35:07.775086+0000","last_undegraded":"2024-05-08T18:35:07.775086+0000","last_fullsized":"2024-05-08T18:35:07.775086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:07.774913+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:07.774913+0000","last_clean_scrub_stamp":"2024-05-08T18:35:07.774913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:33.704007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'8","reported_seq":241,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:34.738076+0000","last_change":"2024-05-08T18:34:34.738123+0000","last_active":"2024-05-08T18:34:34.738076+0000","last_peered":"2024-05-08T18:34:34.738076+0000","last_clean":"2024-05-08T18:34:34.738076+0000","last_became_active":"2024-05-08T18:31:02.288433+0000","last_became_peered":"2024-05-08T18:31:02.288433+0000","last_unstale":"2024-05-08T18:34:34.738076+0000","last_undegraded":"2024-05-08T18:34:34.738076+0000","last_fullsized":"2024-05-08T18:34:34.738076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:34.737972+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:34.737972+0000","last_clean_scrub_stamp":"2024-05-08T18:34:34.737972+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:06.780418+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:34.593136+0000","last_change":"2024-05-08T18:34:34.593167+0000","last_active":"2024-05-08T18:34:34.593136+0000","last_peered":"2024-05-08T18:34:34.593136+0000","last_clean":"2024-05-08T18:34:34.593136+0000","last_became_active":"2024-05-08T18:31:04.298089+0000","last_became_peered":"2024-05-08T18:31:04.298089+0000","last_unstale":"2024-05-08T18:34:34.593136+0000","last_undegraded":"2024-05-08T18:34:34.593136+0000","last_fullsized":"2024-05-08T18:34:34.593136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-08T18:34:34.593039+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-08T18:34:34.593039+0000","last_clean_scrub_stamp":"2024-05-08T18:34:34.593039+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:54.680394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:37.668827+0000","last_change":"2024-05-08T18:34:37.668853+0000","last_active":"2024-05-08T18:34:37.668827+0000","last_peered":"2024-05-08T18:34:37.668827+0000","last_clean":"2024-05-08T18:34:37.668827+0000","last_became_active":"2024-05-08T18:31:06.311810+0000","last_became_peered":"2024-05-08T18:31:06.311810+0000","last_unstale":"2024-05-08T18:34:37.668827+0000","last_undegraded":"2024-05-08T18:34:37.668827+0000","last_fullsized":"2024-05-08T18:34:37.668827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:37.668735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:37.668735+0000","last_clean_scrub_stamp":"2024-05-08T18:34:37.668735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:25.055534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:06.325438+0000","last_change":"2024-05-08T18:35:06.325466+0000","last_active":"2024-05-08T18:35:06.325438+0000","last_peered":"2024-05-08T18:35:06.325438+0000","last_clean":"2024-05-08T18:35:06.325438+0000","last_became_active":"2024-05-08T18:31:08.316723+0000","last_became_peered":"2024-05-08T18:31:08.316723+0000","last_unstale":"2024-05-08T18:35:06.325438+0000","last_undegraded":"2024-05-08T18:35:06.325438+0000","last_fullsized":"2024-05-08T18:35:06.325438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:06.325330+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:06.325330+0000","last_clean_scrub_stamp":"2024-05-08T18:35:06.325330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:40.905872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'4","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:17.669569+0000","last_change":"2024-05-08T18:35:17.669569+0000","last_active":"2024-05-08T18:35:17.669569+0000","last_peered":"2024-05-08T18:35:17.669569+0000","last_clean":"2024-05-08T18:35:17.669569+0000","last_became_active":"2024-05-08T18:31:45.339252+0000","last_became_peered":"2024-05-08T18:31:45.339252+0000","last_unstale":"2024-05-08T18:35:17.669569+0000","last_undegraded":"2024-05-08T18:35:17.669569+0000","last_fullsized":"2024-05-08T18:35:17.669569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:35:17.669456+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:35:17.669456+0000","last_clean_scrub_stamp":"2024-05-08T18:35:17.669456+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:13:26.284655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:45.897118+0000","last_change":"2024-05-08T18:34:45.897118+0000","last_active":"2024-05-08T18:34:45.897118+0000","last_peered":"2024-05-08T18:34:45.897118+0000","last_clean":"2024-05-08T18:34:45.897118+0000","last_became_active":"2024-05-08T18:30:58.308290+0000","last_became_peered":"2024-05-08T18:30:58.308290+0000","last_unstale":"2024-05-08T18:34:45.897118+0000","last_undegraded":"2024-05-08T18:34:45.897118+0000","last_fullsized":"2024-05-08T18:34:45.897118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:45.897004+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:45.897004+0000","last_clean_scrub_stamp":"2024-05-08T18:34:45.897004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:42.049005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:55.818929+0000","last_change":"2024-05-08T18:34:55.818929+0000","last_active":"2024-05-08T18:34:55.818929+0000","last_peered":"2024-05-08T18:34:55.818929+0000","last_clean":"2024-05-08T18:34:55.818929+0000","last_became_active":"2024-05-08T18:31:00.282889+0000","last_became_peered":"2024-05-08T18:31:00.282889+0000","last_unstale":"2024-05-08T18:34:55.818929+0000","last_undegraded":"2024-05-08T18:34:55.818929+0000","last_fullsized":"2024-05-08T18:34:55.818929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:55.818809+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:55.818809+0000","last_clean_scrub_stamp":"2024-05-08T18:34:55.818809+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:32.297670+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:48.628085+0000","last_change":"2024-05-08T18:34:48.628085+0000","last_active":"2024-05-08T18:34:48.628085+0000","last_peered":"2024-05-08T18:34:48.628085+0000","last_clean":"2024-05-08T18:34:48.628085+0000","last_became_active":"2024-05-08T18:30:58.294210+0000","last_became_peered":"2024-05-08T18:30:58.294210+0000","last_unstale":"2024-05-08T18:34:48.628085+0000","last_undegraded":"2024-05-08T18:34:48.628085+0000","last_fullsized":"2024-05-08T18:34:48.628085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:48.627966+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:48.627966+0000","last_clean_scrub_stamp":"2024-05-08T18:34:48.627966+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:09.762407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'4","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:53.379822+0000","last_change":"2024-05-08T18:34:53.379822+0000","last_active":"2024-05-08T18:34:53.379822+0000","last_peered":"2024-05-08T18:34:53.379822+0000","last_clean":"2024-05-08T18:34:53.379822+0000","last_became_active":"2024-05-08T18:31:00.295749+0000","last_became_peered":"2024-05-08T18:31:00.295749+0000","last_unstale":"2024-05-08T18:34:53.379822+0000","last_undegraded":"2024-05-08T18:34:53.379822+0000","last_fullsized":"2024-05-08T18:34:53.379822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:53.379693+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:53.379693+0000","last_clean_scrub_stamp":"2024-05-08T18:34:53.379693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:03.913931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'6","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:20.419331+0000","last_change":"2024-05-08T18:35:20.419364+0000","last_active":"2024-05-08T18:35:20.419331+0000","last_peered":"2024-05-08T18:35:20.419331+0000","last_clean":"2024-05-08T18:35:20.419331+0000","last_became_active":"2024-05-08T18:30:58.314786+0000","last_became_peered":"2024-05-08T18:30:58.314786+0000","last_unstale":"2024-05-08T18:35:20.419331+0000","last_undegraded":"2024-05-08T18:35:20.419331+0000","last_fullsized":"2024-05-08T18:35:20.419331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:35:20.419235+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:35:20.419235+0000","last_clean_scrub_stamp":"2024-05-08T18:35:20.419235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:53.147124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'12","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:53.768373+0000","last_change":"2024-05-08T18:34:53.768373+0000","last_active":"2024-05-08T18:34:53.768373+0000","last_peered":"2024-05-08T18:34:53.768373+0000","last_clean":"2024-05-08T18:34:53.768373+0000","last_became_active":"2024-05-08T18:31:00.282863+0000","last_became_peered":"2024-05-08T18:31:00.282863+0000","last_unstale":"2024-05-08T18:34:53.768373+0000","last_undegraded":"2024-05-08T18:34:53.768373+0000","last_fullsized":"2024-05-08T18:34:53.768373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:53.768253+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:53.768253+0000","last_clean_scrub_stamp":"2024-05-08T18:34:53.768253+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:55.153778+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'3","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:58.706266+0000","last_change":"2024-05-08T18:34:58.706266+0000","last_active":"2024-05-08T18:34:58.706266+0000","last_peered":"2024-05-08T18:34:58.706266+0000","last_clean":"2024-05-08T18:34:58.706266+0000","last_became_active":"2024-05-08T18:30:58.289337+0000","last_became_peered":"2024-05-08T18:30:58.289337+0000","last_unstale":"2024-05-08T18:34:58.706266+0000","last_undegraded":"2024-05-08T18:34:58.706266+0000","last_fullsized":"2024-05-08T18:34:58.706266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-08T18:34:58.706124+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-08T18:34:58.706124+0000","last_clean_scrub_stamp":"2024-05-08T18:34:58.706124+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:11.390893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'8","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:44.639287+0000","last_change":"2024-05-08T18:34:44.639287+0000","last_active":"2024-05-08T18:34:44.639287+0000","last_peered":"2024-05-08T18:34:44.639287+0000","last_clean":"2024-05-08T18:34:44.639287+0000","last_became_active":"2024-05-08T18:31:00.291269+0000","last_became_peered":"2024-05-08T18:31:00.291269+0000","last_unstale":"2024-05-08T18:34:44.639287+0000","last_undegraded":"2024-05-08T18:34:44.639287+0000","last_fullsized":"2024-05-08T18:34:44.639287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:44.639159+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:44.639159+0000","last_clean_scrub_stamp":"2024-05-08T18:34:44.639159+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:39.429539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:09.735499+0000","last_change":"2024-05-08T18:35:09.735499+0000","last_active":"2024-05-08T18:35:09.735499+0000","last_peered":"2024-05-08T18:35:09.735499+0000","last_clean":"2024-05-08T18:35:09.735499+0000","last_became_active":"2024-05-08T18:30:58.283976+0000","last_became_peered":"2024-05-08T18:30:58.283976+0000","last_unstale":"2024-05-08T18:35:09.735499+0000","last_undegraded":"2024-05-08T18:35:09.735499+0000","last_fullsized":"2024-05-08T18:35:09.735499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:09.735360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:09.735360+0000","last_clean_scrub_stamp":"2024-05-08T18:35:09.735360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:01.122007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:41.755623+0000","last_change":"2024-05-08T18:34:41.755623+0000","last_active":"2024-05-08T18:34:41.755623+0000","last_peered":"2024-05-08T18:34:41.755623+0000","last_clean":"2024-05-08T18:34:41.755623+0000","last_became_active":"2024-05-08T18:31:00.292385+0000","last_became_peered":"2024-05-08T18:31:00.292385+0000","last_unstale":"2024-05-08T18:34:41.755623+0000","last_undegraded":"2024-05-08T18:34:41.755623+0000","last_fullsized":"2024-05-08T18:34:41.755623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:41.755496+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:41.755496+0000","last_clean_scrub_stamp":"2024-05-08T18:34:41.755496+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:08:19.929979+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"29'2","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:06.799236+0000","last_change":"2024-05-08T18:35:06.799236+0000","last_active":"2024-05-08T18:35:06.799236+0000","last_peered":"2024-05-08T18:35:06.799236+0000","last_clean":"2024-05-08T18:35:06.799236+0000","last_became_active":"2024-05-08T18:30:58.303839+0000","last_became_peered":"2024-05-08T18:30:58.303839+0000","last_unstale":"2024-05-08T18:35:06.799236+0000","last_undegraded":"2024-05-08T18:35:06.799236+0000","last_fullsized":"2024-05-08T18:35:06.799236+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:06.799126+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:06.799126+0000","last_clean_scrub_stamp":"2024-05-08T18:35:06.799126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'8","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:46.597867+0000","last_change":"2024-05-08T18:34:46.597867+0000","last_active":"2024-05-08T18:34:46.597867+0000","last_peered":"2024-05-08T18:34:46.597867+0000","last_clean":"2024-05-08T18:34:46.597867+0000","last_became_active":"2024-05-08T18:31:00.288202+0000","last_became_peered":"2024-05-08T18:31:00.288202+0000","last_unstale":"2024-05-08T18:34:46.597867+0000","last_undegraded":"2024-05-08T18:34:46.597867+0000","last_fullsized":"2024-05-08T18:34:46.597867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:46.597745+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:46.597745+0000","last_clean_scrub_stamp":"2024-05-08T18:34:46.597745+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:38.535670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:55.867126+0000","last_change":"2024-05-08T18:34:55.867126+0000","last_active":"2024-05-08T18:34:55.867126+0000","last_peered":"2024-05-08T18:34:55.867126+0000","last_clean":"2024-05-08T18:34:55.867126+0000","last_became_active":"2024-05-08T18:30:58.305116+0000","last_became_peered":"2024-05-08T18:30:58.305116+0000","last_unstale":"2024-05-08T18:34:55.867126+0000","last_undegraded":"2024-05-08T18:34:55.867126+0000","last_fullsized":"2024-05-08T18:34:55.867126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:55.867010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:55.867010+0000","last_clean_scrub_stamp":"2024-05-08T18:34:55.867010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:11:07.742066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'4","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:10.786108+0000","last_change":"2024-05-08T18:35:10.786108+0000","last_active":"2024-05-08T18:35:10.786108+0000","last_peered":"2024-05-08T18:35:10.786108+0000","last_clean":"2024-05-08T18:35:10.786108+0000","last_became_active":"2024-05-08T18:31:00.284439+0000","last_became_peered":"2024-05-08T18:31:00.284439+0000","last_unstale":"2024-05-08T18:35:10.786108+0000","last_undegraded":"2024-05-08T18:35:10.786108+0000","last_fullsized":"2024-05-08T18:35:10.786108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:10.785970+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:10.785970+0000","last_clean_scrub_stamp":"2024-05-08T18:35:10.785970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:58.520232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:10.709145+0000","last_change":"2024-05-08T18:35:10.709145+0000","last_active":"2024-05-08T18:35:10.709145+0000","last_peered":"2024-05-08T18:35:10.709145+0000","last_clean":"2024-05-08T18:35:10.709145+0000","last_became_active":"2024-05-08T18:30:58.286930+0000","last_became_peered":"2024-05-08T18:30:58.286930+0000","last_unstale":"2024-05-08T18:35:10.709145+0000","last_undegraded":"2024-05-08T18:35:10.709145+0000","last_fullsized":"2024-05-08T18:35:10.709145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:10.709019+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:10.709019+0000","last_clean_scrub_stamp":"2024-05-08T18:35:10.709019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:50.588130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:58.663344+0000","last_change":"2024-05-08T18:34:58.663390+0000","last_active":"2024-05-08T18:34:58.663344+0000","last_peered":"2024-05-08T18:34:58.663344+0000","last_clean":"2024-05-08T18:34:58.663344+0000","last_became_active":"2024-05-08T18:31:00.282958+0000","last_became_peered":"2024-05-08T18:31:00.282958+0000","last_unstale":"2024-05-08T18:34:58.663344+0000","last_undegraded":"2024-05-08T18:34:58.663344+0000","last_fullsized":"2024-05-08T18:34:58.663344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:58.663254+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:58.663254+0000","last_clean_scrub_stamp":"2024-05-08T18:34:58.663254+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:32.546874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.284487+0000","last_change":"2024-05-08T18:30:58.305701+0000","last_active":"2024-05-08T18:34:18.284487+0000","last_peered":"2024-05-08T18:34:18.284487+0000","last_clean":"2024-05-08T18:34:18.284487+0000","last_became_active":"2024-05-08T18:30:58.302051+0000","last_became_peered":"2024-05-08T18:30:58.302051+0000","last_unstale":"2024-05-08T18:34:18.284487+0000","last_undegraded":"2024-05-08T18:34:18.284487+0000","last_fullsized":"2024-05-08T18:34:18.284487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:30:57.254764+0000","last_clean_scrub_stamp":"2024-05-08T18:30:57.254764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:36.575212+0000","last_change":"2024-05-08T18:34:36.575238+0000","last_active":"2024-05-08T18:34:36.575212+0000","last_peered":"2024-05-08T18:34:36.575212+0000","last_clean":"2024-05-08T18:34:36.575212+0000","last_became_active":"2024-05-08T18:31:00.297787+0000","last_became_peered":"2024-05-08T18:31:00.297787+0000","last_unstale":"2024-05-08T18:34:36.575212+0000","last_undegraded":"2024-05-08T18:34:36.575212+0000","last_fullsized":"2024-05-08T18:34:36.575212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:36.575101+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:36.575101+0000","last_clean_scrub_stamp":"2024-05-08T18:34:36.575101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:18.442678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'4","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:07.731242+0000","last_change":"2024-05-08T18:35:07.731242+0000","last_active":"2024-05-08T18:35:07.731242+0000","last_peered":"2024-05-08T18:35:07.731242+0000","last_clean":"2024-05-08T18:35:07.731242+0000","last_became_active":"2024-05-08T18:30:58.284146+0000","last_became_peered":"2024-05-08T18:30:58.284146+0000","last_unstale":"2024-05-08T18:35:07.731242+0000","last_undegraded":"2024-05-08T18:35:07.731242+0000","last_fullsized":"2024-05-08T18:35:07.731242+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:07.731120+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:07.731120+0000","last_clean_scrub_stamp":"2024-05-08T18:35:07.731120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:40:16.031619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'12","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:43.589692+0000","last_change":"2024-05-08T18:34:43.589692+0000","last_active":"2024-05-08T18:34:43.589692+0000","last_peered":"2024-05-08T18:34:43.589692+0000","last_clean":"2024-05-08T18:34:43.589692+0000","last_became_active":"2024-05-08T18:31:00.291399+0000","last_became_peered":"2024-05-08T18:31:00.291399+0000","last_unstale":"2024-05-08T18:34:43.589692+0000","last_undegraded":"2024-05-08T18:34:43.589692+0000","last_fullsized":"2024-05-08T18:34:43.589692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:43.589557+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:43.589557+0000","last_clean_scrub_stamp":"2024-05-08T18:34:43.589557+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:03.562149+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:57.674663+0000","last_change":"2024-05-08T18:34:57.674663+0000","last_active":"2024-05-08T18:34:57.674663+0000","last_peered":"2024-05-08T18:34:57.674663+0000","last_clean":"2024-05-08T18:34:57.674663+0000","last_became_active":"2024-05-08T18:30:58.305523+0000","last_became_peered":"2024-05-08T18:30:58.305523+0000","last_unstale":"2024-05-08T18:34:57.674663+0000","last_undegraded":"2024-05-08T18:34:57.674663+0000","last_fullsized":"2024-05-08T18:34:57.674663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:57.674531+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:57.674531+0000","last_clean_scrub_stamp":"2024-05-08T18:34:57.674531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:49.819400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'14","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:47.605779+0000","last_change":"2024-05-08T18:34:47.605779+0000","last_active":"2024-05-08T18:34:47.605779+0000","last_peered":"2024-05-08T18:34:47.605779+0000","last_clean":"2024-05-08T18:34:47.605779+0000","last_became_active":"2024-05-08T18:31:00.281199+0000","last_became_peered":"2024-05-08T18:31:00.281199+0000","last_unstale":"2024-05-08T18:34:47.605779+0000","last_undegraded":"2024-05-08T18:34:47.605779+0000","last_fullsized":"2024-05-08T18:34:47.605779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-08T18:34:47.605617+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-08T18:34:47.605617+0000","last_clean_scrub_stamp":"2024-05-08T18:34:47.605617+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:27.417542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:04.773925+0000","last_change":"2024-05-08T18:35:04.773925+0000","last_active":"2024-05-08T18:35:04.773925+0000","last_peered":"2024-05-08T18:35:04.773925+0000","last_clean":"2024-05-08T18:35:04.773925+0000","last_became_active":"2024-05-08T18:30:58.302218+0000","last_became_peered":"2024-05-08T18:30:58.302218+0000","last_unstale":"2024-05-08T18:35:04.773925+0000","last_undegraded":"2024-05-08T18:35:04.773925+0000","last_fullsized":"2024-05-08T18:35:04.773925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:04.773780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:04.773780+0000","last_clean_scrub_stamp":"2024-05-08T18:35:04.773780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:26.938636+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:38.713843+0000","last_change":"2024-05-08T18:34:38.713843+0000","last_active":"2024-05-08T18:34:38.713843+0000","last_peered":"2024-05-08T18:34:38.713843+0000","last_clean":"2024-05-08T18:34:38.713843+0000","last_became_active":"2024-05-08T18:31:00.294146+0000","last_became_peered":"2024-05-08T18:31:00.294146+0000","last_unstale":"2024-05-08T18:34:38.713843+0000","last_undegraded":"2024-05-08T18:34:38.713843+0000","last_fullsized":"2024-05-08T18:34:38.713843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:38.713718+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:38.713718+0000","last_clean_scrub_stamp":"2024-05-08T18:34:38.713718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:03.774145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:11.344730+0000","last_change":"2024-05-08T18:35:11.344730+0000","last_active":"2024-05-08T18:35:11.344730+0000","last_peered":"2024-05-08T18:35:11.344730+0000","last_clean":"2024-05-08T18:35:11.344730+0000","last_became_active":"2024-05-08T18:30:58.314388+0000","last_became_peered":"2024-05-08T18:30:58.314388+0000","last_unstale":"2024-05-08T18:35:11.344730+0000","last_undegraded":"2024-05-08T18:35:11.344730+0000","last_fullsized":"2024-05-08T18:35:11.344730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:11.344574+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:11.344574+0000","last_clean_scrub_stamp":"2024-05-08T18:35:11.344574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:49:14.135686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:54.661169+0000","last_change":"2024-05-08T18:34:54.661169+0000","last_active":"2024-05-08T18:34:54.661169+0000","last_peered":"2024-05-08T18:34:54.661169+0000","last_clean":"2024-05-08T18:34:54.661169+0000","last_became_active":"2024-05-08T18:31:00.281847+0000","last_became_peered":"2024-05-08T18:31:00.281847+0000","last_unstale":"2024-05-08T18:34:54.661169+0000","last_undegraded":"2024-05-08T18:34:54.661169+0000","last_fullsized":"2024-05-08T18:34:54.661169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:54.661048+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:54.661048+0000","last_clean_scrub_stamp":"2024-05-08T18:34:54.661048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:14.748403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:17.354615+0000","last_change":"2024-05-08T18:35:17.354615+0000","last_active":"2024-05-08T18:35:17.354615+0000","last_peered":"2024-05-08T18:35:17.354615+0000","last_clean":"2024-05-08T18:35:17.354615+0000","last_became_active":"2024-05-08T18:30:58.309203+0000","last_became_peered":"2024-05-08T18:30:58.309203+0000","last_unstale":"2024-05-08T18:35:17.354615+0000","last_undegraded":"2024-05-08T18:35:17.354615+0000","last_fullsized":"2024-05-08T18:35:17.354615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:17.354488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:17.354488+0000","last_clean_scrub_stamp":"2024-05-08T18:35:17.354488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:44.437881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'16","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:55.365295+0000","last_change":"2024-05-08T18:34:55.365295+0000","last_active":"2024-05-08T18:34:55.365295+0000","last_peered":"2024-05-08T18:34:55.365295+0000","last_clean":"2024-05-08T18:34:55.365295+0000","last_became_active":"2024-05-08T18:31:00.296240+0000","last_became_peered":"2024-05-08T18:31:00.296240+0000","last_unstale":"2024-05-08T18:34:55.365295+0000","last_undegraded":"2024-05-08T18:34:55.365295+0000","last_fullsized":"2024-05-08T18:34:55.365295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T18:34:55.365128+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T18:34:55.365128+0000","last_clean_scrub_stamp":"2024-05-08T18:34:55.365128+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:53.044461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:53.889999+0000","last_change":"2024-05-08T18:34:53.890035+0000","last_active":"2024-05-08T18:34:53.889999+0000","last_peered":"2024-05-08T18:34:53.889999+0000","last_clean":"2024-05-08T18:34:53.889999+0000","last_became_active":"2024-05-08T18:30:58.305572+0000","last_became_peered":"2024-05-08T18:30:58.305572+0000","last_unstale":"2024-05-08T18:34:53.889999+0000","last_undegraded":"2024-05-08T18:34:53.889999+0000","last_fullsized":"2024-05-08T18:34:53.889999+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:53.889909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:53.889909+0000","last_clean_scrub_stamp":"2024-05-08T18:34:53.889909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.862500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:50.632438+0000","last_change":"2024-05-08T18:34:50.632438+0000","last_active":"2024-05-08T18:34:50.632438+0000","last_peered":"2024-05-08T18:34:50.632438+0000","last_clean":"2024-05-08T18:34:50.632438+0000","last_became_active":"2024-05-08T18:31:00.282414+0000","last_became_peered":"2024-05-08T18:31:00.282414+0000","last_unstale":"2024-05-08T18:34:50.632438+0000","last_undegraded":"2024-05-08T18:34:50.632438+0000","last_fullsized":"2024-05-08T18:34:50.632438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:50.632283+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:50.632283+0000","last_clean_scrub_stamp":"2024-05-08T18:34:50.632283+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:35.148546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:21.385693+0000","last_change":"2024-05-08T18:35:21.385752+0000","last_active":"2024-05-08T18:35:21.385693+0000","last_peered":"2024-05-08T18:35:21.385693+0000","last_clean":"2024-05-08T18:35:21.385693+0000","last_became_active":"2024-05-08T18:30:58.304591+0000","last_became_peered":"2024-05-08T18:30:58.304591+0000","last_unstale":"2024-05-08T18:35:21.385693+0000","last_undegraded":"2024-05-08T18:35:21.385693+0000","last_fullsized":"2024-05-08T18:35:21.385693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:21.385583+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:21.385583+0000","last_clean_scrub_stamp":"2024-05-08T18:35:21.385583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:48.724755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:19.398545+0000","last_change":"2024-05-08T18:35:19.398594+0000","last_active":"2024-05-08T18:35:19.398545+0000","last_peered":"2024-05-08T18:35:19.398545+0000","last_clean":"2024-05-08T18:35:19.398545+0000","last_became_active":"2024-05-08T18:30:58.303443+0000","last_became_peered":"2024-05-08T18:30:58.303443+0000","last_unstale":"2024-05-08T18:35:19.398545+0000","last_undegraded":"2024-05-08T18:35:19.398545+0000","last_fullsized":"2024-05-08T18:35:19.398545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:19.398431+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:19.398431+0000","last_clean_scrub_stamp":"2024-05-08T18:35:19.398431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:59.679917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'12","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:11.731246+0000","last_change":"2024-05-08T18:35:11.731274+0000","last_active":"2024-05-08T18:35:11.731246+0000","last_peered":"2024-05-08T18:35:11.731246+0000","last_clean":"2024-05-08T18:35:11.731246+0000","last_became_active":"2024-05-08T18:31:00.288250+0000","last_became_peered":"2024-05-08T18:31:00.288250+0000","last_unstale":"2024-05-08T18:35:11.731246+0000","last_undegraded":"2024-05-08T18:35:11.731246+0000","last_fullsized":"2024-05-08T18:35:11.731246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:35:11.731157+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:35:11.731157+0000","last_clean_scrub_stamp":"2024-05-08T18:35:11.731157+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:38:05.913388+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:08.772135+0000","last_change":"2024-05-08T18:35:08.772168+0000","last_active":"2024-05-08T18:35:08.772135+0000","last_peered":"2024-05-08T18:35:08.772135+0000","last_clean":"2024-05-08T18:35:08.772135+0000","last_became_active":"2024-05-08T18:30:58.284090+0000","last_became_peered":"2024-05-08T18:30:58.284090+0000","last_unstale":"2024-05-08T18:35:08.772135+0000","last_undegraded":"2024-05-08T18:35:08.772135+0000","last_fullsized":"2024-05-08T18:35:08.772135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:08.772024+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:08.772024+0000","last_clean_scrub_stamp":"2024-05-08T18:35:08.772024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:53.551363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:45.638589+0000","last_change":"2024-05-08T18:34:45.638617+0000","last_active":"2024-05-08T18:34:45.638589+0000","last_peered":"2024-05-08T18:34:45.638589+0000","last_clean":"2024-05-08T18:34:45.638589+0000","last_became_active":"2024-05-08T18:31:00.291650+0000","last_became_peered":"2024-05-08T18:31:00.291650+0000","last_unstale":"2024-05-08T18:34:45.638589+0000","last_undegraded":"2024-05-08T18:34:45.638589+0000","last_fullsized":"2024-05-08T18:34:45.638589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:45.638483+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:45.638483+0000","last_clean_scrub_stamp":"2024-05-08T18:34:45.638483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:17:56.483101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705724,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":136192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705725,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40444,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331396,"statfs":{"total":96636764160,"available":96595349504,"internally_reserved":0,"allocated":970752,"data_stored":724145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705724,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36304,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335536,"statfs":{"total":96636764160,"available":96599588864,"internally_reserved":0,"allocated":991232,"data_stored":724633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":409600,"data_stored":135044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:35:40.192 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:40.193 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:40.193 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:40.193 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:40.194 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:40.194 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:40.194 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:40.195 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:40.195 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:40.195 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:31:07.290664+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=31, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:40.195 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T18:30:57.254764+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=30, tm_sec=57, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=34, tm_sec=15, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:35:40.196 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:36:00.196 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:36:00.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.313+0000 7f83b10a7640 1 Processor -- start 2024-05-08T18:36:00.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.313+0000 7f83b10a7640 1 -- start start 2024-05-08T18:36:00.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.314+0000 7f83b10a7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83ac130000 0x7f83ac134a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:36:00.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.314+0000 7f83b10a7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83ac09f1e0 con 0x7f83ac12f510 2024-05-08T18:36:00.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.314+0000 7f83b10a7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f83ac070d00 con 0x7f83ac130000 2024-05-08T18:36:00.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.314+0000 7f83aa59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83ac130000 0x7f83ac134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:36:00.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.314+0000 7f83aad9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f83ac12f510 0x7f83ac12f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33288/0 (socket says 172.21.15.53:33288) 2024-05-08T18:36:00.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.314+0000 7f83aad9d640 1 -- 172.21.15.53:0/3144351261 learned_addr learned my addr 172.21.15.53:0/3144351261 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:36:00.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.314+0000 7f83aa59c640 1 -- 172.21.15.53:0/3144351261 >> v1:172.21.15.53:6789/0 conn(0x7f83ac12f510 legacy=0x7f83ac12f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:36:00.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.314+0000 7f83aa59c640 1 -- 172.21.15.53:0/3144351261 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac0737b0 con 0x7f83ac130000 2024-05-08T18:36:00.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.315+0000 7f83aa59c640 1 --2- 172.21.15.53:0/3144351261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac130000 0x7f83ac134a40 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009720 tx=0x7f83a002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ace7c9f29b1e2b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:36:00.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.315+0000 7f83a9d9b640 1 -- 172.21.15.53:0/3144351261 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a00316d0 con 0x7f83ac130000 2024-05-08T18:36:00.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.315+0000 7f83a9d9b640 1 -- 172.21.15.53:0/3144351261 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a0037070 con 0x7f83ac130000 2024-05-08T18:36:00.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.315+0000 7f83a9d9b640 1 -- 172.21.15.53:0/3144351261 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a00319c0 con 0x7f83ac130000 2024-05-08T18:36:00.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.316+0000 7f83b10a7640 1 -- 172.21.15.53:0/3144351261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac130000 msgr2=0x7f83ac134a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:36:00.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.316+0000 7f83b10a7640 1 --2- 172.21.15.53:0/3144351261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac130000 0x7f83ac134a40 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009720 tx=0x7f83a002b840 comp rx=0 tx=0).stop 2024-05-08T18:36:00.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.316+0000 7f83b10a7640 1 -- 172.21.15.53:0/3144351261 shutdown_connections 2024-05-08T18:36:00.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.316+0000 7f83b10a7640 1 --2- 172.21.15.53:0/3144351261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac130000 0x7f83ac134a40 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:36:00.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.316+0000 7f83b10a7640 1 -- 172.21.15.53:0/3144351261 >> 172.21.15.53:0/3144351261 conn(0x7f83ac09c7a0 msgr2=0x7f83ac09cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:36:00.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.316+0000 7f83b10a7640 1 -- 172.21.15.53:0/3144351261 shutdown_connections 2024-05-08T18:36:00.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.316+0000 7f83b10a7640 1 -- 172.21.15.53:0/3144351261 wait complete. 2024-05-08T18:36:00.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.317+0000 7f83b10a7640 1 Processor -- start 2024-05-08T18:36:00.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.317+0000 7f83b10a7640 1 -- start start 2024-05-08T18:36:00.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.317+0000 7f83b10a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac12f510 0x7f83ac12dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:36:00.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.317+0000 7f83b10a7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac134f80 con 0x7f83ac12f510 2024-05-08T18:36:00.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.317+0000 7f83aad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac12f510 0x7f83ac12dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:36:00.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.318+0000 7f83aad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac12f510 0x7f83ac12dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60884/0 (socket says 172.21.15.53:60884) 2024-05-08T18:36:00.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.318+0000 7f83aad9d640 1 -- 172.21.15.53:0/849218222 learned_addr learned my addr 172.21.15.53:0/849218222 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:36:00.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.318+0000 7f83aad9d640 1 -- 172.21.15.53:0/849218222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac11fce0 con 0x7f83ac12f510 2024-05-08T18:36:00.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.318+0000 7f83aad9d640 1 --2- 172.21.15.53:0/849218222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac12f510 0x7f83ac12dbf0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f839c00c4a0 tx=0x7f839c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:36:00.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.318+0000 7f83937fe640 1 -- 172.21.15.53:0/849218222 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f839c017070 con 0x7f83ac12f510 2024-05-08T18:36:00.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.318+0000 7f83937fe640 1 -- 172.21.15.53:0/849218222 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839c005c10 con 0x7f83ac12f510 2024-05-08T18:36:00.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.318+0000 7f83937fe640 1 -- 172.21.15.53:0/849218222 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f839c007070 con 0x7f83ac12f510 2024-05-08T18:36:00.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.318+0000 7f83b10a7640 1 -- 172.21.15.53:0/849218222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ac120c50 con 0x7f83ac12f510 2024-05-08T18:36:00.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.319+0000 7f83b10a7640 1 -- 172.21.15.53:0/849218222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ac134620 con 0x7f83ac12f510 2024-05-08T18:36:00.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.319+0000 7f83937fe640 1 -- 172.21.15.53:0/849218222 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f839c01a070 con 0x7f83ac12f510 2024-05-08T18:36:00.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.319+0000 7f83b10a7640 1 -- 172.21.15.53:0/849218222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83ac11f840 con 0x7f83ac12f510 2024-05-08T18:36:00.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.320+0000 7f83937fe640 1 --2- 172.21.15.53:0/849218222 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f839803d2b0 0x7f839803f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:36:00.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.320+0000 7f83937fe640 1 -- 172.21.15.53:0/849218222 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f839c051050 con 0x7f83ac12f510 2024-05-08T18:36:00.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.320+0000 7f83aa59c640 1 --2- 172.21.15.53:0/849218222 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f839803d2b0 0x7f839803f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:36:00.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.321+0000 7f83aa59c640 1 --2- 172.21.15.53:0/849218222 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f839803d2b0 0x7f839803f770 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009720 tx=0x7f83a0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:36:00.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.325+0000 7f83937fe640 1 -- 172.21.15.53:0/849218222 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f839c01ac60 con 0x7f83ac12f510 2024-05-08T18:36:00.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.510+0000 7f83b10a7640 1 -- 172.21.15.53:0/849218222 --> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83ac064010 con 0x7f839803d2b0 2024-05-08T18:36:00.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.525+0000 7f83937fe640 1 -- 172.21.15.53:0/849218222 <== mgr.4102 v2:172.21.15.87:6824/211215191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666317 (secure 0 0 0) 0x7f83ac064010 con 0x7f839803d2b0 2024-05-08T18:36:00.532 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:36:00.538 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:36:00.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.530+0000 7f83b10a7640 1 -- 172.21.15.53:0/849218222 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f839803d2b0 msgr2=0x7f839803f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:36:00.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.530+0000 7f83b10a7640 1 --2- 172.21.15.53:0/849218222 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f839803d2b0 0x7f839803f770 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009720 tx=0x7f83a0008030 comp rx=0 tx=0).stop 2024-05-08T18:36:00.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.530+0000 7f83b10a7640 1 -- 172.21.15.53:0/849218222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac12f510 msgr2=0x7f83ac12dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:36:00.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.530+0000 7f83b10a7640 1 --2- 172.21.15.53:0/849218222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac12f510 0x7f83ac12dbf0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f839c00c4a0 tx=0x7f839c00c960 comp rx=0 tx=0).stop 2024-05-08T18:36:00.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.530+0000 7f83b10a7640 1 -- 172.21.15.53:0/849218222 shutdown_connections 2024-05-08T18:36:00.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.530+0000 7f83b10a7640 1 --2- 172.21.15.53:0/849218222 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7f839803d2b0 0x7f839803f770 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:36:00.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.530+0000 7f83b10a7640 1 --2- 172.21.15.53:0/849218222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac12f510 0x7f83ac12dbf0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:36:00.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.530+0000 7f83b10a7640 1 -- 172.21.15.53:0/849218222 >> 172.21.15.53:0/849218222 conn(0x7f83ac09c7a0 msgr2=0x7f83ac09ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:36:00.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.530+0000 7f83b10a7640 1 -- 172.21.15.53:0/849218222 shutdown_connections 2024-05-08T18:36:00.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.530+0000 7f83b10a7640 1 -- 172.21.15.53:0/849218222 wait complete. 2024-05-08T18:36:00.542 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-05-08T18:36:00.199846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5055,"num_read_kb":4641,"num_write":2119,"num_write_kb":60585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4739,"ondisk_log_size":4739,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152408,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334952,"statfs":{"total":386547056640,"available":386390990848,"internally_reserved":0,"allocated":2809856,"data_stored":1720014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003388"},"pg_stats":[{"pgid":"3.3f","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:57.851976+0000","last_change":"2024-05-08T18:34:57.851976+0000","last_active":"2024-05-08T18:34:57.851976+0000","last_peered":"2024-05-08T18:34:57.851976+0000","last_clean":"2024-05-08T18:34:57.851976+0000","last_became_active":"2024-05-08T18:30:58.305175+0000","last_became_peered":"2024-05-08T18:30:58.305175+0000","last_unstale":"2024-05-08T18:34:57.851976+0000","last_undegraded":"2024-05-08T18:34:57.851976+0000","last_fullsized":"2024-05-08T18:34:57.851976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:57.851844+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:57.851844+0000","last_clean_scrub_stamp":"2024-05-08T18:34:57.851844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:37.663769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'8","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:00.657644+0000","last_change":"2024-05-08T18:35:00.657698+0000","last_active":"2024-05-08T18:35:00.657644+0000","last_peered":"2024-05-08T18:35:00.657644+0000","last_clean":"2024-05-08T18:35:00.657644+0000","last_became_active":"2024-05-08T18:31:00.284574+0000","last_became_peered":"2024-05-08T18:31:00.284574+0000","last_unstale":"2024-05-08T18:35:00.657644+0000","last_undegraded":"2024-05-08T18:35:00.657644+0000","last_fullsized":"2024-05-08T18:35:00.657644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:35:00.657541+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:35:00.657541+0000","last_clean_scrub_stamp":"2024-05-08T18:35:00.657541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:37.359769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:00.642294+0000","last_change":"2024-05-08T18:35:00.642294+0000","last_active":"2024-05-08T18:35:00.642294+0000","last_peered":"2024-05-08T18:35:00.642294+0000","last_clean":"2024-05-08T18:35:00.642294+0000","last_became_active":"2024-05-08T18:30:58.288674+0000","last_became_peered":"2024-05-08T18:30:58.288674+0000","last_unstale":"2024-05-08T18:35:00.642294+0000","last_undegraded":"2024-05-08T18:35:00.642294+0000","last_fullsized":"2024-05-08T18:35:00.642294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:00.642171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:00.642171+0000","last_clean_scrub_stamp":"2024-05-08T18:35:00.642171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:52.334568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:37.548543+0000","last_change":"2024-05-08T18:34:37.548605+0000","last_active":"2024-05-08T18:34:37.548543+0000","last_peered":"2024-05-08T18:34:37.548543+0000","last_clean":"2024-05-08T18:34:37.548543+0000","last_became_active":"2024-05-08T18:31:00.298145+0000","last_became_peered":"2024-05-08T18:31:00.298145+0000","last_unstale":"2024-05-08T18:34:37.548543+0000","last_undegraded":"2024-05-08T18:34:37.548543+0000","last_fullsized":"2024-05-08T18:34:37.548543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:34:37.548430+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:34:37.548430+0000","last_clean_scrub_stamp":"2024-05-08T18:34:37.548430+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:11.432050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:25.408395+0000","last_change":"2024-05-08T18:35:25.408446+0000","last_active":"2024-05-08T18:35:25.408395+0000","last_peered":"2024-05-08T18:35:25.408395+0000","last_clean":"2024-05-08T18:35:25.408395+0000","last_became_active":"2024-05-08T18:30:58.304442+0000","last_became_peered":"2024-05-08T18:30:58.304442+0000","last_unstale":"2024-05-08T18:35:25.408395+0000","last_undegraded":"2024-05-08T18:35:25.408395+0000","last_fullsized":"2024-05-08T18:35:25.408395+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:25.408286+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:25.408286+0000","last_clean_scrub_stamp":"2024-05-08T18:35:25.408286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:37:59.786769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"27'10","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:52.416583+0000","last_change":"2024-05-08T18:34:52.416630+0000","last_active":"2024-05-08T18:34:52.416583+0000","last_peered":"2024-05-08T18:34:52.416583+0000","last_clean":"2024-05-08T18:34:52.416583+0000","last_became_active":"2024-05-08T18:31:00.297810+0000","last_became_peered":"2024-05-08T18:31:00.297810+0000","last_unstale":"2024-05-08T18:34:52.416583+0000","last_undegraded":"2024-05-08T18:34:52.416583+0000","last_fullsized":"2024-05-08T18:34:52.416583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:34:52.416478+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:34:52.416478+0000","last_clean_scrub_stamp":"2024-05-08T18:34:52.416478+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:32.357386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:59.863278+0000","last_change":"2024-05-08T18:34:59.863300+0000","last_active":"2024-05-08T18:34:59.863278+0000","last_peered":"2024-05-08T18:34:59.863278+0000","last_clean":"2024-05-08T18:34:59.863278+0000","last_became_active":"2024-05-08T18:30:58.295569+0000","last_became_peered":"2024-05-08T18:30:58.295569+0000","last_unstale":"2024-05-08T18:34:59.863278+0000","last_undegraded":"2024-05-08T18:34:59.863278+0000","last_fullsized":"2024-05-08T18:34:59.863278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:59.863190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:59.863190+0000","last_clean_scrub_stamp":"2024-05-08T18:34:59.863190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:44.379452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:59.340771+0000","last_change":"2024-05-08T18:34:59.340801+0000","last_active":"2024-05-08T18:34:59.340771+0000","last_peered":"2024-05-08T18:34:59.340771+0000","last_clean":"2024-05-08T18:34:59.340771+0000","last_became_active":"2024-05-08T18:31:00.295611+0000","last_became_peered":"2024-05-08T18:31:00.295611+0000","last_unstale":"2024-05-08T18:34:59.340771+0000","last_undegraded":"2024-05-08T18:34:59.340771+0000","last_fullsized":"2024-05-08T18:34:59.340771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:59.340664+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:59.340664+0000","last_clean_scrub_stamp":"2024-05-08T18:34:59.340664+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:43.577418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:16.329442+0000","last_change":"2024-05-08T18:35:16.329442+0000","last_active":"2024-05-08T18:35:16.329442+0000","last_peered":"2024-05-08T18:35:16.329442+0000","last_clean":"2024-05-08T18:35:16.329442+0000","last_became_active":"2024-05-08T18:30:58.313003+0000","last_became_peered":"2024-05-08T18:30:58.313003+0000","last_unstale":"2024-05-08T18:35:16.329442+0000","last_undegraded":"2024-05-08T18:35:16.329442+0000","last_fullsized":"2024-05-08T18:35:16.329442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:16.329315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:16.329315+0000","last_clean_scrub_stamp":"2024-05-08T18:35:16.329315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:39.163134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'4","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:46.649407+0000","last_change":"2024-05-08T18:34:46.649407+0000","last_active":"2024-05-08T18:34:46.649407+0000","last_peered":"2024-05-08T18:34:46.649407+0000","last_clean":"2024-05-08T18:34:46.649407+0000","last_became_active":"2024-05-08T18:31:00.281065+0000","last_became_peered":"2024-05-08T18:31:00.281065+0000","last_unstale":"2024-05-08T18:34:46.649407+0000","last_undegraded":"2024-05-08T18:34:46.649407+0000","last_fullsized":"2024-05-08T18:34:46.649407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:34:46.649258+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:34:46.649258+0000","last_clean_scrub_stamp":"2024-05-08T18:34:46.649258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:36.416236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:47.845746+0000","last_change":"2024-05-08T18:34:47.845746+0000","last_active":"2024-05-08T18:34:47.845746+0000","last_peered":"2024-05-08T18:34:47.845746+0000","last_clean":"2024-05-08T18:34:47.845746+0000","last_became_active":"2024-05-08T18:30:58.307687+0000","last_became_peered":"2024-05-08T18:30:58.307687+0000","last_unstale":"2024-05-08T18:34:47.845746+0000","last_undegraded":"2024-05-08T18:34:47.845746+0000","last_fullsized":"2024-05-08T18:34:47.845746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:47.845617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:47.845617+0000","last_clean_scrub_stamp":"2024-05-08T18:34:47.845617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:35.232416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'12","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:35.603652+0000","last_change":"2024-05-08T18:34:35.603652+0000","last_active":"2024-05-08T18:34:35.603652+0000","last_peered":"2024-05-08T18:34:35.603652+0000","last_clean":"2024-05-08T18:34:35.603652+0000","last_became_active":"2024-05-08T18:31:00.298978+0000","last_became_peered":"2024-05-08T18:31:00.298978+0000","last_unstale":"2024-05-08T18:34:35.603652+0000","last_undegraded":"2024-05-08T18:34:35.603652+0000","last_fullsized":"2024-05-08T18:34:35.603652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:35.603538+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:35.603538+0000","last_clean_scrub_stamp":"2024-05-08T18:34:35.603538+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.163546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:15.327309+0000","last_change":"2024-05-08T18:35:15.327309+0000","last_active":"2024-05-08T18:35:15.327309+0000","last_peered":"2024-05-08T18:35:15.327309+0000","last_clean":"2024-05-08T18:35:15.327309+0000","last_became_active":"2024-05-08T18:30:58.308931+0000","last_became_peered":"2024-05-08T18:30:58.308931+0000","last_unstale":"2024-05-08T18:35:15.327309+0000","last_undegraded":"2024-05-08T18:35:15.327309+0000","last_fullsized":"2024-05-08T18:35:15.327309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:15.327191+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:15.327191+0000","last_clean_scrub_stamp":"2024-05-08T18:35:15.327191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:13.790526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'10","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:56.873085+0000","last_change":"2024-05-08T18:34:56.873085+0000","last_active":"2024-05-08T18:34:56.873085+0000","last_peered":"2024-05-08T18:34:56.873085+0000","last_clean":"2024-05-08T18:34:56.873085+0000","last_became_active":"2024-05-08T18:31:00.295472+0000","last_became_peered":"2024-05-08T18:31:00.295472+0000","last_unstale":"2024-05-08T18:34:56.873085+0000","last_undegraded":"2024-05-08T18:34:56.873085+0000","last_fullsized":"2024-05-08T18:34:56.873085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:56.872968+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:56.872968+0000","last_clean_scrub_stamp":"2024-05-08T18:34:56.872968+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:48.810892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:52.757867+0000","last_change":"2024-05-08T18:34:52.757867+0000","last_active":"2024-05-08T18:34:52.757867+0000","last_peered":"2024-05-08T18:34:52.757867+0000","last_clean":"2024-05-08T18:34:52.757867+0000","last_became_active":"2024-05-08T18:30:58.294511+0000","last_became_peered":"2024-05-08T18:30:58.294511+0000","last_unstale":"2024-05-08T18:34:52.757867+0000","last_undegraded":"2024-05-08T18:34:52.757867+0000","last_fullsized":"2024-05-08T18:34:52.757867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:52.757734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:52.757734+0000","last_clean_scrub_stamp":"2024-05-08T18:34:52.757734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:46.902960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'4","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:48.805144+0000","last_change":"2024-05-08T18:34:48.805144+0000","last_active":"2024-05-08T18:34:48.805144+0000","last_peered":"2024-05-08T18:34:48.805144+0000","last_clean":"2024-05-08T18:34:48.805144+0000","last_became_active":"2024-05-08T18:31:00.291203+0000","last_became_peered":"2024-05-08T18:31:00.291203+0000","last_unstale":"2024-05-08T18:34:48.805144+0000","last_undegraded":"2024-05-08T18:34:48.805144+0000","last_fullsized":"2024-05-08T18:34:48.805144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:48.804997+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:48.804997+0000","last_clean_scrub_stamp":"2024-05-08T18:34:48.804997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:13.865424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:07.345938+0000","last_change":"2024-05-08T18:35:07.345938+0000","last_active":"2024-05-08T18:35:07.345938+0000","last_peered":"2024-05-08T18:35:07.345938+0000","last_clean":"2024-05-08T18:35:07.345938+0000","last_became_active":"2024-05-08T18:31:00.290806+0000","last_became_peered":"2024-05-08T18:31:00.290806+0000","last_unstale":"2024-05-08T18:35:07.345938+0000","last_undegraded":"2024-05-08T18:35:07.345938+0000","last_fullsized":"2024-05-08T18:35:07.345938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:07.345824+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:07.345824+0000","last_clean_scrub_stamp":"2024-05-08T18:35:07.345824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:28.605906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:59.619045+0000","last_change":"2024-05-08T18:34:59.619045+0000","last_active":"2024-05-08T18:34:59.619045+0000","last_peered":"2024-05-08T18:34:59.619045+0000","last_clean":"2024-05-08T18:34:59.619045+0000","last_became_active":"2024-05-08T18:30:58.304685+0000","last_became_peered":"2024-05-08T18:30:58.304685+0000","last_unstale":"2024-05-08T18:34:59.619045+0000","last_undegraded":"2024-05-08T18:34:59.619045+0000","last_fullsized":"2024-05-08T18:34:59.619045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:59.618879+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:59.618879+0000","last_clean_scrub_stamp":"2024-05-08T18:34:59.618879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:12.303648+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'14","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:52.646329+0000","last_change":"2024-05-08T18:34:52.646329+0000","last_active":"2024-05-08T18:34:52.646329+0000","last_peered":"2024-05-08T18:34:52.646329+0000","last_clean":"2024-05-08T18:34:52.646329+0000","last_became_active":"2024-05-08T18:31:00.281816+0000","last_became_peered":"2024-05-08T18:31:00.281816+0000","last_unstale":"2024-05-08T18:34:52.646329+0000","last_undegraded":"2024-05-08T18:34:52.646329+0000","last_fullsized":"2024-05-08T18:34:52.646329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-05-08T18:34:52.646217+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-05-08T18:34:52.646217+0000","last_clean_scrub_stamp":"2024-05-08T18:34:52.646217+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:59.267706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:49.823601+0000","last_change":"2024-05-08T18:34:49.823601+0000","last_active":"2024-05-08T18:34:49.823601+0000","last_peered":"2024-05-08T18:34:49.823601+0000","last_clean":"2024-05-08T18:34:49.823601+0000","last_became_active":"2024-05-08T18:30:58.306545+0000","last_became_peered":"2024-05-08T18:30:58.306545+0000","last_unstale":"2024-05-08T18:34:49.823601+0000","last_undegraded":"2024-05-08T18:34:49.823601+0000","last_fullsized":"2024-05-08T18:34:49.823601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:49.823481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:49.823481+0000","last_clean_scrub_stamp":"2024-05-08T18:34:49.823481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:44.587517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'16","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:56.719785+0000","last_change":"2024-05-08T18:34:56.719785+0000","last_active":"2024-05-08T18:34:56.719785+0000","last_peered":"2024-05-08T18:34:56.719785+0000","last_clean":"2024-05-08T18:34:56.719785+0000","last_became_active":"2024-05-08T18:31:00.283048+0000","last_became_peered":"2024-05-08T18:31:00.283048+0000","last_unstale":"2024-05-08T18:34:56.719785+0000","last_undegraded":"2024-05-08T18:34:56.719785+0000","last_fullsized":"2024-05-08T18:34:56.719785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T18:34:56.719626+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T18:34:56.719626+0000","last_clean_scrub_stamp":"2024-05-08T18:34:56.719626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:52.054400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:05.812269+0000","last_change":"2024-05-08T18:35:05.812269+0000","last_active":"2024-05-08T18:35:05.812269+0000","last_peered":"2024-05-08T18:35:05.812269+0000","last_clean":"2024-05-08T18:35:05.812269+0000","last_became_active":"2024-05-08T18:30:58.302245+0000","last_became_peered":"2024-05-08T18:30:58.302245+0000","last_unstale":"2024-05-08T18:35:05.812269+0000","last_undegraded":"2024-05-08T18:35:05.812269+0000","last_fullsized":"2024-05-08T18:35:05.812269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:05.812147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:05.812147+0000","last_clean_scrub_stamp":"2024-05-08T18:35:05.812147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:59.880065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:18.806908+0000","last_change":"2024-05-08T18:35:18.806908+0000","last_active":"2024-05-08T18:35:18.806908+0000","last_peered":"2024-05-08T18:35:18.806908+0000","last_clean":"2024-05-08T18:35:18.806908+0000","last_became_active":"2024-05-08T18:31:45.338192+0000","last_became_peered":"2024-05-08T18:31:45.338192+0000","last_unstale":"2024-05-08T18:35:18.806908+0000","last_undegraded":"2024-05-08T18:35:18.806908+0000","last_fullsized":"2024-05-08T18:35:18.806908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:35:18.806789+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:35:18.806789+0000","last_clean_scrub_stamp":"2024-05-08T18:35:18.806789+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:32.718896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:55.692849+0000","last_change":"2024-05-08T18:34:55.692849+0000","last_active":"2024-05-08T18:34:55.692849+0000","last_peered":"2024-05-08T18:34:55.692849+0000","last_clean":"2024-05-08T18:34:55.692849+0000","last_became_active":"2024-05-08T18:30:58.304222+0000","last_became_peered":"2024-05-08T18:30:58.304222+0000","last_unstale":"2024-05-08T18:34:55.692849+0000","last_undegraded":"2024-05-08T18:34:55.692849+0000","last_fullsized":"2024-05-08T18:34:55.692849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:55.692727+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:55.692727+0000","last_clean_scrub_stamp":"2024-05-08T18:34:55.692727+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:35.252735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"27'6","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:06.897509+0000","last_change":"2024-05-08T18:35:06.897509+0000","last_active":"2024-05-08T18:35:06.897509+0000","last_peered":"2024-05-08T18:35:06.897509+0000","last_clean":"2024-05-08T18:35:06.897509+0000","last_became_active":"2024-05-08T18:31:00.295990+0000","last_became_peered":"2024-05-08T18:31:00.295990+0000","last_unstale":"2024-05-08T18:35:06.897509+0000","last_undegraded":"2024-05-08T18:35:06.897509+0000","last_fullsized":"2024-05-08T18:35:06.897509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:35:06.897377+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:35:06.897377+0000","last_clean_scrub_stamp":"2024-05-08T18:35:06.897377+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:08.737527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:05.742326+0000","last_change":"2024-05-08T18:35:05.742326+0000","last_active":"2024-05-08T18:35:05.742326+0000","last_peered":"2024-05-08T18:35:05.742326+0000","last_clean":"2024-05-08T18:35:05.742326+0000","last_became_active":"2024-05-08T18:30:58.283821+0000","last_became_peered":"2024-05-08T18:30:58.283821+0000","last_unstale":"2024-05-08T18:35:05.742326+0000","last_undegraded":"2024-05-08T18:35:05.742326+0000","last_fullsized":"2024-05-08T18:35:05.742326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:05.742198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:05.742198+0000","last_clean_scrub_stamp":"2024-05-08T18:35:05.742198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:23.572628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'12","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:48.577045+0000","last_change":"2024-05-08T18:34:48.577045+0000","last_active":"2024-05-08T18:34:48.577045+0000","last_peered":"2024-05-08T18:34:48.577045+0000","last_clean":"2024-05-08T18:34:48.577045+0000","last_became_active":"2024-05-08T18:31:00.280827+0000","last_became_peered":"2024-05-08T18:31:00.280827+0000","last_unstale":"2024-05-08T18:34:48.577045+0000","last_undegraded":"2024-05-08T18:34:48.577045+0000","last_fullsized":"2024-05-08T18:34:48.577045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:48.576925+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:48.576925+0000","last_clean_scrub_stamp":"2024-05-08T18:34:48.576925+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:44.850249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:27.354052+0000","last_change":"2024-05-08T18:35:27.354052+0000","last_active":"2024-05-08T18:35:27.354052+0000","last_peered":"2024-05-08T18:35:27.354052+0000","last_clean":"2024-05-08T18:35:27.354052+0000","last_became_active":"2024-05-08T18:30:58.305571+0000","last_became_peered":"2024-05-08T18:30:58.305571+0000","last_unstale":"2024-05-08T18:35:27.354052+0000","last_undegraded":"2024-05-08T18:35:27.354052+0000","last_fullsized":"2024-05-08T18:35:27.354052+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:27.353880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:27.353880+0000","last_clean_scrub_stamp":"2024-05-08T18:35:27.353880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:26.384339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'36","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:13.715294+0000","last_change":"2024-05-08T18:35:13.715294+0000","last_active":"2024-05-08T18:35:13.715294+0000","last_peered":"2024-05-08T18:35:13.715294+0000","last_clean":"2024-05-08T18:35:13.715294+0000","last_became_active":"2024-05-08T18:31:08.318181+0000","last_became_peered":"2024-05-08T18:31:08.318181+0000","last_unstale":"2024-05-08T18:35:13.715294+0000","last_undegraded":"2024-05-08T18:35:13.715294+0000","last_fullsized":"2024-05-08T18:35:13.715294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:35:13.715142+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:35:13.715142+0000","last_clean_scrub_stamp":"2024-05-08T18:35:13.715142+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:53.656049+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'12","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:57.319658+0000","last_change":"2024-05-08T18:34:57.319658+0000","last_active":"2024-05-08T18:34:57.319658+0000","last_peered":"2024-05-08T18:34:57.319658+0000","last_clean":"2024-05-08T18:34:57.319658+0000","last_became_active":"2024-05-08T18:31:00.296160+0000","last_became_peered":"2024-05-08T18:31:00.296160+0000","last_unstale":"2024-05-08T18:34:57.319658+0000","last_undegraded":"2024-05-08T18:34:57.319658+0000","last_fullsized":"2024-05-08T18:34:57.319658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:57.319548+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:57.319548+0000","last_clean_scrub_stamp":"2024-05-08T18:34:57.319548+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:19.261625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:09.370064+0000","last_change":"2024-05-08T18:35:09.370064+0000","last_active":"2024-05-08T18:35:09.370064+0000","last_peered":"2024-05-08T18:35:09.370064+0000","last_clean":"2024-05-08T18:35:09.370064+0000","last_became_active":"2024-05-08T18:30:58.315246+0000","last_became_peered":"2024-05-08T18:30:58.315246+0000","last_unstale":"2024-05-08T18:35:09.370064+0000","last_undegraded":"2024-05-08T18:35:09.370064+0000","last_fullsized":"2024-05-08T18:35:09.370064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:09.369913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:09.369913+0000","last_clean_scrub_stamp":"2024-05-08T18:35:09.369913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:01.660528+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.660113+0000","last_change":"2024-05-08T18:34:23.660113+0000","last_active":"2024-05-08T18:34:23.660113+0000","last_peered":"2024-05-08T18:34:23.660113+0000","last_clean":"2024-05-08T18:34:23.660113+0000","last_became_active":"2024-05-08T18:31:02.290465+0000","last_became_peered":"2024-05-08T18:31:02.290465+0000","last_unstale":"2024-05-08T18:34:23.660113+0000","last_undegraded":"2024-05-08T18:34:23.660113+0000","last_fullsized":"2024-05-08T18:34:23.660113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:23.659943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:23.659943+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.659943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:25.967513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'36","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:43.420702+0000","last_change":"2024-05-08T18:34:43.420702+0000","last_active":"2024-05-08T18:34:43.420702+0000","last_peered":"2024-05-08T18:34:43.420702+0000","last_clean":"2024-05-08T18:34:43.420702+0000","last_became_active":"2024-05-08T18:31:04.303815+0000","last_became_peered":"2024-05-08T18:31:04.303815+0000","last_unstale":"2024-05-08T18:34:43.420702+0000","last_undegraded":"2024-05-08T18:34:43.420702+0000","last_fullsized":"2024-05-08T18:34:43.420702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:43.420568+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:43.420568+0000","last_clean_scrub_stamp":"2024-05-08T18:34:43.420568+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:05.585424+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.889148+0000","last_change":"2024-05-08T18:34:24.889148+0000","last_active":"2024-05-08T18:34:24.889148+0000","last_peered":"2024-05-08T18:34:24.889148+0000","last_clean":"2024-05-08T18:34:24.889148+0000","last_became_active":"2024-05-08T18:31:06.310555+0000","last_became_peered":"2024-05-08T18:31:06.310555+0000","last_unstale":"2024-05-08T18:34:24.889148+0000","last_undegraded":"2024-05-08T18:34:24.889148+0000","last_fullsized":"2024-05-08T18:34:24.889148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:24.889019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:24.889019+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.889019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:06.963972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:15.643198+0000","last_change":"2024-05-08T18:35:15.643198+0000","last_active":"2024-05-08T18:35:15.643198+0000","last_peered":"2024-05-08T18:35:15.643198+0000","last_clean":"2024-05-08T18:35:15.643198+0000","last_became_active":"2024-05-08T18:31:08.319009+0000","last_became_peered":"2024-05-08T18:31:08.319009+0000","last_unstale":"2024-05-08T18:35:15.643198+0000","last_undegraded":"2024-05-08T18:35:15.643198+0000","last_fullsized":"2024-05-08T18:35:15.643198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T18:35:15.643079+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T18:35:15.643079+0000","last_clean_scrub_stamp":"2024-05-08T18:35:15.643079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:20:35.673819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:39.555368+0000","last_change":"2024-05-08T18:34:39.555368+0000","last_active":"2024-05-08T18:34:39.555368+0000","last_peered":"2024-05-08T18:34:39.555368+0000","last_clean":"2024-05-08T18:34:39.555368+0000","last_became_active":"2024-05-08T18:31:00.297497+0000","last_became_peered":"2024-05-08T18:31:00.297497+0000","last_unstale":"2024-05-08T18:34:39.555368+0000","last_undegraded":"2024-05-08T18:34:39.555368+0000","last_fullsized":"2024-05-08T18:34:39.555368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:34:39.555243+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:34:39.555243+0000","last_clean_scrub_stamp":"2024-05-08T18:34:39.555243+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:16.257470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:00.889004+0000","last_change":"2024-05-08T18:35:00.889004+0000","last_active":"2024-05-08T18:35:00.889004+0000","last_peered":"2024-05-08T18:35:00.889004+0000","last_clean":"2024-05-08T18:35:00.889004+0000","last_became_active":"2024-05-08T18:30:58.299649+0000","last_became_peered":"2024-05-08T18:30:58.299649+0000","last_unstale":"2024-05-08T18:35:00.889004+0000","last_undegraded":"2024-05-08T18:35:00.889004+0000","last_fullsized":"2024-05-08T18:35:00.889004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:00.888891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:00.888891+0000","last_clean_scrub_stamp":"2024-05-08T18:35:00.888891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:32.791953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"29'2","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:35.582330+0000","last_change":"2024-05-08T18:34:35.582330+0000","last_active":"2024-05-08T18:34:35.582330+0000","last_peered":"2024-05-08T18:34:35.582330+0000","last_clean":"2024-05-08T18:34:35.582330+0000","last_became_active":"2024-05-08T18:31:02.293993+0000","last_became_peered":"2024-05-08T18:31:02.293993+0000","last_unstale":"2024-05-08T18:34:35.582330+0000","last_undegraded":"2024-05-08T18:34:35.582330+0000","last_fullsized":"2024-05-08T18:34:35.582330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:35.582207+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:35.582207+0000","last_clean_scrub_stamp":"2024-05-08T18:34:35.582207+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:12.476691+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.907510+0000","last_change":"2024-05-08T18:34:23.907510+0000","last_active":"2024-05-08T18:34:23.907510+0000","last_peered":"2024-05-08T18:34:23.907510+0000","last_clean":"2024-05-08T18:34:23.907510+0000","last_became_active":"2024-05-08T18:31:04.300059+0000","last_became_peered":"2024-05-08T18:31:04.300059+0000","last_unstale":"2024-05-08T18:34:23.907510+0000","last_undegraded":"2024-05-08T18:34:23.907510+0000","last_fullsized":"2024-05-08T18:34:23.907510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:23.907379+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:23.907379+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.907379+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:16.891137+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.722108+0000","last_change":"2024-05-08T18:34:32.722108+0000","last_active":"2024-05-08T18:34:32.722108+0000","last_peered":"2024-05-08T18:34:32.722108+0000","last_clean":"2024-05-08T18:34:32.722108+0000","last_became_active":"2024-05-08T18:31:06.312651+0000","last_became_peered":"2024-05-08T18:31:06.312651+0000","last_unstale":"2024-05-08T18:34:32.722108+0000","last_undegraded":"2024-05-08T18:34:32.722108+0000","last_fullsized":"2024-05-08T18:34:32.722108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:32.721992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:32.721992+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.721992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:27.698590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:45.631065+0000","last_change":"2024-05-08T18:34:45.631098+0000","last_active":"2024-05-08T18:34:45.631065+0000","last_peered":"2024-05-08T18:34:45.631065+0000","last_clean":"2024-05-08T18:34:45.631065+0000","last_became_active":"2024-05-08T18:31:08.311048+0000","last_became_peered":"2024-05-08T18:31:08.311048+0000","last_unstale":"2024-05-08T18:34:45.631065+0000","last_undegraded":"2024-05-08T18:34:45.631065+0000","last_fullsized":"2024-05-08T18:34:45.631065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:45.630966+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:45.630966+0000","last_clean_scrub_stamp":"2024-05-08T18:34:45.630966+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:57.506022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:56.366442+0000","last_change":"2024-05-08T18:34:56.366442+0000","last_active":"2024-05-08T18:34:56.366442+0000","last_peered":"2024-05-08T18:34:56.366442+0000","last_clean":"2024-05-08T18:34:56.366442+0000","last_became_active":"2024-05-08T18:31:00.296176+0000","last_became_peered":"2024-05-08T18:31:00.296176+0000","last_unstale":"2024-05-08T18:34:56.366442+0000","last_undegraded":"2024-05-08T18:34:56.366442+0000","last_fullsized":"2024-05-08T18:34:56.366442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:56.366327+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:56.366327+0000","last_clean_scrub_stamp":"2024-05-08T18:34:56.366327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:16.210517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:13.324198+0000","last_change":"2024-05-08T18:35:13.324198+0000","last_active":"2024-05-08T18:35:13.324198+0000","last_peered":"2024-05-08T18:35:13.324198+0000","last_clean":"2024-05-08T18:35:13.324198+0000","last_became_active":"2024-05-08T18:30:58.309339+0000","last_became_peered":"2024-05-08T18:30:58.309339+0000","last_unstale":"2024-05-08T18:35:13.324198+0000","last_undegraded":"2024-05-08T18:35:13.324198+0000","last_fullsized":"2024-05-08T18:35:13.324198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:13.324078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:13.324078+0000","last_clean_scrub_stamp":"2024-05-08T18:35:13.324078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:41.496180+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:10.919269+0000","last_change":"2024-05-08T18:35:10.919291+0000","last_active":"2024-05-08T18:35:10.919269+0000","last_peered":"2024-05-08T18:35:10.919269+0000","last_clean":"2024-05-08T18:35:10.919269+0000","last_became_active":"2024-05-08T18:31:45.335489+0000","last_became_peered":"2024-05-08T18:31:45.335489+0000","last_unstale":"2024-05-08T18:35:10.919269+0000","last_undegraded":"2024-05-08T18:35:10.919269+0000","last_fullsized":"2024-05-08T18:35:10.919269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:10.919188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:10.919188+0000","last_clean_scrub_stamp":"2024-05-08T18:35:10.919188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:39.522232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'16","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.718370+0000","last_change":"2024-05-08T18:34:29.718370+0000","last_active":"2024-05-08T18:34:29.718370+0000","last_peered":"2024-05-08T18:34:29.718370+0000","last_clean":"2024-05-08T18:34:29.718370+0000","last_became_active":"2024-05-08T18:31:04.300022+0000","last_became_peered":"2024-05-08T18:31:04.300022+0000","last_unstale":"2024-05-08T18:34:29.718370+0000","last_undegraded":"2024-05-08T18:34:29.718370+0000","last_fullsized":"2024-05-08T18:34:29.718370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T18:34:29.718201+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T18:34:29.718201+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.718201+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:19.939460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'285","reported_seq":403,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:40.541202+0000","last_change":"2024-05-08T18:34:40.541202+0000","last_active":"2024-05-08T18:34:40.541202+0000","last_peered":"2024-05-08T18:34:40.541202+0000","last_clean":"2024-05-08T18:34:40.541202+0000","last_became_active":"2024-05-08T18:31:06.306886+0000","last_became_peered":"2024-05-08T18:31:06.306886+0000","last_unstale":"2024-05-08T18:34:40.541202+0000","last_undegraded":"2024-05-08T18:34:40.541202+0000","last_fullsized":"2024-05-08T18:34:40.541202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:40.541078+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:40.541078+0000","last_clean_scrub_stamp":"2024-05-08T18:34:40.541078+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:11:57.055230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:08.958587+0000","last_change":"2024-05-08T18:35:08.958615+0000","last_active":"2024-05-08T18:35:08.958587+0000","last_peered":"2024-05-08T18:35:08.958587+0000","last_clean":"2024-05-08T18:35:08.958587+0000","last_became_active":"2024-05-08T18:31:08.311780+0000","last_became_peered":"2024-05-08T18:31:08.311780+0000","last_unstale":"2024-05-08T18:35:08.958587+0000","last_undegraded":"2024-05-08T18:35:08.958587+0000","last_fullsized":"2024-05-08T18:35:08.958587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:08.958503+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:08.958503+0000","last_clean_scrub_stamp":"2024-05-08T18:35:08.958503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:45.660730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:47.606735+0000","last_change":"2024-05-08T18:34:47.606735+0000","last_active":"2024-05-08T18:34:47.606735+0000","last_peered":"2024-05-08T18:34:47.606735+0000","last_clean":"2024-05-08T18:34:47.606735+0000","last_became_active":"2024-05-08T18:31:00.281268+0000","last_became_peered":"2024-05-08T18:31:00.281268+0000","last_unstale":"2024-05-08T18:34:47.606735+0000","last_undegraded":"2024-05-08T18:34:47.606735+0000","last_fullsized":"2024-05-08T18:34:47.606735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:34:47.606608+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:34:47.606608+0000","last_clean_scrub_stamp":"2024-05-08T18:34:47.606608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:22:11.586979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:51.636616+0000","last_change":"2024-05-08T18:34:51.636616+0000","last_active":"2024-05-08T18:34:51.636616+0000","last_peered":"2024-05-08T18:34:51.636616+0000","last_clean":"2024-05-08T18:34:51.636616+0000","last_became_active":"2024-05-08T18:30:58.303428+0000","last_became_peered":"2024-05-08T18:30:58.303428+0000","last_unstale":"2024-05-08T18:34:51.636616+0000","last_undegraded":"2024-05-08T18:34:51.636616+0000","last_fullsized":"2024-05-08T18:34:51.636616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:51.636503+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:51.636503+0000","last_clean_scrub_stamp":"2024-05-08T18:34:51.636503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:33.197546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.686287+0000","last_change":"2024-05-08T18:34:20.686287+0000","last_active":"2024-05-08T18:34:20.686287+0000","last_peered":"2024-05-08T18:34:20.686287+0000","last_clean":"2024-05-08T18:34:20.686287+0000","last_became_active":"2024-05-08T18:31:02.291729+0000","last_became_peered":"2024-05-08T18:31:02.291729+0000","last_unstale":"2024-05-08T18:34:20.686287+0000","last_undegraded":"2024-05-08T18:34:20.686287+0000","last_fullsized":"2024-05-08T18:34:20.686287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:20.686141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:20.686141+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.686141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:15.450176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'36","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.681329+0000","last_change":"2024-05-08T18:34:25.681329+0000","last_active":"2024-05-08T18:34:25.681329+0000","last_peered":"2024-05-08T18:34:25.681329+0000","last_clean":"2024-05-08T18:34:25.681329+0000","last_became_active":"2024-05-08T18:31:04.304347+0000","last_became_peered":"2024-05-08T18:31:04.304347+0000","last_unstale":"2024-05-08T18:34:25.681329+0000","last_undegraded":"2024-05-08T18:34:25.681329+0000","last_fullsized":"2024-05-08T18:34:25.681329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:25.681197+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:25.681197+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.681197+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:06.403836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":414,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.709806+0000","last_change":"2024-05-08T18:34:22.709806+0000","last_active":"2024-05-08T18:34:22.709806+0000","last_peered":"2024-05-08T18:34:22.709806+0000","last_clean":"2024-05-08T18:34:22.709806+0000","last_became_active":"2024-05-08T18:31:06.305591+0000","last_became_peered":"2024-05-08T18:31:06.305591+0000","last_unstale":"2024-05-08T18:34:22.709806+0000","last_undegraded":"2024-05-08T18:34:22.709806+0000","last_fullsized":"2024-05-08T18:34:22.709806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:22.709682+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:22.709682+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.709682+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:04.769028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'10","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:05.305632+0000","last_change":"2024-05-08T18:35:05.305632+0000","last_active":"2024-05-08T18:35:05.305632+0000","last_peered":"2024-05-08T18:35:05.305632+0000","last_clean":"2024-05-08T18:35:05.305632+0000","last_became_active":"2024-05-08T18:31:00.290824+0000","last_became_peered":"2024-05-08T18:31:00.290824+0000","last_unstale":"2024-05-08T18:35:05.305632+0000","last_undegraded":"2024-05-08T18:35:05.305632+0000","last_fullsized":"2024-05-08T18:35:05.305632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:35:05.305518+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:35:05.305518+0000","last_clean_scrub_stamp":"2024-05-08T18:35:05.305518+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:25.824273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:01.846057+0000","last_change":"2024-05-08T18:35:01.846057+0000","last_active":"2024-05-08T18:35:01.846057+0000","last_peered":"2024-05-08T18:35:01.846057+0000","last_clean":"2024-05-08T18:35:01.846057+0000","last_became_active":"2024-05-08T18:30:58.300884+0000","last_became_peered":"2024-05-08T18:30:58.300884+0000","last_unstale":"2024-05-08T18:35:01.846057+0000","last_undegraded":"2024-05-08T18:35:01.846057+0000","last_fullsized":"2024-05-08T18:35:01.846057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:01.845907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:01.845907+0000","last_clean_scrub_stamp":"2024-05-08T18:35:01.845907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:08.467397+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.781989+0000","last_change":"2024-05-08T18:34:29.781989+0000","last_active":"2024-05-08T18:34:29.781989+0000","last_peered":"2024-05-08T18:34:29.781989+0000","last_clean":"2024-05-08T18:34:29.781989+0000","last_became_active":"2024-05-08T18:31:02.291536+0000","last_became_peered":"2024-05-08T18:31:02.291536+0000","last_unstale":"2024-05-08T18:34:29.781989+0000","last_undegraded":"2024-05-08T18:34:29.781989+0000","last_fullsized":"2024-05-08T18:34:29.781989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:29.781874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:29.781874+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.781874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:12.430820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'52","reported_seq":113,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.726388+0000","last_change":"2024-05-08T18:34:27.726388+0000","last_active":"2024-05-08T18:34:27.726388+0000","last_peered":"2024-05-08T18:34:27.726388+0000","last_clean":"2024-05-08T18:34:27.726388+0000","last_became_active":"2024-05-08T18:31:04.302455+0000","last_became_peered":"2024-05-08T18:31:04.302455+0000","last_unstale":"2024-05-08T18:34:27.726388+0000","last_undegraded":"2024-05-08T18:34:27.726388+0000","last_fullsized":"2024-05-08T18:34:27.726388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'52","last_scrub_stamp":"2024-05-08T18:34:27.726254+0000","last_deep_scrub":"29'52","last_deep_scrub_stamp":"2024-05-08T18:34:27.726254+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.726254+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:57.760805+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.615646+0000","last_change":"2024-05-08T18:34:24.615646+0000","last_active":"2024-05-08T18:34:24.615646+0000","last_peered":"2024-05-08T18:34:24.615646+0000","last_clean":"2024-05-08T18:34:24.615646+0000","last_became_active":"2024-05-08T18:31:06.304979+0000","last_became_peered":"2024-05-08T18:31:06.304979+0000","last_unstale":"2024-05-08T18:34:24.615646+0000","last_undegraded":"2024-05-08T18:34:24.615646+0000","last_fullsized":"2024-05-08T18:34:24.615646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:24.615505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:24.615505+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.615505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:06.690459+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:07.918347+0000","last_change":"2024-05-08T18:35:07.918347+0000","last_active":"2024-05-08T18:35:07.918347+0000","last_peered":"2024-05-08T18:35:07.918347+0000","last_clean":"2024-05-08T18:35:07.918347+0000","last_became_active":"2024-05-08T18:31:08.311434+0000","last_became_peered":"2024-05-08T18:31:08.311434+0000","last_unstale":"2024-05-08T18:35:07.918347+0000","last_undegraded":"2024-05-08T18:35:07.918347+0000","last_fullsized":"2024-05-08T18:35:07.918347+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T18:35:07.918233+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T18:35:07.918233+0000","last_clean_scrub_stamp":"2024-05-08T18:35:07.918233+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:20.603001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:49.625755+0000","last_change":"2024-05-08T18:34:49.625755+0000","last_active":"2024-05-08T18:34:49.625755+0000","last_peered":"2024-05-08T18:34:49.625755+0000","last_clean":"2024-05-08T18:34:49.625755+0000","last_became_active":"2024-05-08T18:31:00.280969+0000","last_became_peered":"2024-05-08T18:31:00.280969+0000","last_unstale":"2024-05-08T18:34:49.625755+0000","last_undegraded":"2024-05-08T18:34:49.625755+0000","last_fullsized":"2024-05-08T18:34:49.625755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:49.625593+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:49.625593+0000","last_clean_scrub_stamp":"2024-05-08T18:34:49.625593+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:50.500448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:04.885607+0000","last_change":"2024-05-08T18:35:04.885607+0000","last_active":"2024-05-08T18:35:04.885607+0000","last_peered":"2024-05-08T18:35:04.885607+0000","last_clean":"2024-05-08T18:35:04.885607+0000","last_became_active":"2024-05-08T18:30:58.302590+0000","last_became_peered":"2024-05-08T18:30:58.302590+0000","last_unstale":"2024-05-08T18:35:04.885607+0000","last_undegraded":"2024-05-08T18:35:04.885607+0000","last_fullsized":"2024-05-08T18:35:04.885607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:04.885481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:04.885481+0000","last_clean_scrub_stamp":"2024-05-08T18:35:04.885481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:41.364341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:42.569395+0000","last_change":"2024-05-08T18:34:42.569395+0000","last_active":"2024-05-08T18:34:42.569395+0000","last_peered":"2024-05-08T18:34:42.569395+0000","last_clean":"2024-05-08T18:34:42.569395+0000","last_became_active":"2024-05-08T18:31:02.289394+0000","last_became_peered":"2024-05-08T18:31:02.289394+0000","last_unstale":"2024-05-08T18:34:42.569395+0000","last_undegraded":"2024-05-08T18:34:42.569395+0000","last_fullsized":"2024-05-08T18:34:42.569395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:42.569274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:42.569274+0000","last_clean_scrub_stamp":"2024-05-08T18:34:42.569274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:44.876844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'38","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:45.367013+0000","last_change":"2024-05-08T18:34:45.367013+0000","last_active":"2024-05-08T18:34:45.367013+0000","last_peered":"2024-05-08T18:34:45.367013+0000","last_clean":"2024-05-08T18:34:45.367013+0000","last_became_active":"2024-05-08T18:31:04.302886+0000","last_became_peered":"2024-05-08T18:31:04.302886+0000","last_unstale":"2024-05-08T18:34:45.367013+0000","last_undegraded":"2024-05-08T18:34:45.367013+0000","last_fullsized":"2024-05-08T18:34:45.367013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-08T18:34:45.366871+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-08T18:34:45.366871+0000","last_clean_scrub_stamp":"2024-05-08T18:34:45.366871+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:13.940428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.644132+0000","last_change":"2024-05-08T18:34:19.644132+0000","last_active":"2024-05-08T18:34:19.644132+0000","last_peered":"2024-05-08T18:34:19.644132+0000","last_clean":"2024-05-08T18:34:19.644132+0000","last_became_active":"2024-05-08T18:31:06.306607+0000","last_became_peered":"2024-05-08T18:31:06.306607+0000","last_unstale":"2024-05-08T18:34:19.644132+0000","last_undegraded":"2024-05-08T18:34:19.644132+0000","last_fullsized":"2024-05-08T18:34:19.644132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:19.644005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:19.644005+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.644005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:04:00.192002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:36.713780+0000","last_change":"2024-05-08T18:34:36.713780+0000","last_active":"2024-05-08T18:34:36.713780+0000","last_peered":"2024-05-08T18:34:36.713780+0000","last_clean":"2024-05-08T18:34:36.713780+0000","last_became_active":"2024-05-08T18:31:08.305127+0000","last_became_peered":"2024-05-08T18:31:08.305127+0000","last_unstale":"2024-05-08T18:34:36.713780+0000","last_undegraded":"2024-05-08T18:34:36.713780+0000","last_fullsized":"2024-05-08T18:34:36.713780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:36.713654+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:36.713654+0000","last_clean_scrub_stamp":"2024-05-08T18:34:36.713654+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:58.222971+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:52.890746+0000","last_change":"2024-05-08T18:34:52.890746+0000","last_active":"2024-05-08T18:34:52.890746+0000","last_peered":"2024-05-08T18:34:52.890746+0000","last_clean":"2024-05-08T18:34:52.890746+0000","last_became_active":"2024-05-08T18:31:00.293170+0000","last_became_peered":"2024-05-08T18:31:00.293170+0000","last_unstale":"2024-05-08T18:34:52.890746+0000","last_undegraded":"2024-05-08T18:34:52.890746+0000","last_fullsized":"2024-05-08T18:34:52.890746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:52.890630+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:52.890630+0000","last_clean_scrub_stamp":"2024-05-08T18:34:52.890630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:55.198199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:18.378697+0000","last_change":"2024-05-08T18:35:18.378697+0000","last_active":"2024-05-08T18:35:18.378697+0000","last_peered":"2024-05-08T18:35:18.378697+0000","last_clean":"2024-05-08T18:35:18.378697+0000","last_became_active":"2024-05-08T18:30:58.314352+0000","last_became_peered":"2024-05-08T18:30:58.314352+0000","last_unstale":"2024-05-08T18:35:18.378697+0000","last_undegraded":"2024-05-08T18:35:18.378697+0000","last_fullsized":"2024-05-08T18:35:18.378697+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:18.378578+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:18.378578+0000","last_clean_scrub_stamp":"2024-05-08T18:35:18.378578+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:17.371008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:11.876148+0000","last_change":"2024-05-08T18:35:11.876173+0000","last_active":"2024-05-08T18:35:11.876148+0000","last_peered":"2024-05-08T18:35:11.876148+0000","last_clean":"2024-05-08T18:35:11.876148+0000","last_became_active":"2024-05-08T18:31:45.339423+0000","last_became_peered":"2024-05-08T18:31:45.339423+0000","last_unstale":"2024-05-08T18:35:11.876148+0000","last_undegraded":"2024-05-08T18:35:11.876148+0000","last_fullsized":"2024-05-08T18:35:11.876148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:11.876047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:11.876047+0000","last_clean_scrub_stamp":"2024-05-08T18:35:11.876047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:49.524641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'45","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.606003+0000","last_change":"2024-05-08T18:34:32.606003+0000","last_active":"2024-05-08T18:34:32.606003+0000","last_peered":"2024-05-08T18:34:32.606003+0000","last_clean":"2024-05-08T18:34:32.606003+0000","last_became_active":"2024-05-08T18:31:04.298026+0000","last_became_peered":"2024-05-08T18:31:04.298026+0000","last_unstale":"2024-05-08T18:34:32.606003+0000","last_undegraded":"2024-05-08T18:34:32.606003+0000","last_fullsized":"2024-05-08T18:34:32.606003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T18:34:32.605858+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T18:34:32.605858+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.605858+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:39.227348+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":367,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.673057+0000","last_change":"2024-05-08T18:34:18.673057+0000","last_active":"2024-05-08T18:34:18.673057+0000","last_peered":"2024-05-08T18:34:18.673057+0000","last_clean":"2024-05-08T18:34:18.673057+0000","last_became_active":"2024-05-08T18:31:06.306655+0000","last_became_peered":"2024-05-08T18:31:06.306655+0000","last_unstale":"2024-05-08T18:34:18.673057+0000","last_undegraded":"2024-05-08T18:34:18.673057+0000","last_fullsized":"2024-05-08T18:34:18.673057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:18.672962+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:18.672962+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.672962+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:15.669294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:15.786893+0000","last_change":"2024-05-08T18:35:15.786893+0000","last_active":"2024-05-08T18:35:15.786893+0000","last_peered":"2024-05-08T18:35:15.786893+0000","last_clean":"2024-05-08T18:35:15.786893+0000","last_became_active":"2024-05-08T18:31:08.314273+0000","last_became_peered":"2024-05-08T18:31:08.314273+0000","last_unstale":"2024-05-08T18:35:15.786893+0000","last_undegraded":"2024-05-08T18:35:15.786893+0000","last_fullsized":"2024-05-08T18:35:15.786893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:15.786775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:15.786775+0000","last_clean_scrub_stamp":"2024-05-08T18:35:15.786775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:35.385759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:44.889203+0000","last_change":"2024-05-08T18:34:44.889203+0000","last_active":"2024-05-08T18:34:44.889203+0000","last_peered":"2024-05-08T18:34:44.889203+0000","last_clean":"2024-05-08T18:34:44.889203+0000","last_became_active":"2024-05-08T18:31:00.282941+0000","last_became_peered":"2024-05-08T18:31:00.282941+0000","last_unstale":"2024-05-08T18:34:44.889203+0000","last_undegraded":"2024-05-08T18:34:44.889203+0000","last_fullsized":"2024-05-08T18:34:44.889203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:44.889056+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:44.889056+0000","last_clean_scrub_stamp":"2024-05-08T18:34:44.889056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:44:35.228659+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:26.367146+0000","last_change":"2024-05-08T18:35:26.367146+0000","last_active":"2024-05-08T18:35:26.367146+0000","last_peered":"2024-05-08T18:35:26.367146+0000","last_clean":"2024-05-08T18:35:26.367146+0000","last_became_active":"2024-05-08T18:30:58.313431+0000","last_became_peered":"2024-05-08T18:30:58.313431+0000","last_unstale":"2024-05-08T18:35:26.367146+0000","last_undegraded":"2024-05-08T18:35:26.367146+0000","last_fullsized":"2024-05-08T18:35:26.367146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:26.367020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:26.367020+0000","last_clean_scrub_stamp":"2024-05-08T18:35:26.367020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:54.052250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:40.577762+0000","last_change":"2024-05-08T18:34:40.577762+0000","last_active":"2024-05-08T18:34:40.577762+0000","last_peered":"2024-05-08T18:34:40.577762+0000","last_clean":"2024-05-08T18:34:40.577762+0000","last_became_active":"2024-05-08T18:31:02.289669+0000","last_became_peered":"2024-05-08T18:31:02.289669+0000","last_unstale":"2024-05-08T18:34:40.577762+0000","last_undegraded":"2024-05-08T18:34:40.577762+0000","last_fullsized":"2024-05-08T18:34:40.577762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:40.577639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:40.577639+0000","last_clean_scrub_stamp":"2024-05-08T18:34:40.577639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:06.519788+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'67","reported_seq":141,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:48.381040+0000","last_change":"2024-05-08T18:34:48.381040+0000","last_active":"2024-05-08T18:34:48.381040+0000","last_peered":"2024-05-08T18:34:48.381040+0000","last_clean":"2024-05-08T18:34:48.381040+0000","last_became_active":"2024-05-08T18:31:04.302244+0000","last_became_peered":"2024-05-08T18:31:04.302244+0000","last_unstale":"2024-05-08T18:34:48.381040+0000","last_undegraded":"2024-05-08T18:34:48.381040+0000","last_fullsized":"2024-05-08T18:34:48.381040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'67","last_scrub_stamp":"2024-05-08T18:34:48.380911+0000","last_deep_scrub":"29'67","last_deep_scrub_stamp":"2024-05-08T18:34:48.380911+0000","last_clean_scrub_stamp":"2024-05-08T18:34:48.380911+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:33.160250+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.686381+0000","last_change":"2024-05-08T18:34:21.686381+0000","last_active":"2024-05-08T18:34:21.686381+0000","last_peered":"2024-05-08T18:34:21.686381+0000","last_clean":"2024-05-08T18:34:21.686381+0000","last_became_active":"2024-05-08T18:31:06.308806+0000","last_became_peered":"2024-05-08T18:31:06.308806+0000","last_unstale":"2024-05-08T18:34:21.686381+0000","last_undegraded":"2024-05-08T18:34:21.686381+0000","last_fullsized":"2024-05-08T18:34:21.686381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:21.686225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:21.686225+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.686225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:12.963774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'21","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:17.814168+0000","last_change":"2024-05-08T18:35:17.814168+0000","last_active":"2024-05-08T18:35:17.814168+0000","last_peered":"2024-05-08T18:35:17.814168+0000","last_clean":"2024-05-08T18:35:17.814168+0000","last_became_active":"2024-05-08T18:31:08.319370+0000","last_became_peered":"2024-05-08T18:31:08.319370+0000","last_unstale":"2024-05-08T18:35:17.814168+0000","last_undegraded":"2024-05-08T18:35:17.814168+0000","last_fullsized":"2024-05-08T18:35:17.814168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-05-08T18:35:17.814017+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-05-08T18:35:17.814017+0000","last_clean_scrub_stamp":"2024-05-08T18:35:17.814017+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:18.291246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'6","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:42.729045+0000","last_change":"2024-05-08T18:34:42.729045+0000","last_active":"2024-05-08T18:34:42.729045+0000","last_peered":"2024-05-08T18:34:42.729045+0000","last_clean":"2024-05-08T18:34:42.729045+0000","last_became_active":"2024-05-08T18:31:00.292154+0000","last_became_peered":"2024-05-08T18:31:00.292154+0000","last_unstale":"2024-05-08T18:34:42.729045+0000","last_undegraded":"2024-05-08T18:34:42.729045+0000","last_fullsized":"2024-05-08T18:34:42.729045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:42.728933+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:42.728933+0000","last_clean_scrub_stamp":"2024-05-08T18:34:42.728933+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:45.036503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:54.775346+0000","last_change":"2024-05-08T18:34:54.775346+0000","last_active":"2024-05-08T18:34:54.775346+0000","last_peered":"2024-05-08T18:34:54.775346+0000","last_clean":"2024-05-08T18:34:54.775346+0000","last_became_active":"2024-05-08T18:30:58.294377+0000","last_became_peered":"2024-05-08T18:30:58.294377+0000","last_unstale":"2024-05-08T18:34:54.775346+0000","last_undegraded":"2024-05-08T18:34:54.775346+0000","last_fullsized":"2024-05-08T18:34:54.775346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:54.775224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:54.775224+0000","last_clean_scrub_stamp":"2024-05-08T18:34:54.775224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:43:21.245618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:35.836915+0000","last_change":"2024-05-08T18:34:35.836915+0000","last_active":"2024-05-08T18:34:35.836915+0000","last_peered":"2024-05-08T18:34:35.836915+0000","last_clean":"2024-05-08T18:34:35.836915+0000","last_became_active":"2024-05-08T18:31:02.293680+0000","last_became_peered":"2024-05-08T18:31:02.293680+0000","last_unstale":"2024-05-08T18:34:35.836915+0000","last_undegraded":"2024-05-08T18:34:35.836915+0000","last_fullsized":"2024-05-08T18:34:35.836915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:35.836803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:35.836803+0000","last_clean_scrub_stamp":"2024-05-08T18:34:35.836803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:43:05.540412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'40","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.864247+0000","last_change":"2024-05-08T18:34:22.864247+0000","last_active":"2024-05-08T18:34:22.864247+0000","last_peered":"2024-05-08T18:34:22.864247+0000","last_clean":"2024-05-08T18:34:22.864247+0000","last_became_active":"2024-05-08T18:31:04.301147+0000","last_became_peered":"2024-05-08T18:31:04.301147+0000","last_unstale":"2024-05-08T18:34:22.864247+0000","last_undegraded":"2024-05-08T18:34:22.864247+0000","last_fullsized":"2024-05-08T18:34:22.864247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-08T18:34:22.864124+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-08T18:34:22.864124+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.864124+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:04.923471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:50.411290+0000","last_change":"2024-05-08T18:34:50.411290+0000","last_active":"2024-05-08T18:34:50.411290+0000","last_peered":"2024-05-08T18:34:50.411290+0000","last_clean":"2024-05-08T18:34:50.411290+0000","last_became_active":"2024-05-08T18:31:06.308804+0000","last_became_peered":"2024-05-08T18:31:06.308804+0000","last_unstale":"2024-05-08T18:34:50.411290+0000","last_undegraded":"2024-05-08T18:34:50.411290+0000","last_fullsized":"2024-05-08T18:34:50.411290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:50.411147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:50.411147+0000","last_clean_scrub_stamp":"2024-05-08T18:34:50.411147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:30.290258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'6","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:42.385382+0000","last_change":"2024-05-08T18:35:42.385414+0000","last_active":"2024-05-08T18:35:42.385382+0000","last_peered":"2024-05-08T18:35:42.385382+0000","last_clean":"2024-05-08T18:35:42.385382+0000","last_became_active":"2024-05-08T18:31:08.320150+0000","last_became_peered":"2024-05-08T18:31:08.320150+0000","last_unstale":"2024-05-08T18:35:42.385382+0000","last_undegraded":"2024-05-08T18:35:42.385382+0000","last_fullsized":"2024-05-08T18:35:42.385382+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:35:42.385295+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:35:42.385295+0000","last_clean_scrub_stamp":"2024-05-08T18:35:42.385295+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:59.356892+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'4","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.629691+0000","last_change":"2024-05-08T18:34:31.629691+0000","last_active":"2024-05-08T18:34:31.629691+0000","last_peered":"2024-05-08T18:34:31.629691+0000","last_clean":"2024-05-08T18:34:31.629691+0000","last_became_active":"2024-05-08T18:31:00.299379+0000","last_became_peered":"2024-05-08T18:31:00.299379+0000","last_unstale":"2024-05-08T18:34:31.629691+0000","last_undegraded":"2024-05-08T18:34:31.629691+0000","last_fullsized":"2024-05-08T18:34:31.629691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:31.629577+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:31.629577+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.629577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:03.532639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:24.442872+0000","last_change":"2024-05-08T18:35:24.442909+0000","last_active":"2024-05-08T18:35:24.442872+0000","last_peered":"2024-05-08T18:35:24.442872+0000","last_clean":"2024-05-08T18:35:24.442872+0000","last_became_active":"2024-05-08T18:30:58.315625+0000","last_became_peered":"2024-05-08T18:30:58.315625+0000","last_unstale":"2024-05-08T18:35:24.442872+0000","last_undegraded":"2024-05-08T18:35:24.442872+0000","last_fullsized":"2024-05-08T18:35:24.442872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:24.442772+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:24.442772+0000","last_clean_scrub_stamp":"2024-05-08T18:35:24.442772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:56.207323+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:39.588620+0000","last_change":"2024-05-08T18:34:39.588620+0000","last_active":"2024-05-08T18:34:39.588620+0000","last_peered":"2024-05-08T18:34:39.588620+0000","last_clean":"2024-05-08T18:34:39.588620+0000","last_became_active":"2024-05-08T18:31:02.289767+0000","last_became_peered":"2024-05-08T18:31:02.289767+0000","last_unstale":"2024-05-08T18:34:39.588620+0000","last_undegraded":"2024-05-08T18:34:39.588620+0000","last_fullsized":"2024-05-08T18:34:39.588620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:39.588473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:39.588473+0000","last_clean_scrub_stamp":"2024-05-08T18:34:39.588473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:21.718736+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.740604+0000","last_change":"2024-05-08T18:34:31.740604+0000","last_active":"2024-05-08T18:34:31.740604+0000","last_peered":"2024-05-08T18:34:31.740604+0000","last_clean":"2024-05-08T18:34:31.740604+0000","last_became_active":"2024-05-08T18:31:04.294573+0000","last_became_peered":"2024-05-08T18:31:04.294573+0000","last_unstale":"2024-05-08T18:34:31.740604+0000","last_undegraded":"2024-05-08T18:34:31.740604+0000","last_fullsized":"2024-05-08T18:34:31.740604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T18:34:31.740471+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T18:34:31.740471+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.740471+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:36.592489+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":443,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.729967+0000","last_change":"2024-05-08T18:34:28.729967+0000","last_active":"2024-05-08T18:34:28.729967+0000","last_peered":"2024-05-08T18:34:28.729967+0000","last_clean":"2024-05-08T18:34:28.729967+0000","last_became_active":"2024-05-08T18:31:06.312203+0000","last_became_peered":"2024-05-08T18:31:06.312203+0000","last_unstale":"2024-05-08T18:34:28.729967+0000","last_undegraded":"2024-05-08T18:34:28.729967+0000","last_fullsized":"2024-05-08T18:34:28.729967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:28.729835+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:28.729835+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.729835+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:42.916625+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'15","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:14.747872+0000","last_change":"2024-05-08T18:35:14.747872+0000","last_active":"2024-05-08T18:35:14.747872+0000","last_peered":"2024-05-08T18:35:14.747872+0000","last_clean":"2024-05-08T18:35:14.747872+0000","last_became_active":"2024-05-08T18:31:08.314171+0000","last_became_peered":"2024-05-08T18:31:08.314171+0000","last_unstale":"2024-05-08T18:35:14.747872+0000","last_undegraded":"2024-05-08T18:35:14.747872+0000","last_fullsized":"2024-05-08T18:35:14.747872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T18:35:14.747755+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T18:35:14.747755+0000","last_clean_scrub_stamp":"2024-05-08T18:35:14.747755+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:20:34.778495+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:50.816833+0000","last_change":"2024-05-08T18:34:50.816833+0000","last_active":"2024-05-08T18:34:50.816833+0000","last_peered":"2024-05-08T18:34:50.816833+0000","last_clean":"2024-05-08T18:34:50.816833+0000","last_became_active":"2024-05-08T18:31:00.292521+0000","last_became_peered":"2024-05-08T18:31:00.292521+0000","last_unstale":"2024-05-08T18:34:50.816833+0000","last_undegraded":"2024-05-08T18:34:50.816833+0000","last_fullsized":"2024-05-08T18:34:50.816833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:50.816688+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:50.816688+0000","last_clean_scrub_stamp":"2024-05-08T18:34:50.816688+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:09.188418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:12.318580+0000","last_change":"2024-05-08T18:35:12.318580+0000","last_active":"2024-05-08T18:35:12.318580+0000","last_peered":"2024-05-08T18:35:12.318580+0000","last_clean":"2024-05-08T18:35:12.318580+0000","last_became_active":"2024-05-08T18:30:58.309773+0000","last_became_peered":"2024-05-08T18:30:58.309773+0000","last_unstale":"2024-05-08T18:35:12.318580+0000","last_undegraded":"2024-05-08T18:35:12.318580+0000","last_fullsized":"2024-05-08T18:35:12.318580+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:12.318456+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:12.318456+0000","last_clean_scrub_stamp":"2024-05-08T18:35:12.318456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:58:49.908816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'5","reported_seq":429,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.729420+0000","last_change":"2024-05-08T18:34:31.729420+0000","last_active":"2024-05-08T18:34:31.729420+0000","last_peered":"2024-05-08T18:34:31.729420+0000","last_clean":"2024-05-08T18:34:31.729420+0000","last_became_active":"2024-05-08T18:31:02.289253+0000","last_became_peered":"2024-05-08T18:31:02.289253+0000","last_unstale":"2024-05-08T18:34:31.729420+0000","last_undegraded":"2024-05-08T18:34:31.729420+0000","last_fullsized":"2024-05-08T18:34:31.729420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T18:34:31.729298+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T18:34:31.729298+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.729298+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:22.601345+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:44.374141+0000","last_change":"2024-05-08T18:34:44.374141+0000","last_active":"2024-05-08T18:34:44.374141+0000","last_peered":"2024-05-08T18:34:44.374141+0000","last_clean":"2024-05-08T18:34:44.374141+0000","last_became_active":"2024-05-08T18:31:04.303799+0000","last_became_peered":"2024-05-08T18:31:04.303799+0000","last_unstale":"2024-05-08T18:34:44.374141+0000","last_undegraded":"2024-05-08T18:34:44.374141+0000","last_fullsized":"2024-05-08T18:34:44.374141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T18:34:44.374025+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T18:34:44.374025+0000","last_clean_scrub_stamp":"2024-05-08T18:34:44.374025+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:13:06.326093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":472,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.900106+0000","last_change":"2024-05-08T18:34:18.900106+0000","last_active":"2024-05-08T18:34:18.900106+0000","last_peered":"2024-05-08T18:34:18.900106+0000","last_clean":"2024-05-08T18:34:18.900106+0000","last_became_active":"2024-05-08T18:31:06.305201+0000","last_became_peered":"2024-05-08T18:31:06.305201+0000","last_unstale":"2024-05-08T18:34:18.900106+0000","last_undegraded":"2024-05-08T18:34:18.900106+0000","last_fullsized":"2024-05-08T18:34:18.900106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:18.899957+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:18.899957+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.899957+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:33.086747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:40.831088+0000","last_change":"2024-05-08T18:34:40.831088+0000","last_active":"2024-05-08T18:34:40.831088+0000","last_peered":"2024-05-08T18:34:40.831088+0000","last_clean":"2024-05-08T18:34:40.831088+0000","last_became_active":"2024-05-08T18:31:08.310906+0000","last_became_peered":"2024-05-08T18:31:08.310906+0000","last_unstale":"2024-05-08T18:34:40.831088+0000","last_undegraded":"2024-05-08T18:34:40.831088+0000","last_fullsized":"2024-05-08T18:34:40.831088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:40.830900+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:40.830900+0000","last_clean_scrub_stamp":"2024-05-08T18:34:40.830900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:40.154817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'14","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:43.689169+0000","last_change":"2024-05-08T18:34:43.689169+0000","last_active":"2024-05-08T18:34:43.689169+0000","last_peered":"2024-05-08T18:34:43.689169+0000","last_clean":"2024-05-08T18:34:43.689169+0000","last_became_active":"2024-05-08T18:31:00.291563+0000","last_became_peered":"2024-05-08T18:31:00.291563+0000","last_unstale":"2024-05-08T18:34:43.689169+0000","last_undegraded":"2024-05-08T18:34:43.689169+0000","last_fullsized":"2024-05-08T18:34:43.689169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-08T18:34:43.689041+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-08T18:34:43.689041+0000","last_clean_scrub_stamp":"2024-05-08T18:34:43.689041+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:40.499135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:34.533529+0000","last_change":"2024-05-08T18:35:34.533565+0000","last_active":"2024-05-08T18:35:34.533529+0000","last_peered":"2024-05-08T18:35:34.533529+0000","last_clean":"2024-05-08T18:35:34.533529+0000","last_became_active":"2024-05-08T18:30:58.302966+0000","last_became_peered":"2024-05-08T18:30:58.302966+0000","last_unstale":"2024-05-08T18:35:34.533529+0000","last_undegraded":"2024-05-08T18:35:34.533529+0000","last_fullsized":"2024-05-08T18:35:34.533529+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:34.533436+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:34.533436+0000","last_clean_scrub_stamp":"2024-05-08T18:35:34.533436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:39:52.819658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.676588+0000","last_change":"2024-05-08T18:34:28.676588+0000","last_active":"2024-05-08T18:34:28.676588+0000","last_peered":"2024-05-08T18:34:28.676588+0000","last_clean":"2024-05-08T18:34:28.676588+0000","last_became_active":"2024-05-08T18:31:02.288232+0000","last_became_peered":"2024-05-08T18:31:02.288232+0000","last_unstale":"2024-05-08T18:34:28.676588+0000","last_undegraded":"2024-05-08T18:34:28.676588+0000","last_fullsized":"2024-05-08T18:34:28.676588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:28.676467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:28.676467+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.676467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:08.488393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'48","reported_seq":108,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.893987+0000","last_change":"2024-05-08T18:34:19.893987+0000","last_active":"2024-05-08T18:34:19.893987+0000","last_peered":"2024-05-08T18:34:19.893987+0000","last_clean":"2024-05-08T18:34:19.893987+0000","last_became_active":"2024-05-08T18:31:04.301298+0000","last_became_peered":"2024-05-08T18:31:04.301298+0000","last_unstale":"2024-05-08T18:34:19.893987+0000","last_undegraded":"2024-05-08T18:34:19.893987+0000","last_fullsized":"2024-05-08T18:34:19.893987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-05-08T18:34:19.893818+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-05-08T18:34:19.893818+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.893818+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:10.115077+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.544453+0000","last_change":"2024-05-08T18:34:18.544453+0000","last_active":"2024-05-08T18:34:18.544453+0000","last_peered":"2024-05-08T18:34:18.544453+0000","last_clean":"2024-05-08T18:34:18.544453+0000","last_became_active":"2024-05-08T18:31:06.310430+0000","last_became_peered":"2024-05-08T18:31:06.310430+0000","last_unstale":"2024-05-08T18:34:18.544453+0000","last_undegraded":"2024-05-08T18:34:18.544453+0000","last_fullsized":"2024-05-08T18:34:18.544453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:18.544327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:18.544327+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.544327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:32.447203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:40.709867+0000","last_change":"2024-05-08T18:34:40.709867+0000","last_active":"2024-05-08T18:34:40.709867+0000","last_peered":"2024-05-08T18:34:40.709867+0000","last_clean":"2024-05-08T18:34:40.709867+0000","last_became_active":"2024-05-08T18:31:08.306492+0000","last_became_peered":"2024-05-08T18:31:08.306492+0000","last_unstale":"2024-05-08T18:34:40.709867+0000","last_undegraded":"2024-05-08T18:34:40.709867+0000","last_fullsized":"2024-05-08T18:34:40.709867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T18:34:40.709748+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T18:34:40.709748+0000","last_clean_scrub_stamp":"2024-05-08T18:34:40.709748+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:06.651897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'6","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:33.577031+0000","last_change":"2024-05-08T18:34:33.577031+0000","last_active":"2024-05-08T18:34:33.577031+0000","last_peered":"2024-05-08T18:34:33.577031+0000","last_clean":"2024-05-08T18:34:33.577031+0000","last_became_active":"2024-05-08T18:31:00.299186+0000","last_became_peered":"2024-05-08T18:31:00.299186+0000","last_unstale":"2024-05-08T18:34:33.577031+0000","last_undegraded":"2024-05-08T18:34:33.577031+0000","last_fullsized":"2024-05-08T18:34:33.577031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:33.576927+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:33.576927+0000","last_clean_scrub_stamp":"2024-05-08T18:34:33.576927+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:41.675591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'74","reported_seq":149,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:02.747774+0000","last_change":"2024-05-08T18:35:02.747810+0000","last_active":"2024-05-08T18:35:02.747774+0000","last_peered":"2024-05-08T18:35:02.747774+0000","last_clean":"2024-05-08T18:35:02.747774+0000","last_became_active":"2024-05-08T18:30:49.981852+0000","last_became_peered":"2024-05-08T18:30:49.981852+0000","last_unstale":"2024-05-08T18:35:02.747774+0000","last_undegraded":"2024-05-08T18:35:02.747774+0000","last_fullsized":"2024-05-08T18:35:02.747774+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'74","last_scrub_stamp":"2024-05-08T18:35:02.747676+0000","last_deep_scrub":"29'74","last_deep_scrub_stamp":"2024-05-08T18:35:02.747676+0000","last_clean_scrub_stamp":"2024-05-08T18:35:02.747676+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:50.713376+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:30.402942+0000","last_change":"2024-05-08T18:35:30.402978+0000","last_active":"2024-05-08T18:35:30.402942+0000","last_peered":"2024-05-08T18:35:30.402942+0000","last_clean":"2024-05-08T18:35:30.402942+0000","last_became_active":"2024-05-08T18:30:49.983023+0000","last_became_peered":"2024-05-08T18:30:49.983023+0000","last_unstale":"2024-05-08T18:35:30.402942+0000","last_undegraded":"2024-05-08T18:35:30.402942+0000","last_fullsized":"2024-05-08T18:35:30.402942+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:30.402808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:30.402808+0000","last_clean_scrub_stamp":"2024-05-08T18:35:30.402808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:52:50.730400+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:36.487399+0000","last_change":"2024-05-08T18:35:36.487438+0000","last_active":"2024-05-08T18:35:36.487399+0000","last_peered":"2024-05-08T18:35:36.487399+0000","last_clean":"2024-05-08T18:35:36.487399+0000","last_became_active":"2024-05-08T18:30:58.316676+0000","last_became_peered":"2024-05-08T18:30:58.316676+0000","last_unstale":"2024-05-08T18:35:36.487399+0000","last_undegraded":"2024-05-08T18:35:36.487399+0000","last_fullsized":"2024-05-08T18:35:36.487399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:36.487285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:36.487285+0000","last_clean_scrub_stamp":"2024-05-08T18:35:36.487285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:52.407321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:16.651913+0000","last_change":"2024-05-08T18:35:16.651949+0000","last_active":"2024-05-08T18:35:16.651913+0000","last_peered":"2024-05-08T18:35:16.651913+0000","last_clean":"2024-05-08T18:35:16.651913+0000","last_became_active":"2024-05-08T18:31:45.339007+0000","last_became_peered":"2024-05-08T18:31:45.339007+0000","last_unstale":"2024-05-08T18:35:16.651913+0000","last_undegraded":"2024-05-08T18:35:16.651913+0000","last_fullsized":"2024-05-08T18:35:16.651913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:16.651792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:16.651792+0000","last_clean_scrub_stamp":"2024-05-08T18:35:16.651792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:36.250777+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'87","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:38.512120+0000","last_change":"2024-05-08T18:34:38.512120+0000","last_active":"2024-05-08T18:34:38.512120+0000","last_peered":"2024-05-08T18:34:38.512120+0000","last_clean":"2024-05-08T18:34:38.512120+0000","last_became_active":"2024-05-08T18:31:04.299145+0000","last_became_peered":"2024-05-08T18:31:04.299145+0000","last_unstale":"2024-05-08T18:34:38.512120+0000","last_undegraded":"2024-05-08T18:34:38.512120+0000","last_fullsized":"2024-05-08T18:34:38.512120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-08T18:34:38.511998+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-08T18:34:38.511998+0000","last_clean_scrub_stamp":"2024-05-08T18:34:38.511998+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:35:51.196766+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:33.515836+0000","last_change":"2024-05-08T18:34:33.515836+0000","last_active":"2024-05-08T18:34:33.515836+0000","last_peered":"2024-05-08T18:34:33.515836+0000","last_clean":"2024-05-08T18:34:33.515836+0000","last_became_active":"2024-05-08T18:31:06.311742+0000","last_became_peered":"2024-05-08T18:31:06.311742+0000","last_unstale":"2024-05-08T18:34:33.515836+0000","last_undegraded":"2024-05-08T18:34:33.515836+0000","last_fullsized":"2024-05-08T18:34:33.515836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:33.515721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:33.515721+0000","last_clean_scrub_stamp":"2024-05-08T18:34:33.515721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:27.574406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'87","reported_seq":180,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:36.847497+0000","last_change":"2024-05-08T18:34:36.847497+0000","last_active":"2024-05-08T18:34:36.847497+0000","last_peered":"2024-05-08T18:34:36.847497+0000","last_clean":"2024-05-08T18:34:36.847497+0000","last_became_active":"2024-05-08T18:31:08.310715+0000","last_became_peered":"2024-05-08T18:31:08.310715+0000","last_unstale":"2024-05-08T18:34:36.847497+0000","last_undegraded":"2024-05-08T18:34:36.847497+0000","last_fullsized":"2024-05-08T18:34:36.847497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-08T18:34:36.847334+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-08T18:34:36.847334+0000","last_clean_scrub_stamp":"2024-05-08T18:34:36.847334+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:13.088821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":173,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:00.304543+0000","last_change":"2024-05-08T18:35:00.304543+0000","last_active":"2024-05-08T18:35:00.304543+0000","last_peered":"2024-05-08T18:35:00.304543+0000","last_clean":"2024-05-08T18:35:00.304543+0000","last_became_active":"2024-05-08T18:31:00.295578+0000","last_became_peered":"2024-05-08T18:31:00.295578+0000","last_unstale":"2024-05-08T18:35:00.304543+0000","last_undegraded":"2024-05-08T18:35:00.304543+0000","last_fullsized":"2024-05-08T18:35:00.304543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:35:00.304389+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:35:00.304389+0000","last_clean_scrub_stamp":"2024-05-08T18:35:00.304389+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:10.730098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:29.354156+0000","last_change":"2024-05-08T18:35:29.354180+0000","last_active":"2024-05-08T18:35:29.354156+0000","last_peered":"2024-05-08T18:35:29.354156+0000","last_clean":"2024-05-08T18:35:29.354156+0000","last_became_active":"2024-05-08T18:30:49.982854+0000","last_became_peered":"2024-05-08T18:30:49.982854+0000","last_unstale":"2024-05-08T18:35:29.354156+0000","last_undegraded":"2024-05-08T18:35:29.354156+0000","last_fullsized":"2024-05-08T18:35:29.354156+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:29.354063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:29.354063+0000","last_clean_scrub_stamp":"2024-05-08T18:35:29.354063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:54.595824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:50.687618+0000","last_change":"2024-05-08T18:34:50.687618+0000","last_active":"2024-05-08T18:34:50.687618+0000","last_peered":"2024-05-08T18:34:50.687618+0000","last_clean":"2024-05-08T18:34:50.687618+0000","last_became_active":"2024-05-08T18:30:58.294153+0000","last_became_peered":"2024-05-08T18:30:58.294153+0000","last_unstale":"2024-05-08T18:34:50.687618+0000","last_undegraded":"2024-05-08T18:34:50.687618+0000","last_fullsized":"2024-05-08T18:34:50.687618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:50.687422+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:50.687422+0000","last_clean_scrub_stamp":"2024-05-08T18:34:50.687422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:13.071573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.642347+0000","last_change":"2024-05-08T18:34:19.642347+0000","last_active":"2024-05-08T18:34:19.642347+0000","last_peered":"2024-05-08T18:34:19.642347+0000","last_clean":"2024-05-08T18:34:19.642347+0000","last_became_active":"2024-05-08T18:31:02.291979+0000","last_became_peered":"2024-05-08T18:31:02.291979+0000","last_unstale":"2024-05-08T18:34:19.642347+0000","last_undegraded":"2024-05-08T18:34:19.642347+0000","last_fullsized":"2024-05-08T18:34:19.642347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:19.642214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:19.642214+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.642214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:44.702640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'291","reported_seq":517,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.858141+0000","last_change":"2024-05-08T18:34:25.858141+0000","last_active":"2024-05-08T18:34:25.858141+0000","last_peered":"2024-05-08T18:34:25.858141+0000","last_clean":"2024-05-08T18:34:25.858141+0000","last_became_active":"2024-05-08T18:31:04.299494+0000","last_became_peered":"2024-05-08T18:31:04.299494+0000","last_unstale":"2024-05-08T18:34:25.858141+0000","last_undegraded":"2024-05-08T18:34:25.858141+0000","last_fullsized":"2024-05-08T18:34:25.858141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'291","last_scrub_stamp":"2024-05-08T18:34:25.858006+0000","last_deep_scrub":"29'291","last_deep_scrub_stamp":"2024-05-08T18:34:25.858006+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.858006+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:00.713371+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:41.505277+0000","last_change":"2024-05-08T18:34:41.505277+0000","last_active":"2024-05-08T18:34:41.505277+0000","last_peered":"2024-05-08T18:34:41.505277+0000","last_clean":"2024-05-08T18:34:41.505277+0000","last_became_active":"2024-05-08T18:31:06.306554+0000","last_became_peered":"2024-05-08T18:31:06.306554+0000","last_unstale":"2024-05-08T18:34:41.505277+0000","last_undegraded":"2024-05-08T18:34:41.505277+0000","last_fullsized":"2024-05-08T18:34:41.505277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:41.505127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:41.505127+0000","last_clean_scrub_stamp":"2024-05-08T18:34:41.505127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:29.470827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:12.700281+0000","last_change":"2024-05-08T18:35:12.700281+0000","last_active":"2024-05-08T18:35:12.700281+0000","last_peered":"2024-05-08T18:35:12.700281+0000","last_clean":"2024-05-08T18:35:12.700281+0000","last_became_active":"2024-05-08T18:31:08.316536+0000","last_became_peered":"2024-05-08T18:31:08.316536+0000","last_unstale":"2024-05-08T18:35:12.700281+0000","last_undegraded":"2024-05-08T18:35:12.700281+0000","last_fullsized":"2024-05-08T18:35:12.700281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T18:35:12.700165+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T18:35:12.700165+0000","last_clean_scrub_stamp":"2024-05-08T18:35:12.700165+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:38:06.882396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'12","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:49.663199+0000","last_change":"2024-05-08T18:34:49.663199+0000","last_active":"2024-05-08T18:34:49.663199+0000","last_peered":"2024-05-08T18:34:49.663199+0000","last_clean":"2024-05-08T18:34:49.663199+0000","last_became_active":"2024-05-08T18:31:00.281359+0000","last_became_peered":"2024-05-08T18:31:00.281359+0000","last_unstale":"2024-05-08T18:34:49.663199+0000","last_undegraded":"2024-05-08T18:34:49.663199+0000","last_fullsized":"2024-05-08T18:34:49.663199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:49.663075+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:49.663075+0000","last_clean_scrub_stamp":"2024-05-08T18:34:49.663075+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:42.088380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:58.815500+0000","last_change":"2024-05-08T18:34:58.815524+0000","last_active":"2024-05-08T18:34:58.815500+0000","last_peered":"2024-05-08T18:34:58.815500+0000","last_clean":"2024-05-08T18:34:58.815500+0000","last_became_active":"2024-05-08T18:30:49.982438+0000","last_became_peered":"2024-05-08T18:30:49.982438+0000","last_unstale":"2024-05-08T18:34:58.815500+0000","last_undegraded":"2024-05-08T18:34:58.815500+0000","last_fullsized":"2024-05-08T18:34:58.815500+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:58.815417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:58.815417+0000","last_clean_scrub_stamp":"2024-05-08T18:34:58.815417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:19.949858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:56.776237+0000","last_change":"2024-05-08T18:34:56.776237+0000","last_active":"2024-05-08T18:34:56.776237+0000","last_peered":"2024-05-08T18:34:56.776237+0000","last_clean":"2024-05-08T18:34:56.776237+0000","last_became_active":"2024-05-08T18:30:58.294292+0000","last_became_peered":"2024-05-08T18:30:58.294292+0000","last_unstale":"2024-05-08T18:34:56.776237+0000","last_undegraded":"2024-05-08T18:34:56.776237+0000","last_fullsized":"2024-05-08T18:34:56.776237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:56.776056+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:56.776056+0000","last_clean_scrub_stamp":"2024-05-08T18:34:56.776056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:32.295347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:39.826486+0000","last_change":"2024-05-08T18:34:39.826486+0000","last_active":"2024-05-08T18:34:39.826486+0000","last_peered":"2024-05-08T18:34:39.826486+0000","last_clean":"2024-05-08T18:34:39.826486+0000","last_became_active":"2024-05-08T18:31:02.291806+0000","last_became_peered":"2024-05-08T18:31:02.291806+0000","last_unstale":"2024-05-08T18:34:39.826486+0000","last_undegraded":"2024-05-08T18:34:39.826486+0000","last_fullsized":"2024-05-08T18:34:39.826486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:39.826333+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:39.826333+0000","last_clean_scrub_stamp":"2024-05-08T18:34:39.826333+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:07.772048+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.698673+0000","last_change":"2024-05-08T18:34:26.698673+0000","last_active":"2024-05-08T18:34:26.698673+0000","last_peered":"2024-05-08T18:34:26.698673+0000","last_clean":"2024-05-08T18:34:26.698673+0000","last_became_active":"2024-05-08T18:31:04.303321+0000","last_became_peered":"2024-05-08T18:31:04.303321+0000","last_unstale":"2024-05-08T18:34:26.698673+0000","last_undegraded":"2024-05-08T18:34:26.698673+0000","last_fullsized":"2024-05-08T18:34:26.698673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-05-08T18:34:26.698537+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-05-08T18:34:26.698537+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.698537+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:44.151622+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.566404+0000","last_change":"2024-05-08T18:34:25.566404+0000","last_active":"2024-05-08T18:34:25.566404+0000","last_peered":"2024-05-08T18:34:25.566404+0000","last_clean":"2024-05-08T18:34:25.566404+0000","last_became_active":"2024-05-08T18:31:06.309525+0000","last_became_peered":"2024-05-08T18:31:06.309525+0000","last_unstale":"2024-05-08T18:34:25.566404+0000","last_undegraded":"2024-05-08T18:34:25.566404+0000","last_fullsized":"2024-05-08T18:34:25.566404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:25.566280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:25.566280+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.566280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:00.421645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'8","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:02.261818+0000","last_change":"2024-05-08T18:35:02.261818+0000","last_active":"2024-05-08T18:35:02.261818+0000","last_peered":"2024-05-08T18:35:02.261818+0000","last_clean":"2024-05-08T18:35:02.261818+0000","last_became_active":"2024-05-08T18:31:08.314503+0000","last_became_peered":"2024-05-08T18:31:08.314503+0000","last_unstale":"2024-05-08T18:35:02.261818+0000","last_undegraded":"2024-05-08T18:35:02.261818+0000","last_fullsized":"2024-05-08T18:35:02.261818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:35:02.261651+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:35:02.261651+0000","last_clean_scrub_stamp":"2024-05-08T18:35:02.261651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:26.632114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'6","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:59.672032+0000","last_change":"2024-05-08T18:34:59.672032+0000","last_active":"2024-05-08T18:34:59.672032+0000","last_peered":"2024-05-08T18:34:59.672032+0000","last_clean":"2024-05-08T18:34:59.672032+0000","last_became_active":"2024-05-08T18:31:00.283410+0000","last_became_peered":"2024-05-08T18:31:00.283410+0000","last_unstale":"2024-05-08T18:34:59.672032+0000","last_undegraded":"2024-05-08T18:34:59.672032+0000","last_fullsized":"2024-05-08T18:34:59.672032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:59.671941+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:59.671941+0000","last_clean_scrub_stamp":"2024-05-08T18:34:59.671941+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:36.374168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:31.451675+0000","last_change":"2024-05-08T18:35:31.451699+0000","last_active":"2024-05-08T18:35:31.451675+0000","last_peered":"2024-05-08T18:35:31.451675+0000","last_clean":"2024-05-08T18:35:31.451675+0000","last_became_active":"2024-05-08T18:30:49.983515+0000","last_became_peered":"2024-05-08T18:30:49.983515+0000","last_unstale":"2024-05-08T18:35:31.451675+0000","last_undegraded":"2024-05-08T18:35:31.451675+0000","last_fullsized":"2024-05-08T18:35:31.451675+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:31.451567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:31.451567+0000","last_clean_scrub_stamp":"2024-05-08T18:35:31.451567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:18.862553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:51.854795+0000","last_change":"2024-05-08T18:34:51.854795+0000","last_active":"2024-05-08T18:34:51.854795+0000","last_peered":"2024-05-08T18:34:51.854795+0000","last_clean":"2024-05-08T18:34:51.854795+0000","last_became_active":"2024-05-08T18:30:58.306268+0000","last_became_peered":"2024-05-08T18:30:58.306268+0000","last_unstale":"2024-05-08T18:34:51.854795+0000","last_undegraded":"2024-05-08T18:34:51.854795+0000","last_fullsized":"2024-05-08T18:34:51.854795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:51.854640+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:51.854640+0000","last_clean_scrub_stamp":"2024-05-08T18:34:51.854640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:08.246146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:36.627397+0000","last_change":"2024-05-08T18:34:36.627397+0000","last_active":"2024-05-08T18:34:36.627397+0000","last_peered":"2024-05-08T18:34:36.627397+0000","last_clean":"2024-05-08T18:34:36.627397+0000","last_became_active":"2024-05-08T18:31:02.292030+0000","last_became_peered":"2024-05-08T18:31:02.292030+0000","last_unstale":"2024-05-08T18:34:36.627397+0000","last_undegraded":"2024-05-08T18:34:36.627397+0000","last_fullsized":"2024-05-08T18:34:36.627397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:36.627276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:36.627276+0000","last_clean_scrub_stamp":"2024-05-08T18:34:36.627276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:58.136593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.698478+0000","last_change":"2024-05-08T18:34:24.698478+0000","last_active":"2024-05-08T18:34:24.698478+0000","last_peered":"2024-05-08T18:34:24.698478+0000","last_clean":"2024-05-08T18:34:24.698478+0000","last_became_active":"2024-05-08T18:31:04.296257+0000","last_became_peered":"2024-05-08T18:31:04.296257+0000","last_unstale":"2024-05-08T18:34:24.698478+0000","last_undegraded":"2024-05-08T18:34:24.698478+0000","last_fullsized":"2024-05-08T18:34:24.698478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-08T18:34:24.698350+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-08T18:34:24.698350+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.698350+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:44.670942+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:46.393005+0000","last_change":"2024-05-08T18:34:46.393005+0000","last_active":"2024-05-08T18:34:46.393005+0000","last_peered":"2024-05-08T18:34:46.393005+0000","last_clean":"2024-05-08T18:34:46.393005+0000","last_became_active":"2024-05-08T18:31:06.308892+0000","last_became_peered":"2024-05-08T18:31:06.308892+0000","last_unstale":"2024-05-08T18:34:46.393005+0000","last_undegraded":"2024-05-08T18:34:46.393005+0000","last_fullsized":"2024-05-08T18:34:46.393005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:46.392855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:46.392855+0000","last_clean_scrub_stamp":"2024-05-08T18:34:46.392855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:12.321949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:14.687446+0000","last_change":"2024-05-08T18:35:14.687446+0000","last_active":"2024-05-08T18:35:14.687446+0000","last_peered":"2024-05-08T18:35:14.687446+0000","last_clean":"2024-05-08T18:35:14.687446+0000","last_became_active":"2024-05-08T18:31:08.318728+0000","last_became_peered":"2024-05-08T18:31:08.318728+0000","last_unstale":"2024-05-08T18:35:14.687446+0000","last_undegraded":"2024-05-08T18:35:14.687446+0000","last_fullsized":"2024-05-08T18:35:14.687446+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:14.687300+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:14.687300+0000","last_clean_scrub_stamp":"2024-05-08T18:35:14.687300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:25.221538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'4","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:13.819477+0000","last_change":"2024-05-08T18:35:13.819477+0000","last_active":"2024-05-08T18:35:13.819477+0000","last_peered":"2024-05-08T18:35:13.819477+0000","last_clean":"2024-05-08T18:35:13.819477+0000","last_became_active":"2024-05-08T18:31:45.337785+0000","last_became_peered":"2024-05-08T18:31:45.337785+0000","last_unstale":"2024-05-08T18:35:13.819477+0000","last_undegraded":"2024-05-08T18:35:13.819477+0000","last_fullsized":"2024-05-08T18:35:13.819477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:13.819362+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:13.819362+0000","last_clean_scrub_stamp":"2024-05-08T18:35:13.819362+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:13:35.771430+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:03.840567+0000","last_change":"2024-05-08T18:35:03.840567+0000","last_active":"2024-05-08T18:35:03.840567+0000","last_peered":"2024-05-08T18:35:03.840567+0000","last_clean":"2024-05-08T18:35:03.840567+0000","last_became_active":"2024-05-08T18:30:58.302328+0000","last_became_peered":"2024-05-08T18:30:58.302328+0000","last_unstale":"2024-05-08T18:35:03.840567+0000","last_undegraded":"2024-05-08T18:35:03.840567+0000","last_fullsized":"2024-05-08T18:35:03.840567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:03.840399+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:03.840399+0000","last_clean_scrub_stamp":"2024-05-08T18:35:03.840399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:23.927754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:04.757625+0000","last_change":"2024-05-08T18:35:04.757702+0000","last_active":"2024-05-08T18:35:04.757625+0000","last_peered":"2024-05-08T18:35:04.757625+0000","last_clean":"2024-05-08T18:35:04.757625+0000","last_became_active":"2024-05-08T18:30:49.983522+0000","last_became_peered":"2024-05-08T18:30:49.983522+0000","last_unstale":"2024-05-08T18:35:04.757625+0000","last_undegraded":"2024-05-08T18:35:04.757625+0000","last_fullsized":"2024-05-08T18:35:04.757625+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:04.757514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:04.757514+0000","last_clean_scrub_stamp":"2024-05-08T18:35:04.757514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:13:26.709582+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:34.565146+0000","last_change":"2024-05-08T18:34:34.565146+0000","last_active":"2024-05-08T18:34:34.565146+0000","last_peered":"2024-05-08T18:34:34.565146+0000","last_clean":"2024-05-08T18:34:34.565146+0000","last_became_active":"2024-05-08T18:31:02.294603+0000","last_became_peered":"2024-05-08T18:31:02.294603+0000","last_unstale":"2024-05-08T18:34:34.565146+0000","last_undegraded":"2024-05-08T18:34:34.565146+0000","last_fullsized":"2024-05-08T18:34:34.565146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-05-08T18:34:34.564981+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-05-08T18:34:34.564981+0000","last_clean_scrub_stamp":"2024-05-08T18:34:34.564981+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:44:24.904584+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'75","reported_seq":152,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.528098+0000","last_change":"2024-05-08T18:34:32.528098+0000","last_active":"2024-05-08T18:34:32.528098+0000","last_peered":"2024-05-08T18:34:32.528098+0000","last_clean":"2024-05-08T18:34:32.528098+0000","last_became_active":"2024-05-08T18:31:04.295090+0000","last_became_peered":"2024-05-08T18:31:04.295090+0000","last_unstale":"2024-05-08T18:34:32.528098+0000","last_undegraded":"2024-05-08T18:34:32.528098+0000","last_fullsized":"2024-05-08T18:34:32.528098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'75","last_scrub_stamp":"2024-05-08T18:34:32.527967+0000","last_deep_scrub":"29'75","last_deep_scrub_stamp":"2024-05-08T18:34:32.527967+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.527967+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:27.504565+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:24.653420+0000","last_change":"2024-05-08T18:34:24.653420+0000","last_active":"2024-05-08T18:34:24.653420+0000","last_peered":"2024-05-08T18:34:24.653420+0000","last_clean":"2024-05-08T18:34:24.653420+0000","last_became_active":"2024-05-08T18:31:06.312179+0000","last_became_peered":"2024-05-08T18:31:06.312179+0000","last_unstale":"2024-05-08T18:34:24.653420+0000","last_undegraded":"2024-05-08T18:34:24.653420+0000","last_fullsized":"2024-05-08T18:34:24.653420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:24.653263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:24.653263+0000","last_clean_scrub_stamp":"2024-05-08T18:34:24.653263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:54:11.402636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'9","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:41.580867+0000","last_change":"2024-05-08T18:34:41.580867+0000","last_active":"2024-05-08T18:34:41.580867+0000","last_peered":"2024-05-08T18:34:41.580867+0000","last_clean":"2024-05-08T18:34:41.580867+0000","last_became_active":"2024-05-08T18:31:08.304818+0000","last_became_peered":"2024-05-08T18:31:08.304818+0000","last_unstale":"2024-05-08T18:34:41.580867+0000","last_undegraded":"2024-05-08T18:34:41.580867+0000","last_fullsized":"2024-05-08T18:34:41.580867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-08T18:34:41.580713+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-08T18:34:41.580713+0000","last_clean_scrub_stamp":"2024-05-08T18:34:41.580713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.972218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'6","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:37.695951+0000","last_change":"2024-05-08T18:34:37.695951+0000","last_active":"2024-05-08T18:34:37.695951+0000","last_peered":"2024-05-08T18:34:37.695951+0000","last_clean":"2024-05-08T18:34:37.695951+0000","last_became_active":"2024-05-08T18:31:00.294157+0000","last_became_peered":"2024-05-08T18:31:00.294157+0000","last_unstale":"2024-05-08T18:34:37.695951+0000","last_undegraded":"2024-05-08T18:34:37.695951+0000","last_fullsized":"2024-05-08T18:34:37.695951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:37.695840+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:37.695840+0000","last_clean_scrub_stamp":"2024-05-08T18:34:37.695840+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:25.082640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:02.698114+0000","last_change":"2024-05-08T18:35:02.698114+0000","last_active":"2024-05-08T18:35:02.698114+0000","last_peered":"2024-05-08T18:35:02.698114+0000","last_clean":"2024-05-08T18:35:02.698114+0000","last_became_active":"2024-05-08T18:30:58.286578+0000","last_became_peered":"2024-05-08T18:30:58.286578+0000","last_unstale":"2024-05-08T18:35:02.698114+0000","last_undegraded":"2024-05-08T18:35:02.698114+0000","last_fullsized":"2024-05-08T18:35:02.698114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:02.697942+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:02.697942+0000","last_clean_scrub_stamp":"2024-05-08T18:35:02.697942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:40.346535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:28.318172+0000","last_change":"2024-05-08T18:35:28.318201+0000","last_active":"2024-05-08T18:35:28.318172+0000","last_peered":"2024-05-08T18:35:28.318172+0000","last_clean":"2024-05-08T18:35:28.318172+0000","last_became_active":"2024-05-08T18:30:49.982471+0000","last_became_peered":"2024-05-08T18:30:49.982471+0000","last_unstale":"2024-05-08T18:35:28.318172+0000","last_undegraded":"2024-05-08T18:35:28.318172+0000","last_fullsized":"2024-05-08T18:35:28.318172+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:28.318048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:28.318048+0000","last_clean_scrub_stamp":"2024-05-08T18:35:28.318048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:32.899402+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.702739+0000","last_change":"2024-05-08T18:34:27.702739+0000","last_active":"2024-05-08T18:34:27.702739+0000","last_peered":"2024-05-08T18:34:27.702739+0000","last_clean":"2024-05-08T18:34:27.702739+0000","last_became_active":"2024-05-08T18:31:02.287974+0000","last_became_peered":"2024-05-08T18:31:02.287974+0000","last_unstale":"2024-05-08T18:34:27.702739+0000","last_undegraded":"2024-05-08T18:34:27.702739+0000","last_fullsized":"2024-05-08T18:34:27.702739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:27.702607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:27.702607+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.702607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:19.640531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'22","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.906780+0000","last_change":"2024-05-08T18:34:21.906780+0000","last_active":"2024-05-08T18:34:21.906780+0000","last_peered":"2024-05-08T18:34:21.906780+0000","last_clean":"2024-05-08T18:34:21.906780+0000","last_became_active":"2024-05-08T18:31:04.301116+0000","last_became_peered":"2024-05-08T18:31:04.301116+0000","last_unstale":"2024-05-08T18:34:21.906780+0000","last_undegraded":"2024-05-08T18:34:21.906780+0000","last_fullsized":"2024-05-08T18:34:21.906780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-08T18:34:21.906639+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-08T18:34:21.906639+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.906639+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:13.184187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":387,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.878020+0000","last_change":"2024-05-08T18:34:20.878020+0000","last_active":"2024-05-08T18:34:20.878020+0000","last_peered":"2024-05-08T18:34:20.878020+0000","last_clean":"2024-05-08T18:34:20.878020+0000","last_became_active":"2024-05-08T18:31:06.308274+0000","last_became_peered":"2024-05-08T18:31:06.308274+0000","last_unstale":"2024-05-08T18:34:20.878020+0000","last_undegraded":"2024-05-08T18:34:20.878020+0000","last_fullsized":"2024-05-08T18:34:20.878020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:20.877846+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:20.877846+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.877846+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:15.946216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:39.437129+0000","last_change":"2024-05-08T18:35:39.437155+0000","last_active":"2024-05-08T18:35:39.437129+0000","last_peered":"2024-05-08T18:35:39.437129+0000","last_clean":"2024-05-08T18:35:39.437129+0000","last_became_active":"2024-05-08T18:31:08.318609+0000","last_became_peered":"2024-05-08T18:31:08.318609+0000","last_unstale":"2024-05-08T18:35:39.437129+0000","last_undegraded":"2024-05-08T18:35:39.437129+0000","last_fullsized":"2024-05-08T18:35:39.437129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:39.437001+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:39.437001+0000","last_clean_scrub_stamp":"2024-05-08T18:35:39.437001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:01.322911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:04.290347+0000","last_change":"2024-05-08T18:35:04.290371+0000","last_active":"2024-05-08T18:35:04.290347+0000","last_peered":"2024-05-08T18:35:04.290347+0000","last_clean":"2024-05-08T18:35:04.290347+0000","last_became_active":"2024-05-08T18:31:00.291093+0000","last_became_peered":"2024-05-08T18:31:00.291093+0000","last_unstale":"2024-05-08T18:35:04.290347+0000","last_undegraded":"2024-05-08T18:35:04.290347+0000","last_fullsized":"2024-05-08T18:35:04.290347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:04.290261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:04.290261+0000","last_clean_scrub_stamp":"2024-05-08T18:35:04.290261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:18.897471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:23.425372+0000","last_change":"2024-05-08T18:35:23.425417+0000","last_active":"2024-05-08T18:35:23.425372+0000","last_peered":"2024-05-08T18:35:23.425372+0000","last_clean":"2024-05-08T18:35:23.425372+0000","last_became_active":"2024-05-08T18:30:58.305915+0000","last_became_peered":"2024-05-08T18:30:58.305915+0000","last_unstale":"2024-05-08T18:35:23.425372+0000","last_undegraded":"2024-05-08T18:35:23.425372+0000","last_fullsized":"2024-05-08T18:35:23.425372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:23.425253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:23.425253+0000","last_clean_scrub_stamp":"2024-05-08T18:35:23.425253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:03.755517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:03.711951+0000","last_change":"2024-05-08T18:35:03.711951+0000","last_active":"2024-05-08T18:35:03.711951+0000","last_peered":"2024-05-08T18:35:03.711951+0000","last_clean":"2024-05-08T18:35:03.711951+0000","last_became_active":"2024-05-08T18:30:49.982330+0000","last_became_peered":"2024-05-08T18:30:49.982330+0000","last_unstale":"2024-05-08T18:35:03.711951+0000","last_undegraded":"2024-05-08T18:35:03.711951+0000","last_fullsized":"2024-05-08T18:35:03.711951+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:03.711830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:03.711830+0000","last_clean_scrub_stamp":"2024-05-08T18:35:03.711830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:44.102855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:18.649104+0000","last_change":"2024-05-08T18:34:18.649104+0000","last_active":"2024-05-08T18:34:18.649104+0000","last_peered":"2024-05-08T18:34:18.649104+0000","last_clean":"2024-05-08T18:34:18.649104+0000","last_became_active":"2024-05-08T18:31:02.292328+0000","last_became_peered":"2024-05-08T18:31:02.292328+0000","last_unstale":"2024-05-08T18:34:18.649104+0000","last_undegraded":"2024-05-08T18:34:18.649104+0000","last_fullsized":"2024-05-08T18:34:18.649104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:18.648949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:18.648949+0000","last_clean_scrub_stamp":"2024-05-08T18:34:18.648949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:06.035748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:47.396324+0000","last_change":"2024-05-08T18:34:47.396324+0000","last_active":"2024-05-08T18:34:47.396324+0000","last_peered":"2024-05-08T18:34:47.396324+0000","last_clean":"2024-05-08T18:34:47.396324+0000","last_became_active":"2024-05-08T18:31:04.302020+0000","last_became_peered":"2024-05-08T18:31:04.302020+0000","last_unstale":"2024-05-08T18:34:47.396324+0000","last_undegraded":"2024-05-08T18:34:47.396324+0000","last_fullsized":"2024-05-08T18:34:47.396324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T18:34:47.396183+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T18:34:47.396183+0000","last_clean_scrub_stamp":"2024-05-08T18:34:47.396183+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:55.696682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":402,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.664202+0000","last_change":"2024-05-08T18:34:23.664202+0000","last_active":"2024-05-08T18:34:23.664202+0000","last_peered":"2024-05-08T18:34:23.664202+0000","last_clean":"2024-05-08T18:34:23.664202+0000","last_became_active":"2024-05-08T18:31:06.305020+0000","last_became_peered":"2024-05-08T18:31:06.305020+0000","last_unstale":"2024-05-08T18:34:23.664202+0000","last_undegraded":"2024-05-08T18:34:23.664202+0000","last_fullsized":"2024-05-08T18:34:23.664202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:23.664078+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:23.664078+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.664078+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:16.647836+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:44.668260+0000","last_change":"2024-05-08T18:34:44.668260+0000","last_active":"2024-05-08T18:34:44.668260+0000","last_peered":"2024-05-08T18:34:44.668260+0000","last_clean":"2024-05-08T18:34:44.668260+0000","last_became_active":"2024-05-08T18:31:08.309869+0000","last_became_peered":"2024-05-08T18:31:08.309869+0000","last_unstale":"2024-05-08T18:34:44.668260+0000","last_undegraded":"2024-05-08T18:34:44.668260+0000","last_fullsized":"2024-05-08T18:34:44.668260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:34:44.668104+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:34:44.668104+0000","last_clean_scrub_stamp":"2024-05-08T18:34:44.668104+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:43.032453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:41.850994+0000","last_change":"2024-05-08T18:34:41.850994+0000","last_active":"2024-05-08T18:34:41.850994+0000","last_peered":"2024-05-08T18:34:41.850994+0000","last_clean":"2024-05-08T18:34:41.850994+0000","last_became_active":"2024-05-08T18:31:00.296431+0000","last_became_peered":"2024-05-08T18:31:00.296431+0000","last_unstale":"2024-05-08T18:34:41.850994+0000","last_undegraded":"2024-05-08T18:34:41.850994+0000","last_fullsized":"2024-05-08T18:34:41.850994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:41.850804+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:41.850804+0000","last_clean_scrub_stamp":"2024-05-08T18:34:41.850804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:26:55.361491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:08.785644+0000","last_change":"2024-05-08T18:35:08.785644+0000","last_active":"2024-05-08T18:35:08.785644+0000","last_peered":"2024-05-08T18:35:08.785644+0000","last_clean":"2024-05-08T18:35:08.785644+0000","last_became_active":"2024-05-08T18:30:58.303997+0000","last_became_peered":"2024-05-08T18:30:58.303997+0000","last_unstale":"2024-05-08T18:35:08.785644+0000","last_undegraded":"2024-05-08T18:35:08.785644+0000","last_fullsized":"2024-05-08T18:35:08.785644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:08.785470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:08.785470+0000","last_clean_scrub_stamp":"2024-05-08T18:35:08.785470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:40:17.085969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:32.487007+0000","last_change":"2024-05-08T18:35:32.487045+0000","last_active":"2024-05-08T18:35:32.487007+0000","last_peered":"2024-05-08T18:35:32.487007+0000","last_clean":"2024-05-08T18:35:32.487007+0000","last_became_active":"2024-05-08T18:30:49.984280+0000","last_became_peered":"2024-05-08T18:30:49.984280+0000","last_unstale":"2024-05-08T18:35:32.487007+0000","last_undegraded":"2024-05-08T18:35:32.487007+0000","last_fullsized":"2024-05-08T18:35:32.487007+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:32.486911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:32.486911+0000","last_clean_scrub_stamp":"2024-05-08T18:35:32.486911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:59.170114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.647908+0000","last_change":"2024-05-08T18:34:21.647908+0000","last_active":"2024-05-08T18:34:21.647908+0000","last_peered":"2024-05-08T18:34:21.647908+0000","last_clean":"2024-05-08T18:34:21.647908+0000","last_became_active":"2024-05-08T18:31:02.290540+0000","last_became_peered":"2024-05-08T18:31:02.290540+0000","last_unstale":"2024-05-08T18:34:21.647908+0000","last_undegraded":"2024-05-08T18:34:21.647908+0000","last_fullsized":"2024-05-08T18:34:21.647908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:21.647799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:21.647799+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.647799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:43:40.019529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:23.670650+0000","last_change":"2024-05-08T18:34:23.670650+0000","last_active":"2024-05-08T18:34:23.670650+0000","last_peered":"2024-05-08T18:34:23.670650+0000","last_clean":"2024-05-08T18:34:23.670650+0000","last_became_active":"2024-05-08T18:31:04.304669+0000","last_became_peered":"2024-05-08T18:31:04.304669+0000","last_unstale":"2024-05-08T18:34:23.670650+0000","last_undegraded":"2024-05-08T18:34:23.670650+0000","last_fullsized":"2024-05-08T18:34:23.670650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-05-08T18:34:23.670475+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-05-08T18:34:23.670475+0000","last_clean_scrub_stamp":"2024-05-08T18:34:23.670475+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.365929+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:17.640131+0000","last_change":"2024-05-08T18:34:17.640131+0000","last_active":"2024-05-08T18:34:17.640131+0000","last_peered":"2024-05-08T18:34:17.640131+0000","last_clean":"2024-05-08T18:34:17.640131+0000","last_became_active":"2024-05-08T18:31:06.308621+0000","last_became_peered":"2024-05-08T18:31:06.308621+0000","last_unstale":"2024-05-08T18:34:17.640131+0000","last_undegraded":"2024-05-08T18:34:17.640131+0000","last_fullsized":"2024-05-08T18:34:17.640131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:17.639997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:17.639997+0000","last_clean_scrub_stamp":"2024-05-08T18:34:17.639997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:50.847042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:32.736144+0000","last_change":"2024-05-08T18:34:32.736144+0000","last_active":"2024-05-08T18:34:32.736144+0000","last_peered":"2024-05-08T18:34:32.736144+0000","last_clean":"2024-05-08T18:34:32.736144+0000","last_became_active":"2024-05-08T18:31:08.308427+0000","last_became_peered":"2024-05-08T18:31:08.308427+0000","last_unstale":"2024-05-08T18:34:32.736144+0000","last_undegraded":"2024-05-08T18:34:32.736144+0000","last_fullsized":"2024-05-08T18:34:32.736144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:32.736032+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:32.736032+0000","last_clean_scrub_stamp":"2024-05-08T18:34:32.736032+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:14.795378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:09.918330+0000","last_change":"2024-05-08T18:35:09.918330+0000","last_active":"2024-05-08T18:35:09.918330+0000","last_peered":"2024-05-08T18:35:09.918330+0000","last_clean":"2024-05-08T18:35:09.918330+0000","last_became_active":"2024-05-08T18:31:08.315257+0000","last_became_peered":"2024-05-08T18:31:08.315257+0000","last_unstale":"2024-05-08T18:35:09.918330+0000","last_undegraded":"2024-05-08T18:35:09.918330+0000","last_fullsized":"2024-05-08T18:35:09.918330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:09.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:09.918223+0000","last_clean_scrub_stamp":"2024-05-08T18:35:09.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:01.610620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'12","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:54.880286+0000","last_change":"2024-05-08T18:34:54.880286+0000","last_active":"2024-05-08T18:34:54.880286+0000","last_peered":"2024-05-08T18:34:54.880286+0000","last_clean":"2024-05-08T18:34:54.880286+0000","last_became_active":"2024-05-08T18:31:00.294827+0000","last_became_peered":"2024-05-08T18:31:00.294827+0000","last_unstale":"2024-05-08T18:34:54.880286+0000","last_undegraded":"2024-05-08T18:34:54.880286+0000","last_fullsized":"2024-05-08T18:34:54.880286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:54.880168+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:54.880168+0000","last_clean_scrub_stamp":"2024-05-08T18:34:54.880168+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:49.670548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:14.351140+0000","last_change":"2024-05-08T18:35:14.351140+0000","last_active":"2024-05-08T18:35:14.351140+0000","last_peered":"2024-05-08T18:35:14.351140+0000","last_clean":"2024-05-08T18:35:14.351140+0000","last_became_active":"2024-05-08T18:30:58.313034+0000","last_became_peered":"2024-05-08T18:30:58.313034+0000","last_unstale":"2024-05-08T18:35:14.351140+0000","last_undegraded":"2024-05-08T18:35:14.351140+0000","last_fullsized":"2024-05-08T18:35:14.351140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:14.350985+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:14.350985+0000","last_clean_scrub_stamp":"2024-05-08T18:35:14.350985+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:28.132388+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.763337+0000","last_change":"2024-05-08T18:34:30.763337+0000","last_active":"2024-05-08T18:34:30.763337+0000","last_peered":"2024-05-08T18:34:30.763337+0000","last_clean":"2024-05-08T18:34:30.763337+0000","last_became_active":"2024-05-08T18:31:02.291119+0000","last_became_peered":"2024-05-08T18:31:02.291119+0000","last_unstale":"2024-05-08T18:34:30.763337+0000","last_undegraded":"2024-05-08T18:34:30.763337+0000","last_fullsized":"2024-05-08T18:34:30.763337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:30.763186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:30.763186+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.763186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:48.428188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'41","reported_seq":98,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:51.439168+0000","last_change":"2024-05-08T18:34:51.439168+0000","last_active":"2024-05-08T18:34:51.439168+0000","last_peered":"2024-05-08T18:34:51.439168+0000","last_clean":"2024-05-08T18:34:51.439168+0000","last_became_active":"2024-05-08T18:31:04.300990+0000","last_became_peered":"2024-05-08T18:31:04.300990+0000","last_unstale":"2024-05-08T18:34:51.439168+0000","last_undegraded":"2024-05-08T18:34:51.439168+0000","last_fullsized":"2024-05-08T18:34:51.439168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-05-08T18:34:51.439030+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-05-08T18:34:51.439030+0000","last_clean_scrub_stamp":"2024-05-08T18:34:51.439030+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:18.253390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:58.305690+0000","last_change":"2024-05-08T18:34:58.305690+0000","last_active":"2024-05-08T18:34:58.305690+0000","last_peered":"2024-05-08T18:34:58.305690+0000","last_clean":"2024-05-08T18:34:58.305690+0000","last_became_active":"2024-05-08T18:31:06.314696+0000","last_became_peered":"2024-05-08T18:31:06.314696+0000","last_unstale":"2024-05-08T18:34:58.305690+0000","last_undegraded":"2024-05-08T18:34:58.305690+0000","last_fullsized":"2024-05-08T18:34:58.305690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:58.305535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:58.305535+0000","last_clean_scrub_stamp":"2024-05-08T18:34:58.305535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:16.613195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:16.834710+0000","last_change":"2024-05-08T18:35:16.834736+0000","last_active":"2024-05-08T18:35:16.834710+0000","last_peered":"2024-05-08T18:35:16.834710+0000","last_clean":"2024-05-08T18:35:16.834710+0000","last_became_active":"2024-05-08T18:31:08.318901+0000","last_became_peered":"2024-05-08T18:31:08.318901+0000","last_unstale":"2024-05-08T18:35:16.834710+0000","last_undegraded":"2024-05-08T18:35:16.834710+0000","last_fullsized":"2024-05-08T18:35:16.834710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-08T18:35:16.834621+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-08T18:35:16.834621+0000","last_clean_scrub_stamp":"2024-05-08T18:35:16.834621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:15:16.824610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:39.751907+0000","last_change":"2024-05-08T18:34:39.751907+0000","last_active":"2024-05-08T18:34:39.751907+0000","last_peered":"2024-05-08T18:34:39.751907+0000","last_clean":"2024-05-08T18:34:39.751907+0000","last_became_active":"2024-05-08T18:31:00.292376+0000","last_became_peered":"2024-05-08T18:31:00.292376+0000","last_unstale":"2024-05-08T18:34:39.751907+0000","last_undegraded":"2024-05-08T18:34:39.751907+0000","last_fullsized":"2024-05-08T18:34:39.751907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:39.751747+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:39.751747+0000","last_clean_scrub_stamp":"2024-05-08T18:34:39.751747+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:21.882010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:02.862829+0000","last_change":"2024-05-08T18:35:02.862829+0000","last_active":"2024-05-08T18:35:02.862829+0000","last_peered":"2024-05-08T18:35:02.862829+0000","last_clean":"2024-05-08T18:35:02.862829+0000","last_became_active":"2024-05-08T18:30:58.301520+0000","last_became_peered":"2024-05-08T18:30:58.301520+0000","last_unstale":"2024-05-08T18:35:02.862829+0000","last_undegraded":"2024-05-08T18:35:02.862829+0000","last_fullsized":"2024-05-08T18:35:02.862829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:02.862701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:02.862701+0000","last_clean_scrub_stamp":"2024-05-08T18:35:02.862701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:10.961365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.673400+0000","last_change":"2024-05-08T18:34:22.673400+0000","last_active":"2024-05-08T18:34:22.673400+0000","last_peered":"2024-05-08T18:34:22.673400+0000","last_clean":"2024-05-08T18:34:22.673400+0000","last_became_active":"2024-05-08T18:31:02.293459+0000","last_became_peered":"2024-05-08T18:31:02.293459+0000","last_unstale":"2024-05-08T18:34:22.673400+0000","last_undegraded":"2024-05-08T18:34:22.673400+0000","last_fullsized":"2024-05-08T18:34:22.673400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:22.673274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:22.673274+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.673274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:39.064779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.593763+0000","last_change":"2024-05-08T18:34:27.593763+0000","last_active":"2024-05-08T18:34:27.593763+0000","last_peered":"2024-05-08T18:34:27.593763+0000","last_clean":"2024-05-08T18:34:27.593763+0000","last_became_active":"2024-05-08T18:31:04.298237+0000","last_became_peered":"2024-05-08T18:31:04.298237+0000","last_unstale":"2024-05-08T18:34:27.593763+0000","last_undegraded":"2024-05-08T18:34:27.593763+0000","last_fullsized":"2024-05-08T18:34:27.593763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:27.593625+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:27.593625+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.593625+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:11.004092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:21.656429+0000","last_change":"2024-05-08T18:34:21.656429+0000","last_active":"2024-05-08T18:34:21.656429+0000","last_peered":"2024-05-08T18:34:21.656429+0000","last_clean":"2024-05-08T18:34:21.656429+0000","last_became_active":"2024-05-08T18:31:06.307048+0000","last_became_peered":"2024-05-08T18:31:06.307048+0000","last_unstale":"2024-05-08T18:34:21.656429+0000","last_undegraded":"2024-05-08T18:34:21.656429+0000","last_fullsized":"2024-05-08T18:34:21.656429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:21.656318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:21.656318+0000","last_clean_scrub_stamp":"2024-05-08T18:34:21.656318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:04.597248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:13.750070+0000","last_change":"2024-05-08T18:35:13.750126+0000","last_active":"2024-05-08T18:35:13.750070+0000","last_peered":"2024-05-08T18:35:13.750070+0000","last_clean":"2024-05-08T18:35:13.750070+0000","last_became_active":"2024-05-08T18:31:08.313943+0000","last_became_peered":"2024-05-08T18:31:08.313943+0000","last_unstale":"2024-05-08T18:35:13.750070+0000","last_undegraded":"2024-05-08T18:35:13.750070+0000","last_fullsized":"2024-05-08T18:35:13.750070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:13.749965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:13.749965+0000","last_clean_scrub_stamp":"2024-05-08T18:35:13.749965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:24.284202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:01.648672+0000","last_change":"2024-05-08T18:35:01.648672+0000","last_active":"2024-05-08T18:35:01.648672+0000","last_peered":"2024-05-08T18:35:01.648672+0000","last_clean":"2024-05-08T18:35:01.648672+0000","last_became_active":"2024-05-08T18:31:00.285842+0000","last_became_peered":"2024-05-08T18:31:00.285842+0000","last_unstale":"2024-05-08T18:35:01.648672+0000","last_undegraded":"2024-05-08T18:35:01.648672+0000","last_fullsized":"2024-05-08T18:35:01.648672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:01.648519+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:01.648519+0000","last_clean_scrub_stamp":"2024-05-08T18:35:01.648519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:30.251562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:05.877771+0000","last_change":"2024-05-08T18:35:05.877771+0000","last_active":"2024-05-08T18:35:05.877771+0000","last_peered":"2024-05-08T18:35:05.877771+0000","last_clean":"2024-05-08T18:35:05.877771+0000","last_became_active":"2024-05-08T18:30:58.303112+0000","last_became_peered":"2024-05-08T18:30:58.303112+0000","last_unstale":"2024-05-08T18:35:05.877771+0000","last_undegraded":"2024-05-08T18:35:05.877771+0000","last_fullsized":"2024-05-08T18:35:05.877771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:05.877646+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:05.877646+0000","last_clean_scrub_stamp":"2024-05-08T18:35:05.877646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:41.396937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:33.767349+0000","last_change":"2024-05-08T18:34:33.767349+0000","last_active":"2024-05-08T18:34:33.767349+0000","last_peered":"2024-05-08T18:34:33.767349+0000","last_clean":"2024-05-08T18:34:33.767349+0000","last_became_active":"2024-05-08T18:31:02.294812+0000","last_became_peered":"2024-05-08T18:31:02.294812+0000","last_unstale":"2024-05-08T18:34:33.767349+0000","last_undegraded":"2024-05-08T18:34:33.767349+0000","last_fullsized":"2024-05-08T18:34:33.767349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:33.767215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:33.767215+0000","last_clean_scrub_stamp":"2024-05-08T18:34:33.767215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:26.750973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'47","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.562049+0000","last_change":"2024-05-08T18:34:26.562049+0000","last_active":"2024-05-08T18:34:26.562049+0000","last_peered":"2024-05-08T18:34:26.562049+0000","last_clean":"2024-05-08T18:34:26.562049+0000","last_became_active":"2024-05-08T18:31:04.301969+0000","last_became_peered":"2024-05-08T18:31:04.301969+0000","last_unstale":"2024-05-08T18:34:26.562049+0000","last_undegraded":"2024-05-08T18:34:26.562049+0000","last_fullsized":"2024-05-08T18:34:26.562049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-08T18:34:26.561918+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-08T18:34:26.561918+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.561918+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:56.265527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:17.922228+0000","last_change":"2024-05-08T18:34:17.922228+0000","last_active":"2024-05-08T18:34:17.922228+0000","last_peered":"2024-05-08T18:34:17.922228+0000","last_clean":"2024-05-08T18:34:17.922228+0000","last_became_active":"2024-05-08T18:31:06.306346+0000","last_became_peered":"2024-05-08T18:31:06.306346+0000","last_unstale":"2024-05-08T18:34:17.922228+0000","last_undegraded":"2024-05-08T18:34:17.922228+0000","last_fullsized":"2024-05-08T18:34:17.922228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:17.922113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:17.922113+0000","last_clean_scrub_stamp":"2024-05-08T18:34:17.922113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:34.597084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:10.321449+0000","last_change":"2024-05-08T18:35:10.321477+0000","last_active":"2024-05-08T18:35:10.321449+0000","last_peered":"2024-05-08T18:35:10.321449+0000","last_clean":"2024-05-08T18:35:10.321449+0000","last_became_active":"2024-05-08T18:31:08.316673+0000","last_became_peered":"2024-05-08T18:31:08.316673+0000","last_unstale":"2024-05-08T18:35:10.321449+0000","last_undegraded":"2024-05-08T18:35:10.321449+0000","last_fullsized":"2024-05-08T18:35:10.321449+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:10.321358+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:10.321358+0000","last_clean_scrub_stamp":"2024-05-08T18:35:10.321358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:22.456143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'6","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:03.275613+0000","last_change":"2024-05-08T18:35:03.275613+0000","last_active":"2024-05-08T18:35:03.275613+0000","last_peered":"2024-05-08T18:35:03.275613+0000","last_clean":"2024-05-08T18:35:03.275613+0000","last_became_active":"2024-05-08T18:31:00.291163+0000","last_became_peered":"2024-05-08T18:31:00.291163+0000","last_unstale":"2024-05-08T18:35:03.275613+0000","last_undegraded":"2024-05-08T18:35:03.275613+0000","last_fullsized":"2024-05-08T18:35:03.275613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:35:03.275501+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:35:03.275501+0000","last_clean_scrub_stamp":"2024-05-08T18:35:03.275501+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:18.779161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:09.827502+0000","last_change":"2024-05-08T18:35:09.827502+0000","last_active":"2024-05-08T18:35:09.827502+0000","last_peered":"2024-05-08T18:35:09.827502+0000","last_clean":"2024-05-08T18:35:09.827502+0000","last_became_active":"2024-05-08T18:30:58.304135+0000","last_became_peered":"2024-05-08T18:30:58.304135+0000","last_unstale":"2024-05-08T18:35:09.827502+0000","last_undegraded":"2024-05-08T18:35:09.827502+0000","last_fullsized":"2024-05-08T18:35:09.827502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:09.827356+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:09.827356+0000","last_clean_scrub_stamp":"2024-05-08T18:35:09.827356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:19.346446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:25.724048+0000","last_change":"2024-05-08T18:34:25.724048+0000","last_active":"2024-05-08T18:34:25.724048+0000","last_peered":"2024-05-08T18:34:25.724048+0000","last_clean":"2024-05-08T18:34:25.724048+0000","last_became_active":"2024-05-08T18:31:02.290191+0000","last_became_peered":"2024-05-08T18:31:02.290191+0000","last_unstale":"2024-05-08T18:34:25.724048+0000","last_undegraded":"2024-05-08T18:34:25.724048+0000","last_fullsized":"2024-05-08T18:34:25.724048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:25.723912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:25.723912+0000","last_clean_scrub_stamp":"2024-05-08T18:34:25.723912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:20.514292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'36","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.740127+0000","last_change":"2024-05-08T18:34:30.740127+0000","last_active":"2024-05-08T18:34:30.740127+0000","last_peered":"2024-05-08T18:34:30.740127+0000","last_clean":"2024-05-08T18:34:30.740127+0000","last_became_active":"2024-05-08T18:31:04.295255+0000","last_became_peered":"2024-05-08T18:31:04.295255+0000","last_unstale":"2024-05-08T18:34:30.740127+0000","last_undegraded":"2024-05-08T18:34:30.740127+0000","last_fullsized":"2024-05-08T18:34:30.740127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:30.740000+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:30.740000+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.740000+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:21.689161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:22.620008+0000","last_change":"2024-05-08T18:34:22.620008+0000","last_active":"2024-05-08T18:34:22.620008+0000","last_peered":"2024-05-08T18:34:22.620008+0000","last_clean":"2024-05-08T18:34:22.620008+0000","last_became_active":"2024-05-08T18:31:06.304851+0000","last_became_peered":"2024-05-08T18:31:06.304851+0000","last_unstale":"2024-05-08T18:34:22.620008+0000","last_undegraded":"2024-05-08T18:34:22.620008+0000","last_fullsized":"2024-05-08T18:34:22.620008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:22.619859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:22.619859+0000","last_clean_scrub_stamp":"2024-05-08T18:34:22.619859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:19.090940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'8","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:12.829981+0000","last_change":"2024-05-08T18:35:12.829981+0000","last_active":"2024-05-08T18:35:12.829981+0000","last_peered":"2024-05-08T18:35:12.829981+0000","last_clean":"2024-05-08T18:35:12.829981+0000","last_became_active":"2024-05-08T18:31:45.336717+0000","last_became_peered":"2024-05-08T18:31:45.336717+0000","last_unstale":"2024-05-08T18:35:12.829981+0000","last_undegraded":"2024-05-08T18:35:12.829981+0000","last_fullsized":"2024-05-08T18:35:12.829981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:35:12.829847+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:35:12.829847+0000","last_clean_scrub_stamp":"2024-05-08T18:35:12.829847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:53.220872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:33.537311+0000","last_change":"2024-05-08T18:35:33.537311+0000","last_active":"2024-05-08T18:35:33.537311+0000","last_peered":"2024-05-08T18:35:33.537311+0000","last_clean":"2024-05-08T18:35:33.537311+0000","last_became_active":"2024-05-08T18:30:58.302486+0000","last_became_peered":"2024-05-08T18:30:58.302486+0000","last_unstale":"2024-05-08T18:35:33.537311+0000","last_undegraded":"2024-05-08T18:35:33.537311+0000","last_fullsized":"2024-05-08T18:35:33.537311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:33.537162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:33.537162+0000","last_clean_scrub_stamp":"2024-05-08T18:35:33.537162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:03.978703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:38.630273+0000","last_change":"2024-05-08T18:34:38.630273+0000","last_active":"2024-05-08T18:34:38.630273+0000","last_peered":"2024-05-08T18:34:38.630273+0000","last_clean":"2024-05-08T18:34:38.630273+0000","last_became_active":"2024-05-08T18:31:02.291965+0000","last_became_peered":"2024-05-08T18:31:02.291965+0000","last_unstale":"2024-05-08T18:34:38.630273+0000","last_undegraded":"2024-05-08T18:34:38.630273+0000","last_fullsized":"2024-05-08T18:34:38.630273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:38.630108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:38.630108+0000","last_clean_scrub_stamp":"2024-05-08T18:34:38.630108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:03.690534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.589859+0000","last_change":"2024-05-08T18:34:28.589897+0000","last_active":"2024-05-08T18:34:28.589859+0000","last_peered":"2024-05-08T18:34:28.589859+0000","last_clean":"2024-05-08T18:34:28.589859+0000","last_became_active":"2024-05-08T18:31:04.298061+0000","last_became_peered":"2024-05-08T18:31:04.298061+0000","last_unstale":"2024-05-08T18:34:28.589859+0000","last_undegraded":"2024-05-08T18:34:28.589859+0000","last_fullsized":"2024-05-08T18:34:28.589859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-08T18:34:28.589758+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-08T18:34:28.589758+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.589758+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.082408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:19.571868+0000","last_change":"2024-05-08T18:34:19.571892+0000","last_active":"2024-05-08T18:34:19.571868+0000","last_peered":"2024-05-08T18:34:19.571868+0000","last_clean":"2024-05-08T18:34:19.571868+0000","last_became_active":"2024-05-08T18:31:06.308247+0000","last_became_peered":"2024-05-08T18:31:06.308247+0000","last_unstale":"2024-05-08T18:34:19.571868+0000","last_undegraded":"2024-05-08T18:34:19.571868+0000","last_fullsized":"2024-05-08T18:34:19.571868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:19.571752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:19.571752+0000","last_clean_scrub_stamp":"2024-05-08T18:34:19.571752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:10.353530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:12.721905+0000","last_change":"2024-05-08T18:35:12.721905+0000","last_active":"2024-05-08T18:35:12.721905+0000","last_peered":"2024-05-08T18:35:12.721905+0000","last_clean":"2024-05-08T18:35:12.721905+0000","last_became_active":"2024-05-08T18:31:08.313986+0000","last_became_peered":"2024-05-08T18:31:08.313986+0000","last_unstale":"2024-05-08T18:35:12.721905+0000","last_undegraded":"2024-05-08T18:35:12.721905+0000","last_fullsized":"2024-05-08T18:35:12.721905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T18:35:12.721785+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T18:35:12.721785+0000","last_clean_scrub_stamp":"2024-05-08T18:35:12.721785+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:52.662693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:51.729136+0000","last_change":"2024-05-08T18:34:51.729136+0000","last_active":"2024-05-08T18:34:51.729136+0000","last_peered":"2024-05-08T18:34:51.729136+0000","last_clean":"2024-05-08T18:34:51.729136+0000","last_became_active":"2024-05-08T18:31:00.281233+0000","last_became_peered":"2024-05-08T18:31:00.281233+0000","last_unstale":"2024-05-08T18:34:51.729136+0000","last_undegraded":"2024-05-08T18:34:51.729136+0000","last_fullsized":"2024-05-08T18:34:51.729136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:51.729017+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:51.729017+0000","last_clean_scrub_stamp":"2024-05-08T18:34:51.729017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:23.632079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:03.775049+0000","last_change":"2024-05-08T18:35:03.775049+0000","last_active":"2024-05-08T18:35:03.775049+0000","last_peered":"2024-05-08T18:35:03.775049+0000","last_clean":"2024-05-08T18:35:03.775049+0000","last_became_active":"2024-05-08T18:30:58.289251+0000","last_became_peered":"2024-05-08T18:30:58.289251+0000","last_unstale":"2024-05-08T18:35:03.775049+0000","last_undegraded":"2024-05-08T18:35:03.775049+0000","last_fullsized":"2024-05-08T18:35:03.775049+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:03.774929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:03.774929+0000","last_clean_scrub_stamp":"2024-05-08T18:35:03.774929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:33.252828+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:37.837401+0000","last_change":"2024-05-08T18:34:37.837401+0000","last_active":"2024-05-08T18:34:37.837401+0000","last_peered":"2024-05-08T18:34:37.837401+0000","last_clean":"2024-05-08T18:34:37.837401+0000","last_became_active":"2024-05-08T18:31:02.293185+0000","last_became_peered":"2024-05-08T18:31:02.293185+0000","last_unstale":"2024-05-08T18:34:37.837401+0000","last_undegraded":"2024-05-08T18:34:37.837401+0000","last_fullsized":"2024-05-08T18:34:37.837401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:37.837258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:37.837258+0000","last_clean_scrub_stamp":"2024-05-08T18:34:37.837258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:28.286615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.735819+0000","last_change":"2024-05-08T18:34:26.735863+0000","last_active":"2024-05-08T18:34:26.735819+0000","last_peered":"2024-05-08T18:34:26.735819+0000","last_clean":"2024-05-08T18:34:26.735819+0000","last_became_active":"2024-05-08T18:31:04.298482+0000","last_became_peered":"2024-05-08T18:31:04.298482+0000","last_unstale":"2024-05-08T18:34:26.735819+0000","last_undegraded":"2024-05-08T18:34:26.735819+0000","last_fullsized":"2024-05-08T18:34:26.735819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T18:34:26.735726+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T18:34:26.735726+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.735726+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:38.610782+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:28.785527+0000","last_change":"2024-05-08T18:34:28.785567+0000","last_active":"2024-05-08T18:34:28.785527+0000","last_peered":"2024-05-08T18:34:28.785527+0000","last_clean":"2024-05-08T18:34:28.785527+0000","last_became_active":"2024-05-08T18:31:06.311392+0000","last_became_peered":"2024-05-08T18:31:06.311392+0000","last_unstale":"2024-05-08T18:34:28.785527+0000","last_undegraded":"2024-05-08T18:34:28.785527+0000","last_fullsized":"2024-05-08T18:34:28.785527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:28.785418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:28.785418+0000","last_clean_scrub_stamp":"2024-05-08T18:34:28.785418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.278068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:41.429459+0000","last_change":"2024-05-08T18:35:41.429459+0000","last_active":"2024-05-08T18:35:41.429459+0000","last_peered":"2024-05-08T18:35:41.429459+0000","last_clean":"2024-05-08T18:35:41.429459+0000","last_became_active":"2024-05-08T18:31:08.319394+0000","last_became_peered":"2024-05-08T18:31:08.319394+0000","last_unstale":"2024-05-08T18:35:41.429459+0000","last_undegraded":"2024-05-08T18:35:41.429459+0000","last_fullsized":"2024-05-08T18:35:41.429459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:41.429340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:41.429340+0000","last_clean_scrub_stamp":"2024-05-08T18:35:41.429340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:12.467071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'18","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.687783+0000","last_change":"2024-05-08T18:34:29.687812+0000","last_active":"2024-05-08T18:34:29.687783+0000","last_peered":"2024-05-08T18:34:29.687783+0000","last_clean":"2024-05-08T18:34:29.687783+0000","last_became_active":"2024-05-08T18:31:00.299547+0000","last_became_peered":"2024-05-08T18:31:00.299547+0000","last_unstale":"2024-05-08T18:34:29.687783+0000","last_undegraded":"2024-05-08T18:34:29.687783+0000","last_fullsized":"2024-05-08T18:34:29.687783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-05-08T18:34:29.687669+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-05-08T18:34:29.687669+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.687669+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:34:50.822109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:01.708135+0000","last_change":"2024-05-08T18:35:01.708135+0000","last_active":"2024-05-08T18:35:01.708135+0000","last_peered":"2024-05-08T18:35:01.708135+0000","last_clean":"2024-05-08T18:35:01.708135+0000","last_became_active":"2024-05-08T18:30:58.303624+0000","last_became_peered":"2024-05-08T18:30:58.303624+0000","last_unstale":"2024-05-08T18:35:01.708135+0000","last_undegraded":"2024-05-08T18:35:01.708135+0000","last_fullsized":"2024-05-08T18:35:01.708135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:01.708010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:01.708010+0000","last_clean_scrub_stamp":"2024-05-08T18:35:01.708010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:18.222162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:38.801676+0000","last_change":"2024-05-08T18:34:38.801732+0000","last_active":"2024-05-08T18:34:38.801676+0000","last_peered":"2024-05-08T18:34:38.801676+0000","last_clean":"2024-05-08T18:34:38.801676+0000","last_became_active":"2024-05-08T18:31:02.292498+0000","last_became_peered":"2024-05-08T18:31:02.292498+0000","last_unstale":"2024-05-08T18:34:38.801676+0000","last_undegraded":"2024-05-08T18:34:38.801676+0000","last_fullsized":"2024-05-08T18:34:38.801676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:38.801554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:38.801554+0000","last_clean_scrub_stamp":"2024-05-08T18:34:38.801554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:02.934641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:31.519937+0000","last_change":"2024-05-08T18:34:31.519937+0000","last_active":"2024-05-08T18:34:31.519937+0000","last_peered":"2024-05-08T18:34:31.519937+0000","last_clean":"2024-05-08T18:34:31.519937+0000","last_became_active":"2024-05-08T18:31:04.297297+0000","last_became_peered":"2024-05-08T18:31:04.297297+0000","last_unstale":"2024-05-08T18:34:31.519937+0000","last_undegraded":"2024-05-08T18:34:31.519937+0000","last_fullsized":"2024-05-08T18:34:31.519937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-08T18:34:31.519820+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-08T18:34:31.519820+0000","last_clean_scrub_stamp":"2024-05-08T18:34:31.519820+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:29.500105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.647756+0000","last_change":"2024-05-08T18:34:20.647756+0000","last_active":"2024-05-08T18:34:20.647756+0000","last_peered":"2024-05-08T18:34:20.647756+0000","last_clean":"2024-05-08T18:34:20.647756+0000","last_became_active":"2024-05-08T18:31:06.305567+0000","last_became_peered":"2024-05-08T18:31:06.305567+0000","last_unstale":"2024-05-08T18:34:20.647756+0000","last_undegraded":"2024-05-08T18:34:20.647756+0000","last_fullsized":"2024-05-08T18:34:20.647756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:20.647576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:20.647576+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.647576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:11.596737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'11","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:37.515960+0000","last_change":"2024-05-08T18:35:37.515960+0000","last_active":"2024-05-08T18:35:37.515960+0000","last_peered":"2024-05-08T18:35:37.515960+0000","last_clean":"2024-05-08T18:35:37.515960+0000","last_became_active":"2024-05-08T18:31:08.316943+0000","last_became_peered":"2024-05-08T18:31:08.316943+0000","last_unstale":"2024-05-08T18:35:37.515960+0000","last_undegraded":"2024-05-08T18:35:37.515960+0000","last_fullsized":"2024-05-08T18:35:37.515960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-08T18:35:37.515844+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-08T18:35:37.515844+0000","last_clean_scrub_stamp":"2024-05-08T18:35:37.515844+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:59:21.146899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'6","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:57.746662+0000","last_change":"2024-05-08T18:34:57.746715+0000","last_active":"2024-05-08T18:34:57.746662+0000","last_peered":"2024-05-08T18:34:57.746662+0000","last_clean":"2024-05-08T18:34:57.746662+0000","last_became_active":"2024-05-08T18:31:00.282923+0000","last_became_peered":"2024-05-08T18:31:00.282923+0000","last_unstale":"2024-05-08T18:34:57.746662+0000","last_undegraded":"2024-05-08T18:34:57.746662+0000","last_fullsized":"2024-05-08T18:34:57.746662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:57.746576+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:57.746576+0000","last_clean_scrub_stamp":"2024-05-08T18:34:57.746576+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:59.586725+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:08.377482+0000","last_change":"2024-05-08T18:35:08.377482+0000","last_active":"2024-05-08T18:35:08.377482+0000","last_peered":"2024-05-08T18:35:08.377482+0000","last_clean":"2024-05-08T18:35:08.377482+0000","last_became_active":"2024-05-08T18:30:58.316980+0000","last_became_peered":"2024-05-08T18:30:58.316980+0000","last_unstale":"2024-05-08T18:35:08.377482+0000","last_undegraded":"2024-05-08T18:35:08.377482+0000","last_fullsized":"2024-05-08T18:35:08.377482+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:08.377353+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:08.377353+0000","last_clean_scrub_stamp":"2024-05-08T18:35:08.377353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:31:18.567645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:35.723926+0000","last_change":"2024-05-08T18:34:35.723966+0000","last_active":"2024-05-08T18:34:35.723926+0000","last_peered":"2024-05-08T18:34:35.723926+0000","last_clean":"2024-05-08T18:34:35.723926+0000","last_became_active":"2024-05-08T18:31:02.288127+0000","last_became_peered":"2024-05-08T18:31:02.288127+0000","last_unstale":"2024-05-08T18:34:35.723926+0000","last_undegraded":"2024-05-08T18:34:35.723926+0000","last_fullsized":"2024-05-08T18:34:35.723926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:35.723797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:35.723797+0000","last_clean_scrub_stamp":"2024-05-08T18:34:35.723797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:17.046313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:49.428140+0000","last_change":"2024-05-08T18:34:49.428140+0000","last_active":"2024-05-08T18:34:49.428140+0000","last_peered":"2024-05-08T18:34:49.428140+0000","last_clean":"2024-05-08T18:34:49.428140+0000","last_became_active":"2024-05-08T18:31:04.302034+0000","last_became_peered":"2024-05-08T18:31:04.302034+0000","last_unstale":"2024-05-08T18:34:49.428140+0000","last_undegraded":"2024-05-08T18:34:49.428140+0000","last_fullsized":"2024-05-08T18:34:49.428140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T18:34:49.427967+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T18:34:49.427967+0000","last_clean_scrub_stamp":"2024-05-08T18:34:49.427967+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:40.814614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":419,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:20.617045+0000","last_change":"2024-05-08T18:34:20.617045+0000","last_active":"2024-05-08T18:34:20.617045+0000","last_peered":"2024-05-08T18:34:20.617045+0000","last_clean":"2024-05-08T18:34:20.617045+0000","last_became_active":"2024-05-08T18:31:06.311063+0000","last_became_peered":"2024-05-08T18:31:06.311063+0000","last_unstale":"2024-05-08T18:34:20.617045+0000","last_undegraded":"2024-05-08T18:34:20.617045+0000","last_fullsized":"2024-05-08T18:34:20.617045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T18:34:20.616926+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T18:34:20.616926+0000","last_clean_scrub_stamp":"2024-05-08T18:34:20.616926+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:07.788306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:43.358060+0000","last_change":"2024-05-08T18:35:43.358060+0000","last_active":"2024-05-08T18:35:43.358060+0000","last_peered":"2024-05-08T18:35:43.358060+0000","last_clean":"2024-05-08T18:35:43.358060+0000","last_became_active":"2024-05-08T18:31:08.320260+0000","last_became_peered":"2024-05-08T18:31:08.320260+0000","last_unstale":"2024-05-08T18:35:43.358060+0000","last_undegraded":"2024-05-08T18:35:43.358060+0000","last_fullsized":"2024-05-08T18:35:43.358060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:43.357928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:43.357928+0000","last_clean_scrub_stamp":"2024-05-08T18:35:43.357928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:30:27.138172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:46.862485+0000","last_change":"2024-05-08T18:34:46.862513+0000","last_active":"2024-05-08T18:34:46.862485+0000","last_peered":"2024-05-08T18:34:46.862485+0000","last_clean":"2024-05-08T18:34:46.862485+0000","last_became_active":"2024-05-08T18:31:00.284982+0000","last_became_peered":"2024-05-08T18:31:00.284982+0000","last_unstale":"2024-05-08T18:34:46.862485+0000","last_undegraded":"2024-05-08T18:34:46.862485+0000","last_fullsized":"2024-05-08T18:34:46.862485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:46.862388+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:46.862388+0000","last_clean_scrub_stamp":"2024-05-08T18:34:46.862388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:08.371704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:53.644358+0000","last_change":"2024-05-08T18:34:53.644358+0000","last_active":"2024-05-08T18:34:53.644358+0000","last_peered":"2024-05-08T18:34:53.644358+0000","last_clean":"2024-05-08T18:34:53.644358+0000","last_became_active":"2024-05-08T18:30:58.304969+0000","last_became_peered":"2024-05-08T18:30:58.304969+0000","last_unstale":"2024-05-08T18:34:53.644358+0000","last_undegraded":"2024-05-08T18:34:53.644358+0000","last_fullsized":"2024-05-08T18:34:53.644358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:53.644191+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:53.644191+0000","last_clean_scrub_stamp":"2024-05-08T18:34:53.644191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:01.742855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:33.755080+0000","last_change":"2024-05-08T18:34:33.755105+0000","last_active":"2024-05-08T18:34:33.755080+0000","last_peered":"2024-05-08T18:34:33.755080+0000","last_clean":"2024-05-08T18:34:33.755080+0000","last_became_active":"2024-05-08T18:31:02.288719+0000","last_became_peered":"2024-05-08T18:31:02.288719+0000","last_unstale":"2024-05-08T18:34:33.755080+0000","last_undegraded":"2024-05-08T18:34:33.755080+0000","last_fullsized":"2024-05-08T18:34:33.755080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:33.754990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:33.754990+0000","last_clean_scrub_stamp":"2024-05-08T18:34:33.754990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:27.813675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'46","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:26.817876+0000","last_change":"2024-05-08T18:34:26.817876+0000","last_active":"2024-05-08T18:34:26.817876+0000","last_peered":"2024-05-08T18:34:26.817876+0000","last_clean":"2024-05-08T18:34:26.817876+0000","last_became_active":"2024-05-08T18:31:04.297013+0000","last_became_peered":"2024-05-08T18:31:04.297013+0000","last_unstale":"2024-05-08T18:34:26.817876+0000","last_undegraded":"2024-05-08T18:34:26.817876+0000","last_fullsized":"2024-05-08T18:34:26.817876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-05-08T18:34:26.817745+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-05-08T18:34:26.817745+0000","last_clean_scrub_stamp":"2024-05-08T18:34:26.817745+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:56.521354+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:29.591218+0000","last_change":"2024-05-08T18:34:29.591218+0000","last_active":"2024-05-08T18:34:29.591218+0000","last_peered":"2024-05-08T18:34:29.591218+0000","last_clean":"2024-05-08T18:34:29.591218+0000","last_became_active":"2024-05-08T18:31:06.311767+0000","last_became_peered":"2024-05-08T18:31:06.311767+0000","last_unstale":"2024-05-08T18:34:29.591218+0000","last_undegraded":"2024-05-08T18:34:29.591218+0000","last_fullsized":"2024-05-08T18:34:29.591218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:29.591069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:29.591069+0000","last_clean_scrub_stamp":"2024-05-08T18:34:29.591069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:25:12.240015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:11.749595+0000","last_change":"2024-05-08T18:35:11.749595+0000","last_active":"2024-05-08T18:35:11.749595+0000","last_peered":"2024-05-08T18:35:11.749595+0000","last_clean":"2024-05-08T18:35:11.749595+0000","last_became_active":"2024-05-08T18:31:08.312031+0000","last_became_peered":"2024-05-08T18:31:08.312031+0000","last_unstale":"2024-05-08T18:35:11.749595+0000","last_undegraded":"2024-05-08T18:35:11.749595+0000","last_fullsized":"2024-05-08T18:35:11.749595+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:11.749487+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:11.749487+0000","last_clean_scrub_stamp":"2024-05-08T18:35:11.749487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:51.628598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:43.845914+0000","last_change":"2024-05-08T18:34:43.845941+0000","last_active":"2024-05-08T18:34:43.845914+0000","last_peered":"2024-05-08T18:34:43.845914+0000","last_clean":"2024-05-08T18:34:43.845914+0000","last_became_active":"2024-05-08T18:31:00.282605+0000","last_became_peered":"2024-05-08T18:31:00.282605+0000","last_unstale":"2024-05-08T18:34:43.845914+0000","last_undegraded":"2024-05-08T18:34:43.845914+0000","last_fullsized":"2024-05-08T18:34:43.845914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T18:34:43.845805+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T18:34:43.845805+0000","last_clean_scrub_stamp":"2024-05-08T18:34:43.845805+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:33.890772+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:22.420465+0000","last_change":"2024-05-08T18:35:22.420465+0000","last_active":"2024-05-08T18:35:22.420465+0000","last_peered":"2024-05-08T18:35:22.420465+0000","last_clean":"2024-05-08T18:35:22.420465+0000","last_became_active":"2024-05-08T18:30:58.316166+0000","last_became_peered":"2024-05-08T18:30:58.316166+0000","last_unstale":"2024-05-08T18:35:22.420465+0000","last_undegraded":"2024-05-08T18:35:22.420465+0000","last_fullsized":"2024-05-08T18:35:22.420465+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:22.420297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:22.420297+0000","last_clean_scrub_stamp":"2024-05-08T18:35:22.420297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:13.158632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:34.793858+0000","last_change":"2024-05-08T18:34:34.793883+0000","last_active":"2024-05-08T18:34:34.793858+0000","last_peered":"2024-05-08T18:34:34.793858+0000","last_clean":"2024-05-08T18:34:34.793858+0000","last_became_active":"2024-05-08T18:31:02.294335+0000","last_became_peered":"2024-05-08T18:31:02.294335+0000","last_unstale":"2024-05-08T18:34:34.793858+0000","last_undegraded":"2024-05-08T18:34:34.793858+0000","last_fullsized":"2024-05-08T18:34:34.793858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:34.793770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:34.793770+0000","last_clean_scrub_stamp":"2024-05-08T18:34:34.793770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:10.718458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.557516+0000","last_change":"2024-05-08T18:34:30.557516+0000","last_active":"2024-05-08T18:34:30.557516+0000","last_peered":"2024-05-08T18:34:30.557516+0000","last_clean":"2024-05-08T18:34:30.557516+0000","last_became_active":"2024-05-08T18:31:04.297440+0000","last_became_peered":"2024-05-08T18:31:04.297440+0000","last_unstale":"2024-05-08T18:34:30.557516+0000","last_undegraded":"2024-05-08T18:34:30.557516+0000","last_fullsized":"2024-05-08T18:34:30.557516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T18:34:30.557382+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T18:34:30.557382+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.557382+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:48.222384+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:54.392771+0000","last_change":"2024-05-08T18:34:54.392771+0000","last_active":"2024-05-08T18:34:54.392771+0000","last_peered":"2024-05-08T18:34:54.392771+0000","last_clean":"2024-05-08T18:34:54.392771+0000","last_became_active":"2024-05-08T18:31:06.312162+0000","last_became_peered":"2024-05-08T18:31:06.312162+0000","last_unstale":"2024-05-08T18:34:54.392771+0000","last_undegraded":"2024-05-08T18:34:54.392771+0000","last_fullsized":"2024-05-08T18:34:54.392771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:54.392629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:54.392629+0000","last_clean_scrub_stamp":"2024-05-08T18:34:54.392629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:33.529929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:38.477826+0000","last_change":"2024-05-08T18:35:38.477826+0000","last_active":"2024-05-08T18:35:38.477826+0000","last_peered":"2024-05-08T18:35:38.477826+0000","last_clean":"2024-05-08T18:35:38.477826+0000","last_became_active":"2024-05-08T18:31:08.318072+0000","last_became_peered":"2024-05-08T18:31:08.318072+0000","last_unstale":"2024-05-08T18:35:38.477826+0000","last_undegraded":"2024-05-08T18:35:38.477826+0000","last_fullsized":"2024-05-08T18:35:38.477826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:38.477685+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:38.477685+0000","last_clean_scrub_stamp":"2024-05-08T18:35:38.477685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:15.497376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:01.256104+0000","last_change":"2024-05-08T18:35:01.256104+0000","last_active":"2024-05-08T18:35:01.256104+0000","last_peered":"2024-05-08T18:35:01.256104+0000","last_clean":"2024-05-08T18:35:01.256104+0000","last_became_active":"2024-05-08T18:31:00.291128+0000","last_became_peered":"2024-05-08T18:31:00.291128+0000","last_unstale":"2024-05-08T18:35:01.256104+0000","last_undegraded":"2024-05-08T18:35:01.256104+0000","last_fullsized":"2024-05-08T18:35:01.256104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:01.255984+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:01.255984+0000","last_clean_scrub_stamp":"2024-05-08T18:35:01.255984+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:31.249730+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:06.725851+0000","last_change":"2024-05-08T18:35:06.725876+0000","last_active":"2024-05-08T18:35:06.725851+0000","last_peered":"2024-05-08T18:35:06.725851+0000","last_clean":"2024-05-08T18:35:06.725851+0000","last_became_active":"2024-05-08T18:30:58.283402+0000","last_became_peered":"2024-05-08T18:30:58.283402+0000","last_unstale":"2024-05-08T18:35:06.725851+0000","last_undegraded":"2024-05-08T18:35:06.725851+0000","last_fullsized":"2024-05-08T18:35:06.725851+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:06.725759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:06.725759+0000","last_clean_scrub_stamp":"2024-05-08T18:35:06.725759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:32.654853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:27.819657+0000","last_change":"2024-05-08T18:34:27.819657+0000","last_active":"2024-05-08T18:34:27.819657+0000","last_peered":"2024-05-08T18:34:27.819657+0000","last_clean":"2024-05-08T18:34:27.819657+0000","last_became_active":"2024-05-08T18:31:02.291363+0000","last_became_peered":"2024-05-08T18:31:02.291363+0000","last_unstale":"2024-05-08T18:34:27.819657+0000","last_undegraded":"2024-05-08T18:34:27.819657+0000","last_fullsized":"2024-05-08T18:34:27.819657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:27.819512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:27.819512+0000","last_clean_scrub_stamp":"2024-05-08T18:34:27.819512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:11.229979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'33","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:30.643094+0000","last_change":"2024-05-08T18:34:30.643128+0000","last_active":"2024-05-08T18:34:30.643094+0000","last_peered":"2024-05-08T18:34:30.643094+0000","last_clean":"2024-05-08T18:34:30.643094+0000","last_became_active":"2024-05-08T18:31:04.298601+0000","last_became_peered":"2024-05-08T18:31:04.298601+0000","last_unstale":"2024-05-08T18:34:30.643094+0000","last_undegraded":"2024-05-08T18:34:30.643094+0000","last_fullsized":"2024-05-08T18:34:30.643094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2024-05-08T18:34:30.643006+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2024-05-08T18:34:30.643006+0000","last_clean_scrub_stamp":"2024-05-08T18:34:30.643006+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:15.159268+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":49,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:42.467334+0000","last_change":"2024-05-08T18:34:42.467363+0000","last_active":"2024-05-08T18:34:42.467334+0000","last_peered":"2024-05-08T18:34:42.467334+0000","last_clean":"2024-05-08T18:34:42.467334+0000","last_became_active":"2024-05-08T18:31:06.307801+0000","last_became_peered":"2024-05-08T18:31:06.307801+0000","last_unstale":"2024-05-08T18:34:42.467334+0000","last_undegraded":"2024-05-08T18:34:42.467334+0000","last_fullsized":"2024-05-08T18:34:42.467334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:42.467239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:42.467239+0000","last_clean_scrub_stamp":"2024-05-08T18:34:42.467239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:11.945138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:40.400550+0000","last_change":"2024-05-08T18:35:40.400550+0000","last_active":"2024-05-08T18:35:40.400550+0000","last_peered":"2024-05-08T18:35:40.400550+0000","last_clean":"2024-05-08T18:35:40.400550+0000","last_became_active":"2024-05-08T18:31:08.319232+0000","last_became_peered":"2024-05-08T18:31:08.319232+0000","last_unstale":"2024-05-08T18:35:40.400550+0000","last_undegraded":"2024-05-08T18:35:40.400550+0000","last_fullsized":"2024-05-08T18:35:40.400550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:35:40.400419+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:35:40.400419+0000","last_clean_scrub_stamp":"2024-05-08T18:35:40.400419+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:29.971537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:42.804933+0000","last_change":"2024-05-08T18:34:42.804933+0000","last_active":"2024-05-08T18:34:42.804933+0000","last_peered":"2024-05-08T18:34:42.804933+0000","last_clean":"2024-05-08T18:34:42.804933+0000","last_became_active":"2024-05-08T18:31:00.282644+0000","last_became_peered":"2024-05-08T18:31:00.282644+0000","last_unstale":"2024-05-08T18:34:42.804933+0000","last_undegraded":"2024-05-08T18:34:42.804933+0000","last_fullsized":"2024-05-08T18:34:42.804933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:42.804809+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:42.804809+0000","last_clean_scrub_stamp":"2024-05-08T18:34:42.804809+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:20:23.898115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:07.775086+0000","last_change":"2024-05-08T18:35:07.775086+0000","last_active":"2024-05-08T18:35:07.775086+0000","last_peered":"2024-05-08T18:35:07.775086+0000","last_clean":"2024-05-08T18:35:07.775086+0000","last_became_active":"2024-05-08T18:30:58.303312+0000","last_became_peered":"2024-05-08T18:30:58.303312+0000","last_unstale":"2024-05-08T18:35:07.775086+0000","last_undegraded":"2024-05-08T18:35:07.775086+0000","last_fullsized":"2024-05-08T18:35:07.775086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:07.774913+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:07.774913+0000","last_clean_scrub_stamp":"2024-05-08T18:35:07.774913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:33.704007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'8","reported_seq":242,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:34.738123+0000","last_change":"2024-05-08T18:34:34.738123+0000","last_active":"2024-05-08T18:34:34.738123+0000","last_peered":"2024-05-08T18:34:34.738123+0000","last_clean":"2024-05-08T18:34:34.738123+0000","last_became_active":"2024-05-08T18:31:02.288433+0000","last_became_peered":"2024-05-08T18:31:02.288433+0000","last_unstale":"2024-05-08T18:34:34.738123+0000","last_undegraded":"2024-05-08T18:34:34.738123+0000","last_fullsized":"2024-05-08T18:34:34.738123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:34.737972+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:34.737972+0000","last_clean_scrub_stamp":"2024-05-08T18:34:34.737972+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:06.780418+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:34.593136+0000","last_change":"2024-05-08T18:34:34.593167+0000","last_active":"2024-05-08T18:34:34.593136+0000","last_peered":"2024-05-08T18:34:34.593136+0000","last_clean":"2024-05-08T18:34:34.593136+0000","last_became_active":"2024-05-08T18:31:04.298089+0000","last_became_peered":"2024-05-08T18:31:04.298089+0000","last_unstale":"2024-05-08T18:34:34.593136+0000","last_undegraded":"2024-05-08T18:34:34.593136+0000","last_fullsized":"2024-05-08T18:34:34.593136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-08T18:34:34.593039+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-08T18:34:34.593039+0000","last_clean_scrub_stamp":"2024-05-08T18:34:34.593039+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:54.680394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:37.668827+0000","last_change":"2024-05-08T18:34:37.668853+0000","last_active":"2024-05-08T18:34:37.668827+0000","last_peered":"2024-05-08T18:34:37.668827+0000","last_clean":"2024-05-08T18:34:37.668827+0000","last_became_active":"2024-05-08T18:31:06.311810+0000","last_became_peered":"2024-05-08T18:31:06.311810+0000","last_unstale":"2024-05-08T18:34:37.668827+0000","last_undegraded":"2024-05-08T18:34:37.668827+0000","last_fullsized":"2024-05-08T18:34:37.668827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:37.668735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:37.668735+0000","last_clean_scrub_stamp":"2024-05-08T18:34:37.668735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:25.055534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:06.325466+0000","last_change":"2024-05-08T18:35:06.325466+0000","last_active":"2024-05-08T18:35:06.325466+0000","last_peered":"2024-05-08T18:35:06.325466+0000","last_clean":"2024-05-08T18:35:06.325466+0000","last_became_active":"2024-05-08T18:31:08.316723+0000","last_became_peered":"2024-05-08T18:31:08.316723+0000","last_unstale":"2024-05-08T18:35:06.325466+0000","last_undegraded":"2024-05-08T18:35:06.325466+0000","last_fullsized":"2024-05-08T18:35:06.325466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:06.325330+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:06.325330+0000","last_clean_scrub_stamp":"2024-05-08T18:35:06.325330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:40.905872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'4","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:17.669569+0000","last_change":"2024-05-08T18:35:17.669569+0000","last_active":"2024-05-08T18:35:17.669569+0000","last_peered":"2024-05-08T18:35:17.669569+0000","last_clean":"2024-05-08T18:35:17.669569+0000","last_became_active":"2024-05-08T18:31:45.339252+0000","last_became_peered":"2024-05-08T18:31:45.339252+0000","last_unstale":"2024-05-08T18:35:17.669569+0000","last_undegraded":"2024-05-08T18:35:17.669569+0000","last_fullsized":"2024-05-08T18:35:17.669569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:35:17.669456+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:35:17.669456+0000","last_clean_scrub_stamp":"2024-05-08T18:35:17.669456+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:13:26.284655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:45.897118+0000","last_change":"2024-05-08T18:34:45.897118+0000","last_active":"2024-05-08T18:34:45.897118+0000","last_peered":"2024-05-08T18:34:45.897118+0000","last_clean":"2024-05-08T18:34:45.897118+0000","last_became_active":"2024-05-08T18:30:58.308290+0000","last_became_peered":"2024-05-08T18:30:58.308290+0000","last_unstale":"2024-05-08T18:34:45.897118+0000","last_undegraded":"2024-05-08T18:34:45.897118+0000","last_fullsized":"2024-05-08T18:34:45.897118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:45.897004+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:45.897004+0000","last_clean_scrub_stamp":"2024-05-08T18:34:45.897004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:42.049005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:55.818929+0000","last_change":"2024-05-08T18:34:55.818929+0000","last_active":"2024-05-08T18:34:55.818929+0000","last_peered":"2024-05-08T18:34:55.818929+0000","last_clean":"2024-05-08T18:34:55.818929+0000","last_became_active":"2024-05-08T18:31:00.282889+0000","last_became_peered":"2024-05-08T18:31:00.282889+0000","last_unstale":"2024-05-08T18:34:55.818929+0000","last_undegraded":"2024-05-08T18:34:55.818929+0000","last_fullsized":"2024-05-08T18:34:55.818929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:55.818809+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:55.818809+0000","last_clean_scrub_stamp":"2024-05-08T18:34:55.818809+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:32.297670+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:48.628085+0000","last_change":"2024-05-08T18:34:48.628085+0000","last_active":"2024-05-08T18:34:48.628085+0000","last_peered":"2024-05-08T18:34:48.628085+0000","last_clean":"2024-05-08T18:34:48.628085+0000","last_became_active":"2024-05-08T18:30:58.294210+0000","last_became_peered":"2024-05-08T18:30:58.294210+0000","last_unstale":"2024-05-08T18:34:48.628085+0000","last_undegraded":"2024-05-08T18:34:48.628085+0000","last_fullsized":"2024-05-08T18:34:48.628085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:48.627966+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:48.627966+0000","last_clean_scrub_stamp":"2024-05-08T18:34:48.627966+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:09.762407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'4","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:53.379822+0000","last_change":"2024-05-08T18:34:53.379822+0000","last_active":"2024-05-08T18:34:53.379822+0000","last_peered":"2024-05-08T18:34:53.379822+0000","last_clean":"2024-05-08T18:34:53.379822+0000","last_became_active":"2024-05-08T18:31:00.295749+0000","last_became_peered":"2024-05-08T18:31:00.295749+0000","last_unstale":"2024-05-08T18:34:53.379822+0000","last_undegraded":"2024-05-08T18:34:53.379822+0000","last_fullsized":"2024-05-08T18:34:53.379822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:53.379693+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:53.379693+0000","last_clean_scrub_stamp":"2024-05-08T18:34:53.379693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:03.913931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'6","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:20.419331+0000","last_change":"2024-05-08T18:35:20.419364+0000","last_active":"2024-05-08T18:35:20.419331+0000","last_peered":"2024-05-08T18:35:20.419331+0000","last_clean":"2024-05-08T18:35:20.419331+0000","last_became_active":"2024-05-08T18:30:58.314786+0000","last_became_peered":"2024-05-08T18:30:58.314786+0000","last_unstale":"2024-05-08T18:35:20.419331+0000","last_undegraded":"2024-05-08T18:35:20.419331+0000","last_fullsized":"2024-05-08T18:35:20.419331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:35:20.419235+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:35:20.419235+0000","last_clean_scrub_stamp":"2024-05-08T18:35:20.419235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:53.147124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'12","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:53.768373+0000","last_change":"2024-05-08T18:34:53.768373+0000","last_active":"2024-05-08T18:34:53.768373+0000","last_peered":"2024-05-08T18:34:53.768373+0000","last_clean":"2024-05-08T18:34:53.768373+0000","last_became_active":"2024-05-08T18:31:00.282863+0000","last_became_peered":"2024-05-08T18:31:00.282863+0000","last_unstale":"2024-05-08T18:34:53.768373+0000","last_undegraded":"2024-05-08T18:34:53.768373+0000","last_fullsized":"2024-05-08T18:34:53.768373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:53.768253+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:53.768253+0000","last_clean_scrub_stamp":"2024-05-08T18:34:53.768253+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:55.153778+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'3","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:58.706266+0000","last_change":"2024-05-08T18:34:58.706266+0000","last_active":"2024-05-08T18:34:58.706266+0000","last_peered":"2024-05-08T18:34:58.706266+0000","last_clean":"2024-05-08T18:34:58.706266+0000","last_became_active":"2024-05-08T18:30:58.289337+0000","last_became_peered":"2024-05-08T18:30:58.289337+0000","last_unstale":"2024-05-08T18:34:58.706266+0000","last_undegraded":"2024-05-08T18:34:58.706266+0000","last_fullsized":"2024-05-08T18:34:58.706266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-08T18:34:58.706124+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-08T18:34:58.706124+0000","last_clean_scrub_stamp":"2024-05-08T18:34:58.706124+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:11.390893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'8","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:44.639287+0000","last_change":"2024-05-08T18:34:44.639287+0000","last_active":"2024-05-08T18:34:44.639287+0000","last_peered":"2024-05-08T18:34:44.639287+0000","last_clean":"2024-05-08T18:34:44.639287+0000","last_became_active":"2024-05-08T18:31:00.291269+0000","last_became_peered":"2024-05-08T18:31:00.291269+0000","last_unstale":"2024-05-08T18:34:44.639287+0000","last_undegraded":"2024-05-08T18:34:44.639287+0000","last_fullsized":"2024-05-08T18:34:44.639287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:44.639159+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:44.639159+0000","last_clean_scrub_stamp":"2024-05-08T18:34:44.639159+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:39.429539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:09.735499+0000","last_change":"2024-05-08T18:35:09.735499+0000","last_active":"2024-05-08T18:35:09.735499+0000","last_peered":"2024-05-08T18:35:09.735499+0000","last_clean":"2024-05-08T18:35:09.735499+0000","last_became_active":"2024-05-08T18:30:58.283976+0000","last_became_peered":"2024-05-08T18:30:58.283976+0000","last_unstale":"2024-05-08T18:35:09.735499+0000","last_undegraded":"2024-05-08T18:35:09.735499+0000","last_fullsized":"2024-05-08T18:35:09.735499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:09.735360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:09.735360+0000","last_clean_scrub_stamp":"2024-05-08T18:35:09.735360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:01.122007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:41.755623+0000","last_change":"2024-05-08T18:34:41.755623+0000","last_active":"2024-05-08T18:34:41.755623+0000","last_peered":"2024-05-08T18:34:41.755623+0000","last_clean":"2024-05-08T18:34:41.755623+0000","last_became_active":"2024-05-08T18:31:00.292385+0000","last_became_peered":"2024-05-08T18:31:00.292385+0000","last_unstale":"2024-05-08T18:34:41.755623+0000","last_undegraded":"2024-05-08T18:34:41.755623+0000","last_fullsized":"2024-05-08T18:34:41.755623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T18:34:41.755496+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T18:34:41.755496+0000","last_clean_scrub_stamp":"2024-05-08T18:34:41.755496+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:08:19.929979+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"29'2","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:06.799236+0000","last_change":"2024-05-08T18:35:06.799236+0000","last_active":"2024-05-08T18:35:06.799236+0000","last_peered":"2024-05-08T18:35:06.799236+0000","last_clean":"2024-05-08T18:35:06.799236+0000","last_became_active":"2024-05-08T18:30:58.303839+0000","last_became_peered":"2024-05-08T18:30:58.303839+0000","last_unstale":"2024-05-08T18:35:06.799236+0000","last_undegraded":"2024-05-08T18:35:06.799236+0000","last_fullsized":"2024-05-08T18:35:06.799236+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:06.799126+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:06.799126+0000","last_clean_scrub_stamp":"2024-05-08T18:35:06.799126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'8","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:46.597867+0000","last_change":"2024-05-08T18:34:46.597867+0000","last_active":"2024-05-08T18:34:46.597867+0000","last_peered":"2024-05-08T18:34:46.597867+0000","last_clean":"2024-05-08T18:34:46.597867+0000","last_became_active":"2024-05-08T18:31:00.288202+0000","last_became_peered":"2024-05-08T18:31:00.288202+0000","last_unstale":"2024-05-08T18:34:46.597867+0000","last_undegraded":"2024-05-08T18:34:46.597867+0000","last_fullsized":"2024-05-08T18:34:46.597867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:46.597745+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:46.597745+0000","last_clean_scrub_stamp":"2024-05-08T18:34:46.597745+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:38.535670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:55.867126+0000","last_change":"2024-05-08T18:34:55.867126+0000","last_active":"2024-05-08T18:34:55.867126+0000","last_peered":"2024-05-08T18:34:55.867126+0000","last_clean":"2024-05-08T18:34:55.867126+0000","last_became_active":"2024-05-08T18:30:58.305116+0000","last_became_peered":"2024-05-08T18:30:58.305116+0000","last_unstale":"2024-05-08T18:34:55.867126+0000","last_undegraded":"2024-05-08T18:34:55.867126+0000","last_fullsized":"2024-05-08T18:34:55.867126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:55.867010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:55.867010+0000","last_clean_scrub_stamp":"2024-05-08T18:34:55.867010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:11:07.742066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'4","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:10.786108+0000","last_change":"2024-05-08T18:35:10.786108+0000","last_active":"2024-05-08T18:35:10.786108+0000","last_peered":"2024-05-08T18:35:10.786108+0000","last_clean":"2024-05-08T18:35:10.786108+0000","last_became_active":"2024-05-08T18:31:00.284439+0000","last_became_peered":"2024-05-08T18:31:00.284439+0000","last_unstale":"2024-05-08T18:35:10.786108+0000","last_undegraded":"2024-05-08T18:35:10.786108+0000","last_fullsized":"2024-05-08T18:35:10.786108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:10.785970+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:10.785970+0000","last_clean_scrub_stamp":"2024-05-08T18:35:10.785970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:58.520232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:10.709145+0000","last_change":"2024-05-08T18:35:10.709145+0000","last_active":"2024-05-08T18:35:10.709145+0000","last_peered":"2024-05-08T18:35:10.709145+0000","last_clean":"2024-05-08T18:35:10.709145+0000","last_became_active":"2024-05-08T18:30:58.286930+0000","last_became_peered":"2024-05-08T18:30:58.286930+0000","last_unstale":"2024-05-08T18:35:10.709145+0000","last_undegraded":"2024-05-08T18:35:10.709145+0000","last_fullsized":"2024-05-08T18:35:10.709145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:10.709019+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:10.709019+0000","last_clean_scrub_stamp":"2024-05-08T18:35:10.709019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:50.588130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:58.663390+0000","last_change":"2024-05-08T18:34:58.663390+0000","last_active":"2024-05-08T18:34:58.663390+0000","last_peered":"2024-05-08T18:34:58.663390+0000","last_clean":"2024-05-08T18:34:58.663390+0000","last_became_active":"2024-05-08T18:31:00.282958+0000","last_became_peered":"2024-05-08T18:31:00.282958+0000","last_unstale":"2024-05-08T18:34:58.663390+0000","last_undegraded":"2024-05-08T18:34:58.663390+0000","last_fullsized":"2024-05-08T18:34:58.663390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T18:34:58.663254+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T18:34:58.663254+0000","last_clean_scrub_stamp":"2024-05-08T18:34:58.663254+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:32.546874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:35.510162+0000","last_change":"2024-05-08T18:35:35.510188+0000","last_active":"2024-05-08T18:35:35.510162+0000","last_peered":"2024-05-08T18:35:35.510162+0000","last_clean":"2024-05-08T18:35:35.510162+0000","last_became_active":"2024-05-08T18:30:58.302051+0000","last_became_peered":"2024-05-08T18:30:58.302051+0000","last_unstale":"2024-05-08T18:35:35.510162+0000","last_undegraded":"2024-05-08T18:35:35.510162+0000","last_fullsized":"2024-05-08T18:35:35.510162+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:35.510064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:35.510064+0000","last_clean_scrub_stamp":"2024-05-08T18:35:35.510064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:00.691765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:36.575238+0000","last_change":"2024-05-08T18:34:36.575238+0000","last_active":"2024-05-08T18:34:36.575238+0000","last_peered":"2024-05-08T18:34:36.575238+0000","last_clean":"2024-05-08T18:34:36.575238+0000","last_became_active":"2024-05-08T18:31:00.297787+0000","last_became_peered":"2024-05-08T18:31:00.297787+0000","last_unstale":"2024-05-08T18:34:36.575238+0000","last_undegraded":"2024-05-08T18:34:36.575238+0000","last_fullsized":"2024-05-08T18:34:36.575238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:36.575101+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:36.575101+0000","last_clean_scrub_stamp":"2024-05-08T18:34:36.575101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:18.442678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'4","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:07.731242+0000","last_change":"2024-05-08T18:35:07.731242+0000","last_active":"2024-05-08T18:35:07.731242+0000","last_peered":"2024-05-08T18:35:07.731242+0000","last_clean":"2024-05-08T18:35:07.731242+0000","last_became_active":"2024-05-08T18:30:58.284146+0000","last_became_peered":"2024-05-08T18:30:58.284146+0000","last_unstale":"2024-05-08T18:35:07.731242+0000","last_undegraded":"2024-05-08T18:35:07.731242+0000","last_fullsized":"2024-05-08T18:35:07.731242+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:07.731120+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:07.731120+0000","last_clean_scrub_stamp":"2024-05-08T18:35:07.731120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:40:16.031619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'12","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:43.589692+0000","last_change":"2024-05-08T18:34:43.589692+0000","last_active":"2024-05-08T18:34:43.589692+0000","last_peered":"2024-05-08T18:34:43.589692+0000","last_clean":"2024-05-08T18:34:43.589692+0000","last_became_active":"2024-05-08T18:31:00.291399+0000","last_became_peered":"2024-05-08T18:31:00.291399+0000","last_unstale":"2024-05-08T18:34:43.589692+0000","last_undegraded":"2024-05-08T18:34:43.589692+0000","last_fullsized":"2024-05-08T18:34:43.589692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:43.589557+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:43.589557+0000","last_clean_scrub_stamp":"2024-05-08T18:34:43.589557+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:03.562149+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:57.674663+0000","last_change":"2024-05-08T18:34:57.674663+0000","last_active":"2024-05-08T18:34:57.674663+0000","last_peered":"2024-05-08T18:34:57.674663+0000","last_clean":"2024-05-08T18:34:57.674663+0000","last_became_active":"2024-05-08T18:30:58.305523+0000","last_became_peered":"2024-05-08T18:30:58.305523+0000","last_unstale":"2024-05-08T18:34:57.674663+0000","last_undegraded":"2024-05-08T18:34:57.674663+0000","last_fullsized":"2024-05-08T18:34:57.674663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:34:57.674531+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:34:57.674531+0000","last_clean_scrub_stamp":"2024-05-08T18:34:57.674531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:49.819400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'14","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:47.605779+0000","last_change":"2024-05-08T18:34:47.605779+0000","last_active":"2024-05-08T18:34:47.605779+0000","last_peered":"2024-05-08T18:34:47.605779+0000","last_clean":"2024-05-08T18:34:47.605779+0000","last_became_active":"2024-05-08T18:31:00.281199+0000","last_became_peered":"2024-05-08T18:31:00.281199+0000","last_unstale":"2024-05-08T18:34:47.605779+0000","last_undegraded":"2024-05-08T18:34:47.605779+0000","last_fullsized":"2024-05-08T18:34:47.605779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-08T18:34:47.605617+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-08T18:34:47.605617+0000","last_clean_scrub_stamp":"2024-05-08T18:34:47.605617+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:27.417542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:04.773925+0000","last_change":"2024-05-08T18:35:04.773925+0000","last_active":"2024-05-08T18:35:04.773925+0000","last_peered":"2024-05-08T18:35:04.773925+0000","last_clean":"2024-05-08T18:35:04.773925+0000","last_became_active":"2024-05-08T18:30:58.302218+0000","last_became_peered":"2024-05-08T18:30:58.302218+0000","last_unstale":"2024-05-08T18:35:04.773925+0000","last_undegraded":"2024-05-08T18:35:04.773925+0000","last_fullsized":"2024-05-08T18:35:04.773925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:04.773780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:04.773780+0000","last_clean_scrub_stamp":"2024-05-08T18:35:04.773780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:26.938636+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:38.713843+0000","last_change":"2024-05-08T18:34:38.713843+0000","last_active":"2024-05-08T18:34:38.713843+0000","last_peered":"2024-05-08T18:34:38.713843+0000","last_clean":"2024-05-08T18:34:38.713843+0000","last_became_active":"2024-05-08T18:31:00.294146+0000","last_became_peered":"2024-05-08T18:31:00.294146+0000","last_unstale":"2024-05-08T18:34:38.713843+0000","last_undegraded":"2024-05-08T18:34:38.713843+0000","last_fullsized":"2024-05-08T18:34:38.713843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:38.713718+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:38.713718+0000","last_clean_scrub_stamp":"2024-05-08T18:34:38.713718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:03.774145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:11.344730+0000","last_change":"2024-05-08T18:35:11.344730+0000","last_active":"2024-05-08T18:35:11.344730+0000","last_peered":"2024-05-08T18:35:11.344730+0000","last_clean":"2024-05-08T18:35:11.344730+0000","last_became_active":"2024-05-08T18:30:58.314388+0000","last_became_peered":"2024-05-08T18:30:58.314388+0000","last_unstale":"2024-05-08T18:35:11.344730+0000","last_undegraded":"2024-05-08T18:35:11.344730+0000","last_fullsized":"2024-05-08T18:35:11.344730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:11.344574+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:11.344574+0000","last_clean_scrub_stamp":"2024-05-08T18:35:11.344574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:49:14.135686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:54.661169+0000","last_change":"2024-05-08T18:34:54.661169+0000","last_active":"2024-05-08T18:34:54.661169+0000","last_peered":"2024-05-08T18:34:54.661169+0000","last_clean":"2024-05-08T18:34:54.661169+0000","last_became_active":"2024-05-08T18:31:00.281847+0000","last_became_peered":"2024-05-08T18:31:00.281847+0000","last_unstale":"2024-05-08T18:34:54.661169+0000","last_undegraded":"2024-05-08T18:34:54.661169+0000","last_fullsized":"2024-05-08T18:34:54.661169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:34:54.661048+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:34:54.661048+0000","last_clean_scrub_stamp":"2024-05-08T18:34:54.661048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:14.748403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:17.354615+0000","last_change":"2024-05-08T18:35:17.354615+0000","last_active":"2024-05-08T18:35:17.354615+0000","last_peered":"2024-05-08T18:35:17.354615+0000","last_clean":"2024-05-08T18:35:17.354615+0000","last_became_active":"2024-05-08T18:30:58.309203+0000","last_became_peered":"2024-05-08T18:30:58.309203+0000","last_unstale":"2024-05-08T18:35:17.354615+0000","last_undegraded":"2024-05-08T18:35:17.354615+0000","last_fullsized":"2024-05-08T18:35:17.354615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:35:17.354488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:35:17.354488+0000","last_clean_scrub_stamp":"2024-05-08T18:35:17.354488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:44.437881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'16","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:55.365295+0000","last_change":"2024-05-08T18:34:55.365295+0000","last_active":"2024-05-08T18:34:55.365295+0000","last_peered":"2024-05-08T18:34:55.365295+0000","last_clean":"2024-05-08T18:34:55.365295+0000","last_became_active":"2024-05-08T18:31:00.296240+0000","last_became_peered":"2024-05-08T18:31:00.296240+0000","last_unstale":"2024-05-08T18:34:55.365295+0000","last_undegraded":"2024-05-08T18:34:55.365295+0000","last_fullsized":"2024-05-08T18:34:55.365295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T18:34:55.365128+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T18:34:55.365128+0000","last_clean_scrub_stamp":"2024-05-08T18:34:55.365128+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:53.044461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:53.890035+0000","last_change":"2024-05-08T18:34:53.890035+0000","last_active":"2024-05-08T18:34:53.890035+0000","last_peered":"2024-05-08T18:34:53.890035+0000","last_clean":"2024-05-08T18:34:53.890035+0000","last_became_active":"2024-05-08T18:30:58.305572+0000","last_became_peered":"2024-05-08T18:30:58.305572+0000","last_unstale":"2024-05-08T18:34:53.890035+0000","last_undegraded":"2024-05-08T18:34:53.890035+0000","last_fullsized":"2024-05-08T18:34:53.890035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:34:53.889909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:34:53.889909+0000","last_clean_scrub_stamp":"2024-05-08T18:34:53.889909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.862500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:50.632438+0000","last_change":"2024-05-08T18:34:50.632438+0000","last_active":"2024-05-08T18:34:50.632438+0000","last_peered":"2024-05-08T18:34:50.632438+0000","last_clean":"2024-05-08T18:34:50.632438+0000","last_became_active":"2024-05-08T18:31:00.282414+0000","last_became_peered":"2024-05-08T18:31:00.282414+0000","last_unstale":"2024-05-08T18:34:50.632438+0000","last_undegraded":"2024-05-08T18:34:50.632438+0000","last_fullsized":"2024-05-08T18:34:50.632438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:34:50.632283+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:34:50.632283+0000","last_clean_scrub_stamp":"2024-05-08T18:34:50.632283+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:35.148546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:21.385752+0000","last_change":"2024-05-08T18:35:21.385752+0000","last_active":"2024-05-08T18:35:21.385752+0000","last_peered":"2024-05-08T18:35:21.385752+0000","last_clean":"2024-05-08T18:35:21.385752+0000","last_became_active":"2024-05-08T18:30:58.304591+0000","last_became_peered":"2024-05-08T18:30:58.304591+0000","last_unstale":"2024-05-08T18:35:21.385752+0000","last_undegraded":"2024-05-08T18:35:21.385752+0000","last_fullsized":"2024-05-08T18:35:21.385752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T18:35:21.385583+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T18:35:21.385583+0000","last_clean_scrub_stamp":"2024-05-08T18:35:21.385583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:48.724755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:19.398594+0000","last_change":"2024-05-08T18:35:19.398594+0000","last_active":"2024-05-08T18:35:19.398594+0000","last_peered":"2024-05-08T18:35:19.398594+0000","last_clean":"2024-05-08T18:35:19.398594+0000","last_became_active":"2024-05-08T18:30:58.303443+0000","last_became_peered":"2024-05-08T18:30:58.303443+0000","last_unstale":"2024-05-08T18:35:19.398594+0000","last_undegraded":"2024-05-08T18:35:19.398594+0000","last_fullsized":"2024-05-08T18:35:19.398594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T18:35:19.398431+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T18:35:19.398431+0000","last_clean_scrub_stamp":"2024-05-08T18:35:19.398431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:59.679917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'12","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:11.731274+0000","last_change":"2024-05-08T18:35:11.731274+0000","last_active":"2024-05-08T18:35:11.731274+0000","last_peered":"2024-05-08T18:35:11.731274+0000","last_clean":"2024-05-08T18:35:11.731274+0000","last_became_active":"2024-05-08T18:31:00.288250+0000","last_became_peered":"2024-05-08T18:31:00.288250+0000","last_unstale":"2024-05-08T18:35:11.731274+0000","last_undegraded":"2024-05-08T18:35:11.731274+0000","last_fullsized":"2024-05-08T18:35:11.731274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T18:35:11.731157+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T18:35:11.731157+0000","last_clean_scrub_stamp":"2024-05-08T18:35:11.731157+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:38:05.913388+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:35:08.772168+0000","last_change":"2024-05-08T18:35:08.772168+0000","last_active":"2024-05-08T18:35:08.772168+0000","last_peered":"2024-05-08T18:35:08.772168+0000","last_clean":"2024-05-08T18:35:08.772168+0000","last_became_active":"2024-05-08T18:30:58.284090+0000","last_became_peered":"2024-05-08T18:30:58.284090+0000","last_unstale":"2024-05-08T18:35:08.772168+0000","last_undegraded":"2024-05-08T18:35:08.772168+0000","last_fullsized":"2024-05-08T18:35:08.772168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:35:08.772024+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:35:08.772024+0000","last_clean_scrub_stamp":"2024-05-08T18:35:08.772024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:53.551363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T18:34:45.638617+0000","last_change":"2024-05-08T18:34:45.638617+0000","last_active":"2024-05-08T18:34:45.638617+0000","last_peered":"2024-05-08T18:34:45.638617+0000","last_clean":"2024-05-08T18:34:45.638617+0000","last_became_active":"2024-05-08T18:31:00.291650+0000","last_became_peered":"2024-05-08T18:31:00.291650+0000","last_unstale":"2024-05-08T18:34:45.638617+0000","last_undegraded":"2024-05-08T18:34:45.638617+0000","last_fullsized":"2024-05-08T18:34:45.638617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:34:45.638483+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:34:45.638483+0000","last_clean_scrub_stamp":"2024-05-08T18:34:45.638483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:17:56.483101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705729,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":136192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705730,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40444,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331396,"statfs":{"total":96636764160,"available":96595349504,"internally_reserved":0,"allocated":970752,"data_stored":724145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705729,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":991232,"data_stored":724633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705728,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":409600,"data_stored":135044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:36:00.557 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-08T18:36:00.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.684+0000 7efdf70ae640 1 Processor -- start 2024-05-08T18:36:00.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.684+0000 7efdf70ae640 1 -- start start 2024-05-08T18:36:00.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.684+0000 7efdf70ae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efdf012f400 0x7efdf01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:36:00.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.684+0000 7efdf70ae640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf012c1a0 con 0x7efdf012c5f0 2024-05-08T18:36:00.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.684+0000 7efdf70ae640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7efdf006f770 con 0x7efdf012f400 2024-05-08T18:36:00.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.684+0000 7efdeffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efdf012f400 0x7efdf01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:36:00.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.684+0000 7efdf4e4a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efdf012c5f0 0x7efdf012c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33302/0 (socket says 172.21.15.53:33302) 2024-05-08T18:36:00.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.684+0000 7efdf4e4a640 1 -- 172.21.15.53:0/2446226551 learned_addr learned my addr 172.21.15.53:0/2446226551 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:36:00.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.685+0000 7efdeffff640 1 -- 172.21.15.53:0/2446226551 >> v1:172.21.15.53:6789/0 conn(0x7efdf012c5f0 legacy=0x7efdf012c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:36:00.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.685+0000 7efdeffff640 1 -- 172.21.15.53:0/2446226551 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf008fc20 con 0x7efdf012f400 2024-05-08T18:36:00.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.685+0000 7efdef7fe640 1 -- 172.21.15.53:0/2446226551 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472334846 0 0) 0x7efdf012c1a0 con 0x7efdf012c5f0 2024-05-08T18:36:00.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.685+0000 7efdeffff640 1 --2- 172.21.15.53:0/2446226551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf012f400 0x7efdf01317f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7efde0009d90 tx=0x7efde002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad953fec8cdd3f1b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:36:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.686+0000 7efdef7fe640 1 -- 172.21.15.53:0/2446226551 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efde0039070 con 0x7efdf012f400 2024-05-08T18:36:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.686+0000 7efdef7fe640 1 -- 172.21.15.53:0/2446226551 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde002cb10 con 0x7efdf012f400 2024-05-08T18:36:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.686+0000 7efdef7fe640 1 -- 172.21.15.53:0/2446226551 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efde002ce10 con 0x7efdf012f400 2024-05-08T18:36:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.686+0000 7efdf70ae640 1 -- 172.21.15.53:0/2446226551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf012f400 msgr2=0x7efdf01317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:36:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.686+0000 7efdf70ae640 1 --2- 172.21.15.53:0/2446226551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf012f400 0x7efdf01317f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7efde0009d90 tx=0x7efde002beb0 comp rx=0 tx=0).stop 2024-05-08T18:36:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.686+0000 7efdf70ae640 1 -- 172.21.15.53:0/2446226551 shutdown_connections 2024-05-08T18:36:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.686+0000 7efdf70ae640 1 --2- 172.21.15.53:0/2446226551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf012f400 0x7efdf01317f0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:36:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.686+0000 7efdf70ae640 1 -- 172.21.15.53:0/2446226551 >> 172.21.15.53:0/2446226551 conn(0x7efdf009c5a0 msgr2=0x7efdf009c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:36:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.686+0000 7efdf70ae640 1 -- 172.21.15.53:0/2446226551 shutdown_connections 2024-05-08T18:36:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.686+0000 7efdf70ae640 1 -- 172.21.15.53:0/2446226551 wait complete. 2024-05-08T18:36:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.687+0000 7efdf70ae640 1 Processor -- start 2024-05-08T18:36:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.687+0000 7efdf70ae640 1 -- start start 2024-05-08T18:36:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.688+0000 7efdf70ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf012c5f0 0x7efdf009a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:36:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.688+0000 7efdf70ae640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efdf0131eb0 con 0x7efdf012c5f0 2024-05-08T18:36:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.688+0000 7efdf4e4a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf012c5f0 0x7efdf009a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:36:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.688+0000 7efdf4e4a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf012c5f0 0x7efdf009a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60900/0 (socket says 172.21.15.53:60900) 2024-05-08T18:36:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.688+0000 7efdf4e4a640 1 -- 172.21.15.53:0/3547482721 learned_addr learned my addr 172.21.15.53:0/3547482721 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:36:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.688+0000 7efdf4e4a640 1 -- 172.21.15.53:0/3547482721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf0128ef0 con 0x7efdf012c5f0 2024-05-08T18:36:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.688+0000 7efdf4e4a640 1 --2- 172.21.15.53:0/3547482721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf012c5f0 0x7efdf009a570 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7efdd800c420 tx=0x7efdd800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:36:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.688+0000 7efded7fa640 1 -- 172.21.15.53:0/3547482721 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdd8018070 con 0x7efdf012c5f0 2024-05-08T18:36:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.688+0000 7efded7fa640 1 -- 172.21.15.53:0/3547482721 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd80074d0 con 0x7efdf012c5f0 2024-05-08T18:36:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.688+0000 7efded7fa640 1 -- 172.21.15.53:0/3547482721 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdd8004950 con 0x7efdf012c5f0 2024-05-08T18:36:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.688+0000 7efdf70ae640 1 -- 172.21.15.53:0/3547482721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf0128bb0 con 0x7efdf012c5f0 2024-05-08T18:36:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.688+0000 7efdf70ae640 1 -- 172.21.15.53:0/3547482721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf0122970 con 0x7efdf012c5f0 2024-05-08T18:36:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.689+0000 7efded7fa640 1 -- 172.21.15.53:0/3547482721 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7efdd801b070 con 0x7efdf012c5f0 2024-05-08T18:36:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.689+0000 7efdf70ae640 1 -- 172.21.15.53:0/3547482721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf0064010 con 0x7efdf012c5f0 2024-05-08T18:36:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.689+0000 7efded7fa640 1 --2- 172.21.15.53:0/3547482721 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efdd003d2b0 0x7efdd003f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:36:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.689+0000 7efded7fa640 1 -- 172.21.15.53:0/3547482721 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7efdd8051190 con 0x7efdf012c5f0 2024-05-08T18:36:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.690+0000 7efdeffff640 1 --2- 172.21.15.53:0/3547482721 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efdd003d2b0 0x7efdd003f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:36:00.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.690+0000 7efdeffff640 1 --2- 172.21.15.53:0/3547482721 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efdd003d2b0 0x7efdd003f770 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7efde0036000 tx=0x7efde0030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:36:00.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.694+0000 7efded7fa640 1 -- 172.21.15.53:0/3547482721 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7efdf0128bb0 con 0x7efdf012c5f0 2024-05-08T18:36:00.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.883+0000 7efdf70ae640 1 -- 172.21.15.53:0/3547482721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7efdf01281f0 con 0x7efdf012c5f0 2024-05-08T18:36:00.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.885+0000 7efded7fa640 1 -- 172.21.15.53:0/3547482721 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7efdd801bdd0 con 0x7efdf012c5f0 2024-05-08T18:36:00.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.886+0000 7efded7fa640 1 -- 172.21.15.53:0/3547482721 <== mon.0 v2:172.21.15.53:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7efdd801ad00 con 0x7efdf012c5f0 2024-05-08T18:36:00.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.888+0000 7efdf70ae640 1 -- 172.21.15.53:0/3547482721 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efdd003d2b0 msgr2=0x7efdd003f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:36:00.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.888+0000 7efdf70ae640 1 --2- 172.21.15.53:0/3547482721 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efdd003d2b0 0x7efdd003f770 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7efde0036000 tx=0x7efde0030000 comp rx=0 tx=0).stop 2024-05-08T18:36:00.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.888+0000 7efdf70ae640 1 -- 172.21.15.53:0/3547482721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf012c5f0 msgr2=0x7efdf009a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:36:00.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.888+0000 7efdf70ae640 1 --2- 172.21.15.53:0/3547482721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf012c5f0 0x7efdf009a570 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7efdd800c420 tx=0x7efdd800c8e0 comp rx=0 tx=0).stop 2024-05-08T18:36:00.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.888+0000 7efdf70ae640 1 -- 172.21.15.53:0/3547482721 shutdown_connections 2024-05-08T18:36:00.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.888+0000 7efdf70ae640 1 --2- 172.21.15.53:0/3547482721 >> [v2:172.21.15.87:6824/211215191,v1:172.21.15.87:6825/211215191] conn(0x7efdd003d2b0 0x7efdd003f770 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:36:00.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.888+0000 7efdf70ae640 1 --2- 172.21.15.53:0/3547482721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf012c5f0 0x7efdf009a570 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:36:00.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.888+0000 7efdf70ae640 1 -- 172.21.15.53:0/3547482721 >> 172.21.15.53:0/3547482721 conn(0x7efdf009c5a0 msgr2=0x7efdf012cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:36:00.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.888+0000 7efdf70ae640 1 -- 172.21.15.53:0/3547482721 shutdown_connections 2024-05-08T18:36:00.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:36:00.888+0000 7efdf70ae640 1 -- 172.21.15.53:0/3547482721 wait complete. 2024-05-08T18:36:00.897 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-08T18:36:00.897 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-08T18:36:00.898 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-08T18:36:00.898 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:36:00.932 INFO:tasks.ceph.osd.0:Stopped 2024-05-08T18:36:00.933 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-08T18:36:00.933 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:36:00.970 INFO:tasks.ceph.osd.1:Stopped 2024-05-08T18:36:00.970 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-08T18:36:00.971 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:36:01.043 INFO:tasks.ceph.osd.2:Stopped 2024-05-08T18:36:01.043 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-08T18:36:01.043 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:36:01.114 INFO:tasks.ceph.osd.3:Stopped 2024-05-08T18:36:01.114 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-08T18:36:01.114 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-08T18:36:01.114 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:36:01.184 INFO:tasks.ceph.mgr.x:Stopped 2024-05-08T18:36:01.184 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-08T18:36:01.184 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T18:36:01.185 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:36:01.195 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T18:36:01.195 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-08T18:36:01.196 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-05-08T18:36:01.265 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi053.front.sepia.ceph.com 2024-05-08T18:36:01.265 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-08T18:36:01.397 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-08T18:36:01.397 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-08T18:36:01.617 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-08T18:36:01.617 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-08T18:36:01.690 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-08T18:36:01.690 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-08T18:36:01.771 INFO:tasks.ceph:Archiving mon data... 2024-05-08T18:36:01.772 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697913/data/mon.a.tgz 2024-05-08T18:36:01.772 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-05-08T18:36:01.789 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.GVRETtseEP 2024-05-08T18:36:01.790 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.GVRETtseEP 2024-05-08T18:36:01.961 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.GVRETtseEP 2024-05-08T18:36:02.046 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.GVRETtseEP is 266KB 2024-05-08T18:36:02.141 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.GVRETtseEP 2024-05-08T18:36:02.157 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-08T18:36:02.158 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T18:36:02.199 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T18:36:02.278 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T18:36:02.297 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T18:36:02.297 INFO:tasks.ceph:Archiving crash dumps... 2024-05-08T18:36:02.298 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/crash to /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697913/remote/smithi053/crash 2024-05-08T18:36:02.299 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T18:36:02.344 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/crash to /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697913/remote/smithi087/crash 2024-05-08T18:36:02.345 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T18:36:02.383 INFO:tasks.ceph:Compressing logs... 2024-05-08T18:36:02.383 DEBUG:teuthology.orchestra.run.smithi053:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T18:36:02.388 DEBUG:teuthology.orchestra.run.smithi087:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T18:36:02.410 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29877.log 2024-05-08T18:36:02.426 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30365.log 2024-05-08T18:36:02.427 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30839.log 2024-05-08T18:36:02.427 INFO:teuthology.orchestra.run.smithi053.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29877.log.gz 2024-05-08T18:36:02.427 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30323.log 2024-05-08T18:36:02.427 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30839.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.30365.log.gz 2024-05-08T18:36:02.427 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30629.log 2024-05-08T18:36:02.427 INFO:teuthology.orchestra.run.smithi053.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.30839.log.gz 2024-05-08T18:36:02.427 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30323.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-08T18:36:02.427 INFO:teuthology.orchestra.run.smithi053.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30323.log.gz 2024-05-08T18:36:02.427 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29735.log 2024-05-08T18:36:02.427 INFO:teuthology.orchestra.run.smithi053.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30629.log.gz 2024-05-08T18:36:02.427 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30671.log 2024-05-08T18:36:02.427 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30047.log 2024-05-08T18:36:02.428 INFO:teuthology.orchestra.run.smithi053.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29735.log.gz 2024-05-08T18:36:02.428 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30044.log 2024-05-08T18:36:02.428 INFO:teuthology.orchestra.run.smithi053.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30671.log.gz 2024-05-08T18:36:02.428 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30965.log 2024-05-08T18:36:02.428 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30044.log: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-08T18:36:02.428 INFO:teuthology.orchestra.run.smithi053.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30047.log.gz 2024-05-08T18:36:02.428 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-08T18:36:02.428 INFO:teuthology.orchestra.run.smithi053.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30044.log.gz 2024-05-08T18:36:02.428 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30046.log 2024-05-08T18:36:02.428 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30407.log 2024-05-08T18:36:02.428 INFO:teuthology.orchestra.run.smithi053.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30965.log.gz 2024-05-08T18:36:02.428 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28560.log 2024-05-08T18:36:02.428 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-08T18:36:02.429 INFO:teuthology.orchestra.run.smithi053.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30046.log.gz 2024-05-08T18:36:02.429 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30923.log 2024-05-08T18:36:02.429 INFO:teuthology.orchestra.run.smithi053.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30407.log.gz 2024-05-08T18:36:02.429 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.28560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29677.log 2024-05-08T18:36:02.429 INFO:teuthology.orchestra.run.smithi053.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.28560.log.gz 2024-05-08T18:36:02.429 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29635.log 2024-05-08T18:36:02.429 INFO:teuthology.orchestra.run.smithi053.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30923.log.gz 2024-05-08T18:36:02.429 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30217.log 2024-05-08T18:36:02.429 INFO:teuthology.orchestra.run.smithi053.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29677.log.gz 2024-05-08T18:36:02.429 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31049.log 2024-05-08T18:36:02.429 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29635.log: /var/log/ceph/ceph-client.admin.30217.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-08T18:36:02.429 INFO:teuthology.orchestra.run.smithi053.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29635.log.gz 2024-05-08T18:36:02.429 INFO:teuthology.orchestra.run.smithi053.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30217.log.gz 2024-05-08T18:36:02.429 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29535.log 2024-05-08T18:36:02.430 INFO:teuthology.orchestra.run.smithi053.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31049.log.gz 2024-05-08T18:36:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28521.log 2024-05-08T18:36:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28403.log 2024-05-08T18:36:02.430 INFO:teuthology.orchestra.run.smithi053.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29535.log.gz 2024-05-08T18:36:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.28521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30503.log 2024-05-08T18:36:02.430 INFO:teuthology.orchestra.run.smithi053.stderr: 85.0%/var/log/ceph/ceph-client.admin.28403.log: -- replaced with /var/log/ceph/ceph-client.admin.28521.log.gz 2024-05-08T18:36:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31133.log 2024-05-08T18:36:02.430 INFO:teuthology.orchestra.run.smithi053.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.28403.log.gz 2024-05-08T18:36:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30045.log 2024-05-08T18:36:02.430 INFO:teuthology.orchestra.run.smithi053.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30503.log.gz 2024-05-08T18:36:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29879.log 2024-05-08T18:36:02.430 INFO:teuthology.orchestra.run.smithi053.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31133.log.gz 2024-05-08T18:36:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29777.log 2024-05-08T18:36:02.430 INFO:teuthology.orchestra.run.smithi053.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30045.log.gz 2024-05-08T18:36:02.431 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29879.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-08T18:36:02.431 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29879.log.gz 2024-05-08T18:36:02.431 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29593.log 2024-05-08T18:36:02.431 INFO:teuthology.orchestra.run.smithi053.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29777.log.gz 2024-05-08T18:36:02.431 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30797.log 2024-05-08T18:36:02.431 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30461.log 2024-05-08T18:36:02.431 INFO:teuthology.orchestra.run.smithi053.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29593.log.gz 2024-05-08T18:36:02.431 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30881.log 2024-05-08T18:36:02.431 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30461.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30797.log.gz 2024-05-08T18:36:02.431 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31215.log 2024-05-08T18:36:02.431 INFO:teuthology.orchestra.run.smithi053.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30461.log.gz 2024-05-08T18:36:02.431 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30155.log 2024-05-08T18:36:02.431 INFO:teuthology.orchestra.run.smithi053.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.30881.log.gz 2024-05-08T18:36:02.431 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31175.log 2024-05-08T18:36:02.432 INFO:teuthology.orchestra.run.smithi053.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31215.log.gz 2024-05-08T18:36:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30713.log 2024-05-08T18:36:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30155.log: /var/log/ceph/ceph-client.admin.31175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30545.log 2024-05-08T18:36:02.432 INFO:teuthology.orchestra.run.smithi053.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30155.log.gz 2024-05-08T18:36:02.432 INFO:teuthology.orchestra.run.smithi053.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31175.log.gz 2024-05-08T18:36:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31091.log 2024-05-08T18:36:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30755.log 2024-05-08T18:36:02.432 INFO:teuthology.orchestra.run.smithi053.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30713.log.gz 2024-05-08T18:36:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30545.log: /var/log/ceph/ceph-client.admin.31091.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30545.log.gz 2024-05-08T18:36:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29878.log 2024-05-08T18:36:02.432 INFO:teuthology.orchestra.run.smithi053.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31091.log.gz 2024-05-08T18:36:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30587.log 2024-05-08T18:36:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30755.log: /var/log/ceph/ceph-client.admin.29878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31007.log 2024-05-08T18:36:02.432 INFO:teuthology.orchestra.run.smithi053.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30755.log.gz 2024-05-08T18:36:02.432 INFO:teuthology.orchestra.run.smithi053.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29878.log.gz 2024-05-08T18:36:02.433 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30175.log 2024-05-08T18:36:02.433 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26688.log 2024-05-08T18:36:02.433 INFO:teuthology.orchestra.run.smithi053.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30587.log.gz 2024-05-08T18:36:02.433 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30216.log 2024-05-08T18:36:02.433 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30175.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.31007.log.gz 2024-05-08T18:36:02.433 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.tmp-client.admin.26688.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30175.log.gz 2024-05-08T18:36:02.433 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29876.log 2024-05-08T18:36:02.433 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26688.log.gz 2024-05-08T18:36:02.433 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30216.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.30216.log.gz 2024-05-08T18:36:02.433 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29876.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.29876.log.gz 2024-05-08T18:36:02.460 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81917.log 2024-05-08T18:36:02.460 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72842.log 2024-05-08T18:36:02.460 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.81917.log: /var/log/ceph/ceph-client.0.69212.log 2024-05-08T18:36:02.460 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.72842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47432.log 2024-05-08T18:36:02.461 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53482.log 2024-05-08T18:36:02.471 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.69212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69817.log 2024-05-08T18:36:02.471 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.47432.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.81917.log.gz 2024-05-08T18:36:02.471 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5/var/log/ceph/ceph-client.0.53482.log: --verbose -- /var/log/ceph/ceph-client.0.59532.log 2024-05-08T18:36:02.471 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.69817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74052.log 2024-05-08T18:36:02.472 INFO:teuthology.orchestra.run.smithi087.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.72842.log.gz 2024-05-08T18:36:02.472 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.59532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66187.log 2024-05-08T18:36:02.472 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.74052.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87332.log 2024-05-08T18:36:02.472 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.0.47432.log.gz 2024-05-08T18:36:02.472 INFO:teuthology.orchestra.run.smithi087.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53482.log.gz 2024-05-08T18:36:02.472 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.66187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78892.log 2024-05-08T18:36:02.472 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.87332.log: gzip 92.6% -- replaced with /var/log/ceph/ceph-client.0.69212.log.gz 2024-05-08T18:36:02.472 INFO:teuthology.orchestra.run.smithi087.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.64977.log 2024-05-08T18:36:02.472 INFO:teuthology.orchestra.run.smithi087.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.69817.log.gz 2024-05-08T18:36:02.472 INFO:teuthology.orchestra.run.smithi087.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.59532.log.gz 2024-05-08T18:36:02.472 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.78892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37153.log 2024-05-08T18:36:02.472 INFO:teuthology.orchestra.run.smithi087.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74052.log.gz 2024-05-08T18:36:02.472 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.64977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46222.log 2024-05-08T18:36:02.472 INFO:teuthology.orchestra.run.smithi087.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.66187.log.gz 2024-05-08T18:36:02.473 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93382.log 2024-05-08T18:36:02.473 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.37153.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.87332.log.gz 2024-05-08T18:36:02.473 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.46222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80102.log 2024-05-08T18:36:02.473 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.93382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95854.log 2024-05-08T18:36:02.473 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.80102.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.78892.log.gz 2024-05-08T18:36:02.473 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93987.log 2024-05-08T18:36:02.473 INFO:teuthology.orchestra.run.smithi087.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.64977.log.gz 2024-05-08T18:36:02.473 INFO:teuthology.orchestra.run.smithi087.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37153.log.gz 2024-05-08T18:36:02.473 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.95854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49247.log 2024-05-08T18:36:02.473 INFO:teuthology.orchestra.run.smithi087.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.46222.log.gz 2024-05-08T18:36:02.473 INFO:teuthology.orchestra.run.smithi087.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.93382.log.gz 2024-05-08T18:36:02.473 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.93987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38968.log 2024-05-08T18:36:02.473 INFO:teuthology.orchestra.run.smithi087.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.80102.log.gz 2024-05-08T18:36:02.473 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.49247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38363.log 2024-05-08T18:36:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.38968.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-08T18:36:02.474 INFO:teuthology.orchestra.run.smithi087.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.93987.log.gz 2024-05-08T18:36:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.38363.log: 90.3% -- replaced with /var/log/ceph/ceph-client.0.38968.log.gz 2024-05-08T18:36:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60742.log 2024-05-08T18:36:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68607.log 2024-05-08T18:36:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.60742.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.49247.log.gz 2024-05-08T18:36:02.474 INFO:teuthology.orchestra.run.smithi087.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.0.95854.log.gz 2024-05-08T18:36:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92172.log 2024-05-08T18:36:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77077.log 2024-05-08T18:36:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.68607.log: /var/log/ceph/ceph-client.0.92172.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.38363.log.gz 2024-05-08T18:36:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54087.log 2024-05-08T18:36:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60137.log 2024-05-08T18:36:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.77077.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.60742.log.gz 2024-05-08T18:36:02.474 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.54087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83732.log 2024-05-08T18:36:02.475 INFO:teuthology.orchestra.run.smithi087.stderr:gzip/var/log/ceph/ceph-client.0.60137.log: -5 --verbose -- /var/log/ceph/ceph-client.0.51062.log 2024-05-08T18:36:02.475 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.83732.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92172.log.gz 2024-05-08T18:36:02.475 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66792.log 2024-05-08T18:36:02.475 INFO:teuthology.orchestra.run.smithi087.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77077.log.gz 2024-05-08T18:36:02.475 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.51062.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.54087.log.gz 2024-05-08T18:36:02.475 INFO:teuthology.orchestra.run.smithi087.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.60137.log.gz 2024-05-08T18:36:02.475 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36548.log 2024-05-08T18:36:02.496 INFO:teuthology.orchestra.run.smithi087.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.83732.log.gz 2024-05-08T18:36:02.496 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.66792.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-08T18:36:02.496 INFO:teuthology.orchestra.run.smithi087.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.68607.log.gz 2024-05-08T18:36:02.496 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.36548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39567.log 2024-05-08T18:36:02.496 INFO:teuthology.orchestra.run.smithi087.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51062.log.gz 2024-05-08T18:36:02.496 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5/var/log/ceph/ceph-osd.3.log: --verbose -- /var/log/ceph/ceph-client.0.70422.log 2024-05-08T18:36:02.496 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.39567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76472.log 2024-05-08T18:36:02.497 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.70422.log: gzip -5 91.0% --verbose -- /var/log/ceph/ceph-client.0.48037.log 2024-05-08T18:36:02.497 INFO:teuthology.orchestra.run.smithi087.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.36548.log.gz 2024-05-08T18:36:02.497 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.0.66792.log.gz 2024-05-08T18:36:02.497 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.76472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92777.log 2024-05-08T18:36:02.497 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.48037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40777.log 2024-05-08T18:36:02.497 INFO:teuthology.orchestra.run.smithi087.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.39567.log.gz/var/log/ceph/ceph-client.0.92777.log: 2024-05-08T18:36:02.497 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-05-08T18:36:02.497 INFO:teuthology.orchestra.run.smithi087.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.70422.log.gz 2024-05-08T18:36:02.497 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77682.log 2024-05-08T18:36:02.497 INFO:teuthology.orchestra.run.smithi087.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.76472.log.gz 2024-05-08T18:36:02.497 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.40777.log: /var/log/ceph/ops-log-ceph-client.0.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.48037.log.gz 2024-05-08T18:36:02.497 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75867.log 2024-05-08T18:36:02.497 INFO:teuthology.orchestra.run.smithi087.stderr: 91.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-05-08T18:36:02.497 INFO:teuthology.orchestra.run.smithi087.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92777.log.gz 2024-05-08T18:36:02.498 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.77682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65582.log 2024-05-08T18:36:02.498 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.75867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54692.log 2024-05-08T18:36:02.498 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.65582.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.40777.log.gz 2024-05-08T18:36:02.498 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52272.log 2024-05-08T18:36:02.498 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.54692.log: gzip -5 --verbose -- 91.2% -- replaced with /var/log/ceph/ceph-client.0.77682.log.gz 2024-05-08T18:36:02.498 INFO:teuthology.orchestra.run.smithi087.stderr: /var/log/ceph/ceph-client.0.58927.log 2024-05-08T18:36:02.498 INFO:teuthology.orchestra.run.smithi087.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75867.log.gz 2024-05-08T18:36:02.498 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.52272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71027.log 2024-05-08T18:36:02.498 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.58927.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-05-08T18:36:02.498 INFO:teuthology.orchestra.run.smithi087.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.65582.log.gz 2024-05-08T18:36:02.498 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.71027.log: gzip 91.4% -5 --verbose -- /var/log/ceph/ceph-client.0.55297.log 2024-05-08T18:36:02.498 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.0.54692.log.gz 2024-05-08T18:36:02.499 INFO:teuthology.orchestra.run.smithi087.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52272.log.gz 2024-05-08T18:36:02.499 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91567.log 2024-05-08T18:36:02.499 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.55297.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-08T18:36:02.499 INFO:teuthology.orchestra.run.smithi087.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.58927.log.gz/var/log/ceph/ceph-client.0.91567.log: 2024-05-08T18:36:02.499 INFO:teuthology.orchestra.run.smithi087.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.71027.log.gz 2024-05-08T18:36:02.499 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85535.log 2024-05-08T18:36:02.499 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5/var/log/ceph/ceph-osd.1.log: --verbose -- /var/log/ceph/ceph-client.0.42592.log 2024-05-08T18:36:02.499 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.85535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81312.log 2024-05-08T18:36:02.499 INFO:teuthology.orchestra.run.smithi087.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55297.log.gz 2024-05-08T18:36:02.499 INFO:teuthology.orchestra.run.smithi087.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.91567.log.gz 2024-05-08T18:36:02.499 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.42592.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.85535.log.gz 2024-05-08T18:36:02.499 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87937.log 2024-05-08T18:36:02.499 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.81312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68002.log 2024-05-08T18:36:02.500 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.87937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45012.log 2024-05-08T18:36:02.500 INFO:teuthology.orchestra.run.smithi087.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.42592.log.gz 2024-05-08T18:36:02.500 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.68002.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.87937.log.gz 2024-05-08T18:36:02.500 INFO:teuthology.orchestra.run.smithi087.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.81312.log.gz 2024-05-08T18:36:02.500 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78287.log 2024-05-08T18:36:02.500 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.45012.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-08T18:36:02.500 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.78287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50457.log 2024-05-08T18:36:02.500 INFO:teuthology.orchestra.run.smithi087.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.68002.log.gz 2024-05-08T18:36:02.500 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mgr.x.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.45012.log.gz 2024-05-08T18:36:02.500 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30509.log 2024-05-08T18:36:02.500 INFO:teuthology.orchestra.run.smithi087.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.78287.log.gz/var/log/ceph/ceph-client.0.50457.log: 2024-05-08T18:36:02.500 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35070.log 2024-05-08T18:36:02.500 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.30509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94592.log 2024-05-08T18:36:02.500 INFO:teuthology.orchestra.run.smithi087.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30509.log.gz 2024-05-08T18:36:02.501 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35070.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.35070.log.gz 2024-05-08T18:36:02.501 INFO:teuthology.orchestra.run.smithi087.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.50457.log.gz 2024-05-08T18:36:02.501 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46827.log 2024-05-08T18:36:02.501 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.94592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58322.log 2024-05-08T18:36:02.501 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.46827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62557.log 2024-05-08T18:36:02.501 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.58322.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.94592.log.gz 2024-05-08T18:36:02.501 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 91.1% -- replaced with /var/log/ceph/ceph-client.0.46827.log.gz 2024-05-08T18:36:02.501 INFO:teuthology.orchestra.run.smithi087.stderr: --verbose -- /var/log/ceph/ceph-client.0.74657.log 2024-05-08T18:36:02.501 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.62557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48642.log 2024-05-08T18:36:02.501 INFO:teuthology.orchestra.run.smithi087.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.58322.log.gz 2024-05-08T18:36:02.501 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.74657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57112.log 2024-05-08T18:36:02.501 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.48642.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.62557.log.gz 2024-05-08T18:36:02.501 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84337.log 2024-05-08T18:36:02.502 INFO:teuthology.orchestra.run.smithi087.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74657.log.gz 2024-05-08T18:36:02.502 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.57112.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.48642.log.gz 2024-05-08T18:36:02.502 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44407.log 2024-05-08T18:36:02.502 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.84337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61952.log 2024-05-08T18:36:02.502 INFO:teuthology.orchestra.run.smithi087.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.84337.log.gz 2024-05-08T18:36:02.502 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.44407.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.57112.log.gz 2024-05-08T18:36:02.502 INFO:teuthology.orchestra.run.smithi087.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44407.log.gz 2024-05-08T18:36:02.512 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79497.log 2024-05-08T18:36:02.512 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.61952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45617.log 2024-05-08T18:36:02.513 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.79497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30389.log 2024-05-08T18:36:02.513 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.45617.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.61952.log.gz 2024-05-08T18:36:02.513 INFO:teuthology.orchestra.run.smithi087.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.79497.log.gz 2024-05-08T18:36:02.513 INFO:teuthology.orchestra.run.smithi087.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.45617.log.gz 2024-05-08T18:36:02.513 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35150.log 2024-05-08T18:36:02.513 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.30389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35030.log 2024-05-08T18:36:02.513 INFO:teuthology.orchestra.run.smithi087.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.30389.log.gz 2024-05-08T18:36:02.513 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64372.log 2024-05-08T18:36:02.513 INFO:teuthology.orchestra.run.smithi087.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.35150.log.gz 2024-05-08T18:36:02.513 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73447.log 2024-05-08T18:36:02.513 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35030.log: /var/log/ceph/ceph-client.0.64372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86134.log 2024-05-08T18:36:02.513 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.73447.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.35030.log.gz 2024-05-08T18:36:02.513 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72237.log 2024-05-08T18:36:02.513 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.86134.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.86134.log.gz 2024-05-08T18:36:02.514 INFO:teuthology.orchestra.run.smithi087.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.64372.log.gz 2024-05-08T18:36:02.514 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89147.log 2024-05-08T18:36:02.514 INFO:teuthology.orchestra.run.smithi087.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.73447.log.gz 2024-05-08T18:36:02.514 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49852.log 2024-05-08T18:36:02.514 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.72237.log: /var/log/ceph/ceph-client.0.89147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88542.log 2024-05-08T18:36:02.514 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.49852.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.72237.log.gz 2024-05-08T18:36:02.514 INFO:teuthology.orchestra.run.smithi087.stderr: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43197.log 2024-05-08T18:36:02.514 INFO:teuthology.orchestra.run.smithi087.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.89147.log.gz 2024-05-08T18:36:02.514 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.0.49852.log.gz 2024-05-08T18:36:02.514 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56507.log 2024-05-08T18:36:02.514 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.88542.log: /var/log/ceph/ceph-client.0.43197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30469.log 2024-05-08T18:36:02.514 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.56507.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43197.log.gz 2024-05-08T18:36:02.514 INFO:teuthology.orchestra.run.smithi087.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.88542.log.gz 2024-05-08T18:36:02.514 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51667.log 2024-05-08T18:36:02.515 INFO:teuthology.orchestra.run.smithi087.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56507.log.gz 2024-05-08T18:36:02.515 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61347.log 2024-05-08T18:36:02.515 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.30469.log: /var/log/ceph/ceph-client.0.51667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35943.log 2024-05-08T18:36:02.515 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.61347.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.30469.log.gz 2024-05-08T18:36:02.515 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86733.log 2024-05-08T18:36:02.515 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.35943.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.51667.log.gz 2024-05-08T18:36:02.515 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90357.log 2024-05-08T18:36:02.515 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.86733.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.61347.log.gz 2024-05-08T18:36:02.515 INFO:teuthology.orchestra.run.smithi087.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.86733.log.gz 2024-05-08T18:36:02.515 INFO:teuthology.orchestra.run.smithi087.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.35943.log.gz 2024-05-08T18:36:02.515 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71632.log 2024-05-08T18:36:02.515 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.90357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52877.log 2024-05-08T18:36:02.515 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.71632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63162.log 2024-05-08T18:36:02.520 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.52877.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.90357.log.gz 2024-05-08T18:36:02.520 INFO:teuthology.orchestra.run.smithi087.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52877.log.gz 2024-05-08T18:36:02.521 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55902.log 2024-05-08T18:36:02.521 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.63162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40172.log 2024-05-08T18:36:02.521 INFO:teuthology.orchestra.run.smithi087.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.71632.log.gz 2024-05-08T18:36:02.521 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.55902.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63162.log.gz 2024-05-08T18:36:02.521 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43802.log 2024-05-08T18:36:02.521 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.40172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41382.log 2024-05-08T18:36:02.521 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.43802.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55902.log.gz 2024-05-08T18:36:02.521 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63767.log 2024-05-08T18:36:02.521 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.41382.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40172.log.gz 2024-05-08T18:36:02.521 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose 91.0% -- replaced with /var/log/ceph/ceph-client.0.43802.log.gz 2024-05-08T18:36:02.521 INFO:teuthology.orchestra.run.smithi087.stderr: -- /var/log/ceph/ceph-client.0.89752.log 2024-05-08T18:36:02.521 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.63767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37758.log 2024-05-08T18:36:02.521 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.89752.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.41382.log.gz 2024-05-08T18:36:02.521 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67397.log 2024-05-08T18:36:02.521 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.37758.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.63767.log.gz 2024-05-08T18:36:02.524 INFO:teuthology.orchestra.run.smithi087.stderr: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41987.log 2024-05-08T18:36:02.524 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.0.89752.log.gz 2024-05-08T18:36:02.524 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.67397.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37758.log.gz 2024-05-08T18:36:02.524 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35110.log 2024-05-08T18:36:02.525 INFO:teuthology.orchestra.run.smithi087.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.67397.log.gz 2024-05-08T18:36:02.525 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80707.log 2024-05-08T18:36:02.525 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.41987.log: /var/log/ceph/ceph-client.admin.35110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34990.log 2024-05-08T18:36:02.525 INFO:teuthology.orchestra.run.smithi087.stderr: 86.3%/var/log/ceph/ceph-client.0.80707.log: -- replaced with /var/log/ceph/ceph-client.admin.35110.log.gz 2024-05-08T18:36:02.526 INFO:teuthology.orchestra.run.smithi087.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.41987.log.gz 2024-05-08T18:36:02.526 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75262.log 2024-05-08T18:36:02.526 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82522.log 2024-05-08T18:36:02.526 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34990.log: /var/log/ceph/ceph-client.0.75262.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.34990.log.gz 2024-05-08T18:36:02.526 INFO:teuthology.orchestra.run.smithi087.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.80707.log.gz 2024-05-08T18:36:02.526 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90962.log 2024-05-08T18:36:02.527 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84936.log 2024-05-08T18:36:02.527 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.82522.log: /var/log/ceph/ceph-client.0.90962.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75262.log.gz 2024-05-08T18:36:02.528 INFO:teuthology.orchestra.run.smithi087.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.82522.log.gz 2024-05-08T18:36:02.529 INFO:teuthology.orchestra.run.smithi087.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.90962.log.gz 2024-05-08T18:36:02.529 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57717.log 2024-05-08T18:36:02.529 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30429.log 2024-05-08T18:36:02.529 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.84936.log: /var/log/ceph/ceph-client.0.57717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95197.log 2024-05-08T18:36:02.531 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.30429.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.30429.log.gz 2024-05-08T18:36:02.531 INFO:teuthology.orchestra.run.smithi087.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.84936.log.gz 2024-05-08T18:36:02.532 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83127.log 2024-05-08T18:36:02.532 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.95197.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.57717.log.gz 2024-05-08T18:36:02.532 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.83127.log: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-05-08T18:36:02.532 INFO:teuthology.orchestra.run.smithi087.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.95197.log.gz 2024-05-08T18:36:02.533 INFO:teuthology.orchestra.run.smithi087.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.83127.log.gz 2024-05-08T18:36:02.540 INFO:teuthology.orchestra.run.smithi087.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-08T18:36:02.596 INFO:teuthology.orchestra.run.smithi053.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-08T18:36:03.362 INFO:teuthology.orchestra.run.smithi087.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-08T18:36:03.494 INFO:teuthology.orchestra.run.smithi053.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-08T18:36:03.495 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-05-08T18:36:03.495 INFO:teuthology.orchestra.run.smithi053.stderr:real 0m1.095s 2024-05-08T18:36:03.495 INFO:teuthology.orchestra.run.smithi053.stderr:user 0m1.240s 2024-05-08T18:36:03.496 INFO:teuthology.orchestra.run.smithi053.stderr:sys 0m0.078s 2024-05-08T18:36:03.554 INFO:teuthology.orchestra.run.smithi087.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-08T18:36:03.559 INFO:teuthology.orchestra.run.smithi087.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-08T18:36:03.561 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-05-08T18:36:03.561 INFO:teuthology.orchestra.run.smithi087.stderr:real 0m1.111s 2024-05-08T18:36:03.561 INFO:teuthology.orchestra.run.smithi087.stderr:user 0m3.194s 2024-05-08T18:36:03.561 INFO:teuthology.orchestra.run.smithi087.stderr:sys 0m0.223s 2024-05-08T18:36:03.561 INFO:tasks.ceph:Archiving logs... 2024-05-08T18:36:03.561 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/log/ceph to /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697913/remote/smithi053/log 2024-05-08T18:36:03.562 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T18:36:03.827 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697913/remote/smithi087/log 2024-05-08T18:36:03.828 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T18:36:04.433 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T18:36:04.443 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T18:36:04.443 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T18:36:04.446 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T18:36:04.518 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T18:36:04.527 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T18:36:04.527 DEBUG:teuthology.orchestra.run.smithi053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:36:04.530 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:36:04.545 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-05-08T18:36:04.545 INFO:teuthology.orchestra.run.smithi053.stderr:bash: line 1: ntpq: command not found 2024-05-08T18:36:04.548 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T18:36:04.548 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-05-08T18:36:04.549 INFO:teuthology.orchestra.run.smithi087.stdout:^* hv01.front.sepia.ceph.com 3 6 377 37 -1692us[-1674us] +/- 55ms 2024-05-08T18:36:04.549 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 35 +1642us[+1642us] +/- 56ms 2024-05-08T18:36:04.549 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +245us[ +245us] +/- 74ms 2024-05-08T18:36:04.549 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:36:04.550 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T18:36:04.550 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2024-05-08T18:36:04.550 INFO:teuthology.orchestra.run.smithi053.stdout:^* hv01.front.sepia.ceph.com 3 6 377 34 -1682us[-1674us] +/- 55ms 2024-05-08T18:36:04.550 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 35 +1645us[+1652us] +/- 56ms 2024-05-08T18:36:04.551 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +288us[ +295us] +/- 74ms 2024-05-08T18:36:04.551 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:36:04.551 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T18:36:04.560 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T18:36:04.561 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T18:36:04.593 DEBUG:teuthology.orchestra.run.smithi053:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T18:36:04.662 DEBUG:teuthology.orchestra.run.smithi087:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T18:36:04.721 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T18:36:04.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:36:04.751 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T18:36:04.778 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:36:04.779 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T18:36:04.788 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T18:36:04.810 INFO:teuthology.task.internal:Duration was 739.814152 seconds 2024-05-08T18:36:04.811 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T18:36:04.852 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T18:36:04.852 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T18:36:04.855 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T18:36:04.894 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T18:36:04.896 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T18:36:05.090 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T18:36:05.090 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi053.front.sepia.ceph.com 2024-05-08T18:36:05.090 DEBUG:teuthology.orchestra.run.smithi053:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T18:36:05.113 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-05-08T18:36:05.114 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T18:36:05.138 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T18:36:05.138 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T18:36:05.156 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T18:36:05.204 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T18:36:05.204 DEBUG:teuthology.orchestra.run.smithi053:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T18:36:05.225 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T18:36:05.339 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T18:36:05.349 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T18:36:05.349 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T18:36:05.375 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T18:36:05.400 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T18:36:05.410 DEBUG:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:36:05.417 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:36:05.438 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = core 2024-05-08T18:36:05.463 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-05-08T18:36:05.485 DEBUG:teuthology.orchestra.run.smithi053:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:36:05.525 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:36:05.526 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:36:05.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:36:05.540 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T18:36:05.551 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T18:36:05.552 DEBUG:teuthology.misc:Transferring archived files from smithi053:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697913/remote/smithi053 2024-05-08T18:36:05.552 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T18:36:05.600 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697913/remote/smithi087 2024-05-08T18:36:05.600 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T18:36:05.632 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T18:36:05.632 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T18:36:05.637 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T18:36:05.684 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T18:36:05.695 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T18:36:05.695 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T18:36:05.719 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T18:36:05.720 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T18:36:05.722 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T18:36:05.735 INFO:teuthology.orchestra.run.smithi053.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 18:36 /home/ubuntu/cephtest 2024-05-08T18:36:05.738 INFO:teuthology.orchestra.run.smithi087.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 18:36 /home/ubuntu/cephtest 2024-05-08T18:36:05.740 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T18:36:05.762 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T18:36:05.847 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} duration: 739.8141515254974 flavor: default owner: scheduled_ivancich@teuthology success: true 2024-05-08T18:36:05.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T18:36:05.923 INFO:teuthology.run:pass